make -C tools/testing/selftests TARGETS=net/forwarding TEST_PROGS=tc_actioons.sh TEST_GEN_PROGS="" run_tests make: Entering directory '/home/virtme/testing-4/tools/testing/selftests' make[1]: Entering directory '/home/virtme/testing-4/tools/testing/selftests/net/forwarding' make[1]: Nothing to be done for 'all'. make[1]: Leaving directory '/home/virtme/testing-4/tools/testing/selftests/net/forwarding' make[1]: Entering directory '/home/virtme/testing-4/tools/testing/selftests/net/forwarding' TAP version 13 1..1 # timeout set to 10800 # selftests: net/forwarding: tc_actions.sh # TEST: gact drop and ok (skip_hw) [ OK ] # TEST: mirred egress flower redirect (skip_hw) [ OK ] # TEST: mirred egress flower mirror (skip_hw) [ OK ] # TEST: mirred egress matchall mirror (skip_hw) [ OK ] [ 1186.334516][ T3596] ping (3596) used greatest stack depth: 23352 bytes left # TEST: mirred_egress_to_ingress (skip_hw) [ OK ] # [ 1192.237633][ C2] [ 1192.237802][ C2] ============================================ [ 1192.238136][ C2] WARNING: possible recursive locking detected [ 1192.238485][ C2] 6.8.0-rc2-virtme #1 Not tainted [ 1192.238767][ C2] -------------------------------------------- [ 1192.239098][ C2] ksoftirqd/2/27 is trying to acquire lock: [ 1192.239416][ C2] ffff88800a099b70 (slock-AF_INET/1){+.-.}-{2:2}, at: tcp_v4_rcv+0x2159/0x29b0 [ 1192.239911][ C2] [ 1192.239911][ C2] but task is already holding lock: [ 1192.240320][ C2] ffff88800a098e30 (slock-AF_INET/1){+.-.}-{2:2}, at: tcp_v4_rcv+0x2159/0x29b0 [ 1192.240803][ C2] [ 1192.240803][ C2] other info that might help us debug this: [ 1192.241237][ C2] Possible unsafe locking scenario: [ 1192.241237][ C2] [ 1192.241632][ C2] CPU0 [ 1192.241819][ C2] ---- [ 1192.241997][ C2] lock(slock-AF_INET/1); [ 1192.242255][ C2] lock(slock-AF_INET/1); [ 1192.242505][ C2] [ 1192.242505][ C2] *** DEADLOCK *** [ 1192.242505][ C2] [ 1192.242950][ C2] May be due to missing lock nesting notation [ 1192.242950][ C2] [ 1192.243391][ C2] 8 locks held by ksoftirqd/2/27: [ 1192.243662][ C2] #0: ffffffff91f447e0 (rcu_read_lock){....}-{1:2}, at: process_backlog+0x1ed/0x5e0 [ 1192.244176][ C2] #1: ffffffff91f447e0 (rcu_read_lock){....}-{1:2}, at: ip_local_deliver_finish+0x1f5/0x450 [ 1192.244727][ C2] #2: ffff88800a098e30 (slock-AF_INET/1){+.-.}-{2:2}, at: tcp_v4_rcv+0x2159/0x29b0 [ 1192.245239][ C2] #3: ffffffff91f447e0 (rcu_read_lock){....}-{1:2}, at: __ip_queue_xmit+0x65/0x1910 [ 1192.245752][ C2] #4: ffffffff91f447e0 (rcu_read_lock){....}-{1:2}, at: ip_finish_output2+0x262/0x18e0 [ 1192.246277][ C2] #5: ffffffff91f44780 (rcu_read_lock_bh){....}-{1:2}, at: __dev_queue_xmit+0x1c1/0x1ca0 [ 1192.246807][ C2] #6: ffffffff91f447e0 (rcu_read_lock){....}-{1:2}, at: netif_receive_skb_internal+0x84/0x300 [ 1192.247367][ C2] #7: ffffffff91f447e0 (rcu_read_lock){....}-{1:2}, at: ip_local_deliver_finish+0x1f5/0x450 [ 1192.247908][ C2] [ 1192.247908][ C2] stack backtrace: [ 1192.248245][ C2] CPU: 2 PID: 27 Comm: ksoftirqd/2 Not tainted 6.8.0-rc2-virtme #1 [ 1192.248673][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1192.249332][ C2] Call Trace: [ 1192.249518][ C2] [ 1192.249700][ C2] dump_stack_lvl+0x64/0xb0 [ 1192.249952][ C2] validate_chain+0x525/0xa00 [ 1192.250225][ C2] ? __pfx_validate_chain+0x10/0x10 [ 1192.250513][ C2] ? hlock_class+0x4e/0x130 [ 1192.250770][ C2] ? mark_lock+0x38/0x3e0 [ 1192.251019][ C2] __lock_acquire+0xb67/0x1610 [ 1192.251277][ C2] ? lock_downgrade+0xa0/0x110 [ 1192.251541][ C2] ? mark_lock+0x38/0x3e0 [ 1192.251789][ C2] lock_acquire.part.0+0xe5/0x330 [ 1192.252062][ C2] ? tcp_v4_rcv+0x2159/0x29b0 [ 1192.252317][ C2] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1192.252629][ C2] ? __pfx_sk_filter_trim_cap+0x10/0x10 [ 1192.252937][ C2] ? lock_acquire+0x1c1/0x220 [ 1192.253190][ C2] ? tcp_v4_rcv+0x2159/0x29b0 [ 1192.253445][ C2] _raw_spin_lock_nested+0x33/0x80 [ 1192.253726][ C2] ? tcp_v4_rcv+0x2159/0x29b0 [ 1192.253988][ C2] tcp_v4_rcv+0x2159/0x29b0 [ 1192.254242][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1192.254514][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 1192.254789][ C2] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1192.255112][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 1192.255423][ C2] ip_local_deliver_finish+0x2ae/0x450 [ 1192.255722][ C2] ip_local_deliver+0x19d/0x480 [ 1192.255995][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 1192.256288][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1192.256627][ C2] ip_rcv+0x564/0x740 [ 1192.256856][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 1192.257103][ C2] ? lock_acquire.part.0+0xe5/0x330 [ 1192.257387][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 1192.257695][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 1192.257940][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 1192.258256][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1192.258621][ C2] ? mark_held_locks+0xa5/0xf0 [ 1192.258884][ C2] ? lock_acquire+0x1c1/0x220 [ 1192.259135][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 1192.259465][ C2] netif_receive_skb_internal+0xb0/0x300 [ 1192.259769][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1192.260107][ C2] ? __copy_skb_header+0xaf/0x490 [ 1192.260405][ C2] ? __skb_clone+0x57a/0x760 [ 1192.260655][ C2] netif_receive_skb+0x55/0x280 [ 1192.260919][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1192.261263][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1192.261616][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1192.261952][ C2] tcf_action_exec.part.0+0x115/0x3d0 [ 1192.262245][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 1192.262556][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1192.262892][ C2] ? __pfx_usage_match+0x10/0x10 [ 1192.263159][ C2] ? check_irq_usage+0x27e/0x850 [ 1192.263433][ C2] ? __pfx_check_irq_usage+0x10/0x10 [ 1192.263730][ C2] ? __bfs+0x24a/0x650 [ 1192.263955][ C2] ? __pfx_hlock_conflict+0x10/0x10 [ 1192.264231][ C2] ? __pfx_validate_chain+0x10/0x10 [ 1192.264533][ C2] ? hlock_class+0x4e/0x130 [ 1192.264792][ C2] ? check_path.constprop.0+0x24/0x50 [ 1192.265086][ C2] ? check_noncircular+0x14e/0x3e0 [ 1192.265374][ C2] ? __pfx_check_noncircular+0x10/0x10 [ 1192.265675][ C2] __tcf_classify+0x32c/0x7d0 [ 1192.265942][ C2] tcf_classify+0x283/0x930 [ 1192.266196][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 1192.266477][ C2] ? lock_acquire.part.0+0xe5/0x330 [ 1192.266753][ C2] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1192.267036][ C2] tc_run+0x2e4/0x5d0 [ 1192.267273][ C2] ? __pfx_tc_run+0x10/0x10 [ 1192.267527][ C2] ? lock_acquire+0x1c1/0x220 [ 1192.267790][ C2] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1192.268071][ C2] __dev_queue_xmit+0x8eb/0x1ca0 [ 1192.268348][ C2] ? hlock_class+0x4e/0x130 [ 1192.268600][ C2] ? mark_lock+0x38/0x3e0 [ 1192.268848][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1192.269146][ C2] ? lockdep_hardirqs_on_prepare.part.0+0x151/0x370 [ 1192.269508][ C2] ? neigh_hh_output+0x348/0x590 [ 1192.269780][ C2] ip_finish_output2+0x786/0x18e0 [ 1192.270074][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 1192.270365][ C2] ? __ip_finish_output+0x3dd/0x770 [ 1192.270646][ C2] ip_output+0x16b/0x4f0 [ 1192.270872][ C2] ? tcp_clean_rtx_queue.constprop.0+0x9ae/0x2bd0 [ 1192.271225][ C2] ? __pfx_ip_output+0x10/0x10 [ 1192.271494][ C2] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1192.271793][ C2] ? ip_local_out+0x114/0x3b0 [ 1192.272059][ C2] __ip_queue_xmit+0x672/0x1910 [ 1192.272335][ C2] ? __skb_clone+0x57a/0x760 [ 1192.272593][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 1192.272875][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1192.273186][ C2] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1192.273511][ C2] tcp_write_xmit+0xe42/0x24c0 [ 1192.273780][ C2] ? ipv4_mtu+0x37/0x360 [ 1192.274018][ C2] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1192.274302][ C2] ? __pfx_tcp_current_mss+0x10/0x10 [ 1192.274581][ C2] __tcp_push_pending_frames+0x96/0x320 [ 1192.274879][ C2] tcp_rcv_state_process+0x81e/0x1fd0 [ 1192.275178][ C2] ? tcp_v4_rcv+0x2159/0x29b0 [ 1192.275435][ C2] ? hlock_class+0x4e/0x130 [ 1192.275690][ C2] ? __lock_acquired+0x18a/0x6b0 [ 1192.275959][ C2] ? __pfx_tcp_rcv_state_process+0x10/0x10 [ 1192.276276][ C2] ? __pfx___lock_acquired+0x10/0x10 [ 1192.276579][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1192.276891][ C2] tcp_v4_do_rcv+0x154/0x850 [ 1192.277151][ C2] tcp_v4_rcv+0x235a/0x29b0 [ 1192.277396][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1192.277657][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 1192.277935][ C2] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1192.278240][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 1192.278525][ C2] ip_local_deliver_finish+0x2ae/0x450 [ 1192.278824][ C2] ip_local_deliver+0x19d/0x480 [ 1192.279090][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 1192.279378][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1192.279726][ C2] ip_rcv+0x564/0x740 [ 1192.279946][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 1192.280211][ C2] ? lock_acquire.part.0+0xe5/0x330 [ 1192.280489][ C2] ? process_backlog+0x1ed/0x5e0 [ 1192.280755][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 1192.281001][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 1192.281335][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1192.281694][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1192.282000][ C2] ? lock_acquire+0x1c1/0x220 [ 1192.282255][ C2] ? process_backlog+0x1ed/0x5e0 [ 1192.282538][ C2] process_backlog+0xd3/0x5e0 [ 1192.282787][ C2] __napi_poll.constprop.0+0xa5/0x450 [ 1192.283077][ C2] net_rx_action+0x440/0xb40 [ 1192.283328][ C2] ? __pfx_net_rx_action+0x10/0x10 [ 1192.283609][ C2] ? __pfx___schedule+0x10/0x10 [ 1192.283879][ C2] ? __pfx___lock_release+0x10/0x10 [ 1192.284165][ C2] __do_softirq+0x1bc/0x7ff [ 1192.284409][ C2] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1192.284688][ C2] run_ksoftirqd+0x2e/0x60 [ 1192.284935][ C2] smpboot_thread_fn+0x30e/0x840 [ 1192.285210][ C2] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1192.285518][ C2] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1192.285817][ C2] kthread+0x292/0x360 [ 1192.286035][ C2] ? __pfx_kthread+0x10/0x10 [ 1192.286277][ C2] ret_from_fork+0x34/0x70 [ 1192.286522][ C2] ? __pfx_kthread+0x10/0x10 [ 1192.286781][ C2] ret_from_fork_asm+0x1b/0x30 [ 1192.287044][ C2] [ 1216.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 26s! [swapper/0:0] [ 1216.527919][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1216.529117][ C0] irq event stamp: 27567077 [ 1216.529355][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 1216.529887][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 1216.530373][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 1216.530877][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 1216.531371][ C0] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 6.8.0-rc2-virtme #1 [ 1216.531774][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1216.532419][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1216.532760][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1216.533779][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1216.534104][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1216.534524][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1216.534940][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1216.535360][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1216.535777][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1216.536195][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1216.536665][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1216.537016][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1216.537434][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1216.537855][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1216.538280][ C0] Call Trace: [ 1216.538467][ C0] [ 1216.538624][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1216.538900][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1216.539157][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1216.539445][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1216.539738][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1216.540052][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1216.540331][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1216.540650][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1216.540926][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1216.541202][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1216.541528][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1216.541846][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1216.542177][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1216.542485][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1216.542796][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1216.543099][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1216.543425][ C0] ? get_stack_info+0x36/0xc0 [ 1216.543683][ C0] ? lock_acquire+0x1c1/0x220 [ 1216.543942][ C0] ? lock_release+0x1d5/0x250 [ 1216.544199][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1216.544465][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1216.544754][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1216.545056][ C0] ? lock_acquire+0x1c1/0x220 [ 1216.545303][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1216.545554][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1216.545825][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1216.546077][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1216.546339][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1216.546611][ C0] ? __inet_lookup_established+0x341/0x610 [ 1216.546927][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1216.547221][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1216.547512][ C0] ip_local_deliver+0x19d/0x480 [ 1216.547775][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1216.548064][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1216.548330][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1216.548606][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1216.548870][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1216.549210][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1216.549496][ C0] ip_rcv+0x564/0x740 [ 1216.549707][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1216.549953][ C0] ? set_track_prepare+0x8a/0xd0 [ 1216.550220][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1216.550508][ C0] ? rest_init+0x153/0x260 [ 1216.550752][ C0] ? skb_clone+0x10b/0x330 [ 1216.550993][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1216.551334][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1216.551655][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1216.551949][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1216.552261][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1216.552517][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1216.552756][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1216.553073][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1216.553370][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1216.553712][ C0] ? lock_acquire+0x1c1/0x220 [ 1216.553963][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1216.554278][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1216.554575][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1216.554909][ C0] ? __copy_skb_header+0xaf/0x490 [ 1216.555181][ C0] ? __skb_clone+0x57a/0x760 [ 1216.555437][ C0] netif_receive_skb+0x55/0x280 [ 1216.555702][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1216.556044][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1216.556391][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1216.556706][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1216.556991][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1216.557289][ C0] ? hlock_class+0x4e/0x130 [ 1216.557533][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1216.557861][ C0] ? place_entity+0x21/0x2f0 [ 1216.558113][ C0] ? resched_curr+0x219/0x280 [ 1216.558370][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1216.558640][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1216.558924][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1216.559201][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1216.559458][ C0] ? activate_task+0xf5/0x260 [ 1216.559706][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1216.559988][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1216.560261][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1216.560524][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1216.560819][ C0] ? get_stack_info+0x36/0xc0 [ 1216.561077][ C0] ? stack_access_ok+0xda/0x1f0 [ 1216.561335][ C0] ? get_reg+0x119/0x190 [ 1216.561561][ C0] __tcf_classify+0x32c/0x7d0 [ 1216.561816][ C0] tcf_classify+0x283/0x930 [ 1216.562062][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1216.562393][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1216.562659][ C0] ? arch_stack_walk+0x8c/0x100 [ 1216.562919][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1216.563211][ C0] tc_run+0x2e4/0x5d0 [ 1216.563427][ C0] ? __pfx_tc_run+0x10/0x10 [ 1216.563671][ C0] ? lock_acquire+0x1c1/0x220 [ 1216.563922][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1216.564201][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1216.564466][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1216.564754][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1216.565037][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1216.565356][ C0] ? neigh_hh_output+0x348/0x590 [ 1216.565621][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1216.565902][ C0] ip_finish_output2+0x786/0x18e0 [ 1216.566176][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1216.566468][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1216.566820][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1216.567112][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1216.567379][ C0] ? __ip_finish_output+0x10f/0x770 [ 1216.567654][ C0] ip_output+0x16b/0x4f0 [ 1216.567879][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1216.568166][ C0] ? __pfx_ip_output+0x10/0x10 [ 1216.568421][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1216.568724][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1216.568987][ C0] ? ip_local_out+0x114/0x3b0 [ 1216.569242][ C0] __ip_queue_xmit+0x672/0x1910 [ 1216.569504][ C0] ? __skb_clone+0x57a/0x760 [ 1216.569753][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1216.570039][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1216.570335][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1216.570657][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1216.570913][ C0] ? tcp_current_mss+0x40a/0x510 [ 1216.571179][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1216.571456][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1216.571734][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1216.571990][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1216.572258][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1216.572573][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1216.572853][ C0] ? ktime_get+0xb6/0x190 [ 1216.573088][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1216.573367][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1216.573645][ C0] tcp_write_timer+0x82/0x1d0 [ 1216.573898][ C0] call_timer_fn+0x176/0x430 [ 1216.574149][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1216.574422][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1216.574697][ C0] __run_timers.part.0+0x52d/0x890 [ 1216.574968][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1216.575254][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1216.575551][ C0] ? lock_acquire+0x1c1/0x220 [ 1216.575806][ C0] ? clockevents_program_event+0xf6/0x300 [ 1216.576117][ C0] ? lock_release+0x1d5/0x250 [ 1216.576376][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1216.576658][ C0] ? ktime_get+0xb6/0x190 [ 1216.576893][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1216.577196][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1216.577505][ C0] run_timer_softirq+0x72/0x100 [ 1216.577766][ C0] __do_softirq+0x1bc/0x7ff [ 1216.578013][ C0] irq_exit_rcu+0x98/0xc0 [ 1216.578247][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1216.578550][ C0] [ 1216.578707][ C0] [ 1216.578864][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1216.579187][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1216.579458][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1216.580485][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1216.580813][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1216.581230][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1216.581647][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1216.582065][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1216.582480][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1216.582896][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1216.583198][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1216.583469][ C0] default_idle_call+0x69/0xa0 [ 1216.583723][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1216.583985][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1216.584284][ C0] ? lock_release+0x1d5/0x250 [ 1216.584535][ C0] do_idle+0xfb/0x160 [ 1216.584747][ C0] cpu_startup_entry+0x55/0x60 [ 1216.584997][ C0] rest_init+0x153/0x260 [ 1216.585228][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1216.585515][ C0] arch_call_rest_init+0x13/0x40 [ 1216.585780][ C0] start_kernel+0x314/0x3d0 [ 1216.586036][ C0] x86_64_start_reservations+0x18/0x30 [ 1216.586328][ C0] x86_64_start_kernel+0xba/0x110 [ 1216.586595][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1216.586919][ C0] [ 1216.587083][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 26s! [ksoftirqd/1:22] [ 1216.587557][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1216.588775][ C1] irq event stamp: 3886976 [ 1216.589012][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 1216.589518][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 1216.590025][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 1216.590524][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 1216.591022][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1216.591516][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1216.592162][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1216.592503][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1216.593526][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1216.593852][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1216.594273][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1216.594695][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1216.595115][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1216.595533][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1216.595951][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1216.596417][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1216.596768][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1216.597187][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1216.597607][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1216.598031][ C1] Call Trace: [ 1216.598217][ C1] [ 1216.598375][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1216.598650][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1216.598907][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1216.599196][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1216.599486][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1216.599794][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1216.600083][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1216.600403][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1216.600681][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1216.601004][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1216.601313][ C1] [ 1216.601472][ C1] [ 1216.601631][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1216.601970][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1216.602272][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1216.602579][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1216.602886][ C1] ? run_ksoftirqd+0xb/0x60 [ 1216.603133][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1216.603462][ C1] ? __orc_find+0x9c/0xf0 [ 1216.603691][ C1] ? lock_acquire+0x1c1/0x220 [ 1216.603943][ C1] ? irqentry_enter+0x2b/0x60 [ 1216.604195][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1216.604455][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1216.604740][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1216.605037][ C1] ? lock_acquire+0x1c1/0x220 [ 1216.605288][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1216.605543][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1216.605818][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1216.606064][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1216.606322][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1216.606593][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1216.606879][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1216.607168][ C1] ip_local_deliver+0x19d/0x480 [ 1216.607432][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1216.607721][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1216.607988][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1216.608269][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1216.608531][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1216.608870][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1216.609145][ C1] ip_rcv+0x564/0x740 [ 1216.609358][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1216.609603][ C1] ? set_track_prepare+0x8a/0xd0 [ 1216.609867][ C1] ? irqentry_enter+0x2b/0x60 [ 1216.610124][ C1] ? irqentry_enter+0x2b/0x60 [ 1216.610374][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1216.610613][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1216.610925][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1216.611262][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1216.611569][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1216.611911][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1216.612212][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1216.612542][ C1] netif_receive_skb+0x55/0x280 [ 1216.612802][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1216.613132][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1216.613480][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1216.613796][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1216.614086][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1216.614389][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1216.614716][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1216.614993][ C1] ? arch_stack_walk+0x68/0x100 [ 1216.615257][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1216.615537][ C1] ? irqentry_enter+0x2b/0x60 [ 1216.615788][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1216.616113][ C1] ? irqentry_enter+0x2b/0x60 [ 1216.616363][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1216.616683][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1216.616969][ C1] ? arch_stack_walk+0x68/0x100 [ 1216.617229][ C1] __tcf_classify+0x32c/0x7d0 [ 1216.617481][ C1] tcf_classify+0x283/0x930 [ 1216.617722][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1216.617990][ C1] tc_run+0x2e4/0x5d0 [ 1216.618206][ C1] ? __pfx_tc_run+0x10/0x10 [ 1216.618448][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1216.618715][ C1] ? irqentry_enter+0x2b/0x60 [ 1216.618968][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1216.619255][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1216.619581][ C1] ip_finish_output2+0x786/0x18e0 [ 1216.619851][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1216.620157][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1216.620421][ C1] ? __ip_finish_output+0x10f/0x770 [ 1216.620700][ C1] ip_output+0x16b/0x4f0 [ 1216.620931][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1216.621250][ C1] ? __pfx_ip_output+0x10/0x10 [ 1216.621509][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1216.621859][ C1] ? __pfx_ip_output+0x10/0x10 [ 1216.622113][ C1] __ip_queue_xmit+0x672/0x1910 [ 1216.622379][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1216.622663][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1216.622963][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1216.623254][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1216.623551][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1216.623837][ C1] tcp_delack_timer+0x84/0x240 [ 1216.624094][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1216.624376][ C1] call_timer_fn+0x176/0x430 [ 1216.624627][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1216.624904][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1216.625179][ C1] __run_timers.part.0+0x52d/0x890 [ 1216.625449][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1216.625739][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1216.626046][ C1] ? __pfx___schedule+0x10/0x10 [ 1216.626305][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1216.626623][ C1] run_timer_softirq+0x72/0x100 [ 1216.626885][ C1] __do_softirq+0x1bc/0x7ff [ 1216.627131][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1216.627407][ C1] run_ksoftirqd+0x2e/0x60 [ 1216.627645][ C1] smpboot_thread_fn+0x30e/0x840 [ 1216.627914][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1216.628205][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1216.628496][ C1] kthread+0x292/0x360 [ 1216.628712][ C1] ? __pfx_kthread+0x10/0x10 [ 1216.628959][ C1] ret_from_fork+0x34/0x70 [ 1216.629196][ C1] ? __pfx_kthread+0x10/0x10 [ 1216.629443][ C1] ret_from_fork_asm+0x1b/0x30 [ 1216.629704][ C1] [ 1220.309024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 1220.309420][ C0] rcu: 0-....: (27886 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=6354 [ 1220.309930][ C0] rcu: (t=26000 jiffies g=1007429 q=21 ncpus=4) [ 1220.310274][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1220.310753][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1220.311407][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1220.311754][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1220.312782][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1220.313111][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1220.313535][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1220.313977][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1220.314401][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1220.314819][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1220.315238][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1220.315709][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1220.316057][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1220.316477][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1220.316893][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1220.317313][ C0] Call Trace: [ 1220.317493][ C0] [ 1220.317650][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 1220.317941][ C0] ? print_cpu_stall+0x263/0x6a0 [ 1220.318205][ C0] ? check_cpu_stall+0x284/0x500 [ 1220.318469][ C0] ? rcu_pending+0x92/0x360 [ 1220.318707][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 1220.318988][ C0] ? update_process_times+0xb9/0x110 [ 1220.319274][ C0] ? tick_sched_handle+0x67/0x130 [ 1220.319541][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 1220.319838][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1220.320099][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 1220.320428][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1220.320712][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1220.321012][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1220.321289][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1220.321608][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1220.321884][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1220.322158][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1220.322482][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1220.322800][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1220.323133][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1220.323438][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1220.323752][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1220.324054][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1220.324384][ C0] ? get_stack_info+0x36/0xc0 [ 1220.324639][ C0] ? lock_acquire+0x1c1/0x220 [ 1220.324893][ C0] ? lock_release+0x1d5/0x250 [ 1220.325149][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1220.325410][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1220.325697][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1220.325998][ C0] ? lock_acquire+0x1c1/0x220 [ 1220.326249][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1220.326503][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1220.326773][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1220.327022][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1220.327283][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1220.327557][ C0] ? __inet_lookup_established+0x341/0x610 [ 1220.327870][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1220.328161][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1220.328448][ C0] ip_local_deliver+0x19d/0x480 [ 1220.328710][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1220.328998][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1220.329268][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1220.329546][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1220.329809][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1220.330152][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1220.330430][ C0] ip_rcv+0x564/0x740 [ 1220.330650][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1220.330894][ C0] ? set_track_prepare+0x8a/0xd0 [ 1220.331165][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1220.331453][ C0] ? rest_init+0x153/0x260 [ 1220.331693][ C0] ? skb_clone+0x10b/0x330 [ 1220.331931][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1220.332270][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1220.332595][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1220.332888][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1220.333197][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1220.333456][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1220.333698][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1220.334010][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1220.334308][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1220.334652][ C0] ? lock_acquire+0x1c1/0x220 [ 1220.334906][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1220.335219][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1220.335516][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1220.335854][ C0] ? __copy_skb_header+0xaf/0x490 [ 1220.336125][ C0] ? __skb_clone+0x57a/0x760 [ 1220.336375][ C0] netif_receive_skb+0x55/0x280 [ 1220.336633][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1220.336960][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1220.337306][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1220.337623][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1220.337910][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1220.338211][ C0] ? hlock_class+0x4e/0x130 [ 1220.338456][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1220.338782][ C0] ? place_entity+0x21/0x2f0 [ 1220.339026][ C0] ? resched_curr+0x219/0x280 [ 1220.339279][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1220.339552][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1220.339836][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1220.340123][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1220.340383][ C0] ? activate_task+0xf5/0x260 [ 1220.340639][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1220.340916][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1220.341188][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1220.341451][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1220.341744][ C0] ? get_stack_info+0x36/0xc0 [ 1220.341992][ C0] ? stack_access_ok+0xda/0x1f0 [ 1220.342247][ C0] ? get_reg+0x119/0x190 [ 1220.342473][ C0] __tcf_classify+0x32c/0x7d0 [ 1220.342729][ C0] tcf_classify+0x283/0x930 [ 1220.342973][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1220.343302][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1220.343567][ C0] ? arch_stack_walk+0x8c/0x100 [ 1220.343825][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1220.344123][ C0] tc_run+0x2e4/0x5d0 [ 1220.344348][ C0] ? __pfx_tc_run+0x10/0x10 [ 1220.344592][ C0] ? lock_acquire+0x1c1/0x220 [ 1220.344844][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1220.345122][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1220.345383][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1220.345671][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1220.345951][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1220.346274][ C0] ? neigh_hh_output+0x348/0x590 [ 1220.346537][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1220.346815][ C0] ip_finish_output2+0x786/0x18e0 [ 1220.347085][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1220.347379][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1220.347729][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1220.348014][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1220.348282][ C0] ? __ip_finish_output+0x10f/0x770 [ 1220.348557][ C0] ip_output+0x16b/0x4f0 [ 1220.348781][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1220.349065][ C0] ? __pfx_ip_output+0x10/0x10 [ 1220.349319][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1220.349618][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1220.349880][ C0] ? ip_local_out+0x114/0x3b0 [ 1220.350139][ C0] __ip_queue_xmit+0x672/0x1910 [ 1220.350398][ C0] ? __skb_clone+0x57a/0x760 [ 1220.350645][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1220.350927][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1220.351227][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1220.351544][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1220.351798][ C0] ? tcp_current_mss+0x40a/0x510 [ 1220.352065][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1220.352345][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1220.352623][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1220.352881][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1220.353148][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1220.353466][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1220.353745][ C0] ? ktime_get+0xb6/0x190 [ 1220.353986][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1220.354262][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1220.354542][ C0] tcp_write_timer+0x82/0x1d0 [ 1220.354796][ C0] call_timer_fn+0x176/0x430 [ 1220.355049][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1220.355323][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1220.355598][ C0] __run_timers.part.0+0x52d/0x890 [ 1220.355869][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1220.356153][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1220.356450][ C0] ? lock_acquire+0x1c1/0x220 [ 1220.356703][ C0] ? clockevents_program_event+0xf6/0x300 [ 1220.357009][ C0] ? lock_release+0x1d5/0x250 [ 1220.357261][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1220.357539][ C0] ? ktime_get+0xb6/0x190 [ 1220.357771][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1220.358072][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1220.358381][ C0] run_timer_softirq+0x72/0x100 [ 1220.358644][ C0] __do_softirq+0x1bc/0x7ff [ 1220.358891][ C0] irq_exit_rcu+0x98/0xc0 [ 1220.359126][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1220.359428][ C0] [ 1220.359583][ C0] [ 1220.359742][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1220.360066][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1220.360333][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1220.361343][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1220.361661][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1220.362076][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1220.362490][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1220.362904][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1220.363318][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1220.363735][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1220.364036][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1220.364311][ C0] default_idle_call+0x69/0xa0 [ 1220.364567][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1220.364828][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1220.365121][ C0] ? lock_release+0x1d5/0x250 [ 1220.365368][ C0] do_idle+0xfb/0x160 [ 1220.365580][ C0] cpu_startup_entry+0x55/0x60 [ 1220.365834][ C0] rest_init+0x153/0x260 [ 1220.366062][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1220.366345][ C0] arch_call_rest_init+0x13/0x40 [ 1220.366608][ C0] start_kernel+0x314/0x3d0 [ 1220.366853][ C0] x86_64_start_reservations+0x18/0x30 [ 1220.367148][ C0] x86_64_start_kernel+0xba/0x110 [ 1220.367413][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1220.367738][ C0] [ 1220.367914][ C0] Sending NMI from CPU 0 to CPUs 1: [ 1220.368214][ C1] NMI backtrace for cpu 1 [ 1220.368220][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1220.368224][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1220.368227][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 1220.368233][ C1] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 1220.368235][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [ 1220.368239][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1220.368241][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1220.368243][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1220.368245][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1220.368246][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1220.368247][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1220.368249][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1220.368252][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1220.368254][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1220.368255][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1220.368256][ C1] Call Trace: [ 1220.368260][ C1] [ 1220.368261][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 1220.368268][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 1220.368273][ C1] ? nmi_handle+0x156/0x420 [ 1220.368278][ C1] ? default_do_nmi+0x41/0x100 [ 1220.368281][ C1] ? exc_nmi+0xf3/0x120 [ 1220.368284][ C1] ? end_repeat_nmi+0xf/0x60 [ 1220.368288][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1220.368292][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 1220.368294][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 1220.368297][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 1220.368300][ C1] [ 1220.368300][ C1] [ 1220.368302][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 1220.368305][ C1] ? run_ksoftirqd+0xb/0x60 [ 1220.368308][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1220.368311][ C1] ? __orc_find+0x9c/0xf0 [ 1220.368314][ C1] ? lock_acquire+0x1c1/0x220 [ 1220.368318][ C1] ? irqentry_enter+0x2b/0x60 [ 1220.368322][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1220.368326][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1220.368329][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1220.368332][ C1] ? lock_acquire+0x1c1/0x220 [ 1220.368334][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1220.368339][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1220.368342][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1220.368349][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1220.368352][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1220.368358][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1220.368364][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1220.368367][ C1] ip_local_deliver+0x19d/0x480 [ 1220.368370][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1220.368373][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1220.368376][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1220.368380][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1220.368383][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1220.368386][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1220.368395][ C1] ip_rcv+0x564/0x740 [ 1220.368398][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1220.368401][ C1] ? set_track_prepare+0x8a/0xd0 [ 1220.368406][ C1] ? irqentry_enter+0x2b/0x60 [ 1220.368409][ C1] ? irqentry_enter+0x2b/0x60 [ 1220.368413][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1220.368415][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1220.368419][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1220.368422][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1220.368424][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1220.368427][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1220.368430][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1220.368434][ C1] netif_receive_skb+0x55/0x280 [ 1220.368437][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1220.368445][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1220.368452][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1220.368459][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1220.368465][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1220.368477][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1220.368486][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1220.368489][ C1] ? arch_stack_walk+0x68/0x100 [ 1220.368494][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1220.368497][ C1] ? irqentry_enter+0x2b/0x60 [ 1220.368500][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1220.368504][ C1] ? irqentry_enter+0x2b/0x60 [ 1220.368508][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1220.368515][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1220.368517][ C1] ? arch_stack_walk+0x68/0x100 [ 1220.368521][ C1] __tcf_classify+0x32c/0x7d0 [ 1220.368526][ C1] tcf_classify+0x283/0x930 [ 1220.368529][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1220.368533][ C1] tc_run+0x2e4/0x5d0 [ 1220.368537][ C1] ? __pfx_tc_run+0x10/0x10 [ 1220.368542][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1220.368548][ C1] ? irqentry_enter+0x2b/0x60 [ 1220.368551][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1220.368554][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1220.368561][ C1] ip_finish_output2+0x786/0x18e0 [ 1220.368565][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1220.368568][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1220.368572][ C1] ? __ip_finish_output+0x10f/0x770 [ 1220.368575][ C1] ip_output+0x16b/0x4f0 [ 1220.368578][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1220.368581][ C1] ? __pfx_ip_output+0x10/0x10 [ 1220.368585][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1220.368592][ C1] ? __pfx_ip_output+0x10/0x10 [ 1220.368596][ C1] __ip_queue_xmit+0x672/0x1910 [ 1220.368601][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1220.368607][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1220.368612][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1220.368615][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1220.368619][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1220.368622][ C1] tcp_delack_timer+0x84/0x240 [ 1220.368625][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1220.368628][ C1] call_timer_fn+0x176/0x430 [ 1220.368632][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1220.368637][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1220.368640][ C1] __run_timers.part.0+0x52d/0x890 [ 1220.368643][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1220.368648][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1220.368652][ C1] ? __pfx___schedule+0x10/0x10 [ 1220.368655][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1220.368660][ C1] run_timer_softirq+0x72/0x100 [ 1220.368663][ C1] __do_softirq+0x1bc/0x7ff [ 1220.368667][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1220.368670][ C1] run_ksoftirqd+0x2e/0x60 [ 1220.368673][ C1] smpboot_thread_fn+0x30e/0x840 [ 1220.368677][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1220.368680][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1220.368683][ C1] kthread+0x292/0x360 [ 1220.368686][ C1] ? __pfx_kthread+0x10/0x10 [ 1220.368688][ C1] ret_from_fork+0x34/0x70 [ 1220.368690][ C1] ? __pfx_kthread+0x10/0x10 [ 1220.368692][ C1] ret_from_fork_asm+0x1b/0x30 [ 1220.368699][ C1] [ 1244.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 53s! [swapper/0:0] [ 1244.527917][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1244.529117][ C0] irq event stamp: 27567077 [ 1244.529358][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 1244.529901][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 1244.530375][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 1244.530880][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 1244.531374][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1244.531851][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1244.532499][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1244.532845][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1244.533875][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1244.534202][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1244.534628][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1244.535064][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1244.535489][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1244.535912][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1244.536337][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1244.536812][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1244.537163][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1244.537592][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1244.538011][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1244.538440][ C0] Call Trace: [ 1244.538619][ C0] [ 1244.538779][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1244.539059][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1244.539316][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1244.539609][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1244.539905][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1244.540208][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1244.540489][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1244.540813][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1244.541088][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1244.541368][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1244.541693][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1244.542008][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1244.542342][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1244.542647][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1244.542956][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1244.543260][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1244.543593][ C0] ? get_stack_info+0x36/0xc0 [ 1244.543845][ C0] ? lock_acquire+0x1c1/0x220 [ 1244.544097][ C0] ? lock_release+0x1d5/0x250 [ 1244.544349][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1244.544607][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1244.544886][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1244.545182][ C0] ? lock_acquire+0x1c1/0x220 [ 1244.545435][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1244.545691][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1244.545963][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1244.546205][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1244.546460][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1244.546725][ C0] ? __inet_lookup_established+0x341/0x610 [ 1244.547038][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1244.547333][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1244.547622][ C0] ip_local_deliver+0x19d/0x480 [ 1244.547877][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1244.548162][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1244.548425][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1244.548708][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1244.548973][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1244.549306][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1244.549599][ C0] ip_rcv+0x564/0x740 [ 1244.549821][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1244.550066][ C0] ? set_track_prepare+0x8a/0xd0 [ 1244.550337][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1244.550626][ C0] ? rest_init+0x153/0x260 [ 1244.550864][ C0] ? skb_clone+0x10b/0x330 [ 1244.551104][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1244.551434][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1244.551751][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1244.552047][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1244.552359][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1244.552619][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1244.552870][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1244.553193][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1244.553495][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1244.553833][ C0] ? lock_acquire+0x1c1/0x220 [ 1244.554090][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1244.554402][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1244.554702][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1244.555034][ C0] ? __copy_skb_header+0xaf/0x490 [ 1244.555305][ C0] ? __skb_clone+0x57a/0x760 [ 1244.555549][ C0] netif_receive_skb+0x55/0x280 [ 1244.555808][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1244.556144][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1244.556498][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1244.556810][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1244.557107][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1244.557413][ C0] ? hlock_class+0x4e/0x130 [ 1244.557667][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1244.558001][ C0] ? place_entity+0x21/0x2f0 [ 1244.558254][ C0] ? resched_curr+0x219/0x280 [ 1244.558507][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1244.558771][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1244.559057][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1244.559338][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1244.559601][ C0] ? activate_task+0xf5/0x260 [ 1244.559864][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1244.560140][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1244.560409][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1244.560669][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1244.560959][ C0] ? get_stack_info+0x36/0xc0 [ 1244.561208][ C0] ? stack_access_ok+0xda/0x1f0 [ 1244.561463][ C0] ? get_reg+0x119/0x190 [ 1244.561689][ C0] __tcf_classify+0x32c/0x7d0 [ 1244.561942][ C0] tcf_classify+0x283/0x930 [ 1244.562186][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1244.562522][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1244.562791][ C0] ? arch_stack_walk+0x8c/0x100 [ 1244.563050][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1244.563339][ C0] tc_run+0x2e4/0x5d0 [ 1244.563561][ C0] ? __pfx_tc_run+0x10/0x10 [ 1244.563812][ C0] ? lock_acquire+0x1c1/0x220 [ 1244.564065][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1244.564340][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1244.564610][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1244.564905][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1244.565184][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1244.565505][ C0] ? neigh_hh_output+0x348/0x590 [ 1244.565773][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1244.566057][ C0] ip_finish_output2+0x786/0x18e0 [ 1244.566334][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1244.566629][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1244.566980][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1244.567271][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1244.567545][ C0] ? __ip_finish_output+0x10f/0x770 [ 1244.567822][ C0] ip_output+0x16b/0x4f0 [ 1244.568052][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1244.568341][ C0] ? __pfx_ip_output+0x10/0x10 [ 1244.568593][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1244.568894][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1244.569167][ C0] ? ip_local_out+0x114/0x3b0 [ 1244.569424][ C0] __ip_queue_xmit+0x672/0x1910 [ 1244.569684][ C0] ? __skb_clone+0x57a/0x760 [ 1244.569938][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1244.570228][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1244.570530][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1244.570851][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1244.571107][ C0] ? tcp_current_mss+0x40a/0x510 [ 1244.571370][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1244.571652][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1244.571934][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1244.572189][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1244.572454][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1244.572774][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1244.573058][ C0] ? ktime_get+0xb6/0x190 [ 1244.573291][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1244.573566][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1244.573849][ C0] tcp_write_timer+0x82/0x1d0 [ 1244.574105][ C0] call_timer_fn+0x176/0x430 [ 1244.574352][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1244.574624][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1244.574899][ C0] __run_timers.part.0+0x52d/0x890 [ 1244.575169][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1244.575453][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1244.575753][ C0] ? lock_acquire+0x1c1/0x220 [ 1244.576003][ C0] ? clockevents_program_event+0xf6/0x300 [ 1244.576310][ C0] ? lock_release+0x1d5/0x250 [ 1244.576563][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1244.576841][ C0] ? ktime_get+0xb6/0x190 [ 1244.577074][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1244.577372][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1244.577681][ C0] run_timer_softirq+0x72/0x100 [ 1244.577948][ C0] __do_softirq+0x1bc/0x7ff [ 1244.578196][ C0] irq_exit_rcu+0x98/0xc0 [ 1244.578429][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1244.578736][ C0] [ 1244.578898][ C0] [ 1244.579054][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1244.579375][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1244.579653][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1244.580684][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1244.581008][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1244.581425][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1244.581847][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1244.582271][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1244.582690][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1244.583110][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1244.583410][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1244.583682][ C0] default_idle_call+0x69/0xa0 [ 1244.583946][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1244.584207][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1244.584502][ C0] ? lock_release+0x1d5/0x250 [ 1244.584752][ C0] do_idle+0xfb/0x160 [ 1244.584964][ C0] cpu_startup_entry+0x55/0x60 [ 1244.585224][ C0] rest_init+0x153/0x260 [ 1244.585451][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1244.585737][ C0] arch_call_rest_init+0x13/0x40 [ 1244.586003][ C0] start_kernel+0x314/0x3d0 [ 1244.586249][ C0] x86_64_start_reservations+0x18/0x30 [ 1244.586544][ C0] x86_64_start_kernel+0xba/0x110 [ 1244.586821][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1244.587147][ C0] [ 1244.587310][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 53s! [ksoftirqd/1:22] [ 1244.587761][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1244.588951][ C1] irq event stamp: 3886976 [ 1244.589186][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 1244.589683][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 1244.590189][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 1244.590689][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 1244.591182][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1244.591677][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1244.592317][ C1] RIP: 0010:kasan_check_range+0x66/0x1c0 [ 1244.592619][ C1] Code: 5b 5d 41 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df <4d> 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d [ 1244.593648][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000212 [ 1244.593977][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1244.594402][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1244.594829][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1244.595255][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1244.595679][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1244.596102][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1244.596579][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1244.596928][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1244.597354][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1244.597775][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1244.598194][ C1] Call Trace: [ 1244.598375][ C1] [ 1244.598533][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1244.598812][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1244.599066][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1244.599361][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1244.599647][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1244.599960][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1244.600244][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1244.600568][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1244.600841][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1244.601170][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1244.601482][ C1] [ 1244.601644][ C1] [ 1244.601802][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1244.602133][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1244.602444][ C1] ? kasan_check_range+0x66/0x1c0 [ 1244.602721][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 1244.603018][ C1] ? run_ksoftirqd+0xb/0x60 [ 1244.603266][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1244.603598][ C1] ? __orc_find+0x9c/0xf0 [ 1244.603828][ C1] ? lock_acquire+0x1c1/0x220 [ 1244.604080][ C1] ? irqentry_enter+0x2b/0x60 [ 1244.604333][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1244.604595][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1244.604884][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1244.605183][ C1] ? lock_acquire+0x1c1/0x220 [ 1244.605436][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1244.605692][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1244.605970][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1244.606219][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1244.606477][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1244.606749][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1244.607037][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1244.607327][ C1] ip_local_deliver+0x19d/0x480 [ 1244.607594][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1244.607884][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1244.608154][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1244.608432][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1244.608695][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1244.609035][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1244.609310][ C1] ip_rcv+0x564/0x740 [ 1244.609524][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1244.609765][ C1] ? set_track_prepare+0x8a/0xd0 [ 1244.610041][ C1] ? irqentry_enter+0x2b/0x60 [ 1244.610290][ C1] ? irqentry_enter+0x2b/0x60 [ 1244.610539][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1244.610780][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1244.611093][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1244.611432][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1244.611741][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1244.612083][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1244.612385][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1244.612717][ C1] netif_receive_skb+0x55/0x280 [ 1244.612978][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1244.613306][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1244.613653][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1244.613973][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1244.614261][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1244.614565][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1244.614891][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1244.615171][ C1] ? arch_stack_walk+0x68/0x100 [ 1244.615435][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1244.615721][ C1] ? irqentry_enter+0x2b/0x60 [ 1244.615975][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1244.616300][ C1] ? irqentry_enter+0x2b/0x60 [ 1244.616554][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1244.616876][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1244.617159][ C1] ? arch_stack_walk+0x68/0x100 [ 1244.617418][ C1] __tcf_classify+0x32c/0x7d0 [ 1244.617671][ C1] tcf_classify+0x283/0x930 [ 1244.617912][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1244.618180][ C1] tc_run+0x2e4/0x5d0 [ 1244.618395][ C1] ? __pfx_tc_run+0x10/0x10 [ 1244.618640][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1244.618907][ C1] ? irqentry_enter+0x2b/0x60 [ 1244.619160][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1244.619448][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1244.619773][ C1] ip_finish_output2+0x786/0x18e0 [ 1244.620054][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1244.620345][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1244.620609][ C1] ? __ip_finish_output+0x10f/0x770 [ 1244.620889][ C1] ip_output+0x16b/0x4f0 [ 1244.621123][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1244.621443][ C1] ? __pfx_ip_output+0x10/0x10 [ 1244.621711][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1244.622064][ C1] ? __pfx_ip_output+0x10/0x10 [ 1244.622319][ C1] __ip_queue_xmit+0x672/0x1910 [ 1244.622586][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1244.622872][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1244.623177][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1244.623466][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1244.623764][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1244.624050][ C1] tcp_delack_timer+0x84/0x240 [ 1244.624307][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1244.624590][ C1] call_timer_fn+0x176/0x430 [ 1244.624836][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1244.625112][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1244.625389][ C1] __run_timers.part.0+0x52d/0x890 [ 1244.625660][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1244.625948][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1244.626249][ C1] ? __pfx___schedule+0x10/0x10 [ 1244.626510][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1244.626827][ C1] run_timer_softirq+0x72/0x100 [ 1244.627090][ C1] __do_softirq+0x1bc/0x7ff [ 1244.627336][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1244.627619][ C1] run_ksoftirqd+0x2e/0x60 [ 1244.627858][ C1] smpboot_thread_fn+0x30e/0x840 [ 1244.628129][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1244.628419][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1244.628710][ C1] kthread+0x292/0x360 [ 1244.628928][ C1] ? __pfx_kthread+0x10/0x10 [ 1244.629177][ C1] ret_from_fork+0x34/0x70 [ 1244.629415][ C1] ? __pfx_kthread+0x10/0x10 [ 1244.629663][ C1] ret_from_fork_asm+0x1b/0x30 [ 1244.629931][ C1] [ 1272.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 79s! [swapper/0:0] [ 1272.527921][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1272.529115][ C0] irq event stamp: 27567077 [ 1272.529354][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 1272.529889][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 1272.530363][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 1272.530864][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 1272.531358][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1272.531835][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1272.532480][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1272.532825][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1272.533850][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1272.534174][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1272.534599][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1272.535018][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1272.535438][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1272.535863][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1272.536286][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1272.536757][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1272.537105][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1272.537532][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1272.537950][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1272.538366][ C0] Call Trace: [ 1272.538544][ C0] [ 1272.538701][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1272.538980][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1272.539234][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1272.539526][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1272.539818][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1272.540124][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1272.540405][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1272.540730][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1272.541004][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1272.541286][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1272.541610][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1272.541920][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1272.542256][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1272.542559][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1272.542867][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1272.543172][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1272.543504][ C0] ? get_stack_info+0x36/0xc0 [ 1272.543756][ C0] ? lock_acquire+0x1c1/0x220 [ 1272.544004][ C0] ? lock_release+0x1d5/0x250 [ 1272.544252][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1272.544512][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1272.544797][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1272.545094][ C0] ? lock_acquire+0x1c1/0x220 [ 1272.545345][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1272.545600][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1272.545875][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1272.546120][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1272.546377][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1272.546645][ C0] ? __inet_lookup_established+0x341/0x610 [ 1272.546960][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1272.547253][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1272.547546][ C0] ip_local_deliver+0x19d/0x480 [ 1272.547804][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1272.548092][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1272.548355][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1272.548634][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1272.548897][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1272.549230][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1272.549509][ C0] ip_rcv+0x564/0x740 [ 1272.549727][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1272.549967][ C0] ? set_track_prepare+0x8a/0xd0 [ 1272.550231][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1272.550521][ C0] ? rest_init+0x153/0x260 [ 1272.550755][ C0] ? skb_clone+0x10b/0x330 [ 1272.550997][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1272.551330][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1272.551648][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1272.551946][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1272.552260][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1272.552519][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1272.552763][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1272.553082][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1272.553384][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1272.553724][ C0] ? lock_acquire+0x1c1/0x220 [ 1272.553971][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1272.554284][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1272.554585][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1272.554915][ C0] ? __copy_skb_header+0xaf/0x490 [ 1272.555180][ C0] ? __skb_clone+0x57a/0x760 [ 1272.555423][ C0] netif_receive_skb+0x55/0x280 [ 1272.555688][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1272.556018][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1272.556370][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1272.556681][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1272.556970][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1272.557270][ C0] ? hlock_class+0x4e/0x130 [ 1272.557518][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1272.557852][ C0] ? place_entity+0x21/0x2f0 [ 1272.558101][ C0] ? resched_curr+0x219/0x280 [ 1272.558351][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1272.558617][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1272.558896][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1272.559177][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1272.559437][ C0] ? activate_task+0xf5/0x260 [ 1272.559696][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1272.559970][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1272.560245][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1272.560501][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1272.560795][ C0] ? get_stack_info+0x36/0xc0 [ 1272.561050][ C0] ? stack_access_ok+0xda/0x1f0 [ 1272.561312][ C0] ? get_reg+0x119/0x190 [ 1272.561540][ C0] __tcf_classify+0x32c/0x7d0 [ 1272.561788][ C0] tcf_classify+0x283/0x930 [ 1272.562027][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1272.562354][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1272.562623][ C0] ? arch_stack_walk+0x8c/0x100 [ 1272.562889][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1272.563181][ C0] tc_run+0x2e4/0x5d0 [ 1272.563394][ C0] ? __pfx_tc_run+0x10/0x10 [ 1272.563634][ C0] ? lock_acquire+0x1c1/0x220 [ 1272.563883][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1272.564156][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1272.564426][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1272.564711][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1272.564989][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1272.565306][ C0] ? neigh_hh_output+0x348/0x590 [ 1272.565575][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1272.565850][ C0] ip_finish_output2+0x786/0x18e0 [ 1272.566117][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1272.566409][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1272.566766][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1272.567060][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1272.567324][ C0] ? __ip_finish_output+0x10f/0x770 [ 1272.567604][ C0] ip_output+0x16b/0x4f0 [ 1272.567830][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1272.568110][ C0] ? __pfx_ip_output+0x10/0x10 [ 1272.568365][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1272.568664][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1272.568929][ C0] ? ip_local_out+0x114/0x3b0 [ 1272.569179][ C0] __ip_queue_xmit+0x672/0x1910 [ 1272.569436][ C0] ? __skb_clone+0x57a/0x760 [ 1272.569683][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1272.569964][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1272.570259][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1272.570584][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1272.570844][ C0] ? tcp_current_mss+0x40a/0x510 [ 1272.571105][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1272.571388][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1272.571666][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1272.571919][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1272.572188][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1272.572509][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1272.572785][ C0] ? ktime_get+0xb6/0x190 [ 1272.573016][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1272.573288][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1272.573572][ C0] tcp_write_timer+0x82/0x1d0 [ 1272.573821][ C0] call_timer_fn+0x176/0x430 [ 1272.574065][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1272.574344][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1272.574616][ C0] __run_timers.part.0+0x52d/0x890 [ 1272.574890][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1272.575174][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1272.575474][ C0] ? lock_acquire+0x1c1/0x220 [ 1272.575721][ C0] ? clockevents_program_event+0xf6/0x300 [ 1272.576025][ C0] ? lock_release+0x1d5/0x250 [ 1272.576275][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1272.576548][ C0] ? ktime_get+0xb6/0x190 [ 1272.576777][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1272.577073][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1272.577386][ C0] run_timer_softirq+0x72/0x100 [ 1272.577645][ C0] __do_softirq+0x1bc/0x7ff [ 1272.577886][ C0] irq_exit_rcu+0x98/0xc0 [ 1272.578116][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1272.578414][ C0] [ 1272.578573][ C0] [ 1272.578734][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1272.579057][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1272.579326][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1272.580347][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1272.580673][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1272.581098][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1272.581516][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1272.581938][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1272.582362][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1272.582788][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1272.583093][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1272.583369][ C0] default_idle_call+0x69/0xa0 [ 1272.583619][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1272.583885][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1272.584178][ C0] ? lock_release+0x1d5/0x250 [ 1272.584434][ C0] do_idle+0xfb/0x160 [ 1272.584648][ C0] cpu_startup_entry+0x55/0x60 [ 1272.584904][ C0] rest_init+0x153/0x260 [ 1272.585138][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1272.585429][ C0] arch_call_rest_init+0x13/0x40 [ 1272.585698][ C0] start_kernel+0x314/0x3d0 [ 1272.585938][ C0] x86_64_start_reservations+0x18/0x30 [ 1272.586229][ C0] x86_64_start_kernel+0xba/0x110 [ 1272.586499][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1272.586827][ C0] [ 1272.586994][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 79s! [ksoftirqd/1:22] [ 1272.587438][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1272.588640][ C1] irq event stamp: 3886976 [ 1272.588882][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 1272.589375][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 1272.589878][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 1272.590379][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 1272.590867][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1272.591366][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1272.592015][ C1] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 1272.592320][ C1] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 1272.593335][ C1] RSP: 0018:ffffc9000019e9d0 EFLAGS: 00000282 [ 1272.593657][ C1] RAX: ffff88800a098e1c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1272.594077][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1272.594496][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1272.594915][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1272.595332][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1272.595749][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1272.596220][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1272.596572][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1272.596994][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1272.597420][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1272.597847][ C1] Call Trace: [ 1272.598028][ C1] [ 1272.598186][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1272.598462][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1272.598722][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1272.599016][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1272.599308][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1272.599612][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1272.599900][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1272.600222][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1272.600501][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1272.600827][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1272.601142][ C1] [ 1272.601298][ C1] [ 1272.601455][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1272.601783][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1272.602095][ C1] ? kasan_check_range+0x1a/0x1c0 [ 1272.602367][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 1272.602665][ C1] ? run_ksoftirqd+0xb/0x60 [ 1272.602913][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1272.603243][ C1] ? __orc_find+0x9c/0xf0 [ 1272.603472][ C1] ? lock_acquire+0x1c1/0x220 [ 1272.603723][ C1] ? irqentry_enter+0x2b/0x60 [ 1272.603976][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1272.604236][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1272.604520][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1272.604819][ C1] ? lock_acquire+0x1c1/0x220 [ 1272.605072][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1272.605327][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1272.605603][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1272.605847][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1272.606106][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1272.606376][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1272.606666][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1272.606958][ C1] ip_local_deliver+0x19d/0x480 [ 1272.607221][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1272.607508][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1272.607773][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1272.608050][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1272.608310][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1272.608649][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1272.608922][ C1] ip_rcv+0x564/0x740 [ 1272.609134][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1272.609373][ C1] ? set_track_prepare+0x8a/0xd0 [ 1272.609637][ C1] ? irqentry_enter+0x2b/0x60 [ 1272.609897][ C1] ? irqentry_enter+0x2b/0x60 [ 1272.610146][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1272.610387][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1272.610702][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1272.611041][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1272.611349][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1272.611691][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1272.611993][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1272.612326][ C1] netif_receive_skb+0x55/0x280 [ 1272.612585][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1272.612914][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1272.613261][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1272.613579][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1272.613868][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1272.614171][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1272.614497][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1272.614779][ C1] ? arch_stack_walk+0x68/0x100 [ 1272.615045][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1272.615324][ C1] ? irqentry_enter+0x2b/0x60 [ 1272.615579][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1272.615901][ C1] ? irqentry_enter+0x2b/0x60 [ 1272.616150][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1272.616477][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1272.616759][ C1] ? arch_stack_walk+0x68/0x100 [ 1272.617018][ C1] __tcf_classify+0x32c/0x7d0 [ 1272.617271][ C1] tcf_classify+0x283/0x930 [ 1272.617513][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1272.617781][ C1] tc_run+0x2e4/0x5d0 [ 1272.617994][ C1] ? __pfx_tc_run+0x10/0x10 [ 1272.618238][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1272.618503][ C1] ? irqentry_enter+0x2b/0x60 [ 1272.618758][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1272.619047][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1272.619372][ C1] ip_finish_output2+0x786/0x18e0 [ 1272.619642][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1272.619942][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1272.620208][ C1] ? __ip_finish_output+0x10f/0x770 [ 1272.620488][ C1] ip_output+0x16b/0x4f0 [ 1272.620715][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1272.621032][ C1] ? __pfx_ip_output+0x10/0x10 [ 1272.621290][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1272.621642][ C1] ? __pfx_ip_output+0x10/0x10 [ 1272.621899][ C1] __ip_queue_xmit+0x672/0x1910 [ 1272.622164][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1272.622447][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1272.622744][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1272.623032][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1272.623328][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1272.623613][ C1] tcp_delack_timer+0x84/0x240 [ 1272.623868][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1272.624150][ C1] call_timer_fn+0x176/0x430 [ 1272.624396][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1272.624676][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1272.624952][ C1] __run_timers.part.0+0x52d/0x890 [ 1272.625223][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1272.625510][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1272.625816][ C1] ? __pfx___schedule+0x10/0x10 [ 1272.626076][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1272.626395][ C1] run_timer_softirq+0x72/0x100 [ 1272.626660][ C1] __do_softirq+0x1bc/0x7ff [ 1272.626906][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1272.627183][ C1] run_ksoftirqd+0x2e/0x60 [ 1272.627421][ C1] smpboot_thread_fn+0x30e/0x840 [ 1272.627689][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1272.627977][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1272.628269][ C1] kthread+0x292/0x360 [ 1272.628487][ C1] ? __pfx_kthread+0x10/0x10 [ 1272.628736][ C1] ret_from_fork+0x34/0x70 [ 1272.628972][ C1] ? __pfx_kthread+0x10/0x10 [ 1272.629219][ C1] ret_from_fork_asm+0x1b/0x30 [ 1272.629477][ C1] [ 1298.372024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 1298.372420][ C0] rcu: 0-....: (105773 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=25731 [ 1298.372934][ C0] rcu: (t=104063 jiffies g=1007429 q=21 ncpus=4) [ 1298.373276][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1298.373756][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1298.374404][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 1298.374750][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 1298.375764][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1298.376088][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1298.376504][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1298.376922][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1298.377339][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1298.377757][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1298.378175][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1298.378641][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1298.378996][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1298.379417][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1298.379841][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1298.380259][ C0] Call Trace: [ 1298.380437][ C0] [ 1298.380594][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 1298.380883][ C0] ? print_cpu_stall+0x263/0x6a0 [ 1298.381145][ C0] ? check_cpu_stall+0x284/0x500 [ 1298.381414][ C0] ? rcu_pending+0x92/0x360 [ 1298.381656][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 1298.381938][ C0] ? update_process_times+0xb9/0x110 [ 1298.382224][ C0] ? tick_sched_handle+0x67/0x130 [ 1298.382493][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 1298.382790][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1298.383042][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 1298.383371][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1298.383654][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1298.383954][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1298.384234][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1298.384551][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1298.384827][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1298.385105][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1298.385435][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1298.385751][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1298.386081][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1298.386388][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 1298.386693][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1298.386999][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1298.387329][ C0] ? get_stack_info+0x36/0xc0 [ 1298.387583][ C0] ? lock_acquire+0x1c1/0x220 [ 1298.387839][ C0] ? lock_release+0x1d5/0x250 [ 1298.388089][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1298.388349][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1298.388632][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1298.388929][ C0] ? lock_acquire+0x1c1/0x220 [ 1298.389183][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1298.389440][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1298.389722][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1298.389973][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1298.390236][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1298.390509][ C0] ? __inet_lookup_established+0x341/0x610 [ 1298.390825][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1298.391115][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1298.391406][ C0] ip_local_deliver+0x19d/0x480 [ 1298.391669][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1298.391956][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1298.392225][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1298.392501][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1298.392764][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1298.393101][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1298.393375][ C0] ip_rcv+0x564/0x740 [ 1298.393588][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1298.393828][ C0] ? set_track_prepare+0x8a/0xd0 [ 1298.394097][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1298.394389][ C0] ? rest_init+0x153/0x260 [ 1298.394626][ C0] ? skb_clone+0x10b/0x330 [ 1298.394870][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1298.395204][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1298.395530][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1298.395830][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1298.396142][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1298.396407][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1298.396652][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1298.396970][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1298.397272][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1298.397613][ C0] ? lock_acquire+0x1c1/0x220 [ 1298.397862][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1298.398170][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1298.398472][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1298.398798][ C0] ? __copy_skb_header+0xaf/0x490 [ 1298.399065][ C0] ? __skb_clone+0x57a/0x760 [ 1298.399311][ C0] netif_receive_skb+0x55/0x280 [ 1298.399580][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1298.399908][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1298.400257][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1298.400574][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1298.400860][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1298.401159][ C0] ? hlock_class+0x4e/0x130 [ 1298.401403][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1298.401730][ C0] ? place_entity+0x21/0x2f0 [ 1298.401977][ C0] ? resched_curr+0x219/0x280 [ 1298.402232][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1298.402502][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1298.402789][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1298.403065][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1298.403320][ C0] ? activate_task+0xf5/0x260 [ 1298.403568][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1298.403842][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1298.404118][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1298.404379][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1298.404669][ C0] ? get_stack_info+0x36/0xc0 [ 1298.404923][ C0] ? stack_access_ok+0xda/0x1f0 [ 1298.405183][ C0] ? get_reg+0x119/0x190 [ 1298.405420][ C0] __tcf_classify+0x32c/0x7d0 [ 1298.405673][ C0] tcf_classify+0x283/0x930 [ 1298.405916][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1298.406243][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1298.406514][ C0] ? arch_stack_walk+0x8c/0x100 [ 1298.406777][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1298.407069][ C0] tc_run+0x2e4/0x5d0 [ 1298.407285][ C0] ? __pfx_tc_run+0x10/0x10 [ 1298.407526][ C0] ? lock_acquire+0x1c1/0x220 [ 1298.407772][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1298.408045][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1298.408313][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1298.408596][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1298.408873][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1298.409195][ C0] ? neigh_hh_output+0x348/0x590 [ 1298.409463][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1298.409749][ C0] ip_finish_output2+0x786/0x18e0 [ 1298.410020][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1298.410315][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1298.410666][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1298.410958][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1298.411224][ C0] ? __ip_finish_output+0x10f/0x770 [ 1298.411500][ C0] ip_output+0x16b/0x4f0 [ 1298.411728][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1298.412013][ C0] ? __pfx_ip_output+0x10/0x10 [ 1298.412270][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1298.412573][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1298.412836][ C0] ? ip_local_out+0x114/0x3b0 [ 1298.413093][ C0] __ip_queue_xmit+0x672/0x1910 [ 1298.413359][ C0] ? __skb_clone+0x57a/0x760 [ 1298.413609][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1298.413889][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1298.414183][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1298.414500][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1298.414758][ C0] ? tcp_current_mss+0x40a/0x510 [ 1298.415021][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1298.415304][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1298.415578][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1298.415830][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1298.416102][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1298.416425][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1298.416700][ C0] ? ktime_get+0xb6/0x190 [ 1298.416931][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1298.417207][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1298.417490][ C0] tcp_write_timer+0x82/0x1d0 [ 1298.417740][ C0] call_timer_fn+0x176/0x430 [ 1298.417985][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1298.418261][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1298.418533][ C0] __run_timers.part.0+0x52d/0x890 [ 1298.418806][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1298.419085][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1298.419385][ C0] ? lock_acquire+0x1c1/0x220 [ 1298.419638][ C0] ? clockevents_program_event+0xf6/0x300 [ 1298.419949][ C0] ? lock_release+0x1d5/0x250 [ 1298.420201][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1298.420486][ C0] ? ktime_get+0xb6/0x190 [ 1298.420719][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1298.421020][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1298.421328][ C0] run_timer_softirq+0x72/0x100 [ 1298.421589][ C0] __do_softirq+0x1bc/0x7ff [ 1298.421835][ C0] irq_exit_rcu+0x98/0xc0 [ 1298.422069][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1298.422368][ C0] [ 1298.422524][ C0] [ 1298.422680][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1298.422997][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1298.423266][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1298.424291][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1298.424615][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1298.425039][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1298.425465][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1298.425886][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1298.426309][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1298.426735][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1298.427041][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1298.427316][ C0] default_idle_call+0x69/0xa0 [ 1298.427572][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1298.427837][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1298.428127][ C0] ? lock_release+0x1d5/0x250 [ 1298.428382][ C0] do_idle+0xfb/0x160 [ 1298.428599][ C0] cpu_startup_entry+0x55/0x60 [ 1298.428857][ C0] rest_init+0x153/0x260 [ 1298.429082][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1298.429371][ C0] arch_call_rest_init+0x13/0x40 [ 1298.429642][ C0] start_kernel+0x314/0x3d0 [ 1298.429887][ C0] x86_64_start_reservations+0x18/0x30 [ 1298.430179][ C0] x86_64_start_kernel+0xba/0x110 [ 1298.430445][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1298.430770][ C0] [ 1298.430935][ C0] Sending NMI from CPU 0 to CPUs 1: [ 1298.431224][ C1] NMI backtrace for cpu 1 [ 1298.431231][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1298.431234][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1298.431237][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1298.431243][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1298.431246][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1298.431249][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1298.431250][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1298.431252][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1298.431254][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1298.431255][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1298.431256][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1298.431259][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1298.431262][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1298.431263][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1298.431264][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1298.431265][ C1] Call Trace: [ 1298.431268][ C1] [ 1298.431271][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 1298.431277][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 1298.431282][ C1] ? nmi_handle+0x156/0x420 [ 1298.431287][ C1] ? default_do_nmi+0x41/0x100 [ 1298.431290][ C1] ? exc_nmi+0xf3/0x120 [ 1298.431292][ C1] ? end_repeat_nmi+0xf/0x60 [ 1298.431296][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1298.431300][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1298.431303][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1298.431307][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1298.431310][ C1] [ 1298.431311][ C1] [ 1298.431312][ C1] ? run_ksoftirqd+0xb/0x60 [ 1298.431317][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1298.431320][ C1] ? __orc_find+0x9c/0xf0 [ 1298.431323][ C1] ? lock_acquire+0x1c1/0x220 [ 1298.431327][ C1] ? irqentry_enter+0x2b/0x60 [ 1298.431331][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1298.431335][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1298.431338][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1298.431341][ C1] ? lock_acquire+0x1c1/0x220 [ 1298.431343][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1298.431348][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1298.431351][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1298.431358][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1298.431361][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1298.431367][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1298.431373][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1298.431376][ C1] ip_local_deliver+0x19d/0x480 [ 1298.431379][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1298.431382][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1298.431386][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1298.431389][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1298.431392][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1298.431396][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1298.431405][ C1] ip_rcv+0x564/0x740 [ 1298.431408][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1298.431411][ C1] ? set_track_prepare+0x8a/0xd0 [ 1298.431415][ C1] ? irqentry_enter+0x2b/0x60 [ 1298.431418][ C1] ? irqentry_enter+0x2b/0x60 [ 1298.431422][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1298.431424][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1298.431428][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1298.431432][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1298.431435][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1298.431437][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1298.431441][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1298.431445][ C1] netif_receive_skb+0x55/0x280 [ 1298.431449][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1298.431458][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1298.431465][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1298.431472][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1298.431479][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1298.431490][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1298.431499][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1298.431502][ C1] ? arch_stack_walk+0x68/0x100 [ 1298.431506][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1298.431509][ C1] ? irqentry_enter+0x2b/0x60 [ 1298.431513][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1298.431517][ C1] ? irqentry_enter+0x2b/0x60 [ 1298.431521][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1298.431528][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1298.431530][ C1] ? arch_stack_walk+0x68/0x100 [ 1298.431535][ C1] __tcf_classify+0x32c/0x7d0 [ 1298.431540][ C1] tcf_classify+0x283/0x930 [ 1298.431543][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1298.431547][ C1] tc_run+0x2e4/0x5d0 [ 1298.431551][ C1] ? __pfx_tc_run+0x10/0x10 [ 1298.431556][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1298.431561][ C1] ? irqentry_enter+0x2b/0x60 [ 1298.431564][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1298.431567][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1298.431573][ C1] ip_finish_output2+0x786/0x18e0 [ 1298.431579][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1298.431582][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1298.431585][ C1] ? __ip_finish_output+0x10f/0x770 [ 1298.431589][ C1] ip_output+0x16b/0x4f0 [ 1298.431592][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1298.431595][ C1] ? __pfx_ip_output+0x10/0x10 [ 1298.431599][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1298.431606][ C1] ? __pfx_ip_output+0x10/0x10 [ 1298.431610][ C1] __ip_queue_xmit+0x672/0x1910 [ 1298.431615][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1298.431622][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1298.431626][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1298.431629][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1298.431633][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1298.431636][ C1] tcp_delack_timer+0x84/0x240 [ 1298.431640][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1298.431643][ C1] call_timer_fn+0x176/0x430 [ 1298.431647][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1298.431651][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1298.431655][ C1] __run_timers.part.0+0x52d/0x890 [ 1298.431658][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1298.431663][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1298.431667][ C1] ? __pfx___schedule+0x10/0x10 [ 1298.431671][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1298.431676][ C1] run_timer_softirq+0x72/0x100 [ 1298.431679][ C1] __do_softirq+0x1bc/0x7ff [ 1298.431683][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1298.431687][ C1] run_ksoftirqd+0x2e/0x60 [ 1298.431690][ C1] smpboot_thread_fn+0x30e/0x840 [ 1298.431694][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1298.431698][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1298.431701][ C1] kthread+0x292/0x360 [ 1298.431703][ C1] ? __pfx_kthread+0x10/0x10 [ 1298.431706][ C1] ret_from_fork+0x34/0x70 [ 1298.431709][ C1] ? __pfx_kthread+0x10/0x10 [ 1298.431711][ C1] ret_from_fork_asm+0x1b/0x30 [ 1298.431719][ C1] [ 1324.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 127s! [swapper/0:0] [ 1324.527925][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1324.529120][ C0] irq event stamp: 27567077 [ 1324.529361][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 1324.529901][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 1324.530372][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 1324.530874][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 1324.531366][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1324.531845][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1324.532493][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1324.532836][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1324.533865][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1324.534190][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1324.534614][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1324.535039][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1324.535459][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1324.535880][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1324.536303][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1324.536779][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1324.537125][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1324.537551][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1324.537971][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1324.538390][ C0] Call Trace: [ 1324.538567][ C0] [ 1324.538724][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1324.539003][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1324.539258][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1324.539559][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1324.539851][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1324.540154][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1324.540434][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1324.540757][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1324.541028][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1324.541306][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1324.541627][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1324.541937][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1324.542271][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1324.542573][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1324.542882][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1324.543186][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1324.543516][ C0] ? get_stack_info+0x36/0xc0 [ 1324.543767][ C0] ? lock_acquire+0x1c1/0x220 [ 1324.544017][ C0] ? lock_release+0x1d5/0x250 [ 1324.544266][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1324.544523][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1324.544805][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1324.545107][ C0] ? lock_acquire+0x1c1/0x220 [ 1324.545365][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1324.545625][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1324.545900][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1324.546143][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1324.546398][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1324.546666][ C0] ? __inet_lookup_established+0x341/0x610 [ 1324.546978][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1324.547270][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1324.547561][ C0] ip_local_deliver+0x19d/0x480 [ 1324.547819][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1324.548103][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1324.548368][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1324.548649][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1324.548914][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1324.549252][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1324.549536][ C0] ip_rcv+0x564/0x740 [ 1324.549751][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1324.549992][ C0] ? set_track_prepare+0x8a/0xd0 [ 1324.550256][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1324.550546][ C0] ? rest_init+0x153/0x260 [ 1324.550781][ C0] ? skb_clone+0x10b/0x330 [ 1324.551022][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1324.551354][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1324.551671][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1324.551968][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1324.552280][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1324.552544][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1324.552791][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1324.553110][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1324.553411][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1324.553750][ C0] ? lock_acquire+0x1c1/0x220 [ 1324.554004][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1324.554310][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1324.554609][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1324.554937][ C0] ? __copy_skb_header+0xaf/0x490 [ 1324.555203][ C0] ? __skb_clone+0x57a/0x760 [ 1324.555445][ C0] netif_receive_skb+0x55/0x280 [ 1324.555704][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1324.556036][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1324.556385][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1324.556694][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1324.556984][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1324.557286][ C0] ? hlock_class+0x4e/0x130 [ 1324.557535][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1324.557865][ C0] ? place_entity+0x21/0x2f0 [ 1324.558113][ C0] ? resched_curr+0x219/0x280 [ 1324.558366][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1324.558632][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1324.558914][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1324.559194][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1324.559464][ C0] ? activate_task+0xf5/0x260 [ 1324.559715][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1324.559987][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1324.560266][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1324.560523][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1324.560809][ C0] ? get_stack_info+0x36/0xc0 [ 1324.561060][ C0] ? stack_access_ok+0xda/0x1f0 [ 1324.561319][ C0] ? get_reg+0x119/0x190 [ 1324.561549][ C0] __tcf_classify+0x32c/0x7d0 [ 1324.561802][ C0] tcf_classify+0x283/0x930 [ 1324.562041][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1324.562370][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1324.562637][ C0] ? arch_stack_walk+0x8c/0x100 [ 1324.562900][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1324.563193][ C0] tc_run+0x2e4/0x5d0 [ 1324.563409][ C0] ? __pfx_tc_run+0x10/0x10 [ 1324.563651][ C0] ? lock_acquire+0x1c1/0x220 [ 1324.563902][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1324.564175][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1324.564443][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1324.564727][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1324.565001][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1324.565316][ C0] ? neigh_hh_output+0x348/0x590 [ 1324.565580][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1324.565854][ C0] ip_finish_output2+0x786/0x18e0 [ 1324.566120][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1324.566414][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1324.566767][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1324.567056][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1324.567322][ C0] ? __ip_finish_output+0x10f/0x770 [ 1324.567602][ C0] ip_output+0x16b/0x4f0 [ 1324.567832][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1324.568113][ C0] ? __pfx_ip_output+0x10/0x10 [ 1324.568369][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1324.568666][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1324.568933][ C0] ? ip_local_out+0x114/0x3b0 [ 1324.569185][ C0] __ip_queue_xmit+0x672/0x1910 [ 1324.569450][ C0] ? __skb_clone+0x57a/0x760 [ 1324.569699][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1324.569980][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1324.570275][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1324.570592][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1324.570852][ C0] ? tcp_current_mss+0x40a/0x510 [ 1324.571115][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1324.571398][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1324.571673][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1324.571927][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1324.572196][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1324.572521][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1324.572798][ C0] ? ktime_get+0xb6/0x190 [ 1324.573028][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1324.573299][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1324.573582][ C0] tcp_write_timer+0x82/0x1d0 [ 1324.573833][ C0] call_timer_fn+0x176/0x430 [ 1324.574080][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1324.574356][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1324.574630][ C0] __run_timers.part.0+0x52d/0x890 [ 1324.574903][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1324.575184][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1324.575489][ C0] ? lock_acquire+0x1c1/0x220 [ 1324.575738][ C0] ? clockevents_program_event+0xf6/0x300 [ 1324.576041][ C0] ? lock_release+0x1d5/0x250 [ 1324.576287][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1324.576560][ C0] ? ktime_get+0xb6/0x190 [ 1324.576789][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1324.577085][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1324.577398][ C0] run_timer_softirq+0x72/0x100 [ 1324.577655][ C0] __do_softirq+0x1bc/0x7ff [ 1324.577899][ C0] irq_exit_rcu+0x98/0xc0 [ 1324.578128][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1324.578426][ C0] [ 1324.578584][ C0] [ 1324.578747][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1324.579067][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1324.579335][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1324.580362][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1324.580686][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1324.581112][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1324.581537][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1324.581958][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1324.582381][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1324.582808][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1324.583113][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1324.583389][ C0] default_idle_call+0x69/0xa0 [ 1324.583643][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1324.583908][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1324.584198][ C0] ? lock_release+0x1d5/0x250 [ 1324.584453][ C0] do_idle+0xfb/0x160 [ 1324.584672][ C0] cpu_startup_entry+0x55/0x60 [ 1324.584930][ C0] rest_init+0x153/0x260 [ 1324.585157][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1324.585449][ C0] arch_call_rest_init+0x13/0x40 [ 1324.585720][ C0] start_kernel+0x314/0x3d0 [ 1324.585962][ C0] x86_64_start_reservations+0x18/0x30 [ 1324.586255][ C0] x86_64_start_kernel+0xba/0x110 [ 1324.586525][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1324.586862][ C0] [ 1324.587027][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 127s! [ksoftirqd/1:22] [ 1324.587480][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1324.588670][ C1] irq event stamp: 3886976 [ 1324.588907][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 1324.589409][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 1324.589913][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 1324.590413][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 1324.590910][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1324.591402][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1324.592043][ C1] RIP: 0010:kasan_check_range+0x106/0x1c0 [ 1324.592352][ C1] Code: 00 74 f2 48 89 c2 b8 01 00 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff <5b> b8 01 00 00 00 5d 41 5c c3 cc cc cc cc 41 bc 08 00 00 00 45 29 [ 1324.593375][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000246 [ 1324.593698][ C1] RAX: ffffed10014131c4 RBX: ffffed10014131c4 RCX: ffffffff90c7aaa0 [ 1324.594123][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1324.594545][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: ffffed10014131c3 [ 1324.594966][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1324.595382][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1324.595801][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1324.596270][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1324.596622][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1324.597046][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1324.597472][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1324.597894][ C1] Call Trace: [ 1324.598074][ C1] [ 1324.598233][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1324.598513][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1324.598773][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1324.599066][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1324.599356][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1324.599667][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1324.599945][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1324.600270][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1324.600547][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1324.600869][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1324.601183][ C1] [ 1324.601344][ C1] [ 1324.601507][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1324.601839][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1324.602145][ C1] ? kasan_check_range+0x106/0x1c0 [ 1324.602419][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 1324.602721][ C1] ? run_ksoftirqd+0xb/0x60 [ 1324.602972][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1324.603303][ C1] ? __orc_find+0x9c/0xf0 [ 1324.603533][ C1] ? lock_acquire+0x1c1/0x220 [ 1324.603783][ C1] ? irqentry_enter+0x2b/0x60 [ 1324.604035][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1324.604294][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1324.604577][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1324.604880][ C1] ? lock_acquire+0x1c1/0x220 [ 1324.605137][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1324.605396][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1324.605672][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1324.605919][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1324.606177][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1324.606447][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1324.606736][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1324.607025][ C1] ip_local_deliver+0x19d/0x480 [ 1324.607286][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1324.607574][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1324.607842][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1324.608120][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1324.608383][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1324.608726][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1324.608999][ C1] ip_rcv+0x564/0x740 [ 1324.609214][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1324.609464][ C1] ? set_track_prepare+0x8a/0xd0 [ 1324.609732][ C1] ? irqentry_enter+0x2b/0x60 [ 1324.609984][ C1] ? irqentry_enter+0x2b/0x60 [ 1324.610235][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1324.610476][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1324.610789][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1324.611128][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1324.611437][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1324.611781][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1324.612082][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1324.612413][ C1] netif_receive_skb+0x55/0x280 [ 1324.612671][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1324.612996][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1324.613344][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1324.613661][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1324.613950][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1324.614254][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1324.614588][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1324.614872][ C1] ? arch_stack_walk+0x68/0x100 [ 1324.615137][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1324.615418][ C1] ? irqentry_enter+0x2b/0x60 [ 1324.615674][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1324.615995][ C1] ? irqentry_enter+0x2b/0x60 [ 1324.616243][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1324.616562][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1324.616850][ C1] ? arch_stack_walk+0x68/0x100 [ 1324.617111][ C1] __tcf_classify+0x32c/0x7d0 [ 1324.617365][ C1] tcf_classify+0x283/0x930 [ 1324.617612][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1324.617880][ C1] tc_run+0x2e4/0x5d0 [ 1324.618096][ C1] ? __pfx_tc_run+0x10/0x10 [ 1324.618339][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1324.618607][ C1] ? irqentry_enter+0x2b/0x60 [ 1324.618863][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1324.619154][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1324.619484][ C1] ip_finish_output2+0x786/0x18e0 [ 1324.619762][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1324.620057][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1324.620323][ C1] ? __ip_finish_output+0x10f/0x770 [ 1324.620604][ C1] ip_output+0x16b/0x4f0 [ 1324.620837][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1324.621155][ C1] ? __pfx_ip_output+0x10/0x10 [ 1324.621418][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1324.621772][ C1] ? __pfx_ip_output+0x10/0x10 [ 1324.622028][ C1] __ip_queue_xmit+0x672/0x1910 [ 1324.622292][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1324.622577][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1324.622876][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1324.623164][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1324.623462][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1324.623751][ C1] tcp_delack_timer+0x84/0x240 [ 1324.624014][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1324.624300][ C1] call_timer_fn+0x176/0x430 [ 1324.624549][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1324.624827][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1324.625106][ C1] __run_timers.part.0+0x52d/0x890 [ 1324.625383][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1324.625676][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1324.625981][ C1] ? __pfx___schedule+0x10/0x10 [ 1324.626242][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1324.626565][ C1] run_timer_softirq+0x72/0x100 [ 1324.626828][ C1] __do_softirq+0x1bc/0x7ff [ 1324.627077][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1324.627354][ C1] run_ksoftirqd+0x2e/0x60 [ 1324.627590][ C1] smpboot_thread_fn+0x30e/0x840 [ 1324.627857][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1324.628148][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1324.628444][ C1] kthread+0x292/0x360 [ 1324.628663][ C1] ? __pfx_kthread+0x10/0x10 [ 1324.628917][ C1] ret_from_fork+0x34/0x70 [ 1324.629156][ C1] ? __pfx_kthread+0x10/0x10 [ 1324.629404][ C1] ret_from_fork_asm+0x1b/0x30 [ 1324.629671][ C1] [ 1352.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 153s! [swapper/0:0] [ 1352.527920][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1352.529115][ C0] irq event stamp: 27567077 [ 1352.529362][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 1352.529888][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 1352.530364][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 1352.530869][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 1352.531365][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1352.531848][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1352.532487][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1352.532825][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1352.533836][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1352.534157][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1352.534575][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1352.534991][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1352.535408][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1352.535827][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1352.536245][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1352.536711][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1352.537067][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1352.537488][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1352.537908][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1352.538331][ C0] Call Trace: [ 1352.538515][ C0] [ 1352.538673][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1352.538948][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1352.539205][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1352.539501][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1352.539785][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1352.540087][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1352.540365][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1352.540684][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1352.540960][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1352.541236][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1352.541564][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1352.541878][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1352.542207][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1352.542515][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1352.542826][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1352.543129][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1352.543455][ C0] ? get_stack_info+0x36/0xc0 [ 1352.543713][ C0] ? lock_acquire+0x1c1/0x220 [ 1352.543969][ C0] ? lock_release+0x1d5/0x250 [ 1352.544224][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1352.544491][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1352.544781][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1352.545086][ C0] ? lock_acquire+0x1c1/0x220 [ 1352.545333][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1352.545584][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1352.545857][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1352.546106][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1352.546369][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1352.546640][ C0] ? __inet_lookup_established+0x341/0x610 [ 1352.546960][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1352.547250][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1352.547541][ C0] ip_local_deliver+0x19d/0x480 [ 1352.547806][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1352.548093][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1352.548359][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1352.548634][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1352.548895][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1352.549236][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1352.549519][ C0] ip_rcv+0x564/0x740 [ 1352.549733][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1352.549977][ C0] ? set_track_prepare+0x8a/0xd0 [ 1352.550243][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1352.550531][ C0] ? rest_init+0x153/0x260 [ 1352.550770][ C0] ? skb_clone+0x10b/0x330 [ 1352.551010][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1352.551349][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1352.551669][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1352.551963][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1352.552271][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1352.552528][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1352.552766][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1352.553081][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1352.553379][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1352.553721][ C0] ? lock_acquire+0x1c1/0x220 [ 1352.553974][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1352.554288][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1352.554586][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1352.554921][ C0] ? __copy_skb_header+0xaf/0x490 [ 1352.555191][ C0] ? __skb_clone+0x57a/0x760 [ 1352.555440][ C0] netif_receive_skb+0x55/0x280 [ 1352.555697][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1352.556021][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1352.556367][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1352.556681][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1352.556967][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1352.557264][ C0] ? hlock_class+0x4e/0x130 [ 1352.557507][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1352.557836][ C0] ? place_entity+0x21/0x2f0 [ 1352.558084][ C0] ? resched_curr+0x219/0x280 [ 1352.558339][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1352.558608][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1352.558892][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1352.559168][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1352.559432][ C0] ? activate_task+0xf5/0x260 [ 1352.559684][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1352.559963][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1352.560234][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1352.560496][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1352.560789][ C0] ? get_stack_info+0x36/0xc0 [ 1352.561040][ C0] ? stack_access_ok+0xda/0x1f0 [ 1352.561297][ C0] ? get_reg+0x119/0x190 [ 1352.561523][ C0] __tcf_classify+0x32c/0x7d0 [ 1352.561778][ C0] tcf_classify+0x283/0x930 [ 1352.562022][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1352.562353][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1352.562617][ C0] ? arch_stack_walk+0x8c/0x100 [ 1352.562879][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1352.563168][ C0] tc_run+0x2e4/0x5d0 [ 1352.563384][ C0] ? __pfx_tc_run+0x10/0x10 [ 1352.563628][ C0] ? lock_acquire+0x1c1/0x220 [ 1352.563880][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1352.564156][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1352.564422][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1352.564709][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1352.564989][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1352.565310][ C0] ? neigh_hh_output+0x348/0x590 [ 1352.565574][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1352.565857][ C0] ip_finish_output2+0x786/0x18e0 [ 1352.566130][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1352.566424][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1352.566777][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1352.567067][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1352.567335][ C0] ? __ip_finish_output+0x10f/0x770 [ 1352.567610][ C0] ip_output+0x16b/0x4f0 [ 1352.567835][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1352.568121][ C0] ? __pfx_ip_output+0x10/0x10 [ 1352.568375][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1352.568679][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1352.568941][ C0] ? ip_local_out+0x114/0x3b0 [ 1352.569194][ C0] __ip_queue_xmit+0x672/0x1910 [ 1352.569457][ C0] ? __skb_clone+0x57a/0x760 [ 1352.569704][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1352.569988][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1352.570283][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1352.570605][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1352.570861][ C0] ? tcp_current_mss+0x40a/0x510 [ 1352.571125][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1352.571402][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1352.571679][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1352.571934][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1352.572200][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1352.572515][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1352.572794][ C0] ? ktime_get+0xb6/0x190 [ 1352.573029][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1352.573304][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1352.573581][ C0] tcp_write_timer+0x82/0x1d0 [ 1352.573835][ C0] call_timer_fn+0x176/0x430 [ 1352.574085][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1352.574358][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1352.574632][ C0] __run_timers.part.0+0x52d/0x890 [ 1352.574902][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1352.575186][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1352.575489][ C0] ? lock_acquire+0x1c1/0x220 [ 1352.575741][ C0] ? clockevents_program_event+0xf6/0x300 [ 1352.576053][ C0] ? lock_release+0x1d5/0x250 [ 1352.576307][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1352.576586][ C0] ? ktime_get+0xb6/0x190 [ 1352.576820][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1352.577121][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1352.577429][ C0] run_timer_softirq+0x72/0x100 [ 1352.577689][ C0] __do_softirq+0x1bc/0x7ff [ 1352.577934][ C0] irq_exit_rcu+0x98/0xc0 [ 1352.578167][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1352.578469][ C0] [ 1352.578625][ C0] [ 1352.578782][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1352.579103][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1352.579380][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1352.580396][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1352.580718][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1352.581136][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1352.581554][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1352.581973][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1352.582392][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1352.582811][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1352.583113][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1352.583386][ C0] default_idle_call+0x69/0xa0 [ 1352.583641][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1352.583903][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1352.584198][ C0] ? lock_release+0x1d5/0x250 [ 1352.584449][ C0] do_idle+0xfb/0x160 [ 1352.584660][ C0] cpu_startup_entry+0x55/0x60 [ 1352.584912][ C0] rest_init+0x153/0x260 [ 1352.585147][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1352.585439][ C0] arch_call_rest_init+0x13/0x40 [ 1352.585703][ C0] start_kernel+0x314/0x3d0 [ 1352.585947][ C0] x86_64_start_reservations+0x18/0x30 [ 1352.586241][ C0] x86_64_start_kernel+0xba/0x110 [ 1352.586508][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1352.586831][ C0] [ 1352.586993][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 153s! [ksoftirqd/1:22] [ 1352.587448][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1352.588656][ C1] irq event stamp: 3886976 [ 1352.588896][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 1352.589399][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 1352.589900][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 1352.590405][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 1352.590895][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1352.591397][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1352.592046][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1352.592392][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1352.593420][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1352.593747][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1352.594173][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1352.594600][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1352.595022][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1352.595449][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1352.595875][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1352.596354][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1352.596702][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1352.597131][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1352.597554][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1352.597972][ C1] Call Trace: [ 1352.598150][ C1] [ 1352.598306][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1352.598587][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1352.598845][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1352.599140][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1352.599438][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1352.599744][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1352.600026][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1352.600353][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1352.600629][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1352.600959][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1352.601275][ C1] [ 1352.601432][ C1] [ 1352.601589][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1352.601916][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1352.602224][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1352.602538][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1352.602839][ C1] ? run_ksoftirqd+0xb/0x60 [ 1352.603081][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1352.603405][ C1] ? __orc_find+0x9c/0xf0 [ 1352.603640][ C1] ? lock_acquire+0x1c1/0x220 [ 1352.603894][ C1] ? irqentry_enter+0x2b/0x60 [ 1352.604149][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1352.604412][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1352.604701][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1352.605005][ C1] ? lock_acquire+0x1c1/0x220 [ 1352.605255][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1352.605508][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1352.605780][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1352.606030][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1352.606291][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1352.606570][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1352.606863][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1352.607157][ C1] ip_local_deliver+0x19d/0x480 [ 1352.607416][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1352.607698][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1352.607961][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1352.608242][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1352.608510][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1352.608847][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1352.609125][ C1] ip_rcv+0x564/0x740 [ 1352.609350][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1352.609595][ C1] ? set_track_prepare+0x8a/0xd0 [ 1352.609860][ C1] ? irqentry_enter+0x2b/0x60 [ 1352.610118][ C1] ? irqentry_enter+0x2b/0x60 [ 1352.610371][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1352.610612][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1352.610927][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1352.611268][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1352.611583][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1352.611930][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1352.612232][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1352.612565][ C1] netif_receive_skb+0x55/0x280 [ 1352.612822][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1352.613155][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1352.613506][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1352.613825][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1352.614116][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1352.614426][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1352.614757][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1352.615040][ C1] ? arch_stack_walk+0x68/0x100 [ 1352.615305][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1352.615586][ C1] ? irqentry_enter+0x2b/0x60 [ 1352.615843][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1352.616170][ C1] ? irqentry_enter+0x2b/0x60 [ 1352.616418][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1352.616739][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1352.617022][ C1] ? arch_stack_walk+0x68/0x100 [ 1352.617285][ C1] __tcf_classify+0x32c/0x7d0 [ 1352.617539][ C1] tcf_classify+0x283/0x930 [ 1352.617780][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1352.618048][ C1] tc_run+0x2e4/0x5d0 [ 1352.618263][ C1] ? __pfx_tc_run+0x10/0x10 [ 1352.618510][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1352.618778][ C1] ? irqentry_enter+0x2b/0x60 [ 1352.619036][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1352.619333][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1352.619655][ C1] ip_finish_output2+0x786/0x18e0 [ 1352.619933][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1352.620227][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1352.620493][ C1] ? __ip_finish_output+0x10f/0x770 [ 1352.620777][ C1] ip_output+0x16b/0x4f0 [ 1352.621006][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1352.621326][ C1] ? __pfx_ip_output+0x10/0x10 [ 1352.621585][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1352.621938][ C1] ? __pfx_ip_output+0x10/0x10 [ 1352.622196][ C1] __ip_queue_xmit+0x672/0x1910 [ 1352.622461][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1352.622746][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1352.623045][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1352.623334][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1352.623633][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1352.623924][ C1] tcp_delack_timer+0x84/0x240 [ 1352.624185][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1352.624471][ C1] call_timer_fn+0x176/0x430 [ 1352.624720][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1352.625000][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1352.625279][ C1] __run_timers.part.0+0x52d/0x890 [ 1352.625551][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1352.625844][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1352.626150][ C1] ? __pfx___schedule+0x10/0x10 [ 1352.626410][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1352.626733][ C1] run_timer_softirq+0x72/0x100 [ 1352.626996][ C1] __do_softirq+0x1bc/0x7ff [ 1352.627245][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1352.627522][ C1] run_ksoftirqd+0x2e/0x60 [ 1352.627759][ C1] smpboot_thread_fn+0x30e/0x840 [ 1352.628032][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1352.628320][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1352.628615][ C1] kthread+0x292/0x360 [ 1352.628834][ C1] ? __pfx_kthread+0x10/0x10 [ 1352.629084][ C1] ret_from_fork+0x34/0x70 [ 1352.629327][ C1] ? __pfx_kthread+0x10/0x10 [ 1352.629571][ C1] ret_from_fork_asm+0x1b/0x30 [ 1352.629833][ C1] [ 1376.435023][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 1376.435415][ C0] rcu: 0-....: (183660 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=45143 [ 1376.435927][ C0] rcu: (t=182126 jiffies g=1007429 q=31 ncpus=4) [ 1376.436267][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1376.436744][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1376.437391][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1376.437746][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1376.438775][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1376.439099][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1376.439519][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1376.439934][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1376.440348][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1376.440762][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1376.441175][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1376.441641][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1376.441990][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1376.442408][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1376.442831][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1376.443258][ C0] Call Trace: [ 1376.443438][ C0] [ 1376.443595][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 1376.443884][ C0] ? print_cpu_stall+0x263/0x6a0 [ 1376.444151][ C0] ? check_cpu_stall+0x284/0x500 [ 1376.444414][ C0] ? rcu_pending+0x92/0x360 [ 1376.444658][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 1376.444943][ C0] ? update_process_times+0xb9/0x110 [ 1376.445224][ C0] ? tick_sched_handle+0x67/0x130 [ 1376.445496][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 1376.445797][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1376.446051][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 1376.446381][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1376.446666][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1376.446972][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1376.447249][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1376.447570][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1376.447845][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1376.448119][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1376.448448][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1376.448759][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1376.449088][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1376.449396][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1376.449705][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1376.450009][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1376.450338][ C0] ? get_stack_info+0x36/0xc0 [ 1376.450588][ C0] ? lock_acquire+0x1c1/0x220 [ 1376.450842][ C0] ? lock_release+0x1d5/0x250 [ 1376.451089][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1376.451346][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1376.451627][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1376.451925][ C0] ? lock_acquire+0x1c1/0x220 [ 1376.452178][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1376.452436][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1376.452709][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1376.452953][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1376.453208][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1376.453475][ C0] ? __inet_lookup_established+0x341/0x610 [ 1376.453785][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1376.454077][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1376.454368][ C0] ip_local_deliver+0x19d/0x480 [ 1376.454626][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1376.454909][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1376.455174][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1376.455456][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1376.455721][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1376.456054][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1376.456332][ C0] ip_rcv+0x564/0x740 [ 1376.456546][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1376.456791][ C0] ? set_track_prepare+0x8a/0xd0 [ 1376.457062][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1376.457347][ C0] ? rest_init+0x153/0x260 [ 1376.457585][ C0] ? skb_clone+0x10b/0x330 [ 1376.457826][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1376.458161][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1376.458482][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1376.458780][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1376.459090][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1376.459357][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1376.459601][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1376.459915][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1376.460215][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1376.460553][ C0] ? lock_acquire+0x1c1/0x220 [ 1376.460802][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1376.461108][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1376.461413][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1376.461742][ C0] ? __copy_skb_header+0xaf/0x490 [ 1376.462007][ C0] ? __skb_clone+0x57a/0x760 [ 1376.462250][ C0] netif_receive_skb+0x55/0x280 [ 1376.462510][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1376.462842][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1376.463191][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1376.463502][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1376.463793][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1376.464094][ C0] ? hlock_class+0x4e/0x130 [ 1376.464344][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1376.464674][ C0] ? place_entity+0x21/0x2f0 [ 1376.464923][ C0] ? resched_curr+0x219/0x280 [ 1376.465170][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1376.465436][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1376.465719][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1376.465999][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1376.466263][ C0] ? activate_task+0xf5/0x260 [ 1376.466518][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1376.466798][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1376.467068][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1376.467328][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1376.467619][ C0] ? get_stack_info+0x36/0xc0 [ 1376.467867][ C0] ? stack_access_ok+0xda/0x1f0 [ 1376.468122][ C0] ? get_reg+0x119/0x190 [ 1376.468348][ C0] __tcf_classify+0x32c/0x7d0 [ 1376.468601][ C0] tcf_classify+0x283/0x930 [ 1376.468845][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1376.469185][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1376.469453][ C0] ? arch_stack_walk+0x8c/0x100 [ 1376.469716][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1376.470009][ C0] tc_run+0x2e4/0x5d0 [ 1376.470226][ C0] ? __pfx_tc_run+0x10/0x10 [ 1376.470469][ C0] ? lock_acquire+0x1c1/0x220 [ 1376.470718][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1376.470991][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1376.471261][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1376.471545][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1376.471825][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1376.472142][ C0] ? neigh_hh_output+0x348/0x590 [ 1376.472407][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1376.472682][ C0] ip_finish_output2+0x786/0x18e0 [ 1376.472948][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1376.473242][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1376.473596][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1376.473885][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1376.474150][ C0] ? __ip_finish_output+0x10f/0x770 [ 1376.474433][ C0] ip_output+0x16b/0x4f0 [ 1376.474663][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1376.474942][ C0] ? __pfx_ip_output+0x10/0x10 [ 1376.475198][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1376.475495][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1376.475761][ C0] ? ip_local_out+0x114/0x3b0 [ 1376.476011][ C0] __ip_queue_xmit+0x672/0x1910 [ 1376.476270][ C0] ? __skb_clone+0x57a/0x760 [ 1376.476514][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1376.476798][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1376.477095][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1376.477416][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1376.477674][ C0] ? tcp_current_mss+0x40a/0x510 [ 1376.477939][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1376.478217][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1376.478496][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1376.478751][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1376.479016][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1376.479337][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1376.479613][ C0] ? ktime_get+0xb6/0x190 [ 1376.479845][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1376.480114][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1376.480396][ C0] tcp_write_timer+0x82/0x1d0 [ 1376.480646][ C0] call_timer_fn+0x176/0x430 [ 1376.480894][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1376.481168][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1376.481438][ C0] __run_timers.part.0+0x52d/0x890 [ 1376.481713][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1376.481994][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1376.482296][ C0] ? lock_acquire+0x1c1/0x220 [ 1376.482545][ C0] ? clockevents_program_event+0xf6/0x300 [ 1376.482848][ C0] ? lock_release+0x1d5/0x250 [ 1376.483095][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1376.483372][ C0] ? ktime_get+0xb6/0x190 [ 1376.483602][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1376.483899][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1376.484214][ C0] run_timer_softirq+0x72/0x100 [ 1376.484473][ C0] __do_softirq+0x1bc/0x7ff [ 1376.484717][ C0] irq_exit_rcu+0x98/0xc0 [ 1376.484947][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1376.485246][ C0] [ 1376.485405][ C0] [ 1376.485565][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1376.485888][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1376.486155][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1376.487172][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1376.487493][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1376.487909][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1376.488324][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1376.488738][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1376.489154][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1376.489584][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1376.489893][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1376.490168][ C0] default_idle_call+0x69/0xa0 [ 1376.490425][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1376.490689][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1376.490977][ C0] ? lock_release+0x1d5/0x250 [ 1376.491232][ C0] do_idle+0xfb/0x160 [ 1376.491451][ C0] cpu_startup_entry+0x55/0x60 [ 1376.491710][ C0] rest_init+0x153/0x260 [ 1376.491934][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1376.492225][ C0] arch_call_rest_init+0x13/0x40 [ 1376.492494][ C0] start_kernel+0x314/0x3d0 [ 1376.492736][ C0] x86_64_start_reservations+0x18/0x30 [ 1376.493028][ C0] x86_64_start_kernel+0xba/0x110 [ 1376.493297][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1376.493631][ C0] [ 1376.493801][ C0] Sending NMI from CPU 0 to CPUs 1: [ 1376.494087][ C1] NMI backtrace for cpu 1 [ 1376.494093][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1376.494097][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1376.494099][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1376.494105][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1376.494108][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1376.494111][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1376.494113][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1376.494114][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1376.494115][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1376.494117][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1376.494119][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1376.494120][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1376.494124][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1376.494125][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1376.494127][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1376.494128][ C1] Call Trace: [ 1376.494130][ C1] [ 1376.494134][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 1376.494140][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 1376.494145][ C1] ? nmi_handle+0x156/0x420 [ 1376.494150][ C1] ? default_do_nmi+0x41/0x100 [ 1376.494153][ C1] ? exc_nmi+0xf3/0x120 [ 1376.494156][ C1] ? end_repeat_nmi+0xf/0x60 [ 1376.494160][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1376.494164][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1376.494167][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1376.494171][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1376.494174][ C1] [ 1376.494175][ C1] [ 1376.494176][ C1] ? run_ksoftirqd+0xb/0x60 [ 1376.494181][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1376.494184][ C1] ? __orc_find+0x9c/0xf0 [ 1376.494186][ C1] ? lock_acquire+0x1c1/0x220 [ 1376.494190][ C1] ? irqentry_enter+0x2b/0x60 [ 1376.494195][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1376.494199][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1376.494201][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1376.494205][ C1] ? lock_acquire+0x1c1/0x220 [ 1376.494207][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1376.494211][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1376.494215][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1376.494223][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1376.494225][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1376.494231][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1376.494237][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1376.494241][ C1] ip_local_deliver+0x19d/0x480 [ 1376.494244][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1376.494246][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1376.494250][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1376.494254][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1376.494256][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1376.494260][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1376.494269][ C1] ip_rcv+0x564/0x740 [ 1376.494272][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1376.494275][ C1] ? set_track_prepare+0x8a/0xd0 [ 1376.494279][ C1] ? irqentry_enter+0x2b/0x60 [ 1376.494282][ C1] ? irqentry_enter+0x2b/0x60 [ 1376.494286][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1376.494288][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1376.494292][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1376.494295][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1376.494297][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1376.494300][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1376.494303][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1376.494308][ C1] netif_receive_skb+0x55/0x280 [ 1376.494311][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1376.494319][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1376.494326][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1376.494333][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1376.494339][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1376.494350][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1376.494360][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1376.494363][ C1] ? arch_stack_walk+0x68/0x100 [ 1376.494368][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1376.494371][ C1] ? irqentry_enter+0x2b/0x60 [ 1376.494374][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1376.494379][ C1] ? irqentry_enter+0x2b/0x60 [ 1376.494382][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1376.494390][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1376.494392][ C1] ? arch_stack_walk+0x68/0x100 [ 1376.494396][ C1] __tcf_classify+0x32c/0x7d0 [ 1376.494401][ C1] tcf_classify+0x283/0x930 [ 1376.494405][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1376.494409][ C1] tc_run+0x2e4/0x5d0 [ 1376.494413][ C1] ? __pfx_tc_run+0x10/0x10 [ 1376.494418][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1376.494423][ C1] ? irqentry_enter+0x2b/0x60 [ 1376.494426][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1376.494429][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1376.494435][ C1] ip_finish_output2+0x786/0x18e0 [ 1376.494440][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1376.494443][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1376.494447][ C1] ? __ip_finish_output+0x10f/0x770 [ 1376.494451][ C1] ip_output+0x16b/0x4f0 [ 1376.494454][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1376.494457][ C1] ? __pfx_ip_output+0x10/0x10 [ 1376.494461][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1376.494468][ C1] ? __pfx_ip_output+0x10/0x10 [ 1376.494473][ C1] __ip_queue_xmit+0x672/0x1910 [ 1376.494478][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1376.494485][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1376.494489][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1376.494493][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1376.494497][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1376.494500][ C1] tcp_delack_timer+0x84/0x240 [ 1376.494503][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1376.494506][ C1] call_timer_fn+0x176/0x430 [ 1376.494510][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1376.494515][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1376.494518][ C1] __run_timers.part.0+0x52d/0x890 [ 1376.494521][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1376.494526][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1376.494531][ C1] ? __pfx___schedule+0x10/0x10 [ 1376.494535][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1376.494539][ C1] run_timer_softirq+0x72/0x100 [ 1376.494543][ C1] __do_softirq+0x1bc/0x7ff [ 1376.494547][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1376.494550][ C1] run_ksoftirqd+0x2e/0x60 [ 1376.494553][ C1] smpboot_thread_fn+0x30e/0x840 [ 1376.494557][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1376.494561][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1376.494563][ C1] kthread+0x292/0x360 [ 1376.494566][ C1] ? __pfx_kthread+0x10/0x10 [ 1376.494568][ C1] ret_from_fork+0x34/0x70 [ 1376.494571][ C1] ? __pfx_kthread+0x10/0x10 [ 1376.494573][ C1] ret_from_fork_asm+0x1b/0x30 [ 1376.494581][ C1] [ 1400.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 198s! [swapper/0:0] [ 1400.527922][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1400.529132][ C0] irq event stamp: 27567077 [ 1400.529372][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 1400.529899][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 1400.530378][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 1400.530885][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 1400.531383][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1400.531873][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1400.532514][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1400.532854][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1400.533865][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1400.534187][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1400.534604][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1400.535021][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1400.535441][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1400.535858][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1400.536274][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1400.536740][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1400.537095][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1400.537519][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1400.537942][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1400.538362][ C0] Call Trace: [ 1400.538544][ C0] [ 1400.538701][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1400.538975][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1400.539242][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1400.539535][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1400.539819][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1400.540122][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1400.540399][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1400.540717][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1400.540993][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1400.541271][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1400.541599][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1400.541914][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1400.542244][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1400.542552][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1400.542863][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1400.543165][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1400.543492][ C0] ? get_stack_info+0x36/0xc0 [ 1400.543749][ C0] ? lock_acquire+0x1c1/0x220 [ 1400.544005][ C0] ? lock_release+0x1d5/0x250 [ 1400.544261][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1400.544527][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1400.544816][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1400.545118][ C0] ? lock_acquire+0x1c1/0x220 [ 1400.545366][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1400.545619][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1400.545891][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1400.546141][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1400.546405][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1400.546676][ C0] ? __inet_lookup_established+0x341/0x610 [ 1400.546995][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1400.547285][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1400.547577][ C0] ip_local_deliver+0x19d/0x480 [ 1400.547840][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1400.548126][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1400.548393][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1400.548668][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1400.548930][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1400.549276][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1400.549556][ C0] ip_rcv+0x564/0x740 [ 1400.549770][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1400.550014][ C0] ? set_track_prepare+0x8a/0xd0 [ 1400.550280][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1400.550567][ C0] ? rest_init+0x153/0x260 [ 1400.550807][ C0] ? skb_clone+0x10b/0x330 [ 1400.551048][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1400.551385][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1400.551706][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1400.551999][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1400.552307][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1400.552563][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1400.552802][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1400.553120][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1400.553417][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1400.553760][ C0] ? lock_acquire+0x1c1/0x220 [ 1400.554010][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1400.554324][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1400.554621][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1400.554956][ C0] ? __copy_skb_header+0xaf/0x490 [ 1400.555226][ C0] ? __skb_clone+0x57a/0x760 [ 1400.555474][ C0] netif_receive_skb+0x55/0x280 [ 1400.555731][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1400.556057][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1400.556404][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1400.556718][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1400.557007][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1400.557304][ C0] ? hlock_class+0x4e/0x130 [ 1400.557548][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1400.557878][ C0] ? place_entity+0x21/0x2f0 [ 1400.558126][ C0] ? resched_curr+0x219/0x280 [ 1400.558382][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1400.558652][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1400.558940][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1400.559227][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1400.559489][ C0] ? activate_task+0xf5/0x260 [ 1400.559743][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1400.560021][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1400.560292][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1400.560554][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1400.560848][ C0] ? get_stack_info+0x36/0xc0 [ 1400.561100][ C0] ? stack_access_ok+0xda/0x1f0 [ 1400.561358][ C0] ? get_reg+0x119/0x190 [ 1400.561584][ C0] __tcf_classify+0x32c/0x7d0 [ 1400.561840][ C0] tcf_classify+0x283/0x930 [ 1400.562085][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1400.562417][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1400.562682][ C0] ? arch_stack_walk+0x8c/0x100 [ 1400.562945][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1400.563235][ C0] tc_run+0x2e4/0x5d0 [ 1400.563452][ C0] ? __pfx_tc_run+0x10/0x10 [ 1400.563697][ C0] ? lock_acquire+0x1c1/0x220 [ 1400.563949][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1400.564227][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1400.564493][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1400.564781][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1400.565064][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1400.565389][ C0] ? neigh_hh_output+0x348/0x590 [ 1400.565656][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1400.565936][ C0] ip_finish_output2+0x786/0x18e0 [ 1400.566209][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1400.566504][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1400.566857][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1400.567148][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1400.567414][ C0] ? __ip_finish_output+0x10f/0x770 [ 1400.567690][ C0] ip_output+0x16b/0x4f0 [ 1400.567915][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1400.568201][ C0] ? __pfx_ip_output+0x10/0x10 [ 1400.568455][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1400.568761][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1400.569024][ C0] ? ip_local_out+0x114/0x3b0 [ 1400.569280][ C0] __ip_queue_xmit+0x672/0x1910 [ 1400.569538][ C0] ? __skb_clone+0x57a/0x760 [ 1400.569780][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1400.570066][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1400.570363][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1400.570685][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1400.570943][ C0] ? tcp_current_mss+0x40a/0x510 [ 1400.571207][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1400.571490][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1400.571768][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1400.572023][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1400.572290][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1400.572605][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1400.572885][ C0] ? ktime_get+0xb6/0x190 [ 1400.573120][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1400.573394][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1400.573672][ C0] tcp_write_timer+0x82/0x1d0 [ 1400.573925][ C0] call_timer_fn+0x176/0x430 [ 1400.574174][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1400.574447][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1400.574721][ C0] __run_timers.part.0+0x52d/0x890 [ 1400.574991][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1400.575275][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1400.575573][ C0] ? lock_acquire+0x1c1/0x220 [ 1400.575823][ C0] ? clockevents_program_event+0xf6/0x300 [ 1400.576132][ C0] ? lock_release+0x1d5/0x250 [ 1400.576386][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1400.576666][ C0] ? ktime_get+0xb6/0x190 [ 1400.576900][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1400.577202][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1400.577511][ C0] run_timer_softirq+0x72/0x100 [ 1400.577773][ C0] __do_softirq+0x1bc/0x7ff [ 1400.578019][ C0] irq_exit_rcu+0x98/0xc0 [ 1400.578252][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1400.578554][ C0] [ 1400.578712][ C0] [ 1400.578868][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1400.579199][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1400.579466][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1400.580480][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1400.580802][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1400.581220][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1400.581635][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1400.582053][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1400.582470][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1400.582887][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1400.583189][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1400.583460][ C0] default_idle_call+0x69/0xa0 [ 1400.583715][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1400.583977][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1400.584272][ C0] ? lock_release+0x1d5/0x250 [ 1400.584523][ C0] do_idle+0xfb/0x160 [ 1400.584737][ C0] cpu_startup_entry+0x55/0x60 [ 1400.584988][ C0] rest_init+0x153/0x260 [ 1400.585217][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1400.585504][ C0] arch_call_rest_init+0x13/0x40 [ 1400.585769][ C0] start_kernel+0x314/0x3d0 [ 1400.586014][ C0] x86_64_start_reservations+0x18/0x30 [ 1400.586309][ C0] x86_64_start_kernel+0xba/0x110 [ 1400.586578][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1400.586905][ C0] [ 1400.587068][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 198s! [ksoftirqd/1:22] [ 1400.587522][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1400.588729][ C1] irq event stamp: 3886976 [ 1400.588969][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 1400.589481][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 1400.589983][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 1400.590490][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 1400.590979][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1400.591483][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1400.592134][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1400.592481][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1400.593514][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1400.593843][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1400.594269][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1400.594697][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1400.595118][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1400.595540][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1400.595966][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1400.596442][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1400.596789][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1400.597222][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1400.597645][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1400.598065][ C1] Call Trace: [ 1400.598242][ C1] [ 1400.598397][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1400.598679][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1400.598937][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1400.599244][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1400.599538][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1400.599849][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1400.600132][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1400.600459][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1400.600734][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1400.601064][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1400.601381][ C1] [ 1400.601538][ C1] [ 1400.601695][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1400.602023][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1400.602334][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1400.602646][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1400.602949][ C1] ? run_ksoftirqd+0xb/0x60 [ 1400.603196][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1400.603521][ C1] ? __orc_find+0x9c/0xf0 [ 1400.603757][ C1] ? lock_acquire+0x1c1/0x220 [ 1400.604011][ C1] ? irqentry_enter+0x2b/0x60 [ 1400.604270][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1400.604532][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1400.604821][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1400.605124][ C1] ? lock_acquire+0x1c1/0x220 [ 1400.605375][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1400.605628][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1400.605901][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1400.606153][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1400.606413][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1400.606689][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1400.606983][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1400.607287][ C1] ip_local_deliver+0x19d/0x480 [ 1400.607546][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1400.607830][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1400.608094][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1400.608376][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1400.608648][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1400.608990][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1400.609275][ C1] ip_rcv+0x564/0x740 [ 1400.609498][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1400.609740][ C1] ? set_track_prepare+0x8a/0xd0 [ 1400.610004][ C1] ? irqentry_enter+0x2b/0x60 [ 1400.610262][ C1] ? irqentry_enter+0x2b/0x60 [ 1400.610517][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1400.610763][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1400.611086][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1400.611430][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1400.611748][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1400.612089][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1400.612388][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1400.612726][ C1] netif_receive_skb+0x55/0x280 [ 1400.612991][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1400.613325][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1400.613677][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1400.613992][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1400.614288][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1400.614595][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1400.614930][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1400.615217][ C1] ? arch_stack_walk+0x68/0x100 [ 1400.615480][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1400.615758][ C1] ? irqentry_enter+0x2b/0x60 [ 1400.616012][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1400.616332][ C1] ? irqentry_enter+0x2b/0x60 [ 1400.616586][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1400.616915][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1400.617198][ C1] ? arch_stack_walk+0x68/0x100 [ 1400.617463][ C1] __tcf_classify+0x32c/0x7d0 [ 1400.617720][ C1] tcf_classify+0x283/0x930 [ 1400.617968][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1400.618242][ C1] tc_run+0x2e4/0x5d0 [ 1400.618461][ C1] ? __pfx_tc_run+0x10/0x10 [ 1400.618709][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1400.618980][ C1] ? irqentry_enter+0x2b/0x60 [ 1400.619252][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1400.619543][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1400.619870][ C1] ip_finish_output2+0x786/0x18e0 [ 1400.620141][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1400.620433][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1400.620703][ C1] ? __ip_finish_output+0x10f/0x770 [ 1400.620981][ C1] ip_output+0x16b/0x4f0 [ 1400.621209][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1400.621531][ C1] ? __pfx_ip_output+0x10/0x10 [ 1400.621786][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1400.622148][ C1] ? __pfx_ip_output+0x10/0x10 [ 1400.622409][ C1] __ip_queue_xmit+0x672/0x1910 [ 1400.622670][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1400.622950][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1400.623251][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1400.623536][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1400.623830][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1400.624114][ C1] tcp_delack_timer+0x84/0x240 [ 1400.624368][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1400.624657][ C1] call_timer_fn+0x176/0x430 [ 1400.624909][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1400.625183][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1400.625466][ C1] __run_timers.part.0+0x52d/0x890 [ 1400.625741][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1400.626026][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1400.626328][ C1] ? __pfx___schedule+0x10/0x10 [ 1400.626592][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1400.626919][ C1] run_timer_softirq+0x72/0x100 [ 1400.627180][ C1] __do_softirq+0x1bc/0x7ff [ 1400.627425][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1400.627703][ C1] run_ksoftirqd+0x2e/0x60 [ 1400.627945][ C1] smpboot_thread_fn+0x30e/0x840 [ 1400.628215][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1400.628508][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1400.628798][ C1] kthread+0x292/0x360 [ 1400.629029][ C1] ? __pfx_kthread+0x10/0x10 [ 1400.629287][ C1] ret_from_fork+0x34/0x70 [ 1400.629527][ C1] ? __pfx_kthread+0x10/0x10 [ 1400.629776][ C1] ret_from_fork_asm+0x1b/0x30 [ 1400.630035][ C1] [ 1428.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 224s! [swapper/0:0] [ 1428.527918][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1428.529124][ C0] irq event stamp: 27567077 [ 1428.529361][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 1428.529887][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 1428.530363][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 1428.530870][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 1428.531370][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1428.531856][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1428.532497][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1428.532834][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1428.533848][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1428.534174][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1428.534592][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1428.535010][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1428.535432][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1428.535850][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1428.536270][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1428.536743][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1428.537096][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1428.537515][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1428.537935][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1428.538360][ C0] Call Trace: [ 1428.538547][ C0] [ 1428.538705][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1428.538988][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1428.539247][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1428.539539][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1428.539822][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1428.540123][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1428.540401][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1428.540719][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1428.540996][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1428.541272][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1428.541597][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1428.541912][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1428.542242][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1428.542549][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1428.542859][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1428.543161][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1428.543488][ C0] ? get_stack_info+0x36/0xc0 [ 1428.543746][ C0] ? lock_acquire+0x1c1/0x220 [ 1428.544003][ C0] ? lock_release+0x1d5/0x250 [ 1428.544260][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1428.544523][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1428.544809][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1428.545109][ C0] ? lock_acquire+0x1c1/0x220 [ 1428.545355][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1428.545604][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1428.545874][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1428.546125][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1428.546387][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1428.546657][ C0] ? __inet_lookup_established+0x341/0x610 [ 1428.546973][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1428.547262][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1428.547551][ C0] ip_local_deliver+0x19d/0x480 [ 1428.547810][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1428.548096][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1428.548366][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1428.548640][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1428.548902][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1428.549246][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1428.549523][ C0] ip_rcv+0x564/0x740 [ 1428.549740][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1428.549983][ C0] ? set_track_prepare+0x8a/0xd0 [ 1428.550251][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1428.550539][ C0] ? rest_init+0x153/0x260 [ 1428.550778][ C0] ? skb_clone+0x10b/0x330 [ 1428.551016][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1428.551356][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1428.551681][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1428.551976][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1428.552284][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1428.552542][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1428.552786][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1428.553103][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1428.553399][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1428.553742][ C0] ? lock_acquire+0x1c1/0x220 [ 1428.553995][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1428.554308][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1428.554605][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1428.554939][ C0] ? __copy_skb_header+0xaf/0x490 [ 1428.555211][ C0] ? __skb_clone+0x57a/0x760 [ 1428.555460][ C0] netif_receive_skb+0x55/0x280 [ 1428.555718][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1428.556044][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1428.556394][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1428.556709][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1428.556994][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1428.557293][ C0] ? hlock_class+0x4e/0x130 [ 1428.557537][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1428.557863][ C0] ? place_entity+0x21/0x2f0 [ 1428.558109][ C0] ? resched_curr+0x219/0x280 [ 1428.558363][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1428.558632][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1428.558922][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1428.559204][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1428.559466][ C0] ? activate_task+0xf5/0x260 [ 1428.559719][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1428.559998][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1428.560270][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1428.560535][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1428.560832][ C0] ? get_stack_info+0x36/0xc0 [ 1428.561085][ C0] ? stack_access_ok+0xda/0x1f0 [ 1428.561342][ C0] ? get_reg+0x119/0x190 [ 1428.561570][ C0] __tcf_classify+0x32c/0x7d0 [ 1428.561826][ C0] tcf_classify+0x283/0x930 [ 1428.562071][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1428.562401][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1428.562665][ C0] ? arch_stack_walk+0x8c/0x100 [ 1428.562925][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1428.563213][ C0] tc_run+0x2e4/0x5d0 [ 1428.563433][ C0] ? __pfx_tc_run+0x10/0x10 [ 1428.563677][ C0] ? lock_acquire+0x1c1/0x220 [ 1428.563929][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1428.564206][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1428.564471][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1428.564759][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1428.565038][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1428.565368][ C0] ? neigh_hh_output+0x348/0x590 [ 1428.565632][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1428.565913][ C0] ip_finish_output2+0x786/0x18e0 [ 1428.566184][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1428.566478][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1428.566830][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1428.567118][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1428.567384][ C0] ? __ip_finish_output+0x10f/0x770 [ 1428.567660][ C0] ip_output+0x16b/0x4f0 [ 1428.567888][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1428.568175][ C0] ? __pfx_ip_output+0x10/0x10 [ 1428.568430][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1428.568737][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1428.569005][ C0] ? ip_local_out+0x114/0x3b0 [ 1428.569256][ C0] __ip_queue_xmit+0x672/0x1910 [ 1428.569515][ C0] ? __skb_clone+0x57a/0x760 [ 1428.569761][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1428.570046][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1428.570344][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1428.570665][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1428.570921][ C0] ? tcp_current_mss+0x40a/0x510 [ 1428.571190][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1428.571471][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1428.571749][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1428.572004][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1428.572271][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1428.572589][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1428.572870][ C0] ? ktime_get+0xb6/0x190 [ 1428.573107][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1428.573382][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1428.573663][ C0] tcp_write_timer+0x82/0x1d0 [ 1428.573918][ C0] call_timer_fn+0x176/0x430 [ 1428.574168][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1428.574440][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1428.574716][ C0] __run_timers.part.0+0x52d/0x890 [ 1428.574987][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1428.575273][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1428.575569][ C0] ? lock_acquire+0x1c1/0x220 [ 1428.575823][ C0] ? clockevents_program_event+0xf6/0x300 [ 1428.576133][ C0] ? lock_release+0x1d5/0x250 [ 1428.576386][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1428.576666][ C0] ? ktime_get+0xb6/0x190 [ 1428.576899][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1428.577203][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1428.577511][ C0] run_timer_softirq+0x72/0x100 [ 1428.577773][ C0] __do_softirq+0x1bc/0x7ff [ 1428.578021][ C0] irq_exit_rcu+0x98/0xc0 [ 1428.578258][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1428.578559][ C0] [ 1428.578715][ C0] [ 1428.578872][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1428.579198][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1428.579468][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1428.580490][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1428.580811][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1428.581230][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1428.581649][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1428.582067][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1428.582484][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1428.582904][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1428.583205][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1428.583478][ C0] default_idle_call+0x69/0xa0 [ 1428.583735][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1428.583997][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1428.584291][ C0] ? lock_release+0x1d5/0x250 [ 1428.584540][ C0] do_idle+0xfb/0x160 [ 1428.584755][ C0] cpu_startup_entry+0x55/0x60 [ 1428.585009][ C0] rest_init+0x153/0x260 [ 1428.585240][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1428.585527][ C0] arch_call_rest_init+0x13/0x40 [ 1428.585792][ C0] start_kernel+0x314/0x3d0 [ 1428.586042][ C0] x86_64_start_reservations+0x18/0x30 [ 1428.586335][ C0] x86_64_start_kernel+0xba/0x110 [ 1428.586602][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1428.586929][ C0] [ 1428.587094][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 224s! [ksoftirqd/1:22] [ 1428.587552][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1428.588756][ C1] irq event stamp: 3886976 [ 1428.588998][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 1428.589499][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 1428.589997][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 1428.590500][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 1428.590999][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1428.591502][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1428.592153][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1428.592497][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1428.593528][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1428.593857][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1428.594281][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1428.594707][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1428.595133][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1428.595554][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1428.595976][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1428.596452][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1428.596800][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1428.597227][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1428.597646][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1428.598066][ C1] Call Trace: [ 1428.598248][ C1] [ 1428.598406][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1428.598686][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1428.598951][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1428.599241][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1428.599537][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1428.599846][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1428.600130][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1428.600455][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1428.600729][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1428.601060][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1428.601381][ C1] [ 1428.601541][ C1] [ 1428.601700][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1428.602032][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1428.602340][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1428.602655][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1428.602962][ C1] ? run_ksoftirqd+0xb/0x60 [ 1428.603205][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1428.603535][ C1] ? __orc_find+0x9c/0xf0 [ 1428.603770][ C1] ? lock_acquire+0x1c1/0x220 [ 1428.604027][ C1] ? irqentry_enter+0x2b/0x60 [ 1428.604286][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1428.604550][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1428.604838][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1428.605140][ C1] ? lock_acquire+0x1c1/0x220 [ 1428.605388][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1428.605639][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1428.605917][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1428.606174][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1428.606438][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1428.606713][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1428.607012][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1428.607313][ C1] ip_local_deliver+0x19d/0x480 [ 1428.607574][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1428.607860][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1428.608124][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1428.608405][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1428.608670][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1428.609012][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1428.609287][ C1] ip_rcv+0x564/0x740 [ 1428.609499][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1428.609740][ C1] ? set_track_prepare+0x8a/0xd0 [ 1428.610005][ C1] ? irqentry_enter+0x2b/0x60 [ 1428.610259][ C1] ? irqentry_enter+0x2b/0x60 [ 1428.610513][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1428.610759][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1428.611080][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1428.611425][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1428.611738][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1428.612078][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1428.612378][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1428.612715][ C1] netif_receive_skb+0x55/0x280 [ 1428.612981][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1428.613317][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1428.613668][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1428.613982][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1428.614277][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1428.614586][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1428.614921][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1428.615208][ C1] ? arch_stack_walk+0x68/0x100 [ 1428.615470][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1428.615748][ C1] ? irqentry_enter+0x2b/0x60 [ 1428.615998][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1428.616317][ C1] ? irqentry_enter+0x2b/0x60 [ 1428.616576][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1428.616904][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1428.617187][ C1] ? arch_stack_walk+0x68/0x100 [ 1428.617453][ C1] __tcf_classify+0x32c/0x7d0 [ 1428.617712][ C1] tcf_classify+0x283/0x930 [ 1428.617960][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1428.618235][ C1] tc_run+0x2e4/0x5d0 [ 1428.618451][ C1] ? __pfx_tc_run+0x10/0x10 [ 1428.618699][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1428.618976][ C1] ? irqentry_enter+0x2b/0x60 [ 1428.619231][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1428.619520][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1428.619850][ C1] ip_finish_output2+0x786/0x18e0 [ 1428.620121][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1428.620410][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1428.620682][ C1] ? __ip_finish_output+0x10f/0x770 [ 1428.620962][ C1] ip_output+0x16b/0x4f0 [ 1428.621190][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1428.621513][ C1] ? __pfx_ip_output+0x10/0x10 [ 1428.621771][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1428.622129][ C1] ? __pfx_ip_output+0x10/0x10 [ 1428.622392][ C1] __ip_queue_xmit+0x672/0x1910 [ 1428.622654][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1428.622935][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1428.623231][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1428.623518][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1428.623815][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1428.624100][ C1] tcp_delack_timer+0x84/0x240 [ 1428.624355][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1428.624644][ C1] call_timer_fn+0x176/0x430 [ 1428.624895][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1428.625170][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1428.625452][ C1] __run_timers.part.0+0x52d/0x890 [ 1428.625732][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1428.626027][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1428.626331][ C1] ? __pfx___schedule+0x10/0x10 [ 1428.626597][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1428.626918][ C1] run_timer_softirq+0x72/0x100 [ 1428.627177][ C1] __do_softirq+0x1bc/0x7ff [ 1428.627420][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1428.627693][ C1] run_ksoftirqd+0x2e/0x60 [ 1428.627934][ C1] smpboot_thread_fn+0x30e/0x840 [ 1428.628200][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1428.628492][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1428.628779][ C1] kthread+0x292/0x360 [ 1428.629008][ C1] ? __pfx_kthread+0x10/0x10 [ 1428.629257][ C1] ret_from_fork+0x34/0x70 [ 1428.629493][ C1] ? __pfx_kthread+0x10/0x10 [ 1428.629741][ C1] ret_from_fork_asm+0x1b/0x30 [ 1428.630001][ C1] [ 1454.498024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 1454.498412][ C0] rcu: 0-....: (261546 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=64178 [ 1454.498927][ C0] rcu: (t=260189 jiffies g=1007429 q=31 ncpus=4) [ 1454.499272][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1454.499754][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1454.500394][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1454.500737][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1454.501757][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1454.502079][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1454.502495][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1454.502910][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1454.503326][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1454.503741][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1454.504156][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1454.504626][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1454.504978][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1454.505395][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1454.505814][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1454.506237][ C0] Call Trace: [ 1454.506423][ C0] [ 1454.506579][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 1454.506865][ C0] ? print_cpu_stall+0x263/0x6a0 [ 1454.507134][ C0] ? check_cpu_stall+0x284/0x500 [ 1454.507397][ C0] ? rcu_pending+0x92/0x360 [ 1454.507641][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 1454.507929][ C0] ? update_process_times+0xb9/0x110 [ 1454.508213][ C0] ? tick_sched_handle+0x67/0x130 [ 1454.508484][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 1454.508790][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1454.509050][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 1454.509375][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1454.509664][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1454.509969][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1454.510252][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1454.510575][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1454.510845][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1454.511124][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1454.511447][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1454.511757][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1454.512091][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1454.512395][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1454.512705][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1454.513010][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1454.513340][ C0] ? get_stack_info+0x36/0xc0 [ 1454.513594][ C0] ? lock_acquire+0x1c1/0x220 [ 1454.513847][ C0] ? lock_release+0x1d5/0x250 [ 1454.514098][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1454.514359][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1454.514642][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1454.514937][ C0] ? lock_acquire+0x1c1/0x220 [ 1454.515191][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1454.515446][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1454.515723][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1454.515967][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1454.516225][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1454.516493][ C0] ? __inet_lookup_established+0x341/0x610 [ 1454.516803][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1454.517098][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1454.517390][ C0] ip_local_deliver+0x19d/0x480 [ 1454.517650][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1454.517931][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1454.518195][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1454.518475][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1454.518746][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1454.519087][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1454.519361][ C0] ip_rcv+0x564/0x740 [ 1454.519573][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1454.519812][ C0] ? set_track_prepare+0x8a/0xd0 [ 1454.520077][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1454.520368][ C0] ? rest_init+0x153/0x260 [ 1454.520604][ C0] ? skb_clone+0x10b/0x330 [ 1454.520846][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1454.521178][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1454.521499][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1454.521796][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1454.522107][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1454.522370][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1454.522614][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1454.522930][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1454.523228][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1454.523564][ C0] ? lock_acquire+0x1c1/0x220 [ 1454.523813][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1454.524121][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1454.524421][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1454.524746][ C0] ? __copy_skb_header+0xaf/0x490 [ 1454.525011][ C0] ? __skb_clone+0x57a/0x760 [ 1454.525257][ C0] netif_receive_skb+0x55/0x280 [ 1454.525518][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1454.525849][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1454.526202][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1454.526513][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1454.526805][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1454.527111][ C0] ? hlock_class+0x4e/0x130 [ 1454.527359][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1454.527689][ C0] ? place_entity+0x21/0x2f0 [ 1454.527937][ C0] ? resched_curr+0x219/0x280 [ 1454.528186][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1454.528451][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1454.528731][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1454.529014][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1454.529269][ C0] ? activate_task+0xf5/0x260 [ 1454.529515][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1454.529788][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1454.530062][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1454.530321][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1454.530610][ C0] ? get_stack_info+0x36/0xc0 [ 1454.530863][ C0] ? stack_access_ok+0xda/0x1f0 [ 1454.531122][ C0] ? get_reg+0x119/0x190 [ 1454.531352][ C0] __tcf_classify+0x32c/0x7d0 [ 1454.531603][ C0] tcf_classify+0x283/0x930 [ 1454.531844][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1454.532171][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1454.532441][ C0] ? arch_stack_walk+0x8c/0x100 [ 1454.532702][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1454.532992][ C0] tc_run+0x2e4/0x5d0 [ 1454.533208][ C0] ? __pfx_tc_run+0x10/0x10 [ 1454.533447][ C0] ? lock_acquire+0x1c1/0x220 [ 1454.533692][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1454.533965][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1454.534232][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1454.534513][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1454.534791][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1454.535111][ C0] ? neigh_hh_output+0x348/0x590 [ 1454.535377][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1454.535652][ C0] ip_finish_output2+0x786/0x18e0 [ 1454.535917][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1454.536207][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1454.536561][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1454.536854][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1454.537118][ C0] ? __ip_finish_output+0x10f/0x770 [ 1454.537396][ C0] ip_output+0x16b/0x4f0 [ 1454.537625][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1454.537906][ C0] ? __pfx_ip_output+0x10/0x10 [ 1454.538162][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1454.538459][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1454.538724][ C0] ? ip_local_out+0x114/0x3b0 [ 1454.538981][ C0] __ip_queue_xmit+0x672/0x1910 [ 1454.539245][ C0] ? __skb_clone+0x57a/0x760 [ 1454.539494][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1454.539771][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1454.540065][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1454.540379][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1454.540635][ C0] ? tcp_current_mss+0x40a/0x510 [ 1454.540897][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1454.541179][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1454.541452][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1454.541703][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1454.541972][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1454.542293][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1454.542568][ C0] ? ktime_get+0xb6/0x190 [ 1454.542801][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1454.543076][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1454.543358][ C0] tcp_write_timer+0x82/0x1d0 [ 1454.543608][ C0] call_timer_fn+0x176/0x430 [ 1454.543853][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1454.544129][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1454.544406][ C0] __run_timers.part.0+0x52d/0x890 [ 1454.544678][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1454.544956][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1454.545255][ C0] ? lock_acquire+0x1c1/0x220 [ 1454.545503][ C0] ? clockevents_program_event+0xf6/0x300 [ 1454.545805][ C0] ? lock_release+0x1d5/0x250 [ 1454.546053][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1454.546327][ C0] ? ktime_get+0xb6/0x190 [ 1454.546555][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1454.546852][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1454.547163][ C0] run_timer_softirq+0x72/0x100 [ 1454.547421][ C0] __do_softirq+0x1bc/0x7ff [ 1454.547662][ C0] irq_exit_rcu+0x98/0xc0 [ 1454.547891][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1454.548187][ C0] [ 1454.548347][ C0] [ 1454.548506][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1454.548835][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1454.549105][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1454.550127][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1454.550449][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1454.550873][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1454.551293][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1454.551710][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1454.552126][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1454.552548][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1454.552853][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1454.553127][ C0] default_idle_call+0x69/0xa0 [ 1454.553381][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1454.553645][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1454.553933][ C0] ? lock_release+0x1d5/0x250 [ 1454.554184][ C0] do_idle+0xfb/0x160 [ 1454.554399][ C0] cpu_startup_entry+0x55/0x60 [ 1454.554655][ C0] rest_init+0x153/0x260 [ 1454.554880][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1454.555168][ C0] arch_call_rest_init+0x13/0x40 [ 1454.555436][ C0] start_kernel+0x314/0x3d0 [ 1454.555675][ C0] x86_64_start_reservations+0x18/0x30 [ 1454.555962][ C0] x86_64_start_kernel+0xba/0x110 [ 1454.556233][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1454.556565][ C0] [ 1454.556731][ C0] Sending NMI from CPU 0 to CPUs 1: [ 1454.557013][ C1] NMI backtrace for cpu 1 [ 1454.557018][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1454.557023][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1454.557025][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1454.557032][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1454.557034][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1454.557037][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1454.557039][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1454.557040][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1454.557041][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1454.557043][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1454.557045][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1454.557047][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1454.557050][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1454.557051][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1454.557052][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1454.557054][ C1] Call Trace: [ 1454.557056][ C1] [ 1454.557058][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 1454.557064][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 1454.557069][ C1] ? nmi_handle+0x156/0x420 [ 1454.557074][ C1] ? default_do_nmi+0x41/0x100 [ 1454.557077][ C1] ? exc_nmi+0xf3/0x120 [ 1454.557079][ C1] ? end_repeat_nmi+0xf/0x60 [ 1454.557084][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1454.557087][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1454.557090][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1454.557094][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1454.557097][ C1] [ 1454.557098][ C1] [ 1454.557099][ C1] ? run_ksoftirqd+0xb/0x60 [ 1454.557104][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1454.557107][ C1] ? __orc_find+0x9c/0xf0 [ 1454.557110][ C1] ? lock_acquire+0x1c1/0x220 [ 1454.557114][ C1] ? irqentry_enter+0x2b/0x60 [ 1454.557118][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1454.557121][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1454.557124][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1454.557127][ C1] ? lock_acquire+0x1c1/0x220 [ 1454.557129][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1454.557134][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1454.557137][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1454.557144][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1454.557147][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1454.557153][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1454.557159][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1454.557163][ C1] ip_local_deliver+0x19d/0x480 [ 1454.557166][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1454.557168][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1454.557172][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1454.557176][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1454.557179][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1454.557182][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1454.557192][ C1] ip_rcv+0x564/0x740 [ 1454.557195][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1454.557198][ C1] ? set_track_prepare+0x8a/0xd0 [ 1454.557202][ C1] ? irqentry_enter+0x2b/0x60 [ 1454.557205][ C1] ? irqentry_enter+0x2b/0x60 [ 1454.557208][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1454.557211][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1454.557215][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1454.557219][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1454.557221][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1454.557224][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1454.557227][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1454.557231][ C1] netif_receive_skb+0x55/0x280 [ 1454.557234][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1454.557242][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1454.557249][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1454.557256][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1454.557262][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1454.557274][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1454.557283][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1454.557286][ C1] ? arch_stack_walk+0x68/0x100 [ 1454.557290][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1454.557293][ C1] ? irqentry_enter+0x2b/0x60 [ 1454.557297][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1454.557301][ C1] ? irqentry_enter+0x2b/0x60 [ 1454.557305][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1454.557312][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1454.557314][ C1] ? arch_stack_walk+0x68/0x100 [ 1454.557318][ C1] __tcf_classify+0x32c/0x7d0 [ 1454.557323][ C1] tcf_classify+0x283/0x930 [ 1454.557326][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1454.557330][ C1] tc_run+0x2e4/0x5d0 [ 1454.557334][ C1] ? __pfx_tc_run+0x10/0x10 [ 1454.557339][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1454.557344][ C1] ? irqentry_enter+0x2b/0x60 [ 1454.557347][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1454.557350][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1454.557357][ C1] ip_finish_output2+0x786/0x18e0 [ 1454.557362][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1454.557365][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1454.557369][ C1] ? __ip_finish_output+0x10f/0x770 [ 1454.557373][ C1] ip_output+0x16b/0x4f0 [ 1454.557376][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1454.557379][ C1] ? __pfx_ip_output+0x10/0x10 [ 1454.557383][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1454.557390][ C1] ? __pfx_ip_output+0x10/0x10 [ 1454.557395][ C1] __ip_queue_xmit+0x672/0x1910 [ 1454.557400][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1454.557406][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1454.557411][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1454.557414][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1454.557418][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1454.557421][ C1] tcp_delack_timer+0x84/0x240 [ 1454.557425][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1454.557427][ C1] call_timer_fn+0x176/0x430 [ 1454.557431][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1454.557436][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1454.557440][ C1] __run_timers.part.0+0x52d/0x890 [ 1454.557443][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1454.557448][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1454.557452][ C1] ? __pfx___schedule+0x10/0x10 [ 1454.557455][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1454.557460][ C1] run_timer_softirq+0x72/0x100 [ 1454.557463][ C1] __do_softirq+0x1bc/0x7ff [ 1454.557467][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1454.557471][ C1] run_ksoftirqd+0x2e/0x60 [ 1454.557474][ C1] smpboot_thread_fn+0x30e/0x840 [ 1454.557479][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1454.557482][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1454.557485][ C1] kthread+0x292/0x360 [ 1454.557487][ C1] ? __pfx_kthread+0x10/0x10 [ 1454.557490][ C1] ret_from_fork+0x34/0x70 [ 1454.557492][ C1] ? __pfx_kthread+0x10/0x10 [ 1454.557494][ C1] ret_from_fork_asm+0x1b/0x30 [ 1454.557502][ C1] [ 1480.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 272s! [swapper/0:0] [ 1480.527920][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1480.529130][ C0] irq event stamp: 27567077 [ 1480.529371][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 1480.529900][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 1480.530381][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 1480.530888][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 1480.531389][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1480.531875][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1480.532514][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1480.532852][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1480.533870][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1480.534191][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1480.534611][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1480.535030][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1480.535447][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1480.535864][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1480.536285][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1480.536763][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1480.537115][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1480.537537][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1480.537961][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1480.538381][ C0] Call Trace: [ 1480.538560][ C0] [ 1480.538729][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1480.539008][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1480.539264][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1480.539558][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1480.539843][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1480.540143][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1480.540419][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1480.540741][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1480.541014][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1480.541288][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1480.541617][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1480.541929][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1480.542260][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1480.542565][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1480.542877][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1480.543179][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1480.543500][ C0] ? get_stack_info+0x36/0xc0 [ 1480.543756][ C0] ? lock_acquire+0x1c1/0x220 [ 1480.544010][ C0] ? lock_release+0x1d5/0x250 [ 1480.544264][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1480.544526][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1480.544819][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1480.545121][ C0] ? lock_acquire+0x1c1/0x220 [ 1480.545369][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1480.545622][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1480.545893][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1480.546141][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1480.546401][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1480.546673][ C0] ? __inet_lookup_established+0x341/0x610 [ 1480.546986][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1480.547273][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1480.547565][ C0] ip_local_deliver+0x19d/0x480 [ 1480.547829][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1480.548117][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1480.548385][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1480.548664][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1480.548928][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1480.549262][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1480.549543][ C0] ip_rcv+0x564/0x740 [ 1480.549758][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1480.550004][ C0] ? set_track_prepare+0x8a/0xd0 [ 1480.550273][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1480.550561][ C0] ? rest_init+0x153/0x260 [ 1480.550800][ C0] ? skb_clone+0x10b/0x330 [ 1480.551039][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1480.551376][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1480.551697][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1480.551989][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1480.552296][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1480.552555][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1480.552796][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1480.553109][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1480.553406][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1480.553748][ C0] ? lock_acquire+0x1c1/0x220 [ 1480.554001][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1480.554313][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1480.554612][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1480.554946][ C0] ? __copy_skb_header+0xaf/0x490 [ 1480.555216][ C0] ? __skb_clone+0x57a/0x760 [ 1480.555463][ C0] netif_receive_skb+0x55/0x280 [ 1480.555718][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1480.556047][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1480.556395][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1480.556714][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1480.557000][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1480.557299][ C0] ? hlock_class+0x4e/0x130 [ 1480.557541][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1480.557869][ C0] ? place_entity+0x21/0x2f0 [ 1480.558115][ C0] ? resched_curr+0x219/0x280 [ 1480.558369][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1480.558639][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1480.558931][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1480.559212][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1480.559475][ C0] ? activate_task+0xf5/0x260 [ 1480.559729][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1480.560005][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1480.560276][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1480.560535][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1480.560825][ C0] ? get_stack_info+0x36/0xc0 [ 1480.561074][ C0] ? stack_access_ok+0xda/0x1f0 [ 1480.561329][ C0] ? get_reg+0x119/0x190 [ 1480.561555][ C0] __tcf_classify+0x32c/0x7d0 [ 1480.561807][ C0] tcf_classify+0x283/0x930 [ 1480.562050][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1480.562380][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1480.562648][ C0] ? arch_stack_walk+0x8c/0x100 [ 1480.562906][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1480.563196][ C0] tc_run+0x2e4/0x5d0 [ 1480.563413][ C0] ? __pfx_tc_run+0x10/0x10 [ 1480.563659][ C0] ? lock_acquire+0x1c1/0x220 [ 1480.563912][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1480.564188][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1480.564453][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1480.564746][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1480.565025][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1480.565346][ C0] ? neigh_hh_output+0x348/0x590 [ 1480.565608][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1480.565886][ C0] ip_finish_output2+0x786/0x18e0 [ 1480.566157][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1480.566451][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1480.566800][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1480.567091][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1480.567361][ C0] ? __ip_finish_output+0x10f/0x770 [ 1480.567641][ C0] ip_output+0x16b/0x4f0 [ 1480.567867][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1480.568153][ C0] ? __pfx_ip_output+0x10/0x10 [ 1480.568409][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1480.568717][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1480.568985][ C0] ? ip_local_out+0x114/0x3b0 [ 1480.569236][ C0] __ip_queue_xmit+0x672/0x1910 [ 1480.569496][ C0] ? __skb_clone+0x57a/0x760 [ 1480.569740][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1480.570025][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1480.570323][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1480.570648][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1480.570906][ C0] ? tcp_current_mss+0x40a/0x510 [ 1480.571173][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1480.571453][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1480.571738][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1480.571995][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1480.572262][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1480.572582][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1480.572863][ C0] ? ktime_get+0xb6/0x190 [ 1480.573097][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1480.573377][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1480.573657][ C0] tcp_write_timer+0x82/0x1d0 [ 1480.573911][ C0] call_timer_fn+0x176/0x430 [ 1480.574161][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1480.574435][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1480.574713][ C0] __run_timers.part.0+0x52d/0x890 [ 1480.574985][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1480.575270][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1480.575567][ C0] ? lock_acquire+0x1c1/0x220 [ 1480.575818][ C0] ? clockevents_program_event+0xf6/0x300 [ 1480.576126][ C0] ? lock_release+0x1d5/0x250 [ 1480.576380][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1480.576658][ C0] ? ktime_get+0xb6/0x190 [ 1480.576892][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1480.577192][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1480.577505][ C0] run_timer_softirq+0x72/0x100 [ 1480.577766][ C0] __do_softirq+0x1bc/0x7ff [ 1480.578012][ C0] irq_exit_rcu+0x98/0xc0 [ 1480.578245][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1480.578547][ C0] [ 1480.578713][ C0] [ 1480.578870][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1480.579191][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1480.579457][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1480.580476][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1480.580800][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1480.581216][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1480.581631][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1480.582046][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1480.582466][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1480.582887][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1480.583188][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1480.583459][ C0] default_idle_call+0x69/0xa0 [ 1480.583713][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1480.583973][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1480.584268][ C0] ? lock_release+0x1d5/0x250 [ 1480.584518][ C0] do_idle+0xfb/0x160 [ 1480.584732][ C0] cpu_startup_entry+0x55/0x60 [ 1480.584984][ C0] rest_init+0x153/0x260 [ 1480.585212][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1480.585500][ C0] arch_call_rest_init+0x13/0x40 [ 1480.585764][ C0] start_kernel+0x314/0x3d0 [ 1480.586010][ C0] x86_64_start_reservations+0x18/0x30 [ 1480.586305][ C0] x86_64_start_kernel+0xba/0x110 [ 1480.586570][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1480.586893][ C0] [ 1480.587058][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 272s! [ksoftirqd/1:22] [ 1480.587513][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1480.588721][ C1] irq event stamp: 3886976 [ 1480.588956][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 1480.589455][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 1480.589951][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 1480.590451][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 1480.590938][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1480.591435][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1480.592085][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1480.592426][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1480.593451][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1480.593781][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1480.594207][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1480.594628][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1480.595054][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1480.595481][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1480.595902][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1480.596375][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1480.596724][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1480.597147][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1480.597565][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1480.597984][ C1] Call Trace: [ 1480.598163][ C1] [ 1480.598318][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1480.598605][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1480.598877][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1480.599170][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1480.599460][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1480.599769][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1480.600056][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1480.600380][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1480.600657][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1480.600983][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1480.601299][ C1] [ 1480.601457][ C1] [ 1480.601613][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1480.601944][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1480.602253][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1480.602569][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1480.602871][ C1] ? run_ksoftirqd+0xb/0x60 [ 1480.603116][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1480.603445][ C1] ? __orc_find+0x9c/0xf0 [ 1480.603678][ C1] ? lock_acquire+0x1c1/0x220 [ 1480.603934][ C1] ? irqentry_enter+0x2b/0x60 [ 1480.604191][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1480.604457][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1480.604748][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1480.605050][ C1] ? lock_acquire+0x1c1/0x220 [ 1480.605300][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1480.605556][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1480.605830][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1480.606082][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1480.606347][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1480.606623][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1480.606915][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1480.607209][ C1] ip_local_deliver+0x19d/0x480 [ 1480.607468][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1480.607754][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1480.608020][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1480.608303][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1480.608570][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1480.608916][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1480.609192][ C1] ip_rcv+0x564/0x740 [ 1480.609408][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1480.609652][ C1] ? set_track_prepare+0x8a/0xd0 [ 1480.609918][ C1] ? irqentry_enter+0x2b/0x60 [ 1480.610174][ C1] ? irqentry_enter+0x2b/0x60 [ 1480.610428][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1480.610675][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1480.610992][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1480.611338][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1480.611657][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1480.611997][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1480.612296][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1480.612634][ C1] netif_receive_skb+0x55/0x280 [ 1480.612901][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1480.613233][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1480.613587][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1480.613900][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1480.614193][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1480.614502][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1480.614834][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1480.615121][ C1] ? arch_stack_walk+0x68/0x100 [ 1480.615380][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1480.615656][ C1] ? irqentry_enter+0x2b/0x60 [ 1480.615908][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1480.616232][ C1] ? irqentry_enter+0x2b/0x60 [ 1480.616490][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1480.616815][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1480.617095][ C1] ? arch_stack_walk+0x68/0x100 [ 1480.617359][ C1] __tcf_classify+0x32c/0x7d0 [ 1480.617616][ C1] tcf_classify+0x283/0x930 [ 1480.617862][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1480.618138][ C1] tc_run+0x2e4/0x5d0 [ 1480.618355][ C1] ? __pfx_tc_run+0x10/0x10 [ 1480.618604][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1480.618879][ C1] ? irqentry_enter+0x2b/0x60 [ 1480.619134][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1480.619422][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1480.619750][ C1] ip_finish_output2+0x786/0x18e0 [ 1480.620022][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1480.620311][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1480.620581][ C1] ? __ip_finish_output+0x10f/0x770 [ 1480.620858][ C1] ip_output+0x16b/0x4f0 [ 1480.621087][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1480.621413][ C1] ? __pfx_ip_output+0x10/0x10 [ 1480.621671][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1480.622027][ C1] ? __pfx_ip_output+0x10/0x10 [ 1480.622286][ C1] __ip_queue_xmit+0x672/0x1910 [ 1480.622548][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1480.622828][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1480.623128][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1480.623415][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1480.623712][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1480.623998][ C1] tcp_delack_timer+0x84/0x240 [ 1480.624256][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1480.624545][ C1] call_timer_fn+0x176/0x430 [ 1480.624797][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1480.625073][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1480.625356][ C1] __run_timers.part.0+0x52d/0x890 [ 1480.625632][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1480.625921][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1480.626223][ C1] ? __pfx___schedule+0x10/0x10 [ 1480.626486][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1480.626809][ C1] run_timer_softirq+0x72/0x100 [ 1480.627068][ C1] __do_softirq+0x1bc/0x7ff [ 1480.627310][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1480.627585][ C1] run_ksoftirqd+0x2e/0x60 [ 1480.627825][ C1] smpboot_thread_fn+0x30e/0x840 [ 1480.628094][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1480.628388][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1480.628683][ C1] kthread+0x292/0x360 [ 1480.628900][ C1] ? __pfx_kthread+0x10/0x10 [ 1480.629150][ C1] ret_from_fork+0x34/0x70 [ 1480.629395][ C1] ? __pfx_kthread+0x10/0x10 [ 1480.629644][ C1] ret_from_fork_asm+0x1b/0x30 [ 1480.629909][ C1] [ 1508.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 298s! [swapper/0:0] [ 1508.527915][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1508.529117][ C0] irq event stamp: 27567077 [ 1508.529356][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 1508.529883][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 1508.530361][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 1508.530864][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 1508.531363][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1508.531848][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1508.532488][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1508.532826][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1508.533845][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1508.534167][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1508.534585][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1508.535000][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1508.535415][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1508.535832][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1508.536252][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1508.536713][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1508.537065][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1508.537483][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1508.537898][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1508.538317][ C0] Call Trace: [ 1508.538498][ C0] [ 1508.538663][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1508.538943][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1508.539197][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1508.539490][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1508.539774][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1508.540075][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1508.540352][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1508.540670][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1508.540944][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1508.541220][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1508.541546][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1508.541858][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1508.542188][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1508.542494][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1508.542804][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1508.543105][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1508.543429][ C0] ? get_stack_info+0x36/0xc0 [ 1508.543686][ C0] ? lock_acquire+0x1c1/0x220 [ 1508.543942][ C0] ? lock_release+0x1d5/0x250 [ 1508.544197][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1508.544468][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1508.544758][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1508.545061][ C0] ? lock_acquire+0x1c1/0x220 [ 1508.545307][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1508.545557][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1508.545829][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1508.546079][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1508.546342][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1508.546613][ C0] ? __inet_lookup_established+0x341/0x610 [ 1508.546928][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1508.547217][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1508.547507][ C0] ip_local_deliver+0x19d/0x480 [ 1508.547769][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1508.548056][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1508.548321][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1508.548601][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1508.548866][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1508.549200][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1508.549478][ C0] ip_rcv+0x564/0x740 [ 1508.549691][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1508.549934][ C0] ? set_track_prepare+0x8a/0xd0 [ 1508.550201][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1508.550486][ C0] ? rest_init+0x153/0x260 [ 1508.550725][ C0] ? skb_clone+0x10b/0x330 [ 1508.550963][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1508.551300][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1508.551619][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1508.551912][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1508.552219][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1508.552476][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1508.552714][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1508.553031][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1508.553329][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1508.553669][ C0] ? lock_acquire+0x1c1/0x220 [ 1508.553920][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1508.554233][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1508.554529][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1508.554861][ C0] ? __copy_skb_header+0xaf/0x490 [ 1508.555132][ C0] ? __skb_clone+0x57a/0x760 [ 1508.555378][ C0] netif_receive_skb+0x55/0x280 [ 1508.555634][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1508.555958][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1508.556304][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1508.556617][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1508.556900][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1508.557198][ C0] ? hlock_class+0x4e/0x130 [ 1508.557440][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1508.557768][ C0] ? place_entity+0x21/0x2f0 [ 1508.558015][ C0] ? resched_curr+0x219/0x280 [ 1508.558270][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1508.558544][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1508.558825][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1508.559107][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1508.559368][ C0] ? activate_task+0xf5/0x260 [ 1508.559620][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1508.559897][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1508.560168][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1508.560429][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1508.560722][ C0] ? get_stack_info+0x36/0xc0 [ 1508.560972][ C0] ? stack_access_ok+0xda/0x1f0 [ 1508.561229][ C0] ? get_reg+0x119/0x190 [ 1508.561459][ C0] __tcf_classify+0x32c/0x7d0 [ 1508.561714][ C0] tcf_classify+0x283/0x930 [ 1508.561961][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1508.562292][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1508.562556][ C0] ? arch_stack_walk+0x8c/0x100 [ 1508.562814][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1508.563103][ C0] tc_run+0x2e4/0x5d0 [ 1508.563318][ C0] ? __pfx_tc_run+0x10/0x10 [ 1508.563564][ C0] ? lock_acquire+0x1c1/0x220 [ 1508.563814][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1508.564091][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1508.564355][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1508.564640][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1508.564922][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1508.565242][ C0] ? neigh_hh_output+0x348/0x590 [ 1508.565508][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1508.565787][ C0] ip_finish_output2+0x786/0x18e0 [ 1508.566058][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1508.566350][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1508.566702][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1508.566990][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1508.567257][ C0] ? __ip_finish_output+0x10f/0x770 [ 1508.567532][ C0] ip_output+0x16b/0x4f0 [ 1508.567756][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1508.568040][ C0] ? __pfx_ip_output+0x10/0x10 [ 1508.568292][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1508.568600][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1508.568865][ C0] ? ip_local_out+0x114/0x3b0 [ 1508.569114][ C0] __ip_queue_xmit+0x672/0x1910 [ 1508.569369][ C0] ? __skb_clone+0x57a/0x760 [ 1508.569611][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1508.569892][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1508.570187][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1508.570507][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1508.570763][ C0] ? tcp_current_mss+0x40a/0x510 [ 1508.571026][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1508.571303][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1508.571581][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1508.571835][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1508.572100][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1508.572414][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1508.572691][ C0] ? ktime_get+0xb6/0x190 [ 1508.572924][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1508.573198][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1508.573474][ C0] tcp_write_timer+0x82/0x1d0 [ 1508.573726][ C0] call_timer_fn+0x176/0x430 [ 1508.573973][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1508.574247][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1508.574520][ C0] __run_timers.part.0+0x52d/0x890 [ 1508.574794][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1508.575077][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1508.575373][ C0] ? lock_acquire+0x1c1/0x220 [ 1508.575623][ C0] ? clockevents_program_event+0xf6/0x300 [ 1508.575932][ C0] ? lock_release+0x1d5/0x250 [ 1508.576187][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1508.576464][ C0] ? ktime_get+0xb6/0x190 [ 1508.576700][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1508.577000][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1508.577308][ C0] run_timer_softirq+0x72/0x100 [ 1508.577568][ C0] __do_softirq+0x1bc/0x7ff [ 1508.577812][ C0] irq_exit_rcu+0x98/0xc0 [ 1508.578046][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1508.578347][ C0] [ 1508.578503][ C0] [ 1508.578664][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1508.578989][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1508.579257][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1508.580270][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1508.580593][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1508.581009][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1508.581425][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1508.581842][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1508.582259][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1508.582676][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1508.582976][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1508.583248][ C0] default_idle_call+0x69/0xa0 [ 1508.583501][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1508.583762][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1508.584055][ C0] ? lock_release+0x1d5/0x250 [ 1508.584306][ C0] do_idle+0xfb/0x160 [ 1508.584516][ C0] cpu_startup_entry+0x55/0x60 [ 1508.584766][ C0] rest_init+0x153/0x260 [ 1508.584999][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1508.585289][ C0] arch_call_rest_init+0x13/0x40 [ 1508.585554][ C0] start_kernel+0x314/0x3d0 [ 1508.585798][ C0] x86_64_start_reservations+0x18/0x30 [ 1508.586091][ C0] x86_64_start_kernel+0xba/0x110 [ 1508.586356][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1508.586681][ C0] [ 1508.586843][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 298s! [ksoftirqd/1:22] [ 1508.587299][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1508.588500][ C1] irq event stamp: 3886976 [ 1508.588748][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 1508.589252][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 1508.589751][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 1508.590258][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 1508.590748][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1508.591249][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1508.591897][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1508.592243][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1508.593275][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1508.593601][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1508.594030][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1508.594454][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1508.594874][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1508.595297][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1508.595720][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1508.596199][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1508.596544][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1508.596972][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1508.597392][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1508.597811][ C1] Call Trace: [ 1508.597987][ C1] [ 1508.598142][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1508.598421][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1508.598684][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1508.598976][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1508.599268][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1508.599573][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1508.599858][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1508.600185][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1508.600459][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1508.600787][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1508.601101][ C1] [ 1508.601259][ C1] [ 1508.601415][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1508.601742][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1508.602053][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1508.602366][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1508.602668][ C1] ? run_ksoftirqd+0xb/0x60 [ 1508.602910][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1508.603234][ C1] ? __orc_find+0x9c/0xf0 [ 1508.603468][ C1] ? lock_acquire+0x1c1/0x220 [ 1508.603722][ C1] ? irqentry_enter+0x2b/0x60 [ 1508.603977][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1508.604240][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1508.604530][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1508.604833][ C1] ? lock_acquire+0x1c1/0x220 [ 1508.605084][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1508.605338][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1508.605610][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1508.605859][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1508.606122][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1508.606399][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1508.606694][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1508.606991][ C1] ip_local_deliver+0x19d/0x480 [ 1508.607253][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1508.607539][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1508.607804][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1508.608087][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1508.608359][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1508.608707][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1508.608982][ C1] ip_rcv+0x564/0x740 [ 1508.609196][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1508.609437][ C1] ? set_track_prepare+0x8a/0xd0 [ 1508.609703][ C1] ? irqentry_enter+0x2b/0x60 [ 1508.609959][ C1] ? irqentry_enter+0x2b/0x60 [ 1508.610217][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1508.610463][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1508.610786][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1508.611130][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1508.611444][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1508.611787][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1508.612087][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1508.612426][ C1] netif_receive_skb+0x55/0x280 [ 1508.612695][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1508.613030][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1508.613383][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1508.613697][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1508.613992][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1508.614301][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1508.614638][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1508.614924][ C1] ? arch_stack_walk+0x68/0x100 [ 1508.615186][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1508.615465][ C1] ? irqentry_enter+0x2b/0x60 [ 1508.615718][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1508.616038][ C1] ? irqentry_enter+0x2b/0x60 [ 1508.616292][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1508.616626][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1508.616908][ C1] ? arch_stack_walk+0x68/0x100 [ 1508.617173][ C1] __tcf_classify+0x32c/0x7d0 [ 1508.617429][ C1] tcf_classify+0x283/0x930 [ 1508.617679][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1508.617952][ C1] tc_run+0x2e4/0x5d0 [ 1508.618171][ C1] ? __pfx_tc_run+0x10/0x10 [ 1508.618418][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1508.618694][ C1] ? irqentry_enter+0x2b/0x60 [ 1508.618949][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1508.619239][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1508.619566][ C1] ip_finish_output2+0x786/0x18e0 [ 1508.619837][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1508.620129][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1508.620398][ C1] ? __ip_finish_output+0x10f/0x770 [ 1508.620675][ C1] ip_output+0x16b/0x4f0 [ 1508.620906][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1508.621227][ C1] ? __pfx_ip_output+0x10/0x10 [ 1508.621481][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1508.621842][ C1] ? __pfx_ip_output+0x10/0x10 [ 1508.622103][ C1] __ip_queue_xmit+0x672/0x1910 [ 1508.622364][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1508.622644][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1508.622939][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1508.623225][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1508.623519][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1508.623801][ C1] tcp_delack_timer+0x84/0x240 [ 1508.624056][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1508.624347][ C1] call_timer_fn+0x176/0x430 [ 1508.624598][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1508.624871][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1508.625157][ C1] __run_timers.part.0+0x52d/0x890 [ 1508.625432][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1508.625717][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1508.626017][ C1] ? __pfx___schedule+0x10/0x10 [ 1508.626282][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1508.626607][ C1] run_timer_softirq+0x72/0x100 [ 1508.626867][ C1] __do_softirq+0x1bc/0x7ff [ 1508.627113][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1508.627386][ C1] run_ksoftirqd+0x2e/0x60 [ 1508.627627][ C1] smpboot_thread_fn+0x30e/0x840 [ 1508.627892][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1508.628185][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1508.628475][ C1] kthread+0x292/0x360 [ 1508.628704][ C1] ? __pfx_kthread+0x10/0x10 [ 1508.628954][ C1] ret_from_fork+0x34/0x70 [ 1508.629192][ C1] ? __pfx_kthread+0x10/0x10 [ 1508.629440][ C1] ret_from_fork_asm+0x1b/0x30 [ 1508.629699][ C1] [ 1532.560025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 1532.560411][ C1] rcu: 1-....: (339257 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=83211 [ 1532.560996][ C1] rcu: (t=338251 jiffies g=1007429 q=31 ncpus=4) [ 1532.561341][ C1] Sending NMI from CPU 1 to CPUs 0: [ 1532.561632][ C0] NMI backtrace for cpu 0 [ 1532.561639][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1532.561643][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1532.561645][ C0] RIP: 0010:kasan_check_range+0x158/0x1c0 [ 1532.561655][ C0] Code: 11 80 38 00 74 ef 4d 8d 1c 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 <48> 83 c0 01 48 39 d0 74 a5 80 38 00 74 f2 e9 74 ff ff ff b8 01 00 [ 1532.561659][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000246 [ 1532.561663][ C0] RAX: ffffed100141336b RBX: ffffed100141336c RCX: ffffffff90c7aaa0 [ 1532.561664][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1532.561666][ C0] RBP: ffffed100141336b R08: 0000000000000000 R09: ffffed100141336b [ 1532.561668][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1532.561670][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1532.561672][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1532.561674][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1532.561677][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1532.561679][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1532.561680][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1532.561682][ C0] Call Trace: [ 1532.561685][ C0] [ 1532.561688][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 1532.561694][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 1532.561700][ C0] ? nmi_handle+0x156/0x420 [ 1532.561705][ C0] ? default_do_nmi+0x41/0x100 [ 1532.561709][ C0] ? exc_nmi+0xf3/0x120 [ 1532.561712][ C0] ? end_repeat_nmi+0xf/0x60 [ 1532.561717][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1532.561722][ C0] ? kasan_check_range+0x158/0x1c0 [ 1532.561725][ C0] ? kasan_check_range+0x158/0x1c0 [ 1532.561729][ C0] ? kasan_check_range+0x158/0x1c0 [ 1532.561733][ C0] [ 1532.561733][ C0] [ 1532.561735][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 1532.561739][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1532.561742][ C0] ? get_stack_info+0x36/0xc0 [ 1532.561746][ C0] ? lock_acquire+0x1c1/0x220 [ 1532.561752][ C0] ? lock_release+0x1d5/0x250 [ 1532.561755][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1532.561759][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1532.561762][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1532.561765][ C0] ? lock_acquire+0x1c1/0x220 [ 1532.561767][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1532.561773][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1532.561777][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1532.561783][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1532.561786][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1532.561790][ C0] ? __inet_lookup_established+0x341/0x610 [ 1532.561797][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1532.561805][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1532.561808][ C0] ip_local_deliver+0x19d/0x480 [ 1532.561811][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1532.561814][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1532.561819][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1532.561823][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1532.561826][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1532.561830][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1532.561840][ C0] ip_rcv+0x564/0x740 [ 1532.561844][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1532.561846][ C0] ? set_track_prepare+0x8a/0xd0 [ 1532.561851][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1532.561853][ C0] ? rest_init+0x153/0x260 [ 1532.561855][ C0] ? skb_clone+0x10b/0x330 [ 1532.561860][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1532.561867][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1532.561872][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1532.561878][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1532.561887][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1532.561890][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1532.561893][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1532.561897][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1532.561900][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1532.561904][ C0] ? lock_acquire+0x1c1/0x220 [ 1532.561906][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1532.561909][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1532.561912][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1532.561916][ C0] ? __copy_skb_header+0xaf/0x490 [ 1532.561919][ C0] ? __skb_clone+0x57a/0x760 [ 1532.561921][ C0] netif_receive_skb+0x55/0x280 [ 1532.561924][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1532.561932][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1532.561939][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1532.561945][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1532.561950][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1532.561959][ C0] ? hlock_class+0x4e/0x130 [ 1532.561965][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1532.561975][ C0] ? place_entity+0x21/0x2f0 [ 1532.561979][ C0] ? resched_curr+0x219/0x280 [ 1532.561981][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1532.561984][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1532.561988][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1532.561992][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1532.561995][ C0] ? activate_task+0xf5/0x260 [ 1532.561998][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1532.562003][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1532.562006][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1532.562010][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1532.562013][ C0] ? get_stack_info+0x36/0xc0 [ 1532.562017][ C0] ? stack_access_ok+0xda/0x1f0 [ 1532.562019][ C0] ? get_reg+0x119/0x190 [ 1532.562024][ C0] __tcf_classify+0x32c/0x7d0 [ 1532.562029][ C0] tcf_classify+0x283/0x930 [ 1532.562032][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1532.562036][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1532.562038][ C0] ? arch_stack_walk+0x8c/0x100 [ 1532.562042][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1532.562046][ C0] tc_run+0x2e4/0x5d0 [ 1532.562050][ C0] ? __pfx_tc_run+0x10/0x10 [ 1532.562053][ C0] ? lock_acquire+0x1c1/0x220 [ 1532.562056][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1532.562061][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1532.562067][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1532.562070][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1532.562073][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1532.562078][ C0] ? neigh_hh_output+0x348/0x590 [ 1532.562083][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1532.562087][ C0] ip_finish_output2+0x786/0x18e0 [ 1532.562090][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1532.562095][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1532.562103][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1532.562106][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1532.562110][ C0] ? __ip_finish_output+0x10f/0x770 [ 1532.562114][ C0] ip_output+0x16b/0x4f0 [ 1532.562117][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1532.562123][ C0] ? __pfx_ip_output+0x10/0x10 [ 1532.562126][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1532.562130][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1532.562133][ C0] ? ip_local_out+0x114/0x3b0 [ 1532.562137][ C0] __ip_queue_xmit+0x672/0x1910 [ 1532.562141][ C0] ? __skb_clone+0x57a/0x760 [ 1532.562144][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1532.562151][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1532.562156][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1532.562159][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1532.562164][ C0] ? tcp_current_mss+0x40a/0x510 [ 1532.562166][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1532.562169][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1532.562172][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1532.562174][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1532.562177][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1532.562180][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1532.562185][ C0] ? ktime_get+0xb6/0x190 [ 1532.562190][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1532.562194][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1532.562197][ C0] tcp_write_timer+0x82/0x1d0 [ 1532.562201][ C0] call_timer_fn+0x176/0x430 [ 1532.562205][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1532.562210][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1532.562214][ C0] __run_timers.part.0+0x52d/0x890 [ 1532.562217][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1532.562222][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1532.562225][ C0] ? lock_acquire+0x1c1/0x220 [ 1532.562227][ C0] ? clockevents_program_event+0xf6/0x300 [ 1532.562231][ C0] ? lock_release+0x1d5/0x250 [ 1532.562233][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1532.562236][ C0] ? ktime_get+0xb6/0x190 [ 1532.562239][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1532.562243][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1532.562247][ C0] run_timer_softirq+0x72/0x100 [ 1532.562250][ C0] __do_softirq+0x1bc/0x7ff [ 1532.562255][ C0] irq_exit_rcu+0x98/0xc0 [ 1532.562258][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1532.562262][ C0] [ 1532.562263][ C0] [ 1532.562264][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1532.562270][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1532.562273][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1532.562275][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1532.562277][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1532.562279][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1532.562280][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1532.562281][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1532.562283][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1532.562286][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1532.562289][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1532.562293][ C0] default_idle_call+0x69/0xa0 [ 1532.562295][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1532.562297][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1532.562302][ C0] ? lock_release+0x1d5/0x250 [ 1532.562306][ C0] do_idle+0xfb/0x160 [ 1532.562309][ C0] cpu_startup_entry+0x55/0x60 [ 1532.562311][ C0] rest_init+0x153/0x260 [ 1532.562314][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1532.562319][ C0] arch_call_rest_init+0x13/0x40 [ 1532.562324][ C0] start_kernel+0x314/0x3d0 [ 1532.562327][ C0] x86_64_start_reservations+0x18/0x30 [ 1532.562332][ C0] x86_64_start_kernel+0xba/0x110 [ 1532.562335][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1532.562344][ C0] [ 1532.562629][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1532.616818][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1532.617463][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1532.617809][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1532.618841][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1532.619167][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1532.619596][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1532.620017][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1532.620442][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1532.620867][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1532.621293][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1532.621766][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1532.622116][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1532.622543][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1532.622969][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1532.623386][ C1] Call Trace: [ 1532.623561][ C1] [ 1532.623716][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 1532.624004][ C1] ? print_cpu_stall+0x263/0x6a0 [ 1532.624266][ C1] ? check_cpu_stall+0x284/0x500 [ 1532.624533][ C1] ? rcu_pending+0x92/0x360 [ 1532.624775][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 1532.625057][ C1] ? update_process_times+0xb9/0x110 [ 1532.625341][ C1] ? tick_sched_handle+0x67/0x130 [ 1532.625608][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 1532.625906][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1532.626161][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 1532.626485][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1532.626773][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1532.627080][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1532.627361][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1532.627685][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1532.627959][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1532.628285][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1532.628608][ C1] [ 1532.628767][ C1] [ 1532.628927][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1532.629259][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1532.629562][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1532.629872][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1532.630177][ C1] ? run_ksoftirqd+0xb/0x60 [ 1532.630423][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1532.630752][ C1] ? __orc_find+0x9c/0xf0 [ 1532.630982][ C1] ? lock_acquire+0x1c1/0x220 [ 1532.631229][ C1] ? irqentry_enter+0x2b/0x60 [ 1532.631478][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1532.631738][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1532.632022][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1532.632319][ C1] ? lock_acquire+0x1c1/0x220 [ 1532.632574][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1532.632828][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1532.633102][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1532.633347][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1532.633604][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1532.633874][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1532.634161][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1532.634448][ C1] ip_local_deliver+0x19d/0x480 [ 1532.634711][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1532.635004][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1532.635273][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1532.635551][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1532.635813][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1532.636152][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1532.636432][ C1] ip_rcv+0x564/0x740 [ 1532.636646][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1532.636888][ C1] ? set_track_prepare+0x8a/0xd0 [ 1532.637153][ C1] ? irqentry_enter+0x2b/0x60 [ 1532.637406][ C1] ? irqentry_enter+0x2b/0x60 [ 1532.637660][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1532.637905][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1532.638221][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1532.638568][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1532.638876][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1532.639219][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1532.639519][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1532.639848][ C1] netif_receive_skb+0x55/0x280 [ 1532.640108][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1532.640433][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1532.640787][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1532.641102][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1532.641389][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1532.641690][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1532.642018][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1532.642299][ C1] ? arch_stack_walk+0x68/0x100 [ 1532.642562][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1532.642841][ C1] ? irqentry_enter+0x2b/0x60 [ 1532.643095][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1532.643419][ C1] ? irqentry_enter+0x2b/0x60 [ 1532.643670][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1532.643990][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1532.644273][ C1] ? arch_stack_walk+0x68/0x100 [ 1532.644530][ C1] __tcf_classify+0x32c/0x7d0 [ 1532.644780][ C1] tcf_classify+0x283/0x930 [ 1532.645020][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1532.645290][ C1] tc_run+0x2e4/0x5d0 [ 1532.645509][ C1] ? __pfx_tc_run+0x10/0x10 [ 1532.645754][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1532.646020][ C1] ? irqentry_enter+0x2b/0x60 [ 1532.646275][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1532.646562][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1532.646889][ C1] ip_finish_output2+0x786/0x18e0 [ 1532.647159][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1532.647447][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1532.647717][ C1] ? __ip_finish_output+0x10f/0x770 [ 1532.647993][ C1] ip_output+0x16b/0x4f0 [ 1532.648225][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1532.648556][ C1] ? __pfx_ip_output+0x10/0x10 [ 1532.648818][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1532.649171][ C1] ? __pfx_ip_output+0x10/0x10 [ 1532.649425][ C1] __ip_queue_xmit+0x672/0x1910 [ 1532.649691][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1532.649978][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1532.650279][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1532.650569][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1532.650875][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1532.651165][ C1] tcp_delack_timer+0x84/0x240 [ 1532.651426][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1532.651711][ C1] call_timer_fn+0x176/0x430 [ 1532.651966][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1532.652243][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1532.652520][ C1] __run_timers.part.0+0x52d/0x890 [ 1532.652798][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1532.653090][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1532.653395][ C1] ? __pfx___schedule+0x10/0x10 [ 1532.653652][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1532.653971][ C1] run_timer_softirq+0x72/0x100 [ 1532.654233][ C1] __do_softirq+0x1bc/0x7ff [ 1532.654481][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1532.654758][ C1] run_ksoftirqd+0x2e/0x60 [ 1532.654997][ C1] smpboot_thread_fn+0x30e/0x840 [ 1532.655268][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1532.655560][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1532.655854][ C1] kthread+0x292/0x360 [ 1532.656070][ C1] ? __pfx_kthread+0x10/0x10 [ 1532.656319][ C1] ret_from_fork+0x34/0x70 [ 1532.656558][ C1] ? __pfx_kthread+0x10/0x10 [ 1532.656806][ C1] ret_from_fork_asm+0x1b/0x30 [ 1532.657069][ C1] [ 1560.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 347s! [swapper/0:0] [ 1560.527921][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1560.529128][ C0] irq event stamp: 27567077 [ 1560.529369][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 1560.529892][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 1560.530370][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 1560.530873][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 1560.531368][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1560.531849][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1560.532492][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1560.532829][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1560.533842][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1560.534161][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1560.534577][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1560.534993][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1560.535411][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1560.535827][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1560.536251][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1560.536725][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1560.537076][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1560.537497][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1560.537923][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1560.538348][ C0] Call Trace: [ 1560.538524][ C0] [ 1560.538679][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1560.538959][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1560.539214][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1560.539508][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1560.539793][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1560.540093][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1560.540369][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1560.540690][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1560.540962][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1560.541237][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1560.541568][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1560.541879][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1560.542211][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1560.542516][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1560.542828][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1560.543130][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1560.543452][ C0] ? get_stack_info+0x36/0xc0 [ 1560.543707][ C0] ? lock_acquire+0x1c1/0x220 [ 1560.543960][ C0] ? lock_release+0x1d5/0x250 [ 1560.544212][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1560.544476][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1560.544764][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1560.545067][ C0] ? lock_acquire+0x1c1/0x220 [ 1560.545315][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1560.545568][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1560.545840][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1560.546089][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1560.546349][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1560.546622][ C0] ? __inet_lookup_established+0x341/0x610 [ 1560.546937][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1560.547224][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1560.547512][ C0] ip_local_deliver+0x19d/0x480 [ 1560.547777][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1560.548065][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1560.548337][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1560.548620][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1560.548885][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1560.549219][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1560.549500][ C0] ip_rcv+0x564/0x740 [ 1560.549715][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1560.549961][ C0] ? set_track_prepare+0x8a/0xd0 [ 1560.550229][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1560.550516][ C0] ? rest_init+0x153/0x260 [ 1560.550755][ C0] ? skb_clone+0x10b/0x330 [ 1560.550994][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1560.551332][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1560.551654][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1560.551948][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1560.552256][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1560.552522][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1560.552761][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1560.553073][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1560.553370][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1560.553712][ C0] ? lock_acquire+0x1c1/0x220 [ 1560.553962][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1560.554279][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1560.554576][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1560.554909][ C0] ? __copy_skb_header+0xaf/0x490 [ 1560.555177][ C0] ? __skb_clone+0x57a/0x760 [ 1560.555423][ C0] netif_receive_skb+0x55/0x280 [ 1560.555677][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1560.556000][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1560.556347][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1560.556665][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1560.556951][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1560.557248][ C0] ? hlock_class+0x4e/0x130 [ 1560.557491][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1560.557818][ C0] ? place_entity+0x21/0x2f0 [ 1560.558064][ C0] ? resched_curr+0x219/0x280 [ 1560.558321][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1560.558586][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1560.558872][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1560.559152][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1560.559415][ C0] ? activate_task+0xf5/0x260 [ 1560.559669][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1560.559946][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1560.560216][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1560.560477][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1560.560768][ C0] ? get_stack_info+0x36/0xc0 [ 1560.561016][ C0] ? stack_access_ok+0xda/0x1f0 [ 1560.561273][ C0] ? get_reg+0x119/0x190 [ 1560.561499][ C0] __tcf_classify+0x32c/0x7d0 [ 1560.561752][ C0] tcf_classify+0x283/0x930 [ 1560.562000][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1560.562335][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1560.562598][ C0] ? arch_stack_walk+0x8c/0x100 [ 1560.562856][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1560.563147][ C0] tc_run+0x2e4/0x5d0 [ 1560.563364][ C0] ? __pfx_tc_run+0x10/0x10 [ 1560.563610][ C0] ? lock_acquire+0x1c1/0x220 [ 1560.563863][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1560.564140][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1560.564405][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1560.564694][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1560.564976][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1560.565299][ C0] ? neigh_hh_output+0x348/0x590 [ 1560.565562][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1560.565842][ C0] ip_finish_output2+0x786/0x18e0 [ 1560.566114][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1560.566409][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1560.566759][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1560.567046][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1560.567314][ C0] ? __ip_finish_output+0x10f/0x770 [ 1560.567590][ C0] ip_output+0x16b/0x4f0 [ 1560.567816][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1560.568099][ C0] ? __pfx_ip_output+0x10/0x10 [ 1560.568360][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1560.568660][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1560.568927][ C0] ? ip_local_out+0x114/0x3b0 [ 1560.569181][ C0] __ip_queue_xmit+0x672/0x1910 [ 1560.569444][ C0] ? __skb_clone+0x57a/0x760 [ 1560.569691][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1560.569974][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1560.570272][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1560.570592][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1560.570849][ C0] ? tcp_current_mss+0x40a/0x510 [ 1560.571114][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1560.571392][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1560.571671][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1560.571927][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1560.572194][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1560.572509][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1560.572793][ C0] ? ktime_get+0xb6/0x190 [ 1560.573027][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1560.573304][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1560.573582][ C0] tcp_write_timer+0x82/0x1d0 [ 1560.573835][ C0] call_timer_fn+0x176/0x430 [ 1560.574084][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1560.574357][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1560.574633][ C0] __run_timers.part.0+0x52d/0x890 [ 1560.574904][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1560.575191][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1560.575488][ C0] ? lock_acquire+0x1c1/0x220 [ 1560.575739][ C0] ? clockevents_program_event+0xf6/0x300 [ 1560.576048][ C0] ? lock_release+0x1d5/0x250 [ 1560.576302][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1560.576586][ C0] ? ktime_get+0xb6/0x190 [ 1560.576820][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1560.577119][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1560.577428][ C0] run_timer_softirq+0x72/0x100 [ 1560.577689][ C0] __do_softirq+0x1bc/0x7ff [ 1560.577937][ C0] irq_exit_rcu+0x98/0xc0 [ 1560.578170][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1560.578481][ C0] [ 1560.578639][ C0] [ 1560.578797][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1560.579118][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1560.579385][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1560.580404][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1560.580726][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1560.581144][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1560.581561][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1560.581976][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1560.582395][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1560.582814][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1560.583116][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1560.583388][ C0] default_idle_call+0x69/0xa0 [ 1560.583643][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1560.583904][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1560.584200][ C0] ? lock_release+0x1d5/0x250 [ 1560.584451][ C0] do_idle+0xfb/0x160 [ 1560.584665][ C0] cpu_startup_entry+0x55/0x60 [ 1560.584918][ C0] rest_init+0x153/0x260 [ 1560.585146][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1560.585434][ C0] arch_call_rest_init+0x13/0x40 [ 1560.585701][ C0] start_kernel+0x314/0x3d0 [ 1560.585947][ C0] x86_64_start_reservations+0x18/0x30 [ 1560.586243][ C0] x86_64_start_kernel+0xba/0x110 [ 1560.586509][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1560.586837][ C0] [ 1560.587001][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 347s! [ksoftirqd/1:22] [ 1560.587455][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1560.588655][ C1] irq event stamp: 3886976 [ 1560.588895][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 1560.589393][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 1560.589885][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 1560.590384][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 1560.590877][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1560.591372][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1560.592016][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1560.592358][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1560.593378][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1560.593701][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1560.594119][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1560.594535][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1560.594954][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1560.595373][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1560.595792][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1560.596262][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1560.596617][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1560.597038][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1560.597460][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1560.597885][ C1] Call Trace: [ 1560.598072][ C1] [ 1560.598229][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1560.598516][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1560.598771][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1560.599066][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1560.599350][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1560.599652][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1560.599932][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1560.600252][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1560.600531][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1560.600856][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1560.601166][ C1] [ 1560.601325][ C1] [ 1560.601485][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1560.601819][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1560.602124][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1560.602434][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1560.602739][ C1] ? run_ksoftirqd+0xb/0x60 [ 1560.602985][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1560.603322][ C1] ? __orc_find+0x9c/0xf0 [ 1560.603551][ C1] ? lock_acquire+0x1c1/0x220 [ 1560.603802][ C1] ? irqentry_enter+0x2b/0x60 [ 1560.604055][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1560.604314][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1560.604600][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1560.604897][ C1] ? lock_acquire+0x1c1/0x220 [ 1560.605149][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1560.605405][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1560.605681][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1560.605928][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1560.606188][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1560.606460][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1560.606747][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1560.607036][ C1] ip_local_deliver+0x19d/0x480 [ 1560.607301][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1560.607591][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1560.607858][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1560.608135][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1560.608411][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1560.608748][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1560.609029][ C1] ip_rcv+0x564/0x740 [ 1560.609247][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1560.609494][ C1] ? set_track_prepare+0x8a/0xd0 [ 1560.609765][ C1] ? irqentry_enter+0x2b/0x60 [ 1560.610016][ C1] ? irqentry_enter+0x2b/0x60 [ 1560.610266][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1560.610507][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1560.610822][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1560.611165][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1560.611475][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1560.611818][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1560.612127][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1560.612464][ C1] netif_receive_skb+0x55/0x280 [ 1560.612724][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1560.613054][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1560.613403][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1560.613720][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1560.614008][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1560.614312][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1560.614639][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1560.614920][ C1] ? arch_stack_walk+0x68/0x100 [ 1560.615185][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1560.615466][ C1] ? irqentry_enter+0x2b/0x60 [ 1560.615720][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1560.616046][ C1] ? irqentry_enter+0x2b/0x60 [ 1560.616298][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1560.616620][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1560.616905][ C1] ? arch_stack_walk+0x68/0x100 [ 1560.617165][ C1] __tcf_classify+0x32c/0x7d0 [ 1560.617419][ C1] tcf_classify+0x283/0x930 [ 1560.617660][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1560.617930][ C1] tc_run+0x2e4/0x5d0 [ 1560.618144][ C1] ? __pfx_tc_run+0x10/0x10 [ 1560.618401][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1560.618671][ C1] ? irqentry_enter+0x2b/0x60 [ 1560.618921][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1560.619205][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1560.619533][ C1] ip_finish_output2+0x786/0x18e0 [ 1560.619807][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1560.620100][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1560.620367][ C1] ? __ip_finish_output+0x10f/0x770 [ 1560.620654][ C1] ip_output+0x16b/0x4f0 [ 1560.620887][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1560.621214][ C1] ? __pfx_ip_output+0x10/0x10 [ 1560.621474][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1560.621827][ C1] ? __pfx_ip_output+0x10/0x10 [ 1560.622083][ C1] __ip_queue_xmit+0x672/0x1910 [ 1560.622351][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1560.622636][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1560.622938][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1560.623231][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1560.623530][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1560.623819][ C1] tcp_delack_timer+0x84/0x240 [ 1560.624078][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1560.624362][ C1] call_timer_fn+0x176/0x430 [ 1560.624609][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1560.624887][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1560.625167][ C1] __run_timers.part.0+0x52d/0x890 [ 1560.625439][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1560.625730][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1560.626032][ C1] ? __pfx___schedule+0x10/0x10 [ 1560.626291][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1560.626610][ C1] run_timer_softirq+0x72/0x100 [ 1560.626873][ C1] __do_softirq+0x1bc/0x7ff [ 1560.627127][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1560.627405][ C1] run_ksoftirqd+0x2e/0x60 [ 1560.627645][ C1] smpboot_thread_fn+0x30e/0x840 [ 1560.627915][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1560.628207][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1560.628505][ C1] kthread+0x292/0x360 [ 1560.628725][ C1] ? __pfx_kthread+0x10/0x10 [ 1560.628969][ C1] ret_from_fork+0x34/0x70 [ 1560.629212][ C1] ? __pfx_kthread+0x10/0x10 [ 1560.629459][ C1] ret_from_fork_asm+0x1b/0x30 [ 1560.629723][ C1] [ 1588.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 373s! [swapper/0:0] [ 1588.527917][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1588.529116][ C0] irq event stamp: 27567077 [ 1588.529352][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 1588.529875][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 1588.530350][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 1588.530859][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 1588.531356][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1588.531833][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1588.532469][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1588.532804][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1588.533817][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1588.534138][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1588.534556][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1588.534978][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1588.535394][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1588.535810][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1588.536225][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1588.536692][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1588.537041][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1588.537460][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1588.537884][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1588.538314][ C0] Call Trace: [ 1588.538494][ C0] [ 1588.538653][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1588.538931][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1588.539185][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1588.539478][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1588.539762][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1588.540063][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1588.540340][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1588.540660][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1588.540936][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1588.541214][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1588.541544][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1588.541860][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1588.542191][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1588.542497][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1588.542810][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1588.543111][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1588.543435][ C0] ? get_stack_info+0x36/0xc0 [ 1588.543689][ C0] ? lock_acquire+0x1c1/0x220 [ 1588.543943][ C0] ? lock_release+0x1d5/0x250 [ 1588.544196][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1588.544457][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1588.544742][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1588.545042][ C0] ? lock_acquire+0x1c1/0x220 [ 1588.545290][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1588.545544][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1588.545814][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1588.546063][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1588.546326][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1588.546598][ C0] ? __inet_lookup_established+0x341/0x610 [ 1588.546910][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1588.547196][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1588.547482][ C0] ip_local_deliver+0x19d/0x480 [ 1588.547743][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1588.548031][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1588.548302][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1588.548582][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1588.548848][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1588.549181][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1588.549459][ C0] ip_rcv+0x564/0x740 [ 1588.549678][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1588.549927][ C0] ? set_track_prepare+0x8a/0xd0 [ 1588.550199][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1588.550487][ C0] ? rest_init+0x153/0x260 [ 1588.550727][ C0] ? skb_clone+0x10b/0x330 [ 1588.550964][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1588.551302][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1588.551627][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1588.551922][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1588.552229][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1588.552488][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1588.552728][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1588.553040][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1588.553335][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1588.553680][ C0] ? lock_acquire+0x1c1/0x220 [ 1588.553933][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1588.554243][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1588.554539][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1588.554872][ C0] ? __copy_skb_header+0xaf/0x490 [ 1588.555143][ C0] ? __skb_clone+0x57a/0x760 [ 1588.555390][ C0] netif_receive_skb+0x55/0x280 [ 1588.555648][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1588.555975][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1588.556325][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1588.556640][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1588.556926][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1588.557230][ C0] ? hlock_class+0x4e/0x130 [ 1588.557475][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1588.557801][ C0] ? place_entity+0x21/0x2f0 [ 1588.558044][ C0] ? resched_curr+0x219/0x280 [ 1588.558302][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1588.558568][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1588.558848][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1588.559132][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1588.559392][ C0] ? activate_task+0xf5/0x260 [ 1588.559646][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1588.559923][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1588.560194][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1588.560455][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1588.560747][ C0] ? get_stack_info+0x36/0xc0 [ 1588.560995][ C0] ? stack_access_ok+0xda/0x1f0 [ 1588.561250][ C0] ? get_reg+0x119/0x190 [ 1588.561475][ C0] __tcf_classify+0x32c/0x7d0 [ 1588.561729][ C0] tcf_classify+0x283/0x930 [ 1588.561975][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1588.562308][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1588.562575][ C0] ? arch_stack_walk+0x8c/0x100 [ 1588.562833][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1588.563123][ C0] tc_run+0x2e4/0x5d0 [ 1588.563349][ C0] ? __pfx_tc_run+0x10/0x10 [ 1588.563594][ C0] ? lock_acquire+0x1c1/0x220 [ 1588.563849][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1588.564126][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1588.564389][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1588.564676][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1588.564956][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1588.565280][ C0] ? neigh_hh_output+0x348/0x590 [ 1588.565543][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1588.565821][ C0] ip_finish_output2+0x786/0x18e0 [ 1588.566092][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1588.566387][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1588.566736][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1588.567022][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1588.567289][ C0] ? __ip_finish_output+0x10f/0x770 [ 1588.567563][ C0] ip_output+0x16b/0x4f0 [ 1588.567787][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1588.568077][ C0] ? __pfx_ip_output+0x10/0x10 [ 1588.568340][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1588.568637][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1588.568902][ C0] ? ip_local_out+0x114/0x3b0 [ 1588.569152][ C0] __ip_queue_xmit+0x672/0x1910 [ 1588.569412][ C0] ? __skb_clone+0x57a/0x760 [ 1588.569658][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1588.569940][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1588.570240][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1588.570557][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1588.570811][ C0] ? tcp_current_mss+0x40a/0x510 [ 1588.571078][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1588.571359][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1588.571636][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1588.571893][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1588.572159][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1588.572476][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1588.572755][ C0] ? ktime_get+0xb6/0x190 [ 1588.572989][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1588.573264][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1588.573545][ C0] tcp_write_timer+0x82/0x1d0 [ 1588.573799][ C0] call_timer_fn+0x176/0x430 [ 1588.574049][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1588.574319][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1588.574596][ C0] __run_timers.part.0+0x52d/0x890 [ 1588.574866][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1588.575149][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1588.575445][ C0] ? lock_acquire+0x1c1/0x220 [ 1588.575697][ C0] ? clockevents_program_event+0xf6/0x300 [ 1588.576004][ C0] ? lock_release+0x1d5/0x250 [ 1588.576256][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1588.576533][ C0] ? ktime_get+0xb6/0x190 [ 1588.576769][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1588.577068][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1588.577377][ C0] run_timer_softirq+0x72/0x100 [ 1588.577640][ C0] __do_softirq+0x1bc/0x7ff [ 1588.577886][ C0] irq_exit_rcu+0x98/0xc0 [ 1588.578124][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1588.578431][ C0] [ 1588.578591][ C0] [ 1588.578751][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1588.579073][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1588.579340][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1588.580353][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1588.580672][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1588.581088][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1588.581506][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1588.581920][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1588.582333][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1588.582750][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1588.583052][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1588.583323][ C0] default_idle_call+0x69/0xa0 [ 1588.583579][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1588.583839][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1588.584132][ C0] ? lock_release+0x1d5/0x250 [ 1588.584378][ C0] do_idle+0xfb/0x160 [ 1588.584590][ C0] cpu_startup_entry+0x55/0x60 [ 1588.584844][ C0] rest_init+0x153/0x260 [ 1588.585069][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1588.585352][ C0] arch_call_rest_init+0x13/0x40 [ 1588.585617][ C0] start_kernel+0x314/0x3d0 [ 1588.585860][ C0] x86_64_start_reservations+0x18/0x30 [ 1588.586155][ C0] x86_64_start_kernel+0xba/0x110 [ 1588.586421][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1588.586747][ C0] [ 1588.586911][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 373s! [ksoftirqd/1:22] [ 1588.587361][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1588.588567][ C1] irq event stamp: 3886976 [ 1588.588802][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 1588.589304][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 1588.589800][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 1588.590301][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 1588.590791][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1588.591290][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1588.591941][ C1] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 1588.592248][ C1] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 1588.593271][ C1] RSP: 0018:ffffc9000019e9d0 EFLAGS: 00000282 [ 1588.593596][ C1] RAX: ffff88800a098e1c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1588.594016][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1588.594436][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1588.594858][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1588.595280][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1588.595700][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1588.596173][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1588.596528][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1588.596950][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1588.597376][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1588.597804][ C1] Call Trace: [ 1588.597992][ C1] [ 1588.598157][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1588.598439][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1588.598692][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1588.598985][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1588.599271][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1588.599573][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1588.599851][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1588.600172][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1588.600450][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1588.600775][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1588.601088][ C1] [ 1588.601249][ C1] [ 1588.601411][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1588.601748][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1588.602056][ C1] ? kasan_check_range+0x1a/0x1c0 [ 1588.602324][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 1588.602619][ C1] ? run_ksoftirqd+0xb/0x60 [ 1588.602861][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1588.603194][ C1] ? __orc_find+0x9c/0xf0 [ 1588.603427][ C1] ? lock_acquire+0x1c1/0x220 [ 1588.603684][ C1] ? irqentry_enter+0x2b/0x60 [ 1588.603940][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1588.604208][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1588.604499][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1588.604802][ C1] ? lock_acquire+0x1c1/0x220 [ 1588.605052][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1588.605305][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1588.605579][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1588.605834][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1588.606100][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1588.606374][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1588.606666][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1588.606960][ C1] ip_local_deliver+0x19d/0x480 [ 1588.607221][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1588.607506][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1588.607775][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1588.608060][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1588.608330][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1588.608672][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1588.608946][ C1] ip_rcv+0x564/0x740 [ 1588.609163][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1588.609412][ C1] ? set_track_prepare+0x8a/0xd0 [ 1588.609677][ C1] ? irqentry_enter+0x2b/0x60 [ 1588.609931][ C1] ? irqentry_enter+0x2b/0x60 [ 1588.610190][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1588.610437][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1588.610753][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1588.611099][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1588.611413][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1588.611751][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1588.612050][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1588.612387][ C1] netif_receive_skb+0x55/0x280 [ 1588.612654][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1588.612984][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1588.613337][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1588.613649][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1588.613941][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1588.614248][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1588.614581][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1588.614865][ C1] ? arch_stack_walk+0x68/0x100 [ 1588.615125][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1588.615399][ C1] ? irqentry_enter+0x2b/0x60 [ 1588.615649][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1588.615971][ C1] ? irqentry_enter+0x2b/0x60 [ 1588.616229][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1588.616553][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1588.616832][ C1] ? arch_stack_walk+0x68/0x100 [ 1588.617096][ C1] __tcf_classify+0x32c/0x7d0 [ 1588.617354][ C1] tcf_classify+0x283/0x930 [ 1588.617600][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1588.617875][ C1] tc_run+0x2e4/0x5d0 [ 1588.618093][ C1] ? __pfx_tc_run+0x10/0x10 [ 1588.618347][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1588.618615][ C1] ? irqentry_enter+0x2b/0x60 [ 1588.618869][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1588.619156][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1588.619483][ C1] ip_finish_output2+0x786/0x18e0 [ 1588.619752][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1588.620040][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1588.620309][ C1] ? __ip_finish_output+0x10f/0x770 [ 1588.620587][ C1] ip_output+0x16b/0x4f0 [ 1588.620814][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1588.621138][ C1] ? __pfx_ip_output+0x10/0x10 [ 1588.621396][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1588.621753][ C1] ? __pfx_ip_output+0x10/0x10 [ 1588.622014][ C1] __ip_queue_xmit+0x672/0x1910 [ 1588.622276][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1588.622557][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1588.622857][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1588.623145][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1588.623441][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1588.623727][ C1] tcp_delack_timer+0x84/0x240 [ 1588.623983][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1588.624274][ C1] call_timer_fn+0x176/0x430 [ 1588.624526][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1588.624801][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1588.625083][ C1] __run_timers.part.0+0x52d/0x890 [ 1588.625360][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1588.625648][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1588.625949][ C1] ? __pfx___schedule+0x10/0x10 [ 1588.626213][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1588.626540][ C1] run_timer_softirq+0x72/0x100 [ 1588.626799][ C1] __do_softirq+0x1bc/0x7ff [ 1588.627043][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1588.627318][ C1] run_ksoftirqd+0x2e/0x60 [ 1588.627560][ C1] smpboot_thread_fn+0x30e/0x840 [ 1588.627830][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1588.628127][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1588.628426][ C1] kthread+0x292/0x360 [ 1588.628642][ C1] ? __pfx_kthread+0x10/0x10 [ 1588.628892][ C1] ret_from_fork+0x34/0x70 [ 1588.629132][ C1] ? __pfx_kthread+0x10/0x10 [ 1588.629384][ C1] ret_from_fork_asm+0x1b/0x30 [ 1588.629647][ C1] [ 1610.659025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 1610.659419][ C1] rcu: 1-....: (417076 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=102097 [ 1610.660004][ C1] rcu: (t=416350 jiffies g=1007429 q=31 ncpus=4) [ 1610.660346][ C1] Sending NMI from CPU 1 to CPUs 0: [ 1610.660630][ C0] NMI backtrace for cpu 0 [ 1610.660637][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1610.660641][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1610.660644][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1610.660654][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1610.660658][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1610.660662][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1610.660664][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1610.660665][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1610.660667][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1610.660669][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1610.660671][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1610.660673][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1610.660676][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1610.660678][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1610.660679][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1610.660681][ C0] Call Trace: [ 1610.660684][ C0] [ 1610.660689][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 1610.660695][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 1610.660701][ C0] ? nmi_handle+0x156/0x420 [ 1610.660706][ C0] ? default_do_nmi+0x41/0x100 [ 1610.660710][ C0] ? exc_nmi+0xf3/0x120 [ 1610.660712][ C0] ? end_repeat_nmi+0xf/0x60 [ 1610.660717][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1610.660721][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1610.660724][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1610.660728][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1610.660732][ C0] [ 1610.660732][ C0] [ 1610.660734][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1610.660736][ C0] ? get_stack_info+0x36/0xc0 [ 1610.660741][ C0] ? lock_acquire+0x1c1/0x220 [ 1610.660747][ C0] ? lock_release+0x1d5/0x250 [ 1610.660750][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1610.660755][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1610.660758][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1610.660761][ C0] ? lock_acquire+0x1c1/0x220 [ 1610.660763][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1610.660769][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1610.660772][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1610.660780][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1610.660782][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1610.660787][ C0] ? __inet_lookup_established+0x341/0x610 [ 1610.660793][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1610.660801][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1610.660805][ C0] ip_local_deliver+0x19d/0x480 [ 1610.660808][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1610.660810][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1610.660816][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1610.660820][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1610.660823][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1610.660827][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1610.660838][ C0] ip_rcv+0x564/0x740 [ 1610.660841][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1610.660844][ C0] ? set_track_prepare+0x8a/0xd0 [ 1610.660849][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1610.660851][ C0] ? rest_init+0x153/0x260 [ 1610.660855][ C0] ? skb_clone+0x10b/0x330 [ 1610.660861][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1610.660875][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1610.660880][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1610.660886][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1610.660895][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1610.660898][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1610.660901][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1610.660905][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1610.660909][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1610.660912][ C0] ? lock_acquire+0x1c1/0x220 [ 1610.660914][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1610.660918][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1610.660921][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1610.660924][ C0] ? __copy_skb_header+0xaf/0x490 [ 1610.660927][ C0] ? __skb_clone+0x57a/0x760 [ 1610.660930][ C0] netif_receive_skb+0x55/0x280 [ 1610.660932][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1610.660942][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1610.660949][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1610.660955][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1610.660960][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1610.660969][ C0] ? hlock_class+0x4e/0x130 [ 1610.660975][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1610.660985][ C0] ? place_entity+0x21/0x2f0 [ 1610.660988][ C0] ? resched_curr+0x219/0x280 [ 1610.660992][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1610.660995][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1610.660998][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1610.661003][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1610.661006][ C0] ? activate_task+0xf5/0x260 [ 1610.661009][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1610.661014][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1610.661018][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1610.661022][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1610.661025][ C0] ? get_stack_info+0x36/0xc0 [ 1610.661029][ C0] ? stack_access_ok+0xda/0x1f0 [ 1610.661031][ C0] ? get_reg+0x119/0x190 [ 1610.661034][ C0] __tcf_classify+0x32c/0x7d0 [ 1610.661039][ C0] tcf_classify+0x283/0x930 [ 1610.661042][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1610.661046][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1610.661048][ C0] ? arch_stack_walk+0x8c/0x100 [ 1610.661053][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1610.661056][ C0] tc_run+0x2e4/0x5d0 [ 1610.661061][ C0] ? __pfx_tc_run+0x10/0x10 [ 1610.661064][ C0] ? lock_acquire+0x1c1/0x220 [ 1610.661067][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1610.661072][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1610.661077][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1610.661080][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1610.661084][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1610.661090][ C0] ? neigh_hh_output+0x348/0x590 [ 1610.661094][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1610.661098][ C0] ip_finish_output2+0x786/0x18e0 [ 1610.661102][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1610.661107][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1610.661115][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1610.661118][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1610.661122][ C0] ? __ip_finish_output+0x10f/0x770 [ 1610.661126][ C0] ip_output+0x16b/0x4f0 [ 1610.661129][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1610.661135][ C0] ? __pfx_ip_output+0x10/0x10 [ 1610.661138][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1610.661142][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1610.661145][ C0] ? ip_local_out+0x114/0x3b0 [ 1610.661149][ C0] __ip_queue_xmit+0x672/0x1910 [ 1610.661153][ C0] ? __skb_clone+0x57a/0x760 [ 1610.661156][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1610.661164][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1610.661169][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1610.661172][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1610.661178][ C0] ? tcp_current_mss+0x40a/0x510 [ 1610.661181][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1610.661184][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1610.661187][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1610.661189][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1610.661191][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1610.661195][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1610.661201][ C0] ? ktime_get+0xb6/0x190 [ 1610.661206][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1610.661210][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1610.661213][ C0] tcp_write_timer+0x82/0x1d0 [ 1610.661217][ C0] call_timer_fn+0x176/0x430 [ 1610.661220][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1610.661225][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1610.661229][ C0] __run_timers.part.0+0x52d/0x890 [ 1610.661232][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1610.661236][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1610.661239][ C0] ? lock_acquire+0x1c1/0x220 [ 1610.661241][ C0] ? clockevents_program_event+0xf6/0x300 [ 1610.661245][ C0] ? lock_release+0x1d5/0x250 [ 1610.661248][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1610.661250][ C0] ? ktime_get+0xb6/0x190 [ 1610.661253][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1610.661257][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1610.661261][ C0] run_timer_softirq+0x72/0x100 [ 1610.661264][ C0] __do_softirq+0x1bc/0x7ff [ 1610.661269][ C0] irq_exit_rcu+0x98/0xc0 [ 1610.661272][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1610.661275][ C0] [ 1610.661276][ C0] [ 1610.661277][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1610.661282][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1610.661285][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1610.661287][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1610.661289][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1610.661290][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1610.661292][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1610.661293][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1610.661294][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1610.661297][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1610.661301][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1610.661304][ C0] default_idle_call+0x69/0xa0 [ 1610.661306][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1610.661309][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1610.661314][ C0] ? lock_release+0x1d5/0x250 [ 1610.661318][ C0] do_idle+0xfb/0x160 [ 1610.661320][ C0] cpu_startup_entry+0x55/0x60 [ 1610.661323][ C0] rest_init+0x153/0x260 [ 1610.661325][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1610.661330][ C0] arch_call_rest_init+0x13/0x40 [ 1610.661334][ C0] start_kernel+0x314/0x3d0 [ 1610.661337][ C0] x86_64_start_reservations+0x18/0x30 [ 1610.661342][ C0] x86_64_start_kernel+0xba/0x110 [ 1610.661345][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1610.661354][ C0] [ 1610.661626][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1610.715767][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1610.716416][ C1] RIP: 0010:kasan_check_range+0x69/0x1c0 [ 1610.716724][ C1] Code: 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 <48> c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 [ 1610.717737][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000212 [ 1610.718069][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1610.718491][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1610.718916][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffff88800a098e1b [ 1610.719342][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1610.719763][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1610.720185][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1610.720661][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1610.721009][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1610.721433][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1610.721853][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1610.722274][ C1] Call Trace: [ 1610.722454][ C1] [ 1610.722611][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 1610.722901][ C1] ? print_cpu_stall+0x263/0x6a0 [ 1610.723165][ C1] ? check_cpu_stall+0x284/0x500 [ 1610.723429][ C1] ? rcu_pending+0x92/0x360 [ 1610.723668][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 1610.723949][ C1] ? update_process_times+0xb9/0x110 [ 1610.724234][ C1] ? tick_sched_handle+0x67/0x130 [ 1610.724506][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 1610.724805][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1610.725066][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 1610.725394][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1610.725684][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1610.725988][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1610.726268][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1610.726591][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1610.726864][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1610.727192][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1610.727504][ C1] [ 1610.727660][ C1] [ 1610.727817][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1610.728153][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1610.728456][ C1] ? kasan_check_range+0x69/0x1c0 [ 1610.728724][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 1610.729015][ C1] ? run_ksoftirqd+0xb/0x60 [ 1610.729258][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1610.729584][ C1] ? __orc_find+0x9c/0xf0 [ 1610.729816][ C1] ? lock_acquire+0x1c1/0x220 [ 1610.730072][ C1] ? irqentry_enter+0x2b/0x60 [ 1610.730329][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1610.730592][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1610.730885][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1610.731187][ C1] ? lock_acquire+0x1c1/0x220 [ 1610.731433][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1610.731683][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1610.731954][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1610.732204][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1610.732467][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1610.732739][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1610.733032][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1610.733327][ C1] ip_local_deliver+0x19d/0x480 [ 1610.733586][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1610.733871][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1610.734134][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1610.734414][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1610.734678][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1610.735013][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1610.735292][ C1] ip_rcv+0x564/0x740 [ 1610.735506][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1610.735750][ C1] ? set_track_prepare+0x8a/0xd0 [ 1610.736015][ C1] ? irqentry_enter+0x2b/0x60 [ 1610.736263][ C1] ? irqentry_enter+0x2b/0x60 [ 1610.736511][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1610.736750][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1610.737065][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1610.737404][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1610.737710][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1610.738058][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1610.738357][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1610.738693][ C1] netif_receive_skb+0x55/0x280 [ 1610.738956][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1610.739291][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1610.739640][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1610.739952][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1610.740245][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1610.740552][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1610.740883][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1610.741168][ C1] ? arch_stack_walk+0x68/0x100 [ 1610.741427][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1610.741702][ C1] ? irqentry_enter+0x2b/0x60 [ 1610.741951][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1610.742271][ C1] ? irqentry_enter+0x2b/0x60 [ 1610.742525][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1610.742854][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1610.743134][ C1] ? arch_stack_walk+0x68/0x100 [ 1610.743400][ C1] __tcf_classify+0x32c/0x7d0 [ 1610.743658][ C1] tcf_classify+0x283/0x930 [ 1610.743905][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1610.744179][ C1] tc_run+0x2e4/0x5d0 [ 1610.744396][ C1] ? __pfx_tc_run+0x10/0x10 [ 1610.744643][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1610.744910][ C1] ? irqentry_enter+0x2b/0x60 [ 1610.745158][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1610.745440][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1610.745759][ C1] ip_finish_output2+0x786/0x18e0 [ 1610.746031][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1610.746325][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1610.746591][ C1] ? __ip_finish_output+0x10f/0x770 [ 1610.746873][ C1] ip_output+0x16b/0x4f0 [ 1610.747100][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1610.747417][ C1] ? __pfx_ip_output+0x10/0x10 [ 1610.747676][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1610.748030][ C1] ? __pfx_ip_output+0x10/0x10 [ 1610.748298][ C1] __ip_queue_xmit+0x672/0x1910 [ 1610.748560][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1610.748841][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1610.749137][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1610.749423][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1610.749718][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1610.750002][ C1] tcp_delack_timer+0x84/0x240 [ 1610.750256][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1610.750545][ C1] call_timer_fn+0x176/0x430 [ 1610.750797][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1610.751073][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1610.751355][ C1] __run_timers.part.0+0x52d/0x890 [ 1610.751632][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1610.751919][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1610.752218][ C1] ? __pfx___schedule+0x10/0x10 [ 1610.752485][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1610.752805][ C1] run_timer_softirq+0x72/0x100 [ 1610.753064][ C1] __do_softirq+0x1bc/0x7ff [ 1610.753305][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1610.753577][ C1] run_ksoftirqd+0x2e/0x60 [ 1610.753818][ C1] smpboot_thread_fn+0x30e/0x840 [ 1610.754087][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1610.754379][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1610.754666][ C1] kthread+0x292/0x360 [ 1610.754888][ C1] ? __pfx_kthread+0x10/0x10 [ 1610.755133][ C1] ret_from_fork+0x34/0x70 [ 1610.755374][ C1] ? __pfx_kthread+0x10/0x10 [ 1610.755617][ C1] ret_from_fork_asm+0x1b/0x30 [ 1610.755878][ C1] [ 1636.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 418s! [swapper/0:0] [ 1636.527920][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1636.529120][ C0] irq event stamp: 27567077 [ 1636.529361][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 1636.529889][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 1636.530359][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 1636.530857][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 1636.531350][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1636.531826][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1636.532474][ C0] RIP: 0010:__kasan_check_read+0x0/0x20 [ 1636.532771][ C0] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 1636.533797][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000202 [ 1636.534123][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1636.534542][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1636.534967][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1636.535393][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1636.535816][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1636.536236][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1636.536709][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1636.537054][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1636.537476][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1636.537892][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1636.538318][ C0] Call Trace: [ 1636.538504][ C0] [ 1636.538659][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1636.538935][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1636.539191][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1636.539479][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1636.539768][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1636.540078][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1636.540361][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1636.540682][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1636.540953][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1636.541235][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1636.541559][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1636.541871][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1636.542207][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1636.542509][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 1636.542799][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 1636.543094][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1636.543417][ C0] ? get_stack_info+0x36/0xc0 [ 1636.543674][ C0] ? lock_acquire+0x1c1/0x220 [ 1636.543929][ C0] ? lock_release+0x1d5/0x250 [ 1636.544183][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1636.544446][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1636.544734][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1636.545033][ C0] ? lock_acquire+0x1c1/0x220 [ 1636.545279][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1636.545528][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1636.545800][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1636.546048][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1636.546311][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1636.546581][ C0] ? __inet_lookup_established+0x341/0x610 [ 1636.546897][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1636.547186][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1636.547476][ C0] ip_local_deliver+0x19d/0x480 [ 1636.547736][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1636.548031][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1636.548295][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1636.548573][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1636.548835][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1636.549167][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1636.549447][ C0] ip_rcv+0x564/0x740 [ 1636.549659][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1636.549903][ C0] ? set_track_prepare+0x8a/0xd0 [ 1636.550168][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1636.550454][ C0] ? rest_init+0x153/0x260 [ 1636.550694][ C0] ? skb_clone+0x10b/0x330 [ 1636.550931][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1636.551270][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1636.551589][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1636.551887][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1636.552194][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1636.552450][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1636.552687][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1636.553002][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1636.553299][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1636.553641][ C0] ? lock_acquire+0x1c1/0x220 [ 1636.553896][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1636.554209][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1636.554504][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1636.554840][ C0] ? __copy_skb_header+0xaf/0x490 [ 1636.555111][ C0] ? __skb_clone+0x57a/0x760 [ 1636.555358][ C0] netif_receive_skb+0x55/0x280 [ 1636.555614][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1636.555937][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1636.556287][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1636.556600][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1636.556886][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1636.557182][ C0] ? hlock_class+0x4e/0x130 [ 1636.557423][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1636.557751][ C0] ? place_entity+0x21/0x2f0 [ 1636.558002][ C0] ? resched_curr+0x219/0x280 [ 1636.558253][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1636.558519][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1636.558799][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1636.559080][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1636.559340][ C0] ? activate_task+0xf5/0x260 [ 1636.559593][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1636.559869][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1636.560140][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1636.560402][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1636.560695][ C0] ? get_stack_info+0x36/0xc0 [ 1636.560945][ C0] ? stack_access_ok+0xda/0x1f0 [ 1636.561203][ C0] ? get_reg+0x119/0x190 [ 1636.561428][ C0] __tcf_classify+0x32c/0x7d0 [ 1636.561682][ C0] tcf_classify+0x283/0x930 [ 1636.561927][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1636.562260][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1636.562524][ C0] ? arch_stack_walk+0x8c/0x100 [ 1636.562783][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1636.563073][ C0] tc_run+0x2e4/0x5d0 [ 1636.563288][ C0] ? __pfx_tc_run+0x10/0x10 [ 1636.563532][ C0] ? lock_acquire+0x1c1/0x220 [ 1636.563783][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1636.564060][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1636.564324][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1636.564611][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1636.564892][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1636.565212][ C0] ? neigh_hh_output+0x348/0x590 [ 1636.565477][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1636.565755][ C0] ip_finish_output2+0x786/0x18e0 [ 1636.566026][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1636.566321][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1636.566672][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1636.566960][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1636.567227][ C0] ? __ip_finish_output+0x10f/0x770 [ 1636.567502][ C0] ip_output+0x16b/0x4f0 [ 1636.567725][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1636.568015][ C0] ? __pfx_ip_output+0x10/0x10 [ 1636.568275][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1636.568574][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1636.568840][ C0] ? ip_local_out+0x114/0x3b0 [ 1636.569090][ C0] __ip_queue_xmit+0x672/0x1910 [ 1636.569346][ C0] ? __skb_clone+0x57a/0x760 [ 1636.569589][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1636.569872][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1636.570169][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1636.570489][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1636.570746][ C0] ? tcp_current_mss+0x40a/0x510 [ 1636.571008][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1636.571288][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1636.571566][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1636.571825][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1636.572092][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1636.572408][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1636.572686][ C0] ? ktime_get+0xb6/0x190 [ 1636.572921][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1636.573196][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1636.573473][ C0] tcp_write_timer+0x82/0x1d0 [ 1636.573725][ C0] call_timer_fn+0x176/0x430 [ 1636.573976][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1636.574249][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1636.574527][ C0] __run_timers.part.0+0x52d/0x890 [ 1636.574796][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1636.575085][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1636.575381][ C0] ? lock_acquire+0x1c1/0x220 [ 1636.575631][ C0] ? clockevents_program_event+0xf6/0x300 [ 1636.575940][ C0] ? lock_release+0x1d5/0x250 [ 1636.576195][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1636.576477][ C0] ? ktime_get+0xb6/0x190 [ 1636.576711][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1636.577010][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1636.577320][ C0] run_timer_softirq+0x72/0x100 [ 1636.577579][ C0] __do_softirq+0x1bc/0x7ff [ 1636.577824][ C0] irq_exit_rcu+0x98/0xc0 [ 1636.578062][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1636.578361][ C0] [ 1636.578523][ C0] [ 1636.578680][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1636.579004][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1636.579271][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1636.580283][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1636.580605][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1636.581021][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1636.581434][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1636.581852][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1636.582268][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1636.582684][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1636.582984][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1636.583255][ C0] default_idle_call+0x69/0xa0 [ 1636.583508][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1636.583769][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1636.584065][ C0] ? lock_release+0x1d5/0x250 [ 1636.584314][ C0] do_idle+0xfb/0x160 [ 1636.584525][ C0] cpu_startup_entry+0x55/0x60 [ 1636.584775][ C0] rest_init+0x153/0x260 [ 1636.585003][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1636.585291][ C0] arch_call_rest_init+0x13/0x40 [ 1636.585555][ C0] start_kernel+0x314/0x3d0 [ 1636.585800][ C0] x86_64_start_reservations+0x18/0x30 [ 1636.586094][ C0] x86_64_start_kernel+0xba/0x110 [ 1636.586363][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1636.586687][ C0] [ 1636.586850][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 418s! [ksoftirqd/1:22] [ 1636.587302][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1636.588510][ C1] irq event stamp: 3886976 [ 1636.588749][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 1636.589246][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 1636.589741][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 1636.590242][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 1636.590735][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1636.591232][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1636.591874][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1636.592214][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1636.593234][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1636.593556][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1636.593977][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1636.594395][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1636.594812][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1636.595230][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1636.595649][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1636.596121][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1636.596473][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1636.596897][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1636.597326][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1636.597749][ C1] Call Trace: [ 1636.597935][ C1] [ 1636.598091][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1636.598370][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1636.598627][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1636.598922][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1636.599209][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1636.599510][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1636.599787][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1636.600111][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1636.600387][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1636.600708][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1636.601019][ C1] [ 1636.601180][ C1] [ 1636.601341][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1636.601674][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1636.601977][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1636.602287][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1636.602594][ C1] ? run_ksoftirqd+0xb/0x60 [ 1636.602841][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1636.603171][ C1] ? __orc_find+0x9c/0xf0 [ 1636.603401][ C1] ? lock_acquire+0x1c1/0x220 [ 1636.603652][ C1] ? irqentry_enter+0x2b/0x60 [ 1636.603903][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1636.604163][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1636.604447][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1636.604748][ C1] ? lock_acquire+0x1c1/0x220 [ 1636.605002][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1636.605261][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1636.605536][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1636.605781][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1636.606040][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1636.606312][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1636.606601][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1636.606892][ C1] ip_local_deliver+0x19d/0x480 [ 1636.607154][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1636.607440][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1636.607708][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1636.607992][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1636.608260][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1636.608599][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1636.608876][ C1] ip_rcv+0x564/0x740 [ 1636.609095][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1636.609344][ C1] ? set_track_prepare+0x8a/0xd0 [ 1636.609614][ C1] ? irqentry_enter+0x2b/0x60 [ 1636.609866][ C1] ? irqentry_enter+0x2b/0x60 [ 1636.610120][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1636.610360][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1636.610675][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1636.611016][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1636.611327][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1636.611672][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1636.611974][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1636.612309][ C1] netif_receive_skb+0x55/0x280 [ 1636.612567][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1636.612893][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1636.613245][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1636.613563][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1636.613858][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1636.614164][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1636.614495][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1636.614778][ C1] ? arch_stack_walk+0x68/0x100 [ 1636.615052][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1636.615335][ C1] ? irqentry_enter+0x2b/0x60 [ 1636.615592][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1636.615914][ C1] ? irqentry_enter+0x2b/0x60 [ 1636.616164][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1636.616487][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1636.616772][ C1] ? arch_stack_walk+0x68/0x100 [ 1636.617033][ C1] __tcf_classify+0x32c/0x7d0 [ 1636.617285][ C1] tcf_classify+0x283/0x930 [ 1636.617528][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1636.617797][ C1] tc_run+0x2e4/0x5d0 [ 1636.618020][ C1] ? __pfx_tc_run+0x10/0x10 [ 1636.618269][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1636.618540][ C1] ? irqentry_enter+0x2b/0x60 [ 1636.618792][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1636.619080][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1636.619401][ C1] ip_finish_output2+0x786/0x18e0 [ 1636.619677][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1636.619974][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1636.620241][ C1] ? __ip_finish_output+0x10f/0x770 [ 1636.620522][ C1] ip_output+0x16b/0x4f0 [ 1636.620751][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1636.621070][ C1] ? __pfx_ip_output+0x10/0x10 [ 1636.621328][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1636.621681][ C1] ? __pfx_ip_output+0x10/0x10 [ 1636.621938][ C1] __ip_queue_xmit+0x672/0x1910 [ 1636.622203][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1636.622487][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1636.622784][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1636.623074][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1636.623373][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1636.623663][ C1] tcp_delack_timer+0x84/0x240 [ 1636.623924][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1636.624210][ C1] call_timer_fn+0x176/0x430 [ 1636.624459][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1636.624736][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1636.625014][ C1] __run_timers.part.0+0x52d/0x890 [ 1636.625288][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1636.625581][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1636.625885][ C1] ? __pfx___schedule+0x10/0x10 [ 1636.626147][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1636.626471][ C1] run_timer_softirq+0x72/0x100 [ 1636.626734][ C1] __do_softirq+0x1bc/0x7ff [ 1636.626987][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1636.627265][ C1] run_ksoftirqd+0x2e/0x60 [ 1636.627503][ C1] smpboot_thread_fn+0x30e/0x840 [ 1636.627770][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1636.628067][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1636.628355][ C1] kthread+0x292/0x360 [ 1636.628578][ C1] ? __pfx_kthread+0x10/0x10 [ 1636.628825][ C1] ret_from_fork+0x34/0x70 [ 1636.629067][ C1] ? __pfx_kthread+0x10/0x10 [ 1636.629310][ C1] ret_from_fork_asm+0x1b/0x30 [ 1636.629572][ C1] [ 1664.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 444s! [swapper/0:0] [ 1664.527927][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1664.529128][ C0] irq event stamp: 27567077 [ 1664.529368][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 1664.529897][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 1664.530367][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 1664.530865][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 1664.531355][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1664.531832][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1664.532481][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1664.532822][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1664.533840][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1664.534168][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1664.534587][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1664.535007][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1664.535431][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1664.535859][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1664.536281][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1664.536749][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1664.537097][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1664.537518][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1664.537941][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1664.538362][ C0] Call Trace: [ 1664.538544][ C0] [ 1664.538703][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1664.538977][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1664.539234][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1664.539521][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1664.539806][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1664.540112][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1664.540393][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1664.540716][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1664.540989][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1664.541269][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1664.541590][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1664.541900][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1664.542233][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1664.542535][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1664.542842][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1664.543149][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1664.543475][ C0] ? get_stack_info+0x36/0xc0 [ 1664.543728][ C0] ? lock_acquire+0x1c1/0x220 [ 1664.543979][ C0] ? lock_release+0x1d5/0x250 [ 1664.544230][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1664.544489][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1664.544773][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1664.545069][ C0] ? lock_acquire+0x1c1/0x220 [ 1664.545318][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1664.545572][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1664.545846][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1664.546092][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1664.546349][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1664.546616][ C0] ? __inet_lookup_established+0x341/0x610 [ 1664.546931][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1664.547226][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1664.547522][ C0] ip_local_deliver+0x19d/0x480 [ 1664.547784][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1664.548072][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1664.548339][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1664.548613][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1664.548878][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1664.549217][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1664.549491][ C0] ip_rcv+0x564/0x740 [ 1664.549700][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1664.549939][ C0] ? set_track_prepare+0x8a/0xd0 [ 1664.550202][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1664.550494][ C0] ? rest_init+0x153/0x260 [ 1664.550728][ C0] ? skb_clone+0x10b/0x330 [ 1664.550969][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1664.551303][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1664.551620][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1664.551920][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1664.552230][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1664.552491][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1664.552734][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1664.553052][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1664.553352][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1664.553688][ C0] ? lock_acquire+0x1c1/0x220 [ 1664.553934][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1664.554242][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1664.554542][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1664.554871][ C0] ? __copy_skb_header+0xaf/0x490 [ 1664.555145][ C0] ? __skb_clone+0x57a/0x760 [ 1664.555390][ C0] netif_receive_skb+0x55/0x280 [ 1664.555653][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1664.555981][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1664.556332][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1664.556641][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1664.556929][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1664.557231][ C0] ? hlock_class+0x4e/0x130 [ 1664.557479][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1664.557816][ C0] ? place_entity+0x21/0x2f0 [ 1664.558065][ C0] ? resched_curr+0x219/0x280 [ 1664.558320][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1664.558589][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1664.558873][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1664.559150][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1664.559409][ C0] ? activate_task+0xf5/0x260 [ 1664.559658][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1664.559934][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1664.560212][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1664.560472][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1664.560763][ C0] ? get_stack_info+0x36/0xc0 [ 1664.561025][ C0] ? stack_access_ok+0xda/0x1f0 [ 1664.561286][ C0] ? get_reg+0x119/0x190 [ 1664.561515][ C0] __tcf_classify+0x32c/0x7d0 [ 1664.561768][ C0] tcf_classify+0x283/0x930 [ 1664.562007][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1664.562334][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1664.562605][ C0] ? arch_stack_walk+0x8c/0x100 [ 1664.562868][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1664.563161][ C0] tc_run+0x2e4/0x5d0 [ 1664.563375][ C0] ? __pfx_tc_run+0x10/0x10 [ 1664.563615][ C0] ? lock_acquire+0x1c1/0x220 [ 1664.563863][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1664.564137][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1664.564405][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1664.564688][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1664.564965][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1664.565284][ C0] ? neigh_hh_output+0x348/0x590 [ 1664.565552][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1664.565829][ C0] ip_finish_output2+0x786/0x18e0 [ 1664.566098][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1664.566388][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1664.566744][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1664.567034][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1664.567296][ C0] ? __ip_finish_output+0x10f/0x770 [ 1664.567576][ C0] ip_output+0x16b/0x4f0 [ 1664.567806][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1664.568091][ C0] ? __pfx_ip_output+0x10/0x10 [ 1664.568343][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1664.568645][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1664.568904][ C0] ? ip_local_out+0x114/0x3b0 [ 1664.569156][ C0] __ip_queue_xmit+0x672/0x1910 [ 1664.569416][ C0] ? __skb_clone+0x57a/0x760 [ 1664.569663][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1664.569939][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1664.570230][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1664.570544][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1664.570801][ C0] ? tcp_current_mss+0x40a/0x510 [ 1664.571061][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1664.571343][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1664.571615][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1664.571865][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1664.572136][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1664.572452][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1664.572724][ C0] ? ktime_get+0xb6/0x190 [ 1664.572954][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1664.573226][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1664.573507][ C0] tcp_write_timer+0x82/0x1d0 [ 1664.573753][ C0] call_timer_fn+0x176/0x430 [ 1664.573995][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1664.574269][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1664.574545][ C0] __run_timers.part.0+0x52d/0x890 [ 1664.574819][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1664.575098][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1664.575395][ C0] ? lock_acquire+0x1c1/0x220 [ 1664.575640][ C0] ? clockevents_program_event+0xf6/0x300 [ 1664.575942][ C0] ? lock_release+0x1d5/0x250 [ 1664.576192][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1664.576466][ C0] ? ktime_get+0xb6/0x190 [ 1664.576695][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1664.576990][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1664.577301][ C0] run_timer_softirq+0x72/0x100 [ 1664.577557][ C0] __do_softirq+0x1bc/0x7ff [ 1664.577808][ C0] irq_exit_rcu+0x98/0xc0 [ 1664.578040][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1664.578340][ C0] [ 1664.578496][ C0] [ 1664.578651][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1664.578971][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1664.579241][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1664.580260][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1664.580584][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1664.581002][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1664.581425][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1664.581847][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1664.582265][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1664.582684][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1664.582989][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1664.583262][ C0] default_idle_call+0x69/0xa0 [ 1664.583513][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1664.583779][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1664.584068][ C0] ? lock_release+0x1d5/0x250 [ 1664.584319][ C0] do_idle+0xfb/0x160 [ 1664.584531][ C0] cpu_startup_entry+0x55/0x60 [ 1664.584784][ C0] rest_init+0x153/0x260 [ 1664.585008][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1664.585298][ C0] arch_call_rest_init+0x13/0x40 [ 1664.585564][ C0] start_kernel+0x314/0x3d0 [ 1664.585803][ C0] x86_64_start_reservations+0x18/0x30 [ 1664.586092][ C0] x86_64_start_kernel+0xba/0x110 [ 1664.586368][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1664.586696][ C0] [ 1664.586867][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 444s! [ksoftirqd/1:22] [ 1664.587329][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1664.588536][ C1] irq event stamp: 3886976 [ 1664.588774][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 1664.589279][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 1664.589782][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 1664.590289][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 1664.590779][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1664.591281][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1664.591933][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1664.592279][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1664.593309][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1664.593635][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1664.594062][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1664.594489][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1664.594913][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1664.595337][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1664.595764][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1664.596245][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1664.596607][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1664.597038][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1664.597461][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1664.597907][ C1] Call Trace: [ 1664.598091][ C1] [ 1664.598250][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1664.598528][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1664.598790][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1664.599086][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1664.599380][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1664.599688][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1664.599973][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1664.600303][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1664.600580][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1664.600911][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1664.601229][ C1] [ 1664.601388][ C1] [ 1664.601546][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1664.601876][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1664.602190][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1664.602507][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1664.602812][ C1] ? run_ksoftirqd+0xb/0x60 [ 1664.603058][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1664.603386][ C1] ? __orc_find+0x9c/0xf0 [ 1664.603622][ C1] ? lock_acquire+0x1c1/0x220 [ 1664.603879][ C1] ? irqentry_enter+0x2b/0x60 [ 1664.604137][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1664.604402][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1664.604690][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1664.604993][ C1] ? lock_acquire+0x1c1/0x220 [ 1664.605245][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1664.605498][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1664.605771][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1664.606021][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1664.606284][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1664.606560][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1664.606853][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1664.607149][ C1] ip_local_deliver+0x19d/0x480 [ 1664.607408][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1664.607696][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1664.607967][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1664.608246][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1664.608508][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1664.608850][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1664.609126][ C1] ip_rcv+0x564/0x740 [ 1664.609338][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1664.609578][ C1] ? set_track_prepare+0x8a/0xd0 [ 1664.609842][ C1] ? irqentry_enter+0x2b/0x60 [ 1664.610098][ C1] ? irqentry_enter+0x2b/0x60 [ 1664.610353][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1664.610597][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1664.610917][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1664.611260][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1664.611571][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1664.611909][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1664.612209][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1664.612548][ C1] netif_receive_skb+0x55/0x280 [ 1664.612809][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1664.613141][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1664.613491][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1664.613804][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1664.614097][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1664.614403][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1664.614737][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1664.615022][ C1] ? arch_stack_walk+0x68/0x100 [ 1664.615283][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1664.615565][ C1] ? irqentry_enter+0x2b/0x60 [ 1664.615817][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1664.616136][ C1] ? irqentry_enter+0x2b/0x60 [ 1664.616389][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1664.616716][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1664.616999][ C1] ? arch_stack_walk+0x68/0x100 [ 1664.617271][ C1] __tcf_classify+0x32c/0x7d0 [ 1664.617527][ C1] tcf_classify+0x283/0x930 [ 1664.617780][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1664.618052][ C1] tc_run+0x2e4/0x5d0 [ 1664.618266][ C1] ? __pfx_tc_run+0x10/0x10 [ 1664.618513][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1664.618779][ C1] ? irqentry_enter+0x2b/0x60 [ 1664.619036][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1664.619326][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1664.619652][ C1] ip_finish_output2+0x786/0x18e0 [ 1664.619922][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1664.620215][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1664.620484][ C1] ? __ip_finish_output+0x10f/0x770 [ 1664.620762][ C1] ip_output+0x16b/0x4f0 [ 1664.620989][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1664.621312][ C1] ? __pfx_ip_output+0x10/0x10 [ 1664.621566][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1664.621925][ C1] ? __pfx_ip_output+0x10/0x10 [ 1664.622186][ C1] __ip_queue_xmit+0x672/0x1910 [ 1664.622448][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1664.622728][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1664.623024][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1664.623308][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1664.623601][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1664.623885][ C1] tcp_delack_timer+0x84/0x240 [ 1664.624144][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1664.624434][ C1] call_timer_fn+0x176/0x430 [ 1664.624688][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1664.624962][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1664.625246][ C1] __run_timers.part.0+0x52d/0x890 [ 1664.625520][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1664.625805][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1664.626108][ C1] ? __pfx___schedule+0x10/0x10 [ 1664.626371][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1664.626696][ C1] run_timer_softirq+0x72/0x100 [ 1664.626957][ C1] __do_softirq+0x1bc/0x7ff [ 1664.627202][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1664.627477][ C1] run_ksoftirqd+0x2e/0x60 [ 1664.627717][ C1] smpboot_thread_fn+0x30e/0x840 [ 1664.627991][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1664.628281][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1664.628573][ C1] kthread+0x292/0x360 [ 1664.628792][ C1] ? __pfx_kthread+0x10/0x10 [ 1664.629043][ C1] ret_from_fork+0x34/0x70 [ 1664.629280][ C1] ? __pfx_kthread+0x10/0x10 [ 1664.629527][ C1] ret_from_fork_asm+0x1b/0x30 [ 1664.629785][ C1] [ 1688.758024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 1688.758413][ C0] rcu: 0-....: (495399 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=120983 [ 1688.758923][ C0] rcu: (t=494449 jiffies g=1007429 q=31 ncpus=4) [ 1688.759263][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1688.759738][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1688.760389][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 1688.760732][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 1688.761746][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1688.762070][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1688.762487][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1688.762907][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1688.763325][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1688.763745][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1688.764163][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1688.764628][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1688.764985][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1688.765405][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1688.765824][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1688.766245][ C0] Call Trace: [ 1688.766428][ C0] [ 1688.766587][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 1688.766869][ C0] ? print_cpu_stall+0x263/0x6a0 [ 1688.767137][ C0] ? check_cpu_stall+0x284/0x500 [ 1688.767400][ C0] ? rcu_pending+0x92/0x360 [ 1688.767645][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 1688.767930][ C0] ? update_process_times+0xb9/0x110 [ 1688.768216][ C0] ? tick_sched_handle+0x67/0x130 [ 1688.768482][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 1688.768779][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1688.769034][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 1688.769356][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1688.769642][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1688.769946][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1688.770233][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1688.770554][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1688.770827][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1688.771105][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1688.771424][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1688.771732][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1688.772063][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1688.772363][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 1688.772662][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1688.772962][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1688.773288][ C0] ? get_stack_info+0x36/0xc0 [ 1688.773545][ C0] ? lock_acquire+0x1c1/0x220 [ 1688.773801][ C0] ? lock_release+0x1d5/0x250 [ 1688.774057][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1688.774318][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1688.774603][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1688.774905][ C0] ? lock_acquire+0x1c1/0x220 [ 1688.775152][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1688.775401][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1688.775670][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1688.775919][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1688.776179][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1688.776449][ C0] ? __inet_lookup_established+0x341/0x610 [ 1688.776763][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1688.777051][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1688.777340][ C0] ip_local_deliver+0x19d/0x480 [ 1688.777602][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1688.777892][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1688.778157][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1688.778441][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1688.778705][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1688.779040][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1688.779316][ C0] ip_rcv+0x564/0x740 [ 1688.779532][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1688.779776][ C0] ? set_track_prepare+0x8a/0xd0 [ 1688.780043][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1688.780331][ C0] ? rest_init+0x153/0x260 [ 1688.780568][ C0] ? skb_clone+0x10b/0x330 [ 1688.780806][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1688.781141][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1688.781463][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1688.781756][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1688.782062][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1688.782324][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1688.782562][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1688.782874][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1688.783171][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1688.783514][ C0] ? lock_acquire+0x1c1/0x220 [ 1688.783765][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1688.784078][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1688.784378][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1688.784713][ C0] ? __copy_skb_header+0xaf/0x490 [ 1688.784984][ C0] ? __skb_clone+0x57a/0x760 [ 1688.785234][ C0] netif_receive_skb+0x55/0x280 [ 1688.785491][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1688.785818][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1688.786168][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1688.786482][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1688.786768][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1688.787067][ C0] ? hlock_class+0x4e/0x130 [ 1688.787311][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1688.787637][ C0] ? place_entity+0x21/0x2f0 [ 1688.787892][ C0] ? resched_curr+0x219/0x280 [ 1688.788145][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1688.788412][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1688.788692][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1688.788980][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1688.789243][ C0] ? activate_task+0xf5/0x260 [ 1688.789495][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1688.789774][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1688.790047][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1688.790313][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1688.790607][ C0] ? get_stack_info+0x36/0xc0 [ 1688.790868][ C0] ? stack_access_ok+0xda/0x1f0 [ 1688.791127][ C0] ? get_reg+0x119/0x190 [ 1688.791355][ C0] __tcf_classify+0x32c/0x7d0 [ 1688.791612][ C0] tcf_classify+0x283/0x930 [ 1688.791856][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1688.792188][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1688.792453][ C0] ? arch_stack_walk+0x8c/0x100 [ 1688.792714][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1688.793004][ C0] tc_run+0x2e4/0x5d0 [ 1688.793224][ C0] ? __pfx_tc_run+0x10/0x10 [ 1688.793469][ C0] ? lock_acquire+0x1c1/0x220 [ 1688.793721][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1688.793998][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1688.794265][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1688.794549][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1688.794827][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1688.795151][ C0] ? neigh_hh_output+0x348/0x590 [ 1688.795414][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1688.795693][ C0] ip_finish_output2+0x786/0x18e0 [ 1688.795961][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1688.796255][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1688.796604][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1688.796891][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1688.797156][ C0] ? __ip_finish_output+0x10f/0x770 [ 1688.797429][ C0] ip_output+0x16b/0x4f0 [ 1688.797664][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1688.797947][ C0] ? __pfx_ip_output+0x10/0x10 [ 1688.798205][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1688.798502][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1688.798764][ C0] ? ip_local_out+0x114/0x3b0 [ 1688.799011][ C0] __ip_queue_xmit+0x672/0x1910 [ 1688.799274][ C0] ? __skb_clone+0x57a/0x760 [ 1688.799518][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1688.799801][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1688.800098][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1688.800417][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1688.800670][ C0] ? tcp_current_mss+0x40a/0x510 [ 1688.800935][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1688.801215][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1688.801492][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1688.801745][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1688.802009][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1688.802325][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1688.802603][ C0] ? ktime_get+0xb6/0x190 [ 1688.802837][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1688.803111][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1688.803391][ C0] tcp_write_timer+0x82/0x1d0 [ 1688.803645][ C0] call_timer_fn+0x176/0x430 [ 1688.803893][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1688.804165][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1688.804439][ C0] __run_timers.part.0+0x52d/0x890 [ 1688.804708][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1688.804991][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1688.805287][ C0] ? lock_acquire+0x1c1/0x220 [ 1688.805539][ C0] ? clockevents_program_event+0xf6/0x300 [ 1688.805846][ C0] ? lock_release+0x1d5/0x250 [ 1688.806097][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1688.806377][ C0] ? ktime_get+0xb6/0x190 [ 1688.806608][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1688.806910][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1688.807218][ C0] run_timer_softirq+0x72/0x100 [ 1688.807478][ C0] __do_softirq+0x1bc/0x7ff [ 1688.807729][ C0] irq_exit_rcu+0x98/0xc0 [ 1688.807959][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1688.808257][ C0] [ 1688.808416][ C0] [ 1688.808575][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1688.808898][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1688.809164][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1688.810172][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1688.810493][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1688.810910][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1688.811328][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1688.811744][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1688.812160][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1688.812577][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1688.812878][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1688.813150][ C0] default_idle_call+0x69/0xa0 [ 1688.813406][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1688.813667][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1688.813961][ C0] ? lock_release+0x1d5/0x250 [ 1688.814210][ C0] do_idle+0xfb/0x160 [ 1688.814420][ C0] cpu_startup_entry+0x55/0x60 [ 1688.814671][ C0] rest_init+0x153/0x260 [ 1688.814900][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1688.815185][ C0] arch_call_rest_init+0x13/0x40 [ 1688.815448][ C0] start_kernel+0x314/0x3d0 [ 1688.815693][ C0] x86_64_start_reservations+0x18/0x30 [ 1688.815984][ C0] x86_64_start_kernel+0xba/0x110 [ 1688.816250][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1688.816575][ C0] [ 1688.816740][ C0] Sending NMI from CPU 0 to CPUs 1: [ 1688.817028][ C1] NMI backtrace for cpu 1 [ 1688.817034][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1688.817038][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1688.817040][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1688.817047][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1688.817050][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1688.817053][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1688.817055][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1688.817056][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1688.817058][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1688.817060][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1688.817061][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1688.817064][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1688.817067][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1688.817068][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1688.817070][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1688.817071][ C1] Call Trace: [ 1688.817074][ C1] [ 1688.817076][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 1688.817082][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 1688.817087][ C1] ? nmi_handle+0x156/0x420 [ 1688.817093][ C1] ? default_do_nmi+0x41/0x100 [ 1688.817096][ C1] ? exc_nmi+0xf3/0x120 [ 1688.817099][ C1] ? end_repeat_nmi+0xf/0x60 [ 1688.817103][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1688.817107][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1688.817110][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1688.817114][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1688.817117][ C1] [ 1688.817118][ C1] [ 1688.817119][ C1] ? run_ksoftirqd+0xb/0x60 [ 1688.817124][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1688.817127][ C1] ? __orc_find+0x9c/0xf0 [ 1688.817129][ C1] ? lock_acquire+0x1c1/0x220 [ 1688.817133][ C1] ? irqentry_enter+0x2b/0x60 [ 1688.817138][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1688.817141][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1688.817144][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1688.817147][ C1] ? lock_acquire+0x1c1/0x220 [ 1688.817149][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1688.817154][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1688.817157][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1688.817165][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1688.817168][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1688.817173][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1688.817179][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1688.817183][ C1] ip_local_deliver+0x19d/0x480 [ 1688.817186][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1688.817188][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1688.817192][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1688.817196][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1688.817199][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1688.817203][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1688.817212][ C1] ip_rcv+0x564/0x740 [ 1688.817215][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1688.817218][ C1] ? set_track_prepare+0x8a/0xd0 [ 1688.817223][ C1] ? irqentry_enter+0x2b/0x60 [ 1688.817226][ C1] ? irqentry_enter+0x2b/0x60 [ 1688.817230][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1688.817232][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1688.817236][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1688.817240][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1688.817243][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1688.817246][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1688.817249][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1688.817254][ C1] netif_receive_skb+0x55/0x280 [ 1688.817257][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1688.817265][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1688.817272][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1688.817279][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1688.817285][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1688.817296][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1688.817306][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1688.817309][ C1] ? arch_stack_walk+0x68/0x100 [ 1688.817313][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1688.817316][ C1] ? irqentry_enter+0x2b/0x60 [ 1688.817320][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1688.817324][ C1] ? irqentry_enter+0x2b/0x60 [ 1688.817328][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1688.817335][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1688.817337][ C1] ? arch_stack_walk+0x68/0x100 [ 1688.817341][ C1] __tcf_classify+0x32c/0x7d0 [ 1688.817346][ C1] tcf_classify+0x283/0x930 [ 1688.817350][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1688.817354][ C1] tc_run+0x2e4/0x5d0 [ 1688.817357][ C1] ? __pfx_tc_run+0x10/0x10 [ 1688.817362][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1688.817368][ C1] ? irqentry_enter+0x2b/0x60 [ 1688.817371][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1688.817374][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1688.817381][ C1] ip_finish_output2+0x786/0x18e0 [ 1688.817385][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1688.817388][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1688.817392][ C1] ? __ip_finish_output+0x10f/0x770 [ 1688.817396][ C1] ip_output+0x16b/0x4f0 [ 1688.817399][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1688.817402][ C1] ? __pfx_ip_output+0x10/0x10 [ 1688.817407][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1688.817414][ C1] ? __pfx_ip_output+0x10/0x10 [ 1688.817418][ C1] __ip_queue_xmit+0x672/0x1910 [ 1688.817423][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1688.817430][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1688.817435][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1688.817439][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1688.817443][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1688.817446][ C1] tcp_delack_timer+0x84/0x240 [ 1688.817449][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1688.817452][ C1] call_timer_fn+0x176/0x430 [ 1688.817456][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1688.817461][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1688.817465][ C1] __run_timers.part.0+0x52d/0x890 [ 1688.817468][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1688.817473][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1688.817478][ C1] ? __pfx___schedule+0x10/0x10 [ 1688.817482][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1688.817486][ C1] run_timer_softirq+0x72/0x100 [ 1688.817490][ C1] __do_softirq+0x1bc/0x7ff [ 1688.817493][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1688.817497][ C1] run_ksoftirqd+0x2e/0x60 [ 1688.817500][ C1] smpboot_thread_fn+0x30e/0x840 [ 1688.817506][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1688.817509][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1688.817512][ C1] kthread+0x292/0x360 [ 1688.817515][ C1] ? __pfx_kthread+0x10/0x10 [ 1688.817518][ C1] ret_from_fork+0x34/0x70 [ 1688.817521][ C1] ? __pfx_kthread+0x10/0x10 [ 1688.817523][ C1] ret_from_fork_asm+0x1b/0x30 [ 1688.817530][ C1] [ 1716.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 492s! [swapper/0:0] [ 1716.527918][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1716.529134][ C0] irq event stamp: 27567077 [ 1716.529376][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 1716.529907][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 1716.530378][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 1716.530882][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 1716.531370][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1716.531847][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1716.532491][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1716.532834][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1716.533855][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1716.534178][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1716.534600][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1716.535022][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1716.535439][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1716.535858][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1716.536280][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1716.536757][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1716.537102][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1716.537531][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1716.537960][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1716.538384][ C0] Call Trace: [ 1716.538565][ C0] [ 1716.538723][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1716.538998][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1716.539257][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1716.539548][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1716.539837][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1716.540141][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1716.540421][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1716.540745][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1716.541016][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1716.541295][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1716.541616][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1716.541924][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1716.542259][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1716.542560][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1716.542867][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1716.543175][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1716.543503][ C0] ? get_stack_info+0x36/0xc0 [ 1716.543753][ C0] ? lock_acquire+0x1c1/0x220 [ 1716.544002][ C0] ? lock_release+0x1d5/0x250 [ 1716.544249][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1716.544506][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1716.544787][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1716.545084][ C0] ? lock_acquire+0x1c1/0x220 [ 1716.545338][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1716.545596][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1716.545869][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1716.546114][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1716.546369][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1716.546637][ C0] ? __inet_lookup_established+0x341/0x610 [ 1716.546949][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1716.547241][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1716.547537][ C0] ip_local_deliver+0x19d/0x480 [ 1716.547799][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1716.548087][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1716.548356][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1716.548634][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1716.548895][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1716.549232][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1716.549506][ C0] ip_rcv+0x564/0x740 [ 1716.549719][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1716.549961][ C0] ? set_track_prepare+0x8a/0xd0 [ 1716.550227][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1716.550516][ C0] ? rest_init+0x153/0x260 [ 1716.550752][ C0] ? skb_clone+0x10b/0x330 [ 1716.550994][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1716.551325][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1716.551642][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1716.551938][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1716.552251][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1716.552511][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1716.552756][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1716.553071][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1716.553370][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1716.553708][ C0] ? lock_acquire+0x1c1/0x220 [ 1716.553956][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1716.554266][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1716.554564][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1716.554892][ C0] ? __copy_skb_header+0xaf/0x490 [ 1716.555158][ C0] ? __skb_clone+0x57a/0x760 [ 1716.555401][ C0] netif_receive_skb+0x55/0x280 [ 1716.555660][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1716.555990][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1716.556341][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1716.556651][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1716.556941][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1716.557242][ C0] ? hlock_class+0x4e/0x130 [ 1716.557490][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1716.557825][ C0] ? place_entity+0x21/0x2f0 [ 1716.558069][ C0] ? resched_curr+0x219/0x280 [ 1716.558322][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1716.558592][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1716.558879][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1716.559154][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1716.559413][ C0] ? activate_task+0xf5/0x260 [ 1716.559663][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1716.559936][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1716.560215][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1716.560474][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1716.560761][ C0] ? get_stack_info+0x36/0xc0 [ 1716.561014][ C0] ? stack_access_ok+0xda/0x1f0 [ 1716.561276][ C0] ? get_reg+0x119/0x190 [ 1716.561507][ C0] __tcf_classify+0x32c/0x7d0 [ 1716.561757][ C0] tcf_classify+0x283/0x930 [ 1716.562003][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1716.562333][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1716.562601][ C0] ? arch_stack_walk+0x8c/0x100 [ 1716.562865][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1716.563158][ C0] tc_run+0x2e4/0x5d0 [ 1716.563378][ C0] ? __pfx_tc_run+0x10/0x10 [ 1716.563621][ C0] ? lock_acquire+0x1c1/0x220 [ 1716.563870][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1716.564143][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1716.564411][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1716.564695][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1716.564971][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1716.565286][ C0] ? neigh_hh_output+0x348/0x590 [ 1716.565550][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1716.565823][ C0] ip_finish_output2+0x786/0x18e0 [ 1716.566090][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1716.566383][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1716.566739][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1716.567032][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1716.567294][ C0] ? __ip_finish_output+0x10f/0x770 [ 1716.567576][ C0] ip_output+0x16b/0x4f0 [ 1716.567802][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1716.568086][ C0] ? __pfx_ip_output+0x10/0x10 [ 1716.568339][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1716.568639][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1716.568900][ C0] ? ip_local_out+0x114/0x3b0 [ 1716.569157][ C0] __ip_queue_xmit+0x672/0x1910 [ 1716.569418][ C0] ? __skb_clone+0x57a/0x760 [ 1716.569665][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1716.569945][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1716.570239][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1716.570554][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1716.570814][ C0] ? tcp_current_mss+0x40a/0x510 [ 1716.571079][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1716.571359][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1716.571633][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1716.571886][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1716.572154][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1716.572474][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1716.572748][ C0] ? ktime_get+0xb6/0x190 [ 1716.572978][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1716.573248][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1716.573531][ C0] tcp_write_timer+0x82/0x1d0 [ 1716.573780][ C0] call_timer_fn+0x176/0x430 [ 1716.574027][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1716.574301][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1716.574572][ C0] __run_timers.part.0+0x52d/0x890 [ 1716.574844][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1716.575125][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1716.575425][ C0] ? lock_acquire+0x1c1/0x220 [ 1716.575673][ C0] ? clockevents_program_event+0xf6/0x300 [ 1716.575976][ C0] ? lock_release+0x1d5/0x250 [ 1716.576222][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1716.576494][ C0] ? ktime_get+0xb6/0x190 [ 1716.576722][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1716.577017][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1716.577330][ C0] run_timer_softirq+0x72/0x100 [ 1716.577595][ C0] __do_softirq+0x1bc/0x7ff [ 1716.577840][ C0] irq_exit_rcu+0x98/0xc0 [ 1716.578072][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1716.578372][ C0] [ 1716.578528][ C0] [ 1716.578683][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1716.578999][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1716.579272][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1716.580290][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1716.580612][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1716.581032][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1716.581449][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1716.581864][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1716.582284][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1716.582707][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1716.583013][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1716.583289][ C0] default_idle_call+0x69/0xa0 [ 1716.583541][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1716.583803][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1716.584092][ C0] ? lock_release+0x1d5/0x250 [ 1716.584345][ C0] do_idle+0xfb/0x160 [ 1716.584564][ C0] cpu_startup_entry+0x55/0x60 [ 1716.584820][ C0] rest_init+0x153/0x260 [ 1716.585042][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1716.585334][ C0] arch_call_rest_init+0x13/0x40 [ 1716.585602][ C0] start_kernel+0x314/0x3d0 [ 1716.585844][ C0] x86_64_start_reservations+0x18/0x30 [ 1716.586135][ C0] x86_64_start_kernel+0xba/0x110 [ 1716.586403][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1716.586732][ C0] [ 1716.586897][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 492s! [ksoftirqd/1:22] [ 1716.587345][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1716.588553][ C1] irq event stamp: 3886976 [ 1716.588794][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 1716.589289][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 1716.589787][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 1716.590284][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 1716.590779][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1716.591274][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1716.591917][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1716.592258][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1716.593275][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1716.593599][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1716.594019][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1716.594437][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1716.594857][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1716.595277][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1716.595699][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1716.596167][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1716.596521][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1716.596942][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1716.597369][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1716.597799][ C1] Call Trace: [ 1716.597977][ C1] [ 1716.598135][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1716.598417][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1716.598671][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1716.598965][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1716.599251][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1716.599554][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1716.599833][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1716.600158][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1716.600437][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1716.600763][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1716.601076][ C1] [ 1716.601235][ C1] [ 1716.601395][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1716.601732][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1716.602038][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1716.602350][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1716.602657][ C1] ? run_ksoftirqd+0xb/0x60 [ 1716.602905][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1716.603238][ C1] ? __orc_find+0x9c/0xf0 [ 1716.603470][ C1] ? lock_acquire+0x1c1/0x220 [ 1716.603727][ C1] ? irqentry_enter+0x2b/0x60 [ 1716.603979][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1716.604241][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1716.604526][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1716.604824][ C1] ? lock_acquire+0x1c1/0x220 [ 1716.605077][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1716.605332][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1716.605609][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1716.605857][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1716.606117][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1716.606389][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1716.606676][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1716.606967][ C1] ip_local_deliver+0x19d/0x480 [ 1716.607232][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1716.607522][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1716.607798][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1716.608081][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1716.608348][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1716.608684][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1716.608963][ C1] ip_rcv+0x564/0x740 [ 1716.609184][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1716.609432][ C1] ? set_track_prepare+0x8a/0xd0 [ 1716.609701][ C1] ? irqentry_enter+0x2b/0x60 [ 1716.609952][ C1] ? irqentry_enter+0x2b/0x60 [ 1716.610201][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1716.610443][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1716.610756][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1716.611097][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1716.611405][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1716.611748][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1716.612051][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1716.612384][ C1] netif_receive_skb+0x55/0x280 [ 1716.612643][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1716.612974][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1716.613322][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1716.613639][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1716.613928][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1716.614232][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1716.614559][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1716.614839][ C1] ? arch_stack_walk+0x68/0x100 [ 1716.615104][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1716.615384][ C1] ? irqentry_enter+0x2b/0x60 [ 1716.615638][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1716.615962][ C1] ? irqentry_enter+0x2b/0x60 [ 1716.616215][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1716.616536][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1716.616820][ C1] ? arch_stack_walk+0x68/0x100 [ 1716.617082][ C1] __tcf_classify+0x32c/0x7d0 [ 1716.617336][ C1] tcf_classify+0x283/0x930 [ 1716.617587][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1716.617862][ C1] tc_run+0x2e4/0x5d0 [ 1716.618082][ C1] ? __pfx_tc_run+0x10/0x10 [ 1716.618330][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1716.618601][ C1] ? irqentry_enter+0x2b/0x60 [ 1716.618855][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1716.619143][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1716.619470][ C1] ip_finish_output2+0x786/0x18e0 [ 1716.619746][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1716.620039][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1716.620308][ C1] ? __ip_finish_output+0x10f/0x770 [ 1716.620590][ C1] ip_output+0x16b/0x4f0 [ 1716.620822][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1716.621145][ C1] ? __pfx_ip_output+0x10/0x10 [ 1716.621407][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1716.621760][ C1] ? __pfx_ip_output+0x10/0x10 [ 1716.622016][ C1] __ip_queue_xmit+0x672/0x1910 [ 1716.622286][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1716.622570][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1716.622872][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1716.623164][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1716.623463][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1716.623757][ C1] tcp_delack_timer+0x84/0x240 [ 1716.624016][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1716.624304][ C1] call_timer_fn+0x176/0x430 [ 1716.624552][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1716.624830][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1716.625108][ C1] __run_timers.part.0+0x52d/0x890 [ 1716.625381][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1716.625672][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1716.625976][ C1] ? __pfx___schedule+0x10/0x10 [ 1716.626236][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1716.626555][ C1] run_timer_softirq+0x72/0x100 [ 1716.626819][ C1] __do_softirq+0x1bc/0x7ff [ 1716.627066][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1716.627344][ C1] run_ksoftirqd+0x2e/0x60 [ 1716.627590][ C1] smpboot_thread_fn+0x30e/0x840 [ 1716.627857][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1716.628152][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1716.628443][ C1] kthread+0x292/0x360 [ 1716.628660][ C1] ? __pfx_kthread+0x10/0x10 [ 1716.628905][ C1] ret_from_fork+0x34/0x70 [ 1716.629148][ C1] ? __pfx_kthread+0x10/0x10 [ 1716.629395][ C1] ret_from_fork_asm+0x1b/0x30 [ 1716.629659][ C1] [ 1744.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 518s! [swapper/0:0] [ 1744.527923][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1744.529128][ C0] irq event stamp: 27567077 [ 1744.529366][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 1744.529892][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 1744.530368][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 1744.530879][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 1744.531380][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1744.531860][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1744.532500][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1744.532840][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1744.533859][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1744.534181][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1744.534597][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1744.535016][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1744.535440][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1744.535857][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1744.536274][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1744.536742][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1744.537093][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1744.537522][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1744.537941][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1744.538362][ C0] Call Trace: [ 1744.538544][ C0] [ 1744.538702][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1744.538981][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1744.539235][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1744.539531][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1744.539817][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1744.540120][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1744.540398][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1744.540720][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1744.540997][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1744.541274][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1744.541602][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1744.541917][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1744.542250][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1744.542557][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1744.542874][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1744.543179][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1744.543506][ C0] ? get_stack_info+0x36/0xc0 [ 1744.543764][ C0] ? lock_acquire+0x1c1/0x220 [ 1744.544025][ C0] ? lock_release+0x1d5/0x250 [ 1744.544280][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1744.544544][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1744.544832][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1744.545137][ C0] ? lock_acquire+0x1c1/0x220 [ 1744.545387][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1744.545641][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1744.545914][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1744.546165][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1744.546430][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1744.546706][ C0] ? __inet_lookup_established+0x341/0x610 [ 1744.547020][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1744.547311][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1744.547610][ C0] ip_local_deliver+0x19d/0x480 [ 1744.547869][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1744.548153][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1744.548421][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1744.548702][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1744.548970][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1744.549308][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1744.549589][ C0] ip_rcv+0x564/0x740 [ 1744.549810][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1744.550058][ C0] ? set_track_prepare+0x8a/0xd0 [ 1744.550329][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1744.550618][ C0] ? rest_init+0x153/0x260 [ 1744.550859][ C0] ? skb_clone+0x10b/0x330 [ 1744.551103][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1744.551441][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1744.551766][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1744.552063][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1744.552372][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1744.552632][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1744.552873][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1744.553188][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1744.553486][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1744.553830][ C0] ? lock_acquire+0x1c1/0x220 [ 1744.554086][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1744.554402][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1744.554703][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1744.555039][ C0] ? __copy_skb_header+0xaf/0x490 [ 1744.555312][ C0] ? __skb_clone+0x57a/0x760 [ 1744.555560][ C0] netif_receive_skb+0x55/0x280 [ 1744.555818][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1744.556146][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1744.556493][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1744.556813][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1744.557102][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1744.557416][ C0] ? hlock_class+0x4e/0x130 [ 1744.557666][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1744.557998][ C0] ? place_entity+0x21/0x2f0 [ 1744.558249][ C0] ? resched_curr+0x219/0x280 [ 1744.558498][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1744.558767][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1744.559051][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1744.559334][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1744.559596][ C0] ? activate_task+0xf5/0x260 [ 1744.559851][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1744.560131][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1744.560405][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1744.560673][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1744.560966][ C0] ? get_stack_info+0x36/0xc0 [ 1744.561217][ C0] ? stack_access_ok+0xda/0x1f0 [ 1744.561473][ C0] ? get_reg+0x119/0x190 [ 1744.561700][ C0] __tcf_classify+0x32c/0x7d0 [ 1744.561955][ C0] tcf_classify+0x283/0x930 [ 1744.562208][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1744.562538][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1744.562804][ C0] ? arch_stack_walk+0x8c/0x100 [ 1744.563064][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1744.563352][ C0] tc_run+0x2e4/0x5d0 [ 1744.563575][ C0] ? __pfx_tc_run+0x10/0x10 [ 1744.563822][ C0] ? lock_acquire+0x1c1/0x220 [ 1744.564081][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1744.564362][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1744.564627][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1744.564916][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1744.565198][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1744.565522][ C0] ? neigh_hh_output+0x348/0x590 [ 1744.565786][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1744.566067][ C0] ip_finish_output2+0x786/0x18e0 [ 1744.566338][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1744.566636][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1744.566987][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1744.567276][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1744.567549][ C0] ? __ip_finish_output+0x10f/0x770 [ 1744.567830][ C0] ip_output+0x16b/0x4f0 [ 1744.568061][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1744.568344][ C0] ? __pfx_ip_output+0x10/0x10 [ 1744.568602][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1744.568901][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1744.569169][ C0] ? ip_local_out+0x114/0x3b0 [ 1744.569421][ C0] __ip_queue_xmit+0x672/0x1910 [ 1744.569682][ C0] ? __skb_clone+0x57a/0x760 [ 1744.569930][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1744.570214][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1744.570515][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1744.570833][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1744.571091][ C0] ? tcp_current_mss+0x40a/0x510 [ 1744.571359][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1744.571640][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1744.571920][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1744.572179][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1744.572445][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1744.572765][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1744.573045][ C0] ? ktime_get+0xb6/0x190 [ 1744.573281][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1744.573557][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1744.573840][ C0] tcp_write_timer+0x82/0x1d0 [ 1744.574096][ C0] call_timer_fn+0x176/0x430 [ 1744.574347][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1744.574619][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1744.574895][ C0] __run_timers.part.0+0x52d/0x890 [ 1744.575167][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1744.575458][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1744.575756][ C0] ? lock_acquire+0x1c1/0x220 [ 1744.576017][ C0] ? clockevents_program_event+0xf6/0x300 [ 1744.576326][ C0] ? lock_release+0x1d5/0x250 [ 1744.576578][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1744.576857][ C0] ? ktime_get+0xb6/0x190 [ 1744.577092][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1744.577400][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1744.577715][ C0] run_timer_softirq+0x72/0x100 [ 1744.577975][ C0] __do_softirq+0x1bc/0x7ff [ 1744.578217][ C0] irq_exit_rcu+0x98/0xc0 [ 1744.578448][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1744.578747][ C0] [ 1744.578909][ C0] [ 1744.579070][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1744.579393][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1744.579662][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1744.580677][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1744.580999][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1744.581421][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1744.581839][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1744.582258][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1744.582678][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1744.583101][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1744.583406][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1744.583680][ C0] default_idle_call+0x69/0xa0 [ 1744.583938][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1744.584202][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1744.584496][ C0] ? lock_release+0x1d5/0x250 [ 1744.584745][ C0] do_idle+0xfb/0x160 [ 1744.584960][ C0] cpu_startup_entry+0x55/0x60 [ 1744.585216][ C0] rest_init+0x153/0x260 [ 1744.585444][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1744.585730][ C0] arch_call_rest_init+0x13/0x40 [ 1744.585998][ C0] start_kernel+0x314/0x3d0 [ 1744.586246][ C0] x86_64_start_reservations+0x18/0x30 [ 1744.586543][ C0] x86_64_start_kernel+0xba/0x110 [ 1744.586813][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1744.587141][ C0] [ 1744.587307][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 518s! [ksoftirqd/1:22] [ 1744.587773][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1744.588977][ C1] irq event stamp: 3886976 [ 1744.589218][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 1744.589713][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 1744.590206][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 1744.590702][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 1744.591198][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1744.591691][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1744.592336][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 1744.592673][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 1744.593707][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1744.594038][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1744.594460][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1744.594883][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1744.595310][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1744.595738][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1744.596169][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1744.596642][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1744.596991][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1744.597424][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1744.597846][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1744.598273][ C1] Call Trace: [ 1744.598456][ C1] [ 1744.598615][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1744.598895][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1744.599157][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1744.599447][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1744.599737][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1744.600046][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1744.600328][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1744.600657][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1744.600934][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1744.601263][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1744.601579][ C1] [ 1744.601736][ C1] [ 1744.601894][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1744.602230][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1744.602540][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 1744.602853][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1744.603162][ C1] ? run_ksoftirqd+0xb/0x60 [ 1744.603410][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1744.603742][ C1] ? __orc_find+0x9c/0xf0 [ 1744.603974][ C1] ? lock_acquire+0x1c1/0x220 [ 1744.604233][ C1] ? irqentry_enter+0x2b/0x60 [ 1744.604487][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1744.604750][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1744.605039][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1744.605339][ C1] ? lock_acquire+0x1c1/0x220 [ 1744.605595][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1744.605851][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1744.606130][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1744.606379][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1744.606638][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1744.606909][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1744.607199][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1744.607495][ C1] ip_local_deliver+0x19d/0x480 [ 1744.607755][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1744.608041][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1744.608306][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1744.608588][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1744.608856][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1744.609192][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1744.609473][ C1] ip_rcv+0x564/0x740 [ 1744.609690][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1744.609938][ C1] ? set_track_prepare+0x8a/0xd0 [ 1744.610209][ C1] ? irqentry_enter+0x2b/0x60 [ 1744.610459][ C1] ? irqentry_enter+0x2b/0x60 [ 1744.610710][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1744.610953][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1744.611268][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1744.611607][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1744.611917][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1744.612262][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1744.612564][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1744.612897][ C1] netif_receive_skb+0x55/0x280 [ 1744.613159][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1744.613488][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1744.613836][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1744.614153][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1744.614441][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1744.614746][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1744.615075][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1744.615356][ C1] ? arch_stack_walk+0x68/0x100 [ 1744.615621][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1744.615901][ C1] ? irqentry_enter+0x2b/0x60 [ 1744.616157][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1744.616486][ C1] ? irqentry_enter+0x2b/0x60 [ 1744.616738][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1744.617062][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1744.617346][ C1] ? arch_stack_walk+0x68/0x100 [ 1744.617615][ C1] __tcf_classify+0x32c/0x7d0 [ 1744.617874][ C1] tcf_classify+0x283/0x930 [ 1744.618122][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1744.618397][ C1] tc_run+0x2e4/0x5d0 [ 1744.618614][ C1] ? __pfx_tc_run+0x10/0x10 [ 1744.618864][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1744.619135][ C1] ? irqentry_enter+0x2b/0x60 [ 1744.619386][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1744.619673][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1744.620000][ C1] ip_finish_output2+0x786/0x18e0 [ 1744.620277][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1744.620570][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1744.620837][ C1] ? __ip_finish_output+0x10f/0x770 [ 1744.621121][ C1] ip_output+0x16b/0x4f0 [ 1744.621354][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1744.621677][ C1] ? __pfx_ip_output+0x10/0x10 [ 1744.621939][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1744.622296][ C1] ? __pfx_ip_output+0x10/0x10 [ 1744.622554][ C1] __ip_queue_xmit+0x672/0x1910 [ 1744.622824][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1744.623110][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1744.623419][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1744.623711][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1744.624016][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1744.624308][ C1] tcp_delack_timer+0x84/0x240 [ 1744.624568][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1744.624852][ C1] call_timer_fn+0x176/0x430 [ 1744.625101][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1744.625381][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1744.625660][ C1] __run_timers.part.0+0x52d/0x890 [ 1744.625934][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1744.626228][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1744.626532][ C1] ? __pfx___schedule+0x10/0x10 [ 1744.626793][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1744.627115][ C1] run_timer_softirq+0x72/0x100 [ 1744.627379][ C1] __do_softirq+0x1bc/0x7ff [ 1744.627632][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1744.627906][ C1] run_ksoftirqd+0x2e/0x60 [ 1744.628149][ C1] smpboot_thread_fn+0x30e/0x840 [ 1744.628417][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1744.628712][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1744.629003][ C1] kthread+0x292/0x360 [ 1744.629222][ C1] ? __pfx_kthread+0x10/0x10 [ 1744.629466][ C1] ret_from_fork+0x34/0x70 [ 1744.629709][ C1] ? __pfx_kthread+0x10/0x10 [ 1744.629957][ C1] ret_from_fork_asm+0x1b/0x30 [ 1744.630223][ C1] [ 1766.820025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 1766.820410][ C1] rcu: 1-....: (572735 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=139808 [ 1766.820992][ C1] rcu: (t=572511 jiffies g=1007429 q=31 ncpus=4) [ 1766.821337][ C1] Sending NMI from CPU 1 to CPUs 0: [ 1766.821629][ C0] NMI backtrace for cpu 0 [ 1766.821635][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1766.821639][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1766.821641][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1766.821651][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1766.821654][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1766.821658][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1766.821660][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1766.821662][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1766.821664][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1766.821666][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1766.821667][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1766.821669][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1766.821674][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1766.821675][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1766.821676][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1766.821678][ C0] Call Trace: [ 1766.821681][ C0] [ 1766.821684][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 1766.821691][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 1766.821697][ C0] ? nmi_handle+0x156/0x420 [ 1766.821702][ C0] ? default_do_nmi+0x41/0x100 [ 1766.821706][ C0] ? exc_nmi+0xf3/0x120 [ 1766.821708][ C0] ? end_repeat_nmi+0xf/0x60 [ 1766.821713][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1766.821717][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1766.821720][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1766.821724][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1766.821727][ C0] [ 1766.821728][ C0] [ 1766.821729][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1766.821732][ C0] ? get_stack_info+0x36/0xc0 [ 1766.821737][ C0] ? lock_acquire+0x1c1/0x220 [ 1766.821742][ C0] ? lock_release+0x1d5/0x250 [ 1766.821746][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1766.821750][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1766.821753][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1766.821756][ C0] ? lock_acquire+0x1c1/0x220 [ 1766.821758][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1766.821764][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1766.821767][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1766.821774][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1766.821777][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1766.821781][ C0] ? __inet_lookup_established+0x341/0x610 [ 1766.821787][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1766.821795][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1766.821799][ C0] ip_local_deliver+0x19d/0x480 [ 1766.821803][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1766.821805][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1766.821810][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1766.821814][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1766.821817][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1766.821821][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1766.821832][ C0] ip_rcv+0x564/0x740 [ 1766.821835][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1766.821838][ C0] ? set_track_prepare+0x8a/0xd0 [ 1766.821843][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1766.821846][ C0] ? rest_init+0x153/0x260 [ 1766.821848][ C0] ? skb_clone+0x10b/0x330 [ 1766.821853][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1766.821860][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1766.821865][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1766.821871][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1766.821880][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1766.821883][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1766.821886][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1766.821890][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1766.821894][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1766.821897][ C0] ? lock_acquire+0x1c1/0x220 [ 1766.821899][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1766.821903][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1766.821906][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1766.821909][ C0] ? __copy_skb_header+0xaf/0x490 [ 1766.821911][ C0] ? __skb_clone+0x57a/0x760 [ 1766.821914][ C0] netif_receive_skb+0x55/0x280 [ 1766.821916][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1766.821925][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1766.821932][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1766.821938][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1766.821944][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1766.821952][ C0] ? hlock_class+0x4e/0x130 [ 1766.821957][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1766.821967][ C0] ? place_entity+0x21/0x2f0 [ 1766.821970][ C0] ? resched_curr+0x219/0x280 [ 1766.821973][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1766.821976][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1766.821979][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1766.821984][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1766.821986][ C0] ? activate_task+0xf5/0x260 [ 1766.821989][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1766.821995][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1766.821998][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1766.822001][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1766.822004][ C0] ? get_stack_info+0x36/0xc0 [ 1766.822008][ C0] ? stack_access_ok+0xda/0x1f0 [ 1766.822010][ C0] ? get_reg+0x119/0x190 [ 1766.822014][ C0] __tcf_classify+0x32c/0x7d0 [ 1766.822018][ C0] tcf_classify+0x283/0x930 [ 1766.822022][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1766.822027][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1766.822029][ C0] ? arch_stack_walk+0x8c/0x100 [ 1766.822033][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1766.822036][ C0] tc_run+0x2e4/0x5d0 [ 1766.822041][ C0] ? __pfx_tc_run+0x10/0x10 [ 1766.822044][ C0] ? lock_acquire+0x1c1/0x220 [ 1766.822046][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1766.822051][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1766.822057][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1766.822060][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1766.822063][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1766.822069][ C0] ? neigh_hh_output+0x348/0x590 [ 1766.822073][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1766.822077][ C0] ip_finish_output2+0x786/0x18e0 [ 1766.822080][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1766.822085][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1766.822093][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1766.822096][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1766.822100][ C0] ? __ip_finish_output+0x10f/0x770 [ 1766.822104][ C0] ip_output+0x16b/0x4f0 [ 1766.822107][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1766.822112][ C0] ? __pfx_ip_output+0x10/0x10 [ 1766.822115][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1766.822120][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1766.822123][ C0] ? ip_local_out+0x114/0x3b0 [ 1766.822127][ C0] __ip_queue_xmit+0x672/0x1910 [ 1766.822132][ C0] ? __skb_clone+0x57a/0x760 [ 1766.822135][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1766.822142][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1766.822146][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1766.822150][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1766.822155][ C0] ? tcp_current_mss+0x40a/0x510 [ 1766.822158][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1766.822161][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1766.822164][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1766.822166][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1766.822169][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1766.822173][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1766.822178][ C0] ? ktime_get+0xb6/0x190 [ 1766.822182][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1766.822186][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1766.822189][ C0] tcp_write_timer+0x82/0x1d0 [ 1766.822193][ C0] call_timer_fn+0x176/0x430 [ 1766.822196][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1766.822201][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1766.822205][ C0] __run_timers.part.0+0x52d/0x890 [ 1766.822208][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1766.822213][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1766.822216][ C0] ? lock_acquire+0x1c1/0x220 [ 1766.822218][ C0] ? clockevents_program_event+0xf6/0x300 [ 1766.822222][ C0] ? lock_release+0x1d5/0x250 [ 1766.822225][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1766.822227][ C0] ? ktime_get+0xb6/0x190 [ 1766.822230][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1766.822234][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1766.822238][ C0] run_timer_softirq+0x72/0x100 [ 1766.822241][ C0] __do_softirq+0x1bc/0x7ff [ 1766.822246][ C0] irq_exit_rcu+0x98/0xc0 [ 1766.822248][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1766.822252][ C0] [ 1766.822253][ C0] [ 1766.822254][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1766.822259][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1766.822262][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1766.822264][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1766.822266][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1766.822267][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1766.822269][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1766.822270][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1766.822272][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1766.822275][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1766.822278][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1766.822282][ C0] default_idle_call+0x69/0xa0 [ 1766.822284][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1766.822286][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1766.822291][ C0] ? lock_release+0x1d5/0x250 [ 1766.822295][ C0] do_idle+0xfb/0x160 [ 1766.822297][ C0] cpu_startup_entry+0x55/0x60 [ 1766.822300][ C0] rest_init+0x153/0x260 [ 1766.822302][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1766.822307][ C0] arch_call_rest_init+0x13/0x40 [ 1766.822311][ C0] start_kernel+0x314/0x3d0 [ 1766.822315][ C0] x86_64_start_reservations+0x18/0x30 [ 1766.822320][ C0] x86_64_start_kernel+0xba/0x110 [ 1766.822324][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1766.822333][ C0] [ 1766.822625][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1766.877097][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1766.877757][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1766.878109][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1766.879137][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1766.879462][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1766.879888][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1766.880315][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1766.880737][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1766.881164][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1766.881590][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1766.882067][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1766.882415][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1766.882842][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1766.883263][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1766.883681][ C1] Call Trace: [ 1766.883857][ C1] [ 1766.884014][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 1766.884305][ C1] ? print_cpu_stall+0x263/0x6a0 [ 1766.884570][ C1] ? check_cpu_stall+0x284/0x500 [ 1766.884839][ C1] ? rcu_pending+0x92/0x360 [ 1766.885080][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 1766.885359][ C1] ? update_process_times+0xb9/0x110 [ 1766.885644][ C1] ? tick_sched_handle+0x67/0x130 [ 1766.885913][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 1766.886212][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1766.886469][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 1766.886797][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1766.887085][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1766.887396][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1766.887677][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1766.888000][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1766.888277][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1766.888605][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1766.888917][ C1] [ 1766.889077][ C1] [ 1766.889238][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1766.889569][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1766.889871][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1766.890179][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1766.890484][ C1] ? run_ksoftirqd+0xb/0x60 [ 1766.890733][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1766.891061][ C1] ? __orc_find+0x9c/0xf0 [ 1766.891291][ C1] ? lock_acquire+0x1c1/0x220 [ 1766.891540][ C1] ? irqentry_enter+0x2b/0x60 [ 1766.891791][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1766.892048][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1766.892330][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1766.892628][ C1] ? lock_acquire+0x1c1/0x220 [ 1766.892884][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1766.893142][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1766.893417][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1766.893661][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1766.893918][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1766.894188][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1766.894477][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1766.894769][ C1] ip_local_deliver+0x19d/0x480 [ 1766.895030][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1766.895317][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1766.895584][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1766.895860][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1766.896122][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1766.896466][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1766.896739][ C1] ip_rcv+0x564/0x740 [ 1766.896951][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1766.897191][ C1] ? set_track_prepare+0x8a/0xd0 [ 1766.897466][ C1] ? irqentry_enter+0x2b/0x60 [ 1766.897717][ C1] ? irqentry_enter+0x2b/0x60 [ 1766.897967][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1766.898206][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1766.898519][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1766.898856][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1766.899165][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1766.899515][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1766.899815][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1766.900147][ C1] netif_receive_skb+0x55/0x280 [ 1766.900404][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1766.900728][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1766.901077][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1766.901393][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1766.901684][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1766.901988][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1766.902323][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1766.902607][ C1] ? arch_stack_walk+0x68/0x100 [ 1766.902872][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1766.903154][ C1] ? irqentry_enter+0x2b/0x60 [ 1766.903412][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1766.903735][ C1] ? irqentry_enter+0x2b/0x60 [ 1766.903984][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1766.904305][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1766.904589][ C1] ? arch_stack_walk+0x68/0x100 [ 1766.904850][ C1] __tcf_classify+0x32c/0x7d0 [ 1766.905102][ C1] tcf_classify+0x283/0x930 [ 1766.905346][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1766.905615][ C1] tc_run+0x2e4/0x5d0 [ 1766.905833][ C1] ? __pfx_tc_run+0x10/0x10 [ 1766.906077][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1766.906345][ C1] ? irqentry_enter+0x2b/0x60 [ 1766.906603][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1766.906894][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1766.907218][ C1] ip_finish_output2+0x786/0x18e0 [ 1766.907497][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1766.907791][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1766.908058][ C1] ? __ip_finish_output+0x10f/0x770 [ 1766.908340][ C1] ip_output+0x16b/0x4f0 [ 1766.908569][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1766.908887][ C1] ? __pfx_ip_output+0x10/0x10 [ 1766.909145][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1766.909502][ C1] ? __pfx_ip_output+0x10/0x10 [ 1766.909760][ C1] __ip_queue_xmit+0x672/0x1910 [ 1766.910026][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1766.910313][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1766.910612][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1766.910901][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1766.911200][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1766.911491][ C1] tcp_delack_timer+0x84/0x240 [ 1766.911753][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1766.912040][ C1] call_timer_fn+0x176/0x430 [ 1766.912291][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1766.912571][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1766.912849][ C1] __run_timers.part.0+0x52d/0x890 [ 1766.913122][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1766.913414][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1766.913720][ C1] ? __pfx___schedule+0x10/0x10 [ 1766.913982][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1766.914306][ C1] run_timer_softirq+0x72/0x100 [ 1766.914571][ C1] __do_softirq+0x1bc/0x7ff [ 1766.914820][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1766.915098][ C1] run_ksoftirqd+0x2e/0x60 [ 1766.915336][ C1] smpboot_thread_fn+0x30e/0x840 [ 1766.915605][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1766.915895][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1766.916191][ C1] kthread+0x292/0x360 [ 1766.916410][ C1] ? __pfx_kthread+0x10/0x10 [ 1766.916661][ C1] ret_from_fork+0x34/0x70 [ 1766.916903][ C1] ? __pfx_kthread+0x10/0x10 [ 1766.917152][ C1] ret_from_fork_asm+0x1b/0x30 [ 1766.917419][ C1] [ 1792.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 563s! [swapper/0:0] [ 1792.527921][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1792.529109][ C0] irq event stamp: 27567077 [ 1792.529348][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 1792.529870][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 1792.530349][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 1792.530857][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 1792.531353][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1792.531837][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1792.532475][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1792.532811][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1792.533833][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1792.534154][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1792.534571][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1792.534987][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1792.535403][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1792.535818][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1792.536235][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1792.536704][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1792.537061][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1792.537497][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1792.537918][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1792.538335][ C0] Call Trace: [ 1792.538514][ C0] [ 1792.538670][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1792.538949][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1792.539209][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1792.539504][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1792.539790][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1792.540091][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1792.540367][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1792.540688][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1792.540965][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1792.541241][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1792.541570][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1792.541881][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1792.542213][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1792.542519][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1792.542831][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1792.543133][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1792.543456][ C0] ? get_stack_info+0x36/0xc0 [ 1792.543712][ C0] ? lock_acquire+0x1c1/0x220 [ 1792.543966][ C0] ? lock_release+0x1d5/0x250 [ 1792.544220][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1792.544483][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1792.544772][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1792.545079][ C0] ? lock_acquire+0x1c1/0x220 [ 1792.545328][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1792.545580][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1792.545852][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1792.546103][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1792.546364][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1792.546638][ C0] ? __inet_lookup_established+0x341/0x610 [ 1792.546951][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1792.547244][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1792.547535][ C0] ip_local_deliver+0x19d/0x480 [ 1792.547793][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1792.548079][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1792.548344][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1792.548624][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1792.548890][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1792.549226][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1792.549507][ C0] ip_rcv+0x564/0x740 [ 1792.549722][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1792.549970][ C0] ? set_track_prepare+0x8a/0xd0 [ 1792.550241][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1792.550529][ C0] ? rest_init+0x153/0x260 [ 1792.550770][ C0] ? skb_clone+0x10b/0x330 [ 1792.551012][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1792.551353][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1792.551675][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1792.551969][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1792.552277][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1792.552536][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1792.552776][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1792.553093][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1792.553391][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1792.553733][ C0] ? lock_acquire+0x1c1/0x220 [ 1792.553985][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1792.554301][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1792.554601][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1792.554940][ C0] ? __copy_skb_header+0xaf/0x490 [ 1792.555211][ C0] ? __skb_clone+0x57a/0x760 [ 1792.555458][ C0] netif_receive_skb+0x55/0x280 [ 1792.555714][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1792.556038][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1792.556386][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1792.556703][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1792.556991][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1792.557296][ C0] ? hlock_class+0x4e/0x130 [ 1792.557548][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1792.557879][ C0] ? place_entity+0x21/0x2f0 [ 1792.558129][ C0] ? resched_curr+0x219/0x280 [ 1792.558377][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1792.558647][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1792.558931][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1792.559214][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1792.559477][ C0] ? activate_task+0xf5/0x260 [ 1792.559733][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1792.560010][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1792.560283][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1792.560545][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1792.560837][ C0] ? get_stack_info+0x36/0xc0 [ 1792.561087][ C0] ? stack_access_ok+0xda/0x1f0 [ 1792.561344][ C0] ? get_reg+0x119/0x190 [ 1792.561571][ C0] __tcf_classify+0x32c/0x7d0 [ 1792.561825][ C0] tcf_classify+0x283/0x930 [ 1792.562071][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1792.562403][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1792.562668][ C0] ? arch_stack_walk+0x8c/0x100 [ 1792.562929][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1792.563226][ C0] tc_run+0x2e4/0x5d0 [ 1792.563444][ C0] ? __pfx_tc_run+0x10/0x10 [ 1792.563691][ C0] ? lock_acquire+0x1c1/0x220 [ 1792.563946][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1792.564224][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1792.564491][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1792.564781][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1792.565062][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1792.565388][ C0] ? neigh_hh_output+0x348/0x590 [ 1792.565652][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1792.565932][ C0] ip_finish_output2+0x786/0x18e0 [ 1792.566205][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1792.566499][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1792.566848][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1792.567134][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1792.567405][ C0] ? __ip_finish_output+0x10f/0x770 [ 1792.567687][ C0] ip_output+0x16b/0x4f0 [ 1792.567918][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1792.568199][ C0] ? __pfx_ip_output+0x10/0x10 [ 1792.568455][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1792.568752][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1792.569018][ C0] ? ip_local_out+0x114/0x3b0 [ 1792.569269][ C0] __ip_queue_xmit+0x672/0x1910 [ 1792.569528][ C0] ? __skb_clone+0x57a/0x760 [ 1792.569771][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1792.570055][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1792.570353][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1792.570675][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1792.570932][ C0] ? tcp_current_mss+0x40a/0x510 [ 1792.571199][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1792.571477][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1792.571757][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1792.572014][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1792.572280][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1792.572596][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1792.572875][ C0] ? ktime_get+0xb6/0x190 [ 1792.573114][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1792.573389][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1792.573668][ C0] tcp_write_timer+0x82/0x1d0 [ 1792.573922][ C0] call_timer_fn+0x176/0x430 [ 1792.574172][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1792.574445][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1792.574722][ C0] __run_timers.part.0+0x52d/0x890 [ 1792.574994][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1792.575280][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1792.575577][ C0] ? lock_acquire+0x1c1/0x220 [ 1792.575828][ C0] ? clockevents_program_event+0xf6/0x300 [ 1792.576136][ C0] ? lock_release+0x1d5/0x250 [ 1792.576389][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1792.576668][ C0] ? ktime_get+0xb6/0x190 [ 1792.576902][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1792.577206][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1792.577521][ C0] run_timer_softirq+0x72/0x100 [ 1792.577780][ C0] __do_softirq+0x1bc/0x7ff [ 1792.578025][ C0] irq_exit_rcu+0x98/0xc0 [ 1792.578255][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1792.578555][ C0] [ 1792.578713][ C0] [ 1792.578872][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1792.579193][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1792.579461][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1792.580477][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1792.580800][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1792.581220][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1792.581638][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1792.582056][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1792.582474][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1792.582891][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1792.583193][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1792.583464][ C0] default_idle_call+0x69/0xa0 [ 1792.583721][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1792.583982][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1792.584279][ C0] ? lock_release+0x1d5/0x250 [ 1792.584529][ C0] do_idle+0xfb/0x160 [ 1792.584743][ C0] cpu_startup_entry+0x55/0x60 [ 1792.584996][ C0] rest_init+0x153/0x260 [ 1792.585223][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1792.585511][ C0] arch_call_rest_init+0x13/0x40 [ 1792.585777][ C0] start_kernel+0x314/0x3d0 [ 1792.586029][ C0] x86_64_start_reservations+0x18/0x30 [ 1792.586324][ C0] x86_64_start_kernel+0xba/0x110 [ 1792.586592][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1792.586921][ C0] [ 1792.587085][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 563s! [ksoftirqd/1:22] [ 1792.587546][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1792.588737][ C1] irq event stamp: 3886976 [ 1792.588973][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 1792.589475][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 1792.589981][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 1792.590486][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 1792.590974][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1792.591475][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1792.592123][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1792.592468][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1792.593495][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1792.593821][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1792.594247][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1792.594673][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1792.595095][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1792.595517][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1792.595944][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1792.596423][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1792.596772][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1792.597209][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1792.597636][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1792.598063][ C1] Call Trace: [ 1792.598245][ C1] [ 1792.598405][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1792.598684][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1792.598951][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1792.599247][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1792.599539][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1792.599845][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1792.600128][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1792.600457][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1792.600733][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1792.601064][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1792.601379][ C1] [ 1792.601536][ C1] [ 1792.601694][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1792.602024][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1792.602336][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1792.602650][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1792.602955][ C1] ? run_ksoftirqd+0xb/0x60 [ 1792.603198][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1792.603523][ C1] ? __orc_find+0x9c/0xf0 [ 1792.603760][ C1] ? lock_acquire+0x1c1/0x220 [ 1792.604016][ C1] ? irqentry_enter+0x2b/0x60 [ 1792.604276][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1792.604542][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1792.604832][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1792.605137][ C1] ? lock_acquire+0x1c1/0x220 [ 1792.605393][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1792.605648][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1792.605922][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1792.606174][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1792.606437][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1792.606713][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1792.607007][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1792.607312][ C1] ip_local_deliver+0x19d/0x480 [ 1792.607579][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1792.607869][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1792.608138][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1792.608416][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1792.608681][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1792.609028][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1792.609304][ C1] ip_rcv+0x564/0x740 [ 1792.609517][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1792.609758][ C1] ? set_track_prepare+0x8a/0xd0 [ 1792.610023][ C1] ? irqentry_enter+0x2b/0x60 [ 1792.610280][ C1] ? irqentry_enter+0x2b/0x60 [ 1792.610536][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1792.610783][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1792.611106][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1792.611449][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1792.611764][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1792.612105][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1792.612405][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1792.612744][ C1] netif_receive_skb+0x55/0x280 [ 1792.613005][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1792.613339][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1792.613691][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1792.614005][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1792.614301][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1792.614608][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1792.614948][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1792.615236][ C1] ? arch_stack_walk+0x68/0x100 [ 1792.615503][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1792.615782][ C1] ? irqentry_enter+0x2b/0x60 [ 1792.616037][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1792.616357][ C1] ? irqentry_enter+0x2b/0x60 [ 1792.616612][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1792.616943][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1792.617235][ C1] ? arch_stack_walk+0x68/0x100 [ 1792.617497][ C1] __tcf_classify+0x32c/0x7d0 [ 1792.617753][ C1] tcf_classify+0x283/0x930 [ 1792.617999][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1792.618272][ C1] tc_run+0x2e4/0x5d0 [ 1792.618492][ C1] ? __pfx_tc_run+0x10/0x10 [ 1792.618737][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1792.619007][ C1] ? irqentry_enter+0x2b/0x60 [ 1792.619268][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1792.619562][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1792.619889][ C1] ip_finish_output2+0x786/0x18e0 [ 1792.620162][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1792.620454][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1792.620725][ C1] ? __ip_finish_output+0x10f/0x770 [ 1792.621004][ C1] ip_output+0x16b/0x4f0 [ 1792.621232][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1792.621557][ C1] ? __pfx_ip_output+0x10/0x10 [ 1792.621814][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1792.622176][ C1] ? __pfx_ip_output+0x10/0x10 [ 1792.622437][ C1] __ip_queue_xmit+0x672/0x1910 [ 1792.622700][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1792.622982][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1792.623280][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1792.623566][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1792.623861][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1792.624148][ C1] tcp_delack_timer+0x84/0x240 [ 1792.624402][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1792.624694][ C1] call_timer_fn+0x176/0x430 [ 1792.624946][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1792.625221][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1792.625505][ C1] __run_timers.part.0+0x52d/0x890 [ 1792.625781][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1792.626069][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1792.626372][ C1] ? __pfx___schedule+0x10/0x10 [ 1792.626636][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1792.626964][ C1] run_timer_softirq+0x72/0x100 [ 1792.627233][ C1] __do_softirq+0x1bc/0x7ff [ 1792.627481][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1792.627762][ C1] run_ksoftirqd+0x2e/0x60 [ 1792.628003][ C1] smpboot_thread_fn+0x30e/0x840 [ 1792.628272][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1792.628562][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1792.628856][ C1] kthread+0x292/0x360 [ 1792.629078][ C1] ? __pfx_kthread+0x10/0x10 [ 1792.629330][ C1] ret_from_fork+0x34/0x70 [ 1792.629569][ C1] ? __pfx_kthread+0x10/0x10 [ 1792.629818][ C1] ret_from_fork_asm+0x1b/0x30 [ 1792.630078][ C1] [ 1820.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 589s! [swapper/0:0] [ 1820.527923][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1820.529109][ C0] irq event stamp: 27567077 [ 1820.529347][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 1820.529876][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 1820.530353][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 1820.530861][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 1820.531363][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1820.531846][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1820.532488][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1820.532826][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1820.533840][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1820.534164][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1820.534582][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1820.535001][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1820.535419][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1820.535835][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1820.536253][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1820.536721][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1820.537080][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1820.537501][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1820.537917][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1820.538333][ C0] Call Trace: [ 1820.538514][ C0] [ 1820.538669][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1820.538949][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1820.539201][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1820.539493][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1820.539776][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1820.540076][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1820.540356][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1820.540674][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1820.540949][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1820.541225][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1820.541551][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1820.541867][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1820.542197][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1820.542504][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1820.542814][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1820.543116][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1820.543441][ C0] ? get_stack_info+0x36/0xc0 [ 1820.543699][ C0] ? lock_acquire+0x1c1/0x220 [ 1820.543955][ C0] ? lock_release+0x1d5/0x250 [ 1820.544210][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1820.544472][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1820.544758][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1820.545058][ C0] ? lock_acquire+0x1c1/0x220 [ 1820.545304][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1820.545553][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1820.545823][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1820.546074][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1820.546337][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1820.546609][ C0] ? __inet_lookup_established+0x341/0x610 [ 1820.546927][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1820.547229][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1820.547522][ C0] ip_local_deliver+0x19d/0x480 [ 1820.547779][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1820.548061][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1820.548325][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1820.548605][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1820.548871][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1820.549207][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1820.549483][ C0] ip_rcv+0x564/0x740 [ 1820.549700][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1820.549944][ C0] ? set_track_prepare+0x8a/0xd0 [ 1820.550212][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1820.550501][ C0] ? rest_init+0x153/0x260 [ 1820.550738][ C0] ? skb_clone+0x10b/0x330 [ 1820.550976][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1820.551313][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1820.551636][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1820.551930][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1820.552237][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1820.552494][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1820.552732][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1820.553043][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1820.553340][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1820.553682][ C0] ? lock_acquire+0x1c1/0x220 [ 1820.553934][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1820.554247][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1820.554542][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1820.554875][ C0] ? __copy_skb_header+0xaf/0x490 [ 1820.555146][ C0] ? __skb_clone+0x57a/0x760 [ 1820.555394][ C0] netif_receive_skb+0x55/0x280 [ 1820.555652][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1820.555977][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1820.556322][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1820.556637][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1820.556921][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1820.557224][ C0] ? hlock_class+0x4e/0x130 [ 1820.557473][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1820.557806][ C0] ? place_entity+0x21/0x2f0 [ 1820.558054][ C0] ? resched_curr+0x219/0x280 [ 1820.558304][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1820.558570][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1820.558849][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1820.559129][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1820.559387][ C0] ? activate_task+0xf5/0x260 [ 1820.559639][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1820.559915][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1820.560187][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1820.560452][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1820.560744][ C0] ? get_stack_info+0x36/0xc0 [ 1820.560994][ C0] ? stack_access_ok+0xda/0x1f0 [ 1820.561252][ C0] ? get_reg+0x119/0x190 [ 1820.561479][ C0] __tcf_classify+0x32c/0x7d0 [ 1820.561736][ C0] tcf_classify+0x283/0x930 [ 1820.561981][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1820.562310][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1820.562575][ C0] ? arch_stack_walk+0x8c/0x100 [ 1820.562833][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1820.563121][ C0] tc_run+0x2e4/0x5d0 [ 1820.563339][ C0] ? __pfx_tc_run+0x10/0x10 [ 1820.563583][ C0] ? lock_acquire+0x1c1/0x220 [ 1820.563834][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1820.564110][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1820.564374][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1820.564660][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1820.564940][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1820.565263][ C0] ? neigh_hh_output+0x348/0x590 [ 1820.565525][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1820.565807][ C0] ip_finish_output2+0x786/0x18e0 [ 1820.566076][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1820.566369][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1820.566720][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1820.567009][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1820.567281][ C0] ? __ip_finish_output+0x10f/0x770 [ 1820.567560][ C0] ip_output+0x16b/0x4f0 [ 1820.567787][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1820.568070][ C0] ? __pfx_ip_output+0x10/0x10 [ 1820.568327][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1820.568625][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1820.568889][ C0] ? ip_local_out+0x114/0x3b0 [ 1820.569136][ C0] __ip_queue_xmit+0x672/0x1910 [ 1820.569394][ C0] ? __skb_clone+0x57a/0x760 [ 1820.569639][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1820.569921][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1820.570217][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1820.570537][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1820.570790][ C0] ? tcp_current_mss+0x40a/0x510 [ 1820.571057][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1820.571336][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1820.571615][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1820.571869][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1820.572135][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1820.572450][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1820.572730][ C0] ? ktime_get+0xb6/0x190 [ 1820.572964][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1820.573238][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1820.573517][ C0] tcp_write_timer+0x82/0x1d0 [ 1820.573771][ C0] call_timer_fn+0x176/0x430 [ 1820.574020][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1820.574291][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1820.574566][ C0] __run_timers.part.0+0x52d/0x890 [ 1820.574836][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1820.575121][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1820.575416][ C0] ? lock_acquire+0x1c1/0x220 [ 1820.575669][ C0] ? clockevents_program_event+0xf6/0x300 [ 1820.575977][ C0] ? lock_release+0x1d5/0x250 [ 1820.576229][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1820.576508][ C0] ? ktime_get+0xb6/0x190 [ 1820.576739][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1820.577048][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1820.577360][ C0] run_timer_softirq+0x72/0x100 [ 1820.577616][ C0] __do_softirq+0x1bc/0x7ff [ 1820.577857][ C0] irq_exit_rcu+0x98/0xc0 [ 1820.578087][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1820.578385][ C0] [ 1820.578544][ C0] [ 1820.578705][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1820.579029][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1820.579297][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1820.580315][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1820.580633][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1820.581048][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1820.581465][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1820.581881][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1820.582297][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1820.582715][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1820.583021][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1820.583294][ C0] default_idle_call+0x69/0xa0 [ 1820.583552][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1820.583813][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1820.584107][ C0] ? lock_release+0x1d5/0x250 [ 1820.584355][ C0] do_idle+0xfb/0x160 [ 1820.584566][ C0] cpu_startup_entry+0x55/0x60 [ 1820.584818][ C0] rest_init+0x153/0x260 [ 1820.585048][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1820.585333][ C0] arch_call_rest_init+0x13/0x40 [ 1820.585597][ C0] start_kernel+0x314/0x3d0 [ 1820.585841][ C0] x86_64_start_reservations+0x18/0x30 [ 1820.586134][ C0] x86_64_start_kernel+0xba/0x110 [ 1820.586400][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1820.586731][ C0] [ 1820.586896][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 589s! [ksoftirqd/1:22] [ 1820.587354][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1820.588541][ C1] irq event stamp: 3886976 [ 1820.588775][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 1820.589273][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 1820.589774][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 1820.590273][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 1820.590760][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1820.591256][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1820.591910][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1820.592254][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1820.593282][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1820.593610][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1820.594036][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1820.594459][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1820.594884][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1820.595312][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1820.595738][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1820.596216][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1820.596568][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1820.596989][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1820.597420][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1820.597842][ C1] Call Trace: [ 1820.598025][ C1] [ 1820.598184][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1820.598462][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1820.598723][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1820.599013][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1820.599303][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1820.599613][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1820.599895][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1820.600223][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1820.600500][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1820.600830][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1820.601149][ C1] [ 1820.601307][ C1] [ 1820.601465][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1820.601798][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1820.602110][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1820.602427][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1820.602732][ C1] ? run_ksoftirqd+0xb/0x60 [ 1820.602975][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1820.603306][ C1] ? __orc_find+0x9c/0xf0 [ 1820.603540][ C1] ? lock_acquire+0x1c1/0x220 [ 1820.603798][ C1] ? irqentry_enter+0x2b/0x60 [ 1820.604058][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1820.604327][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1820.604618][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1820.604920][ C1] ? lock_acquire+0x1c1/0x220 [ 1820.605171][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1820.605423][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1820.605696][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1820.605946][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1820.606214][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1820.606488][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1820.606781][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1820.607083][ C1] ip_local_deliver+0x19d/0x480 [ 1820.607347][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1820.607637][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1820.607913][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1820.608192][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1820.608457][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1820.608797][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1820.609072][ C1] ip_rcv+0x564/0x740 [ 1820.609287][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1820.609531][ C1] ? set_track_prepare+0x8a/0xd0 [ 1820.609795][ C1] ? irqentry_enter+0x2b/0x60 [ 1820.610049][ C1] ? irqentry_enter+0x2b/0x60 [ 1820.610304][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1820.610551][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1820.610868][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1820.611213][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1820.611526][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1820.611865][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1820.612164][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1820.612500][ C1] netif_receive_skb+0x55/0x280 [ 1820.612766][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1820.613098][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1820.613451][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1820.613767][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1820.614060][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1820.614367][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1820.614703][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1820.614986][ C1] ? arch_stack_walk+0x68/0x100 [ 1820.615247][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1820.615523][ C1] ? irqentry_enter+0x2b/0x60 [ 1820.615773][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1820.616096][ C1] ? irqentry_enter+0x2b/0x60 [ 1820.616353][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1820.616677][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1820.616956][ C1] ? arch_stack_walk+0x68/0x100 [ 1820.617223][ C1] __tcf_classify+0x32c/0x7d0 [ 1820.617473][ C1] tcf_classify+0x283/0x930 [ 1820.617718][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1820.617988][ C1] tc_run+0x2e4/0x5d0 [ 1820.618206][ C1] ? __pfx_tc_run+0x10/0x10 [ 1820.618452][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1820.618719][ C1] ? irqentry_enter+0x2b/0x60 [ 1820.618972][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1820.619262][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1820.619590][ C1] ip_finish_output2+0x786/0x18e0 [ 1820.619860][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1820.620148][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1820.620417][ C1] ? __ip_finish_output+0x10f/0x770 [ 1820.620694][ C1] ip_output+0x16b/0x4f0 [ 1820.620921][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1820.621245][ C1] ? __pfx_ip_output+0x10/0x10 [ 1820.621504][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1820.621858][ C1] ? __pfx_ip_output+0x10/0x10 [ 1820.622117][ C1] __ip_queue_xmit+0x672/0x1910 [ 1820.622378][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1820.622657][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1820.622956][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1820.623243][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1820.623539][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1820.623825][ C1] tcp_delack_timer+0x84/0x240 [ 1820.624082][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1820.624370][ C1] call_timer_fn+0x176/0x430 [ 1820.624621][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1820.624898][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1820.625180][ C1] __run_timers.part.0+0x52d/0x890 [ 1820.625456][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1820.625745][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1820.626046][ C1] ? __pfx___schedule+0x10/0x10 [ 1820.626311][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1820.626634][ C1] run_timer_softirq+0x72/0x100 [ 1820.626893][ C1] __do_softirq+0x1bc/0x7ff [ 1820.627144][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1820.627422][ C1] run_ksoftirqd+0x2e/0x60 [ 1820.627660][ C1] smpboot_thread_fn+0x30e/0x840 [ 1820.627931][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1820.628224][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1820.628520][ C1] kthread+0x292/0x360 [ 1820.628737][ C1] ? __pfx_kthread+0x10/0x10 [ 1820.628986][ C1] ret_from_fork+0x34/0x70 [ 1820.629227][ C1] ? __pfx_kthread+0x10/0x10 [ 1820.629476][ C1] ret_from_fork_asm+0x1b/0x30 [ 1820.629737][ C1] [ 1844.918024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 1844.918415][ C0] rcu: 0-....: (651266 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=158820 [ 1844.918929][ C0] rcu: (t=650609 jiffies g=1007429 q=31 ncpus=4) [ 1844.919273][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1844.919755][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1844.920392][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 1844.920733][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 1844.921751][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1844.922076][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1844.922499][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1844.922917][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1844.923336][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1844.923757][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1844.924180][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1844.924649][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1844.924998][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1844.925425][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1844.925844][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1844.926264][ C0] Call Trace: [ 1844.926439][ C0] [ 1844.926594][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 1844.926885][ C0] ? print_cpu_stall+0x263/0x6a0 [ 1844.927157][ C0] ? check_cpu_stall+0x284/0x500 [ 1844.927419][ C0] ? rcu_pending+0x92/0x360 [ 1844.927666][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 1844.927952][ C0] ? update_process_times+0xb9/0x110 [ 1844.928232][ C0] ? tick_sched_handle+0x67/0x130 [ 1844.928503][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 1844.928802][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1844.929053][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 1844.929382][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1844.929664][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1844.929964][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1844.930242][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1844.930558][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1844.930834][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1844.931109][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1844.931436][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1844.931747][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1844.932074][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1844.932380][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 1844.932684][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1844.932988][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1844.933315][ C0] ? get_stack_info+0x36/0xc0 [ 1844.933568][ C0] ? lock_acquire+0x1c1/0x220 [ 1844.933818][ C0] ? lock_release+0x1d5/0x250 [ 1844.934068][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1844.934326][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1844.934610][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1844.934905][ C0] ? lock_acquire+0x1c1/0x220 [ 1844.935155][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1844.935409][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1844.935683][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1844.935930][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1844.936188][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1844.936455][ C0] ? __inet_lookup_established+0x341/0x610 [ 1844.936766][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1844.937062][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1844.937356][ C0] ip_local_deliver+0x19d/0x480 [ 1844.937621][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1844.937905][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1844.938176][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1844.938450][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1844.938709][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1844.939047][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1844.939320][ C0] ip_rcv+0x564/0x740 [ 1844.939531][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1844.939769][ C0] ? set_track_prepare+0x8a/0xd0 [ 1844.940032][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1844.940323][ C0] ? rest_init+0x153/0x260 [ 1844.940558][ C0] ? skb_clone+0x10b/0x330 [ 1844.940800][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1844.941132][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1844.941449][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1844.941749][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1844.942059][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1844.942320][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1844.942562][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1844.942881][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1844.943187][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1844.943524][ C0] ? lock_acquire+0x1c1/0x220 [ 1844.943769][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1844.944076][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1844.944375][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1844.944707][ C0] ? __copy_skb_header+0xaf/0x490 [ 1844.944973][ C0] ? __skb_clone+0x57a/0x760 [ 1844.945217][ C0] netif_receive_skb+0x55/0x280 [ 1844.945481][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1844.945809][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1844.946163][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1844.946473][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1844.946762][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1844.947067][ C0] ? hlock_class+0x4e/0x130 [ 1844.947315][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1844.947643][ C0] ? place_entity+0x21/0x2f0 [ 1844.947890][ C0] ? resched_curr+0x219/0x280 [ 1844.948147][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1844.948415][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1844.948697][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1844.948974][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1844.949232][ C0] ? activate_task+0xf5/0x260 [ 1844.949480][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1844.949753][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1844.950026][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1844.950284][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1844.950574][ C0] ? get_stack_info+0x36/0xc0 [ 1844.950829][ C0] ? stack_access_ok+0xda/0x1f0 [ 1844.951090][ C0] ? get_reg+0x119/0x190 [ 1844.951318][ C0] __tcf_classify+0x32c/0x7d0 [ 1844.951569][ C0] tcf_classify+0x283/0x930 [ 1844.951808][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1844.952132][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1844.952403][ C0] ? arch_stack_walk+0x8c/0x100 [ 1844.952665][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1844.952960][ C0] tc_run+0x2e4/0x5d0 [ 1844.953174][ C0] ? __pfx_tc_run+0x10/0x10 [ 1844.953413][ C0] ? lock_acquire+0x1c1/0x220 [ 1844.953660][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1844.953938][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1844.954208][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1844.954491][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1844.954770][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1844.955090][ C0] ? neigh_hh_output+0x348/0x590 [ 1844.955359][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1844.955635][ C0] ip_finish_output2+0x786/0x18e0 [ 1844.955903][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1844.956192][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1844.956549][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1844.956841][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1844.957113][ C0] ? __ip_finish_output+0x10f/0x770 [ 1844.957388][ C0] ip_output+0x16b/0x4f0 [ 1844.957612][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1844.957895][ C0] ? __pfx_ip_output+0x10/0x10 [ 1844.958147][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1844.958449][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1844.958710][ C0] ? ip_local_out+0x114/0x3b0 [ 1844.958962][ C0] __ip_queue_xmit+0x672/0x1910 [ 1844.959225][ C0] ? __skb_clone+0x57a/0x760 [ 1844.959472][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1844.959750][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1844.960041][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1844.960358][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1844.960615][ C0] ? tcp_current_mss+0x40a/0x510 [ 1844.960876][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1844.961158][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1844.961432][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1844.961681][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1844.961952][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1844.962271][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1844.962544][ C0] ? ktime_get+0xb6/0x190 [ 1844.962774][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1844.963046][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1844.963328][ C0] tcp_write_timer+0x82/0x1d0 [ 1844.963576][ C0] call_timer_fn+0x176/0x430 [ 1844.963820][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1844.964096][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1844.964372][ C0] __run_timers.part.0+0x52d/0x890 [ 1844.964648][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1844.964928][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1844.965231][ C0] ? lock_acquire+0x1c1/0x220 [ 1844.965477][ C0] ? clockevents_program_event+0xf6/0x300 [ 1844.965778][ C0] ? lock_release+0x1d5/0x250 [ 1844.966026][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1844.966302][ C0] ? ktime_get+0xb6/0x190 [ 1844.966529][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1844.966825][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1844.967138][ C0] run_timer_softirq+0x72/0x100 [ 1844.967398][ C0] __do_softirq+0x1bc/0x7ff [ 1844.967643][ C0] irq_exit_rcu+0x98/0xc0 [ 1844.967875][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1844.968174][ C0] [ 1844.968330][ C0] [ 1844.968486][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1844.968804][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1844.969074][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1844.970090][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1844.970415][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1844.970835][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1844.971259][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1844.971687][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1844.972105][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1844.972524][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1844.972829][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1844.973102][ C0] default_idle_call+0x69/0xa0 [ 1844.973353][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1844.973618][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1844.973907][ C0] ? lock_release+0x1d5/0x250 [ 1844.974160][ C0] do_idle+0xfb/0x160 [ 1844.974371][ C0] cpu_startup_entry+0x55/0x60 [ 1844.974625][ C0] rest_init+0x153/0x260 [ 1844.974849][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1844.975138][ C0] arch_call_rest_init+0x13/0x40 [ 1844.975404][ C0] start_kernel+0x314/0x3d0 [ 1844.975644][ C0] x86_64_start_reservations+0x18/0x30 [ 1844.975930][ C0] x86_64_start_kernel+0xba/0x110 [ 1844.976200][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1844.976525][ C0] [ 1844.976692][ C0] Sending NMI from CPU 0 to CPUs 1: [ 1844.976982][ C1] NMI backtrace for cpu 1 [ 1844.976989][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1844.976993][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1844.976995][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 1844.977001][ C1] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 1844.977004][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [ 1844.977007][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1844.977009][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1844.977011][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1844.977012][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1844.977014][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1844.977016][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1844.977018][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1844.977023][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1844.977025][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1844.977026][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1844.977028][ C1] Call Trace: [ 1844.977030][ C1] [ 1844.977032][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 1844.977039][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 1844.977044][ C1] ? nmi_handle+0x156/0x420 [ 1844.977049][ C1] ? default_do_nmi+0x41/0x100 [ 1844.977053][ C1] ? exc_nmi+0xf3/0x120 [ 1844.977055][ C1] ? end_repeat_nmi+0xf/0x60 [ 1844.977060][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1844.977064][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 1844.977067][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 1844.977070][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 1844.977073][ C1] [ 1844.977074][ C1] [ 1844.977075][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 1844.977079][ C1] ? run_ksoftirqd+0xb/0x60 [ 1844.977084][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1844.977087][ C1] ? __orc_find+0x9c/0xf0 [ 1844.977090][ C1] ? lock_acquire+0x1c1/0x220 [ 1844.977094][ C1] ? irqentry_enter+0x2b/0x60 [ 1844.977099][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1844.977103][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1844.977106][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1844.977109][ C1] ? lock_acquire+0x1c1/0x220 [ 1844.977111][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1844.977116][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1844.977120][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1844.977127][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1844.977129][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1844.977135][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1844.977142][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1844.977146][ C1] ip_local_deliver+0x19d/0x480 [ 1844.977149][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1844.977151][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1844.977155][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1844.977160][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1844.977162][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1844.977166][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1844.977176][ C1] ip_rcv+0x564/0x740 [ 1844.977179][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1844.977182][ C1] ? set_track_prepare+0x8a/0xd0 [ 1844.977185][ C1] ? irqentry_enter+0x2b/0x60 [ 1844.977189][ C1] ? irqentry_enter+0x2b/0x60 [ 1844.977193][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1844.977195][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1844.977200][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1844.977203][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1844.977206][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1844.977209][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1844.977212][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1844.977217][ C1] netif_receive_skb+0x55/0x280 [ 1844.977221][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1844.977229][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1844.977237][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1844.977244][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1844.977250][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1844.977262][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1844.977272][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1844.977275][ C1] ? arch_stack_walk+0x68/0x100 [ 1844.977280][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1844.977283][ C1] ? irqentry_enter+0x2b/0x60 [ 1844.977286][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1844.977291][ C1] ? irqentry_enter+0x2b/0x60 [ 1844.977294][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1844.977301][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1844.977304][ C1] ? arch_stack_walk+0x68/0x100 [ 1844.977308][ C1] __tcf_classify+0x32c/0x7d0 [ 1844.977313][ C1] tcf_classify+0x283/0x930 [ 1844.977317][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1844.977322][ C1] tc_run+0x2e4/0x5d0 [ 1844.977326][ C1] ? __pfx_tc_run+0x10/0x10 [ 1844.977331][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1844.977336][ C1] ? irqentry_enter+0x2b/0x60 [ 1844.977339][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1844.977342][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1844.977350][ C1] ip_finish_output2+0x786/0x18e0 [ 1844.977354][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1844.977357][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1844.977361][ C1] ? __ip_finish_output+0x10f/0x770 [ 1844.977365][ C1] ip_output+0x16b/0x4f0 [ 1844.977368][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1844.977371][ C1] ? __pfx_ip_output+0x10/0x10 [ 1844.977376][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1844.977383][ C1] ? __pfx_ip_output+0x10/0x10 [ 1844.977388][ C1] __ip_queue_xmit+0x672/0x1910 [ 1844.977393][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1844.977400][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1844.977404][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1844.977408][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1844.977413][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1844.977415][ C1] tcp_delack_timer+0x84/0x240 [ 1844.977419][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1844.977422][ C1] call_timer_fn+0x176/0x430 [ 1844.977426][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1844.977431][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1844.977435][ C1] __run_timers.part.0+0x52d/0x890 [ 1844.977438][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1844.977443][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1844.977448][ C1] ? __pfx___schedule+0x10/0x10 [ 1844.977451][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1844.977456][ C1] run_timer_softirq+0x72/0x100 [ 1844.977459][ C1] __do_softirq+0x1bc/0x7ff [ 1844.977463][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1844.977467][ C1] run_ksoftirqd+0x2e/0x60 [ 1844.977471][ C1] smpboot_thread_fn+0x30e/0x840 [ 1844.977475][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1844.977479][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1844.977482][ C1] kthread+0x292/0x360 [ 1844.977485][ C1] ? __pfx_kthread+0x10/0x10 [ 1844.977487][ C1] ret_from_fork+0x34/0x70 [ 1844.977491][ C1] ? __pfx_kthread+0x10/0x10 [ 1844.977493][ C1] ret_from_fork_asm+0x1b/0x30 [ 1844.977500][ C1] [ 1872.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 637s! [swapper/0:0] [ 1872.527917][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1872.529118][ C0] irq event stamp: 27567077 [ 1872.529362][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 1872.529905][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 1872.530379][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 1872.530879][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 1872.531373][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1872.531849][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1872.532503][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 1872.532841][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 1872.533854][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1872.534177][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1872.534594][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1872.535012][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1872.535430][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1872.535850][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1872.536267][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1872.536732][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1872.537090][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1872.537519][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1872.537940][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1872.538360][ C0] Call Trace: [ 1872.538538][ C0] [ 1872.538695][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1872.538974][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1872.539230][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1872.539523][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1872.539806][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1872.540108][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1872.540388][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1872.540705][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1872.540982][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1872.541259][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1872.541587][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1872.541900][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1872.542230][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1872.542539][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 1872.542845][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1872.543153][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1872.543487][ C0] ? get_stack_info+0x36/0xc0 [ 1872.543740][ C0] ? lock_acquire+0x1c1/0x220 [ 1872.543993][ C0] ? lock_release+0x1d5/0x250 [ 1872.544246][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1872.544511][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1872.544798][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1872.545097][ C0] ? lock_acquire+0x1c1/0x220 [ 1872.545349][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1872.545604][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1872.545882][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1872.546130][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1872.546389][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1872.546657][ C0] ? __inet_lookup_established+0x341/0x610 [ 1872.546977][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1872.547267][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1872.547557][ C0] ip_local_deliver+0x19d/0x480 [ 1872.547818][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1872.548105][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1872.548369][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1872.548643][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1872.548905][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1872.549244][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1872.549518][ C0] ip_rcv+0x564/0x740 [ 1872.549730][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1872.549969][ C0] ? set_track_prepare+0x8a/0xd0 [ 1872.550232][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1872.550530][ C0] ? rest_init+0x153/0x260 [ 1872.550764][ C0] ? skb_clone+0x10b/0x330 [ 1872.551009][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1872.551343][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1872.551661][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1872.551961][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1872.552272][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1872.552533][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1872.552776][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1872.553097][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1872.553395][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1872.553733][ C0] ? lock_acquire+0x1c1/0x220 [ 1872.553979][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1872.554288][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1872.554588][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1872.554918][ C0] ? __copy_skb_header+0xaf/0x490 [ 1872.555187][ C0] ? __skb_clone+0x57a/0x760 [ 1872.555431][ C0] netif_receive_skb+0x55/0x280 [ 1872.555695][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1872.556024][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1872.556375][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1872.556686][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1872.556984][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1872.557283][ C0] ? hlock_class+0x4e/0x130 [ 1872.557526][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1872.557858][ C0] ? place_entity+0x21/0x2f0 [ 1872.558107][ C0] ? resched_curr+0x219/0x280 [ 1872.558362][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1872.558632][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1872.558915][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1872.559192][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1872.559449][ C0] ? activate_task+0xf5/0x260 [ 1872.559697][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1872.559971][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1872.560245][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1872.560503][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1872.560794][ C0] ? get_stack_info+0x36/0xc0 [ 1872.561050][ C0] ? stack_access_ok+0xda/0x1f0 [ 1872.561311][ C0] ? get_reg+0x119/0x190 [ 1872.561538][ C0] __tcf_classify+0x32c/0x7d0 [ 1872.561790][ C0] tcf_classify+0x283/0x930 [ 1872.562031][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1872.562360][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1872.562630][ C0] ? arch_stack_walk+0x8c/0x100 [ 1872.562895][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1872.563189][ C0] tc_run+0x2e4/0x5d0 [ 1872.563403][ C0] ? __pfx_tc_run+0x10/0x10 [ 1872.563642][ C0] ? lock_acquire+0x1c1/0x220 [ 1872.563890][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1872.564164][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1872.564437][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1872.564720][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1872.564997][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1872.565318][ C0] ? neigh_hh_output+0x348/0x590 [ 1872.565587][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1872.565865][ C0] ip_finish_output2+0x786/0x18e0 [ 1872.566134][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1872.566423][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1872.566796][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1872.567088][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1872.567353][ C0] ? __ip_finish_output+0x10f/0x770 [ 1872.567628][ C0] ip_output+0x16b/0x4f0 [ 1872.567851][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1872.568137][ C0] ? __pfx_ip_output+0x10/0x10 [ 1872.568388][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1872.568694][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1872.568959][ C0] ? ip_local_out+0x114/0x3b0 [ 1872.569213][ C0] __ip_queue_xmit+0x672/0x1910 [ 1872.569475][ C0] ? __skb_clone+0x57a/0x760 [ 1872.569724][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1872.570001][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1872.570294][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1872.570609][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1872.570866][ C0] ? tcp_current_mss+0x40a/0x510 [ 1872.571128][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1872.571410][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1872.571684][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1872.571934][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1872.572210][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1872.572528][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1872.572803][ C0] ? ktime_get+0xb6/0x190 [ 1872.573035][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1872.573308][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1872.573591][ C0] tcp_write_timer+0x82/0x1d0 [ 1872.573838][ C0] call_timer_fn+0x176/0x430 [ 1872.574083][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1872.574359][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1872.574633][ C0] __run_timers.part.0+0x52d/0x890 [ 1872.574909][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1872.575196][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1872.575495][ C0] ? lock_acquire+0x1c1/0x220 [ 1872.575741][ C0] ? clockevents_program_event+0xf6/0x300 [ 1872.576048][ C0] ? lock_release+0x1d5/0x250 [ 1872.576298][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1872.576575][ C0] ? ktime_get+0xb6/0x190 [ 1872.576815][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1872.577117][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1872.577426][ C0] run_timer_softirq+0x72/0x100 [ 1872.577687][ C0] __do_softirq+0x1bc/0x7ff [ 1872.577934][ C0] irq_exit_rcu+0x98/0xc0 [ 1872.578169][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1872.578471][ C0] [ 1872.578627][ C0] [ 1872.578784][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1872.579107][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1872.579377][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1872.580404][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1872.580731][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1872.581152][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1872.581580][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1872.582004][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1872.582426][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1872.582848][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1872.583156][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1872.583435][ C0] default_idle_call+0x69/0xa0 [ 1872.583687][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1872.583954][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1872.584246][ C0] ? lock_release+0x1d5/0x250 [ 1872.584499][ C0] do_idle+0xfb/0x160 [ 1872.584713][ C0] cpu_startup_entry+0x55/0x60 [ 1872.584969][ C0] rest_init+0x153/0x260 [ 1872.585195][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1872.585484][ C0] arch_call_rest_init+0x13/0x40 [ 1872.585751][ C0] start_kernel+0x314/0x3d0 [ 1872.585991][ C0] x86_64_start_reservations+0x18/0x30 [ 1872.586281][ C0] x86_64_start_kernel+0xba/0x110 [ 1872.586552][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1872.586883][ C0] [ 1872.587046][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 637s! [ksoftirqd/1:22] [ 1872.587507][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1872.588708][ C1] irq event stamp: 3886976 [ 1872.588946][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 1872.589452][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 1872.589956][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 1872.590462][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 1872.590957][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1872.591468][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1872.592127][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 1872.592430][ C1] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 1872.593463][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [ 1872.593792][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1872.594226][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1872.594652][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1872.595083][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1872.595517][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1872.595950][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1872.596432][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1872.596794][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1872.597227][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1872.597661][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1872.598088][ C1] Call Trace: [ 1872.598271][ C1] [ 1872.598434][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1872.598717][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1872.598983][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1872.599279][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1872.599570][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1872.599879][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1872.600166][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1872.600495][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1872.600774][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1872.601106][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1872.601427][ C1] [ 1872.601585][ C1] [ 1872.601743][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1872.602077][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1872.602390][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 1872.602691][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 1872.602992][ C1] ? run_ksoftirqd+0xb/0x60 [ 1872.603244][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1872.603577][ C1] ? __orc_find+0x9c/0xf0 [ 1872.603811][ C1] ? lock_acquire+0x1c1/0x220 [ 1872.604066][ C1] ? irqentry_enter+0x2b/0x60 [ 1872.604322][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1872.604586][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1872.604873][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1872.605175][ C1] ? lock_acquire+0x1c1/0x220 [ 1872.605431][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1872.605691][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1872.605972][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1872.606220][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1872.606480][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1872.606752][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1872.607056][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1872.607353][ C1] ip_local_deliver+0x19d/0x480 [ 1872.607615][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1872.607902][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1872.608169][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1872.608450][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1872.608717][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1872.609056][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1872.609339][ C1] ip_rcv+0x564/0x740 [ 1872.609555][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1872.609801][ C1] ? set_track_prepare+0x8a/0xd0 [ 1872.610070][ C1] ? irqentry_enter+0x2b/0x60 [ 1872.610321][ C1] ? irqentry_enter+0x2b/0x60 [ 1872.610576][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1872.610818][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1872.611137][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1872.611483][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1872.611793][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1872.612141][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1872.612446][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1872.612782][ C1] netif_receive_skb+0x55/0x280 [ 1872.613046][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1872.613386][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1872.613736][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1872.614057][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1872.614348][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1872.614655][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1872.614986][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1872.615270][ C1] ? arch_stack_walk+0x68/0x100 [ 1872.615540][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1872.615822][ C1] ? irqentry_enter+0x2b/0x60 [ 1872.616085][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1872.616412][ C1] ? irqentry_enter+0x2b/0x60 [ 1872.616664][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1872.617003][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1872.617289][ C1] ? arch_stack_walk+0x68/0x100 [ 1872.617557][ C1] __tcf_classify+0x32c/0x7d0 [ 1872.617822][ C1] tcf_classify+0x283/0x930 [ 1872.618071][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1872.618348][ C1] tc_run+0x2e4/0x5d0 [ 1872.618567][ C1] ? __pfx_tc_run+0x10/0x10 [ 1872.618815][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1872.619087][ C1] ? irqentry_enter+0x2b/0x60 [ 1872.619338][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1872.619623][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1872.619947][ C1] ip_finish_output2+0x786/0x18e0 [ 1872.620225][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1872.620522][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1872.620790][ C1] ? __ip_finish_output+0x10f/0x770 [ 1872.621075][ C1] ip_output+0x16b/0x4f0 [ 1872.621304][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1872.621623][ C1] ? __pfx_ip_output+0x10/0x10 [ 1872.621884][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1872.622241][ C1] ? __pfx_ip_output+0x10/0x10 [ 1872.622501][ C1] __ip_queue_xmit+0x672/0x1910 [ 1872.622773][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1872.623061][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1872.623362][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1872.623653][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1872.623953][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1872.624243][ C1] tcp_delack_timer+0x84/0x240 [ 1872.624502][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1872.624787][ C1] call_timer_fn+0x176/0x430 [ 1872.625034][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1872.625318][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1872.625601][ C1] __run_timers.part.0+0x52d/0x890 [ 1872.625874][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1872.626169][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1872.626475][ C1] ? __pfx___schedule+0x10/0x10 [ 1872.626737][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1872.627068][ C1] run_timer_softirq+0x72/0x100 [ 1872.627330][ C1] __do_softirq+0x1bc/0x7ff [ 1872.627572][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1872.627847][ C1] run_ksoftirqd+0x2e/0x60 [ 1872.628090][ C1] smpboot_thread_fn+0x30e/0x840 [ 1872.628359][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1872.628652][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1872.628943][ C1] kthread+0x292/0x360 [ 1872.629166][ C1] ? __pfx_kthread+0x10/0x10 [ 1872.629413][ C1] ret_from_fork+0x34/0x70 [ 1872.629657][ C1] ? __pfx_kthread+0x10/0x10 [ 1872.629902][ C1] ret_from_fork_asm+0x1b/0x30 [ 1872.630168][ C1] [ 1900.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 664s! [swapper/0:0] [ 1900.527923][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1900.529124][ C0] irq event stamp: 27567077 [ 1900.529366][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 1900.529898][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 1900.530368][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 1900.530869][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 1900.531362][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1900.531838][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1900.532486][ C0] RIP: 0010:kasan_check_range+0x156/0x1c0 [ 1900.532798][ C0] Code: d0 74 11 80 38 00 74 ef 4d 8d 1c 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea 09 48 83 c0 01 48 39 d0 74 a5 80 38 00 74 f2 e9 74 ff ff ff b8 [ 1900.533830][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000286 [ 1900.534154][ C0] RAX: ffffed100141336b RBX: ffffed100141336c RCX: ffffffff90c7aaa0 [ 1900.534575][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1900.534997][ C0] RBP: ffffed100141336b R08: 0000000000000000 R09: ffffed100141336b [ 1900.535414][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1900.535831][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1900.536258][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1900.536740][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1900.537089][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1900.537512][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1900.537937][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1900.538361][ C0] Call Trace: [ 1900.538543][ C0] [ 1900.538701][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1900.538975][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1900.539236][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1900.539525][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1900.539813][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1900.540118][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1900.540398][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1900.540722][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1900.540991][ C0] ? hrtimer_interrupt+0x31a/0x770 [ 1900.541266][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1900.541541][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1900.541866][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1900.542186][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1900.542517][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1900.542822][ C0] ? kasan_check_range+0x156/0x1c0 [ 1900.543098][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 1900.543391][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1900.543717][ C0] ? get_stack_info+0x36/0xc0 [ 1900.543975][ C0] ? lock_acquire+0x1c1/0x220 [ 1900.544232][ C0] ? lock_release+0x1d5/0x250 [ 1900.544487][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1900.544749][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1900.545035][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1900.545334][ C0] ? lock_acquire+0x1c1/0x220 [ 1900.545579][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1900.545828][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1900.546100][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1900.546353][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1900.546614][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1900.546890][ C0] ? __inet_lookup_established+0x341/0x610 [ 1900.547202][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1900.547494][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1900.547787][ C0] ip_local_deliver+0x19d/0x480 [ 1900.548047][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1900.548329][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1900.548594][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1900.548878][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1900.549144][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1900.549478][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1900.549754][ C0] ip_rcv+0x564/0x740 [ 1900.549970][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1900.550215][ C0] ? set_track_prepare+0x8a/0xd0 [ 1900.550481][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1900.550768][ C0] ? rest_init+0x153/0x260 [ 1900.551005][ C0] ? skb_clone+0x10b/0x330 [ 1900.551243][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1900.551581][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1900.551905][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1900.552199][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1900.552505][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1900.552763][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1900.553001][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1900.553315][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1900.553611][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1900.553954][ C0] ? lock_acquire+0x1c1/0x220 [ 1900.554208][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1900.554520][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1900.554816][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1900.555149][ C0] ? __copy_skb_header+0xaf/0x490 [ 1900.555421][ C0] ? __skb_clone+0x57a/0x760 [ 1900.555670][ C0] netif_receive_skb+0x55/0x280 [ 1900.555929][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1900.556256][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1900.556603][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1900.556922][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1900.557211][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1900.557512][ C0] ? hlock_class+0x4e/0x130 [ 1900.557760][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1900.558094][ C0] ? place_entity+0x21/0x2f0 [ 1900.558342][ C0] ? resched_curr+0x219/0x280 [ 1900.558592][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1900.558857][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1900.559137][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1900.559416][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1900.559675][ C0] ? activate_task+0xf5/0x260 [ 1900.559928][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1900.560206][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1900.560478][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1900.560742][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1900.561034][ C0] ? get_stack_info+0x36/0xc0 [ 1900.561286][ C0] ? stack_access_ok+0xda/0x1f0 [ 1900.561542][ C0] ? get_reg+0x119/0x190 [ 1900.561770][ C0] __tcf_classify+0x32c/0x7d0 [ 1900.562026][ C0] tcf_classify+0x283/0x930 [ 1900.562273][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1900.562607][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1900.562873][ C0] ? arch_stack_walk+0x8c/0x100 [ 1900.563135][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1900.563422][ C0] tc_run+0x2e4/0x5d0 [ 1900.563642][ C0] ? __pfx_tc_run+0x10/0x10 [ 1900.563886][ C0] ? lock_acquire+0x1c1/0x220 [ 1900.564138][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1900.564414][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1900.564679][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1900.564966][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1900.565246][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1900.565570][ C0] ? neigh_hh_output+0x348/0x590 [ 1900.565833][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1900.566115][ C0] ip_finish_output2+0x786/0x18e0 [ 1900.566385][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1900.566686][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1900.567045][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1900.567337][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1900.567601][ C0] ? __ip_finish_output+0x10f/0x770 [ 1900.567880][ C0] ip_output+0x16b/0x4f0 [ 1900.568108][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1900.568390][ C0] ? __pfx_ip_output+0x10/0x10 [ 1900.568648][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1900.568946][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1900.569210][ C0] ? ip_local_out+0x114/0x3b0 [ 1900.569457][ C0] __ip_queue_xmit+0x672/0x1910 [ 1900.569715][ C0] ? __skb_clone+0x57a/0x760 [ 1900.569960][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1900.570244][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1900.570540][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1900.570861][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1900.571120][ C0] ? tcp_current_mss+0x40a/0x510 [ 1900.571386][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1900.571673][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1900.571951][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1900.572207][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1900.572474][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1900.572790][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1900.573070][ C0] ? ktime_get+0xb6/0x190 [ 1900.573306][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1900.573582][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1900.573862][ C0] tcp_write_timer+0x82/0x1d0 [ 1900.574118][ C0] call_timer_fn+0x176/0x430 [ 1900.574367][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1900.574640][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1900.574915][ C0] __run_timers.part.0+0x52d/0x890 [ 1900.575187][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1900.575476][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1900.575773][ C0] ? lock_acquire+0x1c1/0x220 [ 1900.576026][ C0] ? clockevents_program_event+0xf6/0x300 [ 1900.576336][ C0] ? lock_release+0x1d5/0x250 [ 1900.576588][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1900.576873][ C0] ? ktime_get+0xb6/0x190 [ 1900.577103][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1900.577401][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1900.577718][ C0] run_timer_softirq+0x72/0x100 [ 1900.577974][ C0] __do_softirq+0x1bc/0x7ff [ 1900.578216][ C0] irq_exit_rcu+0x98/0xc0 [ 1900.578447][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1900.578745][ C0] [ 1900.578905][ C0] [ 1900.579067][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1900.579393][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1900.579661][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1900.580675][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1900.580994][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1900.581416][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1900.581834][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1900.582252][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1900.582667][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1900.583087][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1900.583388][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1900.583659][ C0] default_idle_call+0x69/0xa0 [ 1900.583916][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1900.584177][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1900.584469][ C0] ? lock_release+0x1d5/0x250 [ 1900.584716][ C0] do_idle+0xfb/0x160 [ 1900.584927][ C0] cpu_startup_entry+0x55/0x60 [ 1900.585179][ C0] rest_init+0x153/0x260 [ 1900.585408][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1900.585693][ C0] arch_call_rest_init+0x13/0x40 [ 1900.585955][ C0] start_kernel+0x314/0x3d0 [ 1900.586200][ C0] x86_64_start_reservations+0x18/0x30 [ 1900.586492][ C0] x86_64_start_kernel+0xba/0x110 [ 1900.586767][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1900.587095][ C0] [ 1900.587264][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 664s! [ksoftirqd/1:22] [ 1900.587738][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1900.588936][ C1] irq event stamp: 3886976 [ 1900.589172][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 1900.589674][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 1900.590174][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 1900.590678][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 1900.591172][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1900.591674][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1900.592332][ C1] RIP: 0010:kasan_check_range+0x4/0x1c0 [ 1900.592639][ C1] Code: 6a 00 5b 5d 41 5c 41 5d c3 cc cc cc cc 66 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 <48> 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 [ 1900.593681][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000246 [ 1900.594012][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1900.594440][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1900.594867][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1900.595298][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1900.595727][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1900.596155][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1900.596632][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1900.596999][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1900.597425][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1900.597847][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1900.598273][ C1] Call Trace: [ 1900.598457][ C1] [ 1900.598617][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1900.598896][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1900.599156][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1900.599449][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1900.599741][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1900.600052][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1900.600336][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1900.600662][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1900.600940][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1900.601269][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1900.601585][ C1] [ 1900.601742][ C1] [ 1900.601900][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1900.602235][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1900.602544][ C1] ? kasan_check_range+0x4/0x1c0 [ 1900.602816][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 1900.603114][ C1] ? run_ksoftirqd+0xb/0x60 [ 1900.603359][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1900.603686][ C1] ? __orc_find+0x9c/0xf0 [ 1900.603922][ C1] ? lock_acquire+0x1c1/0x220 [ 1900.604176][ C1] ? irqentry_enter+0x2b/0x60 [ 1900.604430][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1900.604694][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1900.604983][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1900.605288][ C1] ? lock_acquire+0x1c1/0x220 [ 1900.605539][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1900.605796][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1900.606073][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1900.606324][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1900.606585][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1900.606865][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1900.607156][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1900.607447][ C1] ip_local_deliver+0x19d/0x480 [ 1900.607708][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1900.607995][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1900.608262][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1900.608539][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1900.608803][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1900.609143][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1900.609421][ C1] ip_rcv+0x564/0x740 [ 1900.609637][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1900.609877][ C1] ? set_track_prepare+0x8a/0xd0 [ 1900.610149][ C1] ? irqentry_enter+0x2b/0x60 [ 1900.610405][ C1] ? irqentry_enter+0x2b/0x60 [ 1900.610662][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1900.610908][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1900.611228][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1900.611576][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1900.611893][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1900.612237][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1900.612537][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1900.612902][ C1] netif_receive_skb+0x55/0x280 [ 1900.613168][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1900.613503][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1900.613859][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1900.614177][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1900.614471][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1900.614780][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1900.615117][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1900.615404][ C1] ? arch_stack_walk+0x68/0x100 [ 1900.615668][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1900.615947][ C1] ? irqentry_enter+0x2b/0x60 [ 1900.616204][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1900.616527][ C1] ? irqentry_enter+0x2b/0x60 [ 1900.616814][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1900.617139][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1900.617424][ C1] ? arch_stack_walk+0x68/0x100 [ 1900.617686][ C1] __tcf_classify+0x32c/0x7d0 [ 1900.617941][ C1] tcf_classify+0x283/0x930 [ 1900.618186][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1900.618456][ C1] tc_run+0x2e4/0x5d0 [ 1900.618675][ C1] ? __pfx_tc_run+0x10/0x10 [ 1900.618920][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1900.619192][ C1] ? irqentry_enter+0x2b/0x60 [ 1900.619450][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1900.619742][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1900.620068][ C1] ip_finish_output2+0x786/0x18e0 [ 1900.620341][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1900.620633][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1900.620902][ C1] ? __ip_finish_output+0x10f/0x770 [ 1900.621182][ C1] ip_output+0x16b/0x4f0 [ 1900.621412][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1900.621735][ C1] ? __pfx_ip_output+0x10/0x10 [ 1900.621992][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1900.622352][ C1] ? __pfx_ip_output+0x10/0x10 [ 1900.622612][ C1] __ip_queue_xmit+0x672/0x1910 [ 1900.622874][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1900.623158][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1900.623454][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1900.623742][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1900.624042][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1900.624330][ C1] tcp_delack_timer+0x84/0x240 [ 1900.624588][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1900.624877][ C1] call_timer_fn+0x176/0x430 [ 1900.625131][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1900.625405][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1900.625686][ C1] __run_timers.part.0+0x52d/0x890 [ 1900.625962][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1900.626251][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1900.626552][ C1] ? __pfx___schedule+0x10/0x10 [ 1900.626819][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1900.627143][ C1] run_timer_softirq+0x72/0x100 [ 1900.627407][ C1] __do_softirq+0x1bc/0x7ff [ 1900.627655][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1900.627932][ C1] run_ksoftirqd+0x2e/0x60 [ 1900.628171][ C1] smpboot_thread_fn+0x30e/0x840 [ 1900.628438][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1900.628727][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1900.629023][ C1] kthread+0x292/0x360 [ 1900.629242][ C1] ? __pfx_kthread+0x10/0x10 [ 1900.629491][ C1] ret_from_fork+0x34/0x70 [ 1900.629731][ C1] ? __pfx_kthread+0x10/0x10 [ 1900.629979][ C1] ret_from_fork_asm+0x1b/0x30 [ 1900.630243][ C1] [ 1922.980023][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 1922.980408][ C0] rcu: 0-....: (729152 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=177296 [ 1922.980915][ C0] rcu: (t=728671 jiffies g=1007429 q=31 ncpus=4) [ 1922.981254][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1922.981732][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1922.982381][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1922.982727][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1922.983747][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1922.984074][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1922.984497][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1922.984918][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1922.985347][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1922.985765][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1922.986186][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1922.986662][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1922.987011][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1922.987429][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1922.987848][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1922.988271][ C0] Call Trace: [ 1922.988457][ C0] [ 1922.988613][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 1922.988898][ C0] ? print_cpu_stall+0x263/0x6a0 [ 1922.989168][ C0] ? check_cpu_stall+0x284/0x500 [ 1922.989429][ C0] ? rcu_pending+0x92/0x360 [ 1922.989672][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 1922.989957][ C0] ? update_process_times+0xb9/0x110 [ 1922.990245][ C0] ? tick_sched_handle+0x67/0x130 [ 1922.990516][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 1922.990816][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1922.991070][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 1922.991397][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1922.991681][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1922.991980][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1922.992257][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1922.992574][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1922.992850][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1922.993125][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1922.993449][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1922.993761][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1922.994092][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1922.994396][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1922.994709][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1922.995009][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1922.995334][ C0] ? get_stack_info+0x36/0xc0 [ 1922.995589][ C0] ? lock_acquire+0x1c1/0x220 [ 1922.995842][ C0] ? lock_release+0x1d5/0x250 [ 1922.996095][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1922.996356][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1922.996650][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1922.996944][ C0] ? lock_acquire+0x1c1/0x220 [ 1922.997197][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1922.997453][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1922.997727][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1922.997970][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1922.998227][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1922.998495][ C0] ? __inet_lookup_established+0x341/0x610 [ 1922.998804][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1922.999095][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1922.999386][ C0] ip_local_deliver+0x19d/0x480 [ 1922.999644][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1922.999923][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1923.000187][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1923.000466][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1923.000732][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1923.001065][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1923.001341][ C0] ip_rcv+0x564/0x740 [ 1923.001563][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1923.001806][ C0] ? set_track_prepare+0x8a/0xd0 [ 1923.002075][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1923.002362][ C0] ? rest_init+0x153/0x260 [ 1923.002600][ C0] ? skb_clone+0x10b/0x330 [ 1923.002838][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1923.003174][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1923.003497][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1923.003797][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1923.004104][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1923.004366][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1923.004608][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1923.004919][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1923.005215][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1923.005558][ C0] ? lock_acquire+0x1c1/0x220 [ 1923.005811][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1923.006121][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1923.006416][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1923.006751][ C0] ? __copy_skb_header+0xaf/0x490 [ 1923.007016][ C0] ? __skb_clone+0x57a/0x760 [ 1923.007264][ C0] netif_receive_skb+0x55/0x280 [ 1923.007524][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1923.007855][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1923.008206][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1923.008517][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1923.008808][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1923.009113][ C0] ? hlock_class+0x4e/0x130 [ 1923.009361][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1923.009691][ C0] ? place_entity+0x21/0x2f0 [ 1923.009939][ C0] ? resched_curr+0x219/0x280 [ 1923.010188][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1923.010455][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1923.010735][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1923.011014][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1923.011275][ C0] ? activate_task+0xf5/0x260 [ 1923.011529][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1923.011807][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1923.012080][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1923.012342][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1923.012633][ C0] ? get_stack_info+0x36/0xc0 [ 1923.012881][ C0] ? stack_access_ok+0xda/0x1f0 [ 1923.013137][ C0] ? get_reg+0x119/0x190 [ 1923.013363][ C0] __tcf_classify+0x32c/0x7d0 [ 1923.013616][ C0] tcf_classify+0x283/0x930 [ 1923.013861][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1923.014192][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1923.014456][ C0] ? arch_stack_walk+0x8c/0x100 [ 1923.014714][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1923.015001][ C0] tc_run+0x2e4/0x5d0 [ 1923.015225][ C0] ? __pfx_tc_run+0x10/0x10 [ 1923.015471][ C0] ? lock_acquire+0x1c1/0x220 [ 1923.015724][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1923.016001][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1923.016270][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1923.016563][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1923.016838][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1923.017159][ C0] ? neigh_hh_output+0x348/0x590 [ 1923.017425][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1923.017701][ C0] ip_finish_output2+0x786/0x18e0 [ 1923.017966][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1923.018257][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1923.018611][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1923.018902][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1923.019164][ C0] ? __ip_finish_output+0x10f/0x770 [ 1923.019444][ C0] ip_output+0x16b/0x4f0 [ 1923.019673][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1923.019956][ C0] ? __pfx_ip_output+0x10/0x10 [ 1923.020214][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1923.020512][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1923.020777][ C0] ? ip_local_out+0x114/0x3b0 [ 1923.021027][ C0] __ip_queue_xmit+0x672/0x1910 [ 1923.021288][ C0] ? __skb_clone+0x57a/0x760 [ 1923.021536][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1923.021819][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1923.022120][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1923.022438][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1923.022693][ C0] ? tcp_current_mss+0x40a/0x510 [ 1923.022964][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1923.023246][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1923.023525][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1923.023783][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1923.024054][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1923.024374][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1923.024653][ C0] ? ktime_get+0xb6/0x190 [ 1923.024889][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1923.025166][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1923.025447][ C0] tcp_write_timer+0x82/0x1d0 [ 1923.025702][ C0] call_timer_fn+0x176/0x430 [ 1923.025955][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1923.026233][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1923.026508][ C0] __run_timers.part.0+0x52d/0x890 [ 1923.026788][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1923.027070][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1923.027370][ C0] ? lock_acquire+0x1c1/0x220 [ 1923.027620][ C0] ? clockevents_program_event+0xf6/0x300 [ 1923.027922][ C0] ? lock_release+0x1d5/0x250 [ 1923.028174][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1923.028452][ C0] ? ktime_get+0xb6/0x190 [ 1923.028682][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1923.028979][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1923.029293][ C0] run_timer_softirq+0x72/0x100 [ 1923.029552][ C0] __do_softirq+0x1bc/0x7ff [ 1923.029793][ C0] irq_exit_rcu+0x98/0xc0 [ 1923.030024][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1923.030322][ C0] [ 1923.030482][ C0] [ 1923.030641][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1923.030965][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1923.031233][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1923.032251][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1923.032573][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1923.032993][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1923.033412][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1923.033829][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1923.034246][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1923.034669][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1923.034972][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1923.035244][ C0] default_idle_call+0x69/0xa0 [ 1923.035500][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1923.035761][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1923.036053][ C0] ? lock_release+0x1d5/0x250 [ 1923.036301][ C0] do_idle+0xfb/0x160 [ 1923.036514][ C0] cpu_startup_entry+0x55/0x60 [ 1923.036777][ C0] rest_init+0x153/0x260 [ 1923.037002][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1923.037292][ C0] arch_call_rest_init+0x13/0x40 [ 1923.037560][ C0] start_kernel+0x314/0x3d0 [ 1923.037800][ C0] x86_64_start_reservations+0x18/0x30 [ 1923.038090][ C0] x86_64_start_kernel+0xba/0x110 [ 1923.038362][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1923.038694][ C0] [ 1923.038861][ C0] Sending NMI from CPU 0 to CPUs 1: [ 1923.039152][ C1] NMI backtrace for cpu 1 [ 1923.039159][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1923.039164][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1923.039167][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1923.039177][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1923.039180][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1923.039184][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1923.039186][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1923.039187][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1923.039189][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1923.039191][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1923.039193][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1923.039195][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1923.039199][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1923.039201][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1923.039202][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1923.039204][ C1] Call Trace: [ 1923.039207][ C1] [ 1923.039212][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 1923.039219][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 1923.039225][ C1] ? nmi_handle+0x156/0x420 [ 1923.039231][ C1] ? default_do_nmi+0x41/0x100 [ 1923.039235][ C1] ? exc_nmi+0xf3/0x120 [ 1923.039238][ C1] ? end_repeat_nmi+0xf/0x60 [ 1923.039243][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1923.039247][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1923.039251][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1923.039254][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1923.039257][ C1] [ 1923.039258][ C1] [ 1923.039259][ C1] ? run_ksoftirqd+0xb/0x60 [ 1923.039264][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1923.039267][ C1] ? __orc_find+0x9c/0xf0 [ 1923.039271][ C1] ? lock_acquire+0x1c1/0x220 [ 1923.039275][ C1] ? irqentry_enter+0x2b/0x60 [ 1923.039280][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1923.039285][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1923.039288][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1923.039291][ C1] ? lock_acquire+0x1c1/0x220 [ 1923.039294][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1923.039300][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1923.039303][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1923.039311][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1923.039314][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1923.039320][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1923.039328][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1923.039332][ C1] ip_local_deliver+0x19d/0x480 [ 1923.039335][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1923.039337][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1923.039342][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1923.039346][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1923.039349][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1923.039353][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1923.039363][ C1] ip_rcv+0x564/0x740 [ 1923.039366][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1923.039369][ C1] ? set_track_prepare+0x8a/0xd0 [ 1923.039375][ C1] ? irqentry_enter+0x2b/0x60 [ 1923.039378][ C1] ? irqentry_enter+0x2b/0x60 [ 1923.039382][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1923.039384][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1923.039389][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1923.039392][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1923.039395][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1923.039398][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1923.039401][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1923.039406][ C1] netif_receive_skb+0x55/0x280 [ 1923.039409][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1923.039420][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1923.039427][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1923.039434][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1923.039441][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1923.039453][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1923.039463][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1923.039465][ C1] ? arch_stack_walk+0x68/0x100 [ 1923.039471][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1923.039474][ C1] ? irqentry_enter+0x2b/0x60 [ 1923.039478][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1923.039483][ C1] ? irqentry_enter+0x2b/0x60 [ 1923.039486][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1923.039494][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1923.039496][ C1] ? arch_stack_walk+0x68/0x100 [ 1923.039500][ C1] __tcf_classify+0x32c/0x7d0 [ 1923.039505][ C1] tcf_classify+0x283/0x930 [ 1923.039509][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1923.039514][ C1] tc_run+0x2e4/0x5d0 [ 1923.039518][ C1] ? __pfx_tc_run+0x10/0x10 [ 1923.039523][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1923.039529][ C1] ? irqentry_enter+0x2b/0x60 [ 1923.039532][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1923.039535][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1923.039542][ C1] ip_finish_output2+0x786/0x18e0 [ 1923.039547][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1923.039550][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1923.039554][ C1] ? __ip_finish_output+0x10f/0x770 [ 1923.039558][ C1] ip_output+0x16b/0x4f0 [ 1923.039561][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1923.039565][ C1] ? __pfx_ip_output+0x10/0x10 [ 1923.039569][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1923.039576][ C1] ? __pfx_ip_output+0x10/0x10 [ 1923.039581][ C1] __ip_queue_xmit+0x672/0x1910 [ 1923.039587][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1923.039594][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1923.039598][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1923.039602][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1923.039606][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1923.039609][ C1] tcp_delack_timer+0x84/0x240 [ 1923.039613][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1923.039615][ C1] call_timer_fn+0x176/0x430 [ 1923.039620][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1923.039625][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1923.039629][ C1] __run_timers.part.0+0x52d/0x890 [ 1923.039633][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1923.039638][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1923.039643][ C1] ? __pfx___schedule+0x10/0x10 [ 1923.039646][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1923.039651][ C1] run_timer_softirq+0x72/0x100 [ 1923.039655][ C1] __do_softirq+0x1bc/0x7ff [ 1923.039659][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1923.039662][ C1] run_ksoftirqd+0x2e/0x60 [ 1923.039666][ C1] smpboot_thread_fn+0x30e/0x840 [ 1923.039670][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1923.039674][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1923.039677][ C1] kthread+0x292/0x360 [ 1923.039679][ C1] ? __pfx_kthread+0x10/0x10 [ 1923.039682][ C1] ret_from_fork+0x34/0x70 [ 1923.039685][ C1] ? __pfx_kthread+0x10/0x10 [ 1923.039687][ C1] ret_from_fork_asm+0x1b/0x30 [ 1923.039695][ C1] [ 1939.629899][ T72] kmemleak: 6 new suspected memory leaks (see /sys/kernel/debug/kmemleak) [ 1948.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 708s! [swapper/0:0] [ 1948.527917][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1948.529111][ C0] irq event stamp: 27567077 [ 1948.529349][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 1948.529880][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 1948.530356][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 1948.530866][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 1948.531364][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1948.531844][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1948.532484][ C0] RIP: 0010:__kasan_check_read+0x0/0x20 [ 1948.532776][ C0] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 1948.533789][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000202 [ 1948.534110][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1948.534527][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1948.534948][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1948.535370][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1948.535792][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1948.536212][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1948.536698][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1948.537051][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1948.537481][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1948.537905][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1948.538329][ C0] Call Trace: [ 1948.538511][ C0] [ 1948.538668][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1948.538949][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1948.539206][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1948.539503][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1948.539791][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1948.540101][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1948.540381][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1948.540704][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1948.540984][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1948.541263][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1948.541594][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1948.541911][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1948.542247][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1948.542555][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 1948.542855][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 1948.543160][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1948.543490][ C0] ? get_stack_info+0x36/0xc0 [ 1948.543746][ C0] ? lock_acquire+0x1c1/0x220 [ 1948.543999][ C0] ? lock_release+0x1d5/0x250 [ 1948.544252][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1948.544512][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1948.544799][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1948.545098][ C0] ? lock_acquire+0x1c1/0x220 [ 1948.545350][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1948.545606][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1948.545883][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1948.546130][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1948.546389][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1948.546667][ C0] ? __inet_lookup_established+0x341/0x610 [ 1948.546987][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1948.547277][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1948.547569][ C0] ip_local_deliver+0x19d/0x480 [ 1948.547832][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1948.548122][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1948.548390][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1948.548665][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1948.548928][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1948.549271][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1948.549546][ C0] ip_rcv+0x564/0x740 [ 1948.549759][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1948.550000][ C0] ? set_track_prepare+0x8a/0xd0 [ 1948.550262][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1948.550556][ C0] ? rest_init+0x153/0x260 [ 1948.550792][ C0] ? skb_clone+0x10b/0x330 [ 1948.551037][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1948.551372][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1948.551694][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1948.551999][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1948.552314][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1948.552578][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1948.552830][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1948.553155][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1948.553459][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1948.553800][ C0] ? lock_acquire+0x1c1/0x220 [ 1948.554049][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1948.554362][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1948.554666][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1948.554999][ C0] ? __copy_skb_header+0xaf/0x490 [ 1948.555268][ C0] ? __skb_clone+0x57a/0x760 [ 1948.555514][ C0] netif_receive_skb+0x55/0x280 [ 1948.555782][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1948.556116][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1948.556484][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1948.556802][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1948.557089][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1948.557387][ C0] ? hlock_class+0x4e/0x130 [ 1948.557632][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1948.557964][ C0] ? place_entity+0x21/0x2f0 [ 1948.558214][ C0] ? resched_curr+0x219/0x280 [ 1948.558472][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1948.558744][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1948.559031][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1948.559310][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1948.559569][ C0] ? activate_task+0xf5/0x260 [ 1948.559820][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1948.560097][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1948.560374][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1948.560633][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1948.560929][ C0] ? get_stack_info+0x36/0xc0 [ 1948.561188][ C0] ? stack_access_ok+0xda/0x1f0 [ 1948.561452][ C0] ? get_reg+0x119/0x190 [ 1948.561682][ C0] __tcf_classify+0x32c/0x7d0 [ 1948.561937][ C0] tcf_classify+0x283/0x930 [ 1948.562180][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1948.562509][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1948.562787][ C0] ? arch_stack_walk+0x8c/0x100 [ 1948.563054][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1948.563348][ C0] tc_run+0x2e4/0x5d0 [ 1948.563561][ C0] ? __pfx_tc_run+0x10/0x10 [ 1948.563802][ C0] ? lock_acquire+0x1c1/0x220 [ 1948.564051][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1948.564325][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1948.564594][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1948.564878][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1948.565154][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1948.565474][ C0] ? neigh_hh_output+0x348/0x590 [ 1948.565743][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1948.566022][ C0] ip_finish_output2+0x786/0x18e0 [ 1948.566290][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1948.566591][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1948.566947][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1948.567239][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1948.567505][ C0] ? __ip_finish_output+0x10f/0x770 [ 1948.567781][ C0] ip_output+0x16b/0x4f0 [ 1948.568006][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1948.568292][ C0] ? __pfx_ip_output+0x10/0x10 [ 1948.568547][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1948.568850][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1948.569115][ C0] ? ip_local_out+0x114/0x3b0 [ 1948.569368][ C0] __ip_queue_xmit+0x672/0x1910 [ 1948.569631][ C0] ? __skb_clone+0x57a/0x760 [ 1948.569880][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1948.570161][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1948.570453][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1948.570768][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1948.571028][ C0] ? tcp_current_mss+0x40a/0x510 [ 1948.571290][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1948.571575][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1948.571851][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1948.572105][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1948.572379][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1948.572701][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1948.572977][ C0] ? ktime_get+0xb6/0x190 [ 1948.573213][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1948.573488][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1948.573775][ C0] tcp_write_timer+0x82/0x1d0 [ 1948.574026][ C0] call_timer_fn+0x176/0x430 [ 1948.574273][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1948.574552][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1948.574828][ C0] __run_timers.part.0+0x52d/0x890 [ 1948.575110][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1948.575393][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1948.575695][ C0] ? lock_acquire+0x1c1/0x220 [ 1948.575944][ C0] ? clockevents_program_event+0xf6/0x300 [ 1948.576251][ C0] ? lock_release+0x1d5/0x250 [ 1948.576511][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1948.576794][ C0] ? ktime_get+0xb6/0x190 [ 1948.577031][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1948.577335][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1948.577645][ C0] run_timer_softirq+0x72/0x100 [ 1948.577910][ C0] __do_softirq+0x1bc/0x7ff [ 1948.578160][ C0] irq_exit_rcu+0x98/0xc0 [ 1948.578396][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1948.578704][ C0] [ 1948.578862][ C0] [ 1948.579022][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1948.579345][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1948.579618][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1948.580653][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1948.580986][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1948.581411][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1948.581838][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1948.582266][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1948.582689][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1948.583117][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1948.583424][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1948.583699][ C0] default_idle_call+0x69/0xa0 [ 1948.583951][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1948.584220][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1948.584510][ C0] ? lock_release+0x1d5/0x250 [ 1948.584763][ C0] do_idle+0xfb/0x160 [ 1948.584977][ C0] cpu_startup_entry+0x55/0x60 [ 1948.585234][ C0] rest_init+0x153/0x260 [ 1948.585459][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1948.585753][ C0] arch_call_rest_init+0x13/0x40 [ 1948.586020][ C0] start_kernel+0x314/0x3d0 [ 1948.586262][ C0] x86_64_start_reservations+0x18/0x30 [ 1948.586561][ C0] x86_64_start_kernel+0xba/0x110 [ 1948.586827][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1948.587152][ C0] [ 1948.587316][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 708s! [ksoftirqd/1:22] [ 1948.587788][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1948.588983][ C1] irq event stamp: 3886976 [ 1948.589221][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 1948.589726][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 1948.590229][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 1948.590736][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 1948.591228][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1948.591733][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1948.592382][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1948.592729][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1948.593764][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1948.594094][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1948.594521][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1948.594947][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1948.595370][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1948.595793][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1948.596220][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1948.596702][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1948.597054][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1948.597477][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1948.597905][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1948.598333][ C1] Call Trace: [ 1948.598516][ C1] [ 1948.598674][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1948.598953][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1948.599215][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1948.599508][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1948.599800][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1948.600107][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1948.600391][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1948.600718][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1948.600992][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1948.601321][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1948.601634][ C1] [ 1948.601790][ C1] [ 1948.601948][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1948.602277][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1948.602586][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1948.602898][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1948.603203][ C1] ? run_ksoftirqd+0xb/0x60 [ 1948.603446][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1948.603770][ C1] ? __orc_find+0x9c/0xf0 [ 1948.604004][ C1] ? lock_acquire+0x1c1/0x220 [ 1948.604260][ C1] ? irqentry_enter+0x2b/0x60 [ 1948.604515][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1948.604778][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1948.605065][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1948.605367][ C1] ? lock_acquire+0x1c1/0x220 [ 1948.605618][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1948.605875][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1948.606148][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1948.606398][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1948.606665][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1948.606938][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1948.607229][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1948.607522][ C1] ip_local_deliver+0x19d/0x480 [ 1948.607785][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1948.608073][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1948.608339][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1948.608616][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1948.608879][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1948.609221][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1948.609496][ C1] ip_rcv+0x564/0x740 [ 1948.609708][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1948.609949][ C1] ? set_track_prepare+0x8a/0xd0 [ 1948.610214][ C1] ? irqentry_enter+0x2b/0x60 [ 1948.610470][ C1] ? irqentry_enter+0x2b/0x60 [ 1948.610726][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1948.610971][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1948.611293][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1948.611636][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1948.611949][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1948.612290][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1948.612590][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1948.612928][ C1] netif_receive_skb+0x55/0x280 [ 1948.613192][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1948.613528][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1948.613881][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1948.614198][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1948.614494][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1948.614803][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1948.615140][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1948.615426][ C1] ? arch_stack_walk+0x68/0x100 [ 1948.615690][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1948.615969][ C1] ? irqentry_enter+0x2b/0x60 [ 1948.616222][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1948.616547][ C1] ? irqentry_enter+0x2b/0x60 [ 1948.616799][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1948.617129][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1948.617414][ C1] ? arch_stack_walk+0x68/0x100 [ 1948.617675][ C1] __tcf_classify+0x32c/0x7d0 [ 1948.617929][ C1] tcf_classify+0x283/0x930 [ 1948.618175][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1948.618445][ C1] tc_run+0x2e4/0x5d0 [ 1948.618659][ C1] ? __pfx_tc_run+0x10/0x10 [ 1948.618903][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1948.619170][ C1] ? irqentry_enter+0x2b/0x60 [ 1948.619427][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1948.619718][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1948.620045][ C1] ip_finish_output2+0x786/0x18e0 [ 1948.620315][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1948.620607][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1948.620875][ C1] ? __ip_finish_output+0x10f/0x770 [ 1948.621153][ C1] ip_output+0x16b/0x4f0 [ 1948.621379][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1948.621702][ C1] ? __pfx_ip_output+0x10/0x10 [ 1948.621958][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1948.622318][ C1] ? __pfx_ip_output+0x10/0x10 [ 1948.622579][ C1] __ip_queue_xmit+0x672/0x1910 [ 1948.622842][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1948.623125][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1948.623421][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1948.623706][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1948.623999][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1948.624285][ C1] tcp_delack_timer+0x84/0x240 [ 1948.624540][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1948.624829][ C1] call_timer_fn+0x176/0x430 [ 1948.625082][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1948.625356][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1948.625638][ C1] __run_timers.part.0+0x52d/0x890 [ 1948.625912][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1948.626198][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1948.626508][ C1] ? __pfx___schedule+0x10/0x10 [ 1948.626769][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1948.627090][ C1] run_timer_softirq+0x72/0x100 [ 1948.627356][ C1] __do_softirq+0x1bc/0x7ff [ 1948.627603][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1948.627882][ C1] run_ksoftirqd+0x2e/0x60 [ 1948.628122][ C1] smpboot_thread_fn+0x30e/0x840 [ 1948.628391][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1948.628680][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1948.628971][ C1] kthread+0x292/0x360 [ 1948.629191][ C1] ? __pfx_kthread+0x10/0x10 [ 1948.629441][ C1] ret_from_fork+0x34/0x70 [ 1948.629679][ C1] ? __pfx_kthread+0x10/0x10 [ 1948.629927][ C1] ret_from_fork_asm+0x1b/0x30 [ 1948.630186][ C1] [ 1976.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 734s! [swapper/0:0] [ 1976.527922][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1976.529124][ C0] irq event stamp: 27567077 [ 1976.529367][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 1976.529900][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 1976.530374][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 1976.530875][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 1976.531366][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 1976.531842][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1976.532491][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1976.532833][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1976.533858][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 1976.534187][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1976.534608][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 1976.535028][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 1976.535452][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 1976.535878][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 1976.536307][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 1976.536774][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1976.537128][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 1976.537549][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1976.537967][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1976.538390][ C0] Call Trace: [ 1976.538572][ C0] [ 1976.538729][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1976.539003][ C0] ? __run_hrtimer+0x1c3/0x710 [ 1976.539261][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1976.539549][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 1976.539839][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1976.540148][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1976.540431][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1976.540754][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 1976.541027][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 1976.541306][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1976.541628][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 1976.541943][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1976.542281][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1976.542583][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1976.542891][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1976.543199][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1976.543527][ C0] ? get_stack_info+0x36/0xc0 [ 1976.543785][ C0] ? lock_acquire+0x1c1/0x220 [ 1976.544038][ C0] ? lock_release+0x1d5/0x250 [ 1976.544290][ C0] do_raw_spin_lock+0x1ec/0x270 [ 1976.544550][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1976.544834][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1976.545132][ C0] ? lock_acquire+0x1c1/0x220 [ 1976.545383][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 1976.545638][ C0] _raw_spin_lock_nested+0x65/0x80 [ 1976.545913][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 1976.546161][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1976.546433][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 1976.546706][ C0] ? __inet_lookup_established+0x341/0x610 [ 1976.547032][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 1976.547321][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 1976.547613][ C0] ip_local_deliver+0x19d/0x480 [ 1976.547874][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 1976.548164][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1976.548433][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 1976.548710][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1976.548972][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1976.549315][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1976.549591][ C0] ip_rcv+0x564/0x740 [ 1976.549804][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1976.550047][ C0] ? set_track_prepare+0x8a/0xd0 [ 1976.550312][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 1976.550608][ C0] ? rest_init+0x153/0x260 [ 1976.550844][ C0] ? skb_clone+0x10b/0x330 [ 1976.551091][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 1976.551426][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 1976.551749][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 1976.552054][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 1976.552366][ C0] ? __tcf_classify+0x32c/0x7d0 [ 1976.552629][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 1976.552876][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 1976.553200][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1976.553502][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1976.553843][ C0] ? lock_acquire+0x1c1/0x220 [ 1976.554092][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 1976.554403][ C0] netif_receive_skb_internal+0xb0/0x300 [ 1976.554706][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1976.555040][ C0] ? __copy_skb_header+0xaf/0x490 [ 1976.555313][ C0] ? __skb_clone+0x57a/0x760 [ 1976.555559][ C0] netif_receive_skb+0x55/0x280 [ 1976.555828][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1976.556161][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1976.556520][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1976.556835][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 1976.557126][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 1976.557430][ C0] ? hlock_class+0x4e/0x130 [ 1976.557679][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1976.558014][ C0] ? place_entity+0x21/0x2f0 [ 1976.558267][ C0] ? resched_curr+0x219/0x280 [ 1976.558520][ C0] ? __pfx_resched_curr+0x10/0x10 [ 1976.558788][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 1976.559070][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 1976.559352][ C0] ? wakeup_preempt+0x161/0x2c0 [ 1976.559615][ C0] ? activate_task+0xf5/0x260 [ 1976.559868][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 1976.560149][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 1976.560423][ C0] ? _raw_spin_unlock+0x23/0x40 [ 1976.560688][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1976.560980][ C0] ? get_stack_info+0x36/0xc0 [ 1976.561232][ C0] ? stack_access_ok+0xda/0x1f0 [ 1976.561490][ C0] ? get_reg+0x119/0x190 [ 1976.561718][ C0] __tcf_classify+0x32c/0x7d0 [ 1976.561973][ C0] tcf_classify+0x283/0x930 [ 1976.562221][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 1976.562550][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 1976.562814][ C0] ? arch_stack_walk+0x8c/0x100 [ 1976.563074][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 1976.563366][ C0] tc_run+0x2e4/0x5d0 [ 1976.563585][ C0] ? __pfx_tc_run+0x10/0x10 [ 1976.563830][ C0] ? lock_acquire+0x1c1/0x220 [ 1976.564081][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 1976.564358][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 1976.564623][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1976.564909][ C0] ? ip_finish_output2+0x786/0x18e0 [ 1976.565190][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1976.565512][ C0] ? neigh_hh_output+0x348/0x590 [ 1976.565776][ C0] ? ip_finish_output2+0x262/0x18e0 [ 1976.566059][ C0] ip_finish_output2+0x786/0x18e0 [ 1976.566331][ C0] ? stack_depot_save_flags+0x45/0x550 [ 1976.566621][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 1976.566979][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 1976.567274][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1976.567536][ C0] ? __ip_finish_output+0x10f/0x770 [ 1976.567816][ C0] ip_output+0x16b/0x4f0 [ 1976.568044][ C0] ? __run_timers.part.0+0x52d/0x890 [ 1976.568332][ C0] ? __pfx_ip_output+0x10/0x10 [ 1976.568592][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1976.568892][ C0] ? rcu_read_lock_held+0xe/0x50 [ 1976.569160][ C0] ? ip_local_out+0x114/0x3b0 [ 1976.569409][ C0] __ip_queue_xmit+0x672/0x1910 [ 1976.569670][ C0] ? __skb_clone+0x57a/0x760 [ 1976.569918][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 1976.570205][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1976.570504][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 1976.570830][ C0] tcp_write_xmit+0xe42/0x24c0 [ 1976.571089][ C0] ? tcp_current_mss+0x40a/0x510 [ 1976.571356][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 1976.571637][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 1976.571918][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 1976.572178][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 1976.572451][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1976.572770][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1976.573052][ C0] ? ktime_get+0xb6/0x190 [ 1976.573290][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 1976.573567][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1976.573849][ C0] tcp_write_timer+0x82/0x1d0 [ 1976.574107][ C0] call_timer_fn+0x176/0x430 [ 1976.574357][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 1976.574632][ C0] ? next_expiry_recalc+0xcd/0x220 [ 1976.574909][ C0] __run_timers.part.0+0x52d/0x890 [ 1976.575183][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 1976.575470][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 1976.575767][ C0] ? lock_acquire+0x1c1/0x220 [ 1976.576022][ C0] ? clockevents_program_event+0xf6/0x300 [ 1976.576342][ C0] ? lock_release+0x1d5/0x250 [ 1976.576595][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 1976.576872][ C0] ? ktime_get+0xb6/0x190 [ 1976.577106][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 1976.577407][ C0] ? clockevents_program_event+0x1ed/0x300 [ 1976.577719][ C0] run_timer_softirq+0x72/0x100 [ 1976.577981][ C0] __do_softirq+0x1bc/0x7ff [ 1976.578227][ C0] irq_exit_rcu+0x98/0xc0 [ 1976.578458][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 1976.578758][ C0] [ 1976.578918][ C0] [ 1976.579081][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1976.579407][ C0] RIP: 0010:default_idle+0xf/0x20 [ 1976.579676][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1976.580701][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 1976.581022][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 1976.581440][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 1976.581857][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 1976.582274][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 1976.582690][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 1976.583110][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 1976.583412][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 1976.583684][ C0] default_idle_call+0x69/0xa0 [ 1976.583943][ C0] cpuidle_idle_call+0x1f6/0x280 [ 1976.584207][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1976.584500][ C0] ? lock_release+0x1d5/0x250 [ 1976.584749][ C0] do_idle+0xfb/0x160 [ 1976.584960][ C0] cpu_startup_entry+0x55/0x60 [ 1976.585214][ C0] rest_init+0x153/0x260 [ 1976.585443][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 1976.585730][ C0] arch_call_rest_init+0x13/0x40 [ 1976.585994][ C0] start_kernel+0x314/0x3d0 [ 1976.586241][ C0] x86_64_start_reservations+0x18/0x30 [ 1976.586540][ C0] x86_64_start_kernel+0xba/0x110 [ 1976.586812][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 1976.587144][ C0] [ 1976.587314][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 734s! [ksoftirqd/1:22] [ 1976.587784][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 1976.588986][ C1] irq event stamp: 3886976 [ 1976.589226][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 1976.589730][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 1976.590233][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 1976.590736][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 1976.591230][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 1976.591732][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1976.592383][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 1976.592731][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 1976.593763][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 1976.594092][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 1976.594521][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 1976.594949][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 1976.595373][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 1976.595801][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 1976.596232][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 1976.596713][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1976.597069][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 1976.597493][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1976.597921][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 1976.598345][ C1] Call Trace: [ 1976.598525][ C1] [ 1976.598685][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 1976.598963][ C1] ? __run_hrtimer+0x1c3/0x710 [ 1976.599224][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 1976.599518][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 1976.599808][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 1976.600114][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 1976.600398][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 1976.600725][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 1976.601000][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 1976.601329][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 1976.601644][ C1] [ 1976.601801][ C1] [ 1976.601957][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1976.602289][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1976.602596][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 1976.602909][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 1976.603212][ C1] ? run_ksoftirqd+0xb/0x60 [ 1976.603457][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 1976.603781][ C1] ? __orc_find+0x9c/0xf0 [ 1976.604016][ C1] ? lock_acquire+0x1c1/0x220 [ 1976.604269][ C1] ? irqentry_enter+0x2b/0x60 [ 1976.604523][ C1] do_raw_spin_lock+0x1ec/0x270 [ 1976.604787][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1976.605077][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 1976.605379][ C1] ? lock_acquire+0x1c1/0x220 [ 1976.605631][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 1976.605885][ C1] _raw_spin_lock_nested+0x65/0x80 [ 1976.606159][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 1976.606413][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 1976.606672][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 1976.606943][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 1976.607233][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 1976.607525][ C1] ip_local_deliver+0x19d/0x480 [ 1976.607787][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 1976.608075][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1976.608344][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 1976.608620][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1976.608885][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 1976.609223][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 1976.609499][ C1] ip_rcv+0x564/0x740 [ 1976.609713][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1976.609954][ C1] ? set_track_prepare+0x8a/0xd0 [ 1976.610221][ C1] ? irqentry_enter+0x2b/0x60 [ 1976.610477][ C1] ? irqentry_enter+0x2b/0x60 [ 1976.610733][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 1976.610979][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 1976.611299][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1976.611642][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 1976.611958][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 1976.612299][ C1] netif_receive_skb_internal+0xb0/0x300 [ 1976.612598][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 1976.612938][ C1] netif_receive_skb+0x55/0x280 [ 1976.613201][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 1976.613533][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 1976.613889][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 1976.614203][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 1976.614495][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 1976.614802][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 1976.615138][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1976.615424][ C1] ? arch_stack_walk+0x68/0x100 [ 1976.615687][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 1976.615964][ C1] ? irqentry_enter+0x2b/0x60 [ 1976.616217][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1976.616544][ C1] ? irqentry_enter+0x2b/0x60 [ 1976.616793][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1976.617115][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 1976.617400][ C1] ? arch_stack_walk+0x68/0x100 [ 1976.617661][ C1] __tcf_classify+0x32c/0x7d0 [ 1976.617912][ C1] tcf_classify+0x283/0x930 [ 1976.618155][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 1976.618425][ C1] tc_run+0x2e4/0x5d0 [ 1976.618641][ C1] ? __pfx_tc_run+0x10/0x10 [ 1976.618884][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 1976.619153][ C1] ? irqentry_enter+0x2b/0x60 [ 1976.619410][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 1976.619700][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1976.620025][ C1] ip_finish_output2+0x786/0x18e0 [ 1976.620295][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 1976.620586][ C1] ? rcu_read_lock_held+0xe/0x50 [ 1976.620852][ C1] ? __ip_finish_output+0x10f/0x770 [ 1976.621132][ C1] ip_output+0x16b/0x4f0 [ 1976.621360][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1976.621681][ C1] ? __pfx_ip_output+0x10/0x10 [ 1976.621936][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 1976.622292][ C1] ? __pfx_ip_output+0x10/0x10 [ 1976.622550][ C1] __ip_queue_xmit+0x672/0x1910 [ 1976.622810][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 1976.623090][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 1976.623383][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 1976.623668][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 1976.623963][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1976.624250][ C1] tcp_delack_timer+0x84/0x240 [ 1976.624507][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1976.624796][ C1] call_timer_fn+0x176/0x430 [ 1976.625048][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1976.625322][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 1976.625602][ C1] __run_timers.part.0+0x52d/0x890 [ 1976.625877][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 1976.626165][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 1976.626471][ C1] ? __pfx___schedule+0x10/0x10 [ 1976.626734][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 1976.627057][ C1] run_timer_softirq+0x72/0x100 [ 1976.627320][ C1] __do_softirq+0x1bc/0x7ff [ 1976.627568][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 1976.627843][ C1] run_ksoftirqd+0x2e/0x60 [ 1976.628084][ C1] smpboot_thread_fn+0x30e/0x840 [ 1976.628351][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1976.628640][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 1976.628934][ C1] kthread+0x292/0x360 [ 1976.629155][ C1] ? __pfx_kthread+0x10/0x10 [ 1976.629405][ C1] ret_from_fork+0x34/0x70 [ 1976.629642][ C1] ? __pfx_kthread+0x10/0x10 [ 1976.629891][ C1] ret_from_fork_asm+0x1b/0x30 [ 1976.630150][ C1] [ 2001.043024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 2001.043418][ C1] rcu: 1-....: (806232 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=196582 [ 2001.043999][ C1] rcu: (t=806734 jiffies g=1007429 q=31 ncpus=4) [ 2001.044338][ C1] Sending NMI from CPU 1 to CPUs 0: [ 2001.044624][ C0] NMI backtrace for cpu 0 [ 2001.044631][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2001.044635][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2001.044638][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2001.044647][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2001.044650][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2001.044654][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2001.044656][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2001.044658][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2001.044659][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2001.044661][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2001.044663][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2001.044666][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2001.044670][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2001.044672][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2001.044673][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2001.044675][ C0] Call Trace: [ 2001.044678][ C0] [ 2001.044681][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 2001.044687][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 2001.044692][ C0] ? nmi_handle+0x156/0x420 [ 2001.044698][ C0] ? default_do_nmi+0x41/0x100 [ 2001.044702][ C0] ? exc_nmi+0xf3/0x120 [ 2001.044705][ C0] ? end_repeat_nmi+0xf/0x60 [ 2001.044710][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2001.044713][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2001.044717][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2001.044721][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2001.044724][ C0] [ 2001.044725][ C0] [ 2001.044726][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2001.044729][ C0] ? get_stack_info+0x36/0xc0 [ 2001.044734][ C0] ? lock_acquire+0x1c1/0x220 [ 2001.044739][ C0] ? lock_release+0x1d5/0x250 [ 2001.044742][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2001.044747][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2001.044749][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2001.044753][ C0] ? lock_acquire+0x1c1/0x220 [ 2001.044755][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2001.044760][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2001.044764][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2001.044771][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2001.044774][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2001.044777][ C0] ? __inet_lookup_established+0x341/0x610 [ 2001.044783][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2001.044791][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2001.044795][ C0] ip_local_deliver+0x19d/0x480 [ 2001.044798][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2001.044800][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2001.044805][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2001.044809][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2001.044812][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2001.044815][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2001.044826][ C0] ip_rcv+0x564/0x740 [ 2001.044829][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2001.044832][ C0] ? set_track_prepare+0x8a/0xd0 [ 2001.044838][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2001.044840][ C0] ? rest_init+0x153/0x260 [ 2001.044842][ C0] ? skb_clone+0x10b/0x330 [ 2001.044848][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2001.044855][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2001.044861][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2001.044866][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2001.044875][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2001.044879][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2001.044882][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2001.044886][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2001.044889][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2001.044893][ C0] ? lock_acquire+0x1c1/0x220 [ 2001.044895][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2001.044898][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2001.044901][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2001.044904][ C0] ? __copy_skb_header+0xaf/0x490 [ 2001.044907][ C0] ? __skb_clone+0x57a/0x760 [ 2001.044910][ C0] netif_receive_skb+0x55/0x280 [ 2001.044912][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2001.044921][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2001.044928][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2001.044935][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2001.044940][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2001.044949][ C0] ? hlock_class+0x4e/0x130 [ 2001.044955][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2001.044965][ C0] ? place_entity+0x21/0x2f0 [ 2001.044969][ C0] ? resched_curr+0x219/0x280 [ 2001.044972][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2001.044975][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2001.044979][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2001.044984][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2001.044986][ C0] ? activate_task+0xf5/0x260 [ 2001.044990][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2001.044995][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2001.044998][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2001.045002][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2001.045005][ C0] ? get_stack_info+0x36/0xc0 [ 2001.045009][ C0] ? stack_access_ok+0xda/0x1f0 [ 2001.045011][ C0] ? get_reg+0x119/0x190 [ 2001.045015][ C0] __tcf_classify+0x32c/0x7d0 [ 2001.045021][ C0] tcf_classify+0x283/0x930 [ 2001.045024][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2001.045029][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2001.045031][ C0] ? arch_stack_walk+0x8c/0x100 [ 2001.045035][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2001.045038][ C0] tc_run+0x2e4/0x5d0 [ 2001.045043][ C0] ? __pfx_tc_run+0x10/0x10 [ 2001.045046][ C0] ? lock_acquire+0x1c1/0x220 [ 2001.045048][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2001.045053][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2001.045059][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2001.045062][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2001.045065][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2001.045070][ C0] ? neigh_hh_output+0x348/0x590 [ 2001.045074][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2001.045078][ C0] ip_finish_output2+0x786/0x18e0 [ 2001.045081][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2001.045088][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2001.045095][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2001.045098][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2001.045102][ C0] ? __ip_finish_output+0x10f/0x770 [ 2001.045106][ C0] ip_output+0x16b/0x4f0 [ 2001.045109][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2001.045114][ C0] ? __pfx_ip_output+0x10/0x10 [ 2001.045117][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2001.045121][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2001.045124][ C0] ? ip_local_out+0x114/0x3b0 [ 2001.045128][ C0] __ip_queue_xmit+0x672/0x1910 [ 2001.045132][ C0] ? __skb_clone+0x57a/0x760 [ 2001.045135][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2001.045143][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2001.045147][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2001.045151][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2001.045156][ C0] ? tcp_current_mss+0x40a/0x510 [ 2001.045159][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2001.045162][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2001.045165][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2001.045167][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2001.045170][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2001.045173][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2001.045178][ C0] ? ktime_get+0xb6/0x190 [ 2001.045182][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2001.045186][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2001.045190][ C0] tcp_write_timer+0x82/0x1d0 [ 2001.045193][ C0] call_timer_fn+0x176/0x430 [ 2001.045197][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2001.045201][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2001.045206][ C0] __run_timers.part.0+0x52d/0x890 [ 2001.045209][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2001.045213][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2001.045216][ C0] ? lock_acquire+0x1c1/0x220 [ 2001.045219][ C0] ? clockevents_program_event+0xf6/0x300 [ 2001.045225][ C0] ? lock_release+0x1d5/0x250 [ 2001.045227][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2001.045230][ C0] ? ktime_get+0xb6/0x190 [ 2001.045233][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2001.045237][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2001.045241][ C0] run_timer_softirq+0x72/0x100 [ 2001.045245][ C0] __do_softirq+0x1bc/0x7ff [ 2001.045249][ C0] irq_exit_rcu+0x98/0xc0 [ 2001.045252][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2001.045256][ C0] [ 2001.045257][ C0] [ 2001.045258][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2001.045263][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2001.045266][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2001.045268][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2001.045270][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2001.045272][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2001.045274][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2001.045275][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2001.045277][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2001.045281][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2001.045284][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2001.045288][ C0] default_idle_call+0x69/0xa0 [ 2001.045290][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2001.045293][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2001.045299][ C0] ? lock_release+0x1d5/0x250 [ 2001.045303][ C0] do_idle+0xfb/0x160 [ 2001.045305][ C0] cpu_startup_entry+0x55/0x60 [ 2001.045308][ C0] rest_init+0x153/0x260 [ 2001.045310][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2001.045316][ C0] arch_call_rest_init+0x13/0x40 [ 2001.045321][ C0] start_kernel+0x314/0x3d0 [ 2001.045325][ C0] x86_64_start_reservations+0x18/0x30 [ 2001.045331][ C0] x86_64_start_kernel+0xba/0x110 [ 2001.045334][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2001.045342][ C0] [ 2001.045620][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2001.099918][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2001.100571][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2001.100916][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2001.101940][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2001.102266][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2001.102687][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2001.103108][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2001.103529][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2001.103948][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2001.104368][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2001.104840][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2001.105194][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2001.105615][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2001.106038][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2001.106466][ C1] Call Trace: [ 2001.106645][ C1] [ 2001.106802][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 2001.107097][ C1] ? print_cpu_stall+0x263/0x6a0 [ 2001.107362][ C1] ? check_cpu_stall+0x284/0x500 [ 2001.107630][ C1] ? rcu_pending+0x92/0x360 [ 2001.107872][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 2001.108158][ C1] ? update_process_times+0xb9/0x110 [ 2001.108445][ C1] ? tick_sched_handle+0x67/0x130 [ 2001.108718][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 2001.109016][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2001.109277][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 2001.109605][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2001.109897][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2001.110206][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2001.110490][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2001.110813][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2001.111089][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2001.111419][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2001.111732][ C1] [ 2001.111890][ C1] [ 2001.112048][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2001.112380][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2001.112688][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2001.113006][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2001.113310][ C1] ? run_ksoftirqd+0xb/0x60 [ 2001.113551][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2001.113878][ C1] ? __orc_find+0x9c/0xf0 [ 2001.114111][ C1] ? lock_acquire+0x1c1/0x220 [ 2001.114371][ C1] ? irqentry_enter+0x2b/0x60 [ 2001.114628][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2001.114893][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2001.115182][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2001.115482][ C1] ? lock_acquire+0x1c1/0x220 [ 2001.115729][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2001.115979][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2001.116257][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2001.116506][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2001.116764][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2001.117035][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2001.117323][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2001.117612][ C1] ip_local_deliver+0x19d/0x480 [ 2001.117877][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2001.118167][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2001.118434][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2001.118710][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2001.118973][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2001.119313][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2001.119588][ C1] ip_rcv+0x564/0x740 [ 2001.119800][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2001.120042][ C1] ? set_track_prepare+0x8a/0xd0 [ 2001.120308][ C1] ? irqentry_enter+0x2b/0x60 [ 2001.120561][ C1] ? irqentry_enter+0x2b/0x60 [ 2001.120815][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2001.121060][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2001.121381][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2001.121729][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2001.122042][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2001.122380][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2001.122680][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2001.123017][ C1] netif_receive_skb+0x55/0x280 [ 2001.123282][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2001.123626][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2001.123981][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2001.124296][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2001.124588][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2001.124898][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2001.125231][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2001.125517][ C1] ? arch_stack_walk+0x68/0x100 [ 2001.125778][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2001.126055][ C1] ? irqentry_enter+0x2b/0x60 [ 2001.126310][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2001.126636][ C1] ? irqentry_enter+0x2b/0x60 [ 2001.126888][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2001.127211][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2001.127496][ C1] ? arch_stack_walk+0x68/0x100 [ 2001.127756][ C1] __tcf_classify+0x32c/0x7d0 [ 2001.128009][ C1] tcf_classify+0x283/0x930 [ 2001.128252][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2001.128521][ C1] tc_run+0x2e4/0x5d0 [ 2001.128736][ C1] ? __pfx_tc_run+0x10/0x10 [ 2001.128979][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2001.129248][ C1] ? irqentry_enter+0x2b/0x60 [ 2001.129501][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2001.129789][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2001.130117][ C1] ip_finish_output2+0x786/0x18e0 [ 2001.130387][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2001.130676][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2001.130945][ C1] ? __ip_finish_output+0x10f/0x770 [ 2001.131228][ C1] ip_output+0x16b/0x4f0 [ 2001.131456][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2001.131780][ C1] ? __pfx_ip_output+0x10/0x10 [ 2001.132037][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2001.132395][ C1] ? __pfx_ip_output+0x10/0x10 [ 2001.132657][ C1] __ip_queue_xmit+0x672/0x1910 [ 2001.132920][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2001.133203][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2001.133500][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2001.133787][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2001.134084][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2001.134369][ C1] tcp_delack_timer+0x84/0x240 [ 2001.134622][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2001.134910][ C1] call_timer_fn+0x176/0x430 [ 2001.135161][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2001.135436][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2001.135718][ C1] __run_timers.part.0+0x52d/0x890 [ 2001.135996][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2001.136290][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2001.136593][ C1] ? __pfx___schedule+0x10/0x10 [ 2001.136853][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2001.137171][ C1] run_timer_softirq+0x72/0x100 [ 2001.137436][ C1] __do_softirq+0x1bc/0x7ff [ 2001.137683][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2001.137964][ C1] run_ksoftirqd+0x2e/0x60 [ 2001.138203][ C1] smpboot_thread_fn+0x30e/0x840 [ 2001.138473][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2001.138763][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2001.139055][ C1] kthread+0x292/0x360 [ 2001.139273][ C1] ? __pfx_kthread+0x10/0x10 [ 2001.139523][ C1] ret_from_fork+0x34/0x70 [ 2001.139760][ C1] ? __pfx_kthread+0x10/0x10 [ 2001.140010][ C1] ret_from_fork_asm+0x1b/0x30 [ 2001.140271][ C1] [ 2028.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 783s! [swapper/0:0] [ 2028.527914][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2028.529103][ C0] irq event stamp: 27567077 [ 2028.529340][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2028.529869][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2028.530346][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2028.530852][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2028.531349][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2028.531832][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2028.532469][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2028.532806][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2028.533816][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2028.534138][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2028.534553][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2028.534966][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2028.535383][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2028.535797][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2028.536222][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2028.536690][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2028.537035][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2028.537455][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2028.537877][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2028.538293][ C0] Call Trace: [ 2028.538472][ C0] [ 2028.538626][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2028.538903][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2028.539155][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2028.539445][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2028.539726][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2028.540025][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2028.540303][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2028.540619][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2028.540893][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2028.541168][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2028.541493][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2028.541807][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2028.542136][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2028.542447][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2028.542758][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2028.543059][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2028.543384][ C0] ? get_stack_info+0x36/0xc0 [ 2028.543644][ C0] ? lock_acquire+0x1c1/0x220 [ 2028.543899][ C0] ? lock_release+0x1d5/0x250 [ 2028.544153][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2028.544414][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2028.544699][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2028.544995][ C0] ? lock_acquire+0x1c1/0x220 [ 2028.545240][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2028.545489][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2028.545759][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2028.546008][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2028.546276][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2028.546542][ C0] ? __inet_lookup_established+0x341/0x610 [ 2028.546854][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2028.547148][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2028.547440][ C0] ip_local_deliver+0x19d/0x480 [ 2028.547697][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2028.547977][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2028.548240][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2028.548519][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2028.548782][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2028.549120][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2028.549395][ C0] ip_rcv+0x564/0x740 [ 2028.549618][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2028.549861][ C0] ? set_track_prepare+0x8a/0xd0 [ 2028.550129][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2028.550422][ C0] ? rest_init+0x153/0x260 [ 2028.550660][ C0] ? skb_clone+0x10b/0x330 [ 2028.550901][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2028.551241][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2028.551564][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2028.551859][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2028.552166][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2028.552422][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2028.552661][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2028.552971][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2028.553268][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2028.553610][ C0] ? lock_acquire+0x1c1/0x220 [ 2028.553863][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2028.554174][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2028.554469][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2028.554802][ C0] ? __copy_skb_header+0xaf/0x490 [ 2028.555073][ C0] ? __skb_clone+0x57a/0x760 [ 2028.555322][ C0] netif_receive_skb+0x55/0x280 [ 2028.555580][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2028.555907][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2028.556261][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2028.556570][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2028.556860][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2028.557161][ C0] ? hlock_class+0x4e/0x130 [ 2028.557410][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2028.557743][ C0] ? place_entity+0x21/0x2f0 [ 2028.557992][ C0] ? resched_curr+0x219/0x280 [ 2028.558245][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2028.558511][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2028.558790][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2028.559070][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2028.559330][ C0] ? activate_task+0xf5/0x260 [ 2028.559582][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2028.559860][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2028.560133][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2028.560401][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2028.560693][ C0] ? get_stack_info+0x36/0xc0 [ 2028.560945][ C0] ? stack_access_ok+0xda/0x1f0 [ 2028.561203][ C0] ? get_reg+0x119/0x190 [ 2028.561432][ C0] __tcf_classify+0x32c/0x7d0 [ 2028.561689][ C0] tcf_classify+0x283/0x930 [ 2028.561934][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2028.562264][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2028.562531][ C0] ? arch_stack_walk+0x8c/0x100 [ 2028.562791][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2028.563081][ C0] tc_run+0x2e4/0x5d0 [ 2028.563300][ C0] ? __pfx_tc_run+0x10/0x10 [ 2028.563549][ C0] ? lock_acquire+0x1c1/0x220 [ 2028.563800][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2028.564078][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2028.564343][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2028.564631][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2028.564915][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2028.565240][ C0] ? neigh_hh_output+0x348/0x590 [ 2028.565504][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2028.565784][ C0] ip_finish_output2+0x786/0x18e0 [ 2028.566063][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2028.566358][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2028.566717][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2028.567009][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2028.567275][ C0] ? __ip_finish_output+0x10f/0x770 [ 2028.567554][ C0] ip_output+0x16b/0x4f0 [ 2028.567781][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2028.568068][ C0] ? __pfx_ip_output+0x10/0x10 [ 2028.568327][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2028.568627][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2028.568894][ C0] ? ip_local_out+0x114/0x3b0 [ 2028.569145][ C0] __ip_queue_xmit+0x672/0x1910 [ 2028.569406][ C0] ? __skb_clone+0x57a/0x760 [ 2028.569653][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2028.569940][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2028.570241][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2028.570568][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2028.570823][ C0] ? tcp_current_mss+0x40a/0x510 [ 2028.571093][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2028.571375][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2028.571656][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2028.571911][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2028.572180][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2028.572498][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2028.572779][ C0] ? ktime_get+0xb6/0x190 [ 2028.573016][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2028.573294][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2028.573578][ C0] tcp_write_timer+0x82/0x1d0 [ 2028.573835][ C0] call_timer_fn+0x176/0x430 [ 2028.574087][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2028.574367][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2028.574645][ C0] __run_timers.part.0+0x52d/0x890 [ 2028.574917][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2028.575204][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2028.575502][ C0] ? lock_acquire+0x1c1/0x220 [ 2028.575757][ C0] ? clockevents_program_event+0xf6/0x300 [ 2028.576076][ C0] ? lock_release+0x1d5/0x250 [ 2028.576333][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2028.576610][ C0] ? ktime_get+0xb6/0x190 [ 2028.576840][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2028.577140][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2028.577452][ C0] run_timer_softirq+0x72/0x100 [ 2028.577710][ C0] __do_softirq+0x1bc/0x7ff [ 2028.577952][ C0] irq_exit_rcu+0x98/0xc0 [ 2028.578184][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2028.578482][ C0] [ 2028.578644][ C0] [ 2028.578804][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2028.579130][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2028.579398][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2028.580415][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2028.580737][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2028.581155][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2028.581576][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2028.581992][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2028.582408][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2028.582826][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2028.583127][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2028.583400][ C0] default_idle_call+0x69/0xa0 [ 2028.583658][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2028.583922][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2028.584213][ C0] ? lock_release+0x1d5/0x250 [ 2028.584461][ C0] do_idle+0xfb/0x160 [ 2028.584672][ C0] cpu_startup_entry+0x55/0x60 [ 2028.584925][ C0] rest_init+0x153/0x260 [ 2028.585155][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2028.585440][ C0] arch_call_rest_init+0x13/0x40 [ 2028.585715][ C0] start_kernel+0x314/0x3d0 [ 2028.585959][ C0] x86_64_start_reservations+0x18/0x30 [ 2028.586257][ C0] x86_64_start_kernel+0xba/0x110 [ 2028.586530][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2028.586858][ C0] [ 2028.587029][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 783s! [ksoftirqd/1:22] [ 2028.587499][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2028.588706][ C1] irq event stamp: 3886976 [ 2028.588946][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2028.589445][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2028.589938][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2028.590436][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2028.590931][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2028.591425][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2028.592068][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 2028.592365][ C1] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 2028.593389][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [ 2028.593713][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2028.594131][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2028.594550][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2028.594968][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2028.595387][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2028.595804][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2028.596278][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2028.596625][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2028.597046][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2028.597463][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2028.597879][ C1] Call Trace: [ 2028.598058][ C1] [ 2028.598215][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2028.598498][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2028.598751][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2028.599045][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2028.599330][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2028.599632][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2028.599913][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2028.600234][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2028.600512][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2028.600836][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2028.601145][ C1] [ 2028.601305][ C1] [ 2028.601464][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2028.601799][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2028.602101][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 2028.602394][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 2028.602690][ C1] ? run_ksoftirqd+0xb/0x60 [ 2028.602934][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2028.603260][ C1] ? __orc_find+0x9c/0xf0 [ 2028.603495][ C1] ? lock_acquire+0x1c1/0x220 [ 2028.603748][ C1] ? irqentry_enter+0x2b/0x60 [ 2028.604001][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2028.604266][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2028.604555][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2028.604860][ C1] ? lock_acquire+0x1c1/0x220 [ 2028.605111][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2028.605364][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2028.605638][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2028.605888][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2028.606154][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2028.606425][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2028.606716][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2028.607007][ C1] ip_local_deliver+0x19d/0x480 [ 2028.607269][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2028.607557][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2028.607825][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2028.608105][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2028.608369][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2028.608709][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2028.608984][ C1] ip_rcv+0x564/0x740 [ 2028.609202][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2028.609443][ C1] ? set_track_prepare+0x8a/0xd0 [ 2028.609709][ C1] ? irqentry_enter+0x2b/0x60 [ 2028.609966][ C1] ? irqentry_enter+0x2b/0x60 [ 2028.610224][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2028.610469][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2028.610788][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2028.611133][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2028.611449][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2028.611789][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2028.612089][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2028.612427][ C1] netif_receive_skb+0x55/0x280 [ 2028.612691][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2028.613022][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2028.613377][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2028.613691][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2028.613985][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2028.614293][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2028.614628][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2028.614913][ C1] ? arch_stack_walk+0x68/0x100 [ 2028.615176][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2028.615453][ C1] ? irqentry_enter+0x2b/0x60 [ 2028.615705][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2028.616025][ C1] ? irqentry_enter+0x2b/0x60 [ 2028.616284][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2028.616605][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2028.616890][ C1] ? arch_stack_walk+0x68/0x100 [ 2028.617152][ C1] __tcf_classify+0x32c/0x7d0 [ 2028.617403][ C1] tcf_classify+0x283/0x930 [ 2028.617645][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2028.617915][ C1] tc_run+0x2e4/0x5d0 [ 2028.618131][ C1] ? __pfx_tc_run+0x10/0x10 [ 2028.618374][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2028.618642][ C1] ? irqentry_enter+0x2b/0x60 [ 2028.618898][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2028.619190][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2028.619514][ C1] ip_finish_output2+0x786/0x18e0 [ 2028.619785][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2028.620080][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2028.620347][ C1] ? __ip_finish_output+0x10f/0x770 [ 2028.620623][ C1] ip_output+0x16b/0x4f0 [ 2028.620851][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2028.621171][ C1] ? __pfx_ip_output+0x10/0x10 [ 2028.621427][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2028.621783][ C1] ? __pfx_ip_output+0x10/0x10 [ 2028.622044][ C1] __ip_queue_xmit+0x672/0x1910 [ 2028.622304][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2028.622583][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2028.622878][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2028.623164][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2028.623458][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2028.623744][ C1] tcp_delack_timer+0x84/0x240 [ 2028.624001][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2028.624292][ C1] call_timer_fn+0x176/0x430 [ 2028.624545][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2028.624819][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2028.625100][ C1] __run_timers.part.0+0x52d/0x890 [ 2028.625376][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2028.625663][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2028.625964][ C1] ? __pfx___schedule+0x10/0x10 [ 2028.626233][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2028.626556][ C1] run_timer_softirq+0x72/0x100 [ 2028.626819][ C1] __do_softirq+0x1bc/0x7ff [ 2028.627067][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2028.627343][ C1] run_ksoftirqd+0x2e/0x60 [ 2028.627580][ C1] smpboot_thread_fn+0x30e/0x840 [ 2028.627846][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2028.628135][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2028.628431][ C1] kthread+0x292/0x360 [ 2028.628650][ C1] ? __pfx_kthread+0x10/0x10 [ 2028.628901][ C1] ret_from_fork+0x34/0x70 [ 2028.629141][ C1] ? __pfx_kthread+0x10/0x10 [ 2028.629389][ C1] ret_from_fork_asm+0x1b/0x30 [ 2028.629648][ C1] [ 2056.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 809s! [swapper/0:0] [ 2056.527915][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2056.529116][ C0] irq event stamp: 27567077 [ 2056.529358][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2056.529885][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2056.530356][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2056.530856][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2056.531347][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2056.531824][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2056.532471][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2056.532814][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2056.533837][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2056.534162][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2056.534584][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2056.535007][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2056.535426][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2056.535845][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2056.536272][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2056.536742][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2056.537093][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2056.537513][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2056.537935][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2056.538360][ C0] Call Trace: [ 2056.538542][ C0] [ 2056.538700][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2056.538974][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2056.539234][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2056.539524][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2056.539813][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2056.540117][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2056.540399][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2056.540722][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2056.540994][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2056.541272][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2056.541595][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2056.541903][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2056.542239][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2056.542541][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2056.542849][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2056.543153][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2056.543482][ C0] ? get_stack_info+0x36/0xc0 [ 2056.543733][ C0] ? lock_acquire+0x1c1/0x220 [ 2056.543982][ C0] ? lock_release+0x1d5/0x250 [ 2056.544231][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2056.544489][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2056.544770][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2056.545068][ C0] ? lock_acquire+0x1c1/0x220 [ 2056.545321][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2056.545578][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2056.545854][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2056.546108][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2056.546372][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2056.546646][ C0] ? __inet_lookup_established+0x341/0x610 [ 2056.546961][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2056.547253][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2056.547542][ C0] ip_local_deliver+0x19d/0x480 [ 2056.547804][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2056.548094][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2056.548365][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2056.548643][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2056.548909][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2056.549249][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2056.549524][ C0] ip_rcv+0x564/0x740 [ 2056.549739][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2056.549981][ C0] ? set_track_prepare+0x8a/0xd0 [ 2056.550247][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2056.550538][ C0] ? rest_init+0x153/0x260 [ 2056.550775][ C0] ? skb_clone+0x10b/0x330 [ 2056.551015][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2056.551348][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2056.551666][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2056.551964][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2056.552278][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2056.552542][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2056.552788][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2056.553104][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2056.553409][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2056.553750][ C0] ? lock_acquire+0x1c1/0x220 [ 2056.554000][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2056.554310][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2056.554615][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2056.554946][ C0] ? __copy_skb_header+0xaf/0x490 [ 2056.555214][ C0] ? __skb_clone+0x57a/0x760 [ 2056.555458][ C0] netif_receive_skb+0x55/0x280 [ 2056.555722][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2056.556061][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2056.556407][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2056.556726][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2056.557014][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2056.557316][ C0] ? hlock_class+0x4e/0x130 [ 2056.557563][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2056.557893][ C0] ? place_entity+0x21/0x2f0 [ 2056.558136][ C0] ? resched_curr+0x219/0x280 [ 2056.558387][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2056.558657][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2056.558940][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2056.559216][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2056.559473][ C0] ? activate_task+0xf5/0x260 [ 2056.559723][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2056.559995][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2056.560268][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2056.560526][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2056.560813][ C0] ? get_stack_info+0x36/0xc0 [ 2056.561066][ C0] ? stack_access_ok+0xda/0x1f0 [ 2056.561326][ C0] ? get_reg+0x119/0x190 [ 2056.561557][ C0] __tcf_classify+0x32c/0x7d0 [ 2056.561807][ C0] tcf_classify+0x283/0x930 [ 2056.562047][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2056.562376][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2056.562642][ C0] ? arch_stack_walk+0x8c/0x100 [ 2056.562906][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2056.563198][ C0] tc_run+0x2e4/0x5d0 [ 2056.563413][ C0] ? __pfx_tc_run+0x10/0x10 [ 2056.563654][ C0] ? lock_acquire+0x1c1/0x220 [ 2056.563907][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2056.564179][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2056.564448][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2056.564731][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2056.565006][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2056.565322][ C0] ? neigh_hh_output+0x348/0x590 [ 2056.565588][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2056.565865][ C0] ip_finish_output2+0x786/0x18e0 [ 2056.566142][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2056.566439][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2056.566791][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2056.567079][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2056.567347][ C0] ? __ip_finish_output+0x10f/0x770 [ 2056.567623][ C0] ip_output+0x16b/0x4f0 [ 2056.567850][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2056.568137][ C0] ? __pfx_ip_output+0x10/0x10 [ 2056.568391][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2056.568694][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2056.568957][ C0] ? ip_local_out+0x114/0x3b0 [ 2056.569214][ C0] __ip_queue_xmit+0x672/0x1910 [ 2056.569477][ C0] ? __skb_clone+0x57a/0x760 [ 2056.569724][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2056.570004][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2056.570302][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2056.570618][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2056.570880][ C0] ? tcp_current_mss+0x40a/0x510 [ 2056.571144][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2056.571427][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2056.571704][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2056.571959][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2056.572229][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2056.572551][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2056.572828][ C0] ? ktime_get+0xb6/0x190 [ 2056.573060][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2056.573332][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2056.573615][ C0] tcp_write_timer+0x82/0x1d0 [ 2056.573867][ C0] call_timer_fn+0x176/0x430 [ 2056.574117][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2056.574391][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2056.574662][ C0] __run_timers.part.0+0x52d/0x890 [ 2056.574937][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2056.575225][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2056.575528][ C0] ? lock_acquire+0x1c1/0x220 [ 2056.575779][ C0] ? clockevents_program_event+0xf6/0x300 [ 2056.576098][ C0] ? lock_release+0x1d5/0x250 [ 2056.576350][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2056.576629][ C0] ? ktime_get+0xb6/0x190 [ 2056.576867][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2056.577168][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2056.577479][ C0] run_timer_softirq+0x72/0x100 [ 2056.577743][ C0] __do_softirq+0x1bc/0x7ff [ 2056.577990][ C0] irq_exit_rcu+0x98/0xc0 [ 2056.578223][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2056.578524][ C0] [ 2056.578683][ C0] [ 2056.578839][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2056.579156][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2056.579428][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2056.580447][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2056.580770][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2056.581195][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2056.581612][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2056.582031][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2056.582451][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2056.582874][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2056.583179][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2056.583453][ C0] default_idle_call+0x69/0xa0 [ 2056.583706][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2056.583969][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2056.584258][ C0] ? lock_release+0x1d5/0x250 [ 2056.584513][ C0] do_idle+0xfb/0x160 [ 2056.584731][ C0] cpu_startup_entry+0x55/0x60 [ 2056.584987][ C0] rest_init+0x153/0x260 [ 2056.585213][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2056.585507][ C0] arch_call_rest_init+0x13/0x40 [ 2056.585778][ C0] start_kernel+0x314/0x3d0 [ 2056.586031][ C0] x86_64_start_reservations+0x18/0x30 [ 2056.586327][ C0] x86_64_start_kernel+0xba/0x110 [ 2056.586595][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2056.586923][ C0] [ 2056.587090][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 809s! [ksoftirqd/1:22] [ 2056.587571][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2056.588779][ C1] irq event stamp: 3886976 [ 2056.589018][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2056.589523][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2056.590029][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2056.590544][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2056.591042][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2056.591542][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2056.592194][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2056.592548][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2056.593582][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2056.593917][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2056.594349][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2056.594775][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2056.595207][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2056.595636][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2056.596069][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2056.596537][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2056.596895][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2056.597316][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2056.597749][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2056.598177][ C1] Call Trace: [ 2056.598369][ C1] [ 2056.598527][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2056.598804][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2056.599061][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2056.599350][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2056.599640][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2056.599949][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2056.600234][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2056.600558][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2056.600832][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2056.601164][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2056.601477][ C1] [ 2056.601634][ C1] [ 2056.601792][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2056.602124][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2056.602432][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2056.602747][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2056.603056][ C1] ? run_ksoftirqd+0xb/0x60 [ 2056.603303][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2056.603629][ C1] ? __orc_find+0x9c/0xf0 [ 2056.603869][ C1] ? lock_acquire+0x1c1/0x220 [ 2056.604133][ C1] ? irqentry_enter+0x2b/0x60 [ 2056.604391][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2056.604658][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2056.604946][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2056.605247][ C1] ? lock_acquire+0x1c1/0x220 [ 2056.605494][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2056.605748][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2056.606045][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2056.606292][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2056.606552][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2056.606826][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2056.607116][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2056.607412][ C1] ip_local_deliver+0x19d/0x480 [ 2056.607680][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2056.607969][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2056.608245][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2056.608522][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2056.608796][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2056.609136][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2056.609413][ C1] ip_rcv+0x564/0x740 [ 2056.609630][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2056.609869][ C1] ? set_track_prepare+0x8a/0xd0 [ 2056.610135][ C1] ? irqentry_enter+0x2b/0x60 [ 2056.610387][ C1] ? irqentry_enter+0x2b/0x60 [ 2056.610638][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2056.610881][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2056.611201][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2056.611550][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2056.611865][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2056.612207][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2056.612512][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2056.612853][ C1] netif_receive_skb+0x55/0x280 [ 2056.613116][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2056.613452][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2056.613809][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2056.614131][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2056.614422][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2056.614730][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2056.615063][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2056.615347][ C1] ? arch_stack_walk+0x68/0x100 [ 2056.615607][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2056.615882][ C1] ? irqentry_enter+0x2b/0x60 [ 2056.616143][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2056.616473][ C1] ? irqentry_enter+0x2b/0x60 [ 2056.616723][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2056.617043][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2056.617325][ C1] ? arch_stack_walk+0x68/0x100 [ 2056.617584][ C1] __tcf_classify+0x32c/0x7d0 [ 2056.617837][ C1] tcf_classify+0x283/0x930 [ 2056.618078][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2056.618346][ C1] tc_run+0x2e4/0x5d0 [ 2056.618560][ C1] ? __pfx_tc_run+0x10/0x10 [ 2056.618803][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2056.619070][ C1] ? irqentry_enter+0x2b/0x60 [ 2056.619321][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2056.619608][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2056.619935][ C1] ip_finish_output2+0x786/0x18e0 [ 2056.620204][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2056.620493][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2056.620761][ C1] ? __ip_finish_output+0x10f/0x770 [ 2056.621040][ C1] ip_output+0x16b/0x4f0 [ 2056.621267][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2056.621590][ C1] ? __pfx_ip_output+0x10/0x10 [ 2056.621845][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2056.622202][ C1] ? __pfx_ip_output+0x10/0x10 [ 2056.622461][ C1] __ip_queue_xmit+0x672/0x1910 [ 2056.622722][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2056.623004][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2056.623301][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2056.623588][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2056.623882][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2056.624167][ C1] tcp_delack_timer+0x84/0x240 [ 2056.624420][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2056.624709][ C1] call_timer_fn+0x176/0x430 [ 2056.624958][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2056.625234][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2056.625514][ C1] __run_timers.part.0+0x52d/0x890 [ 2056.625791][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2056.626088][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2056.626390][ C1] ? __pfx___schedule+0x10/0x10 [ 2056.626650][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2056.626968][ C1] run_timer_softirq+0x72/0x100 [ 2056.627231][ C1] __do_softirq+0x1bc/0x7ff [ 2056.627477][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2056.627754][ C1] run_ksoftirqd+0x2e/0x60 [ 2056.627992][ C1] smpboot_thread_fn+0x30e/0x840 [ 2056.628263][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2056.628555][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2056.628848][ C1] kthread+0x292/0x360 [ 2056.629067][ C1] ? __pfx_kthread+0x10/0x10 [ 2056.629316][ C1] ret_from_fork+0x34/0x70 [ 2056.629553][ C1] ? __pfx_kthread+0x10/0x10 [ 2056.629803][ C1] ret_from_fork_asm+0x1b/0x30 [ 2056.630064][ C1] [ 2079.141024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 2079.141421][ C1] rcu: 1-....: (884049 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=215450 [ 2079.142007][ C1] rcu: (t=884832 jiffies g=1007429 q=31 ncpus=4) [ 2079.142347][ C1] Sending NMI from CPU 1 to CPUs 0: [ 2079.142632][ C0] NMI backtrace for cpu 0 [ 2079.142639][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2079.142643][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2079.142645][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2079.142654][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2079.142657][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2079.142660][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2079.142662][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2079.142664][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2079.142666][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2079.142668][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2079.142669][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2079.142672][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2079.142675][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2079.142677][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2079.142678][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2079.142680][ C0] Call Trace: [ 2079.142683][ C0] [ 2079.142686][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 2079.142693][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 2079.142698][ C0] ? nmi_handle+0x156/0x420 [ 2079.142703][ C0] ? default_do_nmi+0x41/0x100 [ 2079.142708][ C0] ? exc_nmi+0xf3/0x120 [ 2079.142710][ C0] ? end_repeat_nmi+0xf/0x60 [ 2079.142715][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2079.142718][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2079.142722][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2079.142725][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2079.142729][ C0] [ 2079.142730][ C0] [ 2079.142731][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2079.142734][ C0] ? get_stack_info+0x36/0xc0 [ 2079.142739][ C0] ? lock_acquire+0x1c1/0x220 [ 2079.142743][ C0] ? lock_release+0x1d5/0x250 [ 2079.142747][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2079.142751][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2079.142754][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2079.142758][ C0] ? lock_acquire+0x1c1/0x220 [ 2079.142760][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2079.142765][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2079.142769][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2079.142776][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2079.142779][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2079.142783][ C0] ? __inet_lookup_established+0x341/0x610 [ 2079.142790][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2079.142797][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2079.142800][ C0] ip_local_deliver+0x19d/0x480 [ 2079.142804][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2079.142806][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2079.142812][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2079.142815][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2079.142818][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2079.142822][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2079.142832][ C0] ip_rcv+0x564/0x740 [ 2079.142835][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2079.142838][ C0] ? set_track_prepare+0x8a/0xd0 [ 2079.142843][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2079.142845][ C0] ? rest_init+0x153/0x260 [ 2079.142848][ C0] ? skb_clone+0x10b/0x330 [ 2079.142852][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2079.142859][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2079.142864][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2079.142869][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2079.142878][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2079.142881][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2079.142884][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2079.142889][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2079.142892][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2079.142896][ C0] ? lock_acquire+0x1c1/0x220 [ 2079.142898][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2079.142901][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2079.142904][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2079.142908][ C0] ? __copy_skb_header+0xaf/0x490 [ 2079.142910][ C0] ? __skb_clone+0x57a/0x760 [ 2079.142913][ C0] netif_receive_skb+0x55/0x280 [ 2079.142916][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2079.142924][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2079.142931][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2079.142938][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2079.142943][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2079.142951][ C0] ? hlock_class+0x4e/0x130 [ 2079.142957][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2079.142967][ C0] ? place_entity+0x21/0x2f0 [ 2079.142971][ C0] ? resched_curr+0x219/0x280 [ 2079.142974][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2079.142977][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2079.142981][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2079.142985][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2079.142988][ C0] ? activate_task+0xf5/0x260 [ 2079.142991][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2079.142997][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2079.143000][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2079.143004][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2079.143007][ C0] ? get_stack_info+0x36/0xc0 [ 2079.143011][ C0] ? stack_access_ok+0xda/0x1f0 [ 2079.143013][ C0] ? get_reg+0x119/0x190 [ 2079.143017][ C0] __tcf_classify+0x32c/0x7d0 [ 2079.143022][ C0] tcf_classify+0x283/0x930 [ 2079.143025][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2079.143030][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2079.143032][ C0] ? arch_stack_walk+0x8c/0x100 [ 2079.143036][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2079.143039][ C0] tc_run+0x2e4/0x5d0 [ 2079.143044][ C0] ? __pfx_tc_run+0x10/0x10 [ 2079.143047][ C0] ? lock_acquire+0x1c1/0x220 [ 2079.143049][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2079.143054][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2079.143060][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2079.143063][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2079.143067][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2079.143072][ C0] ? neigh_hh_output+0x348/0x590 [ 2079.143076][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2079.143080][ C0] ip_finish_output2+0x786/0x18e0 [ 2079.143084][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2079.143089][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2079.143097][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2079.143100][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2079.143104][ C0] ? __ip_finish_output+0x10f/0x770 [ 2079.143108][ C0] ip_output+0x16b/0x4f0 [ 2079.143111][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2079.143116][ C0] ? __pfx_ip_output+0x10/0x10 [ 2079.143119][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2079.143124][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2079.143127][ C0] ? ip_local_out+0x114/0x3b0 [ 2079.143131][ C0] __ip_queue_xmit+0x672/0x1910 [ 2079.143135][ C0] ? __skb_clone+0x57a/0x760 [ 2079.143139][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2079.143146][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2079.143151][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2079.143154][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2079.143160][ C0] ? tcp_current_mss+0x40a/0x510 [ 2079.143162][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2079.143165][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2079.143168][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2079.143170][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2079.143173][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2079.143176][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2079.143181][ C0] ? ktime_get+0xb6/0x190 [ 2079.143185][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2079.143189][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2079.143192][ C0] tcp_write_timer+0x82/0x1d0 [ 2079.143196][ C0] call_timer_fn+0x176/0x430 [ 2079.143200][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2079.143204][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2079.143209][ C0] __run_timers.part.0+0x52d/0x890 [ 2079.143212][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2079.143217][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2079.143220][ C0] ? lock_acquire+0x1c1/0x220 [ 2079.143222][ C0] ? clockevents_program_event+0xf6/0x300 [ 2079.143227][ C0] ? lock_release+0x1d5/0x250 [ 2079.143230][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2079.143232][ C0] ? ktime_get+0xb6/0x190 [ 2079.143235][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2079.143239][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2079.143244][ C0] run_timer_softirq+0x72/0x100 [ 2079.143247][ C0] __do_softirq+0x1bc/0x7ff [ 2079.143252][ C0] irq_exit_rcu+0x98/0xc0 [ 2079.143255][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2079.143260][ C0] [ 2079.143260][ C0] [ 2079.143261][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2079.143267][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2079.143270][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2079.143272][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2079.143274][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2079.143276][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2079.143278][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2079.143279][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2079.143281][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2079.143284][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2079.143288][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2079.143292][ C0] default_idle_call+0x69/0xa0 [ 2079.143294][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2079.143297][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2079.143302][ C0] ? lock_release+0x1d5/0x250 [ 2079.143306][ C0] do_idle+0xfb/0x160 [ 2079.143309][ C0] cpu_startup_entry+0x55/0x60 [ 2079.143311][ C0] rest_init+0x153/0x260 [ 2079.143314][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2079.143320][ C0] arch_call_rest_init+0x13/0x40 [ 2079.143325][ C0] start_kernel+0x314/0x3d0 [ 2079.143329][ C0] x86_64_start_reservations+0x18/0x30 [ 2079.143333][ C0] x86_64_start_kernel+0xba/0x110 [ 2079.143337][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2079.143345][ C0] [ 2079.143629][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2079.198011][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2079.198659][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2079.199007][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2079.200030][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2079.200356][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2079.200775][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2079.201195][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2079.201613][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2079.202034][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2079.202454][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2079.202922][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2079.203280][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2079.203702][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2079.204124][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2079.204548][ C1] Call Trace: [ 2079.204733][ C1] [ 2079.204892][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 2079.205181][ C1] ? print_cpu_stall+0x263/0x6a0 [ 2079.205450][ C1] ? check_cpu_stall+0x284/0x500 [ 2079.205716][ C1] ? rcu_pending+0x92/0x360 [ 2079.205967][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 2079.206252][ C1] ? update_process_times+0xb9/0x110 [ 2079.206539][ C1] ? tick_sched_handle+0x67/0x130 [ 2079.206810][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 2079.207110][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2079.207366][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 2079.207693][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2079.207983][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2079.208292][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2079.208576][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2079.208902][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2079.209178][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2079.209506][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2079.209822][ C1] [ 2079.209980][ C1] [ 2079.210138][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2079.210471][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2079.210778][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2079.211094][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2079.211403][ C1] ? run_ksoftirqd+0xb/0x60 [ 2079.211645][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2079.211972][ C1] ? __orc_find+0x9c/0xf0 [ 2079.212206][ C1] ? lock_acquire+0x1c1/0x220 [ 2079.212462][ C1] ? irqentry_enter+0x2b/0x60 [ 2079.212720][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2079.212986][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2079.213277][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2079.213580][ C1] ? lock_acquire+0x1c1/0x220 [ 2079.213828][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2079.214081][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2079.214355][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2079.214605][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2079.214871][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2079.215147][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2079.215441][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2079.215735][ C1] ip_local_deliver+0x19d/0x480 [ 2079.216002][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2079.216294][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2079.216566][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2079.216846][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2079.217110][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2079.217451][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2079.217727][ C1] ip_rcv+0x564/0x740 [ 2079.217943][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2079.218189][ C1] ? set_track_prepare+0x8a/0xd0 [ 2079.218456][ C1] ? irqentry_enter+0x2b/0x60 [ 2079.218711][ C1] ? irqentry_enter+0x2b/0x60 [ 2079.218967][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2079.219216][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2079.219535][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2079.219884][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2079.220199][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2079.220540][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2079.220838][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2079.221178][ C1] netif_receive_skb+0x55/0x280 [ 2079.221445][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2079.221779][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2079.222134][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2079.222447][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2079.222741][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2079.223053][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2079.223388][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2079.223673][ C1] ? arch_stack_walk+0x68/0x100 [ 2079.223933][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2079.224214][ C1] ? irqentry_enter+0x2b/0x60 [ 2079.224467][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2079.224790][ C1] ? irqentry_enter+0x2b/0x60 [ 2079.225048][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2079.225374][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2079.225653][ C1] ? arch_stack_walk+0x68/0x100 [ 2079.225924][ C1] __tcf_classify+0x32c/0x7d0 [ 2079.226177][ C1] tcf_classify+0x283/0x930 [ 2079.226418][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2079.226689][ C1] tc_run+0x2e4/0x5d0 [ 2079.226906][ C1] ? __pfx_tc_run+0x10/0x10 [ 2079.227154][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2079.227421][ C1] ? irqentry_enter+0x2b/0x60 [ 2079.227677][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2079.227967][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2079.228296][ C1] ip_finish_output2+0x786/0x18e0 [ 2079.228567][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2079.228856][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2079.229131][ C1] ? __ip_finish_output+0x10f/0x770 [ 2079.229408][ C1] ip_output+0x16b/0x4f0 [ 2079.229635][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2079.229959][ C1] ? __pfx_ip_output+0x10/0x10 [ 2079.230218][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2079.230573][ C1] ? __pfx_ip_output+0x10/0x10 [ 2079.230833][ C1] __ip_queue_xmit+0x672/0x1910 [ 2079.231095][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2079.231376][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2079.231672][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2079.231959][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2079.232256][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2079.232542][ C1] tcp_delack_timer+0x84/0x240 [ 2079.232798][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2079.233088][ C1] call_timer_fn+0x176/0x430 [ 2079.233339][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2079.233614][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2079.233897][ C1] __run_timers.part.0+0x52d/0x890 [ 2079.234173][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2079.234466][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2079.234766][ C1] ? __pfx___schedule+0x10/0x10 [ 2079.235031][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2079.235356][ C1] run_timer_softirq+0x72/0x100 [ 2079.235615][ C1] __do_softirq+0x1bc/0x7ff [ 2079.235865][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2079.236144][ C1] run_ksoftirqd+0x2e/0x60 [ 2079.236381][ C1] smpboot_thread_fn+0x30e/0x840 [ 2079.236652][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2079.236945][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2079.237240][ C1] kthread+0x292/0x360 [ 2079.237457][ C1] ? __pfx_kthread+0x10/0x10 [ 2079.237706][ C1] ret_from_fork+0x34/0x70 [ 2079.237946][ C1] ? __pfx_kthread+0x10/0x10 [ 2079.238198][ C1] ret_from_fork_asm+0x1b/0x30 [ 2079.238461][ C1] [ 2104.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 853s! [swapper/0:0] [ 2104.527915][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2104.529116][ C0] irq event stamp: 27567077 [ 2104.529355][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2104.529880][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2104.530359][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2104.530870][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2104.531368][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2104.531850][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2104.532490][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2104.532829][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2104.533857][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2104.534179][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2104.534599][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2104.535021][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2104.535440][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2104.535866][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2104.536290][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2104.536765][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2104.537113][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2104.537539][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2104.537957][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2104.538376][ C0] Call Trace: [ 2104.538558][ C0] [ 2104.538715][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2104.538994][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2104.539246][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2104.539541][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2104.539825][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2104.540129][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2104.540406][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2104.540724][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2104.541001][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2104.541276][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2104.541604][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2104.541918][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2104.542249][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2104.542557][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2104.542875][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2104.543177][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2104.543502][ C0] ? get_stack_info+0x36/0xc0 [ 2104.543755][ C0] ? lock_acquire+0x1c1/0x220 [ 2104.544009][ C0] ? lock_release+0x1d5/0x250 [ 2104.544262][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2104.544525][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2104.544811][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2104.545112][ C0] ? lock_acquire+0x1c1/0x220 [ 2104.545360][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2104.545616][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2104.545897][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2104.546142][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2104.546402][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2104.546671][ C0] ? __inet_lookup_established+0x341/0x610 [ 2104.546983][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2104.547276][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2104.547569][ C0] ip_local_deliver+0x19d/0x480 [ 2104.547827][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2104.548109][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2104.548378][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2104.548660][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2104.548929][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2104.549266][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2104.549546][ C0] ip_rcv+0x564/0x740 [ 2104.549766][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2104.550011][ C0] ? set_track_prepare+0x8a/0xd0 [ 2104.550281][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2104.550571][ C0] ? rest_init+0x153/0x260 [ 2104.550814][ C0] ? skb_clone+0x10b/0x330 [ 2104.551052][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2104.551391][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2104.551716][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2104.552012][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2104.552319][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2104.552579][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2104.552829][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2104.553143][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2104.553441][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2104.553787][ C0] ? lock_acquire+0x1c1/0x220 [ 2104.554043][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2104.554356][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2104.554653][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2104.554994][ C0] ? __copy_skb_header+0xaf/0x490 [ 2104.555267][ C0] ? __skb_clone+0x57a/0x760 [ 2104.555518][ C0] netif_receive_skb+0x55/0x280 [ 2104.555788][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2104.556123][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2104.556476][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2104.556792][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2104.557085][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2104.557393][ C0] ? hlock_class+0x4e/0x130 [ 2104.557644][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2104.557978][ C0] ? place_entity+0x21/0x2f0 [ 2104.558227][ C0] ? resched_curr+0x219/0x280 [ 2104.558476][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2104.558742][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2104.559028][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2104.559308][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2104.559568][ C0] ? activate_task+0xf5/0x260 [ 2104.559822][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2104.560099][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2104.560371][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2104.560634][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2104.560931][ C0] ? get_stack_info+0x36/0xc0 [ 2104.561179][ C0] ? stack_access_ok+0xda/0x1f0 [ 2104.561433][ C0] ? get_reg+0x119/0x190 [ 2104.561660][ C0] __tcf_classify+0x32c/0x7d0 [ 2104.561913][ C0] tcf_classify+0x283/0x930 [ 2104.562158][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2104.562488][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2104.562753][ C0] ? arch_stack_walk+0x8c/0x100 [ 2104.563010][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2104.563298][ C0] tc_run+0x2e4/0x5d0 [ 2104.563520][ C0] ? __pfx_tc_run+0x10/0x10 [ 2104.563764][ C0] ? lock_acquire+0x1c1/0x220 [ 2104.564017][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2104.564294][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2104.564559][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2104.564848][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2104.565127][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2104.565451][ C0] ? neigh_hh_output+0x348/0x590 [ 2104.565720][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2104.565996][ C0] ip_finish_output2+0x786/0x18e0 [ 2104.566264][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2104.566556][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2104.566912][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2104.567204][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2104.567469][ C0] ? __ip_finish_output+0x10f/0x770 [ 2104.567752][ C0] ip_output+0x16b/0x4f0 [ 2104.567983][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2104.568268][ C0] ? __pfx_ip_output+0x10/0x10 [ 2104.568528][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2104.568828][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2104.569095][ C0] ? ip_local_out+0x114/0x3b0 [ 2104.569350][ C0] __ip_queue_xmit+0x672/0x1910 [ 2104.569611][ C0] ? __skb_clone+0x57a/0x760 [ 2104.569860][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2104.570149][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2104.570451][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2104.570773][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2104.571033][ C0] ? tcp_current_mss+0x40a/0x510 [ 2104.571305][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2104.571588][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2104.571868][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2104.572134][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2104.572403][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2104.572725][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2104.573008][ C0] ? ktime_get+0xb6/0x190 [ 2104.573245][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2104.573522][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2104.573808][ C0] tcp_write_timer+0x82/0x1d0 [ 2104.574066][ C0] call_timer_fn+0x176/0x430 [ 2104.574318][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2104.574592][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2104.574869][ C0] __run_timers.part.0+0x52d/0x890 [ 2104.575143][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2104.575430][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2104.575738][ C0] ? lock_acquire+0x1c1/0x220 [ 2104.575992][ C0] ? clockevents_program_event+0xf6/0x300 [ 2104.576299][ C0] ? lock_release+0x1d5/0x250 [ 2104.576548][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2104.576827][ C0] ? ktime_get+0xb6/0x190 [ 2104.577060][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2104.577360][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2104.577675][ C0] run_timer_softirq+0x72/0x100 [ 2104.577936][ C0] __do_softirq+0x1bc/0x7ff [ 2104.578179][ C0] irq_exit_rcu+0x98/0xc0 [ 2104.578409][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2104.578706][ C0] [ 2104.578867][ C0] [ 2104.579027][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2104.579351][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2104.579618][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2104.580631][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2104.580951][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2104.581372][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2104.581788][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2104.582203][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2104.582618][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2104.583039][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2104.583340][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2104.583613][ C0] default_idle_call+0x69/0xa0 [ 2104.583871][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2104.584133][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2104.584425][ C0] ? lock_release+0x1d5/0x250 [ 2104.584675][ C0] do_idle+0xfb/0x160 [ 2104.584887][ C0] cpu_startup_entry+0x55/0x60 [ 2104.585142][ C0] rest_init+0x153/0x260 [ 2104.585368][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2104.585653][ C0] arch_call_rest_init+0x13/0x40 [ 2104.585925][ C0] start_kernel+0x314/0x3d0 [ 2104.586167][ C0] x86_64_start_reservations+0x18/0x30 [ 2104.586460][ C0] x86_64_start_kernel+0xba/0x110 [ 2104.586734][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2104.587070][ C0] [ 2104.587239][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 854s! [ksoftirqd/1:22] [ 2104.587721][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2104.588943][ C1] irq event stamp: 3886976 [ 2104.589186][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2104.589688][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2104.590186][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2104.590688][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2104.591191][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2104.591689][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2104.592340][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2104.592683][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2104.593712][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2104.594038][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2104.594460][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2104.594886][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2104.595311][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2104.595743][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2104.596174][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2104.596656][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2104.597009][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2104.597440][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2104.597864][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2104.598289][ C1] Call Trace: [ 2104.598471][ C1] [ 2104.598630][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2104.598912][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2104.599169][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2104.599467][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2104.599756][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2104.600062][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2104.600342][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2104.600665][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2104.600945][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2104.601274][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2104.601587][ C1] [ 2104.601750][ C1] [ 2104.601911][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2104.602255][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2104.602560][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2104.602871][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2104.603179][ C1] ? run_ksoftirqd+0xb/0x60 [ 2104.603427][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2104.603760][ C1] ? __orc_find+0x9c/0xf0 [ 2104.603992][ C1] ? lock_acquire+0x1c1/0x220 [ 2104.604248][ C1] ? irqentry_enter+0x2b/0x60 [ 2104.604502][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2104.604764][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2104.605052][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2104.605351][ C1] ? lock_acquire+0x1c1/0x220 [ 2104.605607][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2104.605869][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2104.606144][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2104.606397][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2104.606662][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2104.606939][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2104.607236][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2104.607534][ C1] ip_local_deliver+0x19d/0x480 [ 2104.607795][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2104.608084][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2104.608351][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2104.608633][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2104.608901][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2104.609242][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2104.609523][ C1] ip_rcv+0x564/0x740 [ 2104.609739][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2104.609989][ C1] ? set_track_prepare+0x8a/0xd0 [ 2104.610261][ C1] ? irqentry_enter+0x2b/0x60 [ 2104.610512][ C1] ? irqentry_enter+0x2b/0x60 [ 2104.610763][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2104.611005][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2104.611326][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2104.611668][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2104.611979][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2104.612328][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2104.612634][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2104.612969][ C1] netif_receive_skb+0x55/0x280 [ 2104.613234][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2104.613567][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2104.613917][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2104.614240][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2104.614532][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2104.614839][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2104.615175][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2104.615458][ C1] ? arch_stack_walk+0x68/0x100 [ 2104.615731][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2104.616009][ C1] ? irqentry_enter+0x2b/0x60 [ 2104.616261][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2104.616582][ C1] ? irqentry_enter+0x2b/0x60 [ 2104.616838][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2104.617170][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2104.617454][ C1] ? arch_stack_walk+0x68/0x100 [ 2104.617723][ C1] __tcf_classify+0x32c/0x7d0 [ 2104.617984][ C1] tcf_classify+0x283/0x930 [ 2104.618235][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2104.618511][ C1] tc_run+0x2e4/0x5d0 [ 2104.618731][ C1] ? __pfx_tc_run+0x10/0x10 [ 2104.618979][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2104.619254][ C1] ? irqentry_enter+0x2b/0x60 [ 2104.619504][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2104.619789][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2104.620115][ C1] ip_finish_output2+0x786/0x18e0 [ 2104.620389][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2104.620687][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2104.620956][ C1] ? __ip_finish_output+0x10f/0x770 [ 2104.621242][ C1] ip_output+0x16b/0x4f0 [ 2104.621472][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2104.621790][ C1] ? __pfx_ip_output+0x10/0x10 [ 2104.622054][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2104.622411][ C1] ? __pfx_ip_output+0x10/0x10 [ 2104.622671][ C1] __ip_queue_xmit+0x672/0x1910 [ 2104.622938][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2104.623227][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2104.623528][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2104.623820][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2104.624122][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2104.624412][ C1] tcp_delack_timer+0x84/0x240 [ 2104.624671][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2104.624955][ C1] call_timer_fn+0x176/0x430 [ 2104.625204][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2104.625483][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2104.625767][ C1] __run_timers.part.0+0x52d/0x890 [ 2104.626051][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2104.626340][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2104.626642][ C1] ? __pfx___schedule+0x10/0x10 [ 2104.626910][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2104.627235][ C1] run_timer_softirq+0x72/0x100 [ 2104.627496][ C1] __do_softirq+0x1bc/0x7ff [ 2104.627741][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2104.628016][ C1] run_ksoftirqd+0x2e/0x60 [ 2104.628263][ C1] smpboot_thread_fn+0x30e/0x840 [ 2104.628530][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2104.628827][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2104.629120][ C1] kthread+0x292/0x360 [ 2104.629344][ C1] ? __pfx_kthread+0x10/0x10 [ 2104.629591][ C1] ret_from_fork+0x34/0x70 [ 2104.629835][ C1] ? __pfx_kthread+0x10/0x10 [ 2104.630083][ C1] ret_from_fork_asm+0x1b/0x30 [ 2104.630349][ C1] [ 2132.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 880s! [swapper/0:0] [ 2132.527908][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2132.529113][ C0] irq event stamp: 27567077 [ 2132.529355][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2132.529884][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2132.530358][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2132.530860][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2132.531350][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2132.531826][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2132.532474][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2132.532817][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2132.533840][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2132.534167][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2132.534593][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2132.535019][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2132.535439][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2132.535863][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2132.536278][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2132.536746][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2132.537095][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2132.537518][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2132.537941][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2132.538371][ C0] Call Trace: [ 2132.538552][ C0] [ 2132.538710][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2132.538986][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2132.539245][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2132.539535][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2132.539826][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2132.540130][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2132.540411][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2132.540736][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2132.541009][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2132.541287][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2132.541610][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2132.541918][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2132.542252][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2132.542554][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2132.542861][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2132.543165][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2132.543493][ C0] ? get_stack_info+0x36/0xc0 [ 2132.543747][ C0] ? lock_acquire+0x1c1/0x220 [ 2132.543998][ C0] ? lock_release+0x1d5/0x250 [ 2132.544248][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2132.544507][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2132.544791][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2132.545091][ C0] ? lock_acquire+0x1c1/0x220 [ 2132.545349][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2132.545610][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2132.545884][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2132.546134][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2132.546399][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2132.546672][ C0] ? __inet_lookup_established+0x341/0x610 [ 2132.546987][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2132.547277][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2132.547566][ C0] ip_local_deliver+0x19d/0x480 [ 2132.547828][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2132.548119][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2132.548390][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2132.548668][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2132.548931][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2132.549275][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2132.549550][ C0] ip_rcv+0x564/0x740 [ 2132.549766][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2132.550011][ C0] ? set_track_prepare+0x8a/0xd0 [ 2132.550278][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2132.550569][ C0] ? rest_init+0x153/0x260 [ 2132.550810][ C0] ? skb_clone+0x10b/0x330 [ 2132.551054][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2132.551387][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2132.551706][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2132.552004][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2132.552318][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2132.552581][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2132.552829][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2132.553150][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2132.553452][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2132.553793][ C0] ? lock_acquire+0x1c1/0x220 [ 2132.554043][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2132.554353][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2132.554655][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2132.554987][ C0] ? __copy_skb_header+0xaf/0x490 [ 2132.555255][ C0] ? __skb_clone+0x57a/0x760 [ 2132.555499][ C0] netif_receive_skb+0x55/0x280 [ 2132.555767][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2132.556094][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2132.556439][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2132.556756][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2132.557043][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2132.557347][ C0] ? hlock_class+0x4e/0x130 [ 2132.557594][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2132.557919][ C0] ? place_entity+0x21/0x2f0 [ 2132.558164][ C0] ? resched_curr+0x219/0x280 [ 2132.558418][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2132.558690][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2132.558974][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2132.559249][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2132.559505][ C0] ? activate_task+0xf5/0x260 [ 2132.559755][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2132.560029][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2132.560303][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2132.560561][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2132.560849][ C0] ? get_stack_info+0x36/0xc0 [ 2132.561102][ C0] ? stack_access_ok+0xda/0x1f0 [ 2132.561362][ C0] ? get_reg+0x119/0x190 [ 2132.561595][ C0] __tcf_classify+0x32c/0x7d0 [ 2132.561847][ C0] tcf_classify+0x283/0x930 [ 2132.562088][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2132.562417][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2132.562685][ C0] ? arch_stack_walk+0x8c/0x100 [ 2132.562949][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2132.563244][ C0] tc_run+0x2e4/0x5d0 [ 2132.563462][ C0] ? __pfx_tc_run+0x10/0x10 [ 2132.563706][ C0] ? lock_acquire+0x1c1/0x220 [ 2132.563956][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2132.564231][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2132.564502][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2132.564789][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2132.565071][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2132.565390][ C0] ? neigh_hh_output+0x348/0x590 [ 2132.565670][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2132.565953][ C0] ip_finish_output2+0x786/0x18e0 [ 2132.566226][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2132.566524][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2132.566877][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2132.567167][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2132.567436][ C0] ? __ip_finish_output+0x10f/0x770 [ 2132.567714][ C0] ip_output+0x16b/0x4f0 [ 2132.567940][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2132.568226][ C0] ? __pfx_ip_output+0x10/0x10 [ 2132.568483][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2132.568785][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2132.569050][ C0] ? ip_local_out+0x114/0x3b0 [ 2132.569308][ C0] __ip_queue_xmit+0x672/0x1910 [ 2132.569572][ C0] ? __skb_clone+0x57a/0x760 [ 2132.569822][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2132.570105][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2132.570402][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2132.570720][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2132.570983][ C0] ? tcp_current_mss+0x40a/0x510 [ 2132.571248][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2132.571534][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2132.571811][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2132.572068][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2132.572339][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2132.572665][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2132.572942][ C0] ? ktime_get+0xb6/0x190 [ 2132.573180][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2132.573454][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2132.573738][ C0] tcp_write_timer+0x82/0x1d0 [ 2132.573993][ C0] call_timer_fn+0x176/0x430 [ 2132.574244][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2132.574521][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2132.574801][ C0] __run_timers.part.0+0x52d/0x890 [ 2132.575079][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2132.575361][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2132.575672][ C0] ? lock_acquire+0x1c1/0x220 [ 2132.575926][ C0] ? clockevents_program_event+0xf6/0x300 [ 2132.576237][ C0] ? lock_release+0x1d5/0x250 [ 2132.576488][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2132.576766][ C0] ? ktime_get+0xb6/0x190 [ 2132.576998][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2132.577297][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2132.577606][ C0] run_timer_softirq+0x72/0x100 [ 2132.577870][ C0] __do_softirq+0x1bc/0x7ff [ 2132.578115][ C0] irq_exit_rcu+0x98/0xc0 [ 2132.578350][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2132.578651][ C0] [ 2132.578807][ C0] [ 2132.578964][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2132.579280][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2132.579551][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2132.580572][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2132.580894][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2132.581319][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2132.581739][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2132.582161][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2132.582582][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2132.583007][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2132.583311][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2132.583586][ C0] default_idle_call+0x69/0xa0 [ 2132.583841][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2132.584106][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2132.584397][ C0] ? lock_release+0x1d5/0x250 [ 2132.584653][ C0] do_idle+0xfb/0x160 [ 2132.584873][ C0] cpu_startup_entry+0x55/0x60 [ 2132.585131][ C0] rest_init+0x153/0x260 [ 2132.585357][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2132.585658][ C0] arch_call_rest_init+0x13/0x40 [ 2132.585926][ C0] start_kernel+0x314/0x3d0 [ 2132.586173][ C0] x86_64_start_reservations+0x18/0x30 [ 2132.586472][ C0] x86_64_start_kernel+0xba/0x110 [ 2132.586740][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2132.587070][ C0] [ 2132.587238][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 880s! [ksoftirqd/1:22] [ 2132.587713][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2132.588907][ C1] irq event stamp: 3886976 [ 2132.589143][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2132.589646][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2132.590148][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2132.590650][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2132.591142][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2132.591640][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2132.592293][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2132.592638][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2132.593670][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2132.594002][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2132.594428][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2132.594850][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2132.595279][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2132.595711][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2132.596127][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2132.596592][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2132.596945][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2132.597365][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2132.597783][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2132.598203][ C1] Call Trace: [ 2132.598385][ C1] [ 2132.598544][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2132.598820][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2132.599081][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2132.599369][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2132.599656][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2132.599962][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2132.600244][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2132.600567][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2132.600840][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2132.601168][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2132.601481][ C1] [ 2132.601637][ C1] [ 2132.601795][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2132.602130][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2132.602434][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2132.602748][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2132.603051][ C1] ? run_ksoftirqd+0xb/0x60 [ 2132.603293][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2132.603622][ C1] ? __orc_find+0x9c/0xf0 [ 2132.603853][ C1] ? lock_acquire+0x1c1/0x220 [ 2132.604114][ C1] ? irqentry_enter+0x2b/0x60 [ 2132.604371][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2132.604639][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2132.604929][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2132.605232][ C1] ? lock_acquire+0x1c1/0x220 [ 2132.605479][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2132.605738][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2132.606016][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2132.606262][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2132.606521][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2132.606792][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2132.607082][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2132.607372][ C1] ip_local_deliver+0x19d/0x480 [ 2132.607633][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2132.607922][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2132.608194][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2132.608472][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2132.608735][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2132.609077][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2132.609352][ C1] ip_rcv+0x564/0x740 [ 2132.609567][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2132.609811][ C1] ? set_track_prepare+0x8a/0xd0 [ 2132.610079][ C1] ? irqentry_enter+0x2b/0x60 [ 2132.610333][ C1] ? irqentry_enter+0x2b/0x60 [ 2132.610587][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2132.610833][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2132.611155][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2132.611499][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2132.611812][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2132.612152][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2132.612450][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2132.612785][ C1] netif_receive_skb+0x55/0x280 [ 2132.613053][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2132.613383][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2132.613734][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2132.614048][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2132.614339][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2132.614644][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2132.614976][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2132.615260][ C1] ? arch_stack_walk+0x68/0x100 [ 2132.615518][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2132.615809][ C1] ? irqentry_enter+0x2b/0x60 [ 2132.616065][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2132.616389][ C1] ? irqentry_enter+0x2b/0x60 [ 2132.616641][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2132.616961][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2132.617245][ C1] ? arch_stack_walk+0x68/0x100 [ 2132.617507][ C1] __tcf_classify+0x32c/0x7d0 [ 2132.617756][ C1] tcf_classify+0x283/0x930 [ 2132.617998][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2132.618267][ C1] tc_run+0x2e4/0x5d0 [ 2132.618484][ C1] ? __pfx_tc_run+0x10/0x10 [ 2132.618730][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2132.618995][ C1] ? irqentry_enter+0x2b/0x60 [ 2132.619249][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2132.619537][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2132.619863][ C1] ip_finish_output2+0x786/0x18e0 [ 2132.620134][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2132.620421][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2132.620688][ C1] ? __ip_finish_output+0x10f/0x770 [ 2132.620964][ C1] ip_output+0x16b/0x4f0 [ 2132.621193][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2132.621515][ C1] ? __pfx_ip_output+0x10/0x10 [ 2132.621772][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2132.622128][ C1] ? __pfx_ip_output+0x10/0x10 [ 2132.622385][ C1] __ip_queue_xmit+0x672/0x1910 [ 2132.622645][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2132.622923][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2132.623219][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2132.623509][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2132.623805][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2132.624093][ C1] tcp_delack_timer+0x84/0x240 [ 2132.624348][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2132.624636][ C1] call_timer_fn+0x176/0x430 [ 2132.624887][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2132.625165][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2132.625447][ C1] __run_timers.part.0+0x52d/0x890 [ 2132.625726][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2132.626017][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2132.626321][ C1] ? __pfx___schedule+0x10/0x10 [ 2132.626578][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2132.626896][ C1] run_timer_softirq+0x72/0x100 [ 2132.627159][ C1] __do_softirq+0x1bc/0x7ff [ 2132.627403][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2132.627679][ C1] run_ksoftirqd+0x2e/0x60 [ 2132.627916][ C1] smpboot_thread_fn+0x30e/0x840 [ 2132.628185][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2132.628477][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2132.628768][ C1] kthread+0x292/0x360 [ 2132.628984][ C1] ? __pfx_kthread+0x10/0x10 [ 2132.629234][ C1] ret_from_fork+0x34/0x70 [ 2132.629474][ C1] ? __pfx_kthread+0x10/0x10 [ 2132.629724][ C1] ret_from_fork_asm+0x1b/0x30 [ 2132.629985][ C1] [ 2157.239024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 2157.239412][ C1] rcu: 1-....: (961865 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=234343 [ 2157.239992][ C1] rcu: (t=962930 jiffies g=1007429 q=31 ncpus=4) [ 2157.240332][ C1] Sending NMI from CPU 1 to CPUs 0: [ 2157.240616][ C0] NMI backtrace for cpu 0 [ 2157.240624][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2157.240628][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2157.240631][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2157.240639][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2157.240642][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2157.240645][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2157.240647][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2157.240649][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2157.240651][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2157.240653][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2157.240654][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2157.240657][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2157.240661][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2157.240663][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2157.240664][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2157.240666][ C0] Call Trace: [ 2157.240671][ C0] [ 2157.240675][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 2157.240681][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 2157.240687][ C0] ? nmi_handle+0x156/0x420 [ 2157.240692][ C0] ? default_do_nmi+0x41/0x100 [ 2157.240696][ C0] ? exc_nmi+0xf3/0x120 [ 2157.240698][ C0] ? end_repeat_nmi+0xf/0x60 [ 2157.240703][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2157.240707][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2157.240711][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2157.240715][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2157.240718][ C0] [ 2157.240719][ C0] [ 2157.240721][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2157.240724][ C0] ? get_stack_info+0x36/0xc0 [ 2157.240729][ C0] ? lock_acquire+0x1c1/0x220 [ 2157.240733][ C0] ? lock_release+0x1d5/0x250 [ 2157.240737][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2157.240742][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2157.240745][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2157.240748][ C0] ? lock_acquire+0x1c1/0x220 [ 2157.240750][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2157.240755][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2157.240759][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2157.240766][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2157.240769][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2157.240773][ C0] ? __inet_lookup_established+0x341/0x610 [ 2157.240779][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2157.240791][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2157.240795][ C0] ip_local_deliver+0x19d/0x480 [ 2157.240798][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2157.240801][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2157.240806][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2157.240810][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2157.240813][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2157.240817][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2157.240827][ C0] ip_rcv+0x564/0x740 [ 2157.240830][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2157.240833][ C0] ? set_track_prepare+0x8a/0xd0 [ 2157.240838][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2157.240840][ C0] ? rest_init+0x153/0x260 [ 2157.240843][ C0] ? skb_clone+0x10b/0x330 [ 2157.240848][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2157.240854][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2157.240860][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2157.240865][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2157.240875][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2157.240878][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2157.240880][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2157.240885][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2157.240888][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2157.240891][ C0] ? lock_acquire+0x1c1/0x220 [ 2157.240894][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2157.240897][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2157.240900][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2157.240903][ C0] ? __copy_skb_header+0xaf/0x490 [ 2157.240906][ C0] ? __skb_clone+0x57a/0x760 [ 2157.240909][ C0] netif_receive_skb+0x55/0x280 [ 2157.240911][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2157.240920][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2157.240927][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2157.240934][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2157.240939][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2157.240948][ C0] ? hlock_class+0x4e/0x130 [ 2157.240955][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2157.240965][ C0] ? place_entity+0x21/0x2f0 [ 2157.240968][ C0] ? resched_curr+0x219/0x280 [ 2157.240972][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2157.240975][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2157.240978][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2157.240982][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2157.240985][ C0] ? activate_task+0xf5/0x260 [ 2157.240988][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2157.240993][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2157.240996][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2157.241000][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2157.241003][ C0] ? get_stack_info+0x36/0xc0 [ 2157.241007][ C0] ? stack_access_ok+0xda/0x1f0 [ 2157.241009][ C0] ? get_reg+0x119/0x190 [ 2157.241013][ C0] __tcf_classify+0x32c/0x7d0 [ 2157.241017][ C0] tcf_classify+0x283/0x930 [ 2157.241021][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2157.241026][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2157.241028][ C0] ? arch_stack_walk+0x8c/0x100 [ 2157.241034][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2157.241037][ C0] tc_run+0x2e4/0x5d0 [ 2157.241042][ C0] ? __pfx_tc_run+0x10/0x10 [ 2157.241045][ C0] ? lock_acquire+0x1c1/0x220 [ 2157.241048][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2157.241052][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2157.241058][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2157.241061][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2157.241065][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2157.241070][ C0] ? neigh_hh_output+0x348/0x590 [ 2157.241074][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2157.241079][ C0] ip_finish_output2+0x786/0x18e0 [ 2157.241082][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2157.241088][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2157.241096][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2157.241099][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2157.241103][ C0] ? __ip_finish_output+0x10f/0x770 [ 2157.241107][ C0] ip_output+0x16b/0x4f0 [ 2157.241110][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2157.241114][ C0] ? __pfx_ip_output+0x10/0x10 [ 2157.241117][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2157.241122][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2157.241125][ C0] ? ip_local_out+0x114/0x3b0 [ 2157.241129][ C0] __ip_queue_xmit+0x672/0x1910 [ 2157.241133][ C0] ? __skb_clone+0x57a/0x760 [ 2157.241137][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2157.241144][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2157.241149][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2157.241153][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2157.241158][ C0] ? tcp_current_mss+0x40a/0x510 [ 2157.241161][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2157.241164][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2157.241167][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2157.241169][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2157.241172][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2157.241176][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2157.241180][ C0] ? ktime_get+0xb6/0x190 [ 2157.241185][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2157.241189][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2157.241192][ C0] tcp_write_timer+0x82/0x1d0 [ 2157.241196][ C0] call_timer_fn+0x176/0x430 [ 2157.241199][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2157.241204][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2157.241208][ C0] __run_timers.part.0+0x52d/0x890 [ 2157.241211][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2157.241216][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2157.241219][ C0] ? lock_acquire+0x1c1/0x220 [ 2157.241221][ C0] ? clockevents_program_event+0xf6/0x300 [ 2157.241225][ C0] ? lock_release+0x1d5/0x250 [ 2157.241228][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2157.241231][ C0] ? ktime_get+0xb6/0x190 [ 2157.241234][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2157.241237][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2157.241242][ C0] run_timer_softirq+0x72/0x100 [ 2157.241245][ C0] __do_softirq+0x1bc/0x7ff [ 2157.241250][ C0] irq_exit_rcu+0x98/0xc0 [ 2157.241253][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2157.241257][ C0] [ 2157.241257][ C0] [ 2157.241259][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2157.241265][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2157.241268][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2157.241270][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2157.241272][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2157.241274][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2157.241275][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2157.241277][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2157.241279][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2157.241282][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2157.241286][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2157.241290][ C0] default_idle_call+0x69/0xa0 [ 2157.241293][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2157.241295][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2157.241300][ C0] ? lock_release+0x1d5/0x250 [ 2157.241305][ C0] do_idle+0xfb/0x160 [ 2157.241308][ C0] cpu_startup_entry+0x55/0x60 [ 2157.241311][ C0] rest_init+0x153/0x260 [ 2157.241313][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2157.241319][ C0] arch_call_rest_init+0x13/0x40 [ 2157.241325][ C0] start_kernel+0x314/0x3d0 [ 2157.241328][ C0] x86_64_start_reservations+0x18/0x30 [ 2157.241333][ C0] x86_64_start_kernel+0xba/0x110 [ 2157.241337][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2157.241346][ C0] [ 2157.241613][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2157.295653][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2157.296308][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2157.296657][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2157.297685][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2157.298016][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2157.298439][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2157.298861][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2157.299286][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2157.299711][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2157.300133][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2157.300607][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2157.300954][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2157.301375][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2157.301791][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2157.302209][ C1] Call Trace: [ 2157.302388][ C1] [ 2157.302543][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 2157.302834][ C1] ? print_cpu_stall+0x263/0x6a0 [ 2157.303099][ C1] ? check_cpu_stall+0x284/0x500 [ 2157.303367][ C1] ? rcu_pending+0x92/0x360 [ 2157.303607][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 2157.303889][ C1] ? update_process_times+0xb9/0x110 [ 2157.304175][ C1] ? tick_sched_handle+0x67/0x130 [ 2157.304443][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 2157.304739][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2157.304997][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 2157.305322][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2157.305616][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2157.305919][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2157.306199][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2157.306516][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2157.306794][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2157.307118][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2157.307426][ C1] [ 2157.307585][ C1] [ 2157.307744][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2157.308079][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2157.308381][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2157.308690][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2157.308995][ C1] ? run_ksoftirqd+0xb/0x60 [ 2157.309242][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2157.309572][ C1] ? __orc_find+0x9c/0xf0 [ 2157.309801][ C1] ? lock_acquire+0x1c1/0x220 [ 2157.310054][ C1] ? irqentry_enter+0x2b/0x60 [ 2157.310305][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2157.310566][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2157.310850][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2157.311149][ C1] ? lock_acquire+0x1c1/0x220 [ 2157.311404][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2157.311659][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2157.311935][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2157.312184][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2157.312443][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2157.312712][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2157.313000][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2157.313294][ C1] ip_local_deliver+0x19d/0x480 [ 2157.313559][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2157.313849][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2157.314117][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2157.314392][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2157.314655][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2157.314993][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2157.315269][ C1] ip_rcv+0x564/0x740 [ 2157.315488][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2157.315736][ C1] ? set_track_prepare+0x8a/0xd0 [ 2157.316004][ C1] ? irqentry_enter+0x2b/0x60 [ 2157.316254][ C1] ? irqentry_enter+0x2b/0x60 [ 2157.316504][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2157.316744][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2157.317058][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2157.317397][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2157.317705][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2157.318049][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2157.318352][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2157.318684][ C1] netif_receive_skb+0x55/0x280 [ 2157.318944][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2157.319274][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2157.319621][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2157.319936][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2157.320229][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2157.320530][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2157.320856][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2157.321134][ C1] ? arch_stack_walk+0x68/0x100 [ 2157.321398][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2157.321678][ C1] ? irqentry_enter+0x2b/0x60 [ 2157.321930][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2157.322256][ C1] ? irqentry_enter+0x2b/0x60 [ 2157.322507][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2157.322826][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2157.323110][ C1] ? arch_stack_walk+0x68/0x100 [ 2157.323369][ C1] __tcf_classify+0x32c/0x7d0 [ 2157.323622][ C1] tcf_classify+0x283/0x930 [ 2157.323862][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2157.324130][ C1] tc_run+0x2e4/0x5d0 [ 2157.324343][ C1] ? __pfx_tc_run+0x10/0x10 [ 2157.324588][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2157.324853][ C1] ? irqentry_enter+0x2b/0x60 [ 2157.325105][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2157.325392][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2157.325724][ C1] ip_finish_output2+0x786/0x18e0 [ 2157.325995][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2157.326288][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2157.326551][ C1] ? __ip_finish_output+0x10f/0x770 [ 2157.326830][ C1] ip_output+0x16b/0x4f0 [ 2157.327061][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2157.327380][ C1] ? __pfx_ip_output+0x10/0x10 [ 2157.327639][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2157.327988][ C1] ? __pfx_ip_output+0x10/0x10 [ 2157.328244][ C1] __ip_queue_xmit+0x672/0x1910 [ 2157.328510][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2157.328792][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2157.329092][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2157.329382][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2157.329684][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2157.329970][ C1] tcp_delack_timer+0x84/0x240 [ 2157.330228][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2157.330509][ C1] call_timer_fn+0x176/0x430 [ 2157.330753][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2157.331030][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2157.331306][ C1] __run_timers.part.0+0x52d/0x890 [ 2157.331576][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2157.331865][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2157.332166][ C1] ? __pfx___schedule+0x10/0x10 [ 2157.332425][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2157.332742][ C1] run_timer_softirq+0x72/0x100 [ 2157.333003][ C1] __do_softirq+0x1bc/0x7ff [ 2157.333251][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2157.333527][ C1] run_ksoftirqd+0x2e/0x60 [ 2157.333765][ C1] smpboot_thread_fn+0x30e/0x840 [ 2157.334033][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2157.334323][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2157.334615][ C1] kthread+0x292/0x360 [ 2157.334831][ C1] ? __pfx_kthread+0x10/0x10 [ 2157.335080][ C1] ret_from_fork+0x34/0x70 [ 2157.335316][ C1] ? __pfx_kthread+0x10/0x10 [ 2157.335570][ C1] ret_from_fork_asm+0x1b/0x30 [ 2157.335833][ C1] [ 2184.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 928s! [swapper/0:0] [ 2184.527907][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2184.529103][ C0] irq event stamp: 27567077 [ 2184.529345][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2184.529876][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2184.530347][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2184.530845][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2184.531334][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2184.531810][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2184.532460][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2184.532802][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2184.533819][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2184.534146][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2184.534565][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2184.534985][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2184.535411][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2184.535826][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2184.536243][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2184.536707][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2184.537060][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2184.537477][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2184.537894][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2184.538315][ C0] Call Trace: [ 2184.538496][ C0] [ 2184.538652][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2184.538925][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2184.539182][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2184.539467][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2184.539753][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2184.540057][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2184.540336][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2184.540662][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2184.540934][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2184.541211][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2184.541530][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2184.541838][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2184.542173][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2184.542473][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2184.542778][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2184.543083][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2184.543409][ C0] ? get_stack_info+0x36/0xc0 [ 2184.543661][ C0] ? lock_acquire+0x1c1/0x220 [ 2184.543911][ C0] ? lock_release+0x1d5/0x250 [ 2184.544161][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2184.544421][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2184.544708][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2184.545004][ C0] ? lock_acquire+0x1c1/0x220 [ 2184.545254][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2184.545513][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2184.545784][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2184.546031][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2184.546293][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2184.546563][ C0] ? __inet_lookup_established+0x341/0x610 [ 2184.546882][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2184.547170][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2184.547460][ C0] ip_local_deliver+0x19d/0x480 [ 2184.547720][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2184.548004][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2184.548273][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2184.548546][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2184.548807][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2184.549149][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2184.549422][ C0] ip_rcv+0x564/0x740 [ 2184.549633][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2184.549871][ C0] ? set_track_prepare+0x8a/0xd0 [ 2184.550134][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2184.550425][ C0] ? rest_init+0x153/0x260 [ 2184.550660][ C0] ? skb_clone+0x10b/0x330 [ 2184.550906][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2184.551237][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2184.551555][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2184.551855][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2184.552164][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2184.552425][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2184.552669][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2184.552988][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2184.553292][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2184.553629][ C0] ? lock_acquire+0x1c1/0x220 [ 2184.553875][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2184.554183][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2184.554483][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2184.554811][ C0] ? __copy_skb_header+0xaf/0x490 [ 2184.555077][ C0] ? __skb_clone+0x57a/0x760 [ 2184.555326][ C0] netif_receive_skb+0x55/0x280 [ 2184.555582][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2184.555905][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2184.556253][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2184.556566][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2184.556851][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2184.557152][ C0] ? hlock_class+0x4e/0x130 [ 2184.557394][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2184.557722][ C0] ? place_entity+0x21/0x2f0 [ 2184.557970][ C0] ? resched_curr+0x219/0x280 [ 2184.558225][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2184.558494][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2184.558777][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2184.559052][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2184.559311][ C0] ? activate_task+0xf5/0x260 [ 2184.559560][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2184.559835][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2184.560109][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2184.560367][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2184.560658][ C0] ? get_stack_info+0x36/0xc0 [ 2184.560914][ C0] ? stack_access_ok+0xda/0x1f0 [ 2184.561175][ C0] ? get_reg+0x119/0x190 [ 2184.561402][ C0] __tcf_classify+0x32c/0x7d0 [ 2184.561656][ C0] tcf_classify+0x283/0x930 [ 2184.561895][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2184.562220][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2184.562490][ C0] ? arch_stack_walk+0x8c/0x100 [ 2184.562755][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2184.563048][ C0] tc_run+0x2e4/0x5d0 [ 2184.563267][ C0] ? __pfx_tc_run+0x10/0x10 [ 2184.563508][ C0] ? lock_acquire+0x1c1/0x220 [ 2184.563756][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2184.564032][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2184.564301][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2184.564585][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2184.564863][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2184.565185][ C0] ? neigh_hh_output+0x348/0x590 [ 2184.565468][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2184.565751][ C0] ip_finish_output2+0x786/0x18e0 [ 2184.566025][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2184.566321][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2184.566677][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2184.566969][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2184.567238][ C0] ? __ip_finish_output+0x10f/0x770 [ 2184.567514][ C0] ip_output+0x16b/0x4f0 [ 2184.567740][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2184.568026][ C0] ? __pfx_ip_output+0x10/0x10 [ 2184.568282][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2184.568586][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2184.568849][ C0] ? ip_local_out+0x114/0x3b0 [ 2184.569104][ C0] __ip_queue_xmit+0x672/0x1910 [ 2184.569367][ C0] ? __skb_clone+0x57a/0x760 [ 2184.569616][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2184.569896][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2184.570193][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2184.570515][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2184.570776][ C0] ? tcp_current_mss+0x40a/0x510 [ 2184.571043][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2184.571327][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2184.571601][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2184.571853][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2184.572126][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2184.572445][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2184.572721][ C0] ? ktime_get+0xb6/0x190 [ 2184.572952][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2184.573227][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2184.573512][ C0] tcp_write_timer+0x82/0x1d0 [ 2184.573761][ C0] call_timer_fn+0x176/0x430 [ 2184.574005][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2184.574283][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2184.574556][ C0] __run_timers.part.0+0x52d/0x890 [ 2184.574833][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2184.575115][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2184.575420][ C0] ? lock_acquire+0x1c1/0x220 [ 2184.575671][ C0] ? clockevents_program_event+0xf6/0x300 [ 2184.575981][ C0] ? lock_release+0x1d5/0x250 [ 2184.576237][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2184.576515][ C0] ? ktime_get+0xb6/0x190 [ 2184.576750][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2184.577051][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2184.577361][ C0] run_timer_softirq+0x72/0x100 [ 2184.577623][ C0] __do_softirq+0x1bc/0x7ff [ 2184.577873][ C0] irq_exit_rcu+0x98/0xc0 [ 2184.578108][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2184.578411][ C0] [ 2184.578567][ C0] [ 2184.578724][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2184.579046][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2184.579317][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2184.580343][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2184.580672][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2184.581093][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2184.581518][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2184.581945][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2184.582368][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2184.582793][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2184.583102][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2184.583380][ C0] default_idle_call+0x69/0xa0 [ 2184.583635][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2184.583905][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2184.584199][ C0] ? lock_release+0x1d5/0x250 [ 2184.584454][ C0] do_idle+0xfb/0x160 [ 2184.584670][ C0] cpu_startup_entry+0x55/0x60 [ 2184.584930][ C0] rest_init+0x153/0x260 [ 2184.585161][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2184.585460][ C0] arch_call_rest_init+0x13/0x40 [ 2184.585727][ C0] start_kernel+0x314/0x3d0 [ 2184.585973][ C0] x86_64_start_reservations+0x18/0x30 [ 2184.586268][ C0] x86_64_start_kernel+0xba/0x110 [ 2184.586537][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2184.586864][ C0] [ 2184.587028][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 928s! [ksoftirqd/1:22] [ 2184.587493][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2184.588691][ C1] irq event stamp: 3886976 [ 2184.588931][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2184.589428][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2184.589920][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2184.590416][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2184.590912][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2184.591406][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2184.592052][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 2184.592389][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 2184.593420][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2184.593750][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2184.594173][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2184.594595][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2184.595023][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2184.595455][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2184.595872][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2184.596340][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2184.596695][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2184.597117][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2184.597536][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2184.597957][ C1] Call Trace: [ 2184.598140][ C1] [ 2184.598299][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2184.598574][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2184.598832][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2184.599121][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2184.599409][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2184.599715][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2184.599997][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2184.600323][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2184.600599][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2184.600926][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2184.601242][ C1] [ 2184.601398][ C1] [ 2184.601556][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2184.601886][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2184.602192][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 2184.602499][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2184.602803][ C1] ? run_ksoftirqd+0xb/0x60 [ 2184.603049][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2184.603381][ C1] ? __orc_find+0x9c/0xf0 [ 2184.603611][ C1] ? lock_acquire+0x1c1/0x220 [ 2184.603863][ C1] ? irqentry_enter+0x2b/0x60 [ 2184.604117][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2184.604378][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2184.604663][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2184.604961][ C1] ? lock_acquire+0x1c1/0x220 [ 2184.605213][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2184.605474][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2184.605747][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2184.605997][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2184.606263][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2184.606536][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2184.606826][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2184.607122][ C1] ip_local_deliver+0x19d/0x480 [ 2184.607380][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2184.607665][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2184.607930][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2184.608214][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2184.608480][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2184.608816][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2184.609099][ C1] ip_rcv+0x564/0x740 [ 2184.609315][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2184.609561][ C1] ? set_track_prepare+0x8a/0xd0 [ 2184.609831][ C1] ? irqentry_enter+0x2b/0x60 [ 2184.610081][ C1] ? irqentry_enter+0x2b/0x60 [ 2184.610330][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2184.610571][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2184.610887][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2184.611228][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2184.611536][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2184.611879][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2184.612182][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2184.612515][ C1] netif_receive_skb+0x55/0x280 [ 2184.612775][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2184.613107][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2184.613455][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2184.613769][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2184.614058][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2184.614362][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2184.614690][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2184.614967][ C1] ? arch_stack_walk+0x68/0x100 [ 2184.615234][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2184.615523][ C1] ? irqentry_enter+0x2b/0x60 [ 2184.615772][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2184.616094][ C1] ? irqentry_enter+0x2b/0x60 [ 2184.616350][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2184.616673][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2184.616951][ C1] ? arch_stack_walk+0x68/0x100 [ 2184.617217][ C1] __tcf_classify+0x32c/0x7d0 [ 2184.617473][ C1] tcf_classify+0x283/0x930 [ 2184.617718][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2184.617992][ C1] tc_run+0x2e4/0x5d0 [ 2184.618211][ C1] ? __pfx_tc_run+0x10/0x10 [ 2184.618459][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2184.618728][ C1] ? irqentry_enter+0x2b/0x60 [ 2184.618977][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2184.619263][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2184.619587][ C1] ip_finish_output2+0x786/0x18e0 [ 2184.619859][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2184.620152][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2184.620416][ C1] ? __ip_finish_output+0x10f/0x770 [ 2184.620697][ C1] ip_output+0x16b/0x4f0 [ 2184.620927][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2184.621249][ C1] ? __pfx_ip_output+0x10/0x10 [ 2184.621509][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2184.621859][ C1] ? __pfx_ip_output+0x10/0x10 [ 2184.622116][ C1] __ip_queue_xmit+0x672/0x1910 [ 2184.622385][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2184.622668][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2184.622970][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2184.623262][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2184.623562][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2184.623850][ C1] tcp_delack_timer+0x84/0x240 [ 2184.624109][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2184.624394][ C1] call_timer_fn+0x176/0x430 [ 2184.624642][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2184.624918][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2184.625195][ C1] __run_timers.part.0+0x52d/0x890 [ 2184.625473][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2184.625760][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2184.626060][ C1] ? __pfx___schedule+0x10/0x10 [ 2184.626321][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2184.626644][ C1] run_timer_softirq+0x72/0x100 [ 2184.626899][ C1] __do_softirq+0x1bc/0x7ff [ 2184.627141][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2184.627414][ C1] run_ksoftirqd+0x2e/0x60 [ 2184.627654][ C1] smpboot_thread_fn+0x30e/0x840 [ 2184.627919][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2184.628215][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2184.628504][ C1] kthread+0x292/0x360 [ 2184.628721][ C1] ? __pfx_kthread+0x10/0x10 [ 2184.628963][ C1] ret_from_fork+0x34/0x70 [ 2184.629204][ C1] ? __pfx_kthread+0x10/0x10 [ 2184.629451][ C1] ret_from_fork_asm+0x1b/0x30 [ 2184.629713][ C1] [ 2212.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 954s! [swapper/0:0] [ 2212.527907][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2212.529103][ C0] irq event stamp: 27567077 [ 2212.529345][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2212.529874][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2212.530346][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2212.530847][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2212.531341][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2212.531821][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2212.532474][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2212.532815][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2212.533837][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2212.534168][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2212.534587][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2212.535006][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2212.535433][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2212.535848][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2212.536263][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2212.536726][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2212.537079][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2212.537500][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2212.537917][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2212.538336][ C0] Call Trace: [ 2212.538517][ C0] [ 2212.538675][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2212.538948][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2212.539204][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2212.539491][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2212.539776][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2212.540082][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2212.540364][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2212.540686][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2212.540959][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2212.541237][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2212.541558][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2212.541867][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2212.542198][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2212.542500][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2212.542806][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2212.543113][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2212.543441][ C0] ? get_stack_info+0x36/0xc0 [ 2212.543694][ C0] ? lock_acquire+0x1c1/0x220 [ 2212.543945][ C0] ? lock_release+0x1d5/0x250 [ 2212.544195][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2212.544454][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2212.544739][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2212.545037][ C0] ? lock_acquire+0x1c1/0x220 [ 2212.545294][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2212.545545][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2212.545817][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2212.546066][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2212.546333][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2212.546603][ C0] ? __inet_lookup_established+0x341/0x610 [ 2212.546922][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2212.547214][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2212.547504][ C0] ip_local_deliver+0x19d/0x480 [ 2212.547765][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2212.548051][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2212.548316][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2212.548589][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2212.548850][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2212.549189][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2212.549463][ C0] ip_rcv+0x564/0x740 [ 2212.549674][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2212.549912][ C0] ? set_track_prepare+0x8a/0xd0 [ 2212.550175][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2212.550467][ C0] ? rest_init+0x153/0x260 [ 2212.550706][ C0] ? skb_clone+0x10b/0x330 [ 2212.550948][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2212.551279][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2212.551599][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2212.551900][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2212.552217][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2212.552479][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2212.552722][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2212.553041][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2212.553341][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2212.553679][ C0] ? lock_acquire+0x1c1/0x220 [ 2212.553924][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2212.554233][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2212.554533][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2212.554862][ C0] ? __copy_skb_header+0xaf/0x490 [ 2212.555129][ C0] ? __skb_clone+0x57a/0x760 [ 2212.555380][ C0] netif_receive_skb+0x55/0x280 [ 2212.555637][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2212.555961][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2212.556307][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2212.556621][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2212.556906][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2212.557203][ C0] ? hlock_class+0x4e/0x130 [ 2212.557449][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2212.557782][ C0] ? place_entity+0x21/0x2f0 [ 2212.558030][ C0] ? resched_curr+0x219/0x280 [ 2212.558288][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2212.558557][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2212.558841][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2212.559117][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2212.559373][ C0] ? activate_task+0xf5/0x260 [ 2212.559620][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2212.559893][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2212.560166][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2212.560424][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2212.560715][ C0] ? get_stack_info+0x36/0xc0 [ 2212.560973][ C0] ? stack_access_ok+0xda/0x1f0 [ 2212.561236][ C0] ? get_reg+0x119/0x190 [ 2212.561467][ C0] __tcf_classify+0x32c/0x7d0 [ 2212.561720][ C0] tcf_classify+0x283/0x930 [ 2212.561963][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2212.562290][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2212.562563][ C0] ? arch_stack_walk+0x8c/0x100 [ 2212.562828][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2212.563123][ C0] tc_run+0x2e4/0x5d0 [ 2212.563337][ C0] ? __pfx_tc_run+0x10/0x10 [ 2212.563579][ C0] ? lock_acquire+0x1c1/0x220 [ 2212.563828][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2212.564104][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2212.564374][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2212.564661][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2212.564938][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2212.565264][ C0] ? neigh_hh_output+0x348/0x590 [ 2212.565530][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2212.565812][ C0] ip_finish_output2+0x786/0x18e0 [ 2212.566086][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2212.566382][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2212.566736][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2212.567027][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2212.567297][ C0] ? __ip_finish_output+0x10f/0x770 [ 2212.567575][ C0] ip_output+0x16b/0x4f0 [ 2212.567805][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2212.568091][ C0] ? __pfx_ip_output+0x10/0x10 [ 2212.568346][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2212.568651][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2212.568914][ C0] ? ip_local_out+0x114/0x3b0 [ 2212.569169][ C0] __ip_queue_xmit+0x672/0x1910 [ 2212.569438][ C0] ? __skb_clone+0x57a/0x760 [ 2212.569688][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2212.569969][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2212.570264][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2212.570582][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2212.570843][ C0] ? tcp_current_mss+0x40a/0x510 [ 2212.571106][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2212.571393][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2212.571669][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2212.571926][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2212.572201][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2212.572521][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2212.572797][ C0] ? ktime_get+0xb6/0x190 [ 2212.573028][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2212.573300][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2212.573584][ C0] tcp_write_timer+0x82/0x1d0 [ 2212.573833][ C0] call_timer_fn+0x176/0x430 [ 2212.574077][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2212.574355][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2212.574628][ C0] __run_timers.part.0+0x52d/0x890 [ 2212.574904][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2212.575192][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2212.575490][ C0] ? lock_acquire+0x1c1/0x220 [ 2212.575741][ C0] ? clockevents_program_event+0xf6/0x300 [ 2212.576054][ C0] ? lock_release+0x1d5/0x250 [ 2212.576309][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2212.576587][ C0] ? ktime_get+0xb6/0x190 [ 2212.576822][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2212.577123][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2212.577431][ C0] run_timer_softirq+0x72/0x100 [ 2212.577691][ C0] __do_softirq+0x1bc/0x7ff [ 2212.577937][ C0] irq_exit_rcu+0x98/0xc0 [ 2212.578174][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2212.578476][ C0] [ 2212.578633][ C0] [ 2212.578789][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2212.579111][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2212.579381][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2212.580411][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2212.580739][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2212.581162][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2212.581590][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2212.582018][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2212.582440][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2212.582864][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2212.583172][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2212.583447][ C0] default_idle_call+0x69/0xa0 [ 2212.583701][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2212.583969][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2212.584259][ C0] ? lock_release+0x1d5/0x250 [ 2212.584512][ C0] do_idle+0xfb/0x160 [ 2212.584726][ C0] cpu_startup_entry+0x55/0x60 [ 2212.584982][ C0] rest_init+0x153/0x260 [ 2212.585213][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2212.585503][ C0] arch_call_rest_init+0x13/0x40 [ 2212.585770][ C0] start_kernel+0x314/0x3d0 [ 2212.586017][ C0] x86_64_start_reservations+0x18/0x30 [ 2212.586312][ C0] x86_64_start_kernel+0xba/0x110 [ 2212.586579][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2212.586904][ C0] [ 2212.587067][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 954s! [ksoftirqd/1:22] [ 2212.587534][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2212.588733][ C1] irq event stamp: 3886976 [ 2212.588970][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2212.589473][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2212.589973][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2212.590476][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2212.590967][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2212.591467][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2212.592116][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2212.592462][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2212.593487][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2212.593812][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2212.594240][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2212.594660][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2212.595081][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2212.595506][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2212.595925][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2212.596395][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2212.596747][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2212.597171][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2212.597595][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2212.598015][ C1] Call Trace: [ 2212.598195][ C1] [ 2212.598353][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2212.598630][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2212.598888][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2212.599179][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2212.599467][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2212.599772][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2212.600055][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2212.600381][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2212.600655][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2212.600983][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2212.601300][ C1] [ 2212.601457][ C1] [ 2212.601614][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2212.601942][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2212.602252][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2212.602565][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2212.602867][ C1] ? run_ksoftirqd+0xb/0x60 [ 2212.603113][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2212.603439][ C1] ? __orc_find+0x9c/0xf0 [ 2212.603673][ C1] ? lock_acquire+0x1c1/0x220 [ 2212.603927][ C1] ? irqentry_enter+0x2b/0x60 [ 2212.604184][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2212.604447][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2212.604737][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2212.605041][ C1] ? lock_acquire+0x1c1/0x220 [ 2212.605302][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2212.605560][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2212.605834][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2212.606080][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2212.606338][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2212.606609][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2212.606898][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2212.607191][ C1] ip_local_deliver+0x19d/0x480 [ 2212.607453][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2212.607740][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2212.608009][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2212.608287][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2212.608552][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2212.608891][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2212.609167][ C1] ip_rcv+0x564/0x740 [ 2212.609380][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2212.609622][ C1] ? set_track_prepare+0x8a/0xd0 [ 2212.609889][ C1] ? irqentry_enter+0x2b/0x60 [ 2212.610146][ C1] ? irqentry_enter+0x2b/0x60 [ 2212.610404][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2212.610653][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2212.610971][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2212.611317][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2212.611632][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2212.611971][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2212.612272][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2212.612609][ C1] netif_receive_skb+0x55/0x280 [ 2212.612871][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2212.613203][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2212.613556][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2212.613867][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2212.614160][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2212.614466][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2212.614800][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2212.615085][ C1] ? arch_stack_walk+0x68/0x100 [ 2212.615357][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2212.615637][ C1] ? irqentry_enter+0x2b/0x60 [ 2212.615892][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2212.616213][ C1] ? irqentry_enter+0x2b/0x60 [ 2212.616460][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2212.616783][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2212.617067][ C1] ? arch_stack_walk+0x68/0x100 [ 2212.617327][ C1] __tcf_classify+0x32c/0x7d0 [ 2212.617576][ C1] tcf_classify+0x283/0x930 [ 2212.617818][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2212.618086][ C1] tc_run+0x2e4/0x5d0 [ 2212.618301][ C1] ? __pfx_tc_run+0x10/0x10 [ 2212.618542][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2212.618807][ C1] ? irqentry_enter+0x2b/0x60 [ 2212.619064][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2212.619353][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2212.619674][ C1] ip_finish_output2+0x786/0x18e0 [ 2212.619943][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2212.620235][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2212.620500][ C1] ? __ip_finish_output+0x10f/0x770 [ 2212.620775][ C1] ip_output+0x16b/0x4f0 [ 2212.621002][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2212.621322][ C1] ? __pfx_ip_output+0x10/0x10 [ 2212.621576][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2212.621931][ C1] ? __pfx_ip_output+0x10/0x10 [ 2212.622190][ C1] __ip_queue_xmit+0x672/0x1910 [ 2212.622448][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2212.622726][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2212.623019][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2212.623303][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2212.623597][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2212.623882][ C1] tcp_delack_timer+0x84/0x240 [ 2212.624141][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2212.624429][ C1] call_timer_fn+0x176/0x430 [ 2212.624681][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2212.624953][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2212.625243][ C1] __run_timers.part.0+0x52d/0x890 [ 2212.625514][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2212.625804][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2212.626109][ C1] ? __pfx___schedule+0x10/0x10 [ 2212.626369][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2212.626690][ C1] run_timer_softirq+0x72/0x100 [ 2212.626955][ C1] __do_softirq+0x1bc/0x7ff [ 2212.627203][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2212.627479][ C1] run_ksoftirqd+0x2e/0x60 [ 2212.627716][ C1] smpboot_thread_fn+0x30e/0x840 [ 2212.627982][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2212.628273][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2212.628567][ C1] kthread+0x292/0x360 [ 2212.628786][ C1] ? __pfx_kthread+0x10/0x10 [ 2212.629036][ C1] ret_from_fork+0x34/0x70 [ 2212.629277][ C1] ? __pfx_kthread+0x10/0x10 [ 2212.629525][ C1] ret_from_fork_asm+0x1b/0x30 [ 2212.629784][ C1] [ 2235.337023][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 2235.337417][ C0] rcu: 0-....: (1040978 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=253203 [ 2235.337937][ C0] rcu: (t=1041028 jiffies g=1007429 q=31 ncpus=4) [ 2235.338282][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2235.338765][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2235.339407][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2235.339751][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2235.340768][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2235.341092][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2235.341510][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2235.341927][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2235.342348][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2235.342764][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2235.343181][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2235.343644][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2235.344001][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2235.344420][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2235.344837][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2235.345260][ C0] Call Trace: [ 2235.345437][ C0] [ 2235.345592][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 2235.345880][ C0] ? print_cpu_stall+0x263/0x6a0 [ 2235.346144][ C0] ? check_cpu_stall+0x284/0x500 [ 2235.346411][ C0] ? rcu_pending+0x92/0x360 [ 2235.346652][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 2235.346934][ C0] ? update_process_times+0xb9/0x110 [ 2235.347221][ C0] ? tick_sched_handle+0x67/0x130 [ 2235.347488][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 2235.347784][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2235.348039][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 2235.348362][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2235.348649][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2235.348953][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2235.349234][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2235.349556][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2235.349829][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2235.350106][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2235.350425][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2235.350735][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2235.351067][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2235.351367][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2235.351673][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2235.351979][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2235.352306][ C0] ? get_stack_info+0x36/0xc0 [ 2235.352559][ C0] ? lock_acquire+0x1c1/0x220 [ 2235.352810][ C0] ? lock_release+0x1d5/0x250 [ 2235.353062][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2235.353321][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2235.353605][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2235.353901][ C0] ? lock_acquire+0x1c1/0x220 [ 2235.354152][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2235.354406][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2235.354679][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2235.354925][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2235.355191][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2235.355462][ C0] ? __inet_lookup_established+0x341/0x610 [ 2235.355777][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2235.356067][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2235.356357][ C0] ip_local_deliver+0x19d/0x480 [ 2235.356621][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2235.356908][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2235.357175][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2235.357450][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2235.357711][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2235.358051][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2235.358327][ C0] ip_rcv+0x564/0x740 [ 2235.358541][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2235.358782][ C0] ? set_track_prepare+0x8a/0xd0 [ 2235.359048][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2235.359343][ C0] ? rest_init+0x153/0x260 [ 2235.359578][ C0] ? skb_clone+0x10b/0x330 [ 2235.359821][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2235.360155][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2235.360474][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2235.360778][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2235.361089][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2235.361353][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2235.361597][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2235.361918][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2235.362220][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2235.362558][ C0] ? lock_acquire+0x1c1/0x220 [ 2235.362804][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2235.363113][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2235.363413][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2235.363747][ C0] ? __copy_skb_header+0xaf/0x490 [ 2235.364014][ C0] ? __skb_clone+0x57a/0x760 [ 2235.364265][ C0] netif_receive_skb+0x55/0x280 [ 2235.364529][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2235.364859][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2235.365219][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2235.365532][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2235.365818][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2235.366114][ C0] ? hlock_class+0x4e/0x130 [ 2235.366357][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2235.366686][ C0] ? place_entity+0x21/0x2f0 [ 2235.366933][ C0] ? resched_curr+0x219/0x280 [ 2235.367189][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2235.367462][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2235.367744][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2235.368020][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2235.368283][ C0] ? activate_task+0xf5/0x260 [ 2235.368535][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2235.368811][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2235.369087][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2235.369345][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2235.369637][ C0] ? get_stack_info+0x36/0xc0 [ 2235.369894][ C0] ? stack_access_ok+0xda/0x1f0 [ 2235.370157][ C0] ? get_reg+0x119/0x190 [ 2235.370386][ C0] __tcf_classify+0x32c/0x7d0 [ 2235.370640][ C0] tcf_classify+0x283/0x930 [ 2235.370881][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2235.371209][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2235.371480][ C0] ? arch_stack_walk+0x8c/0x100 [ 2235.371751][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2235.372045][ C0] tc_run+0x2e4/0x5d0 [ 2235.372260][ C0] ? __pfx_tc_run+0x10/0x10 [ 2235.372501][ C0] ? lock_acquire+0x1c1/0x220 [ 2235.372749][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2235.373024][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2235.373295][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2235.373583][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2235.373861][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2235.374184][ C0] ? neigh_hh_output+0x348/0x590 [ 2235.374455][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2235.374733][ C0] ip_finish_output2+0x786/0x18e0 [ 2235.375003][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2235.375305][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2235.375661][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2235.375953][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2235.376223][ C0] ? __ip_finish_output+0x10f/0x770 [ 2235.376502][ C0] ip_output+0x16b/0x4f0 [ 2235.376727][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2235.377013][ C0] ? __pfx_ip_output+0x10/0x10 [ 2235.377268][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2235.377574][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2235.377837][ C0] ? ip_local_out+0x114/0x3b0 [ 2235.378092][ C0] __ip_queue_xmit+0x672/0x1910 [ 2235.378356][ C0] ? __skb_clone+0x57a/0x760 [ 2235.378608][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2235.378889][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2235.379189][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2235.379507][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2235.379765][ C0] ? tcp_current_mss+0x40a/0x510 [ 2235.380027][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2235.380311][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2235.380584][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2235.380836][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2235.381109][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2235.381427][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2235.381702][ C0] ? ktime_get+0xb6/0x190 [ 2235.381933][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2235.382208][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2235.382491][ C0] tcp_write_timer+0x82/0x1d0 [ 2235.382740][ C0] call_timer_fn+0x176/0x430 [ 2235.382985][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2235.383263][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2235.383537][ C0] __run_timers.part.0+0x52d/0x890 [ 2235.383815][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2235.384096][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2235.384394][ C0] ? lock_acquire+0x1c1/0x220 [ 2235.384641][ C0] ? clockevents_program_event+0xf6/0x300 [ 2235.384944][ C0] ? lock_release+0x1d5/0x250 [ 2235.385205][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2235.385484][ C0] ? ktime_get+0xb6/0x190 [ 2235.385724][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2235.386026][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2235.386335][ C0] run_timer_softirq+0x72/0x100 [ 2235.386595][ C0] __do_softirq+0x1bc/0x7ff [ 2235.386844][ C0] irq_exit_rcu+0x98/0xc0 [ 2235.387078][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2235.387379][ C0] [ 2235.387536][ C0] [ 2235.387693][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2235.388016][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2235.388289][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2235.389321][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2235.389649][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2235.390072][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2235.390498][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2235.390924][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2235.391347][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2235.391770][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2235.392078][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2235.392355][ C0] default_idle_call+0x69/0xa0 [ 2235.392609][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2235.392877][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2235.393173][ C0] ? lock_release+0x1d5/0x250 [ 2235.393427][ C0] do_idle+0xfb/0x160 [ 2235.393643][ C0] cpu_startup_entry+0x55/0x60 [ 2235.393900][ C0] rest_init+0x153/0x260 [ 2235.394127][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2235.394419][ C0] arch_call_rest_init+0x13/0x40 [ 2235.394686][ C0] start_kernel+0x314/0x3d0 [ 2235.394928][ C0] x86_64_start_reservations+0x18/0x30 [ 2235.395232][ C0] x86_64_start_kernel+0xba/0x110 [ 2235.395501][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2235.395827][ C0] [ 2235.395991][ C0] Sending NMI from CPU 0 to CPUs 1: [ 2235.396285][ C1] NMI backtrace for cpu 1 [ 2235.396294][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2235.396299][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2235.396302][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2235.396310][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2235.396314][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2235.396317][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2235.396319][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2235.396321][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2235.396323][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2235.396325][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2235.396327][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2235.396330][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2235.396333][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2235.396335][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2235.396337][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2235.396338][ C1] Call Trace: [ 2235.396342][ C1] [ 2235.396347][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 2235.396353][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 2235.396359][ C1] ? nmi_handle+0x156/0x420 [ 2235.396365][ C1] ? default_do_nmi+0x41/0x100 [ 2235.396369][ C1] ? exc_nmi+0xf3/0x120 [ 2235.396371][ C1] ? end_repeat_nmi+0xf/0x60 [ 2235.396376][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2235.396380][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2235.396383][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2235.396387][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2235.396391][ C1] [ 2235.396391][ C1] [ 2235.396393][ C1] ? run_ksoftirqd+0xb/0x60 [ 2235.396397][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2235.396400][ C1] ? __orc_find+0x9c/0xf0 [ 2235.396403][ C1] ? lock_acquire+0x1c1/0x220 [ 2235.396408][ C1] ? irqentry_enter+0x2b/0x60 [ 2235.396413][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2235.396417][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2235.396420][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2235.396423][ C1] ? lock_acquire+0x1c1/0x220 [ 2235.396425][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2235.396431][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2235.396434][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2235.396442][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2235.396445][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2235.396451][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2235.396458][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2235.396462][ C1] ip_local_deliver+0x19d/0x480 [ 2235.396465][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2235.396467][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2235.396472][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2235.396476][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2235.396479][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2235.396483][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2235.396492][ C1] ip_rcv+0x564/0x740 [ 2235.396495][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2235.396498][ C1] ? set_track_prepare+0x8a/0xd0 [ 2235.396504][ C1] ? irqentry_enter+0x2b/0x60 [ 2235.396508][ C1] ? irqentry_enter+0x2b/0x60 [ 2235.396512][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2235.396514][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2235.396519][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2235.396522][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2235.396525][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2235.396528][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2235.396531][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2235.396536][ C1] netif_receive_skb+0x55/0x280 [ 2235.396540][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2235.396549][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2235.396557][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2235.396563][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2235.396571][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2235.396583][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2235.396593][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2235.396595][ C1] ? arch_stack_walk+0x68/0x100 [ 2235.396601][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2235.396604][ C1] ? irqentry_enter+0x2b/0x60 [ 2235.396607][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2235.396612][ C1] ? irqentry_enter+0x2b/0x60 [ 2235.396615][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2235.396623][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2235.396625][ C1] ? arch_stack_walk+0x68/0x100 [ 2235.396629][ C1] __tcf_classify+0x32c/0x7d0 [ 2235.396634][ C1] tcf_classify+0x283/0x930 [ 2235.396638][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2235.396642][ C1] tc_run+0x2e4/0x5d0 [ 2235.396646][ C1] ? __pfx_tc_run+0x10/0x10 [ 2235.396651][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2235.396657][ C1] ? irqentry_enter+0x2b/0x60 [ 2235.396660][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2235.396663][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2235.396670][ C1] ip_finish_output2+0x786/0x18e0 [ 2235.396676][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2235.396678][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2235.396682][ C1] ? __ip_finish_output+0x10f/0x770 [ 2235.396686][ C1] ip_output+0x16b/0x4f0 [ 2235.396690][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2235.396693][ C1] ? __pfx_ip_output+0x10/0x10 [ 2235.396697][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2235.396705][ C1] ? __pfx_ip_output+0x10/0x10 [ 2235.396709][ C1] __ip_queue_xmit+0x672/0x1910 [ 2235.396714][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2235.396721][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2235.396726][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2235.396729][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2235.396734][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2235.396737][ C1] tcp_delack_timer+0x84/0x240 [ 2235.396740][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2235.396743][ C1] call_timer_fn+0x176/0x430 [ 2235.396748][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2235.396753][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2235.396757][ C1] __run_timers.part.0+0x52d/0x890 [ 2235.396760][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2235.396764][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2235.396769][ C1] ? __pfx___schedule+0x10/0x10 [ 2235.396773][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2235.396778][ C1] run_timer_softirq+0x72/0x100 [ 2235.396781][ C1] __do_softirq+0x1bc/0x7ff [ 2235.396785][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2235.396789][ C1] run_ksoftirqd+0x2e/0x60 [ 2235.396792][ C1] smpboot_thread_fn+0x30e/0x840 [ 2235.396796][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2235.396800][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2235.396802][ C1] kthread+0x292/0x360 [ 2235.396805][ C1] ? __pfx_kthread+0x10/0x10 [ 2235.396808][ C1] ret_from_fork+0x34/0x70 [ 2235.396810][ C1] ? __pfx_kthread+0x10/0x10 [ 2235.396812][ C1] ret_from_fork_asm+0x1b/0x30 [ 2235.396820][ C1] [ 2260.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 999s! [swapper/0:0] [ 2260.527915][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2260.529120][ C0] irq event stamp: 27567077 [ 2260.529362][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2260.529892][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2260.530363][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2260.530860][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2260.531349][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2260.531824][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2260.532474][ C0] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 2260.532781][ C0] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 2260.533794][ C0] RSP: 0018:ffffc900000069c8 EFLAGS: 00000202 [ 2260.534117][ C0] RAX: ffff88800a099b58 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2260.534531][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2260.534956][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2260.535380][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2260.535801][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2260.536220][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2260.536688][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2260.537032][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2260.537451][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2260.537866][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2260.538281][ C0] Call Trace: [ 2260.538458][ C0] [ 2260.538612][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2260.538893][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2260.539145][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2260.539437][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2260.539719][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2260.540019][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2260.540300][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2260.540618][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2260.540894][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2260.541170][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2260.541496][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2260.541812][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2260.542143][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2260.542455][ C0] ? kasan_check_range+0x12/0x1c0 [ 2260.542727][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 2260.543027][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2260.543354][ C0] ? get_stack_info+0x36/0xc0 [ 2260.543608][ C0] ? lock_acquire+0x1c1/0x220 [ 2260.543861][ C0] ? lock_release+0x1d5/0x250 [ 2260.544114][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2260.544376][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2260.544661][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2260.544965][ C0] ? lock_acquire+0x1c1/0x220 [ 2260.545219][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2260.545474][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2260.545747][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2260.545997][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2260.546269][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2260.546541][ C0] ? __inet_lookup_established+0x341/0x610 [ 2260.546859][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2260.547153][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2260.547444][ C0] ip_local_deliver+0x19d/0x480 [ 2260.547706][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2260.547995][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2260.548262][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2260.548537][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2260.548798][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2260.549138][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2260.549413][ C0] ip_rcv+0x564/0x740 [ 2260.549624][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2260.549864][ C0] ? set_track_prepare+0x8a/0xd0 [ 2260.550128][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2260.550421][ C0] ? rest_init+0x153/0x260 [ 2260.550655][ C0] ? skb_clone+0x10b/0x330 [ 2260.550898][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2260.551234][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2260.551554][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2260.551854][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2260.552171][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2260.552433][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2260.552677][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2260.552994][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2260.553295][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2260.553632][ C0] ? lock_acquire+0x1c1/0x220 [ 2260.553883][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2260.554191][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2260.554491][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2260.554820][ C0] ? __copy_skb_header+0xaf/0x490 [ 2260.555094][ C0] ? __skb_clone+0x57a/0x760 [ 2260.555341][ C0] netif_receive_skb+0x55/0x280 [ 2260.555602][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2260.555927][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2260.556274][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2260.556586][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2260.556870][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2260.557167][ C0] ? hlock_class+0x4e/0x130 [ 2260.557411][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2260.557741][ C0] ? place_entity+0x21/0x2f0 [ 2260.557987][ C0] ? resched_curr+0x219/0x280 [ 2260.558244][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2260.558513][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2260.558797][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2260.559072][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2260.559331][ C0] ? activate_task+0xf5/0x260 [ 2260.559581][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2260.559855][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2260.560131][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2260.560391][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2260.560684][ C0] ? get_stack_info+0x36/0xc0 [ 2260.560942][ C0] ? stack_access_ok+0xda/0x1f0 [ 2260.561206][ C0] ? get_reg+0x119/0x190 [ 2260.561437][ C0] __tcf_classify+0x32c/0x7d0 [ 2260.561690][ C0] tcf_classify+0x283/0x930 [ 2260.561930][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2260.562257][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2260.562529][ C0] ? arch_stack_walk+0x8c/0x100 [ 2260.562795][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2260.563089][ C0] tc_run+0x2e4/0x5d0 [ 2260.563304][ C0] ? __pfx_tc_run+0x10/0x10 [ 2260.563547][ C0] ? lock_acquire+0x1c1/0x220 [ 2260.563795][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2260.564071][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2260.564341][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2260.564626][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2260.564911][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2260.565234][ C0] ? neigh_hh_output+0x348/0x590 [ 2260.565500][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2260.565782][ C0] ip_finish_output2+0x786/0x18e0 [ 2260.566056][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2260.566350][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2260.566704][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2260.566995][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2260.567265][ C0] ? __ip_finish_output+0x10f/0x770 [ 2260.567543][ C0] ip_output+0x16b/0x4f0 [ 2260.567768][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2260.568056][ C0] ? __pfx_ip_output+0x10/0x10 [ 2260.568309][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2260.568613][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2260.568876][ C0] ? ip_local_out+0x114/0x3b0 [ 2260.569132][ C0] __ip_queue_xmit+0x672/0x1910 [ 2260.569395][ C0] ? __skb_clone+0x57a/0x760 [ 2260.569645][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2260.569930][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2260.570224][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2260.570541][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2260.570801][ C0] ? tcp_current_mss+0x40a/0x510 [ 2260.571064][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2260.571347][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2260.571622][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2260.571879][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2260.572152][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2260.572472][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2260.572750][ C0] ? ktime_get+0xb6/0x190 [ 2260.572981][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2260.573254][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2260.573538][ C0] tcp_write_timer+0x82/0x1d0 [ 2260.573786][ C0] call_timer_fn+0x176/0x430 [ 2260.574030][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2260.574307][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2260.574579][ C0] __run_timers.part.0+0x52d/0x890 [ 2260.574854][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2260.575145][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2260.575441][ C0] ? lock_acquire+0x1c1/0x220 [ 2260.575691][ C0] ? clockevents_program_event+0xf6/0x300 [ 2260.575999][ C0] ? lock_release+0x1d5/0x250 [ 2260.576254][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2260.576532][ C0] ? ktime_get+0xb6/0x190 [ 2260.576767][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2260.577068][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2260.577376][ C0] run_timer_softirq+0x72/0x100 [ 2260.577637][ C0] __do_softirq+0x1bc/0x7ff [ 2260.577882][ C0] irq_exit_rcu+0x98/0xc0 [ 2260.578115][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2260.578416][ C0] [ 2260.578573][ C0] [ 2260.578729][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2260.579050][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2260.579324][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2260.580349][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2260.580674][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2260.581095][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2260.581520][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2260.581943][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2260.582364][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2260.582786][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2260.583096][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2260.583372][ C0] default_idle_call+0x69/0xa0 [ 2260.583623][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2260.583892][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2260.584184][ C0] ? lock_release+0x1d5/0x250 [ 2260.584442][ C0] do_idle+0xfb/0x160 [ 2260.584656][ C0] cpu_startup_entry+0x55/0x60 [ 2260.584923][ C0] rest_init+0x153/0x260 [ 2260.585154][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2260.585442][ C0] arch_call_rest_init+0x13/0x40 [ 2260.585708][ C0] start_kernel+0x314/0x3d0 [ 2260.585953][ C0] x86_64_start_reservations+0x18/0x30 [ 2260.586250][ C0] x86_64_start_kernel+0xba/0x110 [ 2260.586519][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2260.586844][ C0] [ 2260.587006][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 999s! [ksoftirqd/1:22] [ 2260.587472][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2260.588665][ C1] irq event stamp: 3886976 [ 2260.588902][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2260.589407][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2260.589907][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2260.590411][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2260.590901][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2260.591403][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2260.592053][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2260.592400][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2260.593431][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2260.593760][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2260.594186][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2260.594612][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2260.595036][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2260.595452][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2260.595867][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2260.596336][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2260.596686][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2260.597106][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2260.597530][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2260.597955][ C1] Call Trace: [ 2260.598136][ C1] [ 2260.598293][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2260.598569][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2260.598829][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2260.599120][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2260.599411][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2260.599716][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2260.599998][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2260.600324][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2260.600598][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2260.600926][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2260.601240][ C1] [ 2260.601397][ C1] [ 2260.601553][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2260.601881][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2260.602190][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2260.602501][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2260.602802][ C1] ? run_ksoftirqd+0xb/0x60 [ 2260.603045][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2260.603369][ C1] ? __orc_find+0x9c/0xf0 [ 2260.603603][ C1] ? lock_acquire+0x1c1/0x220 [ 2260.603858][ C1] ? irqentry_enter+0x2b/0x60 [ 2260.604113][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2260.604376][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2260.604663][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2260.604969][ C1] ? lock_acquire+0x1c1/0x220 [ 2260.605223][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2260.605481][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2260.605758][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2260.606003][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2260.606263][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2260.606534][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2260.606823][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2260.607115][ C1] ip_local_deliver+0x19d/0x480 [ 2260.607377][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2260.607665][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2260.607931][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2260.608209][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2260.608474][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2260.608814][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2260.609087][ C1] ip_rcv+0x564/0x740 [ 2260.609298][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2260.609539][ C1] ? set_track_prepare+0x8a/0xd0 [ 2260.609804][ C1] ? irqentry_enter+0x2b/0x60 [ 2260.610060][ C1] ? irqentry_enter+0x2b/0x60 [ 2260.610315][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2260.610559][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2260.610885][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2260.611228][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2260.611540][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2260.611878][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2260.612177][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2260.612514][ C1] netif_receive_skb+0x55/0x280 [ 2260.612775][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2260.613107][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2260.613457][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2260.613770][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2260.614063][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2260.614369][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2260.614704][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2260.614989][ C1] ? arch_stack_walk+0x68/0x100 [ 2260.615257][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2260.615537][ C1] ? irqentry_enter+0x2b/0x60 [ 2260.615792][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2260.616116][ C1] ? irqentry_enter+0x2b/0x60 [ 2260.616365][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2260.616690][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2260.616974][ C1] ? arch_stack_walk+0x68/0x100 [ 2260.617237][ C1] __tcf_classify+0x32c/0x7d0 [ 2260.617490][ C1] tcf_classify+0x283/0x930 [ 2260.617733][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2260.618002][ C1] tc_run+0x2e4/0x5d0 [ 2260.618216][ C1] ? __pfx_tc_run+0x10/0x10 [ 2260.618458][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2260.618726][ C1] ? irqentry_enter+0x2b/0x60 [ 2260.618981][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2260.619272][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2260.619597][ C1] ip_finish_output2+0x786/0x18e0 [ 2260.619867][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2260.620159][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2260.620427][ C1] ? __ip_finish_output+0x10f/0x770 [ 2260.620705][ C1] ip_output+0x16b/0x4f0 [ 2260.620931][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2260.621254][ C1] ? __pfx_ip_output+0x10/0x10 [ 2260.621510][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2260.621870][ C1] ? __pfx_ip_output+0x10/0x10 [ 2260.622131][ C1] __ip_queue_xmit+0x672/0x1910 [ 2260.622394][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2260.622675][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2260.622972][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2260.623257][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2260.623553][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2260.623837][ C1] tcp_delack_timer+0x84/0x240 [ 2260.624093][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2260.624383][ C1] call_timer_fn+0x176/0x430 [ 2260.624635][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2260.624915][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2260.625196][ C1] __run_timers.part.0+0x52d/0x890 [ 2260.625469][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2260.625760][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2260.626066][ C1] ? __pfx___schedule+0x10/0x10 [ 2260.626327][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2260.626646][ C1] run_timer_softirq+0x72/0x100 [ 2260.626913][ C1] __do_softirq+0x1bc/0x7ff [ 2260.627161][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2260.627439][ C1] run_ksoftirqd+0x2e/0x60 [ 2260.627679][ C1] smpboot_thread_fn+0x30e/0x840 [ 2260.627947][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2260.628238][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2260.628530][ C1] kthread+0x292/0x360 [ 2260.628751][ C1] ? __pfx_kthread+0x10/0x10 [ 2260.629002][ C1] ret_from_fork+0x34/0x70 [ 2260.629240][ C1] ? __pfx_kthread+0x10/0x10 [ 2260.629489][ C1] ret_from_fork_asm+0x1b/0x30 [ 2260.629748][ C1] [ 2288.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1025s! [swapper/0:0] [ 2288.527920][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2288.529114][ C0] irq event stamp: 27567077 [ 2288.529355][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2288.529881][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2288.530348][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2288.530844][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2288.531337][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2288.531814][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2288.532460][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2288.532802][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2288.533829][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2288.534156][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2288.534580][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2288.535007][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2288.535426][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2288.535842][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2288.536258][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2288.536724][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2288.537075][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2288.537493][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2288.537911][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2288.538333][ C0] Call Trace: [ 2288.538519][ C0] [ 2288.538674][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2288.538951][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2288.539208][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2288.539498][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2288.539797][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2288.540105][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2288.540386][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2288.540709][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2288.540981][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2288.541262][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2288.541583][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2288.541893][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2288.542229][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2288.542533][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2288.542843][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2288.543150][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2288.543480][ C0] ? get_stack_info+0x36/0xc0 [ 2288.543734][ C0] ? lock_acquire+0x1c1/0x220 [ 2288.543985][ C0] ? lock_release+0x1d5/0x250 [ 2288.544238][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2288.544498][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2288.544791][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2288.545092][ C0] ? lock_acquire+0x1c1/0x220 [ 2288.545339][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2288.545589][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2288.545862][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2288.546114][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2288.546378][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2288.546650][ C0] ? __inet_lookup_established+0x341/0x610 [ 2288.546967][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2288.547256][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2288.547547][ C0] ip_local_deliver+0x19d/0x480 [ 2288.547810][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2288.548098][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2288.548368][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2288.548644][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2288.548907][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2288.549246][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2288.549521][ C0] ip_rcv+0x564/0x740 [ 2288.549740][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2288.549979][ C0] ? set_track_prepare+0x8a/0xd0 [ 2288.550244][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2288.550533][ C0] ? rest_init+0x153/0x260 [ 2288.550770][ C0] ? skb_clone+0x10b/0x330 [ 2288.551011][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2288.551345][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2288.551665][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2288.551961][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2288.552271][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2288.552534][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2288.552778][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2288.553095][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2288.553394][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2288.553731][ C0] ? lock_acquire+0x1c1/0x220 [ 2288.553979][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2288.554287][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2288.554585][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2288.554922][ C0] ? __copy_skb_header+0xaf/0x490 [ 2288.555194][ C0] ? __skb_clone+0x57a/0x760 [ 2288.555442][ C0] netif_receive_skb+0x55/0x280 [ 2288.555700][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2288.556025][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2288.556371][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2288.556686][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2288.556970][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2288.557269][ C0] ? hlock_class+0x4e/0x130 [ 2288.557512][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2288.557842][ C0] ? place_entity+0x21/0x2f0 [ 2288.558086][ C0] ? resched_curr+0x219/0x280 [ 2288.558340][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2288.558610][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2288.558897][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2288.559175][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2288.559430][ C0] ? activate_task+0xf5/0x260 [ 2288.559679][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2288.559953][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2288.560230][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2288.560491][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2288.560781][ C0] ? get_stack_info+0x36/0xc0 [ 2288.561036][ C0] ? stack_access_ok+0xda/0x1f0 [ 2288.561296][ C0] ? get_reg+0x119/0x190 [ 2288.561527][ C0] __tcf_classify+0x32c/0x7d0 [ 2288.561779][ C0] tcf_classify+0x283/0x930 [ 2288.562023][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2288.562351][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2288.562622][ C0] ? arch_stack_walk+0x8c/0x100 [ 2288.562885][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2288.563178][ C0] tc_run+0x2e4/0x5d0 [ 2288.563395][ C0] ? __pfx_tc_run+0x10/0x10 [ 2288.563635][ C0] ? lock_acquire+0x1c1/0x220 [ 2288.563883][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2288.564159][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2288.564426][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2288.564710][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2288.564998][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2288.565324][ C0] ? neigh_hh_output+0x348/0x590 [ 2288.565589][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2288.565874][ C0] ip_finish_output2+0x786/0x18e0 [ 2288.566145][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2288.566443][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2288.566794][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2288.567087][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2288.567353][ C0] ? __ip_finish_output+0x10f/0x770 [ 2288.567630][ C0] ip_output+0x16b/0x4f0 [ 2288.567858][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2288.568149][ C0] ? __pfx_ip_output+0x10/0x10 [ 2288.568409][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2288.568711][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2288.568973][ C0] ? ip_local_out+0x114/0x3b0 [ 2288.569233][ C0] __ip_queue_xmit+0x672/0x1910 [ 2288.569500][ C0] ? __skb_clone+0x57a/0x760 [ 2288.569751][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2288.570031][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2288.570325][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2288.570641][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2288.570898][ C0] ? tcp_current_mss+0x40a/0x510 [ 2288.571161][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2288.571446][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2288.571720][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2288.571972][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2288.572244][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2288.572566][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2288.572840][ C0] ? ktime_get+0xb6/0x190 [ 2288.573071][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2288.573344][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2288.573626][ C0] tcp_write_timer+0x82/0x1d0 [ 2288.573877][ C0] call_timer_fn+0x176/0x430 [ 2288.574126][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2288.574404][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2288.574678][ C0] __run_timers.part.0+0x52d/0x890 [ 2288.574962][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2288.575249][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2288.575545][ C0] ? lock_acquire+0x1c1/0x220 [ 2288.575798][ C0] ? clockevents_program_event+0xf6/0x300 [ 2288.576109][ C0] ? lock_release+0x1d5/0x250 [ 2288.576360][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2288.576639][ C0] ? ktime_get+0xb6/0x190 [ 2288.576869][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2288.577171][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2288.577478][ C0] run_timer_softirq+0x72/0x100 [ 2288.577739][ C0] __do_softirq+0x1bc/0x7ff [ 2288.577990][ C0] irq_exit_rcu+0x98/0xc0 [ 2288.578225][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2288.578525][ C0] [ 2288.578680][ C0] [ 2288.578837][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2288.579155][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2288.579429][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2288.580460][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2288.580787][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2288.581212][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2288.581638][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2288.582063][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2288.582486][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2288.582913][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2288.583222][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2288.583498][ C0] default_idle_call+0x69/0xa0 [ 2288.583754][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2288.584020][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2288.584310][ C0] ? lock_release+0x1d5/0x250 [ 2288.584563][ C0] do_idle+0xfb/0x160 [ 2288.584785][ C0] cpu_startup_entry+0x55/0x60 [ 2288.585041][ C0] rest_init+0x153/0x260 [ 2288.585271][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2288.585557][ C0] arch_call_rest_init+0x13/0x40 [ 2288.585823][ C0] start_kernel+0x314/0x3d0 [ 2288.586070][ C0] x86_64_start_reservations+0x18/0x30 [ 2288.586365][ C0] x86_64_start_kernel+0xba/0x110 [ 2288.586633][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2288.586960][ C0] [ 2288.587127][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1025s! [ksoftirqd/1:22] [ 2288.587600][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2288.588807][ C1] irq event stamp: 3886976 [ 2288.589049][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2288.589545][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2288.590039][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2288.590538][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2288.591032][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2288.591522][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2288.592168][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2288.592509][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2288.593528][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2288.593852][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2288.594272][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2288.594691][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2288.595117][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2288.595543][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2288.595970][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2288.596445][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2288.596796][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2288.597226][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2288.597646][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2288.598066][ C1] Call Trace: [ 2288.598243][ C1] [ 2288.598398][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2288.598678][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2288.598933][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2288.599225][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2288.599509][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2288.599810][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2288.600087][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2288.600406][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2288.600684][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2288.601005][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2288.601315][ C1] [ 2288.601474][ C1] [ 2288.601634][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2288.601969][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2288.602272][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2288.602583][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2288.602890][ C1] ? run_ksoftirqd+0xb/0x60 [ 2288.603139][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2288.603469][ C1] ? __orc_find+0x9c/0xf0 [ 2288.603699][ C1] ? lock_acquire+0x1c1/0x220 [ 2288.603948][ C1] ? irqentry_enter+0x2b/0x60 [ 2288.604198][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2288.604458][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2288.604744][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2288.605054][ C1] ? lock_acquire+0x1c1/0x220 [ 2288.605305][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2288.605558][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2288.605830][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2288.606081][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2288.606343][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2288.606620][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2288.606912][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2288.607206][ C1] ip_local_deliver+0x19d/0x480 [ 2288.607462][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2288.607745][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2288.608011][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2288.608294][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2288.608562][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2288.608898][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2288.609177][ C1] ip_rcv+0x564/0x740 [ 2288.609399][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2288.609645][ C1] ? set_track_prepare+0x8a/0xd0 [ 2288.609916][ C1] ? irqentry_enter+0x2b/0x60 [ 2288.610169][ C1] ? irqentry_enter+0x2b/0x60 [ 2288.610420][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2288.610664][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2288.610977][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2288.611318][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2288.611627][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2288.611970][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2288.612271][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2288.612600][ C1] netif_receive_skb+0x55/0x280 [ 2288.612859][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2288.613186][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2288.613534][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2288.613849][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2288.614136][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2288.614436][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2288.614761][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2288.615051][ C1] ? arch_stack_walk+0x68/0x100 [ 2288.615316][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2288.615592][ C1] ? irqentry_enter+0x2b/0x60 [ 2288.615842][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2288.616162][ C1] ? irqentry_enter+0x2b/0x60 [ 2288.616416][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2288.616742][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2288.617021][ C1] ? arch_stack_walk+0x68/0x100 [ 2288.617283][ C1] __tcf_classify+0x32c/0x7d0 [ 2288.617537][ C1] tcf_classify+0x283/0x930 [ 2288.617783][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2288.618055][ C1] tc_run+0x2e4/0x5d0 [ 2288.618277][ C1] ? __pfx_tc_run+0x10/0x10 [ 2288.618525][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2288.618796][ C1] ? irqentry_enter+0x2b/0x60 [ 2288.619050][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2288.619335][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2288.619656][ C1] ip_finish_output2+0x786/0x18e0 [ 2288.619931][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2288.620224][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2288.620487][ C1] ? __ip_finish_output+0x10f/0x770 [ 2288.620775][ C1] ip_output+0x16b/0x4f0 [ 2288.621006][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2288.621325][ C1] ? __pfx_ip_output+0x10/0x10 [ 2288.621586][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2288.621938][ C1] ? __pfx_ip_output+0x10/0x10 [ 2288.622192][ C1] __ip_queue_xmit+0x672/0x1910 [ 2288.622456][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2288.622740][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2288.623039][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2288.623330][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2288.623632][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2288.623921][ C1] tcp_delack_timer+0x84/0x240 [ 2288.624181][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2288.624466][ C1] call_timer_fn+0x176/0x430 [ 2288.624718][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2288.625000][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2288.625281][ C1] __run_timers.part.0+0x52d/0x890 [ 2288.625555][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2288.625843][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2288.626144][ C1] ? __pfx___schedule+0x10/0x10 [ 2288.626405][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2288.626729][ C1] run_timer_softirq+0x72/0x100 [ 2288.626988][ C1] __do_softirq+0x1bc/0x7ff [ 2288.627230][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2288.627503][ C1] run_ksoftirqd+0x2e/0x60 [ 2288.627744][ C1] smpboot_thread_fn+0x30e/0x840 [ 2288.628006][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2288.628301][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2288.628592][ C1] kthread+0x292/0x360 [ 2288.628811][ C1] ? __pfx_kthread+0x10/0x10 [ 2288.629055][ C1] ret_from_fork+0x34/0x70 [ 2288.629296][ C1] ? __pfx_kthread+0x10/0x10 [ 2288.629541][ C1] ret_from_fork_asm+0x1b/0x30 [ 2288.629805][ C1] [ 2313.400024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 2313.400421][ C1] rcu: 1-....: (1117528 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=272387 [ 2313.401015][ C1] rcu: (t=1119091 jiffies g=1007429 q=31 ncpus=4) [ 2313.401369][ C1] Sending NMI from CPU 1 to CPUs 0: [ 2313.401654][ C0] NMI backtrace for cpu 0 [ 2313.401662][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2313.401667][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2313.401670][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2313.401679][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2313.401683][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2313.401686][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2313.401688][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2313.401690][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2313.401691][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2313.401693][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2313.401696][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2313.401697][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2313.401702][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2313.401703][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2313.401705][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2313.401706][ C0] Call Trace: [ 2313.401709][ C0] [ 2313.401713][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 2313.401719][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 2313.401724][ C0] ? nmi_handle+0x156/0x420 [ 2313.401730][ C0] ? default_do_nmi+0x41/0x100 [ 2313.401734][ C0] ? exc_nmi+0xf3/0x120 [ 2313.401736][ C0] ? end_repeat_nmi+0xf/0x60 [ 2313.401741][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2313.401744][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2313.401748][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2313.401752][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2313.401755][ C0] [ 2313.401756][ C0] [ 2313.401758][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2313.401761][ C0] ? get_stack_info+0x36/0xc0 [ 2313.401766][ C0] ? lock_acquire+0x1c1/0x220 [ 2313.401771][ C0] ? lock_release+0x1d5/0x250 [ 2313.401775][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2313.401779][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2313.401781][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2313.401785][ C0] ? lock_acquire+0x1c1/0x220 [ 2313.401787][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2313.401793][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2313.401796][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2313.401803][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2313.401806][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2313.401810][ C0] ? __inet_lookup_established+0x341/0x610 [ 2313.401816][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2313.401824][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2313.401827][ C0] ip_local_deliver+0x19d/0x480 [ 2313.401830][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2313.401833][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2313.401839][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2313.401843][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2313.401846][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2313.401850][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2313.401860][ C0] ip_rcv+0x564/0x740 [ 2313.401864][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2313.401867][ C0] ? set_track_prepare+0x8a/0xd0 [ 2313.401872][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2313.401874][ C0] ? rest_init+0x153/0x260 [ 2313.401877][ C0] ? skb_clone+0x10b/0x330 [ 2313.401883][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2313.401890][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2313.401896][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2313.401901][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2313.401911][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2313.401915][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2313.401917][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2313.401921][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2313.401924][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2313.401928][ C0] ? lock_acquire+0x1c1/0x220 [ 2313.401930][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2313.401933][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2313.401936][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2313.401940][ C0] ? __copy_skb_header+0xaf/0x490 [ 2313.401942][ C0] ? __skb_clone+0x57a/0x760 [ 2313.401945][ C0] netif_receive_skb+0x55/0x280 [ 2313.401948][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2313.401956][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2313.401963][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2313.401970][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2313.401975][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2313.401984][ C0] ? hlock_class+0x4e/0x130 [ 2313.401991][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2313.402001][ C0] ? place_entity+0x21/0x2f0 [ 2313.402005][ C0] ? resched_curr+0x219/0x280 [ 2313.402008][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2313.402011][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2313.402015][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2313.402019][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2313.402023][ C0] ? activate_task+0xf5/0x260 [ 2313.402026][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2313.402031][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2313.402035][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2313.402038][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2313.402041][ C0] ? get_stack_info+0x36/0xc0 [ 2313.402045][ C0] ? stack_access_ok+0xda/0x1f0 [ 2313.402047][ C0] ? get_reg+0x119/0x190 [ 2313.402051][ C0] __tcf_classify+0x32c/0x7d0 [ 2313.402056][ C0] tcf_classify+0x283/0x930 [ 2313.402059][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2313.402064][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2313.402066][ C0] ? arch_stack_walk+0x8c/0x100 [ 2313.402072][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2313.402075][ C0] tc_run+0x2e4/0x5d0 [ 2313.402080][ C0] ? __pfx_tc_run+0x10/0x10 [ 2313.402084][ C0] ? lock_acquire+0x1c1/0x220 [ 2313.402086][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2313.402090][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2313.402096][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2313.402099][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2313.402103][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2313.402108][ C0] ? neigh_hh_output+0x348/0x590 [ 2313.402112][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2313.402116][ C0] ip_finish_output2+0x786/0x18e0 [ 2313.402119][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2313.402125][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2313.402133][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2313.402136][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2313.402141][ C0] ? __ip_finish_output+0x10f/0x770 [ 2313.402145][ C0] ip_output+0x16b/0x4f0 [ 2313.402148][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2313.402153][ C0] ? __pfx_ip_output+0x10/0x10 [ 2313.402156][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2313.402161][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2313.402165][ C0] ? ip_local_out+0x114/0x3b0 [ 2313.402168][ C0] __ip_queue_xmit+0x672/0x1910 [ 2313.402173][ C0] ? __skb_clone+0x57a/0x760 [ 2313.402176][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2313.402183][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2313.402188][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2313.402191][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2313.402196][ C0] ? tcp_current_mss+0x40a/0x510 [ 2313.402199][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2313.402202][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2313.402205][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2313.402207][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2313.402210][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2313.402214][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2313.402218][ C0] ? ktime_get+0xb6/0x190 [ 2313.402222][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2313.402227][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2313.402230][ C0] tcp_write_timer+0x82/0x1d0 [ 2313.402234][ C0] call_timer_fn+0x176/0x430 [ 2313.402237][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2313.402242][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2313.402246][ C0] __run_timers.part.0+0x52d/0x890 [ 2313.402249][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2313.402254][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2313.402257][ C0] ? lock_acquire+0x1c1/0x220 [ 2313.402259][ C0] ? clockevents_program_event+0xf6/0x300 [ 2313.402263][ C0] ? lock_release+0x1d5/0x250 [ 2313.402266][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2313.402269][ C0] ? ktime_get+0xb6/0x190 [ 2313.402271][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2313.402275][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2313.402280][ C0] run_timer_softirq+0x72/0x100 [ 2313.402283][ C0] __do_softirq+0x1bc/0x7ff [ 2313.402288][ C0] irq_exit_rcu+0x98/0xc0 [ 2313.402291][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2313.402295][ C0] [ 2313.402295][ C0] [ 2313.402297][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2313.402303][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2313.402306][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2313.402308][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2313.402311][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2313.402312][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2313.402314][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2313.402315][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2313.402317][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2313.402320][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2313.402323][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2313.402327][ C0] default_idle_call+0x69/0xa0 [ 2313.402329][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2313.402331][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2313.402337][ C0] ? lock_release+0x1d5/0x250 [ 2313.402341][ C0] do_idle+0xfb/0x160 [ 2313.402343][ C0] cpu_startup_entry+0x55/0x60 [ 2313.402346][ C0] rest_init+0x153/0x260 [ 2313.402348][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2313.402354][ C0] arch_call_rest_init+0x13/0x40 [ 2313.402360][ C0] start_kernel+0x314/0x3d0 [ 2313.402363][ C0] x86_64_start_reservations+0x18/0x30 [ 2313.402368][ C0] x86_64_start_kernel+0xba/0x110 [ 2313.402372][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2313.402381][ C0] [ 2313.402651][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2313.456658][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2313.457305][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2313.457652][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2313.458671][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2313.458998][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2313.459420][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2313.459840][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2313.460263][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2313.460684][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2313.461104][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2313.461575][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2313.461929][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2313.462350][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2313.462773][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2313.463201][ C1] Call Trace: [ 2313.463387][ C1] [ 2313.463545][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 2313.463831][ C1] ? print_cpu_stall+0x263/0x6a0 [ 2313.464100][ C1] ? check_cpu_stall+0x284/0x500 [ 2313.464363][ C1] ? rcu_pending+0x92/0x360 [ 2313.464607][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 2313.464899][ C1] ? update_process_times+0xb9/0x110 [ 2313.465186][ C1] ? tick_sched_handle+0x67/0x130 [ 2313.465455][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 2313.465751][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2313.466009][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 2313.466335][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2313.466625][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2313.466931][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2313.467217][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2313.467539][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2313.467812][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2313.468145][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2313.468457][ C1] [ 2313.468614][ C1] [ 2313.468771][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2313.469104][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2313.469410][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2313.469722][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2313.470027][ C1] ? run_ksoftirqd+0xb/0x60 [ 2313.470267][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2313.470593][ C1] ? __orc_find+0x9c/0xf0 [ 2313.470826][ C1] ? lock_acquire+0x1c1/0x220 [ 2313.471083][ C1] ? irqentry_enter+0x2b/0x60 [ 2313.471340][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2313.471604][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2313.471893][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2313.472193][ C1] ? lock_acquire+0x1c1/0x220 [ 2313.472440][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2313.472690][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2313.472960][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2313.473212][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2313.473473][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2313.473746][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2313.474041][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2313.474337][ C1] ip_local_deliver+0x19d/0x480 [ 2313.474596][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2313.474896][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2313.475164][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2313.475441][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2313.475704][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2313.476044][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2313.476319][ C1] ip_rcv+0x564/0x740 [ 2313.476531][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2313.476772][ C1] ? set_track_prepare+0x8a/0xd0 [ 2313.477037][ C1] ? irqentry_enter+0x2b/0x60 [ 2313.477291][ C1] ? irqentry_enter+0x2b/0x60 [ 2313.477545][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2313.477790][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2313.478111][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2313.478459][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2313.478770][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2313.479109][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2313.479407][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2313.479744][ C1] netif_receive_skb+0x55/0x280 [ 2313.480007][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2313.480342][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2313.480692][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2313.481005][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2313.481302][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2313.481612][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2313.481942][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2313.482229][ C1] ? arch_stack_walk+0x68/0x100 [ 2313.482489][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2313.482764][ C1] ? irqentry_enter+0x2b/0x60 [ 2313.483012][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2313.483329][ C1] ? irqentry_enter+0x2b/0x60 [ 2313.483582][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2313.483908][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2313.484188][ C1] ? arch_stack_walk+0x68/0x100 [ 2313.484454][ C1] __tcf_classify+0x32c/0x7d0 [ 2313.484724][ C1] tcf_classify+0x283/0x930 [ 2313.484970][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2313.485243][ C1] tc_run+0x2e4/0x5d0 [ 2313.485460][ C1] ? __pfx_tc_run+0x10/0x10 [ 2313.485709][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2313.485978][ C1] ? irqentry_enter+0x2b/0x60 [ 2313.486228][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2313.486511][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2313.486836][ C1] ip_finish_output2+0x786/0x18e0 [ 2313.487109][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2313.487401][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2313.487665][ C1] ? __ip_finish_output+0x10f/0x770 [ 2313.487946][ C1] ip_output+0x16b/0x4f0 [ 2313.488181][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2313.488501][ C1] ? __pfx_ip_output+0x10/0x10 [ 2313.488761][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2313.489113][ C1] ? __pfx_ip_output+0x10/0x10 [ 2313.489368][ C1] __ip_queue_xmit+0x672/0x1910 [ 2313.489636][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2313.489920][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2313.490225][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2313.490516][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2313.490815][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2313.491103][ C1] tcp_delack_timer+0x84/0x240 [ 2313.491362][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2313.491646][ C1] call_timer_fn+0x176/0x430 [ 2313.491891][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2313.492169][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2313.492446][ C1] __run_timers.part.0+0x52d/0x890 [ 2313.492717][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2313.493008][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2313.493310][ C1] ? __pfx___schedule+0x10/0x10 [ 2313.493569][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2313.493887][ C1] run_timer_softirq+0x72/0x100 [ 2313.494150][ C1] __do_softirq+0x1bc/0x7ff [ 2313.494396][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2313.494680][ C1] run_ksoftirqd+0x2e/0x60 [ 2313.494919][ C1] smpboot_thread_fn+0x30e/0x840 [ 2313.495186][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2313.495480][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2313.495770][ C1] kthread+0x292/0x360 [ 2313.495988][ C1] ? __pfx_kthread+0x10/0x10 [ 2313.496233][ C1] ret_from_fork+0x34/0x70 [ 2313.496474][ C1] ? __pfx_kthread+0x10/0x10 [ 2313.496724][ C1] ret_from_fork_asm+0x1b/0x30 [ 2313.496990][ C1] [ 2340.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1073s! [swapper/0:0] [ 2340.527930][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2340.529123][ C0] irq event stamp: 27567077 [ 2340.529366][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2340.529897][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2340.530371][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2340.530871][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2340.531363][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2340.531841][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2340.532490][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2340.532834][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2340.533859][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2340.534185][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2340.534614][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2340.535036][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2340.535453][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2340.535868][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2340.536290][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2340.536757][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2340.537110][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2340.537532][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2340.537955][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2340.538381][ C0] Call Trace: [ 2340.538562][ C0] [ 2340.538720][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2340.539000][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2340.539259][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2340.539549][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2340.539836][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2340.540142][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2340.540423][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2340.540748][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2340.541021][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2340.541299][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2340.541623][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2340.541931][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2340.542265][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2340.542567][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2340.542874][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2340.543179][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2340.543507][ C0] ? get_stack_info+0x36/0xc0 [ 2340.543756][ C0] ? lock_acquire+0x1c1/0x220 [ 2340.544005][ C0] ? lock_release+0x1d5/0x250 [ 2340.544253][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2340.544519][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2340.544809][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2340.545111][ C0] ? lock_acquire+0x1c1/0x220 [ 2340.545358][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2340.545610][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2340.545881][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2340.546131][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2340.546392][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2340.546664][ C0] ? __inet_lookup_established+0x341/0x610 [ 2340.546981][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2340.547268][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2340.547554][ C0] ip_local_deliver+0x19d/0x480 [ 2340.547818][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2340.548106][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2340.548374][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2340.548649][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2340.548909][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2340.549248][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2340.549522][ C0] ip_rcv+0x564/0x740 [ 2340.549735][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2340.549976][ C0] ? set_track_prepare+0x8a/0xd0 [ 2340.550241][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2340.550530][ C0] ? rest_init+0x153/0x260 [ 2340.550764][ C0] ? skb_clone+0x10b/0x330 [ 2340.551006][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2340.551340][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2340.551657][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2340.551956][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2340.552270][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2340.552529][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2340.552772][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2340.553091][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2340.553392][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2340.553730][ C0] ? lock_acquire+0x1c1/0x220 [ 2340.553976][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2340.554286][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2340.554595][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2340.554928][ C0] ? __copy_skb_header+0xaf/0x490 [ 2340.555198][ C0] ? __skb_clone+0x57a/0x760 [ 2340.555445][ C0] netif_receive_skb+0x55/0x280 [ 2340.555700][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2340.556024][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2340.556372][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2340.556689][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2340.556979][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2340.557280][ C0] ? hlock_class+0x4e/0x130 [ 2340.557523][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2340.557851][ C0] ? place_entity+0x21/0x2f0 [ 2340.558100][ C0] ? resched_curr+0x219/0x280 [ 2340.558356][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2340.558627][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2340.558913][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2340.559192][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2340.559451][ C0] ? activate_task+0xf5/0x260 [ 2340.559704][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2340.559979][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2340.560257][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2340.560514][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2340.560803][ C0] ? get_stack_info+0x36/0xc0 [ 2340.561060][ C0] ? stack_access_ok+0xda/0x1f0 [ 2340.561324][ C0] ? get_reg+0x119/0x190 [ 2340.561553][ C0] __tcf_classify+0x32c/0x7d0 [ 2340.561804][ C0] tcf_classify+0x283/0x930 [ 2340.562045][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2340.562374][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2340.562649][ C0] ? arch_stack_walk+0x8c/0x100 [ 2340.562917][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2340.563213][ C0] tc_run+0x2e4/0x5d0 [ 2340.563429][ C0] ? __pfx_tc_run+0x10/0x10 [ 2340.563671][ C0] ? lock_acquire+0x1c1/0x220 [ 2340.563920][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2340.564198][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2340.564470][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2340.564766][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2340.565050][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2340.565374][ C0] ? neigh_hh_output+0x348/0x590 [ 2340.565637][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2340.565918][ C0] ip_finish_output2+0x786/0x18e0 [ 2340.566196][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2340.566493][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2340.566845][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2340.567135][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2340.567404][ C0] ? __ip_finish_output+0x10f/0x770 [ 2340.567683][ C0] ip_output+0x16b/0x4f0 [ 2340.567909][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2340.568198][ C0] ? __pfx_ip_output+0x10/0x10 [ 2340.568450][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2340.568755][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2340.569020][ C0] ? ip_local_out+0x114/0x3b0 [ 2340.569280][ C0] __ip_queue_xmit+0x672/0x1910 [ 2340.569542][ C0] ? __skb_clone+0x57a/0x760 [ 2340.569791][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2340.570072][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2340.570364][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2340.570683][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2340.570943][ C0] ? tcp_current_mss+0x40a/0x510 [ 2340.571206][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2340.571486][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2340.571760][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2340.572012][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2340.572282][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2340.572608][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2340.572885][ C0] ? ktime_get+0xb6/0x190 [ 2340.573115][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2340.573386][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2340.573668][ C0] tcp_write_timer+0x82/0x1d0 [ 2340.573915][ C0] call_timer_fn+0x176/0x430 [ 2340.574160][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2340.574435][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2340.574719][ C0] __run_timers.part.0+0x52d/0x890 [ 2340.574990][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2340.575275][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2340.575571][ C0] ? lock_acquire+0x1c1/0x220 [ 2340.575821][ C0] ? clockevents_program_event+0xf6/0x300 [ 2340.576126][ C0] ? lock_release+0x1d5/0x250 [ 2340.576378][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2340.576656][ C0] ? ktime_get+0xb6/0x190 [ 2340.576891][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2340.577188][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2340.577496][ C0] run_timer_softirq+0x72/0x100 [ 2340.577757][ C0] __do_softirq+0x1bc/0x7ff [ 2340.578004][ C0] irq_exit_rcu+0x98/0xc0 [ 2340.578238][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2340.578542][ C0] [ 2340.578698][ C0] [ 2340.578855][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2340.579177][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2340.579450][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2340.580477][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2340.580805][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2340.581227][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2340.581647][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2340.582070][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2340.582493][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2340.582913][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2340.583219][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2340.583497][ C0] default_idle_call+0x69/0xa0 [ 2340.583749][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2340.584016][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2340.584309][ C0] ? lock_release+0x1d5/0x250 [ 2340.584567][ C0] do_idle+0xfb/0x160 [ 2340.584783][ C0] cpu_startup_entry+0x55/0x60 [ 2340.585037][ C0] rest_init+0x153/0x260 [ 2340.585265][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2340.585555][ C0] arch_call_rest_init+0x13/0x40 [ 2340.585821][ C0] start_kernel+0x314/0x3d0 [ 2340.586073][ C0] x86_64_start_reservations+0x18/0x30 [ 2340.586368][ C0] x86_64_start_kernel+0xba/0x110 [ 2340.586635][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2340.586960][ C0] [ 2340.587127][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1073s! [ksoftirqd/1:22] [ 2340.587600][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2340.588812][ C1] irq event stamp: 3886976 [ 2340.589053][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2340.589552][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2340.590048][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2340.590548][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2340.591042][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2340.591540][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2340.592182][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2340.592521][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2340.593543][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2340.593865][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2340.594290][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2340.594718][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2340.595139][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2340.595561][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2340.595987][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2340.596468][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2340.596816][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2340.597244][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2340.597666][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2340.598086][ C1] Call Trace: [ 2340.598264][ C1] [ 2340.598421][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2340.598701][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2340.598959][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2340.599255][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2340.599544][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2340.599847][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2340.600126][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2340.600451][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2340.600728][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2340.601051][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2340.601364][ C1] [ 2340.601525][ C1] [ 2340.601687][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2340.602022][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2340.602327][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2340.602637][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2340.602946][ C1] ? run_ksoftirqd+0xb/0x60 [ 2340.603194][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2340.603523][ C1] ? __orc_find+0x9c/0xf0 [ 2340.603754][ C1] ? lock_acquire+0x1c1/0x220 [ 2340.604005][ C1] ? irqentry_enter+0x2b/0x60 [ 2340.604257][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2340.604524][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2340.604815][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2340.605118][ C1] ? lock_acquire+0x1c1/0x220 [ 2340.605370][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2340.605625][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2340.605900][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2340.606151][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2340.606413][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2340.606691][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2340.606986][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2340.607286][ C1] ip_local_deliver+0x19d/0x480 [ 2340.607545][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2340.607831][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2340.608098][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2340.608379][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2340.608648][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2340.608987][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2340.609266][ C1] ip_rcv+0x564/0x740 [ 2340.609485][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2340.609732][ C1] ? set_track_prepare+0x8a/0xd0 [ 2340.610002][ C1] ? irqentry_enter+0x2b/0x60 [ 2340.610255][ C1] ? irqentry_enter+0x2b/0x60 [ 2340.610507][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2340.610748][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2340.611064][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2340.611404][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2340.611716][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2340.612062][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2340.612364][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2340.612697][ C1] netif_receive_skb+0x55/0x280 [ 2340.612956][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2340.613283][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2340.613634][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2340.613952][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2340.614245][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2340.614555][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2340.614891][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2340.615178][ C1] ? arch_stack_walk+0x68/0x100 [ 2340.615442][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2340.615720][ C1] ? irqentry_enter+0x2b/0x60 [ 2340.615972][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2340.616292][ C1] ? irqentry_enter+0x2b/0x60 [ 2340.616546][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2340.616874][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2340.617160][ C1] ? arch_stack_walk+0x68/0x100 [ 2340.617425][ C1] __tcf_classify+0x32c/0x7d0 [ 2340.617681][ C1] tcf_classify+0x283/0x930 [ 2340.617931][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2340.618205][ C1] tc_run+0x2e4/0x5d0 [ 2340.618428][ C1] ? __pfx_tc_run+0x10/0x10 [ 2340.618677][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2340.618949][ C1] ? irqentry_enter+0x2b/0x60 [ 2340.619202][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2340.619490][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2340.619812][ C1] ip_finish_output2+0x786/0x18e0 [ 2340.620090][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2340.620384][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2340.620650][ C1] ? __ip_finish_output+0x10f/0x770 [ 2340.620932][ C1] ip_output+0x16b/0x4f0 [ 2340.621163][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2340.621483][ C1] ? __pfx_ip_output+0x10/0x10 [ 2340.621742][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2340.622096][ C1] ? __pfx_ip_output+0x10/0x10 [ 2340.622354][ C1] __ip_queue_xmit+0x672/0x1910 [ 2340.622618][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2340.622903][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2340.623202][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2340.623491][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2340.623790][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2340.624081][ C1] tcp_delack_timer+0x84/0x240 [ 2340.624343][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2340.624636][ C1] call_timer_fn+0x176/0x430 [ 2340.624889][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2340.625164][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2340.625448][ C1] __run_timers.part.0+0x52d/0x890 [ 2340.625723][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2340.626009][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2340.626312][ C1] ? __pfx___schedule+0x10/0x10 [ 2340.626576][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2340.626904][ C1] run_timer_softirq+0x72/0x100 [ 2340.627166][ C1] __do_softirq+0x1bc/0x7ff [ 2340.627412][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2340.627686][ C1] run_ksoftirqd+0x2e/0x60 [ 2340.627929][ C1] smpboot_thread_fn+0x30e/0x840 [ 2340.628195][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2340.628489][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2340.628778][ C1] kthread+0x292/0x360 [ 2340.629003][ C1] ? __pfx_kthread+0x10/0x10 [ 2340.629253][ C1] ret_from_fork+0x34/0x70 [ 2340.629493][ C1] ? __pfx_kthread+0x10/0x10 [ 2340.629738][ C1] ret_from_fork_asm+0x1b/0x30 [ 2340.630001][ C1] [ 2368.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1099s! [swapper/0:0] [ 2368.527914][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2368.529113][ C0] irq event stamp: 27567077 [ 2368.529354][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2368.529885][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2368.530357][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2368.530856][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2368.531348][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2368.531825][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2368.532480][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2368.532822][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2368.533847][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2368.534180][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2368.534607][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2368.535023][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2368.535439][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2368.535856][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2368.536275][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2368.536740][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2368.537094][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2368.537515][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2368.537933][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2368.538356][ C0] Call Trace: [ 2368.538540][ C0] [ 2368.538697][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2368.538971][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2368.539227][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2368.539514][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2368.539801][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2368.540106][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2368.540387][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2368.540710][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2368.540982][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2368.541263][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2368.541583][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2368.541894][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2368.542227][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2368.542532][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2368.542840][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2368.543147][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2368.543475][ C0] ? get_stack_info+0x36/0xc0 [ 2368.543729][ C0] ? lock_acquire+0x1c1/0x220 [ 2368.543987][ C0] ? lock_release+0x1d5/0x250 [ 2368.544239][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2368.544506][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2368.544796][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2368.545096][ C0] ? lock_acquire+0x1c1/0x220 [ 2368.545343][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2368.545600][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2368.545872][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2368.546121][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2368.546389][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2368.546661][ C0] ? __inet_lookup_established+0x341/0x610 [ 2368.546981][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2368.547271][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2368.547566][ C0] ip_local_deliver+0x19d/0x480 [ 2368.547827][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2368.548114][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2368.548380][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2368.548656][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2368.548916][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2368.549258][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2368.549532][ C0] ip_rcv+0x564/0x740 [ 2368.549743][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2368.549981][ C0] ? set_track_prepare+0x8a/0xd0 [ 2368.550245][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2368.550538][ C0] ? rest_init+0x153/0x260 [ 2368.550773][ C0] ? skb_clone+0x10b/0x330 [ 2368.551015][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2368.551349][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2368.551668][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2368.551968][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2368.552280][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2368.552541][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2368.552785][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2368.553106][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2368.553406][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2368.553744][ C0] ? lock_acquire+0x1c1/0x220 [ 2368.553990][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2368.554300][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2368.554607][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2368.554942][ C0] ? __copy_skb_header+0xaf/0x490 [ 2368.555213][ C0] ? __skb_clone+0x57a/0x760 [ 2368.555462][ C0] netif_receive_skb+0x55/0x280 [ 2368.555720][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2368.556045][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2368.556394][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2368.556711][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2368.556996][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2368.557295][ C0] ? hlock_class+0x4e/0x130 [ 2368.557538][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2368.557867][ C0] ? place_entity+0x21/0x2f0 [ 2368.558117][ C0] ? resched_curr+0x219/0x280 [ 2368.558374][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2368.558644][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2368.558929][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2368.559207][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2368.559466][ C0] ? activate_task+0xf5/0x260 [ 2368.559714][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2368.559994][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2368.560271][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2368.560532][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2368.560825][ C0] ? get_stack_info+0x36/0xc0 [ 2368.561090][ C0] ? stack_access_ok+0xda/0x1f0 [ 2368.561353][ C0] ? get_reg+0x119/0x190 [ 2368.561582][ C0] __tcf_classify+0x32c/0x7d0 [ 2368.561836][ C0] tcf_classify+0x283/0x930 [ 2368.562078][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2368.562406][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2368.562679][ C0] ? arch_stack_walk+0x8c/0x100 [ 2368.562944][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2368.563238][ C0] tc_run+0x2e4/0x5d0 [ 2368.563455][ C0] ? __pfx_tc_run+0x10/0x10 [ 2368.563696][ C0] ? lock_acquire+0x1c1/0x220 [ 2368.563944][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2368.564222][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2368.564500][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2368.564788][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2368.565072][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2368.565393][ C0] ? neigh_hh_output+0x348/0x590 [ 2368.565660][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2368.565945][ C0] ip_finish_output2+0x786/0x18e0 [ 2368.566221][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2368.566517][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2368.566872][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2368.567163][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2368.567431][ C0] ? __ip_finish_output+0x10f/0x770 [ 2368.567707][ C0] ip_output+0x16b/0x4f0 [ 2368.567932][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2368.568220][ C0] ? __pfx_ip_output+0x10/0x10 [ 2368.568473][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2368.568778][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2368.569042][ C0] ? ip_local_out+0x114/0x3b0 [ 2368.569295][ C0] __ip_queue_xmit+0x672/0x1910 [ 2368.569558][ C0] ? __skb_clone+0x57a/0x760 [ 2368.569807][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2368.570088][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2368.570382][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2368.570698][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2368.570957][ C0] ? tcp_current_mss+0x40a/0x510 [ 2368.571219][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2368.571502][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2368.571776][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2368.572029][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2368.572301][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2368.572621][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2368.572897][ C0] ? ktime_get+0xb6/0x190 [ 2368.573130][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2368.573404][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2368.573690][ C0] tcp_write_timer+0x82/0x1d0 [ 2368.573939][ C0] call_timer_fn+0x176/0x430 [ 2368.574183][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2368.574468][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2368.574742][ C0] __run_timers.part.0+0x52d/0x890 [ 2368.575013][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2368.575299][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2368.575597][ C0] ? lock_acquire+0x1c1/0x220 [ 2368.575848][ C0] ? clockevents_program_event+0xf6/0x300 [ 2368.576163][ C0] ? lock_release+0x1d5/0x250 [ 2368.576420][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2368.576702][ C0] ? ktime_get+0xb6/0x190 [ 2368.576943][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2368.577248][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2368.577563][ C0] run_timer_softirq+0x72/0x100 [ 2368.577829][ C0] __do_softirq+0x1bc/0x7ff [ 2368.578077][ C0] irq_exit_rcu+0x98/0xc0 [ 2368.578312][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2368.578616][ C0] [ 2368.578774][ C0] [ 2368.578932][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2368.579257][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2368.579530][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2368.580567][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2368.580897][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2368.581323][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2368.581752][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2368.582180][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2368.582606][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2368.583032][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2368.583343][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2368.583620][ C0] default_idle_call+0x69/0xa0 [ 2368.583877][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2368.584146][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2368.584446][ C0] ? lock_release+0x1d5/0x250 [ 2368.584698][ C0] do_idle+0xfb/0x160 [ 2368.584911][ C0] cpu_startup_entry+0x55/0x60 [ 2368.585167][ C0] rest_init+0x153/0x260 [ 2368.585398][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2368.585688][ C0] arch_call_rest_init+0x13/0x40 [ 2368.585956][ C0] start_kernel+0x314/0x3d0 [ 2368.586204][ C0] x86_64_start_reservations+0x18/0x30 [ 2368.586499][ C0] x86_64_start_kernel+0xba/0x110 [ 2368.586771][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2368.587099][ C0] [ 2368.587262][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1099s! [ksoftirqd/1:22] [ 2368.587737][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2368.588933][ C1] irq event stamp: 3886976 [ 2368.589170][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2368.589674][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2368.590176][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2368.590684][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2368.591180][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2368.591684][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2368.592336][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2368.592683][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2368.593712][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2368.594039][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2368.594467][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2368.594887][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2368.595308][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2368.595727][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2368.596146][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2368.596617][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2368.596970][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2368.597394][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2368.597822][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2368.598252][ C1] Call Trace: [ 2368.598434][ C1] [ 2368.598593][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2368.598869][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2368.599131][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2368.599425][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2368.599717][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2368.600023][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2368.600306][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2368.600634][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2368.600912][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2368.601242][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2368.601556][ C1] [ 2368.601713][ C1] [ 2368.601870][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2368.602199][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2368.602507][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2368.602820][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2368.603123][ C1] ? run_ksoftirqd+0xb/0x60 [ 2368.603367][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2368.603693][ C1] ? __orc_find+0x9c/0xf0 [ 2368.603929][ C1] ? lock_acquire+0x1c1/0x220 [ 2368.604185][ C1] ? irqentry_enter+0x2b/0x60 [ 2368.604448][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2368.604710][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2368.604995][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2368.605294][ C1] ? lock_acquire+0x1c1/0x220 [ 2368.605549][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2368.605807][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2368.606086][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2368.606332][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2368.606591][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2368.606863][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2368.607155][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2368.607448][ C1] ip_local_deliver+0x19d/0x480 [ 2368.607711][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2368.607999][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2368.608267][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2368.608544][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2368.608807][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2368.609148][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2368.609423][ C1] ip_rcv+0x564/0x740 [ 2368.609636][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2368.609876][ C1] ? set_track_prepare+0x8a/0xd0 [ 2368.610142][ C1] ? irqentry_enter+0x2b/0x60 [ 2368.610398][ C1] ? irqentry_enter+0x2b/0x60 [ 2368.610654][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2368.610899][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2368.611221][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2368.611564][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2368.611877][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2368.612217][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2368.612517][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2368.612854][ C1] netif_receive_skb+0x55/0x280 [ 2368.613117][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2368.613449][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2368.613801][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2368.614115][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2368.614415][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2368.614720][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2368.615050][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2368.615331][ C1] ? arch_stack_walk+0x68/0x100 [ 2368.615597][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2368.615879][ C1] ? irqentry_enter+0x2b/0x60 [ 2368.616137][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2368.616460][ C1] ? irqentry_enter+0x2b/0x60 [ 2368.616710][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2368.617035][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2368.617322][ C1] ? arch_stack_walk+0x68/0x100 [ 2368.617588][ C1] __tcf_classify+0x32c/0x7d0 [ 2368.617842][ C1] tcf_classify+0x283/0x930 [ 2368.618088][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2368.618358][ C1] tc_run+0x2e4/0x5d0 [ 2368.618573][ C1] ? __pfx_tc_run+0x10/0x10 [ 2368.618816][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2368.619084][ C1] ? irqentry_enter+0x2b/0x60 [ 2368.619339][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2368.619630][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2368.619957][ C1] ip_finish_output2+0x786/0x18e0 [ 2368.620228][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2368.620520][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2368.620789][ C1] ? __ip_finish_output+0x10f/0x770 [ 2368.621068][ C1] ip_output+0x16b/0x4f0 [ 2368.621295][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2368.621617][ C1] ? __pfx_ip_output+0x10/0x10 [ 2368.621871][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2368.622231][ C1] ? __pfx_ip_output+0x10/0x10 [ 2368.622492][ C1] __ip_queue_xmit+0x672/0x1910 [ 2368.622754][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2368.623039][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2368.623338][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2368.623624][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2368.623918][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2368.624203][ C1] tcp_delack_timer+0x84/0x240 [ 2368.624463][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2368.624749][ C1] call_timer_fn+0x176/0x430 [ 2368.624995][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2368.625273][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2368.625551][ C1] __run_timers.part.0+0x52d/0x890 [ 2368.625823][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2368.626114][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2368.626419][ C1] ? __pfx___schedule+0x10/0x10 [ 2368.626680][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2368.627000][ C1] run_timer_softirq+0x72/0x100 [ 2368.627270][ C1] __do_softirq+0x1bc/0x7ff [ 2368.627517][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2368.627796][ C1] run_ksoftirqd+0x2e/0x60 [ 2368.628038][ C1] smpboot_thread_fn+0x30e/0x840 [ 2368.628308][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2368.628596][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2368.628888][ C1] kthread+0x292/0x360 [ 2368.629108][ C1] ? __pfx_kthread+0x10/0x10 [ 2368.629358][ C1] ret_from_fork+0x34/0x70 [ 2368.629595][ C1] ? __pfx_kthread+0x10/0x10 [ 2368.629843][ C1] ret_from_fork_asm+0x1b/0x30 [ 2368.630100][ C1] [ 2391.498023][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 2391.498406][ C1] rcu: 1-....: (1195344 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=291660 [ 2391.498994][ C1] rcu: (t=1197189 jiffies g=1007429 q=31 ncpus=4) [ 2391.499344][ C1] Sending NMI from CPU 1 to CPUs 0: [ 2391.499629][ C0] NMI backtrace for cpu 0 [ 2391.499636][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2391.499640][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2391.499643][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2391.499652][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2391.499655][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2391.499659][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2391.499661][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2391.499663][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2391.499664][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2391.499666][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2391.499668][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2391.499670][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2391.499674][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2391.499676][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2391.499678][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2391.499679][ C0] Call Trace: [ 2391.499683][ C0] [ 2391.499686][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 2391.499692][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 2391.499698][ C0] ? nmi_handle+0x156/0x420 [ 2391.499703][ C0] ? default_do_nmi+0x41/0x100 [ 2391.499708][ C0] ? exc_nmi+0xf3/0x120 [ 2391.499710][ C0] ? end_repeat_nmi+0xf/0x60 [ 2391.499715][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2391.499719][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2391.499723][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2391.499727][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2391.499730][ C0] [ 2391.499731][ C0] [ 2391.499733][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2391.499736][ C0] ? get_stack_info+0x36/0xc0 [ 2391.499741][ C0] ? lock_acquire+0x1c1/0x220 [ 2391.499745][ C0] ? lock_release+0x1d5/0x250 [ 2391.499749][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2391.499753][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2391.499755][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2391.499759][ C0] ? lock_acquire+0x1c1/0x220 [ 2391.499761][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2391.499767][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2391.499771][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2391.499778][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2391.499781][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2391.499785][ C0] ? __inet_lookup_established+0x341/0x610 [ 2391.499791][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2391.499799][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2391.499803][ C0] ip_local_deliver+0x19d/0x480 [ 2391.499806][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2391.499809][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2391.499814][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2391.499818][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2391.499821][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2391.499824][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2391.499834][ C0] ip_rcv+0x564/0x740 [ 2391.499838][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2391.499841][ C0] ? set_track_prepare+0x8a/0xd0 [ 2391.499846][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2391.499848][ C0] ? rest_init+0x153/0x260 [ 2391.499850][ C0] ? skb_clone+0x10b/0x330 [ 2391.499855][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2391.499861][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2391.499867][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2391.499873][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2391.499882][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2391.499885][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2391.499887][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2391.499892][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2391.499896][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2391.499899][ C0] ? lock_acquire+0x1c1/0x220 [ 2391.499901][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2391.499905][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2391.499907][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2391.499911][ C0] ? __copy_skb_header+0xaf/0x490 [ 2391.499914][ C0] ? __skb_clone+0x57a/0x760 [ 2391.499916][ C0] netif_receive_skb+0x55/0x280 [ 2391.499919][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2391.499927][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2391.499935][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2391.499941][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2391.499947][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2391.499955][ C0] ? hlock_class+0x4e/0x130 [ 2391.499962][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2391.499972][ C0] ? place_entity+0x21/0x2f0 [ 2391.499976][ C0] ? resched_curr+0x219/0x280 [ 2391.499980][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2391.499983][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2391.499987][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2391.499992][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2391.499994][ C0] ? activate_task+0xf5/0x260 [ 2391.499998][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2391.500003][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2391.500007][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2391.500010][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2391.500013][ C0] ? get_stack_info+0x36/0xc0 [ 2391.500017][ C0] ? stack_access_ok+0xda/0x1f0 [ 2391.500019][ C0] ? get_reg+0x119/0x190 [ 2391.500024][ C0] __tcf_classify+0x32c/0x7d0 [ 2391.500029][ C0] tcf_classify+0x283/0x930 [ 2391.500032][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2391.500037][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2391.500039][ C0] ? arch_stack_walk+0x8c/0x100 [ 2391.500044][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2391.500048][ C0] tc_run+0x2e4/0x5d0 [ 2391.500053][ C0] ? __pfx_tc_run+0x10/0x10 [ 2391.500057][ C0] ? lock_acquire+0x1c1/0x220 [ 2391.500059][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2391.500064][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2391.500070][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2391.500072][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2391.500076][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2391.500081][ C0] ? neigh_hh_output+0x348/0x590 [ 2391.500085][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2391.500089][ C0] ip_finish_output2+0x786/0x18e0 [ 2391.500092][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2391.500098][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2391.500106][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2391.500109][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2391.500113][ C0] ? __ip_finish_output+0x10f/0x770 [ 2391.500117][ C0] ip_output+0x16b/0x4f0 [ 2391.500120][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2391.500125][ C0] ? __pfx_ip_output+0x10/0x10 [ 2391.500128][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2391.500133][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2391.500136][ C0] ? ip_local_out+0x114/0x3b0 [ 2391.500140][ C0] __ip_queue_xmit+0x672/0x1910 [ 2391.500144][ C0] ? __skb_clone+0x57a/0x760 [ 2391.500147][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2391.500154][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2391.500159][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2391.500163][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2391.500168][ C0] ? tcp_current_mss+0x40a/0x510 [ 2391.500172][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2391.500175][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2391.500177][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2391.500180][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2391.500183][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2391.500186][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2391.500192][ C0] ? ktime_get+0xb6/0x190 [ 2391.500196][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2391.500200][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2391.500203][ C0] tcp_write_timer+0x82/0x1d0 [ 2391.500207][ C0] call_timer_fn+0x176/0x430 [ 2391.500211][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2391.500215][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2391.500219][ C0] __run_timers.part.0+0x52d/0x890 [ 2391.500222][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2391.500227][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2391.500230][ C0] ? lock_acquire+0x1c1/0x220 [ 2391.500232][ C0] ? clockevents_program_event+0xf6/0x300 [ 2391.500239][ C0] ? lock_release+0x1d5/0x250 [ 2391.500241][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2391.500244][ C0] ? ktime_get+0xb6/0x190 [ 2391.500247][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2391.500250][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2391.500255][ C0] run_timer_softirq+0x72/0x100 [ 2391.500258][ C0] __do_softirq+0x1bc/0x7ff [ 2391.500263][ C0] irq_exit_rcu+0x98/0xc0 [ 2391.500266][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2391.500270][ C0] [ 2391.500271][ C0] [ 2391.500272][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2391.500277][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2391.500280][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2391.500283][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2391.500285][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2391.500286][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2391.500288][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2391.500289][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2391.500291][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2391.500294][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2391.500298][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2391.500301][ C0] default_idle_call+0x69/0xa0 [ 2391.500304][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2391.500306][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2391.500312][ C0] ? lock_release+0x1d5/0x250 [ 2391.500316][ C0] do_idle+0xfb/0x160 [ 2391.500319][ C0] cpu_startup_entry+0x55/0x60 [ 2391.500321][ C0] rest_init+0x153/0x260 [ 2391.500324][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2391.500330][ C0] arch_call_rest_init+0x13/0x40 [ 2391.500335][ C0] start_kernel+0x314/0x3d0 [ 2391.500339][ C0] x86_64_start_reservations+0x18/0x30 [ 2391.500344][ C0] x86_64_start_kernel+0xba/0x110 [ 2391.500347][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2391.500355][ C0] [ 2391.500624][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2391.554819][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2391.555465][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2391.555810][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2391.556826][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2391.557153][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2391.557574][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2391.557996][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2391.558418][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2391.558836][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2391.559254][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2391.559723][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2391.560076][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2391.560494][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2391.560915][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2391.561341][ C1] Call Trace: [ 2391.561529][ C1] [ 2391.561685][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 2391.561971][ C1] ? print_cpu_stall+0x263/0x6a0 [ 2391.562241][ C1] ? check_cpu_stall+0x284/0x500 [ 2391.562505][ C1] ? rcu_pending+0x92/0x360 [ 2391.562749][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 2391.563035][ C1] ? update_process_times+0xb9/0x110 [ 2391.563322][ C1] ? tick_sched_handle+0x67/0x130 [ 2391.563593][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 2391.563895][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2391.564152][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 2391.564485][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2391.564775][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2391.565084][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2391.565366][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2391.565688][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2391.565961][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2391.566292][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2391.566604][ C1] [ 2391.566761][ C1] [ 2391.566918][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2391.567250][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2391.567557][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2391.567871][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2391.568173][ C1] ? run_ksoftirqd+0xb/0x60 [ 2391.568414][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2391.568740][ C1] ? __orc_find+0x9c/0xf0 [ 2391.568973][ C1] ? lock_acquire+0x1c1/0x220 [ 2391.569230][ C1] ? irqentry_enter+0x2b/0x60 [ 2391.569487][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2391.569751][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2391.570039][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2391.570338][ C1] ? lock_acquire+0x1c1/0x220 [ 2391.570584][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2391.570835][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2391.571107][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2391.571360][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2391.571624][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2391.571897][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2391.572192][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2391.572488][ C1] ip_local_deliver+0x19d/0x480 [ 2391.572747][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2391.573034][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2391.573298][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2391.573579][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2391.573844][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2391.574178][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2391.574464][ C1] ip_rcv+0x564/0x740 [ 2391.574676][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2391.574917][ C1] ? set_track_prepare+0x8a/0xd0 [ 2391.575183][ C1] ? irqentry_enter+0x2b/0x60 [ 2391.575436][ C1] ? irqentry_enter+0x2b/0x60 [ 2391.575688][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2391.575932][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2391.576252][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2391.576596][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2391.576907][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2391.577245][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2391.577544][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2391.577879][ C1] netif_receive_skb+0x55/0x280 [ 2391.578142][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2391.578475][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2391.578825][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2391.579138][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2391.579431][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2391.579739][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2391.580070][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2391.580354][ C1] ? arch_stack_walk+0x68/0x100 [ 2391.580613][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2391.580888][ C1] ? irqentry_enter+0x2b/0x60 [ 2391.581136][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2391.581452][ C1] ? irqentry_enter+0x2b/0x60 [ 2391.581706][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2391.582032][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2391.582312][ C1] ? arch_stack_walk+0x68/0x100 [ 2391.582577][ C1] __tcf_classify+0x32c/0x7d0 [ 2391.582834][ C1] tcf_classify+0x283/0x930 [ 2391.583081][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2391.583353][ C1] tc_run+0x2e4/0x5d0 [ 2391.583569][ C1] ? __pfx_tc_run+0x10/0x10 [ 2391.583815][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2391.584083][ C1] ? irqentry_enter+0x2b/0x60 [ 2391.584337][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2391.584625][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2391.584955][ C1] ip_finish_output2+0x786/0x18e0 [ 2391.585226][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2391.585514][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2391.585783][ C1] ? __ip_finish_output+0x10f/0x770 [ 2391.586062][ C1] ip_output+0x16b/0x4f0 [ 2391.586289][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2391.586612][ C1] ? __pfx_ip_output+0x10/0x10 [ 2391.586868][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2391.587225][ C1] ? __pfx_ip_output+0x10/0x10 [ 2391.587489][ C1] __ip_queue_xmit+0x672/0x1910 [ 2391.587751][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2391.588034][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2391.588330][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2391.588616][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2391.588912][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2391.589196][ C1] tcp_delack_timer+0x84/0x240 [ 2391.589449][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2391.589735][ C1] call_timer_fn+0x176/0x430 [ 2391.589984][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2391.590260][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2391.590540][ C1] __run_timers.part.0+0x52d/0x890 [ 2391.590816][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2391.591103][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2391.591402][ C1] ? __pfx___schedule+0x10/0x10 [ 2391.591667][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2391.591988][ C1] run_timer_softirq+0x72/0x100 [ 2391.592248][ C1] __do_softirq+0x1bc/0x7ff [ 2391.592489][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2391.592762][ C1] run_ksoftirqd+0x2e/0x60 [ 2391.593003][ C1] smpboot_thread_fn+0x30e/0x840 [ 2391.593268][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2391.593560][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2391.593848][ C1] kthread+0x292/0x360 [ 2391.594070][ C1] ? __pfx_kthread+0x10/0x10 [ 2391.594322][ C1] ret_from_fork+0x34/0x70 [ 2391.594564][ C1] ? __pfx_kthread+0x10/0x10 [ 2391.594813][ C1] ret_from_fork_asm+0x1b/0x30 [ 2391.595073][ C1] [ 2416.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1144s! [swapper/0:0] [ 2416.527924][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2416.529126][ C0] irq event stamp: 27567077 [ 2416.529368][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2416.529900][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2416.530375][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2416.530878][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2416.531373][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2416.531851][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2416.532502][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2416.532845][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2416.533870][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2416.534203][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2416.534621][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2416.535038][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2416.535456][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2416.535872][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2416.536290][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2416.536759][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2416.537112][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2416.537531][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2416.537955][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2416.538381][ C0] Call Trace: [ 2416.538561][ C0] [ 2416.538722][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2416.538997][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2416.539256][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2416.539547][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2416.539839][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2416.540144][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2416.540424][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2416.540748][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2416.541019][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2416.541299][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2416.541621][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2416.541929][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2416.542265][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2416.542565][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2416.542877][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2416.543182][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2416.543509][ C0] ? get_stack_info+0x36/0xc0 [ 2416.543759][ C0] ? lock_acquire+0x1c1/0x220 [ 2416.544007][ C0] ? lock_release+0x1d5/0x250 [ 2416.544265][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2416.544526][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2416.544811][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2416.545117][ C0] ? lock_acquire+0x1c1/0x220 [ 2416.545364][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2416.545617][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2416.545888][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2416.546138][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2416.546398][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2416.546672][ C0] ? __inet_lookup_established+0x341/0x610 [ 2416.546985][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2416.547274][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2416.547562][ C0] ip_local_deliver+0x19d/0x480 [ 2416.547823][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2416.548113][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2416.548384][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2416.548660][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2416.548921][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2416.549260][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2416.549531][ C0] ip_rcv+0x564/0x740 [ 2416.549746][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2416.549988][ C0] ? set_track_prepare+0x8a/0xd0 [ 2416.550251][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2416.550539][ C0] ? rest_init+0x153/0x260 [ 2416.550775][ C0] ? skb_clone+0x10b/0x330 [ 2416.551016][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2416.551346][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2416.551663][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2416.551957][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2416.552269][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2416.552529][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2416.552774][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2416.553090][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2416.553389][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2416.553727][ C0] ? lock_acquire+0x1c1/0x220 [ 2416.553975][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2416.554290][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2416.554585][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2416.554917][ C0] ? __copy_skb_header+0xaf/0x490 [ 2416.555189][ C0] ? __skb_clone+0x57a/0x760 [ 2416.555437][ C0] netif_receive_skb+0x55/0x280 [ 2416.555693][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2416.556019][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2416.556364][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2416.556679][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2416.556966][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2416.557266][ C0] ? hlock_class+0x4e/0x130 [ 2416.557512][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2416.557838][ C0] ? place_entity+0x21/0x2f0 [ 2416.558084][ C0] ? resched_curr+0x219/0x280 [ 2416.558336][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2416.558608][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2416.558894][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2416.559175][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2416.559432][ C0] ? activate_task+0xf5/0x260 [ 2416.559685][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2416.559958][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2416.560235][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2416.560494][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2416.560782][ C0] ? get_stack_info+0x36/0xc0 [ 2416.561036][ C0] ? stack_access_ok+0xda/0x1f0 [ 2416.561297][ C0] ? get_reg+0x119/0x190 [ 2416.561529][ C0] __tcf_classify+0x32c/0x7d0 [ 2416.561780][ C0] tcf_classify+0x283/0x930 [ 2416.562022][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2416.562353][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2416.562622][ C0] ? arch_stack_walk+0x8c/0x100 [ 2416.562890][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2416.563186][ C0] tc_run+0x2e4/0x5d0 [ 2416.563402][ C0] ? __pfx_tc_run+0x10/0x10 [ 2416.563645][ C0] ? lock_acquire+0x1c1/0x220 [ 2416.563895][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2416.564175][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2416.564440][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2416.564729][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2416.565010][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2416.565337][ C0] ? neigh_hh_output+0x348/0x590 [ 2416.565600][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2416.565880][ C0] ip_finish_output2+0x786/0x18e0 [ 2416.566151][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2416.566449][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2416.566799][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2416.567087][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2416.567354][ C0] ? __ip_finish_output+0x10f/0x770 [ 2416.567630][ C0] ip_output+0x16b/0x4f0 [ 2416.567856][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2416.568140][ C0] ? __pfx_ip_output+0x10/0x10 [ 2416.568395][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2416.568695][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2416.568958][ C0] ? ip_local_out+0x114/0x3b0 [ 2416.569214][ C0] __ip_queue_xmit+0x672/0x1910 [ 2416.569477][ C0] ? __skb_clone+0x57a/0x760 [ 2416.569725][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2416.570005][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2416.570300][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2416.570617][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2416.570878][ C0] ? tcp_current_mss+0x40a/0x510 [ 2416.571141][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2416.571424][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2416.571700][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2416.571954][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2416.572226][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2416.572548][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2416.572823][ C0] ? ktime_get+0xb6/0x190 [ 2416.573055][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2416.573329][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2416.573612][ C0] tcp_write_timer+0x82/0x1d0 [ 2416.573863][ C0] call_timer_fn+0x176/0x430 [ 2416.574113][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2416.574393][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2416.574669][ C0] __run_timers.part.0+0x52d/0x890 [ 2416.574940][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2416.575227][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2416.575525][ C0] ? lock_acquire+0x1c1/0x220 [ 2416.575779][ C0] ? clockevents_program_event+0xf6/0x300 [ 2416.576089][ C0] ? lock_release+0x1d5/0x250 [ 2416.576341][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2416.576620][ C0] ? ktime_get+0xb6/0x190 [ 2416.576853][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2416.577157][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2416.577469][ C0] run_timer_softirq+0x72/0x100 [ 2416.577733][ C0] __do_softirq+0x1bc/0x7ff [ 2416.577980][ C0] irq_exit_rcu+0x98/0xc0 [ 2416.578216][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2416.578519][ C0] [ 2416.578675][ C0] [ 2416.578831][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2416.579148][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2416.579427][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2416.580452][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2416.580778][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2416.581204][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2416.581625][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2416.582044][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2416.582466][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2416.582891][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2416.583195][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2416.583471][ C0] default_idle_call+0x69/0xa0 [ 2416.583724][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2416.583987][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2416.584282][ C0] ? lock_release+0x1d5/0x250 [ 2416.584529][ C0] do_idle+0xfb/0x160 [ 2416.584742][ C0] cpu_startup_entry+0x55/0x60 [ 2416.584997][ C0] rest_init+0x153/0x260 [ 2416.585224][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2416.585510][ C0] arch_call_rest_init+0x13/0x40 [ 2416.585775][ C0] start_kernel+0x314/0x3d0 [ 2416.586020][ C0] x86_64_start_reservations+0x18/0x30 [ 2416.586321][ C0] x86_64_start_kernel+0xba/0x110 [ 2416.586588][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2416.586916][ C0] [ 2416.587082][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1144s! [ksoftirqd/1:22] [ 2416.587552][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2416.588750][ C1] irq event stamp: 3886976 [ 2416.588993][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2416.589486][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2416.589976][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2416.590476][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2416.590969][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2416.591459][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2416.592102][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2416.592442][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2416.593459][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2416.593781][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2416.594211][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2416.594632][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2416.595055][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2416.595481][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2416.595909][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2416.596384][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2416.596734][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2416.597167][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2416.597590][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2416.598009][ C1] Call Trace: [ 2416.598188][ C1] [ 2416.598344][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2416.598625][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2416.598880][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2416.599176][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2416.599460][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2416.599762][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2416.600040][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2416.600361][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2416.600639][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2416.600961][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2416.601271][ C1] [ 2416.601430][ C1] [ 2416.601589][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2416.601925][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2416.602229][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2416.602538][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2416.602845][ C1] ? run_ksoftirqd+0xb/0x60 [ 2416.603093][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2416.603422][ C1] ? __orc_find+0x9c/0xf0 [ 2416.603652][ C1] ? lock_acquire+0x1c1/0x220 [ 2416.603902][ C1] ? irqentry_enter+0x2b/0x60 [ 2416.604157][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2416.604420][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2416.604711][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2416.605017][ C1] ? lock_acquire+0x1c1/0x220 [ 2416.605271][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2416.605525][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2416.605798][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2416.606048][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2416.606309][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2416.606585][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2416.606877][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2416.607171][ C1] ip_local_deliver+0x19d/0x480 [ 2416.607428][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2416.607710][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2416.607976][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2416.608256][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2416.608522][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2416.608857][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2416.609135][ C1] ip_rcv+0x564/0x740 [ 2416.609355][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2416.609608][ C1] ? set_track_prepare+0x8a/0xd0 [ 2416.609877][ C1] ? irqentry_enter+0x2b/0x60 [ 2416.610128][ C1] ? irqentry_enter+0x2b/0x60 [ 2416.610379][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2416.610621][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2416.610933][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2416.611273][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2416.611580][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2416.611922][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2416.612221][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2416.612550][ C1] netif_receive_skb+0x55/0x280 [ 2416.612808][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2416.613134][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2416.613481][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2416.613795][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2416.614082][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2416.614395][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2416.614728][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2416.615012][ C1] ? arch_stack_walk+0x68/0x100 [ 2416.615273][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2416.615549][ C1] ? irqentry_enter+0x2b/0x60 [ 2416.615800][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2416.616119][ C1] ? irqentry_enter+0x2b/0x60 [ 2416.616375][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2416.616699][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2416.616978][ C1] ? arch_stack_walk+0x68/0x100 [ 2416.617240][ C1] __tcf_classify+0x32c/0x7d0 [ 2416.617495][ C1] tcf_classify+0x283/0x930 [ 2416.617740][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2416.618012][ C1] tc_run+0x2e4/0x5d0 [ 2416.618233][ C1] ? __pfx_tc_run+0x10/0x10 [ 2416.618480][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2416.618751][ C1] ? irqentry_enter+0x2b/0x60 [ 2416.619003][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2416.619288][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2416.619614][ C1] ip_finish_output2+0x786/0x18e0 [ 2416.619891][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2416.620185][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2416.620447][ C1] ? __ip_finish_output+0x10f/0x770 [ 2416.620728][ C1] ip_output+0x16b/0x4f0 [ 2416.620960][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2416.621278][ C1] ? __pfx_ip_output+0x10/0x10 [ 2416.621539][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2416.621890][ C1] ? __pfx_ip_output+0x10/0x10 [ 2416.622145][ C1] __ip_queue_xmit+0x672/0x1910 [ 2416.622409][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2416.622693][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2416.622989][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2416.623280][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2416.623582][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2416.623871][ C1] tcp_delack_timer+0x84/0x240 [ 2416.624137][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2416.624426][ C1] call_timer_fn+0x176/0x430 [ 2416.624678][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2416.624951][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2416.625232][ C1] __run_timers.part.0+0x52d/0x890 [ 2416.625507][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2416.625795][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2416.626095][ C1] ? __pfx___schedule+0x10/0x10 [ 2416.626357][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2416.626681][ C1] run_timer_softirq+0x72/0x100 [ 2416.626941][ C1] __do_softirq+0x1bc/0x7ff [ 2416.627183][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2416.627456][ C1] run_ksoftirqd+0x2e/0x60 [ 2416.627697][ C1] smpboot_thread_fn+0x30e/0x840 [ 2416.627961][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2416.628258][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2416.628550][ C1] kthread+0x292/0x360 [ 2416.628769][ C1] ? __pfx_kthread+0x10/0x10 [ 2416.629014][ C1] ret_from_fork+0x34/0x70 [ 2416.629255][ C1] ? __pfx_kthread+0x10/0x10 [ 2416.629503][ C1] ret_from_fork_asm+0x1b/0x30 [ 2416.629768][ C1] [ 2444.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1170s! [swapper/0:0] [ 2444.527924][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2444.529113][ C0] irq event stamp: 27567077 [ 2444.529352][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2444.529876][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2444.530356][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2444.530863][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2444.531368][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2444.531852][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2444.532489][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2444.532826][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2444.533843][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2444.534170][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2444.534595][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2444.535020][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2444.535441][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2444.535865][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2444.536289][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2444.536765][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2444.537114][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2444.537541][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2444.537961][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2444.538379][ C0] Call Trace: [ 2444.538557][ C0] [ 2444.538713][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2444.538992][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2444.539248][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2444.539541][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2444.539827][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2444.540128][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2444.540405][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2444.540727][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2444.541002][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2444.541278][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2444.541608][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2444.541919][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2444.542251][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2444.542558][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2444.542870][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2444.543172][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2444.543495][ C0] ? get_stack_info+0x36/0xc0 [ 2444.543749][ C0] ? lock_acquire+0x1c1/0x220 [ 2444.544009][ C0] ? lock_release+0x1d5/0x250 [ 2444.544258][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2444.544518][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2444.544800][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2444.545099][ C0] ? lock_acquire+0x1c1/0x220 [ 2444.545352][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2444.545609][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2444.545885][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2444.546128][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2444.546383][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2444.546650][ C0] ? __inet_lookup_established+0x341/0x610 [ 2444.546959][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2444.547250][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2444.547541][ C0] ip_local_deliver+0x19d/0x480 [ 2444.547797][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2444.548082][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2444.548347][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2444.548628][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2444.548893][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2444.549227][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2444.549506][ C0] ip_rcv+0x564/0x740 [ 2444.549721][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2444.549966][ C0] ? set_track_prepare+0x8a/0xd0 [ 2444.550233][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2444.550520][ C0] ? rest_init+0x153/0x260 [ 2444.550759][ C0] ? skb_clone+0x10b/0x330 [ 2444.550998][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2444.551336][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2444.551659][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2444.551950][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2444.552256][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2444.552516][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2444.552756][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2444.553073][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2444.553377][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2444.553717][ C0] ? lock_acquire+0x1c1/0x220 [ 2444.553969][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2444.554286][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2444.554587][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2444.554917][ C0] ? __copy_skb_header+0xaf/0x490 [ 2444.555184][ C0] ? __skb_clone+0x57a/0x760 [ 2444.555428][ C0] netif_receive_skb+0x55/0x280 [ 2444.555688][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2444.556022][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2444.556373][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2444.556684][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2444.556976][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2444.557279][ C0] ? hlock_class+0x4e/0x130 [ 2444.557529][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2444.557860][ C0] ? place_entity+0x21/0x2f0 [ 2444.558110][ C0] ? resched_curr+0x219/0x280 [ 2444.558358][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2444.558624][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2444.558908][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2444.559187][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2444.559452][ C0] ? activate_task+0xf5/0x260 [ 2444.559708][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2444.559983][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2444.560254][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2444.560516][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2444.560806][ C0] ? get_stack_info+0x36/0xc0 [ 2444.561056][ C0] ? stack_access_ok+0xda/0x1f0 [ 2444.561313][ C0] ? get_reg+0x119/0x190 [ 2444.561545][ C0] __tcf_classify+0x32c/0x7d0 [ 2444.561799][ C0] tcf_classify+0x283/0x930 [ 2444.562044][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2444.562382][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2444.562647][ C0] ? arch_stack_walk+0x8c/0x100 [ 2444.562908][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2444.563199][ C0] tc_run+0x2e4/0x5d0 [ 2444.563417][ C0] ? __pfx_tc_run+0x10/0x10 [ 2444.563665][ C0] ? lock_acquire+0x1c1/0x220 [ 2444.563919][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2444.564200][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2444.564471][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2444.564759][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2444.565038][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2444.565355][ C0] ? neigh_hh_output+0x348/0x590 [ 2444.565620][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2444.565893][ C0] ip_finish_output2+0x786/0x18e0 [ 2444.566160][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2444.566454][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2444.566807][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2444.567099][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2444.567363][ C0] ? __ip_finish_output+0x10f/0x770 [ 2444.567643][ C0] ip_output+0x16b/0x4f0 [ 2444.567873][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2444.568154][ C0] ? __pfx_ip_output+0x10/0x10 [ 2444.568410][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2444.568710][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2444.568977][ C0] ? ip_local_out+0x114/0x3b0 [ 2444.569229][ C0] __ip_queue_xmit+0x672/0x1910 [ 2444.569488][ C0] ? __skb_clone+0x57a/0x760 [ 2444.569732][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2444.570015][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2444.570312][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2444.570633][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2444.570890][ C0] ? tcp_current_mss+0x40a/0x510 [ 2444.571157][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2444.571436][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2444.571718][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2444.571974][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2444.572240][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2444.572556][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2444.572836][ C0] ? ktime_get+0xb6/0x190 [ 2444.573070][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2444.573347][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2444.573627][ C0] tcp_write_timer+0x82/0x1d0 [ 2444.573879][ C0] call_timer_fn+0x176/0x430 [ 2444.574136][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2444.574412][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2444.574684][ C0] __run_timers.part.0+0x52d/0x890 [ 2444.574960][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2444.575245][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2444.575547][ C0] ? lock_acquire+0x1c1/0x220 [ 2444.575796][ C0] ? clockevents_program_event+0xf6/0x300 [ 2444.576100][ C0] ? lock_release+0x1d5/0x250 [ 2444.576347][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2444.576621][ C0] ? ktime_get+0xb6/0x190 [ 2444.576851][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2444.577149][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2444.577464][ C0] run_timer_softirq+0x72/0x100 [ 2444.577733][ C0] __do_softirq+0x1bc/0x7ff [ 2444.577977][ C0] irq_exit_rcu+0x98/0xc0 [ 2444.578208][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2444.578512][ C0] [ 2444.578670][ C0] [ 2444.578829][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2444.579149][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2444.579415][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2444.580428][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2444.580755][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2444.581176][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2444.581593][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2444.582007][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2444.582424][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2444.582842][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2444.583142][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2444.583413][ C0] default_idle_call+0x69/0xa0 [ 2444.583669][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2444.583930][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2444.584228][ C0] ? lock_release+0x1d5/0x250 [ 2444.584481][ C0] do_idle+0xfb/0x160 [ 2444.584702][ C0] cpu_startup_entry+0x55/0x60 [ 2444.584958][ C0] rest_init+0x153/0x260 [ 2444.585183][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2444.585474][ C0] arch_call_rest_init+0x13/0x40 [ 2444.585744][ C0] start_kernel+0x314/0x3d0 [ 2444.585986][ C0] x86_64_start_reservations+0x18/0x30 [ 2444.586278][ C0] x86_64_start_kernel+0xba/0x110 [ 2444.586548][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2444.586878][ C0] [ 2444.587044][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1170s! [ksoftirqd/1:22] [ 2444.587514][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2444.588710][ C1] irq event stamp: 3886976 [ 2444.588946][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2444.589450][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2444.589951][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2444.590456][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2444.590949][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2444.591448][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2444.592100][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 2444.592399][ C1] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 2444.593431][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [ 2444.593760][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2444.594196][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2444.594618][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2444.595042][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2444.595463][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2444.595883][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2444.596356][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2444.596712][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2444.597136][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2444.597560][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2444.597989][ C1] Call Trace: [ 2444.598179][ C1] [ 2444.598336][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2444.598613][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2444.598871][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2444.599161][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2444.599456][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2444.599764][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2444.600051][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2444.600374][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2444.600649][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2444.600980][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2444.601299][ C1] [ 2444.601456][ C1] [ 2444.601614][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2444.601945][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2444.602253][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 2444.602553][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 2444.602852][ C1] ? run_ksoftirqd+0xb/0x60 [ 2444.603101][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2444.603431][ C1] ? __orc_find+0x9c/0xf0 [ 2444.603663][ C1] ? lock_acquire+0x1c1/0x220 [ 2444.603912][ C1] ? irqentry_enter+0x2b/0x60 [ 2444.604168][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2444.604433][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2444.604723][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2444.605029][ C1] ? lock_acquire+0x1c1/0x220 [ 2444.605279][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2444.605534][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2444.605807][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2444.606058][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2444.606324][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2444.606601][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2444.606893][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2444.607188][ C1] ip_local_deliver+0x19d/0x480 [ 2444.607445][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2444.607727][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2444.607992][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2444.608274][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2444.608543][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2444.608879][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2444.609156][ C1] ip_rcv+0x564/0x740 [ 2444.609378][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2444.609624][ C1] ? set_track_prepare+0x8a/0xd0 [ 2444.609894][ C1] ? irqentry_enter+0x2b/0x60 [ 2444.610148][ C1] ? irqentry_enter+0x2b/0x60 [ 2444.610399][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2444.610642][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2444.610956][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2444.611298][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2444.611608][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2444.611952][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2444.612254][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2444.612584][ C1] netif_receive_skb+0x55/0x280 [ 2444.612844][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2444.613172][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2444.613522][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2444.613837][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2444.614136][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2444.614443][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2444.614777][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2444.615062][ C1] ? arch_stack_walk+0x68/0x100 [ 2444.615323][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2444.615599][ C1] ? irqentry_enter+0x2b/0x60 [ 2444.615851][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2444.616173][ C1] ? irqentry_enter+0x2b/0x60 [ 2444.616429][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2444.616754][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2444.617035][ C1] ? arch_stack_walk+0x68/0x100 [ 2444.617298][ C1] __tcf_classify+0x32c/0x7d0 [ 2444.617553][ C1] tcf_classify+0x283/0x930 [ 2444.617799][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2444.618075][ C1] tc_run+0x2e4/0x5d0 [ 2444.618298][ C1] ? __pfx_tc_run+0x10/0x10 [ 2444.618547][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2444.618823][ C1] ? irqentry_enter+0x2b/0x60 [ 2444.619076][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2444.619364][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2444.619687][ C1] ip_finish_output2+0x786/0x18e0 [ 2444.619963][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2444.620257][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2444.620521][ C1] ? __ip_finish_output+0x10f/0x770 [ 2444.620804][ C1] ip_output+0x16b/0x4f0 [ 2444.621035][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2444.621353][ C1] ? __pfx_ip_output+0x10/0x10 [ 2444.621615][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2444.621969][ C1] ? __pfx_ip_output+0x10/0x10 [ 2444.622225][ C1] __ip_queue_xmit+0x672/0x1910 [ 2444.622490][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2444.622776][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2444.623075][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2444.623367][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2444.623669][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2444.623960][ C1] tcp_delack_timer+0x84/0x240 [ 2444.624226][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2444.624517][ C1] call_timer_fn+0x176/0x430 [ 2444.624771][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2444.625046][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2444.625326][ C1] __run_timers.part.0+0x52d/0x890 [ 2444.625603][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2444.625893][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2444.626196][ C1] ? __pfx___schedule+0x10/0x10 [ 2444.626458][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2444.626784][ C1] run_timer_softirq+0x72/0x100 [ 2444.627045][ C1] __do_softirq+0x1bc/0x7ff [ 2444.627289][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2444.627562][ C1] run_ksoftirqd+0x2e/0x60 [ 2444.627805][ C1] smpboot_thread_fn+0x30e/0x840 [ 2444.628070][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2444.628366][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2444.628657][ C1] kthread+0x292/0x360 [ 2444.628877][ C1] ? __pfx_kthread+0x10/0x10 [ 2444.629123][ C1] ret_from_fork+0x34/0x70 [ 2444.629366][ C1] ? __pfx_kthread+0x10/0x10 [ 2444.629610][ C1] ret_from_fork_asm+0x1b/0x30 [ 2444.629875][ C1] [ 2469.596024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 2469.596410][ C0] rcu: 0-....: (1274825 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=310602 [ 2469.596926][ C0] rcu: (t=1275287 jiffies g=1007429 q=31 ncpus=4) [ 2469.597270][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2469.597754][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2469.598395][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2469.598738][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2469.599752][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2469.600076][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2469.600493][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2469.600909][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2469.601326][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2469.601743][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2469.602162][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2469.602627][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2469.602980][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2469.603399][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2469.603816][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2469.604244][ C0] Call Trace: [ 2469.604422][ C0] [ 2469.604577][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 2469.604864][ C0] ? print_cpu_stall+0x263/0x6a0 [ 2469.605132][ C0] ? check_cpu_stall+0x284/0x500 [ 2469.605398][ C0] ? rcu_pending+0x92/0x360 [ 2469.605639][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 2469.605926][ C0] ? update_process_times+0xb9/0x110 [ 2469.606212][ C0] ? tick_sched_handle+0x67/0x130 [ 2469.606480][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 2469.606777][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2469.607032][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 2469.607355][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2469.607641][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2469.607946][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2469.608228][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2469.608550][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2469.608822][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2469.609099][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2469.609419][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2469.609728][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2469.610059][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2469.610360][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2469.610667][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2469.610972][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2469.611301][ C0] ? get_stack_info+0x36/0xc0 [ 2469.611554][ C0] ? lock_acquire+0x1c1/0x220 [ 2469.611806][ C0] ? lock_release+0x1d5/0x250 [ 2469.612057][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2469.612317][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2469.612603][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2469.612900][ C0] ? lock_acquire+0x1c1/0x220 [ 2469.613155][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2469.613408][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2469.613681][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2469.613931][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2469.614196][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2469.614466][ C0] ? __inet_lookup_established+0x341/0x610 [ 2469.614782][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2469.615071][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2469.615360][ C0] ip_local_deliver+0x19d/0x480 [ 2469.615620][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2469.615905][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2469.616174][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2469.616449][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2469.616709][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2469.617048][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2469.617323][ C0] ip_rcv+0x564/0x740 [ 2469.617533][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2469.617771][ C0] ? set_track_prepare+0x8a/0xd0 [ 2469.618034][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2469.618325][ C0] ? rest_init+0x153/0x260 [ 2469.618559][ C0] ? skb_clone+0x10b/0x330 [ 2469.618800][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2469.619132][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2469.619452][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2469.619753][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2469.620063][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2469.620328][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2469.620570][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2469.620889][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2469.621190][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2469.621528][ C0] ? lock_acquire+0x1c1/0x220 [ 2469.621773][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2469.622081][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2469.622380][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2469.622709][ C0] ? __copy_skb_header+0xaf/0x490 [ 2469.622974][ C0] ? __skb_clone+0x57a/0x760 [ 2469.623221][ C0] netif_receive_skb+0x55/0x280 [ 2469.623485][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2469.623814][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2469.624171][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2469.624485][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2469.624770][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2469.625066][ C0] ? hlock_class+0x4e/0x130 [ 2469.625309][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2469.625638][ C0] ? place_entity+0x21/0x2f0 [ 2469.625885][ C0] ? resched_curr+0x219/0x280 [ 2469.626142][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2469.626411][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2469.626695][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2469.626971][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2469.627235][ C0] ? activate_task+0xf5/0x260 [ 2469.627483][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2469.627757][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2469.628032][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2469.628291][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2469.628581][ C0] ? get_stack_info+0x36/0xc0 [ 2469.628837][ C0] ? stack_access_ok+0xda/0x1f0 [ 2469.629102][ C0] ? get_reg+0x119/0x190 [ 2469.629330][ C0] __tcf_classify+0x32c/0x7d0 [ 2469.629586][ C0] tcf_classify+0x283/0x930 [ 2469.629827][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2469.630152][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2469.630423][ C0] ? arch_stack_walk+0x8c/0x100 [ 2469.630687][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2469.630980][ C0] tc_run+0x2e4/0x5d0 [ 2469.631195][ C0] ? __pfx_tc_run+0x10/0x10 [ 2469.631434][ C0] ? lock_acquire+0x1c1/0x220 [ 2469.631680][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2469.631952][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2469.632220][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2469.632502][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2469.632776][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2469.633094][ C0] ? neigh_hh_output+0x348/0x590 [ 2469.633367][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2469.633644][ C0] ip_finish_output2+0x786/0x18e0 [ 2469.633923][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2469.634217][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2469.634569][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2469.634859][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2469.635125][ C0] ? __ip_finish_output+0x10f/0x770 [ 2469.635404][ C0] ip_output+0x16b/0x4f0 [ 2469.635628][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2469.635911][ C0] ? __pfx_ip_output+0x10/0x10 [ 2469.636166][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2469.636467][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2469.636728][ C0] ? ip_local_out+0x114/0x3b0 [ 2469.636982][ C0] __ip_queue_xmit+0x672/0x1910 [ 2469.637245][ C0] ? __skb_clone+0x57a/0x760 [ 2469.637492][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2469.637769][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2469.638061][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2469.638375][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2469.638632][ C0] ? tcp_current_mss+0x40a/0x510 [ 2469.638894][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2469.639177][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2469.639450][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2469.639700][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2469.639970][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2469.640289][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2469.640562][ C0] ? ktime_get+0xb6/0x190 [ 2469.640792][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2469.641068][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2469.641351][ C0] tcp_write_timer+0x82/0x1d0 [ 2469.641599][ C0] call_timer_fn+0x176/0x430 [ 2469.641842][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2469.642119][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2469.642391][ C0] __run_timers.part.0+0x52d/0x890 [ 2469.642668][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2469.642948][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2469.643248][ C0] ? lock_acquire+0x1c1/0x220 [ 2469.643494][ C0] ? clockevents_program_event+0xf6/0x300 [ 2469.643797][ C0] ? lock_release+0x1d5/0x250 [ 2469.644060][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2469.644339][ C0] ? ktime_get+0xb6/0x190 [ 2469.644574][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2469.644873][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2469.645182][ C0] run_timer_softirq+0x72/0x100 [ 2469.645445][ C0] __do_softirq+0x1bc/0x7ff [ 2469.645691][ C0] irq_exit_rcu+0x98/0xc0 [ 2469.645925][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2469.646228][ C0] [ 2469.646385][ C0] [ 2469.646541][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2469.646861][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2469.647132][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2469.648155][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2469.648481][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2469.648902][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2469.649328][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2469.649757][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2469.650176][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2469.650598][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2469.650902][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2469.651176][ C0] default_idle_call+0x69/0xa0 [ 2469.651426][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2469.651692][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2469.651979][ C0] ? lock_release+0x1d5/0x250 [ 2469.652232][ C0] do_idle+0xfb/0x160 [ 2469.652449][ C0] cpu_startup_entry+0x55/0x60 [ 2469.652703][ C0] rest_init+0x153/0x260 [ 2469.652926][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2469.653216][ C0] arch_call_rest_init+0x13/0x40 [ 2469.653482][ C0] start_kernel+0x314/0x3d0 [ 2469.653721][ C0] x86_64_start_reservations+0x18/0x30 [ 2469.654019][ C0] x86_64_start_kernel+0xba/0x110 [ 2469.654284][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2469.654608][ C0] [ 2469.654771][ C0] Sending NMI from CPU 0 to CPUs 1: [ 2469.655061][ C1] NMI backtrace for cpu 1 [ 2469.655071][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2469.655075][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2469.655078][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 2469.655086][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 2469.655090][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2469.655093][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2469.655095][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2469.655097][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2469.655099][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2469.655101][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2469.655102][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2469.655104][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2469.655108][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2469.655110][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2469.655112][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2469.655113][ C1] Call Trace: [ 2469.655117][ C1] [ 2469.655121][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 2469.655128][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 2469.655135][ C1] ? nmi_handle+0x156/0x420 [ 2469.655141][ C1] ? default_do_nmi+0x41/0x100 [ 2469.655145][ C1] ? exc_nmi+0xf3/0x120 [ 2469.655148][ C1] ? end_repeat_nmi+0xf/0x60 [ 2469.655152][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2469.655156][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 2469.655160][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 2469.655163][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 2469.655167][ C1] [ 2469.655168][ C1] [ 2469.655169][ C1] ? run_ksoftirqd+0xb/0x60 [ 2469.655174][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2469.655177][ C1] ? __orc_find+0x9c/0xf0 [ 2469.655181][ C1] ? lock_acquire+0x1c1/0x220 [ 2469.655185][ C1] ? irqentry_enter+0x2b/0x60 [ 2469.655190][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2469.655194][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2469.655197][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2469.655200][ C1] ? lock_acquire+0x1c1/0x220 [ 2469.655203][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2469.655208][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2469.655213][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2469.655220][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2469.655223][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2469.655230][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2469.655237][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2469.655241][ C1] ip_local_deliver+0x19d/0x480 [ 2469.655244][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2469.655247][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2469.655252][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2469.655256][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2469.655259][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2469.655262][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2469.655272][ C1] ip_rcv+0x564/0x740 [ 2469.655275][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2469.655277][ C1] ? set_track_prepare+0x8a/0xd0 [ 2469.655283][ C1] ? irqentry_enter+0x2b/0x60 [ 2469.655286][ C1] ? irqentry_enter+0x2b/0x60 [ 2469.655290][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2469.655292][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2469.655297][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2469.655300][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2469.655303][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2469.655306][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2469.655309][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2469.655314][ C1] netif_receive_skb+0x55/0x280 [ 2469.655317][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2469.655327][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2469.655334][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2469.655341][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2469.655347][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2469.655360][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2469.655369][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2469.655372][ C1] ? arch_stack_walk+0x68/0x100 [ 2469.655377][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2469.655380][ C1] ? irqentry_enter+0x2b/0x60 [ 2469.655384][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2469.655389][ C1] ? irqentry_enter+0x2b/0x60 [ 2469.655392][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2469.655399][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2469.655402][ C1] ? arch_stack_walk+0x68/0x100 [ 2469.655406][ C1] __tcf_classify+0x32c/0x7d0 [ 2469.655411][ C1] tcf_classify+0x283/0x930 [ 2469.655415][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2469.655419][ C1] tc_run+0x2e4/0x5d0 [ 2469.655424][ C1] ? __pfx_tc_run+0x10/0x10 [ 2469.655429][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2469.655435][ C1] ? irqentry_enter+0x2b/0x60 [ 2469.655438][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2469.655441][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2469.655448][ C1] ip_finish_output2+0x786/0x18e0 [ 2469.655454][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2469.655457][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2469.655461][ C1] ? __ip_finish_output+0x10f/0x770 [ 2469.655465][ C1] ip_output+0x16b/0x4f0 [ 2469.655468][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2469.655471][ C1] ? __pfx_ip_output+0x10/0x10 [ 2469.655476][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2469.655483][ C1] ? __pfx_ip_output+0x10/0x10 [ 2469.655487][ C1] __ip_queue_xmit+0x672/0x1910 [ 2469.655492][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2469.655499][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2469.655503][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2469.655507][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2469.655511][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2469.655514][ C1] tcp_delack_timer+0x84/0x240 [ 2469.655518][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2469.655521][ C1] call_timer_fn+0x176/0x430 [ 2469.655525][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2469.655531][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2469.655535][ C1] __run_timers.part.0+0x52d/0x890 [ 2469.655538][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2469.655543][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2469.655548][ C1] ? __pfx___schedule+0x10/0x10 [ 2469.655551][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2469.655556][ C1] run_timer_softirq+0x72/0x100 [ 2469.655559][ C1] __do_softirq+0x1bc/0x7ff [ 2469.655563][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2469.655567][ C1] run_ksoftirqd+0x2e/0x60 [ 2469.655570][ C1] smpboot_thread_fn+0x30e/0x840 [ 2469.655574][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2469.655578][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2469.655581][ C1] kthread+0x292/0x360 [ 2469.655583][ C1] ? __pfx_kthread+0x10/0x10 [ 2469.655586][ C1] ret_from_fork+0x34/0x70 [ 2469.655589][ C1] ? __pfx_kthread+0x10/0x10 [ 2469.655591][ C1] ret_from_fork_asm+0x1b/0x30 [ 2469.655598][ C1] [ 2496.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1219s! [swapper/0:0] [ 2496.527912][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2496.529105][ C0] irq event stamp: 27567077 [ 2496.529344][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2496.529873][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2496.530355][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2496.530865][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2496.531365][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2496.531852][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2496.532490][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2496.532828][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2496.533852][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2496.534179][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2496.534601][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2496.535026][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2496.535452][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2496.535871][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2496.536292][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2496.536766][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2496.537113][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2496.537535][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2496.537951][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2496.538369][ C0] Call Trace: [ 2496.538550][ C0] [ 2496.538707][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2496.538984][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2496.539237][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2496.539533][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2496.539818][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2496.540118][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2496.540395][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2496.540713][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2496.540990][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2496.541266][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2496.541592][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2496.541903][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2496.542234][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2496.542538][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2496.542851][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2496.543151][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2496.543475][ C0] ? get_stack_info+0x36/0xc0 [ 2496.543731][ C0] ? lock_acquire+0x1c1/0x220 [ 2496.543988][ C0] ? lock_release+0x1d5/0x250 [ 2496.544240][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2496.544499][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2496.544781][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2496.545079][ C0] ? lock_acquire+0x1c1/0x220 [ 2496.545336][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2496.545598][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2496.545875][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2496.546120][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2496.546379][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2496.546645][ C0] ? __inet_lookup_established+0x341/0x610 [ 2496.546960][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2496.547255][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2496.547547][ C0] ip_local_deliver+0x19d/0x480 [ 2496.547802][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2496.548086][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2496.548350][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2496.548630][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2496.548897][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2496.549237][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2496.549514][ C0] ip_rcv+0x564/0x740 [ 2496.549735][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2496.549980][ C0] ? set_track_prepare+0x8a/0xd0 [ 2496.550249][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2496.550537][ C0] ? rest_init+0x153/0x260 [ 2496.550781][ C0] ? skb_clone+0x10b/0x330 [ 2496.551019][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2496.551355][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2496.551679][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2496.551973][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2496.552280][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2496.552537][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2496.552777][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2496.553090][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2496.553386][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2496.553729][ C0] ? lock_acquire+0x1c1/0x220 [ 2496.553987][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2496.554295][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2496.554594][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2496.554919][ C0] ? __copy_skb_header+0xaf/0x490 [ 2496.555183][ C0] ? __skb_clone+0x57a/0x760 [ 2496.555429][ C0] netif_receive_skb+0x55/0x280 [ 2496.555690][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2496.556021][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2496.556370][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2496.556682][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2496.556972][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2496.557276][ C0] ? hlock_class+0x4e/0x130 [ 2496.557525][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2496.557855][ C0] ? place_entity+0x21/0x2f0 [ 2496.558103][ C0] ? resched_curr+0x219/0x280 [ 2496.558351][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2496.558617][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2496.558896][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2496.559175][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2496.559435][ C0] ? activate_task+0xf5/0x260 [ 2496.559688][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2496.559964][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2496.560235][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2496.560496][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2496.560786][ C0] ? get_stack_info+0x36/0xc0 [ 2496.561034][ C0] ? stack_access_ok+0xda/0x1f0 [ 2496.561288][ C0] ? get_reg+0x119/0x190 [ 2496.561513][ C0] __tcf_classify+0x32c/0x7d0 [ 2496.561766][ C0] tcf_classify+0x283/0x930 [ 2496.562011][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2496.562339][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2496.562604][ C0] ? arch_stack_walk+0x8c/0x100 [ 2496.562862][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2496.563148][ C0] tc_run+0x2e4/0x5d0 [ 2496.563371][ C0] ? __pfx_tc_run+0x10/0x10 [ 2496.563614][ C0] ? lock_acquire+0x1c1/0x220 [ 2496.563869][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2496.564140][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2496.564406][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2496.564686][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2496.564959][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2496.565280][ C0] ? neigh_hh_output+0x348/0x590 [ 2496.565545][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2496.565819][ C0] ip_finish_output2+0x786/0x18e0 [ 2496.566084][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2496.566373][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2496.566730][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2496.567019][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2496.567280][ C0] ? __ip_finish_output+0x10f/0x770 [ 2496.567564][ C0] ip_output+0x16b/0x4f0 [ 2496.567793][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2496.568074][ C0] ? __pfx_ip_output+0x10/0x10 [ 2496.568331][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2496.568627][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2496.568892][ C0] ? ip_local_out+0x114/0x3b0 [ 2496.569143][ C0] __ip_queue_xmit+0x672/0x1910 [ 2496.569401][ C0] ? __skb_clone+0x57a/0x760 [ 2496.569647][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2496.569930][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2496.570229][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2496.570545][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2496.570798][ C0] ? tcp_current_mss+0x40a/0x510 [ 2496.571063][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2496.571344][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2496.571620][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2496.571874][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2496.572139][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2496.572455][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2496.572733][ C0] ? ktime_get+0xb6/0x190 [ 2496.572966][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2496.573241][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2496.573521][ C0] tcp_write_timer+0x82/0x1d0 [ 2496.573784][ C0] call_timer_fn+0x176/0x430 [ 2496.574028][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2496.574305][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2496.574577][ C0] __run_timers.part.0+0x52d/0x890 [ 2496.574850][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2496.575129][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2496.575430][ C0] ? lock_acquire+0x1c1/0x220 [ 2496.575679][ C0] ? clockevents_program_event+0xf6/0x300 [ 2496.575983][ C0] ? lock_release+0x1d5/0x250 [ 2496.576229][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2496.576503][ C0] ? ktime_get+0xb6/0x190 [ 2496.576732][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2496.577027][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2496.577339][ C0] run_timer_softirq+0x72/0x100 [ 2496.577597][ C0] __do_softirq+0x1bc/0x7ff [ 2496.577841][ C0] irq_exit_rcu+0x98/0xc0 [ 2496.578070][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2496.578370][ C0] [ 2496.578534][ C0] [ 2496.578694][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2496.579014][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2496.579280][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2496.580291][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2496.580610][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2496.581026][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2496.581443][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2496.581857][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2496.582273][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2496.582691][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2496.582992][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2496.583264][ C0] default_idle_call+0x69/0xa0 [ 2496.583520][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2496.583788][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2496.584079][ C0] ? lock_release+0x1d5/0x250 [ 2496.584330][ C0] do_idle+0xfb/0x160 [ 2496.584546][ C0] cpu_startup_entry+0x55/0x60 [ 2496.584803][ C0] rest_init+0x153/0x260 [ 2496.585026][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2496.585314][ C0] arch_call_rest_init+0x13/0x40 [ 2496.585581][ C0] start_kernel+0x314/0x3d0 [ 2496.585819][ C0] x86_64_start_reservations+0x18/0x30 [ 2496.586106][ C0] x86_64_start_kernel+0xba/0x110 [ 2496.586376][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2496.586706][ C0] [ 2496.586873][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1219s! [ksoftirqd/1:22] [ 2496.587342][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2496.588543][ C1] irq event stamp: 3886976 [ 2496.588782][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2496.589279][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2496.589770][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2496.590266][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2496.590760][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2496.591257][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2496.591901][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2496.592245][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2496.593264][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2496.593588][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2496.594012][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2496.594434][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2496.594859][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2496.595287][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2496.595709][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2496.596181][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2496.596529][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2496.596951][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2496.597369][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2496.597787][ C1] Call Trace: [ 2496.597969][ C1] [ 2496.598125][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2496.598407][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2496.598660][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2496.598953][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2496.599237][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2496.599540][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2496.599820][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2496.600142][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2496.600420][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2496.600746][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2496.601057][ C1] [ 2496.601216][ C1] [ 2496.601376][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2496.601711][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2496.602014][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2496.602334][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2496.602639][ C1] ? run_ksoftirqd+0xb/0x60 [ 2496.602885][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2496.603219][ C1] ? __orc_find+0x9c/0xf0 [ 2496.603449][ C1] ? lock_acquire+0x1c1/0x220 [ 2496.603706][ C1] ? irqentry_enter+0x2b/0x60 [ 2496.603965][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2496.604235][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2496.604528][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2496.604830][ C1] ? lock_acquire+0x1c1/0x220 [ 2496.605079][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2496.605331][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2496.605605][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2496.605855][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2496.606121][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2496.606395][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2496.606686][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2496.606979][ C1] ip_local_deliver+0x19d/0x480 [ 2496.607239][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2496.607524][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2496.607790][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2496.608073][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2496.608338][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2496.608673][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2496.608953][ C1] ip_rcv+0x564/0x740 [ 2496.609169][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2496.609416][ C1] ? set_track_prepare+0x8a/0xd0 [ 2496.609685][ C1] ? irqentry_enter+0x2b/0x60 [ 2496.609934][ C1] ? irqentry_enter+0x2b/0x60 [ 2496.610185][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2496.610426][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2496.610740][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2496.611081][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2496.611390][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2496.611733][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2496.612036][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2496.612370][ C1] netif_receive_skb+0x55/0x280 [ 2496.612630][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2496.612958][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2496.613307][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2496.613622][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2496.613916][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2496.614223][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2496.614554][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2496.614839][ C1] ? arch_stack_walk+0x68/0x100 [ 2496.615100][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2496.615375][ C1] ? irqentry_enter+0x2b/0x60 [ 2496.615624][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2496.615946][ C1] ? irqentry_enter+0x2b/0x60 [ 2496.616204][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2496.616527][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2496.616805][ C1] ? arch_stack_walk+0x68/0x100 [ 2496.617073][ C1] __tcf_classify+0x32c/0x7d0 [ 2496.617330][ C1] tcf_classify+0x283/0x930 [ 2496.617577][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2496.617851][ C1] tc_run+0x2e4/0x5d0 [ 2496.618069][ C1] ? __pfx_tc_run+0x10/0x10 [ 2496.618318][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2496.618591][ C1] ? irqentry_enter+0x2b/0x60 [ 2496.618840][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2496.619126][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2496.619451][ C1] ip_finish_output2+0x786/0x18e0 [ 2496.619724][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2496.620017][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2496.620283][ C1] ? __ip_finish_output+0x10f/0x770 [ 2496.620564][ C1] ip_output+0x16b/0x4f0 [ 2496.620796][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2496.621118][ C1] ? __pfx_ip_output+0x10/0x10 [ 2496.621378][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2496.621730][ C1] ? __pfx_ip_output+0x10/0x10 [ 2496.621985][ C1] __ip_queue_xmit+0x672/0x1910 [ 2496.622254][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2496.622538][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2496.622840][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2496.623132][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2496.623430][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2496.623719][ C1] tcp_delack_timer+0x84/0x240 [ 2496.623981][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2496.624271][ C1] call_timer_fn+0x176/0x430 [ 2496.624522][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2496.624797][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2496.625080][ C1] __run_timers.part.0+0x52d/0x890 [ 2496.625357][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2496.625644][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2496.625944][ C1] ? __pfx___schedule+0x10/0x10 [ 2496.626208][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2496.626531][ C1] run_timer_softirq+0x72/0x100 [ 2496.626788][ C1] __do_softirq+0x1bc/0x7ff [ 2496.627030][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2496.627304][ C1] run_ksoftirqd+0x2e/0x60 [ 2496.627544][ C1] smpboot_thread_fn+0x30e/0x840 [ 2496.627810][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2496.628106][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2496.628396][ C1] kthread+0x292/0x360 [ 2496.628614][ C1] ? __pfx_kthread+0x10/0x10 [ 2496.628857][ C1] ret_from_fork+0x34/0x70 [ 2496.629099][ C1] ? __pfx_kthread+0x10/0x10 [ 2496.629347][ C1] ret_from_fork_asm+0x1b/0x30 [ 2496.629610][ C1] [ 2524.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1245s! [swapper/0:0] [ 2524.527916][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2524.529108][ C0] irq event stamp: 27567077 [ 2524.529345][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2524.529865][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2524.530338][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2524.530845][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2524.531340][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2524.531818][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2524.532454][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2524.532794][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2524.533813][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2524.534137][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2524.534554][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2524.534980][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2524.535400][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2524.535817][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2524.536237][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2524.536709][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2524.537056][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2524.537476][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2524.537892][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2524.538307][ C0] Call Trace: [ 2524.538486][ C0] [ 2524.538641][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2524.538916][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2524.539167][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2524.539459][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2524.539744][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2524.540044][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2524.540319][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2524.540637][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2524.540912][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2524.541187][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2524.541510][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2524.541821][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2524.542150][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2524.542454][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2524.542765][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2524.543064][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2524.543387][ C0] ? get_stack_info+0x36/0xc0 [ 2524.543647][ C0] ? lock_acquire+0x1c1/0x220 [ 2524.543897][ C0] ? lock_release+0x1d5/0x250 [ 2524.544147][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2524.544405][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2524.544686][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2524.544981][ C0] ? lock_acquire+0x1c1/0x220 [ 2524.545238][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2524.545493][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2524.545768][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2524.546011][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2524.546272][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2524.546538][ C0] ? __inet_lookup_established+0x341/0x610 [ 2524.546851][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2524.547140][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2524.547431][ C0] ip_local_deliver+0x19d/0x480 [ 2524.547686][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2524.547966][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2524.548230][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2524.548509][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2524.548774][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2524.549106][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2524.549383][ C0] ip_rcv+0x564/0x740 [ 2524.549601][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2524.549845][ C0] ? set_track_prepare+0x8a/0xd0 [ 2524.550112][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2524.550404][ C0] ? rest_init+0x153/0x260 [ 2524.550643][ C0] ? skb_clone+0x10b/0x330 [ 2524.550880][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2524.551220][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2524.551543][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2524.551837][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2524.552143][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2524.552403][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2524.552643][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2524.552958][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2524.553255][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2524.553598][ C0] ? lock_acquire+0x1c1/0x220 [ 2524.553855][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2524.554162][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2524.554461][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2524.554795][ C0] ? __copy_skb_header+0xaf/0x490 [ 2524.555060][ C0] ? __skb_clone+0x57a/0x760 [ 2524.555306][ C0] netif_receive_skb+0x55/0x280 [ 2524.555568][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2524.555900][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2524.556254][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2524.556566][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2524.556856][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2524.557161][ C0] ? hlock_class+0x4e/0x130 [ 2524.557410][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2524.557740][ C0] ? place_entity+0x21/0x2f0 [ 2524.557991][ C0] ? resched_curr+0x219/0x280 [ 2524.558240][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2524.558506][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2524.558787][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2524.559069][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2524.559329][ C0] ? activate_task+0xf5/0x260 [ 2524.559583][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2524.559859][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2524.560130][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2524.560392][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2524.560683][ C0] ? get_stack_info+0x36/0xc0 [ 2524.560931][ C0] ? stack_access_ok+0xda/0x1f0 [ 2524.561183][ C0] ? get_reg+0x119/0x190 [ 2524.561408][ C0] __tcf_classify+0x32c/0x7d0 [ 2524.561662][ C0] tcf_classify+0x283/0x930 [ 2524.561907][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2524.562236][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2524.562502][ C0] ? arch_stack_walk+0x8c/0x100 [ 2524.562757][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2524.563049][ C0] tc_run+0x2e4/0x5d0 [ 2524.563271][ C0] ? __pfx_tc_run+0x10/0x10 [ 2524.563515][ C0] ? lock_acquire+0x1c1/0x220 [ 2524.563769][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2524.564040][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2524.564306][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2524.564588][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2524.564863][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2524.565183][ C0] ? neigh_hh_output+0x348/0x590 [ 2524.565448][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2524.565723][ C0] ip_finish_output2+0x786/0x18e0 [ 2524.565988][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2524.566278][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2524.566631][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2524.566920][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2524.567181][ C0] ? __ip_finish_output+0x10f/0x770 [ 2524.567461][ C0] ip_output+0x16b/0x4f0 [ 2524.567689][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2524.567971][ C0] ? __pfx_ip_output+0x10/0x10 [ 2524.568227][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2524.568524][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2524.568789][ C0] ? ip_local_out+0x114/0x3b0 [ 2524.569040][ C0] __ip_queue_xmit+0x672/0x1910 [ 2524.569298][ C0] ? __skb_clone+0x57a/0x760 [ 2524.569545][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2524.569825][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2524.570124][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2524.570441][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2524.570695][ C0] ? tcp_current_mss+0x40a/0x510 [ 2524.570960][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2524.571240][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2524.571517][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2524.571775][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2524.572041][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2524.572360][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2524.572638][ C0] ? ktime_get+0xb6/0x190 [ 2524.572872][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2524.573146][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2524.573427][ C0] tcp_write_timer+0x82/0x1d0 [ 2524.573685][ C0] call_timer_fn+0x176/0x430 [ 2524.573933][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2524.574210][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2524.574482][ C0] __run_timers.part.0+0x52d/0x890 [ 2524.574754][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2524.575034][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2524.575335][ C0] ? lock_acquire+0x1c1/0x220 [ 2524.575584][ C0] ? clockevents_program_event+0xf6/0x300 [ 2524.575887][ C0] ? lock_release+0x1d5/0x250 [ 2524.576135][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2524.576410][ C0] ? ktime_get+0xb6/0x190 [ 2524.576638][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2524.576935][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2524.577250][ C0] run_timer_softirq+0x72/0x100 [ 2524.577509][ C0] __do_softirq+0x1bc/0x7ff [ 2524.577750][ C0] irq_exit_rcu+0x98/0xc0 [ 2524.577980][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2524.578276][ C0] [ 2524.578436][ C0] [ 2524.578595][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2524.578916][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2524.579183][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2524.580192][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2524.580512][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2524.580934][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2524.581349][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2524.581765][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2524.582181][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2524.582600][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2524.582901][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2524.583176][ C0] default_idle_call+0x69/0xa0 [ 2524.583431][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2524.583699][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2524.583987][ C0] ? lock_release+0x1d5/0x250 [ 2524.584239][ C0] do_idle+0xfb/0x160 [ 2524.584454][ C0] cpu_startup_entry+0x55/0x60 [ 2524.584711][ C0] rest_init+0x153/0x260 [ 2524.584936][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2524.585223][ C0] arch_call_rest_init+0x13/0x40 [ 2524.585490][ C0] start_kernel+0x314/0x3d0 [ 2524.585729][ C0] x86_64_start_reservations+0x18/0x30 [ 2524.586018][ C0] x86_64_start_kernel+0xba/0x110 [ 2524.586288][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2524.586619][ C0] [ 2524.586785][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1245s! [ksoftirqd/1:22] [ 2524.587261][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2524.588467][ C1] irq event stamp: 3886976 [ 2524.588710][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2524.589211][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2524.589706][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2524.590208][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2524.590703][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2524.591201][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2524.591844][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2524.592188][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2524.593211][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2524.593535][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2524.593966][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2524.594397][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2524.594820][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2524.595247][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2524.595675][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2524.596157][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2524.596508][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2524.596940][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2524.597366][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2524.597787][ C1] Call Trace: [ 2524.597966][ C1] [ 2524.598124][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2524.598405][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2524.598663][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2524.598958][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2524.599246][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2524.599549][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2524.599826][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2524.600151][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2524.600427][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2524.600755][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2524.601073][ C1] [ 2524.601230][ C1] [ 2524.601388][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2524.601719][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2524.602030][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2524.602345][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2524.602648][ C1] ? run_ksoftirqd+0xb/0x60 [ 2524.602895][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2524.603224][ C1] ? __orc_find+0x9c/0xf0 [ 2524.603461][ C1] ? lock_acquire+0x1c1/0x220 [ 2524.603723][ C1] ? irqentry_enter+0x2b/0x60 [ 2524.603976][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2524.604237][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2524.604522][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2524.604823][ C1] ? lock_acquire+0x1c1/0x220 [ 2524.605081][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2524.605340][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2524.605619][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2524.605866][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2524.606124][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2524.606396][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2524.606686][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2524.606978][ C1] ip_local_deliver+0x19d/0x480 [ 2524.607242][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2524.607530][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2524.607800][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2524.608080][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2524.608345][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2524.608684][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2524.608959][ C1] ip_rcv+0x564/0x740 [ 2524.609177][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2524.609417][ C1] ? set_track_prepare+0x8a/0xd0 [ 2524.609685][ C1] ? irqentry_enter+0x2b/0x60 [ 2524.609942][ C1] ? irqentry_enter+0x2b/0x60 [ 2524.610201][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2524.610447][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2524.610767][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2524.611112][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2524.611428][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2524.611769][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2524.612070][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2524.612407][ C1] netif_receive_skb+0x55/0x280 [ 2524.612671][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2524.613003][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2524.613359][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2524.613678][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2524.613969][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2524.614275][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2524.614607][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2524.614891][ C1] ? arch_stack_walk+0x68/0x100 [ 2524.615158][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2524.615441][ C1] ? irqentry_enter+0x2b/0x60 [ 2524.615699][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2524.616025][ C1] ? irqentry_enter+0x2b/0x60 [ 2524.616275][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2524.616597][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2524.616882][ C1] ? arch_stack_walk+0x68/0x100 [ 2524.617145][ C1] __tcf_classify+0x32c/0x7d0 [ 2524.617397][ C1] tcf_classify+0x283/0x930 [ 2524.617640][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2524.617910][ C1] tc_run+0x2e4/0x5d0 [ 2524.618127][ C1] ? __pfx_tc_run+0x10/0x10 [ 2524.618370][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2524.618638][ C1] ? irqentry_enter+0x2b/0x60 [ 2524.618895][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2524.619187][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2524.619511][ C1] ip_finish_output2+0x786/0x18e0 [ 2524.619781][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2524.620075][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2524.620342][ C1] ? __ip_finish_output+0x10f/0x770 [ 2524.620619][ C1] ip_output+0x16b/0x4f0 [ 2524.620848][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2524.621171][ C1] ? __pfx_ip_output+0x10/0x10 [ 2524.621428][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2524.621785][ C1] ? __pfx_ip_output+0x10/0x10 [ 2524.622047][ C1] __ip_queue_xmit+0x672/0x1910 [ 2524.622308][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2524.622588][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2524.622882][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2524.623168][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2524.623464][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2524.623757][ C1] tcp_delack_timer+0x84/0x240 [ 2524.624018][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2524.624307][ C1] call_timer_fn+0x176/0x430 [ 2524.624555][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2524.624834][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2524.625114][ C1] __run_timers.part.0+0x52d/0x890 [ 2524.625388][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2524.625681][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2524.625987][ C1] ? __pfx___schedule+0x10/0x10 [ 2524.626250][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2524.626574][ C1] run_timer_softirq+0x72/0x100 [ 2524.626838][ C1] __do_softirq+0x1bc/0x7ff [ 2524.627088][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2524.627365][ C1] run_ksoftirqd+0x2e/0x60 [ 2524.627603][ C1] smpboot_thread_fn+0x30e/0x840 [ 2524.627872][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2524.628164][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2524.628460][ C1] kthread+0x292/0x360 [ 2524.628679][ C1] ? __pfx_kthread+0x10/0x10 [ 2524.628930][ C1] ret_from_fork+0x34/0x70 [ 2524.629171][ C1] ? __pfx_kthread+0x10/0x10 [ 2524.629420][ C1] ret_from_fork_asm+0x1b/0x30 [ 2524.629680][ C1] [ 2547.659024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 2547.659411][ C1] rcu: 1-....: (1351004 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=328120 [ 2547.660005][ C1] rcu: (t=1353350 jiffies g=1007429 q=31 ncpus=4) [ 2547.660355][ C1] Sending NMI from CPU 1 to CPUs 0: [ 2547.660639][ C0] NMI backtrace for cpu 0 [ 2547.660646][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2547.660650][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2547.660653][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2547.660661][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2547.660665][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2547.660668][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2547.660670][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2547.660671][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2547.660674][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2547.660675][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2547.660677][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2547.660679][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2547.660683][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2547.660685][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2547.660686][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2547.660688][ C0] Call Trace: [ 2547.660691][ C0] [ 2547.660693][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 2547.660699][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 2547.660705][ C0] ? nmi_handle+0x156/0x420 [ 2547.660710][ C0] ? default_do_nmi+0x41/0x100 [ 2547.660714][ C0] ? exc_nmi+0xf3/0x120 [ 2547.660717][ C0] ? end_repeat_nmi+0xf/0x60 [ 2547.660721][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2547.660726][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2547.660729][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2547.660733][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2547.660736][ C0] [ 2547.660737][ C0] [ 2547.660738][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2547.660741][ C0] ? get_stack_info+0x36/0xc0 [ 2547.660746][ C0] ? lock_acquire+0x1c1/0x220 [ 2547.660750][ C0] ? lock_release+0x1d5/0x250 [ 2547.660754][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2547.660758][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2547.660761][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2547.660764][ C0] ? lock_acquire+0x1c1/0x220 [ 2547.660766][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2547.660772][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2547.660776][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2547.660783][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2547.660786][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2547.660790][ C0] ? __inet_lookup_established+0x341/0x610 [ 2547.660797][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2547.660803][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2547.660807][ C0] ip_local_deliver+0x19d/0x480 [ 2547.660810][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2547.660813][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2547.660818][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2547.660822][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2547.660825][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2547.660828][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2547.660839][ C0] ip_rcv+0x564/0x740 [ 2547.660842][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2547.660845][ C0] ? set_track_prepare+0x8a/0xd0 [ 2547.660850][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2547.660853][ C0] ? rest_init+0x153/0x260 [ 2547.660855][ C0] ? skb_clone+0x10b/0x330 [ 2547.660860][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2547.660866][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2547.660872][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2547.660877][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2547.660886][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2547.660889][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2547.660891][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2547.660895][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2547.660899][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2547.660902][ C0] ? lock_acquire+0x1c1/0x220 [ 2547.660905][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2547.660908][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2547.660911][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2547.660914][ C0] ? __copy_skb_header+0xaf/0x490 [ 2547.660917][ C0] ? __skb_clone+0x57a/0x760 [ 2547.660920][ C0] netif_receive_skb+0x55/0x280 [ 2547.660922][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2547.660930][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2547.660937][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2547.660944][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2547.660950][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2547.660958][ C0] ? hlock_class+0x4e/0x130 [ 2547.660965][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2547.660975][ C0] ? place_entity+0x21/0x2f0 [ 2547.660978][ C0] ? resched_curr+0x219/0x280 [ 2547.660981][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2547.660984][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2547.660988][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2547.660992][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2547.660994][ C0] ? activate_task+0xf5/0x260 [ 2547.660998][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2547.661003][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2547.661007][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2547.661010][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2547.661013][ C0] ? get_stack_info+0x36/0xc0 [ 2547.661017][ C0] ? stack_access_ok+0xda/0x1f0 [ 2547.661019][ C0] ? get_reg+0x119/0x190 [ 2547.661024][ C0] __tcf_classify+0x32c/0x7d0 [ 2547.661029][ C0] tcf_classify+0x283/0x930 [ 2547.661031][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2547.661036][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2547.661038][ C0] ? arch_stack_walk+0x8c/0x100 [ 2547.661044][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2547.661048][ C0] tc_run+0x2e4/0x5d0 [ 2547.661052][ C0] ? __pfx_tc_run+0x10/0x10 [ 2547.661055][ C0] ? lock_acquire+0x1c1/0x220 [ 2547.661058][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2547.661062][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2547.661068][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2547.661071][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2547.661075][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2547.661080][ C0] ? neigh_hh_output+0x348/0x590 [ 2547.661084][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2547.661088][ C0] ip_finish_output2+0x786/0x18e0 [ 2547.661091][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2547.661097][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2547.661105][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2547.661107][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2547.661111][ C0] ? __ip_finish_output+0x10f/0x770 [ 2547.661116][ C0] ip_output+0x16b/0x4f0 [ 2547.661119][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2547.661123][ C0] ? __pfx_ip_output+0x10/0x10 [ 2547.661127][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2547.661131][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2547.661134][ C0] ? ip_local_out+0x114/0x3b0 [ 2547.661138][ C0] __ip_queue_xmit+0x672/0x1910 [ 2547.661142][ C0] ? __skb_clone+0x57a/0x760 [ 2547.661145][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2547.661152][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2547.661157][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2547.661161][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2547.661166][ C0] ? tcp_current_mss+0x40a/0x510 [ 2547.661169][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2547.661172][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2547.661175][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2547.661177][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2547.661180][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2547.661183][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2547.661188][ C0] ? ktime_get+0xb6/0x190 [ 2547.661192][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2547.661196][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2547.661199][ C0] tcp_write_timer+0x82/0x1d0 [ 2547.661203][ C0] call_timer_fn+0x176/0x430 [ 2547.661206][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2547.661211][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2547.661215][ C0] __run_timers.part.0+0x52d/0x890 [ 2547.661218][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2547.661223][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2547.661226][ C0] ? lock_acquire+0x1c1/0x220 [ 2547.661228][ C0] ? clockevents_program_event+0xf6/0x300 [ 2547.661233][ C0] ? lock_release+0x1d5/0x250 [ 2547.661236][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2547.661238][ C0] ? ktime_get+0xb6/0x190 [ 2547.661242][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2547.661246][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2547.661250][ C0] run_timer_softirq+0x72/0x100 [ 2547.661254][ C0] __do_softirq+0x1bc/0x7ff [ 2547.661259][ C0] irq_exit_rcu+0x98/0xc0 [ 2547.661262][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2547.661266][ C0] [ 2547.661266][ C0] [ 2547.661268][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2547.661273][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2547.661276][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2547.661278][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2547.661280][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2547.661282][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2547.661284][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2547.661285][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2547.661287][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2547.661290][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2547.661294][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2547.661298][ C0] default_idle_call+0x69/0xa0 [ 2547.661300][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2547.661303][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2547.661309][ C0] ? lock_release+0x1d5/0x250 [ 2547.661313][ C0] do_idle+0xfb/0x160 [ 2547.661315][ C0] cpu_startup_entry+0x55/0x60 [ 2547.661318][ C0] rest_init+0x153/0x260 [ 2547.661320][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2547.661326][ C0] arch_call_rest_init+0x13/0x40 [ 2547.661331][ C0] start_kernel+0x314/0x3d0 [ 2547.661334][ C0] x86_64_start_reservations+0x18/0x30 [ 2547.661339][ C0] x86_64_start_kernel+0xba/0x110 [ 2547.661343][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2547.661350][ C0] [ 2547.661637][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2547.715827][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2547.716471][ C1] RIP: 0010:kasan_check_range+0x106/0x1c0 [ 2547.716779][ C1] Code: 00 74 f2 48 89 c2 b8 01 00 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff <5b> b8 01 00 00 00 5d 41 5c c3 cc cc cc cc 41 bc 08 00 00 00 45 29 [ 2547.717798][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000246 [ 2547.718122][ C1] RAX: ffffed10014131c4 RBX: ffffed10014131c4 RCX: ffffffff90c7aaa0 [ 2547.718539][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2547.718958][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: ffffed10014131c3 [ 2547.719375][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2547.719793][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2547.720212][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2547.720678][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2547.721034][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2547.721456][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2547.721876][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2547.722299][ C1] Call Trace: [ 2547.722481][ C1] [ 2547.722639][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 2547.722923][ C1] ? print_cpu_stall+0x263/0x6a0 [ 2547.723193][ C1] ? check_cpu_stall+0x284/0x500 [ 2547.723457][ C1] ? rcu_pending+0x92/0x360 [ 2547.723711][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 2547.723994][ C1] ? update_process_times+0xb9/0x110 [ 2547.724281][ C1] ? tick_sched_handle+0x67/0x130 [ 2547.724549][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 2547.724846][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2547.725103][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 2547.725427][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2547.725716][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2547.726021][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2547.726306][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2547.726630][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2547.726905][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2547.727231][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2547.727545][ C1] [ 2547.727701][ C1] [ 2547.727858][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2547.728192][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2547.728499][ C1] ? kasan_check_range+0x106/0x1c0 [ 2547.728776][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 2547.729075][ C1] ? run_ksoftirqd+0xb/0x60 [ 2547.729317][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2547.729644][ C1] ? __orc_find+0x9c/0xf0 [ 2547.729876][ C1] ? lock_acquire+0x1c1/0x220 [ 2547.730133][ C1] ? irqentry_enter+0x2b/0x60 [ 2547.730389][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2547.730654][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2547.730944][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2547.731249][ C1] ? lock_acquire+0x1c1/0x220 [ 2547.731496][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2547.731747][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2547.732020][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2547.732270][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2547.732535][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2547.732808][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2547.733100][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2547.733393][ C1] ip_local_deliver+0x19d/0x480 [ 2547.733656][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2547.733946][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2547.734217][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2547.734497][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2547.734760][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2547.735100][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2547.735372][ C1] ip_rcv+0x564/0x740 [ 2547.735587][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2547.735829][ C1] ? set_track_prepare+0x8a/0xd0 [ 2547.736093][ C1] ? irqentry_enter+0x2b/0x60 [ 2547.736346][ C1] ? irqentry_enter+0x2b/0x60 [ 2547.736600][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2547.736845][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2547.737163][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2547.737507][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2547.737820][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2547.738160][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2547.738456][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2547.738792][ C1] netif_receive_skb+0x55/0x280 [ 2547.739058][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2547.739388][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2547.739739][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2547.740054][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2547.740345][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2547.740651][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2547.740983][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2547.741268][ C1] ? arch_stack_walk+0x68/0x100 [ 2547.741526][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2547.741801][ C1] ? irqentry_enter+0x2b/0x60 [ 2547.742051][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2547.742371][ C1] ? irqentry_enter+0x2b/0x60 [ 2547.742627][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2547.742949][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2547.743229][ C1] ? arch_stack_walk+0x68/0x100 [ 2547.743498][ C1] __tcf_classify+0x32c/0x7d0 [ 2547.743751][ C1] tcf_classify+0x283/0x930 [ 2547.743992][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2547.744263][ C1] tc_run+0x2e4/0x5d0 [ 2547.744479][ C1] ? __pfx_tc_run+0x10/0x10 [ 2547.744727][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2547.744994][ C1] ? irqentry_enter+0x2b/0x60 [ 2547.745249][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2547.745538][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2547.745865][ C1] ip_finish_output2+0x786/0x18e0 [ 2547.746138][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2547.746426][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2547.746694][ C1] ? __ip_finish_output+0x10f/0x770 [ 2547.746973][ C1] ip_output+0x16b/0x4f0 [ 2547.747203][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2547.747530][ C1] ? __pfx_ip_output+0x10/0x10 [ 2547.747788][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2547.748144][ C1] ? __pfx_ip_output+0x10/0x10 [ 2547.748403][ C1] __ip_queue_xmit+0x672/0x1910 [ 2547.748664][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2547.748944][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2547.749241][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2547.749530][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2547.749825][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2547.750112][ C1] tcp_delack_timer+0x84/0x240 [ 2547.750367][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2547.750655][ C1] call_timer_fn+0x176/0x430 [ 2547.750905][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2547.751181][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2547.751463][ C1] __run_timers.part.0+0x52d/0x890 [ 2547.751737][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2547.752024][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2547.752325][ C1] ? __pfx___schedule+0x10/0x10 [ 2547.752587][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2547.752913][ C1] run_timer_softirq+0x72/0x100 [ 2547.753171][ C1] __do_softirq+0x1bc/0x7ff [ 2547.753412][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2547.753692][ C1] run_ksoftirqd+0x2e/0x60 [ 2547.753929][ C1] smpboot_thread_fn+0x30e/0x840 [ 2547.754198][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2547.754489][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2547.754781][ C1] kthread+0x292/0x360 [ 2547.754996][ C1] ? __pfx_kthread+0x10/0x10 [ 2547.755245][ C1] ret_from_fork+0x34/0x70 [ 2547.755483][ C1] ? __pfx_kthread+0x10/0x10 [ 2547.755732][ C1] ret_from_fork_asm+0x1b/0x30 [ 2547.755993][ C1] [ 2572.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1289s! [swapper/0:0] [ 2572.527912][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2572.529100][ C0] irq event stamp: 27567077 [ 2572.529337][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2572.529861][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2572.530336][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2572.530845][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2572.531341][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2572.531821][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2572.532459][ C0] RIP: 0010:__kasan_check_read+0x0/0x20 [ 2572.532751][ C0] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 2572.533773][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000202 [ 2572.534098][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2572.534517][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2572.534938][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2572.535361][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2572.535780][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2572.536200][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2572.536671][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2572.537015][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2572.537434][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2572.537850][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2572.538265][ C0] Call Trace: [ 2572.538442][ C0] [ 2572.538596][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2572.538871][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2572.539123][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2572.539415][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2572.539704][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2572.540003][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2572.540284][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2572.540602][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2572.540878][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2572.541155][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2572.541480][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2572.541793][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2572.542123][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2572.542431][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 2572.542725][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 2572.543024][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2572.543352][ C0] ? get_stack_info+0x36/0xc0 [ 2572.543610][ C0] ? lock_acquire+0x1c1/0x220 [ 2572.543864][ C0] ? lock_release+0x1d5/0x250 [ 2572.544117][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2572.544382][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2572.544669][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2572.544969][ C0] ? lock_acquire+0x1c1/0x220 [ 2572.545215][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2572.545466][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2572.545738][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2572.545986][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2572.546250][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2572.546521][ C0] ? __inet_lookup_established+0x341/0x610 [ 2572.546837][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2572.547130][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2572.547420][ C0] ip_local_deliver+0x19d/0x480 [ 2572.547682][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2572.547967][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2572.548233][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2572.548510][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2572.548771][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2572.549114][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2572.549388][ C0] ip_rcv+0x564/0x740 [ 2572.549602][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2572.549840][ C0] ? set_track_prepare+0x8a/0xd0 [ 2572.550103][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2572.550394][ C0] ? rest_init+0x153/0x260 [ 2572.550628][ C0] ? skb_clone+0x10b/0x330 [ 2572.550870][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2572.551206][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2572.551524][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2572.551826][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2572.552136][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2572.552397][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2572.552640][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2572.552959][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2572.553259][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2572.553604][ C0] ? lock_acquire+0x1c1/0x220 [ 2572.553856][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2572.554170][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2572.554467][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2572.554800][ C0] ? __copy_skb_header+0xaf/0x490 [ 2572.555070][ C0] ? __skb_clone+0x57a/0x760 [ 2572.555319][ C0] netif_receive_skb+0x55/0x280 [ 2572.555576][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2572.555899][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2572.556245][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2572.556560][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2572.556845][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2572.557142][ C0] ? hlock_class+0x4e/0x130 [ 2572.557383][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2572.557713][ C0] ? place_entity+0x21/0x2f0 [ 2572.557961][ C0] ? resched_curr+0x219/0x280 [ 2572.558217][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2572.558486][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2572.558769][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2572.559049][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2572.559307][ C0] ? activate_task+0xf5/0x260 [ 2572.559554][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2572.559829][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2572.560103][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2572.560361][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2572.560651][ C0] ? get_stack_info+0x36/0xc0 [ 2572.560906][ C0] ? stack_access_ok+0xda/0x1f0 [ 2572.561172][ C0] ? get_reg+0x119/0x190 [ 2572.561401][ C0] __tcf_classify+0x32c/0x7d0 [ 2572.561653][ C0] tcf_classify+0x283/0x930 [ 2572.561893][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2572.562217][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2572.562487][ C0] ? arch_stack_walk+0x8c/0x100 [ 2572.562750][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2572.563042][ C0] tc_run+0x2e4/0x5d0 [ 2572.563255][ C0] ? __pfx_tc_run+0x10/0x10 [ 2572.563501][ C0] ? lock_acquire+0x1c1/0x220 [ 2572.563751][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2572.564027][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2572.564292][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2572.564578][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2572.564858][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2572.565177][ C0] ? neigh_hh_output+0x348/0x590 [ 2572.565442][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2572.565721][ C0] ip_finish_output2+0x786/0x18e0 [ 2572.565990][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2572.566287][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2572.566637][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2572.566927][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2572.567192][ C0] ? __ip_finish_output+0x10f/0x770 [ 2572.567467][ C0] ip_output+0x16b/0x4f0 [ 2572.567692][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2572.567976][ C0] ? __pfx_ip_output+0x10/0x10 [ 2572.568229][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2572.568531][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2572.568792][ C0] ? ip_local_out+0x114/0x3b0 [ 2572.569045][ C0] __ip_queue_xmit+0x672/0x1910 [ 2572.569306][ C0] ? __skb_clone+0x57a/0x760 [ 2572.569553][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2572.569831][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2572.570122][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2572.570436][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2572.570693][ C0] ? tcp_current_mss+0x40a/0x510 [ 2572.570954][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2572.571236][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2572.571509][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2572.571759][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2572.572031][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2572.572349][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2572.572623][ C0] ? ktime_get+0xb6/0x190 [ 2572.572855][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2572.573127][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2572.573419][ C0] tcp_write_timer+0x82/0x1d0 [ 2572.573671][ C0] call_timer_fn+0x176/0x430 [ 2572.573921][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2572.574195][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2572.574468][ C0] __run_timers.part.0+0x52d/0x890 [ 2572.574738][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2572.575022][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2572.575318][ C0] ? lock_acquire+0x1c1/0x220 [ 2572.575569][ C0] ? clockevents_program_event+0xf6/0x300 [ 2572.575879][ C0] ? lock_release+0x1d5/0x250 [ 2572.576133][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2572.576413][ C0] ? ktime_get+0xb6/0x190 [ 2572.576648][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2572.576948][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2572.577256][ C0] run_timer_softirq+0x72/0x100 [ 2572.577521][ C0] __do_softirq+0x1bc/0x7ff [ 2572.577766][ C0] irq_exit_rcu+0x98/0xc0 [ 2572.578000][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2572.578300][ C0] [ 2572.578457][ C0] [ 2572.578613][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2572.578932][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2572.579202][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2572.580223][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2572.580551][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2572.580970][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2572.581392][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2572.581814][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2572.582233][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2572.582651][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2572.582957][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2572.583229][ C0] default_idle_call+0x69/0xa0 [ 2572.583483][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2572.583745][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2572.584036][ C0] ? lock_release+0x1d5/0x250 [ 2572.584285][ C0] do_idle+0xfb/0x160 [ 2572.584498][ C0] cpu_startup_entry+0x55/0x60 [ 2572.584748][ C0] rest_init+0x153/0x260 [ 2572.584976][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2572.585261][ C0] arch_call_rest_init+0x13/0x40 [ 2572.585525][ C0] start_kernel+0x314/0x3d0 [ 2572.585768][ C0] x86_64_start_reservations+0x18/0x30 [ 2572.586061][ C0] x86_64_start_kernel+0xba/0x110 [ 2572.586325][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2572.586648][ C0] [ 2572.586810][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1289s! [ksoftirqd/1:22] [ 2572.587287][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2572.588485][ C1] irq event stamp: 3886976 [ 2572.588722][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2572.589227][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2572.589730][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2572.590235][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2572.590724][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2572.591225][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2572.591879][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2572.592227][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2572.593262][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2572.593595][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2572.594018][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2572.594441][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2572.594861][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2572.595286][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2572.595706][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2572.596179][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2572.596537][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2572.596960][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2572.597385][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2572.597813][ C1] Call Trace: [ 2572.597996][ C1] [ 2572.598156][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2572.598432][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2572.598691][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2572.598981][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2572.599272][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2572.599578][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2572.599861][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2572.600187][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2572.600464][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2572.600791][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2572.601107][ C1] [ 2572.601264][ C1] [ 2572.601422][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2572.601754][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2572.602062][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2572.602377][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2572.602679][ C1] ? run_ksoftirqd+0xb/0x60 [ 2572.602922][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2572.603252][ C1] ? __orc_find+0x9c/0xf0 [ 2572.603487][ C1] ? lock_acquire+0x1c1/0x220 [ 2572.603738][ C1] ? irqentry_enter+0x2b/0x60 [ 2572.603987][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2572.604249][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2572.604535][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2572.604837][ C1] ? lock_acquire+0x1c1/0x220 [ 2572.605093][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2572.605350][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2572.605630][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2572.605875][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2572.606137][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2572.606412][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2572.606700][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2572.606990][ C1] ip_local_deliver+0x19d/0x480 [ 2572.607258][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2572.607549][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2572.607818][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2572.608099][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2572.608363][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2572.608707][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2572.608982][ C1] ip_rcv+0x564/0x740 [ 2572.609199][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2572.609442][ C1] ? set_track_prepare+0x8a/0xd0 [ 2572.609710][ C1] ? irqentry_enter+0x2b/0x60 [ 2572.609964][ C1] ? irqentry_enter+0x2b/0x60 [ 2572.610219][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2572.610467][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2572.610784][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2572.611132][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2572.611449][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2572.611789][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2572.612088][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2572.612426][ C1] netif_receive_skb+0x55/0x280 [ 2572.612692][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2572.613026][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2572.613389][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2572.613706][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2572.613995][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2572.614299][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2572.614627][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2572.614909][ C1] ? arch_stack_walk+0x68/0x100 [ 2572.615175][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2572.615455][ C1] ? irqentry_enter+0x2b/0x60 [ 2572.615710][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2572.616037][ C1] ? irqentry_enter+0x2b/0x60 [ 2572.616290][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2572.616612][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2572.616896][ C1] ? arch_stack_walk+0x68/0x100 [ 2572.617157][ C1] __tcf_classify+0x32c/0x7d0 [ 2572.617407][ C1] tcf_classify+0x283/0x930 [ 2572.617649][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2572.617918][ C1] tc_run+0x2e4/0x5d0 [ 2572.618137][ C1] ? __pfx_tc_run+0x10/0x10 [ 2572.618382][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2572.618650][ C1] ? irqentry_enter+0x2b/0x60 [ 2572.618904][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2572.619194][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2572.619522][ C1] ip_finish_output2+0x786/0x18e0 [ 2572.619793][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2572.620083][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2572.620351][ C1] ? __ip_finish_output+0x10f/0x770 [ 2572.620628][ C1] ip_output+0x16b/0x4f0 [ 2572.620856][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2572.621185][ C1] ? __pfx_ip_output+0x10/0x10 [ 2572.621444][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2572.621800][ C1] ? __pfx_ip_output+0x10/0x10 [ 2572.622059][ C1] __ip_queue_xmit+0x672/0x1910 [ 2572.622321][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2572.622602][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2572.622902][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2572.623190][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2572.623491][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2572.623782][ C1] tcp_delack_timer+0x84/0x240 [ 2572.624042][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2572.624328][ C1] call_timer_fn+0x176/0x430 [ 2572.624580][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2572.624856][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2572.625134][ C1] __run_timers.part.0+0x52d/0x890 [ 2572.625408][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2572.625700][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2572.626004][ C1] ? __pfx___schedule+0x10/0x10 [ 2572.626263][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2572.626582][ C1] run_timer_softirq+0x72/0x100 [ 2572.626844][ C1] __do_softirq+0x1bc/0x7ff [ 2572.627091][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2572.627370][ C1] run_ksoftirqd+0x2e/0x60 [ 2572.627607][ C1] smpboot_thread_fn+0x30e/0x840 [ 2572.627877][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2572.628172][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2572.628465][ C1] kthread+0x292/0x360 [ 2572.628682][ C1] ? __pfx_kthread+0x10/0x10 [ 2572.628930][ C1] ret_from_fork+0x34/0x70 [ 2572.629171][ C1] ? __pfx_kthread+0x10/0x10 [ 2572.629420][ C1] ret_from_fork_asm+0x1b/0x30 [ 2572.629682][ C1] [ 2600.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1315s! [swapper/0:0] [ 2600.527922][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2600.529114][ C0] irq event stamp: 27567077 [ 2600.529350][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2600.529876][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2600.530352][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2600.530859][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2600.531359][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2600.531843][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2600.532484][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 2600.532818][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 2600.533845][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2600.534165][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2600.534579][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2600.534998][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2600.535410][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2600.535824][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2600.536239][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2600.536702][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2600.537053][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2600.537473][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2600.537889][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2600.538307][ C0] Call Trace: [ 2600.538490][ C0] [ 2600.538647][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2600.538921][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2600.539178][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2600.539465][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2600.539751][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2600.540057][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2600.540342][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2600.540663][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2600.540937][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2600.541215][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2600.541535][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2600.541846][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2600.542179][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2600.542480][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 2600.542781][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2600.543081][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2600.543411][ C0] ? get_stack_info+0x36/0xc0 [ 2600.543664][ C0] ? lock_acquire+0x1c1/0x220 [ 2600.543916][ C0] ? lock_release+0x1d5/0x250 [ 2600.544167][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2600.544427][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2600.544712][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2600.545009][ C0] ? lock_acquire+0x1c1/0x220 [ 2600.545259][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2600.545513][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2600.545791][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2600.546037][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2600.546294][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2600.546560][ C0] ? __inet_lookup_established+0x341/0x610 [ 2600.546870][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2600.547162][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2600.547455][ C0] ip_local_deliver+0x19d/0x480 [ 2600.547713][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2600.547995][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2600.548258][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2600.548540][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2600.548807][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2600.549144][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2600.549422][ C0] ip_rcv+0x564/0x740 [ 2600.549639][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2600.549883][ C0] ? set_track_prepare+0x8a/0xd0 [ 2600.550151][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2600.550442][ C0] ? rest_init+0x153/0x260 [ 2600.550681][ C0] ? skb_clone+0x10b/0x330 [ 2600.550920][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2600.551259][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2600.551583][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2600.551877][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2600.552184][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2600.552442][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2600.552682][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2600.552993][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2600.553300][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2600.553639][ C0] ? lock_acquire+0x1c1/0x220 [ 2600.553885][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2600.554193][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2600.554492][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2600.554821][ C0] ? __copy_skb_header+0xaf/0x490 [ 2600.555087][ C0] ? __skb_clone+0x57a/0x760 [ 2600.555332][ C0] netif_receive_skb+0x55/0x280 [ 2600.555595][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2600.555924][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2600.556275][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2600.556584][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2600.556872][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2600.557178][ C0] ? hlock_class+0x4e/0x130 [ 2600.557426][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2600.557758][ C0] ? place_entity+0x21/0x2f0 [ 2600.558006][ C0] ? resched_curr+0x219/0x280 [ 2600.558258][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2600.558524][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2600.558802][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2600.559081][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2600.559339][ C0] ? activate_task+0xf5/0x260 [ 2600.559590][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2600.559868][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2600.560139][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2600.560403][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2600.560695][ C0] ? get_stack_info+0x36/0xc0 [ 2600.560945][ C0] ? stack_access_ok+0xda/0x1f0 [ 2600.561202][ C0] ? get_reg+0x119/0x190 [ 2600.561430][ C0] __tcf_classify+0x32c/0x7d0 [ 2600.561686][ C0] tcf_classify+0x283/0x930 [ 2600.561933][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2600.562261][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2600.562527][ C0] ? arch_stack_walk+0x8c/0x100 [ 2600.562785][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2600.563077][ C0] tc_run+0x2e4/0x5d0 [ 2600.563297][ C0] ? __pfx_tc_run+0x10/0x10 [ 2600.563536][ C0] ? lock_acquire+0x1c1/0x220 [ 2600.563783][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2600.564058][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2600.564325][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2600.564608][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2600.564882][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2600.565199][ C0] ? neigh_hh_output+0x348/0x590 [ 2600.565466][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2600.565742][ C0] ip_finish_output2+0x786/0x18e0 [ 2600.566009][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2600.566301][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2600.566658][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2600.566948][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2600.567210][ C0] ? __ip_finish_output+0x10f/0x770 [ 2600.567489][ C0] ip_output+0x16b/0x4f0 [ 2600.567716][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2600.567997][ C0] ? __pfx_ip_output+0x10/0x10 [ 2600.568261][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2600.568559][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2600.568822][ C0] ? ip_local_out+0x114/0x3b0 [ 2600.569069][ C0] __ip_queue_xmit+0x672/0x1910 [ 2600.569327][ C0] ? __skb_clone+0x57a/0x760 [ 2600.569571][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2600.569855][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2600.570152][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2600.570472][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2600.570726][ C0] ? tcp_current_mss+0x40a/0x510 [ 2600.570991][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2600.571271][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2600.571551][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2600.571806][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2600.572072][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2600.572388][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2600.572666][ C0] ? ktime_get+0xb6/0x190 [ 2600.572901][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2600.573175][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2600.573461][ C0] tcp_write_timer+0x82/0x1d0 [ 2600.573708][ C0] call_timer_fn+0x176/0x430 [ 2600.573953][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2600.574228][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2600.574502][ C0] __run_timers.part.0+0x52d/0x890 [ 2600.574777][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2600.575059][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2600.575358][ C0] ? lock_acquire+0x1c1/0x220 [ 2600.575604][ C0] ? clockevents_program_event+0xf6/0x300 [ 2600.575910][ C0] ? lock_release+0x1d5/0x250 [ 2600.576161][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2600.576438][ C0] ? ktime_get+0xb6/0x190 [ 2600.576668][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2600.576965][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2600.577276][ C0] run_timer_softirq+0x72/0x100 [ 2600.577531][ C0] __do_softirq+0x1bc/0x7ff [ 2600.577773][ C0] irq_exit_rcu+0x98/0xc0 [ 2600.578002][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2600.578300][ C0] [ 2600.578460][ C0] [ 2600.578620][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2600.578945][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2600.579211][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2600.580224][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2600.580543][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2600.580960][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2600.581377][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2600.581797][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2600.582212][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2600.582629][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2600.582929][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2600.583201][ C0] default_idle_call+0x69/0xa0 [ 2600.583461][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2600.583728][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2600.584019][ C0] ? lock_release+0x1d5/0x250 [ 2600.584272][ C0] do_idle+0xfb/0x160 [ 2600.584484][ C0] cpu_startup_entry+0x55/0x60 [ 2600.584738][ C0] rest_init+0x153/0x260 [ 2600.584964][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2600.585254][ C0] arch_call_rest_init+0x13/0x40 [ 2600.585521][ C0] start_kernel+0x314/0x3d0 [ 2600.585761][ C0] x86_64_start_reservations+0x18/0x30 [ 2600.586052][ C0] x86_64_start_kernel+0xba/0x110 [ 2600.586325][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2600.586654][ C0] [ 2600.586823][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1315s! [ksoftirqd/1:22] [ 2600.587294][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2600.588500][ C1] irq event stamp: 3886976 [ 2600.588738][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2600.589233][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2600.589727][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2600.590224][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2600.590721][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2600.591215][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2600.591860][ C1] RIP: 0010:kasan_check_range+0x1b/0x1c0 [ 2600.592164][ C1] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 53 <72> 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 23 [ 2600.593194][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000282 [ 2600.593522][ C1] RAX: ffff88800a098e1c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2600.593939][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2600.594358][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2600.594775][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2600.595196][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2600.595613][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2600.596083][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2600.596433][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2600.596854][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2600.597281][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2600.597706][ C1] Call Trace: [ 2600.597887][ C1] [ 2600.598046][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2600.598322][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2600.598582][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2600.598874][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2600.599167][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2600.599471][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2600.599753][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2600.600081][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2600.600354][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2600.600681][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2600.600992][ C1] [ 2600.601150][ C1] [ 2600.601306][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2600.601633][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2600.601941][ C1] ? kasan_check_range+0x1b/0x1c0 [ 2600.602214][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 2600.602516][ C1] ? run_ksoftirqd+0xb/0x60 [ 2600.602762][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2600.603093][ C1] ? __orc_find+0x9c/0xf0 [ 2600.603331][ C1] ? lock_acquire+0x1c1/0x220 [ 2600.603587][ C1] ? irqentry_enter+0x2b/0x60 [ 2600.603844][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2600.604108][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2600.604396][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2600.604695][ C1] ? lock_acquire+0x1c1/0x220 [ 2600.604943][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2600.605195][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2600.605467][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2600.605718][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2600.605980][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2600.606256][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2600.606550][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2600.606845][ C1] ip_local_deliver+0x19d/0x480 [ 2600.607106][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2600.607391][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2600.607657][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2600.607939][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2600.608209][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2600.608543][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2600.608822][ C1] ip_rcv+0x564/0x740 [ 2600.609038][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2600.609282][ C1] ? set_track_prepare+0x8a/0xd0 [ 2600.609549][ C1] ? irqentry_enter+0x2b/0x60 [ 2600.609797][ C1] ? irqentry_enter+0x2b/0x60 [ 2600.610048][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2600.610288][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2600.610605][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2600.610945][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2600.611257][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2600.611600][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2600.611904][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2600.612237][ C1] netif_receive_skb+0x55/0x280 [ 2600.612496][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2600.612825][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2600.613173][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2600.613497][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2600.613793][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2600.614103][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2600.614433][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2600.614716][ C1] ? arch_stack_walk+0x68/0x100 [ 2600.614977][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2600.615254][ C1] ? irqentry_enter+0x2b/0x60 [ 2600.615501][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2600.615817][ C1] ? irqentry_enter+0x2b/0x60 [ 2600.616073][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2600.616399][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2600.616678][ C1] ? arch_stack_walk+0x68/0x100 [ 2600.616943][ C1] __tcf_classify+0x32c/0x7d0 [ 2600.617202][ C1] tcf_classify+0x283/0x930 [ 2600.617447][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2600.617720][ C1] tc_run+0x2e4/0x5d0 [ 2600.617936][ C1] ? __pfx_tc_run+0x10/0x10 [ 2600.618183][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2600.618451][ C1] ? irqentry_enter+0x2b/0x60 [ 2600.618698][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2600.618981][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2600.619302][ C1] ip_finish_output2+0x786/0x18e0 [ 2600.619576][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2600.619870][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2600.620136][ C1] ? __ip_finish_output+0x10f/0x770 [ 2600.620417][ C1] ip_output+0x16b/0x4f0 [ 2600.620643][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2600.620958][ C1] ? __pfx_ip_output+0x10/0x10 [ 2600.621218][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2600.621569][ C1] ? __pfx_ip_output+0x10/0x10 [ 2600.621827][ C1] __ip_queue_xmit+0x672/0x1910 [ 2600.622092][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2600.622376][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2600.622674][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2600.622966][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2600.623269][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2600.623553][ C1] tcp_delack_timer+0x84/0x240 [ 2600.623806][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2600.624095][ C1] call_timer_fn+0x176/0x430 [ 2600.624345][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2600.624620][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2600.624900][ C1] __run_timers.part.0+0x52d/0x890 [ 2600.625179][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2600.625465][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2600.625765][ C1] ? __pfx___schedule+0x10/0x10 [ 2600.626031][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2600.626353][ C1] run_timer_softirq+0x72/0x100 [ 2600.626611][ C1] __do_softirq+0x1bc/0x7ff [ 2600.626853][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2600.627128][ C1] run_ksoftirqd+0x2e/0x60 [ 2600.627370][ C1] smpboot_thread_fn+0x30e/0x840 [ 2600.627636][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2600.627929][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2600.628217][ C1] kthread+0x292/0x360 [ 2600.628439][ C1] ? __pfx_kthread+0x10/0x10 [ 2600.628686][ C1] ret_from_fork+0x34/0x70 [ 2600.628927][ C1] ? __pfx_kthread+0x10/0x10 [ 2600.629172][ C1] ret_from_fork_asm+0x1b/0x30 [ 2600.629435][ C1] [ 2625.758024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 2625.758410][ C1] rcu: 1-....: (1428823 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=346486 [ 2625.758999][ C1] rcu: (t=1431449 jiffies g=1007429 q=31 ncpus=4) [ 2625.759349][ C1] Sending NMI from CPU 1 to CPUs 0: [ 2625.759635][ C0] NMI backtrace for cpu 0 [ 2625.759643][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2625.759647][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2625.759649][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2625.759659][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2625.759662][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2625.759666][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2625.759668][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2625.759670][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2625.759672][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2625.759674][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2625.759676][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2625.759678][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2625.759681][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2625.759683][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2625.759684][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2625.759686][ C0] Call Trace: [ 2625.759689][ C0] [ 2625.759693][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 2625.759699][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 2625.759705][ C0] ? nmi_handle+0x156/0x420 [ 2625.759710][ C0] ? default_do_nmi+0x41/0x100 [ 2625.759715][ C0] ? exc_nmi+0xf3/0x120 [ 2625.759717][ C0] ? end_repeat_nmi+0xf/0x60 [ 2625.759722][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2625.759725][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2625.759729][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2625.759733][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2625.759736][ C0] [ 2625.759737][ C0] [ 2625.759739][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2625.759742][ C0] ? get_stack_info+0x36/0xc0 [ 2625.759747][ C0] ? lock_acquire+0x1c1/0x220 [ 2625.759751][ C0] ? lock_release+0x1d5/0x250 [ 2625.759755][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2625.759759][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2625.759762][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2625.759766][ C0] ? lock_acquire+0x1c1/0x220 [ 2625.759768][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2625.759773][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2625.759777][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2625.759784][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2625.759787][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2625.759791][ C0] ? __inet_lookup_established+0x341/0x610 [ 2625.759797][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2625.759805][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2625.759809][ C0] ip_local_deliver+0x19d/0x480 [ 2625.759813][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2625.759815][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2625.759821][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2625.759824][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2625.759828][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2625.759831][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2625.759842][ C0] ip_rcv+0x564/0x740 [ 2625.759845][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2625.759848][ C0] ? set_track_prepare+0x8a/0xd0 [ 2625.759853][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2625.759855][ C0] ? rest_init+0x153/0x260 [ 2625.759857][ C0] ? skb_clone+0x10b/0x330 [ 2625.759863][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2625.759869][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2625.759875][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2625.759879][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2625.759889][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2625.759891][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2625.759894][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2625.759898][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2625.759902][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2625.759905][ C0] ? lock_acquire+0x1c1/0x220 [ 2625.759908][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2625.759911][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2625.759914][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2625.759917][ C0] ? __copy_skb_header+0xaf/0x490 [ 2625.759920][ C0] ? __skb_clone+0x57a/0x760 [ 2625.759923][ C0] netif_receive_skb+0x55/0x280 [ 2625.759926][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2625.759934][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2625.759941][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2625.759948][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2625.759953][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2625.759962][ C0] ? hlock_class+0x4e/0x130 [ 2625.759967][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2625.759977][ C0] ? place_entity+0x21/0x2f0 [ 2625.759981][ C0] ? resched_curr+0x219/0x280 [ 2625.759984][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2625.759987][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2625.759991][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2625.759995][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2625.759998][ C0] ? activate_task+0xf5/0x260 [ 2625.760001][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2625.760007][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2625.760010][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2625.760014][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2625.760017][ C0] ? get_stack_info+0x36/0xc0 [ 2625.760022][ C0] ? stack_access_ok+0xda/0x1f0 [ 2625.760024][ C0] ? get_reg+0x119/0x190 [ 2625.760028][ C0] __tcf_classify+0x32c/0x7d0 [ 2625.760032][ C0] tcf_classify+0x283/0x930 [ 2625.760035][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2625.760040][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2625.760042][ C0] ? arch_stack_walk+0x8c/0x100 [ 2625.760046][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2625.760049][ C0] tc_run+0x2e4/0x5d0 [ 2625.760054][ C0] ? __pfx_tc_run+0x10/0x10 [ 2625.760057][ C0] ? lock_acquire+0x1c1/0x220 [ 2625.760059][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2625.760064][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2625.760069][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2625.760072][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2625.760076][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2625.760081][ C0] ? neigh_hh_output+0x348/0x590 [ 2625.760085][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2625.760089][ C0] ip_finish_output2+0x786/0x18e0 [ 2625.760092][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2625.760098][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2625.760106][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2625.760109][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2625.760113][ C0] ? __ip_finish_output+0x10f/0x770 [ 2625.760117][ C0] ip_output+0x16b/0x4f0 [ 2625.760120][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2625.760125][ C0] ? __pfx_ip_output+0x10/0x10 [ 2625.760128][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2625.760133][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2625.760136][ C0] ? ip_local_out+0x114/0x3b0 [ 2625.760140][ C0] __ip_queue_xmit+0x672/0x1910 [ 2625.760145][ C0] ? __skb_clone+0x57a/0x760 [ 2625.760148][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2625.760155][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2625.760159][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2625.760163][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2625.760169][ C0] ? tcp_current_mss+0x40a/0x510 [ 2625.760171][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2625.760175][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2625.760178][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2625.760180][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2625.760182][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2625.760186][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2625.760191][ C0] ? ktime_get+0xb6/0x190 [ 2625.760195][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2625.760199][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2625.760203][ C0] tcp_write_timer+0x82/0x1d0 [ 2625.760207][ C0] call_timer_fn+0x176/0x430 [ 2625.760210][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2625.760215][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2625.760220][ C0] __run_timers.part.0+0x52d/0x890 [ 2625.760223][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2625.760227][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2625.760230][ C0] ? lock_acquire+0x1c1/0x220 [ 2625.760232][ C0] ? clockevents_program_event+0xf6/0x300 [ 2625.760237][ C0] ? lock_release+0x1d5/0x250 [ 2625.760240][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2625.760242][ C0] ? ktime_get+0xb6/0x190 [ 2625.760245][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2625.760249][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2625.760253][ C0] run_timer_softirq+0x72/0x100 [ 2625.760257][ C0] __do_softirq+0x1bc/0x7ff [ 2625.760261][ C0] irq_exit_rcu+0x98/0xc0 [ 2625.760264][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2625.760268][ C0] [ 2625.760269][ C0] [ 2625.760270][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2625.760277][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2625.760280][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2625.760282][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2625.760284][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2625.760286][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2625.760287][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2625.760288][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2625.760290][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2625.760294][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2625.760297][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2625.760301][ C0] default_idle_call+0x69/0xa0 [ 2625.760303][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2625.760306][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2625.760311][ C0] ? lock_release+0x1d5/0x250 [ 2625.760315][ C0] do_idle+0xfb/0x160 [ 2625.760318][ C0] cpu_startup_entry+0x55/0x60 [ 2625.760321][ C0] rest_init+0x153/0x260 [ 2625.760324][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2625.760329][ C0] arch_call_rest_init+0x13/0x40 [ 2625.760335][ C0] start_kernel+0x314/0x3d0 [ 2625.760339][ C0] x86_64_start_reservations+0x18/0x30 [ 2625.760344][ C0] x86_64_start_kernel+0xba/0x110 [ 2625.760347][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2625.760356][ C0] [ 2625.760632][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2625.814917][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2625.815566][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2625.815912][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2625.816935][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2625.817262][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2625.817683][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2625.818105][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2625.818524][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2625.818944][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2625.819365][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2625.819833][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2625.820198][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2625.820620][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2625.821046][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2625.821468][ C1] Call Trace: [ 2625.821652][ C1] [ 2625.821810][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 2625.822096][ C1] ? print_cpu_stall+0x263/0x6a0 [ 2625.822364][ C1] ? check_cpu_stall+0x284/0x500 [ 2625.822628][ C1] ? rcu_pending+0x92/0x360 [ 2625.822877][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 2625.823171][ C1] ? update_process_times+0xb9/0x110 [ 2625.823459][ C1] ? tick_sched_handle+0x67/0x130 [ 2625.823728][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 2625.824027][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2625.824283][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 2625.824608][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2625.824897][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2625.825204][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2625.825486][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2625.825812][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2625.826089][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2625.826415][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2625.826730][ C1] [ 2625.826887][ C1] [ 2625.827045][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2625.827377][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2625.827683][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2625.827998][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2625.828302][ C1] ? run_ksoftirqd+0xb/0x60 [ 2625.828544][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2625.828872][ C1] ? __orc_find+0x9c/0xf0 [ 2625.829106][ C1] ? lock_acquire+0x1c1/0x220 [ 2625.829362][ C1] ? irqentry_enter+0x2b/0x60 [ 2625.829618][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2625.829888][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2625.830180][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2625.830481][ C1] ? lock_acquire+0x1c1/0x220 [ 2625.830729][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2625.830980][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2625.831254][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2625.831505][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2625.831769][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2625.832045][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2625.832338][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2625.832634][ C1] ip_local_deliver+0x19d/0x480 [ 2625.832895][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2625.833186][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2625.833457][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2625.833739][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2625.834003][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2625.834345][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2625.834620][ C1] ip_rcv+0x564/0x740 [ 2625.834835][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2625.835080][ C1] ? set_track_prepare+0x8a/0xd0 [ 2625.835346][ C1] ? irqentry_enter+0x2b/0x60 [ 2625.835599][ C1] ? irqentry_enter+0x2b/0x60 [ 2625.835853][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2625.836100][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2625.836415][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2625.836760][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2625.837074][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2625.837413][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2625.837710][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2625.838048][ C1] netif_receive_skb+0x55/0x280 [ 2625.838315][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2625.838646][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2625.839000][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2625.839315][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2625.839610][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2625.839918][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2625.840256][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2625.840541][ C1] ? arch_stack_walk+0x68/0x100 [ 2625.840801][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2625.841079][ C1] ? irqentry_enter+0x2b/0x60 [ 2625.841329][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2625.841651][ C1] ? irqentry_enter+0x2b/0x60 [ 2625.841908][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2625.842234][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2625.842513][ C1] ? arch_stack_walk+0x68/0x100 [ 2625.842777][ C1] __tcf_classify+0x32c/0x7d0 [ 2625.843036][ C1] tcf_classify+0x283/0x930 [ 2625.843286][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2625.843557][ C1] tc_run+0x2e4/0x5d0 [ 2625.843774][ C1] ? __pfx_tc_run+0x10/0x10 [ 2625.844020][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2625.844287][ C1] ? irqentry_enter+0x2b/0x60 [ 2625.844542][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2625.844831][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2625.845161][ C1] ip_finish_output2+0x786/0x18e0 [ 2625.845431][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2625.845720][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2625.845990][ C1] ? __ip_finish_output+0x10f/0x770 [ 2625.846269][ C1] ip_output+0x16b/0x4f0 [ 2625.846497][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2625.846821][ C1] ? __pfx_ip_output+0x10/0x10 [ 2625.847080][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2625.847436][ C1] ? __pfx_ip_output+0x10/0x10 [ 2625.847697][ C1] __ip_queue_xmit+0x672/0x1910 [ 2625.847958][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2625.848243][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2625.848543][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2625.848830][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2625.849131][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2625.849417][ C1] tcp_delack_timer+0x84/0x240 [ 2625.849673][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2625.849962][ C1] call_timer_fn+0x176/0x430 [ 2625.850214][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2625.850491][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2625.850776][ C1] __run_timers.part.0+0x52d/0x890 [ 2625.851054][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2625.851342][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2625.851642][ C1] ? __pfx___schedule+0x10/0x10 [ 2625.851906][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2625.852231][ C1] run_timer_softirq+0x72/0x100 [ 2625.852488][ C1] __do_softirq+0x1bc/0x7ff [ 2625.852730][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2625.853004][ C1] run_ksoftirqd+0x2e/0x60 [ 2625.853253][ C1] smpboot_thread_fn+0x30e/0x840 [ 2625.853523][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2625.853815][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2625.854109][ C1] kthread+0x292/0x360 [ 2625.854325][ C1] ? __pfx_kthread+0x10/0x10 [ 2625.854574][ C1] ret_from_fork+0x34/0x70 [ 2625.854813][ C1] ? __pfx_kthread+0x10/0x10 [ 2625.855064][ C1] ret_from_fork_asm+0x1b/0x30 [ 2625.855326][ C1] [ 2652.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1364s! [swapper/0:0] [ 2652.527915][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2652.529103][ C0] irq event stamp: 27567077 [ 2652.529342][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2652.529867][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2652.530352][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2652.530854][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2652.531355][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2652.531838][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2652.532478][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 2652.532814][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 2652.533839][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2652.534159][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2652.534577][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2652.534994][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2652.535411][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2652.535828][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2652.536250][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2652.536717][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2652.537069][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2652.537489][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2652.537914][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2652.538334][ C0] Call Trace: [ 2652.538514][ C0] [ 2652.538673][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2652.538949][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2652.539206][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2652.539495][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2652.539782][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2652.540085][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2652.540365][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2652.540688][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2652.540960][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2652.541240][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2652.541565][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2652.541873][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2652.542207][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2652.542510][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 2652.542810][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2652.543120][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2652.543447][ C0] ? get_stack_info+0x36/0xc0 [ 2652.543695][ C0] ? lock_acquire+0x1c1/0x220 [ 2652.543943][ C0] ? lock_release+0x1d5/0x250 [ 2652.544190][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2652.544449][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2652.544733][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2652.545031][ C0] ? lock_acquire+0x1c1/0x220 [ 2652.545283][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2652.545538][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2652.545813][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2652.546057][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2652.546315][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2652.546582][ C0] ? __inet_lookup_established+0x341/0x610 [ 2652.546894][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2652.547187][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2652.547480][ C0] ip_local_deliver+0x19d/0x480 [ 2652.547739][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2652.548023][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2652.548288][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2652.548568][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2652.548832][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2652.549170][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2652.549448][ C0] ip_rcv+0x564/0x740 [ 2652.549662][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2652.549906][ C0] ? set_track_prepare+0x8a/0xd0 [ 2652.550171][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2652.550457][ C0] ? rest_init+0x153/0x260 [ 2652.550697][ C0] ? skb_clone+0x10b/0x330 [ 2652.550936][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2652.551274][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2652.551595][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2652.551889][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2652.552196][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2652.552452][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2652.552691][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2652.553006][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2652.553311][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2652.553649][ C0] ? lock_acquire+0x1c1/0x220 [ 2652.553896][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2652.554205][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2652.554507][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2652.554838][ C0] ? __copy_skb_header+0xaf/0x490 [ 2652.555108][ C0] ? __skb_clone+0x57a/0x760 [ 2652.555351][ C0] netif_receive_skb+0x55/0x280 [ 2652.555613][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2652.555942][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2652.556293][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2652.556605][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2652.556895][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2652.557196][ C0] ? hlock_class+0x4e/0x130 [ 2652.557444][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2652.557780][ C0] ? place_entity+0x21/0x2f0 [ 2652.558032][ C0] ? resched_curr+0x219/0x280 [ 2652.558283][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2652.558550][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2652.558830][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2652.559112][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2652.559373][ C0] ? activate_task+0xf5/0x260 [ 2652.559624][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2652.559899][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2652.560169][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2652.560431][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2652.560724][ C0] ? get_stack_info+0x36/0xc0 [ 2652.560975][ C0] ? stack_access_ok+0xda/0x1f0 [ 2652.561233][ C0] ? get_reg+0x119/0x190 [ 2652.561458][ C0] __tcf_classify+0x32c/0x7d0 [ 2652.561713][ C0] tcf_classify+0x283/0x930 [ 2652.561958][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2652.562290][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2652.562557][ C0] ? arch_stack_walk+0x8c/0x100 [ 2652.562817][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2652.563112][ C0] tc_run+0x2e4/0x5d0 [ 2652.563326][ C0] ? __pfx_tc_run+0x10/0x10 [ 2652.563567][ C0] ? lock_acquire+0x1c1/0x220 [ 2652.563818][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2652.564092][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2652.564363][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2652.564648][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2652.564924][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2652.565243][ C0] ? neigh_hh_output+0x348/0x590 [ 2652.565510][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2652.565785][ C0] ip_finish_output2+0x786/0x18e0 [ 2652.566051][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2652.566343][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2652.566699][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2652.566992][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2652.567255][ C0] ? __ip_finish_output+0x10f/0x770 [ 2652.567536][ C0] ip_output+0x16b/0x4f0 [ 2652.567763][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2652.568043][ C0] ? __pfx_ip_output+0x10/0x10 [ 2652.568299][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2652.568598][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2652.568863][ C0] ? ip_local_out+0x114/0x3b0 [ 2652.569112][ C0] __ip_queue_xmit+0x672/0x1910 [ 2652.569369][ C0] ? __skb_clone+0x57a/0x760 [ 2652.569612][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2652.569895][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2652.570196][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2652.570518][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2652.570775][ C0] ? tcp_current_mss+0x40a/0x510 [ 2652.571039][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2652.571320][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2652.571599][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2652.571855][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2652.572122][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2652.572439][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2652.572720][ C0] ? ktime_get+0xb6/0x190 [ 2652.572954][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2652.573238][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2652.573522][ C0] tcp_write_timer+0x82/0x1d0 [ 2652.573770][ C0] call_timer_fn+0x176/0x430 [ 2652.574015][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2652.574292][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2652.574565][ C0] __run_timers.part.0+0x52d/0x890 [ 2652.574839][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2652.575124][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2652.575425][ C0] ? lock_acquire+0x1c1/0x220 [ 2652.575672][ C0] ? clockevents_program_event+0xf6/0x300 [ 2652.575976][ C0] ? lock_release+0x1d5/0x250 [ 2652.576227][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2652.576503][ C0] ? ktime_get+0xb6/0x190 [ 2652.576732][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2652.577029][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2652.577343][ C0] run_timer_softirq+0x72/0x100 [ 2652.577603][ C0] __do_softirq+0x1bc/0x7ff [ 2652.577846][ C0] irq_exit_rcu+0x98/0xc0 [ 2652.578076][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2652.578376][ C0] [ 2652.578534][ C0] [ 2652.578694][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2652.579018][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2652.579287][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2652.580301][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2652.580624][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2652.581041][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2652.581466][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2652.581889][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2652.582304][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2652.582720][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2652.583021][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2652.583301][ C0] default_idle_call+0x69/0xa0 [ 2652.583553][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2652.583817][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2652.584109][ C0] ? lock_release+0x1d5/0x250 [ 2652.584365][ C0] do_idle+0xfb/0x160 [ 2652.584579][ C0] cpu_startup_entry+0x55/0x60 [ 2652.584834][ C0] rest_init+0x153/0x260 [ 2652.585060][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2652.585351][ C0] arch_call_rest_init+0x13/0x40 [ 2652.585619][ C0] start_kernel+0x314/0x3d0 [ 2652.585863][ C0] x86_64_start_reservations+0x18/0x30 [ 2652.586154][ C0] x86_64_start_kernel+0xba/0x110 [ 2652.586424][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2652.586753][ C0] [ 2652.586922][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1364s! [ksoftirqd/1:22] [ 2652.587404][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2652.588603][ C1] irq event stamp: 3886976 [ 2652.588839][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2652.589345][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2652.589846][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2652.590350][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2652.590841][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2652.591342][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2652.591991][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2652.592340][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2652.593371][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2652.593694][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2652.594117][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2652.594541][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2652.594962][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2652.595385][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2652.595807][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2652.596282][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2652.596637][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2652.597064][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2652.597493][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2652.597917][ C1] Call Trace: [ 2652.598097][ C1] [ 2652.598259][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2652.598536][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2652.598795][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2652.599091][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2652.599383][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2652.599689][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2652.599972][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2652.600300][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2652.600577][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2652.600905][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2652.601223][ C1] [ 2652.601380][ C1] [ 2652.601537][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2652.601870][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2652.602180][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2652.602494][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2652.602797][ C1] ? run_ksoftirqd+0xb/0x60 [ 2652.603049][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2652.603380][ C1] ? __orc_find+0x9c/0xf0 [ 2652.603612][ C1] ? lock_acquire+0x1c1/0x220 [ 2652.603863][ C1] ? irqentry_enter+0x2b/0x60 [ 2652.604116][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2652.604376][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2652.604659][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2652.604960][ C1] ? lock_acquire+0x1c1/0x220 [ 2652.605216][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2652.605474][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2652.605749][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2652.605993][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2652.606252][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2652.606524][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2652.606814][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2652.607108][ C1] ip_local_deliver+0x19d/0x480 [ 2652.607369][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2652.607656][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2652.607926][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2652.608204][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2652.608469][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2652.608808][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2652.609088][ C1] ip_rcv+0x564/0x740 [ 2652.609303][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2652.609544][ C1] ? set_track_prepare+0x8a/0xd0 [ 2652.609811][ C1] ? irqentry_enter+0x2b/0x60 [ 2652.610070][ C1] ? irqentry_enter+0x2b/0x60 [ 2652.610327][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2652.610574][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2652.610897][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2652.611243][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2652.611559][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2652.611898][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2652.612198][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2652.612536][ C1] netif_receive_skb+0x55/0x280 [ 2652.612798][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2652.613135][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2652.613485][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2652.613802][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2652.614095][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2652.614400][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2652.614731][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2652.615014][ C1] ? arch_stack_walk+0x68/0x100 [ 2652.615280][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2652.615561][ C1] ? irqentry_enter+0x2b/0x60 [ 2652.615818][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2652.616141][ C1] ? irqentry_enter+0x2b/0x60 [ 2652.616390][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2652.616711][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2652.616995][ C1] ? arch_stack_walk+0x68/0x100 [ 2652.617258][ C1] __tcf_classify+0x32c/0x7d0 [ 2652.617509][ C1] tcf_classify+0x283/0x930 [ 2652.617751][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2652.618020][ C1] tc_run+0x2e4/0x5d0 [ 2652.618237][ C1] ? __pfx_tc_run+0x10/0x10 [ 2652.618481][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2652.618748][ C1] ? irqentry_enter+0x2b/0x60 [ 2652.619005][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2652.619297][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2652.619620][ C1] ip_finish_output2+0x786/0x18e0 [ 2652.619892][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2652.620184][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2652.620451][ C1] ? __ip_finish_output+0x10f/0x770 [ 2652.620728][ C1] ip_output+0x16b/0x4f0 [ 2652.620959][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2652.621281][ C1] ? __pfx_ip_output+0x10/0x10 [ 2652.621536][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2652.621895][ C1] ? __pfx_ip_output+0x10/0x10 [ 2652.622156][ C1] __ip_queue_xmit+0x672/0x1910 [ 2652.622415][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2652.622694][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2652.622988][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2652.623280][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2652.623579][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2652.623869][ C1] tcp_delack_timer+0x84/0x240 [ 2652.624131][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2652.624417][ C1] call_timer_fn+0x176/0x430 [ 2652.624665][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2652.624944][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2652.625223][ C1] __run_timers.part.0+0x52d/0x890 [ 2652.625496][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2652.625788][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2652.626096][ C1] ? __pfx___schedule+0x10/0x10 [ 2652.626357][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2652.626680][ C1] run_timer_softirq+0x72/0x100 [ 2652.626944][ C1] __do_softirq+0x1bc/0x7ff [ 2652.627194][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2652.627470][ C1] run_ksoftirqd+0x2e/0x60 [ 2652.627707][ C1] smpboot_thread_fn+0x30e/0x840 [ 2652.627973][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2652.628268][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2652.628563][ C1] kthread+0x292/0x360 [ 2652.628783][ C1] ? __pfx_kthread+0x10/0x10 [ 2652.629034][ C1] ret_from_fork+0x34/0x70 [ 2652.629273][ C1] ? __pfx_kthread+0x10/0x10 [ 2652.629521][ C1] ret_from_fork_asm+0x1b/0x30 [ 2652.629784][ C1] [ 2680.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1390s! [swapper/0:0] [ 2680.527911][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2680.529096][ C0] irq event stamp: 27567077 [ 2680.529335][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2680.529864][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2680.530342][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2680.530843][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2680.531339][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2680.531823][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2680.532462][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 2680.532796][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 2680.533814][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2680.534133][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2680.534548][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2680.534963][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2680.535376][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2680.535791][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2680.536207][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2680.536673][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2680.537023][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2680.537444][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2680.537868][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2680.538287][ C0] Call Trace: [ 2680.538465][ C0] [ 2680.538623][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2680.538897][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2680.539155][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2680.539444][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2680.539730][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2680.540034][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2680.540315][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2680.540638][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2680.540910][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2680.541190][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2680.541512][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2680.541818][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2680.542152][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2680.542453][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 2680.542753][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2680.543065][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2680.543392][ C0] ? get_stack_info+0x36/0xc0 [ 2680.543643][ C0] ? lock_acquire+0x1c1/0x220 [ 2680.543891][ C0] ? lock_release+0x1d5/0x250 [ 2680.544138][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2680.544399][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2680.544683][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2680.544980][ C0] ? lock_acquire+0x1c1/0x220 [ 2680.545232][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2680.545487][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2680.545766][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2680.546009][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2680.546268][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2680.546535][ C0] ? __inet_lookup_established+0x341/0x610 [ 2680.546854][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2680.547148][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2680.547442][ C0] ip_local_deliver+0x19d/0x480 [ 2680.547700][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2680.547984][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2680.548250][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2680.548529][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2680.548792][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2680.549124][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2680.549403][ C0] ip_rcv+0x564/0x740 [ 2680.549615][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2680.549858][ C0] ? set_track_prepare+0x8a/0xd0 [ 2680.550124][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2680.550411][ C0] ? rest_init+0x153/0x260 [ 2680.550650][ C0] ? skb_clone+0x10b/0x330 [ 2680.550889][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2680.551227][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2680.551547][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2680.551841][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2680.552150][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2680.552405][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2680.552643][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2680.552964][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2680.553266][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2680.553604][ C0] ? lock_acquire+0x1c1/0x220 [ 2680.553850][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2680.554158][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2680.554460][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2680.554788][ C0] ? __copy_skb_header+0xaf/0x490 [ 2680.555053][ C0] ? __skb_clone+0x57a/0x760 [ 2680.555294][ C0] netif_receive_skb+0x55/0x280 [ 2680.555555][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2680.555883][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2680.556234][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2680.556544][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2680.556834][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2680.557134][ C0] ? hlock_class+0x4e/0x130 [ 2680.557381][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2680.557715][ C0] ? place_entity+0x21/0x2f0 [ 2680.557964][ C0] ? resched_curr+0x219/0x280 [ 2680.558215][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2680.558481][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2680.558760][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2680.559040][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2680.559301][ C0] ? activate_task+0xf5/0x260 [ 2680.559552][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2680.559829][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2680.560100][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2680.560360][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2680.560655][ C0] ? get_stack_info+0x36/0xc0 [ 2680.560905][ C0] ? stack_access_ok+0xda/0x1f0 [ 2680.561163][ C0] ? get_reg+0x119/0x190 [ 2680.561389][ C0] __tcf_classify+0x32c/0x7d0 [ 2680.561644][ C0] tcf_classify+0x283/0x930 [ 2680.561888][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2680.562219][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2680.562483][ C0] ? arch_stack_walk+0x8c/0x100 [ 2680.562743][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2680.563042][ C0] tc_run+0x2e4/0x5d0 [ 2680.563256][ C0] ? __pfx_tc_run+0x10/0x10 [ 2680.563497][ C0] ? lock_acquire+0x1c1/0x220 [ 2680.563745][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2680.564021][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2680.564292][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2680.564576][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2680.564853][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2680.565171][ C0] ? neigh_hh_output+0x348/0x590 [ 2680.565439][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2680.565715][ C0] ip_finish_output2+0x786/0x18e0 [ 2680.565983][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2680.566276][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2680.566632][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2680.566925][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2680.567190][ C0] ? __ip_finish_output+0x10f/0x770 [ 2680.567472][ C0] ip_output+0x16b/0x4f0 [ 2680.567699][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2680.567978][ C0] ? __pfx_ip_output+0x10/0x10 [ 2680.568235][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2680.568535][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2680.568799][ C0] ? ip_local_out+0x114/0x3b0 [ 2680.569049][ C0] __ip_queue_xmit+0x672/0x1910 [ 2680.569307][ C0] ? __skb_clone+0x57a/0x760 [ 2680.569551][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2680.569834][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2680.570131][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2680.570454][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2680.570710][ C0] ? tcp_current_mss+0x40a/0x510 [ 2680.570975][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2680.571254][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2680.571533][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2680.571787][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2680.572054][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2680.572370][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2680.572649][ C0] ? ktime_get+0xb6/0x190 [ 2680.572890][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2680.573164][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2680.573448][ C0] tcp_write_timer+0x82/0x1d0 [ 2680.573697][ C0] call_timer_fn+0x176/0x430 [ 2680.573943][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2680.574220][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2680.574492][ C0] __run_timers.part.0+0x52d/0x890 [ 2680.574768][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2680.575052][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2680.575356][ C0] ? lock_acquire+0x1c1/0x220 [ 2680.575603][ C0] ? clockevents_program_event+0xf6/0x300 [ 2680.575905][ C0] ? lock_release+0x1d5/0x250 [ 2680.576158][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2680.576432][ C0] ? ktime_get+0xb6/0x190 [ 2680.576661][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2680.576958][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2680.577272][ C0] run_timer_softirq+0x72/0x100 [ 2680.577532][ C0] __do_softirq+0x1bc/0x7ff [ 2680.577773][ C0] irq_exit_rcu+0x98/0xc0 [ 2680.578006][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2680.578305][ C0] [ 2680.578464][ C0] [ 2680.578623][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2680.578946][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2680.579214][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2680.580238][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2680.580560][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2680.580976][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2680.581392][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2680.581810][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2680.582226][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2680.582646][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2680.582958][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2680.583234][ C0] default_idle_call+0x69/0xa0 [ 2680.583486][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2680.583752][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2680.584046][ C0] ? lock_release+0x1d5/0x250 [ 2680.584303][ C0] do_idle+0xfb/0x160 [ 2680.584518][ C0] cpu_startup_entry+0x55/0x60 [ 2680.584773][ C0] rest_init+0x153/0x260 [ 2680.585000][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2680.585295][ C0] arch_call_rest_init+0x13/0x40 [ 2680.585565][ C0] start_kernel+0x314/0x3d0 [ 2680.585807][ C0] x86_64_start_reservations+0x18/0x30 [ 2680.586099][ C0] x86_64_start_kernel+0xba/0x110 [ 2680.586371][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2680.586701][ C0] [ 2680.586870][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1390s! [ksoftirqd/1:22] [ 2680.587341][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2680.588544][ C1] irq event stamp: 3886976 [ 2680.588784][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2680.589281][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2680.589774][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2680.590272][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2680.590766][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2680.591259][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2680.591903][ C1] RIP: 0010:kasan_check_range+0x161/0x1c0 [ 2680.592211][ C1] Code: 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 48 83 c0 01 48 39 d0 74 a5 <80> 38 00 74 f2 e9 74 ff ff ff b8 01 00 00 00 c3 cc cc cc cc 48 29 [ 2680.593241][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000282 [ 2680.593571][ C1] RAX: ffffed10014131c3 RBX: ffffed10014131c4 RCX: ffffffff90c7aaa0 [ 2680.593995][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2680.594419][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: ffffed10014131c3 [ 2680.594846][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2680.595276][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2680.595699][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2680.596174][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2680.596523][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2680.596947][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2680.597368][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2680.597788][ C1] Call Trace: [ 2680.597966][ C1] [ 2680.598123][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2680.598408][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2680.598662][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2680.598955][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2680.599242][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2680.599544][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2680.599827][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2680.600149][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2680.600427][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2680.600751][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2680.601062][ C1] [ 2680.601221][ C1] [ 2680.601381][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2680.601715][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2680.602017][ C1] ? kasan_check_range+0x161/0x1c0 [ 2680.602290][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 2680.602588][ C1] ? run_ksoftirqd+0xb/0x60 [ 2680.602835][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2680.603171][ C1] ? __orc_find+0x9c/0xf0 [ 2680.603404][ C1] ? lock_acquire+0x1c1/0x220 [ 2680.603660][ C1] ? irqentry_enter+0x2b/0x60 [ 2680.603917][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2680.604185][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2680.604475][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2680.604778][ C1] ? lock_acquire+0x1c1/0x220 [ 2680.605027][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2680.605278][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2680.605552][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2680.605806][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2680.606072][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2680.606352][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2680.606647][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2680.606940][ C1] ip_local_deliver+0x19d/0x480 [ 2680.607203][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2680.607489][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2680.607755][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2680.608037][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2680.608304][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2680.608639][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2680.608919][ C1] ip_rcv+0x564/0x740 [ 2680.609137][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2680.609384][ C1] ? set_track_prepare+0x8a/0xd0 [ 2680.609654][ C1] ? irqentry_enter+0x2b/0x60 [ 2680.609904][ C1] ? irqentry_enter+0x2b/0x60 [ 2680.610155][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2680.610396][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2680.610709][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2680.611054][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2680.611363][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2680.611706][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2680.612008][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2680.612343][ C1] netif_receive_skb+0x55/0x280 [ 2680.612604][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2680.612938][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2680.613292][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2680.613606][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2680.613898][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2680.614206][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2680.614541][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2680.614825][ C1] ? arch_stack_walk+0x68/0x100 [ 2680.615085][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2680.615360][ C1] ? irqentry_enter+0x2b/0x60 [ 2680.615610][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2680.615931][ C1] ? irqentry_enter+0x2b/0x60 [ 2680.616188][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2680.616512][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2680.616792][ C1] ? arch_stack_walk+0x68/0x100 [ 2680.617057][ C1] __tcf_classify+0x32c/0x7d0 [ 2680.617314][ C1] tcf_classify+0x283/0x930 [ 2680.617560][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2680.617834][ C1] tc_run+0x2e4/0x5d0 [ 2680.618052][ C1] ? __pfx_tc_run+0x10/0x10 [ 2680.618302][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2680.618571][ C1] ? irqentry_enter+0x2b/0x60 [ 2680.618823][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2680.619108][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2680.619433][ C1] ip_finish_output2+0x786/0x18e0 [ 2680.619706][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2680.619998][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2680.620263][ C1] ? __ip_finish_output+0x10f/0x770 [ 2680.620544][ C1] ip_output+0x16b/0x4f0 [ 2680.620776][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2680.621097][ C1] ? __pfx_ip_output+0x10/0x10 [ 2680.621357][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2680.621708][ C1] ? __pfx_ip_output+0x10/0x10 [ 2680.621963][ C1] __ip_queue_xmit+0x672/0x1910 [ 2680.622232][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2680.622517][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2680.622819][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2680.623115][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2680.623411][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2680.623697][ C1] tcp_delack_timer+0x84/0x240 [ 2680.623953][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2680.624242][ C1] call_timer_fn+0x176/0x430 [ 2680.624494][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2680.624769][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2680.625051][ C1] __run_timers.part.0+0x52d/0x890 [ 2680.625327][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2680.625615][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2680.625916][ C1] ? __pfx___schedule+0x10/0x10 [ 2680.626180][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2680.626504][ C1] run_timer_softirq+0x72/0x100 [ 2680.626762][ C1] __do_softirq+0x1bc/0x7ff [ 2680.627003][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2680.627280][ C1] run_ksoftirqd+0x2e/0x60 [ 2680.627520][ C1] smpboot_thread_fn+0x30e/0x840 [ 2680.627787][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2680.628082][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2680.628373][ C1] kthread+0x292/0x360 [ 2680.628591][ C1] ? __pfx_kthread+0x10/0x10 [ 2680.628835][ C1] ret_from_fork+0x34/0x70 [ 2680.629077][ C1] ? __pfx_kthread+0x10/0x10 [ 2680.629325][ C1] ret_from_fork_asm+0x1b/0x30 [ 2680.629589][ C1] [ 2703.856023][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 2703.856414][ C0] rcu: 0-....: (1508678 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=364777 [ 2703.856936][ C0] rcu: (t=1509547 jiffies g=1007429 q=31 ncpus=4) [ 2703.857283][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2703.857768][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2703.858416][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2703.858760][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2703.859775][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2703.860099][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2703.860516][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2703.860935][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2703.861356][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2703.861776][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2703.862198][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2703.862669][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2703.863027][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2703.863450][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2703.863868][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2703.864288][ C0] Call Trace: [ 2703.864467][ C0] [ 2703.864622][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 2703.864912][ C0] ? print_cpu_stall+0x263/0x6a0 [ 2703.865177][ C0] ? check_cpu_stall+0x284/0x500 [ 2703.865443][ C0] ? rcu_pending+0x92/0x360 [ 2703.865682][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 2703.865965][ C0] ? update_process_times+0xb9/0x110 [ 2703.866251][ C0] ? tick_sched_handle+0x67/0x130 [ 2703.866520][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 2703.866814][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2703.867073][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 2703.867398][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2703.867687][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2703.867992][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2703.868274][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2703.868594][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2703.868865][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2703.869144][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2703.869465][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2703.869774][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2703.870109][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2703.870411][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2703.870720][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2703.871025][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2703.871354][ C0] ? get_stack_info+0x36/0xc0 [ 2703.871605][ C0] ? lock_acquire+0x1c1/0x220 [ 2703.871857][ C0] ? lock_release+0x1d5/0x250 [ 2703.872108][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2703.872367][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2703.872649][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2703.872954][ C0] ? lock_acquire+0x1c1/0x220 [ 2703.873201][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2703.873452][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2703.873723][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2703.873972][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2703.874234][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2703.874504][ C0] ? __inet_lookup_established+0x341/0x610 [ 2703.874819][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2703.875109][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2703.875399][ C0] ip_local_deliver+0x19d/0x480 [ 2703.875662][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2703.875947][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2703.876215][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2703.876490][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2703.876752][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2703.877090][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2703.877363][ C0] ip_rcv+0x564/0x740 [ 2703.877577][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2703.877817][ C0] ? set_track_prepare+0x8a/0xd0 [ 2703.878082][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2703.878373][ C0] ? rest_init+0x153/0x260 [ 2703.878610][ C0] ? skb_clone+0x10b/0x330 [ 2703.878851][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2703.879184][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2703.879505][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2703.879807][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2703.880118][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2703.880383][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2703.880628][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2703.880944][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2703.881243][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2703.881580][ C0] ? lock_acquire+0x1c1/0x220 [ 2703.881829][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2703.882137][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2703.882436][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2703.882763][ C0] ? __copy_skb_header+0xaf/0x490 [ 2703.883042][ C0] ? __skb_clone+0x57a/0x760 [ 2703.883291][ C0] netif_receive_skb+0x55/0x280 [ 2703.883548][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2703.883875][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2703.884222][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2703.884537][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2703.884822][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2703.885121][ C0] ? hlock_class+0x4e/0x130 [ 2703.885366][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2703.885694][ C0] ? place_entity+0x21/0x2f0 [ 2703.885939][ C0] ? resched_curr+0x219/0x280 [ 2703.886194][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2703.886464][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2703.886749][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2703.887025][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2703.887282][ C0] ? activate_task+0xf5/0x260 [ 2703.887530][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2703.887804][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2703.888079][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2703.888338][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2703.888628][ C0] ? get_stack_info+0x36/0xc0 [ 2703.888883][ C0] ? stack_access_ok+0xda/0x1f0 [ 2703.889142][ C0] ? get_reg+0x119/0x190 [ 2703.889373][ C0] __tcf_classify+0x32c/0x7d0 [ 2703.889626][ C0] tcf_classify+0x283/0x930 [ 2703.889878][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2703.890207][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2703.890476][ C0] ? arch_stack_walk+0x8c/0x100 [ 2703.890738][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2703.891029][ C0] tc_run+0x2e4/0x5d0 [ 2703.891243][ C0] ? __pfx_tc_run+0x10/0x10 [ 2703.891483][ C0] ? lock_acquire+0x1c1/0x220 [ 2703.891729][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2703.892001][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2703.892269][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2703.892551][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2703.892832][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2703.893160][ C0] ? neigh_hh_output+0x348/0x590 [ 2703.893424][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2703.893710][ C0] ip_finish_output2+0x786/0x18e0 [ 2703.893982][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2703.894281][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2703.894634][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2703.894923][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2703.895189][ C0] ? __ip_finish_output+0x10f/0x770 [ 2703.895469][ C0] ip_output+0x16b/0x4f0 [ 2703.895697][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2703.895982][ C0] ? __pfx_ip_output+0x10/0x10 [ 2703.896238][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2703.896540][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2703.896803][ C0] ? ip_local_out+0x114/0x3b0 [ 2703.897060][ C0] __ip_queue_xmit+0x672/0x1910 [ 2703.897326][ C0] ? __skb_clone+0x57a/0x760 [ 2703.897576][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2703.897857][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2703.898153][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2703.898469][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2703.898727][ C0] ? tcp_current_mss+0x40a/0x510 [ 2703.898990][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2703.899273][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2703.899548][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2703.899800][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2703.900072][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2703.900394][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2703.900667][ C0] ? ktime_get+0xb6/0x190 [ 2703.900896][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2703.901169][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2703.901453][ C0] tcp_write_timer+0x82/0x1d0 [ 2703.901703][ C0] call_timer_fn+0x176/0x430 [ 2703.901949][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2703.902226][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2703.902498][ C0] __run_timers.part.0+0x52d/0x890 [ 2703.902779][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2703.903065][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2703.903360][ C0] ? lock_acquire+0x1c1/0x220 [ 2703.903613][ C0] ? clockevents_program_event+0xf6/0x300 [ 2703.903920][ C0] ? lock_release+0x1d5/0x250 [ 2703.904171][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2703.904450][ C0] ? ktime_get+0xb6/0x190 [ 2703.904682][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2703.904983][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2703.905292][ C0] run_timer_softirq+0x72/0x100 [ 2703.905554][ C0] __do_softirq+0x1bc/0x7ff [ 2703.905800][ C0] irq_exit_rcu+0x98/0xc0 [ 2703.906037][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2703.906339][ C0] [ 2703.906494][ C0] [ 2703.906649][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2703.906966][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2703.907236][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2703.908260][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2703.908584][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2703.909010][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2703.909434][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2703.909853][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2703.910274][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2703.910698][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2703.911004][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2703.911286][ C0] default_idle_call+0x69/0xa0 [ 2703.911542][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2703.911807][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2703.912099][ C0] ? lock_release+0x1d5/0x250 [ 2703.912352][ C0] do_idle+0xfb/0x160 [ 2703.912569][ C0] cpu_startup_entry+0x55/0x60 [ 2703.912834][ C0] rest_init+0x153/0x260 [ 2703.913064][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2703.913351][ C0] arch_call_rest_init+0x13/0x40 [ 2703.913618][ C0] start_kernel+0x314/0x3d0 [ 2703.913863][ C0] x86_64_start_reservations+0x18/0x30 [ 2703.914157][ C0] x86_64_start_kernel+0xba/0x110 [ 2703.914424][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2703.914750][ C0] [ 2703.914916][ C0] Sending NMI from CPU 0 to CPUs 1: [ 2703.915213][ C1] NMI backtrace for cpu 1 [ 2703.915221][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2703.915227][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2703.915229][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2703.915238][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2703.915242][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2703.915245][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2703.915247][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2703.915249][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2703.915252][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2703.915253][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2703.915255][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2703.915257][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2703.915261][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2703.915262][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2703.915264][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2703.915265][ C1] Call Trace: [ 2703.915269][ C1] [ 2703.915273][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 2703.915280][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 2703.915287][ C1] ? nmi_handle+0x156/0x420 [ 2703.915293][ C1] ? default_do_nmi+0x41/0x100 [ 2703.915297][ C1] ? exc_nmi+0xf3/0x120 [ 2703.915299][ C1] ? end_repeat_nmi+0xf/0x60 [ 2703.915304][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2703.915308][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2703.915312][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2703.915316][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2703.915320][ C1] [ 2703.915321][ C1] [ 2703.915322][ C1] ? run_ksoftirqd+0xb/0x60 [ 2703.915327][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2703.915330][ C1] ? __orc_find+0x9c/0xf0 [ 2703.915333][ C1] ? lock_acquire+0x1c1/0x220 [ 2703.915338][ C1] ? irqentry_enter+0x2b/0x60 [ 2703.915343][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2703.915347][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2703.915350][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2703.915353][ C1] ? lock_acquire+0x1c1/0x220 [ 2703.915356][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2703.915361][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2703.915366][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2703.915373][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2703.915376][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2703.915383][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2703.915391][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2703.915395][ C1] ip_local_deliver+0x19d/0x480 [ 2703.915398][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2703.915401][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2703.915406][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2703.915410][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2703.915413][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2703.915416][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2703.915426][ C1] ip_rcv+0x564/0x740 [ 2703.915429][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2703.915432][ C1] ? set_track_prepare+0x8a/0xd0 [ 2703.915438][ C1] ? irqentry_enter+0x2b/0x60 [ 2703.915441][ C1] ? irqentry_enter+0x2b/0x60 [ 2703.915445][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2703.915447][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2703.915453][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2703.915456][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2703.915459][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2703.915463][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2703.915466][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2703.915471][ C1] netif_receive_skb+0x55/0x280 [ 2703.915475][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2703.915483][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2703.915490][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2703.915498][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2703.915505][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2703.915517][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2703.915526][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2703.915530][ C1] ? arch_stack_walk+0x68/0x100 [ 2703.915536][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2703.915539][ C1] ? irqentry_enter+0x2b/0x60 [ 2703.915542][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2703.915547][ C1] ? irqentry_enter+0x2b/0x60 [ 2703.915551][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2703.915558][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2703.915560][ C1] ? arch_stack_walk+0x68/0x100 [ 2703.915565][ C1] __tcf_classify+0x32c/0x7d0 [ 2703.915571][ C1] tcf_classify+0x283/0x930 [ 2703.915575][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2703.915580][ C1] tc_run+0x2e4/0x5d0 [ 2703.915585][ C1] ? __pfx_tc_run+0x10/0x10 [ 2703.915590][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2703.915596][ C1] ? irqentry_enter+0x2b/0x60 [ 2703.915599][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2703.915602][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2703.915609][ C1] ip_finish_output2+0x786/0x18e0 [ 2703.915615][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2703.915617][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2703.915621][ C1] ? __ip_finish_output+0x10f/0x770 [ 2703.915625][ C1] ip_output+0x16b/0x4f0 [ 2703.915629][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2703.915632][ C1] ? __pfx_ip_output+0x10/0x10 [ 2703.915636][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2703.915643][ C1] ? __pfx_ip_output+0x10/0x10 [ 2703.915648][ C1] __ip_queue_xmit+0x672/0x1910 [ 2703.915654][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2703.915661][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2703.915665][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2703.915669][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2703.915673][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2703.915676][ C1] tcp_delack_timer+0x84/0x240 [ 2703.915680][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2703.915683][ C1] call_timer_fn+0x176/0x430 [ 2703.915688][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2703.915693][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2703.915697][ C1] __run_timers.part.0+0x52d/0x890 [ 2703.915700][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2703.915705][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2703.915710][ C1] ? __pfx___schedule+0x10/0x10 [ 2703.915714][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2703.915719][ C1] run_timer_softirq+0x72/0x100 [ 2703.915723][ C1] __do_softirq+0x1bc/0x7ff [ 2703.915727][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2703.915731][ C1] run_ksoftirqd+0x2e/0x60 [ 2703.915735][ C1] smpboot_thread_fn+0x30e/0x840 [ 2703.915739][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2703.915743][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2703.915746][ C1] kthread+0x292/0x360 [ 2703.915748][ C1] ? __pfx_kthread+0x10/0x10 [ 2703.915751][ C1] ret_from_fork+0x34/0x70 [ 2703.915754][ C1] ? __pfx_kthread+0x10/0x10 [ 2703.915756][ C1] ret_from_fork_asm+0x1b/0x30 [ 2703.915763][ C1] [ 2728.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1435s! [swapper/0:0] [ 2728.527922][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2728.529126][ C0] irq event stamp: 27567077 [ 2728.529369][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2728.529900][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2728.530369][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2728.530869][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2728.531363][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2728.531846][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2728.532495][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2728.532844][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2728.533863][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2728.534187][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2728.534604][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2728.535020][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2728.535438][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2728.535856][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2728.536274][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2728.536745][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2728.537097][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2728.537515][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2728.537935][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2728.538359][ C0] Call Trace: [ 2728.538545][ C0] [ 2728.538701][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2728.538977][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2728.539233][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2728.539522][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2728.539811][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2728.540118][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2728.540400][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2728.540722][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2728.540992][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2728.541272][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2728.541593][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2728.541902][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2728.542236][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2728.542538][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2728.542855][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2728.543157][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2728.543484][ C0] ? get_stack_info+0x36/0xc0 [ 2728.543742][ C0] ? lock_acquire+0x1c1/0x220 [ 2728.543998][ C0] ? lock_release+0x1d5/0x250 [ 2728.544255][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2728.544518][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2728.544803][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2728.545103][ C0] ? lock_acquire+0x1c1/0x220 [ 2728.545349][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2728.545599][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2728.545871][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2728.546122][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2728.546383][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2728.546655][ C0] ? __inet_lookup_established+0x341/0x610 [ 2728.546973][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2728.547262][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2728.547553][ C0] ip_local_deliver+0x19d/0x480 [ 2728.547813][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2728.548099][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2728.548366][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2728.548641][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2728.548903][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2728.549241][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2728.549515][ C0] ip_rcv+0x564/0x740 [ 2728.549729][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2728.549968][ C0] ? set_track_prepare+0x8a/0xd0 [ 2728.550235][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2728.550526][ C0] ? rest_init+0x153/0x260 [ 2728.550762][ C0] ? skb_clone+0x10b/0x330 [ 2728.551005][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2728.551340][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2728.551664][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2728.551963][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2728.552274][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2728.552540][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2728.552787][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2728.553100][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2728.553396][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2728.553739][ C0] ? lock_acquire+0x1c1/0x220 [ 2728.553993][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2728.554306][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2728.554602][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2728.554934][ C0] ? __copy_skb_header+0xaf/0x490 [ 2728.555207][ C0] ? __skb_clone+0x57a/0x760 [ 2728.555456][ C0] netif_receive_skb+0x55/0x280 [ 2728.555713][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2728.556039][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2728.556386][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2728.556701][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2728.556986][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2728.557286][ C0] ? hlock_class+0x4e/0x130 [ 2728.557528][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2728.557856][ C0] ? place_entity+0x21/0x2f0 [ 2728.558101][ C0] ? resched_curr+0x219/0x280 [ 2728.558354][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2728.558625][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2728.558910][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2728.559186][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2728.559442][ C0] ? activate_task+0xf5/0x260 [ 2728.559689][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2728.559963][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2728.560238][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2728.560497][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2728.560787][ C0] ? get_stack_info+0x36/0xc0 [ 2728.561041][ C0] ? stack_access_ok+0xda/0x1f0 [ 2728.561301][ C0] ? get_reg+0x119/0x190 [ 2728.561532][ C0] __tcf_classify+0x32c/0x7d0 [ 2728.561784][ C0] tcf_classify+0x283/0x930 [ 2728.562026][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2728.562352][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2728.562623][ C0] ? arch_stack_walk+0x8c/0x100 [ 2728.562893][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2728.563181][ C0] tc_run+0x2e4/0x5d0 [ 2728.563404][ C0] ? __pfx_tc_run+0x10/0x10 [ 2728.563654][ C0] ? lock_acquire+0x1c1/0x220 [ 2728.563905][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2728.564183][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2728.564453][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2728.564739][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2728.565018][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2728.565343][ C0] ? neigh_hh_output+0x348/0x590 [ 2728.565605][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2728.565886][ C0] ip_finish_output2+0x786/0x18e0 [ 2728.566161][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2728.566456][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2728.566806][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2728.567097][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2728.567362][ C0] ? __ip_finish_output+0x10f/0x770 [ 2728.567637][ C0] ip_output+0x16b/0x4f0 [ 2728.567868][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2728.568153][ C0] ? __pfx_ip_output+0x10/0x10 [ 2728.568410][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2728.568713][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2728.568974][ C0] ? ip_local_out+0x114/0x3b0 [ 2728.569231][ C0] __ip_queue_xmit+0x672/0x1910 [ 2728.569497][ C0] ? __skb_clone+0x57a/0x760 [ 2728.569752][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2728.570031][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2728.570326][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2728.570642][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2728.570902][ C0] ? tcp_current_mss+0x40a/0x510 [ 2728.571167][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2728.571451][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2728.571725][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2728.571976][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2728.572250][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2728.572572][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2728.572857][ C0] ? ktime_get+0xb6/0x190 [ 2728.573094][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2728.573370][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2728.573651][ C0] tcp_write_timer+0x82/0x1d0 [ 2728.573906][ C0] call_timer_fn+0x176/0x430 [ 2728.574157][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2728.574429][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2728.574705][ C0] __run_timers.part.0+0x52d/0x890 [ 2728.574976][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2728.575262][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2728.575559][ C0] ? lock_acquire+0x1c1/0x220 [ 2728.575812][ C0] ? clockevents_program_event+0xf6/0x300 [ 2728.576121][ C0] ? lock_release+0x1d5/0x250 [ 2728.576374][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2728.576654][ C0] ? ktime_get+0xb6/0x190 [ 2728.576886][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2728.577191][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2728.577499][ C0] run_timer_softirq+0x72/0x100 [ 2728.577761][ C0] __do_softirq+0x1bc/0x7ff [ 2728.578008][ C0] irq_exit_rcu+0x98/0xc0 [ 2728.578246][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2728.578545][ C0] [ 2728.578700][ C0] [ 2728.578856][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2728.579174][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2728.579442][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2728.580464][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2728.580788][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2728.581213][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2728.581637][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2728.582057][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2728.582479][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2728.582904][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2728.583207][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2728.583479][ C0] default_idle_call+0x69/0xa0 [ 2728.583737][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2728.584004][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2728.584298][ C0] ? lock_release+0x1d5/0x250 [ 2728.584546][ C0] do_idle+0xfb/0x160 [ 2728.584757][ C0] cpu_startup_entry+0x55/0x60 [ 2728.585008][ C0] rest_init+0x153/0x260 [ 2728.585238][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2728.585523][ C0] arch_call_rest_init+0x13/0x40 [ 2728.585786][ C0] start_kernel+0x314/0x3d0 [ 2728.586031][ C0] x86_64_start_reservations+0x18/0x30 [ 2728.586324][ C0] x86_64_start_kernel+0xba/0x110 [ 2728.586591][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2728.586919][ C0] [ 2728.587086][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1435s! [ksoftirqd/1:22] [ 2728.587565][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2728.588770][ C1] irq event stamp: 3886976 [ 2728.589007][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2728.589515][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2728.590019][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2728.590529][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2728.591020][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2728.591523][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2728.592176][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2728.592525][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2728.593558][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2728.593879][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2728.594299][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2728.594719][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2728.595140][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2728.595559][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2728.595982][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2728.596454][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2728.596806][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2728.597235][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2728.597663][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2728.598093][ C1] Call Trace: [ 2728.598276][ C1] [ 2728.598434][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2728.598712][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2728.598974][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2728.599268][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2728.599560][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2728.599867][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2728.600154][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2728.600481][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2728.600756][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2728.601088][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2728.601402][ C1] [ 2728.601559][ C1] [ 2728.601717][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2728.602049][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2728.602364][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2728.602685][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2728.602990][ C1] ? run_ksoftirqd+0xb/0x60 [ 2728.603239][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2728.603570][ C1] ? __orc_find+0x9c/0xf0 [ 2728.603804][ C1] ? lock_acquire+0x1c1/0x220 [ 2728.604058][ C1] ? irqentry_enter+0x2b/0x60 [ 2728.604311][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2728.604573][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2728.604857][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2728.605156][ C1] ? lock_acquire+0x1c1/0x220 [ 2728.605410][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2728.605669][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2728.605948][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2728.606196][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2728.606455][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2728.606724][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2728.607014][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2728.607309][ C1] ip_local_deliver+0x19d/0x480 [ 2728.607572][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2728.607861][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2728.608129][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2728.608406][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2728.608670][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2728.609010][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2728.609287][ C1] ip_rcv+0x564/0x740 [ 2728.609499][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2728.609739][ C1] ? set_track_prepare+0x8a/0xd0 [ 2728.610003][ C1] ? irqentry_enter+0x2b/0x60 [ 2728.610259][ C1] ? irqentry_enter+0x2b/0x60 [ 2728.610515][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2728.610761][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2728.611085][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2728.611430][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2728.611742][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2728.612083][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2728.612382][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2728.612722][ C1] netif_receive_skb+0x55/0x280 [ 2728.612984][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2728.613315][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2728.613664][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2728.613984][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2728.614275][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2728.614579][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2728.614909][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2728.615192][ C1] ? arch_stack_walk+0x68/0x100 [ 2728.615459][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2728.615740][ C1] ? irqentry_enter+0x2b/0x60 [ 2728.615996][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2728.616322][ C1] ? irqentry_enter+0x2b/0x60 [ 2728.616575][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2728.616899][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2728.617185][ C1] ? arch_stack_walk+0x68/0x100 [ 2728.617447][ C1] __tcf_classify+0x32c/0x7d0 [ 2728.617700][ C1] tcf_classify+0x283/0x930 [ 2728.617944][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2728.618214][ C1] tc_run+0x2e4/0x5d0 [ 2728.618428][ C1] ? __pfx_tc_run+0x10/0x10 [ 2728.618671][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2728.618936][ C1] ? irqentry_enter+0x2b/0x60 [ 2728.619194][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2728.619484][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2728.619810][ C1] ip_finish_output2+0x786/0x18e0 [ 2728.620082][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2728.620374][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2728.620642][ C1] ? __ip_finish_output+0x10f/0x770 [ 2728.620919][ C1] ip_output+0x16b/0x4f0 [ 2728.621147][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2728.621470][ C1] ? __pfx_ip_output+0x10/0x10 [ 2728.621725][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2728.622085][ C1] ? __pfx_ip_output+0x10/0x10 [ 2728.622345][ C1] __ip_queue_xmit+0x672/0x1910 [ 2728.622608][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2728.622898][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2728.623203][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2728.623493][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2728.623791][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2728.624080][ C1] tcp_delack_timer+0x84/0x240 [ 2728.624338][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2728.624622][ C1] call_timer_fn+0x176/0x430 [ 2728.624868][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2728.625148][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2728.625428][ C1] __run_timers.part.0+0x52d/0x890 [ 2728.625700][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2728.625991][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2728.626298][ C1] ? __pfx___schedule+0x10/0x10 [ 2728.626559][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2728.626880][ C1] run_timer_softirq+0x72/0x100 [ 2728.627148][ C1] __do_softirq+0x1bc/0x7ff [ 2728.627396][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2728.627678][ C1] run_ksoftirqd+0x2e/0x60 [ 2728.627917][ C1] smpboot_thread_fn+0x30e/0x840 [ 2728.628188][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2728.628477][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2728.628769][ C1] kthread+0x292/0x360 [ 2728.628989][ C1] ? __pfx_kthread+0x10/0x10 [ 2728.629242][ C1] ret_from_fork+0x34/0x70 [ 2728.629480][ C1] ? __pfx_kthread+0x10/0x10 [ 2728.629729][ C1] ret_from_fork_asm+0x1b/0x30 [ 2728.629987][ C1] [ 2756.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1461s! [swapper/0:0] [ 2756.527916][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2756.529114][ C0] irq event stamp: 27567077 [ 2756.529355][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2756.529882][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2756.530366][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2756.530870][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2756.531370][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2756.531858][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2756.532508][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2756.532856][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2756.533883][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2756.534209][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2756.534634][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2756.535062][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2756.535484][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2756.535909][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2756.536335][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2756.536807][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2756.537161][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2756.537586][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2756.538003][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2756.538419][ C0] Call Trace: [ 2756.538594][ C0] [ 2756.538752][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2756.539030][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2756.539283][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2756.539577][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2756.539860][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2756.540164][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2756.540441][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2756.540759][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2756.541036][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2756.541311][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2756.541637][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2756.541947][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2756.542279][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2756.542590][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2756.542900][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2756.543207][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2756.543535][ C0] ? get_stack_info+0x36/0xc0 [ 2756.543787][ C0] ? lock_acquire+0x1c1/0x220 [ 2756.544037][ C0] ? lock_release+0x1d5/0x250 [ 2756.544285][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2756.544546][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2756.544832][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2756.545134][ C0] ? lock_acquire+0x1c1/0x220 [ 2756.545382][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2756.545633][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2756.545909][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2756.546160][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2756.546424][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2756.546696][ C0] ? __inet_lookup_established+0x341/0x610 [ 2756.547013][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2756.547304][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2756.547596][ C0] ip_local_deliver+0x19d/0x480 [ 2756.547859][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2756.548146][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2756.548412][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2756.548689][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2756.548950][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2756.549291][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2756.549568][ C0] ip_rcv+0x564/0x740 [ 2756.549780][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2756.550020][ C0] ? set_track_prepare+0x8a/0xd0 [ 2756.550285][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2756.550579][ C0] ? rest_init+0x153/0x260 [ 2756.550815][ C0] ? skb_clone+0x10b/0x330 [ 2756.551059][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2756.551393][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2756.551713][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2756.552015][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2756.552326][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2756.552595][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2756.552835][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2756.553151][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2756.553449][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2756.553792][ C0] ? lock_acquire+0x1c1/0x220 [ 2756.554043][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2756.554366][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2756.554665][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2756.554999][ C0] ? __copy_skb_header+0xaf/0x490 [ 2756.555269][ C0] ? __skb_clone+0x57a/0x760 [ 2756.555518][ C0] netif_receive_skb+0x55/0x280 [ 2756.555775][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2756.556101][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2756.556448][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2756.556763][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2756.557049][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2756.557345][ C0] ? hlock_class+0x4e/0x130 [ 2756.557586][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2756.557918][ C0] ? place_entity+0x21/0x2f0 [ 2756.558167][ C0] ? resched_curr+0x219/0x280 [ 2756.558424][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2756.558698][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2756.558983][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2756.559260][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2756.559522][ C0] ? activate_task+0xf5/0x260 [ 2756.559771][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2756.560048][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2756.560322][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2756.560580][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2756.560877][ C0] ? get_stack_info+0x36/0xc0 [ 2756.561133][ C0] ? stack_access_ok+0xda/0x1f0 [ 2756.561394][ C0] ? get_reg+0x119/0x190 [ 2756.561623][ C0] __tcf_classify+0x32c/0x7d0 [ 2756.561876][ C0] tcf_classify+0x283/0x930 [ 2756.562116][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2756.562442][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2756.562717][ C0] ? arch_stack_walk+0x8c/0x100 [ 2756.562981][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2756.563271][ C0] tc_run+0x2e4/0x5d0 [ 2756.563488][ C0] ? __pfx_tc_run+0x10/0x10 [ 2756.563732][ C0] ? lock_acquire+0x1c1/0x220 [ 2756.563985][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2756.564261][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2756.564532][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2756.564819][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2756.565101][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2756.565422][ C0] ? neigh_hh_output+0x348/0x590 [ 2756.565687][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2756.565966][ C0] ip_finish_output2+0x786/0x18e0 [ 2756.566241][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2756.566536][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2756.566889][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2756.567181][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2756.567448][ C0] ? __ip_finish_output+0x10f/0x770 [ 2756.567724][ C0] ip_output+0x16b/0x4f0 [ 2756.567949][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2756.568234][ C0] ? __pfx_ip_output+0x10/0x10 [ 2756.568486][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2756.568790][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2756.569053][ C0] ? ip_local_out+0x114/0x3b0 [ 2756.569306][ C0] __ip_queue_xmit+0x672/0x1910 [ 2756.569570][ C0] ? __skb_clone+0x57a/0x760 [ 2756.569825][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2756.570105][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2756.570397][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2756.570713][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2756.570972][ C0] ? tcp_current_mss+0x40a/0x510 [ 2756.571236][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2756.571520][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2756.571795][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2756.572049][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2756.572322][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2756.572646][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2756.572926][ C0] ? ktime_get+0xb6/0x190 [ 2756.573166][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2756.573441][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2756.573720][ C0] tcp_write_timer+0x82/0x1d0 [ 2756.573974][ C0] call_timer_fn+0x176/0x430 [ 2756.574224][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2756.574499][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2756.574775][ C0] __run_timers.part.0+0x52d/0x890 [ 2756.575046][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2756.575332][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2756.575630][ C0] ? lock_acquire+0x1c1/0x220 [ 2756.575880][ C0] ? clockevents_program_event+0xf6/0x300 [ 2756.576191][ C0] ? lock_release+0x1d5/0x250 [ 2756.576446][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2756.576725][ C0] ? ktime_get+0xb6/0x190 [ 2756.576960][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2756.577263][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2756.577572][ C0] run_timer_softirq+0x72/0x100 [ 2756.577834][ C0] __do_softirq+0x1bc/0x7ff [ 2756.578083][ C0] irq_exit_rcu+0x98/0xc0 [ 2756.578317][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2756.578619][ C0] [ 2756.578775][ C0] [ 2756.578931][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2756.579253][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2756.579523][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2756.580549][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2756.580885][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2756.581309][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2756.581733][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2756.582158][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2756.582587][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2756.583006][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2756.583309][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2756.583580][ C0] default_idle_call+0x69/0xa0 [ 2756.583834][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2756.584098][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2756.584392][ C0] ? lock_release+0x1d5/0x250 [ 2756.584643][ C0] do_idle+0xfb/0x160 [ 2756.584855][ C0] cpu_startup_entry+0x55/0x60 [ 2756.585107][ C0] rest_init+0x153/0x260 [ 2756.585336][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2756.585626][ C0] arch_call_rest_init+0x13/0x40 [ 2756.585893][ C0] start_kernel+0x314/0x3d0 [ 2756.586139][ C0] x86_64_start_reservations+0x18/0x30 [ 2756.586433][ C0] x86_64_start_kernel+0xba/0x110 [ 2756.586701][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2756.587027][ C0] [ 2756.587190][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1461s! [ksoftirqd/1:22] [ 2756.587658][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2756.588859][ C1] irq event stamp: 3886976 [ 2756.589102][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2756.589600][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2756.590093][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2756.590589][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2756.591088][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2756.591580][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2756.592223][ C1] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 2756.592528][ C1] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 2756.593554][ C1] RSP: 0018:ffffc9000019e9d0 EFLAGS: 00000282 [ 2756.593875][ C1] RAX: ffff88800a098e1c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2756.594295][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2756.594716][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2756.595135][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2756.595554][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2756.595971][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2756.596444][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2756.596795][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2756.597218][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2756.597643][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2756.598070][ C1] Call Trace: [ 2756.598252][ C1] [ 2756.598410][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2756.598689][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2756.598951][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2756.599245][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2756.599535][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2756.599840][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2756.600123][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2756.600448][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2756.600722][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2756.601050][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2756.601362][ C1] [ 2756.601520][ C1] [ 2756.601676][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2756.602004][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2756.602313][ C1] ? kasan_check_range+0x1a/0x1c0 [ 2756.602589][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 2756.602882][ C1] ? run_ksoftirqd+0xb/0x60 [ 2756.603126][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2756.603455][ C1] ? __orc_find+0x9c/0xf0 [ 2756.603689][ C1] ? lock_acquire+0x1c1/0x220 [ 2756.603946][ C1] ? irqentry_enter+0x2b/0x60 [ 2756.604205][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2756.604469][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2756.604759][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2756.605061][ C1] ? lock_acquire+0x1c1/0x220 [ 2756.605309][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2756.605560][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2756.605833][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2756.606086][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2756.606349][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2756.606624][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2756.606918][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2756.607214][ C1] ip_local_deliver+0x19d/0x480 [ 2756.607475][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2756.607764][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2756.608031][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2756.608312][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2756.608578][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2756.608913][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2756.609193][ C1] ip_rcv+0x564/0x740 [ 2756.609408][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2756.609653][ C1] ? set_track_prepare+0x8a/0xd0 [ 2756.609920][ C1] ? irqentry_enter+0x2b/0x60 [ 2756.610170][ C1] ? irqentry_enter+0x2b/0x60 [ 2756.610419][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2756.610659][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2756.610976][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2756.611317][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2756.611624][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2756.611969][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2756.612276][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2756.612614][ C1] netif_receive_skb+0x55/0x280 [ 2756.612880][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2756.613218][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2756.613567][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2756.613881][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2756.614176][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2756.614484][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2756.614815][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2756.615100][ C1] ? arch_stack_walk+0x68/0x100 [ 2756.615359][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2756.615635][ C1] ? irqentry_enter+0x2b/0x60 [ 2756.615883][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2756.616202][ C1] ? irqentry_enter+0x2b/0x60 [ 2756.616456][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2756.616783][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2756.617064][ C1] ? arch_stack_walk+0x68/0x100 [ 2756.617333][ C1] __tcf_classify+0x32c/0x7d0 [ 2756.617591][ C1] tcf_classify+0x283/0x930 [ 2756.617837][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2756.618111][ C1] tc_run+0x2e4/0x5d0 [ 2756.618328][ C1] ? __pfx_tc_run+0x10/0x10 [ 2756.618574][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2756.618843][ C1] ? irqentry_enter+0x2b/0x60 [ 2756.619093][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2756.619376][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2756.619696][ C1] ip_finish_output2+0x786/0x18e0 [ 2756.619969][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2756.620265][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2756.620533][ C1] ? __ip_finish_output+0x10f/0x770 [ 2756.620815][ C1] ip_output+0x16b/0x4f0 [ 2756.621044][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2756.621360][ C1] ? __pfx_ip_output+0x10/0x10 [ 2756.621618][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2756.621972][ C1] ? __pfx_ip_output+0x10/0x10 [ 2756.622231][ C1] __ip_queue_xmit+0x672/0x1910 [ 2756.622496][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2756.622783][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2756.623081][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2756.623369][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2756.623664][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2756.623949][ C1] tcp_delack_timer+0x84/0x240 [ 2756.624203][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2756.624490][ C1] call_timer_fn+0x176/0x430 [ 2756.624740][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2756.625015][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2756.625297][ C1] __run_timers.part.0+0x52d/0x890 [ 2756.625576][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2756.625862][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2756.626163][ C1] ? __pfx___schedule+0x10/0x10 [ 2756.626430][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2756.626751][ C1] run_timer_softirq+0x72/0x100 [ 2756.627011][ C1] __do_softirq+0x1bc/0x7ff [ 2756.627253][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2756.627525][ C1] run_ksoftirqd+0x2e/0x60 [ 2756.627768][ C1] smpboot_thread_fn+0x30e/0x840 [ 2756.628034][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2756.628327][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2756.628615][ C1] kthread+0x292/0x360 [ 2756.628837][ C1] ? __pfx_kthread+0x10/0x10 [ 2756.629083][ C1] ret_from_fork+0x34/0x70 [ 2756.629325][ C1] ? __pfx_kthread+0x10/0x10 [ 2756.629569][ C1] ret_from_fork_asm+0x1b/0x30 [ 2756.629832][ C1] [ 2781.919024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 2781.919415][ C0] rcu: 0-....: (1586564 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=383515 [ 2781.919938][ C0] rcu: (t=1587610 jiffies g=1007429 q=31 ncpus=4) [ 2781.920285][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2781.920772][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2781.921411][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12b/0xb90 [ 2781.921754][ C0] Code: 24 80 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc 90 e9 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 [ 2781.922781][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2781.923111][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2781.923533][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2781.923955][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2781.924387][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2781.924814][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2781.925236][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2781.925710][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2781.926057][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2781.926477][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2781.926893][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2781.927312][ C0] Call Trace: [ 2781.927489][ C0] [ 2781.927644][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 2781.927931][ C0] ? print_cpu_stall+0x263/0x6a0 [ 2781.928203][ C0] ? check_cpu_stall+0x284/0x500 [ 2781.928468][ C0] ? rcu_pending+0x92/0x360 [ 2781.928707][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 2781.928991][ C0] ? update_process_times+0xb9/0x110 [ 2781.929277][ C0] ? tick_sched_handle+0x67/0x130 [ 2781.929546][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 2781.929842][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2781.930100][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 2781.930424][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2781.930714][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2781.931018][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2781.931300][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2781.931621][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2781.931891][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2781.932170][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2781.932498][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2781.932812][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2781.933140][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2781.933449][ C0] ? queued_spin_lock_slowpath+0x12b/0xb90 [ 2781.933760][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2781.934061][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2781.934387][ C0] ? get_stack_info+0x36/0xc0 [ 2781.934647][ C0] ? lock_acquire+0x1c1/0x220 [ 2781.934903][ C0] ? lock_release+0x1d5/0x250 [ 2781.935158][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2781.935422][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2781.935708][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2781.936007][ C0] ? lock_acquire+0x1c1/0x220 [ 2781.936254][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2781.936505][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2781.936776][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2781.937026][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2781.937288][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2781.937558][ C0] ? __inet_lookup_established+0x341/0x610 [ 2781.937878][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2781.938168][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2781.938458][ C0] ip_local_deliver+0x19d/0x480 [ 2781.938719][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2781.939005][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2781.939273][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2781.939549][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2781.939813][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2781.940150][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2781.940425][ C0] ip_rcv+0x564/0x740 [ 2781.940638][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2781.940878][ C0] ? set_track_prepare+0x8a/0xd0 [ 2781.941144][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2781.941436][ C0] ? rest_init+0x153/0x260 [ 2781.941673][ C0] ? skb_clone+0x10b/0x330 [ 2781.941917][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2781.942251][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2781.942580][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2781.942877][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2781.943185][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2781.943442][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2781.943681][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2781.943993][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2781.944290][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2781.944633][ C0] ? lock_acquire+0x1c1/0x220 [ 2781.944888][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2781.945201][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2781.945498][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2781.945833][ C0] ? __copy_skb_header+0xaf/0x490 [ 2781.946104][ C0] ? __skb_clone+0x57a/0x760 [ 2781.946354][ C0] netif_receive_skb+0x55/0x280 [ 2781.946611][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2781.946938][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2781.947286][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2781.947600][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2781.947886][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2781.948184][ C0] ? hlock_class+0x4e/0x130 [ 2781.948427][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2781.948753][ C0] ? place_entity+0x21/0x2f0 [ 2781.948997][ C0] ? resched_curr+0x219/0x280 [ 2781.949251][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2781.949520][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2781.949805][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2781.950081][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2781.950337][ C0] ? activate_task+0xf5/0x260 [ 2781.950584][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2781.950856][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2781.951132][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2781.951390][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2781.951680][ C0] ? get_stack_info+0x36/0xc0 [ 2781.951933][ C0] ? stack_access_ok+0xda/0x1f0 [ 2781.952192][ C0] ? get_reg+0x119/0x190 [ 2781.952430][ C0] __tcf_classify+0x32c/0x7d0 [ 2781.952686][ C0] tcf_classify+0x283/0x930 [ 2781.952930][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2781.953260][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2781.953525][ C0] ? arch_stack_walk+0x8c/0x100 [ 2781.953787][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2781.954079][ C0] tc_run+0x2e4/0x5d0 [ 2781.954298][ C0] ? __pfx_tc_run+0x10/0x10 [ 2781.954542][ C0] ? lock_acquire+0x1c1/0x220 [ 2781.954793][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2781.955071][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2781.955336][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2781.955624][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2781.955904][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2781.956230][ C0] ? neigh_hh_output+0x348/0x590 [ 2781.956494][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2781.956776][ C0] ip_finish_output2+0x786/0x18e0 [ 2781.957046][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2781.957340][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2781.957690][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2781.957980][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2781.958246][ C0] ? __ip_finish_output+0x10f/0x770 [ 2781.958521][ C0] ip_output+0x16b/0x4f0 [ 2781.958749][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2781.959034][ C0] ? __pfx_ip_output+0x10/0x10 [ 2781.959290][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2781.959593][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2781.959854][ C0] ? ip_local_out+0x114/0x3b0 [ 2781.960109][ C0] __ip_queue_xmit+0x672/0x1910 [ 2781.960374][ C0] ? __skb_clone+0x57a/0x760 [ 2781.960627][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2781.960906][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2781.961199][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2781.961515][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2781.961773][ C0] ? tcp_current_mss+0x40a/0x510 [ 2781.962037][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2781.962320][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2781.962603][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2781.962857][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2781.963123][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2781.963440][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2781.963718][ C0] ? ktime_get+0xb6/0x190 [ 2781.963954][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2781.964231][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2781.964511][ C0] tcp_write_timer+0x82/0x1d0 [ 2781.964765][ C0] call_timer_fn+0x176/0x430 [ 2781.965014][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2781.965286][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2781.965562][ C0] __run_timers.part.0+0x52d/0x890 [ 2781.965832][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2781.966117][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2781.966413][ C0] ? lock_acquire+0x1c1/0x220 [ 2781.966665][ C0] ? clockevents_program_event+0xf6/0x300 [ 2781.966972][ C0] ? lock_release+0x1d5/0x250 [ 2781.967225][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2781.967507][ C0] ? ktime_get+0xb6/0x190 [ 2781.967738][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2781.968041][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2781.968348][ C0] run_timer_softirq+0x72/0x100 [ 2781.968613][ C0] __do_softirq+0x1bc/0x7ff [ 2781.968859][ C0] irq_exit_rcu+0x98/0xc0 [ 2781.969093][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2781.969394][ C0] [ 2781.969549][ C0] [ 2781.969704][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2781.970021][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2781.970292][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2781.971318][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2781.971642][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2781.972071][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2781.972497][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2781.972911][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2781.973325][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2781.973740][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2781.974043][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2781.974317][ C0] default_idle_call+0x69/0xa0 [ 2781.974575][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2781.974836][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2781.975132][ C0] ? lock_release+0x1d5/0x250 [ 2781.975380][ C0] do_idle+0xfb/0x160 [ 2781.975591][ C0] cpu_startup_entry+0x55/0x60 [ 2781.975843][ C0] rest_init+0x153/0x260 [ 2781.976074][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2781.976359][ C0] arch_call_rest_init+0x13/0x40 [ 2781.976623][ C0] start_kernel+0x314/0x3d0 [ 2781.976868][ C0] x86_64_start_reservations+0x18/0x30 [ 2781.977161][ C0] x86_64_start_kernel+0xba/0x110 [ 2781.977427][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2781.977756][ C0] [ 2781.977921][ C0] Sending NMI from CPU 0 to CPUs 1: [ 2781.978211][ C1] NMI backtrace for cpu 1 [ 2781.978220][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2781.978225][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2781.978229][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2781.978238][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2781.978242][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2781.978246][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2781.978248][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2781.978250][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2781.978252][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2781.978254][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2781.978256][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2781.978258][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2781.978262][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2781.978264][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2781.978265][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2781.978267][ C1] Call Trace: [ 2781.978272][ C1] [ 2781.978276][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 2781.978282][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 2781.978287][ C1] ? nmi_handle+0x156/0x420 [ 2781.978293][ C1] ? default_do_nmi+0x41/0x100 [ 2781.978297][ C1] ? exc_nmi+0xf3/0x120 [ 2781.978299][ C1] ? end_repeat_nmi+0xf/0x60 [ 2781.978304][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2781.978308][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2781.978311][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2781.978315][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2781.978318][ C1] [ 2781.978319][ C1] [ 2781.978320][ C1] ? run_ksoftirqd+0xb/0x60 [ 2781.978325][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2781.978328][ C1] ? __orc_find+0x9c/0xf0 [ 2781.978331][ C1] ? lock_acquire+0x1c1/0x220 [ 2781.978336][ C1] ? irqentry_enter+0x2b/0x60 [ 2781.978341][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2781.978345][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2781.978348][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2781.978352][ C1] ? lock_acquire+0x1c1/0x220 [ 2781.978354][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2781.978359][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2781.978363][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2781.978371][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2781.978375][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2781.978381][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2781.978390][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2781.978394][ C1] ip_local_deliver+0x19d/0x480 [ 2781.978397][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2781.978400][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2781.978405][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2781.978409][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2781.978412][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2781.978416][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2781.978425][ C1] ip_rcv+0x564/0x740 [ 2781.978429][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2781.978432][ C1] ? set_track_prepare+0x8a/0xd0 [ 2781.978437][ C1] ? irqentry_enter+0x2b/0x60 [ 2781.978441][ C1] ? irqentry_enter+0x2b/0x60 [ 2781.978445][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2781.978448][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2781.978452][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2781.978456][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2781.978459][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2781.978462][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2781.978465][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2781.978469][ C1] netif_receive_skb+0x55/0x280 [ 2781.978473][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2781.978481][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2781.978488][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2781.978495][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2781.978503][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2781.978514][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2781.978524][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2781.978526][ C1] ? arch_stack_walk+0x68/0x100 [ 2781.978532][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2781.978536][ C1] ? irqentry_enter+0x2b/0x60 [ 2781.978539][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2781.978544][ C1] ? irqentry_enter+0x2b/0x60 [ 2781.978547][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2781.978554][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2781.978557][ C1] ? arch_stack_walk+0x68/0x100 [ 2781.978562][ C1] __tcf_classify+0x32c/0x7d0 [ 2781.978566][ C1] tcf_classify+0x283/0x930 [ 2781.978570][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2781.978575][ C1] tc_run+0x2e4/0x5d0 [ 2781.978579][ C1] ? __pfx_tc_run+0x10/0x10 [ 2781.978584][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2781.978591][ C1] ? irqentry_enter+0x2b/0x60 [ 2781.978594][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2781.978597][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2781.978604][ C1] ip_finish_output2+0x786/0x18e0 [ 2781.978609][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2781.978612][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2781.978616][ C1] ? __ip_finish_output+0x10f/0x770 [ 2781.978620][ C1] ip_output+0x16b/0x4f0 [ 2781.978623][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2781.978627][ C1] ? __pfx_ip_output+0x10/0x10 [ 2781.978631][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2781.978638][ C1] ? __pfx_ip_output+0x10/0x10 [ 2781.978643][ C1] __ip_queue_xmit+0x672/0x1910 [ 2781.978648][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2781.978655][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2781.978659][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2781.978663][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2781.978667][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2781.978670][ C1] tcp_delack_timer+0x84/0x240 [ 2781.978674][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2781.978678][ C1] call_timer_fn+0x176/0x430 [ 2781.978683][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2781.978688][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2781.978692][ C1] __run_timers.part.0+0x52d/0x890 [ 2781.978696][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2781.978700][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2781.978705][ C1] ? __pfx___schedule+0x10/0x10 [ 2781.978709][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2781.978714][ C1] run_timer_softirq+0x72/0x100 [ 2781.978718][ C1] __do_softirq+0x1bc/0x7ff [ 2781.978721][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2781.978725][ C1] run_ksoftirqd+0x2e/0x60 [ 2781.978728][ C1] smpboot_thread_fn+0x30e/0x840 [ 2781.978733][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2781.978736][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2781.978739][ C1] kthread+0x292/0x360 [ 2781.978742][ C1] ? __pfx_kthread+0x10/0x10 [ 2781.978744][ C1] ret_from_fork+0x34/0x70 [ 2781.978747][ C1] ? __pfx_kthread+0x10/0x10 [ 2781.978750][ C1] ret_from_fork_asm+0x1b/0x30 [ 2781.978757][ C1] [ 2808.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1509s! [swapper/0:0] [ 2808.527919][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2808.529121][ C0] irq event stamp: 27567077 [ 2808.529365][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2808.529895][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2808.530368][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2808.530869][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2808.531361][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2808.531839][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2808.532487][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2808.532824][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2808.533837][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2808.534158][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2808.534580][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2808.534996][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2808.535412][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2808.535828][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2808.536245][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2808.536713][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2808.537065][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2808.537492][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2808.537918][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2808.538339][ C0] Call Trace: [ 2808.538519][ C0] [ 2808.538681][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2808.538957][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2808.539218][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2808.539507][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2808.539795][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2808.540099][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2808.540380][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2808.540702][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2808.540979][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2808.541262][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2808.541586][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2808.541894][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2808.542229][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2808.542539][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2808.542851][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2808.543152][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2808.543475][ C0] ? get_stack_info+0x36/0xc0 [ 2808.543731][ C0] ? lock_acquire+0x1c1/0x220 [ 2808.543984][ C0] ? lock_release+0x1d5/0x250 [ 2808.544238][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2808.544500][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2808.544789][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2808.545092][ C0] ? lock_acquire+0x1c1/0x220 [ 2808.545343][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2808.545596][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2808.545868][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2808.546117][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2808.546378][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2808.546650][ C0] ? __inet_lookup_established+0x341/0x610 [ 2808.546968][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2808.547255][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2808.547544][ C0] ip_local_deliver+0x19d/0x480 [ 2808.547808][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2808.548097][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2808.548365][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2808.548640][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2808.548902][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2808.549240][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2808.549513][ C0] ip_rcv+0x564/0x740 [ 2808.549724][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2808.549963][ C0] ? set_track_prepare+0x8a/0xd0 [ 2808.550228][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2808.550517][ C0] ? rest_init+0x153/0x260 [ 2808.550751][ C0] ? skb_clone+0x10b/0x330 [ 2808.550993][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2808.551326][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2808.551644][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2808.551941][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2808.552253][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2808.552518][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2808.552757][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2808.553069][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2808.553366][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2808.553707][ C0] ? lock_acquire+0x1c1/0x220 [ 2808.553958][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2808.554275][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2808.554580][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2808.554914][ C0] ? __copy_skb_header+0xaf/0x490 [ 2808.555188][ C0] ? __skb_clone+0x57a/0x760 [ 2808.555435][ C0] netif_receive_skb+0x55/0x280 [ 2808.555691][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2808.556014][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2808.556361][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2808.556677][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2808.556963][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2808.557262][ C0] ? hlock_class+0x4e/0x130 [ 2808.557505][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2808.557833][ C0] ? place_entity+0x21/0x2f0 [ 2808.558079][ C0] ? resched_curr+0x219/0x280 [ 2808.558333][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2808.558605][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2808.558888][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2808.559166][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2808.559423][ C0] ? activate_task+0xf5/0x260 [ 2808.559674][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2808.559947][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2808.560223][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2808.560479][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2808.560767][ C0] ? get_stack_info+0x36/0xc0 [ 2808.561022][ C0] ? stack_access_ok+0xda/0x1f0 [ 2808.561286][ C0] ? get_reg+0x119/0x190 [ 2808.561514][ C0] __tcf_classify+0x32c/0x7d0 [ 2808.561763][ C0] tcf_classify+0x283/0x930 [ 2808.562002][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2808.562337][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2808.562602][ C0] ? arch_stack_walk+0x8c/0x100 [ 2808.562862][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2808.563153][ C0] tc_run+0x2e4/0x5d0 [ 2808.563371][ C0] ? __pfx_tc_run+0x10/0x10 [ 2808.563617][ C0] ? lock_acquire+0x1c1/0x220 [ 2808.563871][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2808.564147][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2808.564413][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2808.564702][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2808.564982][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2808.565305][ C0] ? neigh_hh_output+0x348/0x590 [ 2808.565568][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2808.565849][ C0] ip_finish_output2+0x786/0x18e0 [ 2808.566122][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2808.566417][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2808.566767][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2808.567056][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2808.567324][ C0] ? __ip_finish_output+0x10f/0x770 [ 2808.567603][ C0] ip_output+0x16b/0x4f0 [ 2808.567829][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2808.568116][ C0] ? __pfx_ip_output+0x10/0x10 [ 2808.568368][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2808.568670][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2808.568933][ C0] ? ip_local_out+0x114/0x3b0 [ 2808.569188][ C0] __ip_queue_xmit+0x672/0x1910 [ 2808.569449][ C0] ? __skb_clone+0x57a/0x760 [ 2808.569697][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2808.569982][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2808.570278][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2808.570598][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2808.570858][ C0] ? tcp_current_mss+0x40a/0x510 [ 2808.571121][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2808.571406][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2808.571681][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2808.571934][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2808.572205][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2808.572532][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2808.572812][ C0] ? ktime_get+0xb6/0x190 [ 2808.573045][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2808.573322][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2808.573602][ C0] tcp_write_timer+0x82/0x1d0 [ 2808.573855][ C0] call_timer_fn+0x176/0x430 [ 2808.574106][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2808.574381][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2808.574658][ C0] __run_timers.part.0+0x52d/0x890 [ 2808.574932][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2808.575220][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2808.575517][ C0] ? lock_acquire+0x1c1/0x220 [ 2808.575769][ C0] ? clockevents_program_event+0xf6/0x300 [ 2808.576079][ C0] ? lock_release+0x1d5/0x250 [ 2808.576332][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2808.576611][ C0] ? ktime_get+0xb6/0x190 [ 2808.576845][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2808.577144][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2808.577453][ C0] run_timer_softirq+0x72/0x100 [ 2808.577714][ C0] __do_softirq+0x1bc/0x7ff [ 2808.577961][ C0] irq_exit_rcu+0x98/0xc0 [ 2808.578196][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2808.578500][ C0] [ 2808.578656][ C0] [ 2808.578812][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2808.579130][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2808.579401][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2808.580425][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2808.580753][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2808.581182][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2808.581606][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2808.582029][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2808.582456][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2808.582875][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2808.583177][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2808.583449][ C0] default_idle_call+0x69/0xa0 [ 2808.583704][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2808.583965][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2808.584259][ C0] ? lock_release+0x1d5/0x250 [ 2808.584510][ C0] do_idle+0xfb/0x160 [ 2808.584724][ C0] cpu_startup_entry+0x55/0x60 [ 2808.584979][ C0] rest_init+0x153/0x260 [ 2808.585211][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2808.585500][ C0] arch_call_rest_init+0x13/0x40 [ 2808.585766][ C0] start_kernel+0x314/0x3d0 [ 2808.586020][ C0] x86_64_start_reservations+0x18/0x30 [ 2808.586317][ C0] x86_64_start_kernel+0xba/0x110 [ 2808.586584][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2808.586909][ C0] [ 2808.587074][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1509s! [ksoftirqd/1:22] [ 2808.587547][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2808.588739][ C1] irq event stamp: 3886976 [ 2808.588975][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2808.589478][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2808.589975][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2808.590479][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2808.590968][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2808.591466][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2808.592121][ C1] RIP: 0010:kasan_check_range+0x69/0x1c0 [ 2808.592429][ C1] Code: 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 <48> c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 [ 2808.593459][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000212 [ 2808.593788][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2808.594212][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2808.594635][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffff88800a098e1b [ 2808.595060][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2808.595486][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2808.595908][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2808.596380][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2808.596727][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2808.597150][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2808.597568][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2808.597986][ C1] Call Trace: [ 2808.598166][ C1] [ 2808.598321][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2808.598602][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2808.598855][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2808.599149][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2808.599433][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2808.599733][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2808.600014][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2808.600335][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2808.600614][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2808.600938][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2808.601247][ C1] [ 2808.601406][ C1] [ 2808.601566][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2808.601903][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2808.602208][ C1] ? kasan_check_range+0x69/0x1c0 [ 2808.602484][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 2808.602784][ C1] ? run_ksoftirqd+0xb/0x60 [ 2808.603032][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2808.603363][ C1] ? __orc_find+0x9c/0xf0 [ 2808.603593][ C1] ? lock_acquire+0x1c1/0x220 [ 2808.603844][ C1] ? irqentry_enter+0x2b/0x60 [ 2808.604095][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2808.604356][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2808.604645][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2808.604946][ C1] ? lock_acquire+0x1c1/0x220 [ 2808.605200][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2808.605457][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2808.605734][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2808.605980][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2808.606241][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2808.606513][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2808.606801][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2808.607091][ C1] ip_local_deliver+0x19d/0x480 [ 2808.607353][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2808.607644][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2808.607915][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2808.608195][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2808.608459][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2808.608800][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2808.609076][ C1] ip_rcv+0x564/0x740 [ 2808.609291][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2808.609537][ C1] ? set_track_prepare+0x8a/0xd0 [ 2808.609804][ C1] ? irqentry_enter+0x2b/0x60 [ 2808.610059][ C1] ? irqentry_enter+0x2b/0x60 [ 2808.610314][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2808.610561][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2808.610880][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2808.611226][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2808.611541][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2808.611880][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2808.612180][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2808.612520][ C1] netif_receive_skb+0x55/0x280 [ 2808.612780][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2808.613108][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2808.613456][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2808.613773][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2808.614063][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2808.614365][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2808.614692][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2808.614973][ C1] ? arch_stack_walk+0x68/0x100 [ 2808.615240][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2808.615520][ C1] ? irqentry_enter+0x2b/0x60 [ 2808.615775][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2808.616103][ C1] ? irqentry_enter+0x2b/0x60 [ 2808.616355][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2808.616677][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2808.616961][ C1] ? arch_stack_walk+0x68/0x100 [ 2808.617222][ C1] __tcf_classify+0x32c/0x7d0 [ 2808.617472][ C1] tcf_classify+0x283/0x930 [ 2808.617714][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2808.617984][ C1] tc_run+0x2e4/0x5d0 [ 2808.618202][ C1] ? __pfx_tc_run+0x10/0x10 [ 2808.618450][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2808.618718][ C1] ? irqentry_enter+0x2b/0x60 [ 2808.618972][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2808.619263][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2808.619591][ C1] ip_finish_output2+0x786/0x18e0 [ 2808.619862][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2808.620152][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2808.620420][ C1] ? __ip_finish_output+0x10f/0x770 [ 2808.620697][ C1] ip_output+0x16b/0x4f0 [ 2808.620926][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2808.621253][ C1] ? __pfx_ip_output+0x10/0x10 [ 2808.621511][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2808.621867][ C1] ? __pfx_ip_output+0x10/0x10 [ 2808.622126][ C1] __ip_queue_xmit+0x672/0x1910 [ 2808.622393][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2808.622679][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2808.622978][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2808.623271][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2808.623573][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2808.623864][ C1] tcp_delack_timer+0x84/0x240 [ 2808.624126][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2808.624413][ C1] call_timer_fn+0x176/0x430 [ 2808.624664][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2808.624942][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2808.625220][ C1] __run_timers.part.0+0x52d/0x890 [ 2808.625495][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2808.625788][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2808.626095][ C1] ? __pfx___schedule+0x10/0x10 [ 2808.626352][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2808.626672][ C1] run_timer_softirq+0x72/0x100 [ 2808.626935][ C1] __do_softirq+0x1bc/0x7ff [ 2808.627183][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2808.627461][ C1] run_ksoftirqd+0x2e/0x60 [ 2808.627699][ C1] smpboot_thread_fn+0x30e/0x840 [ 2808.627969][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2808.628264][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2808.628559][ C1] kthread+0x292/0x360 [ 2808.628776][ C1] ? __pfx_kthread+0x10/0x10 [ 2808.629025][ C1] ret_from_fork+0x34/0x70 [ 2808.629265][ C1] ? __pfx_kthread+0x10/0x10 [ 2808.629519][ C1] ret_from_fork_asm+0x1b/0x30 [ 2808.629781][ C1] [ 2836.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1535s! [swapper/0:0] [ 2836.527932][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2836.529131][ C0] irq event stamp: 27567077 [ 2836.529373][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2836.529907][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2836.530378][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2836.530880][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2836.531376][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2836.531854][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2836.532506][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2836.532844][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2836.533860][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2836.534184][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2836.534602][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2836.535021][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2836.535440][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2836.535857][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2836.536278][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2836.536745][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2836.537097][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2836.537516][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2836.537936][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2836.538360][ C0] Call Trace: [ 2836.538546][ C0] [ 2836.538703][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2836.538978][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2836.539236][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2836.539524][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2836.539813][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2836.540119][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2836.540400][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2836.540721][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2836.540992][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2836.541271][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2836.541591][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2836.541900][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2836.542237][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2836.542548][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2836.542860][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2836.543162][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2836.543488][ C0] ? get_stack_info+0x36/0xc0 [ 2836.543747][ C0] ? lock_acquire+0x1c1/0x220 [ 2836.544003][ C0] ? lock_release+0x1d5/0x250 [ 2836.544259][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2836.544525][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2836.544812][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2836.545111][ C0] ? lock_acquire+0x1c1/0x220 [ 2836.545358][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2836.545610][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2836.545880][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2836.546132][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2836.546393][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2836.546668][ C0] ? __inet_lookup_established+0x341/0x610 [ 2836.546984][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2836.547276][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2836.547565][ C0] ip_local_deliver+0x19d/0x480 [ 2836.547826][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2836.548118][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2836.548387][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2836.548663][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2836.548925][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2836.549263][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2836.549540][ C0] ip_rcv+0x564/0x740 [ 2836.549753][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2836.549992][ C0] ? set_track_prepare+0x8a/0xd0 [ 2836.550257][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2836.550549][ C0] ? rest_init+0x153/0x260 [ 2836.550785][ C0] ? skb_clone+0x10b/0x330 [ 2836.551028][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2836.551362][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2836.551684][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2836.551984][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2836.552300][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2836.552557][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2836.552798][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2836.553110][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2836.553406][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2836.553748][ C0] ? lock_acquire+0x1c1/0x220 [ 2836.553999][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2836.554311][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2836.554607][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2836.554941][ C0] ? __copy_skb_header+0xaf/0x490 [ 2836.555212][ C0] ? __skb_clone+0x57a/0x760 [ 2836.555461][ C0] netif_receive_skb+0x55/0x280 [ 2836.555718][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2836.556044][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2836.556394][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2836.556710][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2836.556995][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2836.557293][ C0] ? hlock_class+0x4e/0x130 [ 2836.557537][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2836.557862][ C0] ? place_entity+0x21/0x2f0 [ 2836.558107][ C0] ? resched_curr+0x219/0x280 [ 2836.558365][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2836.558634][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2836.558917][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2836.559192][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2836.559446][ C0] ? activate_task+0xf5/0x260 [ 2836.559693][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2836.559966][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2836.560242][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2836.560500][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2836.560789][ C0] ? get_stack_info+0x36/0xc0 [ 2836.561043][ C0] ? stack_access_ok+0xda/0x1f0 [ 2836.561302][ C0] ? get_reg+0x119/0x190 [ 2836.561532][ C0] __tcf_classify+0x32c/0x7d0 [ 2836.561783][ C0] tcf_classify+0x283/0x930 [ 2836.562025][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2836.562356][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2836.562621][ C0] ? arch_stack_walk+0x8c/0x100 [ 2836.562879][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2836.563167][ C0] tc_run+0x2e4/0x5d0 [ 2836.563387][ C0] ? __pfx_tc_run+0x10/0x10 [ 2836.563630][ C0] ? lock_acquire+0x1c1/0x220 [ 2836.563882][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2836.564159][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2836.564425][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2836.564711][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2836.564991][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2836.565315][ C0] ? neigh_hh_output+0x348/0x590 [ 2836.565578][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2836.565860][ C0] ip_finish_output2+0x786/0x18e0 [ 2836.566130][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2836.566423][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2836.566774][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2836.567065][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2836.567330][ C0] ? __ip_finish_output+0x10f/0x770 [ 2836.567604][ C0] ip_output+0x16b/0x4f0 [ 2836.567831][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2836.568117][ C0] ? __pfx_ip_output+0x10/0x10 [ 2836.568372][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2836.568672][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2836.568934][ C0] ? ip_local_out+0x114/0x3b0 [ 2836.569189][ C0] __ip_queue_xmit+0x672/0x1910 [ 2836.569454][ C0] ? __skb_clone+0x57a/0x760 [ 2836.569704][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2836.569982][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2836.570276][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2836.570594][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2836.570851][ C0] ? tcp_current_mss+0x40a/0x510 [ 2836.571113][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2836.571397][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2836.571670][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2836.571921][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2836.572199][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2836.572515][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2836.572797][ C0] ? ktime_get+0xb6/0x190 [ 2836.573031][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2836.573305][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2836.573584][ C0] tcp_write_timer+0x82/0x1d0 [ 2836.573839][ C0] call_timer_fn+0x176/0x430 [ 2836.574087][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2836.574358][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2836.574633][ C0] __run_timers.part.0+0x52d/0x890 [ 2836.574903][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2836.575185][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2836.575480][ C0] ? lock_acquire+0x1c1/0x220 [ 2836.575733][ C0] ? clockevents_program_event+0xf6/0x300 [ 2836.576040][ C0] ? lock_release+0x1d5/0x250 [ 2836.576291][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2836.576569][ C0] ? ktime_get+0xb6/0x190 [ 2836.576801][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2836.577103][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2836.577409][ C0] run_timer_softirq+0x72/0x100 [ 2836.577670][ C0] __do_softirq+0x1bc/0x7ff [ 2836.577915][ C0] irq_exit_rcu+0x98/0xc0 [ 2836.578149][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2836.578448][ C0] [ 2836.578604][ C0] [ 2836.578759][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2836.579080][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2836.579350][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2836.580368][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2836.580690][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2836.581114][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2836.581537][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2836.581956][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2836.582380][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2836.582798][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2836.583099][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2836.583372][ C0] default_idle_call+0x69/0xa0 [ 2836.583629][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2836.583891][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2836.584187][ C0] ? lock_release+0x1d5/0x250 [ 2836.584436][ C0] do_idle+0xfb/0x160 [ 2836.584647][ C0] cpu_startup_entry+0x55/0x60 [ 2836.584899][ C0] rest_init+0x153/0x260 [ 2836.585129][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2836.585416][ C0] arch_call_rest_init+0x13/0x40 [ 2836.585680][ C0] start_kernel+0x314/0x3d0 [ 2836.585926][ C0] x86_64_start_reservations+0x18/0x30 [ 2836.586224][ C0] x86_64_start_kernel+0xba/0x110 [ 2836.586491][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2836.586819][ C0] [ 2836.586984][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1535s! [ksoftirqd/1:22] [ 2836.587462][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2836.588655][ C1] irq event stamp: 3886976 [ 2836.588890][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2836.589390][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2836.589888][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2836.590390][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2836.590879][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2836.591380][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2836.592031][ C1] RIP: 0010:kasan_check_range+0x1b/0x1c0 [ 2836.592339][ C1] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 53 <72> 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 23 [ 2836.593365][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000282 [ 2836.593694][ C1] RAX: ffff88800a098e1c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2836.594117][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2836.594538][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2836.594963][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2836.595391][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2836.595813][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2836.596285][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2836.596633][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2836.597056][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2836.597475][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2836.597893][ C1] Call Trace: [ 2836.598074][ C1] [ 2836.598229][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2836.598509][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2836.598763][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2836.599056][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2836.599339][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2836.599641][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2836.599921][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2836.600241][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2836.600519][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2836.600843][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2836.601158][ C1] [ 2836.601318][ C1] [ 2836.601476][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2836.601813][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2836.602117][ C1] ? kasan_check_range+0x1b/0x1c0 [ 2836.602397][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 2836.602696][ C1] ? run_ksoftirqd+0xb/0x60 [ 2836.602945][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2836.603277][ C1] ? __orc_find+0x9c/0xf0 [ 2836.603508][ C1] ? lock_acquire+0x1c1/0x220 [ 2836.603757][ C1] ? irqentry_enter+0x2b/0x60 [ 2836.604007][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2836.604269][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2836.604555][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2836.604857][ C1] ? lock_acquire+0x1c1/0x220 [ 2836.605112][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2836.605367][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2836.605644][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2836.605890][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2836.606151][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2836.606422][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2836.606710][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2836.606999][ C1] ip_local_deliver+0x19d/0x480 [ 2836.607263][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2836.607555][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2836.607826][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2836.608111][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2836.608375][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2836.608716][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2836.608990][ C1] ip_rcv+0x564/0x740 [ 2836.609206][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2836.609448][ C1] ? set_track_prepare+0x8a/0xd0 [ 2836.609714][ C1] ? irqentry_enter+0x2b/0x60 [ 2836.609967][ C1] ? irqentry_enter+0x2b/0x60 [ 2836.610222][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2836.610469][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2836.610784][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2836.611131][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2836.611445][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2836.611787][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2836.612085][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2836.612422][ C1] netif_receive_skb+0x55/0x280 [ 2836.612679][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2836.613004][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2836.613354][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2836.613668][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2836.613956][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2836.614258][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2836.614585][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2836.614865][ C1] ? arch_stack_walk+0x68/0x100 [ 2836.615130][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2836.615410][ C1] ? irqentry_enter+0x2b/0x60 [ 2836.615664][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2836.615988][ C1] ? irqentry_enter+0x2b/0x60 [ 2836.616240][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2836.616561][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2836.616844][ C1] ? arch_stack_walk+0x68/0x100 [ 2836.617104][ C1] __tcf_classify+0x32c/0x7d0 [ 2836.617354][ C1] tcf_classify+0x283/0x930 [ 2836.617595][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2836.617864][ C1] tc_run+0x2e4/0x5d0 [ 2836.618081][ C1] ? __pfx_tc_run+0x10/0x10 [ 2836.618327][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2836.618593][ C1] ? irqentry_enter+0x2b/0x60 [ 2836.618846][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2836.619136][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2836.619464][ C1] ip_finish_output2+0x786/0x18e0 [ 2836.619734][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2836.620021][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2836.620289][ C1] ? __ip_finish_output+0x10f/0x770 [ 2836.620566][ C1] ip_output+0x16b/0x4f0 [ 2836.620793][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2836.621118][ C1] ? __pfx_ip_output+0x10/0x10 [ 2836.621375][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2836.621729][ C1] ? __pfx_ip_output+0x10/0x10 [ 2836.621986][ C1] __ip_queue_xmit+0x672/0x1910 [ 2836.622253][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2836.622538][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2836.622836][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2836.623128][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2836.623429][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2836.623719][ C1] tcp_delack_timer+0x84/0x240 [ 2836.623979][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2836.624266][ C1] call_timer_fn+0x176/0x430 [ 2836.624515][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2836.624792][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2836.625071][ C1] __run_timers.part.0+0x52d/0x890 [ 2836.625344][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2836.625635][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2836.625939][ C1] ? __pfx___schedule+0x10/0x10 [ 2836.626196][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2836.626516][ C1] run_timer_softirq+0x72/0x100 [ 2836.626779][ C1] __do_softirq+0x1bc/0x7ff [ 2836.627025][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2836.627302][ C1] run_ksoftirqd+0x2e/0x60 [ 2836.627543][ C1] smpboot_thread_fn+0x30e/0x840 [ 2836.627811][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2836.628104][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2836.628396][ C1] kthread+0x292/0x360 [ 2836.628614][ C1] ? __pfx_kthread+0x10/0x10 [ 2836.628863][ C1] ret_from_fork+0x34/0x70 [ 2836.629102][ C1] ? __pfx_kthread+0x10/0x10 [ 2836.629352][ C1] ret_from_fork_asm+0x1b/0x30 [ 2836.629612][ C1] [ 2859.982024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 2859.982404][ C1] rcu: 1-....: (1662326 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=402050 [ 2859.982989][ C1] rcu: (t=1665673 jiffies g=1007429 q=31 ncpus=4) [ 2859.983334][ C1] Sending NMI from CPU 1 to CPUs 0: [ 2859.983624][ C0] NMI backtrace for cpu 0 [ 2859.983632][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2859.983637][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2859.983640][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 2859.983649][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 2859.983653][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2859.983657][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2859.983659][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2859.983661][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2859.983662][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2859.983664][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2859.983666][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2859.983668][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2859.983672][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2859.983674][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2859.983675][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2859.983677][ C0] Call Trace: [ 2859.983681][ C0] [ 2859.983685][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 2859.983691][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 2859.983696][ C0] ? nmi_handle+0x156/0x420 [ 2859.983701][ C0] ? default_do_nmi+0x41/0x100 [ 2859.983705][ C0] ? exc_nmi+0xf3/0x120 [ 2859.983708][ C0] ? end_repeat_nmi+0xf/0x60 [ 2859.983712][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2859.983716][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 2859.983719][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 2859.983723][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 2859.983726][ C0] [ 2859.983727][ C0] [ 2859.983729][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2859.983732][ C0] ? get_stack_info+0x36/0xc0 [ 2859.983737][ C0] ? lock_acquire+0x1c1/0x220 [ 2859.983742][ C0] ? lock_release+0x1d5/0x250 [ 2859.983746][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2859.983750][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2859.983753][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2859.983756][ C0] ? lock_acquire+0x1c1/0x220 [ 2859.983758][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2859.983765][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2859.983768][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2859.983776][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2859.983779][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2859.983783][ C0] ? __inet_lookup_established+0x341/0x610 [ 2859.983789][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2859.983797][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2859.983801][ C0] ip_local_deliver+0x19d/0x480 [ 2859.983805][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2859.983807][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2859.983812][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2859.983816][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2859.983819][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2859.983823][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2859.983833][ C0] ip_rcv+0x564/0x740 [ 2859.983837][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2859.983840][ C0] ? set_track_prepare+0x8a/0xd0 [ 2859.983845][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2859.983848][ C0] ? rest_init+0x153/0x260 [ 2859.983850][ C0] ? skb_clone+0x10b/0x330 [ 2859.983856][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2859.983862][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2859.983867][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2859.983872][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2859.983881][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2859.983884][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2859.983887][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2859.983891][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2859.983894][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2859.983898][ C0] ? lock_acquire+0x1c1/0x220 [ 2859.983900][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2859.983904][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2859.983907][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2859.983910][ C0] ? __copy_skb_header+0xaf/0x490 [ 2859.983913][ C0] ? __skb_clone+0x57a/0x760 [ 2859.983915][ C0] netif_receive_skb+0x55/0x280 [ 2859.983918][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2859.983927][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2859.983934][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2859.983940][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2859.983946][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2859.983954][ C0] ? hlock_class+0x4e/0x130 [ 2859.983960][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2859.983970][ C0] ? place_entity+0x21/0x2f0 [ 2859.983973][ C0] ? resched_curr+0x219/0x280 [ 2859.983976][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2859.983979][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2859.983982][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2859.983988][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2859.983990][ C0] ? activate_task+0xf5/0x260 [ 2859.983993][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2859.983998][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2859.984002][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2859.984005][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2859.984008][ C0] ? get_stack_info+0x36/0xc0 [ 2859.984012][ C0] ? stack_access_ok+0xda/0x1f0 [ 2859.984014][ C0] ? get_reg+0x119/0x190 [ 2859.984018][ C0] __tcf_classify+0x32c/0x7d0 [ 2859.984023][ C0] tcf_classify+0x283/0x930 [ 2859.984026][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2859.984032][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2859.984034][ C0] ? arch_stack_walk+0x8c/0x100 [ 2859.984039][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2859.984043][ C0] tc_run+0x2e4/0x5d0 [ 2859.984047][ C0] ? __pfx_tc_run+0x10/0x10 [ 2859.984050][ C0] ? lock_acquire+0x1c1/0x220 [ 2859.984053][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2859.984057][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2859.984063][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2859.984066][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2859.984070][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2859.984075][ C0] ? neigh_hh_output+0x348/0x590 [ 2859.984079][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2859.984083][ C0] ip_finish_output2+0x786/0x18e0 [ 2859.984086][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2859.984092][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2859.984100][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2859.984102][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2859.984106][ C0] ? __ip_finish_output+0x10f/0x770 [ 2859.984110][ C0] ip_output+0x16b/0x4f0 [ 2859.984114][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2859.984118][ C0] ? __pfx_ip_output+0x10/0x10 [ 2859.984122][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2859.984126][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2859.984129][ C0] ? ip_local_out+0x114/0x3b0 [ 2859.984133][ C0] __ip_queue_xmit+0x672/0x1910 [ 2859.984137][ C0] ? __skb_clone+0x57a/0x760 [ 2859.984141][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2859.984148][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2859.984152][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2859.984156][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2859.984162][ C0] ? tcp_current_mss+0x40a/0x510 [ 2859.984165][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2859.984168][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2859.984170][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2859.984173][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2859.984176][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2859.984179][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2859.984184][ C0] ? ktime_get+0xb6/0x190 [ 2859.984188][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2859.984192][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2859.984195][ C0] tcp_write_timer+0x82/0x1d0 [ 2859.984199][ C0] call_timer_fn+0x176/0x430 [ 2859.984203][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2859.984208][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2859.984212][ C0] __run_timers.part.0+0x52d/0x890 [ 2859.984215][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2859.984220][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2859.984223][ C0] ? lock_acquire+0x1c1/0x220 [ 2859.984226][ C0] ? clockevents_program_event+0xf6/0x300 [ 2859.984231][ C0] ? lock_release+0x1d5/0x250 [ 2859.984234][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2859.984237][ C0] ? ktime_get+0xb6/0x190 [ 2859.984240][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2859.984244][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2859.984249][ C0] run_timer_softirq+0x72/0x100 [ 2859.984252][ C0] __do_softirq+0x1bc/0x7ff [ 2859.984257][ C0] irq_exit_rcu+0x98/0xc0 [ 2859.984260][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2859.984264][ C0] [ 2859.984265][ C0] [ 2859.984266][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2859.984273][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2859.984276][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2859.984278][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2859.984280][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2859.984282][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2859.984284][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2859.984285][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2859.984287][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2859.984291][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2859.984294][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2859.984298][ C0] default_idle_call+0x69/0xa0 [ 2859.984301][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2859.984303][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2859.984308][ C0] ? lock_release+0x1d5/0x250 [ 2859.984312][ C0] do_idle+0xfb/0x160 [ 2859.984316][ C0] cpu_startup_entry+0x55/0x60 [ 2859.984318][ C0] rest_init+0x153/0x260 [ 2859.984320][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2859.984326][ C0] arch_call_rest_init+0x13/0x40 [ 2859.984332][ C0] start_kernel+0x314/0x3d0 [ 2859.984335][ C0] x86_64_start_reservations+0x18/0x30 [ 2859.984340][ C0] x86_64_start_kernel+0xba/0x110 [ 2859.984344][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2859.984352][ C0] [ 2859.984621][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2860.038877][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2860.039535][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 2860.039837][ C1] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 2860.040867][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [ 2860.041200][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2860.041624][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2860.042054][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2860.042474][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2860.042895][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2860.043317][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2860.043786][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2860.044145][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2860.044569][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2860.044990][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2860.045415][ C1] Call Trace: [ 2860.045599][ C1] [ 2860.045758][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 2860.046045][ C1] ? print_cpu_stall+0x263/0x6a0 [ 2860.046314][ C1] ? check_cpu_stall+0x284/0x500 [ 2860.046578][ C1] ? rcu_pending+0x92/0x360 [ 2860.046824][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 2860.047113][ C1] ? update_process_times+0xb9/0x110 [ 2860.047395][ C1] ? tick_sched_handle+0x67/0x130 [ 2860.047672][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 2860.047973][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2860.048228][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 2860.048557][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2860.048841][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2860.049144][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2860.049423][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2860.049740][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2860.050018][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2860.050342][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2860.050650][ C1] [ 2860.050809][ C1] [ 2860.050968][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2860.051305][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2860.051608][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 2860.051902][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 2860.052205][ C1] ? run_ksoftirqd+0xb/0x60 [ 2860.052454][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2860.052781][ C1] ? __orc_find+0x9c/0xf0 [ 2860.053010][ C1] ? lock_acquire+0x1c1/0x220 [ 2860.053262][ C1] ? irqentry_enter+0x2b/0x60 [ 2860.053511][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2860.053768][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2860.054052][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2860.054352][ C1] ? lock_acquire+0x1c1/0x220 [ 2860.054607][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2860.054865][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2860.055141][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2860.055385][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2860.055641][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2860.055911][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2860.056203][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2860.056494][ C1] ip_local_deliver+0x19d/0x480 [ 2860.056756][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2860.057044][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2860.057313][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2860.057589][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2860.057853][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2860.058197][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2860.058471][ C1] ip_rcv+0x564/0x740 [ 2860.058685][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2860.058926][ C1] ? set_track_prepare+0x8a/0xd0 [ 2860.059195][ C1] ? irqentry_enter+0x2b/0x60 [ 2860.059451][ C1] ? irqentry_enter+0x2b/0x60 [ 2860.059711][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2860.059956][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2860.060275][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2860.060618][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2860.060935][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2860.061276][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2860.061573][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2860.061910][ C1] netif_receive_skb+0x55/0x280 [ 2860.062179][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2860.062508][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2860.062857][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2860.063175][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2860.063465][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2860.063767][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2860.064098][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2860.064380][ C1] ? arch_stack_walk+0x68/0x100 [ 2860.064643][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2860.064924][ C1] ? irqentry_enter+0x2b/0x60 [ 2860.065181][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2860.065501][ C1] ? irqentry_enter+0x2b/0x60 [ 2860.065749][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2860.066071][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2860.066358][ C1] ? arch_stack_walk+0x68/0x100 [ 2860.066616][ C1] __tcf_classify+0x32c/0x7d0 [ 2860.066867][ C1] tcf_classify+0x283/0x930 [ 2860.067110][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2860.067378][ C1] tc_run+0x2e4/0x5d0 [ 2860.067594][ C1] ? __pfx_tc_run+0x10/0x10 [ 2860.067836][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2860.068103][ C1] ? irqentry_enter+0x2b/0x60 [ 2860.068358][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2860.068649][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2860.068971][ C1] ip_finish_output2+0x786/0x18e0 [ 2860.069242][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2860.069532][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2860.069797][ C1] ? __ip_finish_output+0x10f/0x770 [ 2860.070074][ C1] ip_output+0x16b/0x4f0 [ 2860.070302][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2860.070621][ C1] ? __pfx_ip_output+0x10/0x10 [ 2860.070875][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2860.071232][ C1] ? __pfx_ip_output+0x10/0x10 [ 2860.071489][ C1] __ip_queue_xmit+0x672/0x1910 [ 2860.071747][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2860.072029][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2860.072330][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2860.072618][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2860.072921][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2860.073211][ C1] tcp_delack_timer+0x84/0x240 [ 2860.073471][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2860.073756][ C1] call_timer_fn+0x176/0x430 [ 2860.074005][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2860.074286][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2860.074563][ C1] __run_timers.part.0+0x52d/0x890 [ 2860.074834][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2860.075126][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2860.075431][ C1] ? __pfx___schedule+0x10/0x10 [ 2860.075691][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2860.076013][ C1] run_timer_softirq+0x72/0x100 [ 2860.076277][ C1] __do_softirq+0x1bc/0x7ff [ 2860.076524][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2860.076800][ C1] run_ksoftirqd+0x2e/0x60 [ 2860.077037][ C1] smpboot_thread_fn+0x30e/0x840 [ 2860.077305][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2860.077594][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2860.077888][ C1] kthread+0x292/0x360 [ 2860.078107][ C1] ? __pfx_kthread+0x10/0x10 [ 2860.078356][ C1] ret_from_fork+0x34/0x70 [ 2860.078593][ C1] ? __pfx_kthread+0x10/0x10 [ 2860.078841][ C1] ret_from_fork_asm+0x1b/0x30 [ 2860.079101][ C1] [ 2884.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1580s! [swapper/0:0] [ 2884.527914][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2884.529102][ C0] irq event stamp: 27567077 [ 2884.529340][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2884.529868][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2884.530350][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2884.530861][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2884.531361][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2884.531845][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2884.532501][ C0] RIP: 0010:kasan_check_range+0x54/0x1c0 [ 2884.532806][ C0] Code: ff fe 48 39 c7 77 23 44 89 c2 e8 57 e8 ff ff 83 f0 01 5b 5d 41 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd <4c> 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 [ 2884.533826][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000216 [ 2884.534151][ C0] RAX: ffff7fffffffffff RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2884.534570][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2884.534986][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2884.535403][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2884.535824][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2884.536240][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2884.536708][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2884.537060][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2884.537478][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2884.537898][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2884.538325][ C0] Call Trace: [ 2884.538510][ C0] [ 2884.538666][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2884.538947][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2884.539205][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2884.539494][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2884.539783][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2884.540090][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2884.540373][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2884.540696][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2884.540968][ C0] ? hrtimer_interrupt+0x31a/0x770 [ 2884.541244][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2884.541521][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2884.541850][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2884.542174][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2884.542510][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2884.542812][ C0] ? kasan_check_range+0x54/0x1c0 [ 2884.543082][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 2884.543374][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2884.543699][ C0] ? get_stack_info+0x36/0xc0 [ 2884.543954][ C0] ? lock_acquire+0x1c1/0x220 [ 2884.544208][ C0] ? lock_release+0x1d5/0x250 [ 2884.544461][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2884.544724][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2884.545013][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2884.545317][ C0] ? lock_acquire+0x1c1/0x220 [ 2884.545566][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2884.545817][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2884.546090][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2884.546339][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2884.546600][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2884.546874][ C0] ? __inet_lookup_established+0x341/0x610 [ 2884.547189][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2884.547477][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2884.547766][ C0] ip_local_deliver+0x19d/0x480 [ 2884.548032][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2884.548321][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2884.548589][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2884.548869][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2884.549132][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2884.549471][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2884.549744][ C0] ip_rcv+0x564/0x740 [ 2884.549956][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2884.550197][ C0] ? set_track_prepare+0x8a/0xd0 [ 2884.550461][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2884.550750][ C0] ? rest_init+0x153/0x260 [ 2884.550985][ C0] ? skb_clone+0x10b/0x330 [ 2884.551228][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2884.551561][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2884.551879][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2884.552186][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2884.552494][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2884.552753][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2884.552993][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2884.553306][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2884.553604][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2884.553946][ C0] ? lock_acquire+0x1c1/0x220 [ 2884.554198][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2884.554510][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2884.554817][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2884.555150][ C0] ? __copy_skb_header+0xaf/0x490 [ 2884.555420][ C0] ? __skb_clone+0x57a/0x760 [ 2884.555668][ C0] netif_receive_skb+0x55/0x280 [ 2884.555923][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2884.556249][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2884.556597][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2884.556915][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2884.557202][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2884.557501][ C0] ? hlock_class+0x4e/0x130 [ 2884.557746][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2884.558075][ C0] ? place_entity+0x21/0x2f0 [ 2884.558321][ C0] ? resched_curr+0x219/0x280 [ 2884.558575][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2884.558846][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2884.559130][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2884.559408][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2884.559667][ C0] ? activate_task+0xf5/0x260 [ 2884.559918][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2884.560192][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2884.560467][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2884.560723][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2884.561010][ C0] ? get_stack_info+0x36/0xc0 [ 2884.561265][ C0] ? stack_access_ok+0xda/0x1f0 [ 2884.561531][ C0] ? get_reg+0x119/0x190 [ 2884.561759][ C0] __tcf_classify+0x32c/0x7d0 [ 2884.562015][ C0] tcf_classify+0x283/0x930 [ 2884.562260][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2884.562591][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2884.562857][ C0] ? arch_stack_walk+0x8c/0x100 [ 2884.563118][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2884.563409][ C0] tc_run+0x2e4/0x5d0 [ 2884.563627][ C0] ? __pfx_tc_run+0x10/0x10 [ 2884.563874][ C0] ? lock_acquire+0x1c1/0x220 [ 2884.564129][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2884.564405][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2884.564671][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2884.564961][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2884.565243][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2884.565565][ C0] ? neigh_hh_output+0x348/0x590 [ 2884.565829][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2884.566111][ C0] ip_finish_output2+0x786/0x18e0 [ 2884.566386][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2884.566683][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2884.567034][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2884.567322][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2884.567593][ C0] ? __ip_finish_output+0x10f/0x770 [ 2884.567871][ C0] ip_output+0x16b/0x4f0 [ 2884.568098][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2884.568386][ C0] ? __pfx_ip_output+0x10/0x10 [ 2884.568641][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2884.568945][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2884.569209][ C0] ? ip_local_out+0x114/0x3b0 [ 2884.569464][ C0] __ip_queue_xmit+0x672/0x1910 [ 2884.569726][ C0] ? __skb_clone+0x57a/0x760 [ 2884.569976][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2884.570260][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2884.570554][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2884.570875][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2884.571136][ C0] ? tcp_current_mss+0x40a/0x510 [ 2884.571404][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2884.571686][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2884.571971][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2884.572229][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2884.572495][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2884.572811][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2884.573091][ C0] ? ktime_get+0xb6/0x190 [ 2884.573323][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2884.573599][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2884.573878][ C0] tcp_write_timer+0x82/0x1d0 [ 2884.574132][ C0] call_timer_fn+0x176/0x430 [ 2884.574381][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2884.574653][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2884.574930][ C0] __run_timers.part.0+0x52d/0x890 [ 2884.575201][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2884.575486][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2884.575783][ C0] ? lock_acquire+0x1c1/0x220 [ 2884.576035][ C0] ? clockevents_program_event+0xf6/0x300 [ 2884.576340][ C0] ? lock_release+0x1d5/0x250 [ 2884.576593][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2884.576873][ C0] ? ktime_get+0xb6/0x190 [ 2884.577107][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2884.577406][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2884.577714][ C0] run_timer_softirq+0x72/0x100 [ 2884.577976][ C0] __do_softirq+0x1bc/0x7ff [ 2884.578224][ C0] irq_exit_rcu+0x98/0xc0 [ 2884.578455][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2884.578758][ C0] [ 2884.578916][ C0] [ 2884.579074][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2884.579392][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2884.579669][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2884.580692][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2884.581024][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2884.581444][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2884.581865][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2884.582292][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2884.582707][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2884.583127][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2884.583429][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2884.583700][ C0] default_idle_call+0x69/0xa0 [ 2884.583957][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2884.584218][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2884.584514][ C0] ? lock_release+0x1d5/0x250 [ 2884.584765][ C0] do_idle+0xfb/0x160 [ 2884.584979][ C0] cpu_startup_entry+0x55/0x60 [ 2884.585236][ C0] rest_init+0x153/0x260 [ 2884.585463][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2884.585753][ C0] arch_call_rest_init+0x13/0x40 [ 2884.586018][ C0] start_kernel+0x314/0x3d0 [ 2884.586265][ C0] x86_64_start_reservations+0x18/0x30 [ 2884.586560][ C0] x86_64_start_kernel+0xba/0x110 [ 2884.586826][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2884.587151][ C0] [ 2884.587316][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1580s! [ksoftirqd/1:22] [ 2884.587786][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2884.588997][ C1] irq event stamp: 3886976 [ 2884.589237][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2884.589734][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2884.590229][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2884.590728][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2884.591222][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2884.591716][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2884.592363][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 2884.592703][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 2884.593721][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2884.594043][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2884.594462][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2884.594881][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2884.595299][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2884.595720][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2884.596139][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2884.596606][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2884.596956][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2884.597378][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2884.597802][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2884.598227][ C1] Call Trace: [ 2884.598408][ C1] [ 2884.598565][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2884.598840][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2884.599100][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2884.599393][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2884.599685][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2884.599989][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2884.600272][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2884.600598][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2884.600871][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2884.601200][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2884.601512][ C1] [ 2884.601669][ C1] [ 2884.601824][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2884.602162][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2884.602470][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 2884.602773][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2884.603077][ C1] ? run_ksoftirqd+0xb/0x60 [ 2884.603320][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2884.603643][ C1] ? __orc_find+0x9c/0xf0 [ 2884.603879][ C1] ? lock_acquire+0x1c1/0x220 [ 2884.604135][ C1] ? irqentry_enter+0x2b/0x60 [ 2884.604390][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2884.604653][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2884.604941][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2884.605243][ C1] ? lock_acquire+0x1c1/0x220 [ 2884.605493][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2884.605746][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2884.606017][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2884.606268][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2884.606528][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2884.606805][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2884.607100][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2884.607394][ C1] ip_local_deliver+0x19d/0x480 [ 2884.607653][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2884.607936][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2884.608201][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2884.608482][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2884.608748][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2884.609086][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2884.609362][ C1] ip_rcv+0x564/0x740 [ 2884.609579][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2884.609824][ C1] ? set_track_prepare+0x8a/0xd0 [ 2884.610094][ C1] ? irqentry_enter+0x2b/0x60 [ 2884.610345][ C1] ? irqentry_enter+0x2b/0x60 [ 2884.610597][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2884.610837][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2884.611152][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2884.611492][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2884.611802][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2884.612152][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2884.612451][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2884.612788][ C1] netif_receive_skb+0x55/0x280 [ 2884.613051][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2884.613382][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2884.613732][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2884.614047][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2884.614340][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2884.614647][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2884.614982][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2884.615268][ C1] ? arch_stack_walk+0x68/0x100 [ 2884.615530][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2884.615813][ C1] ? irqentry_enter+0x2b/0x60 [ 2884.616065][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2884.616383][ C1] ? irqentry_enter+0x2b/0x60 [ 2884.616635][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2884.616962][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2884.617245][ C1] ? arch_stack_walk+0x68/0x100 [ 2884.617509][ C1] __tcf_classify+0x32c/0x7d0 [ 2884.617765][ C1] tcf_classify+0x283/0x930 [ 2884.618013][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2884.618286][ C1] tc_run+0x2e4/0x5d0 [ 2884.618505][ C1] ? __pfx_tc_run+0x10/0x10 [ 2884.618752][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2884.619023][ C1] ? irqentry_enter+0x2b/0x60 [ 2884.619274][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2884.619559][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2884.619879][ C1] ip_finish_output2+0x786/0x18e0 [ 2884.620155][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2884.620448][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2884.620712][ C1] ? __ip_finish_output+0x10f/0x770 [ 2884.620993][ C1] ip_output+0x16b/0x4f0 [ 2884.621222][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2884.621538][ C1] ? __pfx_ip_output+0x10/0x10 [ 2884.621799][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2884.622158][ C1] ? __pfx_ip_output+0x10/0x10 [ 2884.622418][ C1] __ip_queue_xmit+0x672/0x1910 [ 2884.622680][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2884.622960][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2884.623256][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2884.623541][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2884.623834][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2884.624119][ C1] tcp_delack_timer+0x84/0x240 [ 2884.624374][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2884.624665][ C1] call_timer_fn+0x176/0x430 [ 2884.624915][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2884.625189][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2884.625471][ C1] __run_timers.part.0+0x52d/0x890 [ 2884.625745][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2884.626031][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2884.626333][ C1] ? __pfx___schedule+0x10/0x10 [ 2884.626596][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2884.626921][ C1] run_timer_softirq+0x72/0x100 [ 2884.627183][ C1] __do_softirq+0x1bc/0x7ff [ 2884.627428][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2884.627700][ C1] run_ksoftirqd+0x2e/0x60 [ 2884.627941][ C1] smpboot_thread_fn+0x30e/0x840 [ 2884.628208][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2884.628500][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2884.628788][ C1] kthread+0x292/0x360 [ 2884.629012][ C1] ? __pfx_kthread+0x10/0x10 [ 2884.629263][ C1] ret_from_fork+0x34/0x70 [ 2884.629502][ C1] ? __pfx_kthread+0x10/0x10 [ 2884.629746][ C1] ret_from_fork_asm+0x1b/0x30 [ 2884.630008][ C1] [ 2912.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1606s! [swapper/0:0] [ 2912.527918][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2912.529107][ C0] irq event stamp: 27567077 [ 2912.529344][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2912.529868][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2912.530347][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2912.530850][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2912.531346][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2912.531842][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2912.532486][ C0] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 2912.532792][ C0] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 2912.533805][ C0] RSP: 0018:ffffc900000069c0 EFLAGS: 00000286 [ 2912.534131][ C0] RAX: ffff88800a099b5c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2912.534548][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2912.534966][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2912.535384][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2912.535802][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2912.536218][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2912.536683][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2912.537039][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2912.537458][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2912.537876][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2912.538300][ C0] Call Trace: [ 2912.538483][ C0] [ 2912.538640][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2912.538914][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2912.539172][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2912.539458][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2912.539750][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2912.540056][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2912.540336][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2912.540658][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2912.540931][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2912.541210][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2912.541532][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2912.541847][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2912.542174][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2912.542480][ C0] ? kasan_check_range+0x1a/0x1c0 [ 2912.542749][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 2912.543046][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2912.543373][ C0] ? get_stack_info+0x36/0xc0 [ 2912.543622][ C0] ? lock_acquire+0x1c1/0x220 [ 2912.543869][ C0] ? lock_release+0x1d5/0x250 [ 2912.544115][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2912.544373][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2912.544655][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2912.544951][ C0] ? lock_acquire+0x1c1/0x220 [ 2912.545203][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2912.545457][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2912.545731][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2912.545974][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2912.546231][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2912.546499][ C0] ? __inet_lookup_established+0x341/0x610 [ 2912.546811][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2912.547106][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2912.547402][ C0] ip_local_deliver+0x19d/0x480 [ 2912.547659][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2912.547942][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2912.548207][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2912.548487][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2912.548750][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2912.549083][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2912.549359][ C0] ip_rcv+0x564/0x740 [ 2912.549571][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2912.549814][ C0] ? set_track_prepare+0x8a/0xd0 [ 2912.550079][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2912.550365][ C0] ? rest_init+0x153/0x260 [ 2912.550604][ C0] ? skb_clone+0x10b/0x330 [ 2912.550841][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2912.551177][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2912.551496][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2912.551796][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2912.552109][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2912.552368][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2912.552611][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2912.552927][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2912.553228][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2912.553564][ C0] ? lock_acquire+0x1c1/0x220 [ 2912.553809][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2912.554118][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2912.554420][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2912.554748][ C0] ? __copy_skb_header+0xaf/0x490 [ 2912.555013][ C0] ? __skb_clone+0x57a/0x760 [ 2912.555256][ C0] netif_receive_skb+0x55/0x280 [ 2912.555519][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2912.555847][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2912.556199][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2912.556509][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2912.556798][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2912.557098][ C0] ? hlock_class+0x4e/0x130 [ 2912.557344][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2912.557677][ C0] ? place_entity+0x21/0x2f0 [ 2912.557926][ C0] ? resched_curr+0x219/0x280 [ 2912.558176][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2912.558442][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2912.558722][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2912.559001][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2912.559260][ C0] ? activate_task+0xf5/0x260 [ 2912.559512][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2912.559788][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2912.560059][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2912.560321][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2912.560613][ C0] ? get_stack_info+0x36/0xc0 [ 2912.560863][ C0] ? stack_access_ok+0xda/0x1f0 [ 2912.561122][ C0] ? get_reg+0x119/0x190 [ 2912.561346][ C0] __tcf_classify+0x32c/0x7d0 [ 2912.561601][ C0] tcf_classify+0x283/0x930 [ 2912.561857][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2912.562185][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2912.562457][ C0] ? arch_stack_walk+0x8c/0x100 [ 2912.562723][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2912.563015][ C0] tc_run+0x2e4/0x5d0 [ 2912.563230][ C0] ? __pfx_tc_run+0x10/0x10 [ 2912.563470][ C0] ? lock_acquire+0x1c1/0x220 [ 2912.563719][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2912.563991][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2912.564261][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2912.564545][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2912.564822][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2912.565140][ C0] ? neigh_hh_output+0x348/0x590 [ 2912.565407][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2912.565682][ C0] ip_finish_output2+0x786/0x18e0 [ 2912.565948][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2912.566241][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2912.566596][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2912.566889][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2912.567153][ C0] ? __ip_finish_output+0x10f/0x770 [ 2912.567433][ C0] ip_output+0x16b/0x4f0 [ 2912.567659][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2912.567938][ C0] ? __pfx_ip_output+0x10/0x10 [ 2912.568192][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2912.568491][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2912.568757][ C0] ? ip_local_out+0x114/0x3b0 [ 2912.569006][ C0] __ip_queue_xmit+0x672/0x1910 [ 2912.569263][ C0] ? __skb_clone+0x57a/0x760 [ 2912.569505][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2912.569788][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2912.570084][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2912.570405][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2912.570660][ C0] ? tcp_current_mss+0x40a/0x510 [ 2912.570922][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2912.571200][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2912.571478][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2912.571732][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2912.572004][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2912.572330][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2912.572604][ C0] ? ktime_get+0xb6/0x190 [ 2912.572834][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2912.573105][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2912.573386][ C0] tcp_write_timer+0x82/0x1d0 [ 2912.573635][ C0] call_timer_fn+0x176/0x430 [ 2912.573879][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2912.574154][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2912.574425][ C0] __run_timers.part.0+0x52d/0x890 [ 2912.574704][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2912.574987][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2912.575298][ C0] ? lock_acquire+0x1c1/0x220 [ 2912.575544][ C0] ? clockevents_program_event+0xf6/0x300 [ 2912.575846][ C0] ? lock_release+0x1d5/0x250 [ 2912.576097][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2912.576370][ C0] ? ktime_get+0xb6/0x190 [ 2912.576598][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2912.576893][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2912.577207][ C0] run_timer_softirq+0x72/0x100 [ 2912.577466][ C0] __do_softirq+0x1bc/0x7ff [ 2912.577707][ C0] irq_exit_rcu+0x98/0xc0 [ 2912.577935][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2912.578234][ C0] [ 2912.578392][ C0] [ 2912.578549][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2912.578871][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2912.579138][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2912.580147][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2912.580467][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2912.580883][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2912.581298][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2912.581715][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2912.582146][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2912.582566][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2912.582871][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2912.583147][ C0] default_idle_call+0x69/0xa0 [ 2912.583398][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2912.583663][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2912.583956][ C0] ? lock_release+0x1d5/0x250 [ 2912.584212][ C0] do_idle+0xfb/0x160 [ 2912.584427][ C0] cpu_startup_entry+0x55/0x60 [ 2912.584683][ C0] rest_init+0x153/0x260 [ 2912.584908][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2912.585200][ C0] arch_call_rest_init+0x13/0x40 [ 2912.585471][ C0] start_kernel+0x314/0x3d0 [ 2912.585711][ C0] x86_64_start_reservations+0x18/0x30 [ 2912.586002][ C0] x86_64_start_kernel+0xba/0x110 [ 2912.586272][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2912.586602][ C0] [ 2912.586770][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1606s! [ksoftirqd/1:22] [ 2912.587250][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2912.588445][ C1] irq event stamp: 3886976 [ 2912.588682][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2912.589188][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2912.589690][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2912.590199][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2912.590691][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2912.591192][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2912.591856][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 2912.592154][ C1] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 2912.593176][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [ 2912.593499][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2912.593922][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2912.594344][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2912.594763][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2912.595184][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2912.595609][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2912.596081][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2912.596439][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2912.596864][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2912.597292][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2912.597716][ C1] Call Trace: [ 2912.597895][ C1] [ 2912.598058][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2912.598339][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2912.598602][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2912.598892][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2912.599182][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2912.599488][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2912.599772][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2912.600100][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2912.600375][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2912.600702][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2912.601019][ C1] [ 2912.601177][ C1] [ 2912.601334][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2912.601669][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2912.601984][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 2912.602281][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 2912.602575][ C1] ? run_ksoftirqd+0xb/0x60 [ 2912.602819][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2912.603149][ C1] ? __orc_find+0x9c/0xf0 [ 2912.603384][ C1] ? lock_acquire+0x1c1/0x220 [ 2912.603641][ C1] ? irqentry_enter+0x2b/0x60 [ 2912.603900][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2912.604169][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2912.604460][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2912.604762][ C1] ? lock_acquire+0x1c1/0x220 [ 2912.605010][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2912.605264][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2912.605536][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2912.605788][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2912.606052][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2912.606327][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2912.606625][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2912.606921][ C1] ip_local_deliver+0x19d/0x480 [ 2912.607182][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2912.607468][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2912.607733][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2912.608014][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2912.608280][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2912.608615][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2912.608896][ C1] ip_rcv+0x564/0x740 [ 2912.609112][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2912.609357][ C1] ? set_track_prepare+0x8a/0xd0 [ 2912.609624][ C1] ? irqentry_enter+0x2b/0x60 [ 2912.609872][ C1] ? irqentry_enter+0x2b/0x60 [ 2912.610122][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2912.610362][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2912.610679][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2912.611018][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2912.611327][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2912.611673][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2912.611985][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2912.612324][ C1] netif_receive_skb+0x55/0x280 [ 2912.612587][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2912.612922][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2912.613274][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2912.613588][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2912.613883][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2912.614194][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2912.614525][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2912.614810][ C1] ? arch_stack_walk+0x68/0x100 [ 2912.615072][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2912.615348][ C1] ? irqentry_enter+0x2b/0x60 [ 2912.615597][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2912.615916][ C1] ? irqentry_enter+0x2b/0x60 [ 2912.616174][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2912.616507][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2912.616789][ C1] ? arch_stack_walk+0x68/0x100 [ 2912.617058][ C1] __tcf_classify+0x32c/0x7d0 [ 2912.617317][ C1] tcf_classify+0x283/0x930 [ 2912.617564][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2912.617840][ C1] tc_run+0x2e4/0x5d0 [ 2912.618058][ C1] ? __pfx_tc_run+0x10/0x10 [ 2912.618309][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2912.618578][ C1] ? irqentry_enter+0x2b/0x60 [ 2912.618827][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2912.619112][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2912.619436][ C1] ip_finish_output2+0x786/0x18e0 [ 2912.619710][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2912.620006][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2912.620274][ C1] ? __ip_finish_output+0x10f/0x770 [ 2912.620558][ C1] ip_output+0x16b/0x4f0 [ 2912.620787][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2912.621105][ C1] ? __pfx_ip_output+0x10/0x10 [ 2912.621365][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2912.621723][ C1] ? __pfx_ip_output+0x10/0x10 [ 2912.621987][ C1] __ip_queue_xmit+0x672/0x1910 [ 2912.622251][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2912.622534][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2912.622831][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2912.623120][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2912.623415][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2912.623699][ C1] tcp_delack_timer+0x84/0x240 [ 2912.623953][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2912.624245][ C1] call_timer_fn+0x176/0x430 [ 2912.624499][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2912.624773][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2912.625055][ C1] __run_timers.part.0+0x52d/0x890 [ 2912.625332][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2912.625620][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2912.625920][ C1] ? __pfx___schedule+0x10/0x10 [ 2912.626188][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2912.626508][ C1] run_timer_softirq+0x72/0x100 [ 2912.626768][ C1] __do_softirq+0x1bc/0x7ff [ 2912.627010][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2912.627284][ C1] run_ksoftirqd+0x2e/0x60 [ 2912.627527][ C1] smpboot_thread_fn+0x30e/0x840 [ 2912.627793][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2912.628088][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2912.628377][ C1] kthread+0x292/0x360 [ 2912.628599][ C1] ? __pfx_kthread+0x10/0x10 [ 2912.628845][ C1] ret_from_fork+0x34/0x70 [ 2912.629087][ C1] ? __pfx_kthread+0x10/0x10 [ 2912.629331][ C1] ret_from_fork_asm+0x1b/0x30 [ 2912.629593][ C1] [ 2938.080024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 2938.080408][ C1] rcu: 1-....: (1740143 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=420664 [ 2938.080995][ C1] rcu: (t=1743771 jiffies g=1007429 q=31 ncpus=4) [ 2938.081347][ C1] Sending NMI from CPU 1 to CPUs 0: [ 2938.081639][ C0] NMI backtrace for cpu 0 [ 2938.081648][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2938.081653][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2938.081656][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2938.081668][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2938.081672][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2938.081675][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2938.081678][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2938.081680][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2938.081681][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2938.081683][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2938.081685][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2938.081687][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2938.081691][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2938.081692][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2938.081694][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2938.081695][ C0] Call Trace: [ 2938.081699][ C0] [ 2938.081704][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 2938.081710][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 2938.081716][ C0] ? nmi_handle+0x156/0x420 [ 2938.081722][ C0] ? default_do_nmi+0x41/0x100 [ 2938.081726][ C0] ? exc_nmi+0xf3/0x120 [ 2938.081728][ C0] ? end_repeat_nmi+0xf/0x60 [ 2938.081733][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2938.081737][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2938.081741][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2938.081745][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2938.081748][ C0] [ 2938.081749][ C0] [ 2938.081750][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2938.081754][ C0] ? get_stack_info+0x36/0xc0 [ 2938.081758][ C0] ? lock_acquire+0x1c1/0x220 [ 2938.081764][ C0] ? lock_release+0x1d5/0x250 [ 2938.081768][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2938.081772][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2938.081774][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2938.081778][ C0] ? lock_acquire+0x1c1/0x220 [ 2938.081780][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2938.081787][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2938.081791][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2938.081798][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2938.081801][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2938.081805][ C0] ? __inet_lookup_established+0x341/0x610 [ 2938.081812][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2938.081820][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2938.081824][ C0] ip_local_deliver+0x19d/0x480 [ 2938.081827][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2938.081830][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2938.081836][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2938.081840][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2938.081843][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2938.081847][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2938.081858][ C0] ip_rcv+0x564/0x740 [ 2938.081861][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2938.081864][ C0] ? set_track_prepare+0x8a/0xd0 [ 2938.081870][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2938.081872][ C0] ? rest_init+0x153/0x260 [ 2938.081875][ C0] ? skb_clone+0x10b/0x330 [ 2938.081881][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2938.081887][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2938.081892][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2938.081898][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2938.081907][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2938.081910][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2938.081913][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2938.081918][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2938.081921][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2938.081925][ C0] ? lock_acquire+0x1c1/0x220 [ 2938.081927][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2938.081930][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2938.081933][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2938.081936][ C0] ? __copy_skb_header+0xaf/0x490 [ 2938.081939][ C0] ? __skb_clone+0x57a/0x760 [ 2938.081942][ C0] netif_receive_skb+0x55/0x280 [ 2938.081944][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2938.081953][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2938.081960][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2938.081967][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2938.081972][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2938.081980][ C0] ? hlock_class+0x4e/0x130 [ 2938.081988][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2938.081998][ C0] ? place_entity+0x21/0x2f0 [ 2938.082002][ C0] ? resched_curr+0x219/0x280 [ 2938.082006][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2938.082009][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2938.082013][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2938.082018][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2938.082022][ C0] ? activate_task+0xf5/0x260 [ 2938.082025][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2938.082030][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2938.082034][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2938.082037][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2938.082040][ C0] ? get_stack_info+0x36/0xc0 [ 2938.082043][ C0] ? stack_access_ok+0xda/0x1f0 [ 2938.082045][ C0] ? get_reg+0x119/0x190 [ 2938.082049][ C0] __tcf_classify+0x32c/0x7d0 [ 2938.082054][ C0] tcf_classify+0x283/0x930 [ 2938.082057][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2938.082062][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2938.082064][ C0] ? arch_stack_walk+0x8c/0x100 [ 2938.082070][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2938.082073][ C0] tc_run+0x2e4/0x5d0 [ 2938.082078][ C0] ? __pfx_tc_run+0x10/0x10 [ 2938.082082][ C0] ? lock_acquire+0x1c1/0x220 [ 2938.082084][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2938.082089][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2938.082095][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2938.082098][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2938.082101][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2938.082108][ C0] ? neigh_hh_output+0x348/0x590 [ 2938.082112][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2938.082116][ C0] ip_finish_output2+0x786/0x18e0 [ 2938.082119][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2938.082126][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2938.082134][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2938.082137][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2938.082141][ C0] ? __ip_finish_output+0x10f/0x770 [ 2938.082145][ C0] ip_output+0x16b/0x4f0 [ 2938.082149][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2938.082155][ C0] ? __pfx_ip_output+0x10/0x10 [ 2938.082158][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2938.082163][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2938.082165][ C0] ? ip_local_out+0x114/0x3b0 [ 2938.082169][ C0] __ip_queue_xmit+0x672/0x1910 [ 2938.082174][ C0] ? __skb_clone+0x57a/0x760 [ 2938.082177][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2938.082185][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2938.082189][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2938.082193][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2938.082198][ C0] ? tcp_current_mss+0x40a/0x510 [ 2938.082201][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2938.082204][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2938.082207][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2938.082209][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2938.082212][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2938.082216][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2938.082221][ C0] ? ktime_get+0xb6/0x190 [ 2938.082225][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2938.082229][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2938.082232][ C0] tcp_write_timer+0x82/0x1d0 [ 2938.082236][ C0] call_timer_fn+0x176/0x430 [ 2938.082239][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2938.082244][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2938.082248][ C0] __run_timers.part.0+0x52d/0x890 [ 2938.082251][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2938.082256][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2938.082259][ C0] ? lock_acquire+0x1c1/0x220 [ 2938.082261][ C0] ? clockevents_program_event+0xf6/0x300 [ 2938.082266][ C0] ? lock_release+0x1d5/0x250 [ 2938.082268][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2938.082271][ C0] ? ktime_get+0xb6/0x190 [ 2938.082274][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2938.082278][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2938.082282][ C0] run_timer_softirq+0x72/0x100 [ 2938.082286][ C0] __do_softirq+0x1bc/0x7ff [ 2938.082291][ C0] irq_exit_rcu+0x98/0xc0 [ 2938.082294][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2938.082299][ C0] [ 2938.082299][ C0] [ 2938.082300][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2938.082307][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2938.082311][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2938.082313][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2938.082315][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2938.082317][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2938.082319][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2938.082320][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2938.082322][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2938.082326][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2938.082329][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2938.082333][ C0] default_idle_call+0x69/0xa0 [ 2938.082335][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2938.082338][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2938.082343][ C0] ? lock_release+0x1d5/0x250 [ 2938.082347][ C0] do_idle+0xfb/0x160 [ 2938.082350][ C0] cpu_startup_entry+0x55/0x60 [ 2938.082353][ C0] rest_init+0x153/0x260 [ 2938.082355][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2938.082361][ C0] arch_call_rest_init+0x13/0x40 [ 2938.082368][ C0] start_kernel+0x314/0x3d0 [ 2938.082372][ C0] x86_64_start_reservations+0x18/0x30 [ 2938.082376][ C0] x86_64_start_kernel+0xba/0x110 [ 2938.082380][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2938.082389][ C0] [ 2938.082629][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2938.136874][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2938.137525][ C1] RIP: 0010:kasan_check_range+0x106/0x1c0 [ 2938.137840][ C1] Code: 00 74 f2 48 89 c2 b8 01 00 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff <5b> b8 01 00 00 00 5d 41 5c c3 cc cc cc cc 41 bc 08 00 00 00 45 29 [ 2938.138863][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000246 [ 2938.139188][ C1] RAX: ffffed10014131c4 RBX: ffffed10014131c4 RCX: ffffffff90c7aaa0 [ 2938.139605][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2938.140022][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: ffffed10014131c3 [ 2938.140445][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2938.140861][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2938.141278][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2938.141763][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2938.142109][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2938.142531][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2938.142947][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2938.143365][ C1] Call Trace: [ 2938.143543][ C1] [ 2938.143698][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 2938.143986][ C1] ? print_cpu_stall+0x263/0x6a0 [ 2938.144251][ C1] ? check_cpu_stall+0x284/0x500 [ 2938.144517][ C1] ? rcu_pending+0x92/0x360 [ 2938.144758][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 2938.145042][ C1] ? update_process_times+0xb9/0x110 [ 2938.145328][ C1] ? tick_sched_handle+0x67/0x130 [ 2938.145596][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 2938.145893][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2938.146152][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 2938.146479][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2938.146769][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2938.147080][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2938.147362][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2938.147682][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2938.147956][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2938.148287][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2938.148600][ C1] [ 2938.148756][ C1] [ 2938.148912][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2938.149244][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2938.149553][ C1] ? kasan_check_range+0x106/0x1c0 [ 2938.149830][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 2938.150124][ C1] ? run_ksoftirqd+0xb/0x60 [ 2938.150365][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2938.150691][ C1] ? __orc_find+0x9c/0xf0 [ 2938.150924][ C1] ? lock_acquire+0x1c1/0x220 [ 2938.151181][ C1] ? irqentry_enter+0x2b/0x60 [ 2938.151437][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2938.151706][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2938.151991][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2938.152289][ C1] ? lock_acquire+0x1c1/0x220 [ 2938.152540][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2938.152794][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2938.153073][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2938.153320][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2938.153578][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2938.153848][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2938.154137][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2938.154426][ C1] ip_local_deliver+0x19d/0x480 [ 2938.154695][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2938.154984][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2938.155252][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2938.155528][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2938.155790][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2938.156130][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2938.156403][ C1] ip_rcv+0x564/0x740 [ 2938.156615][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2938.156856][ C1] ? set_track_prepare+0x8a/0xd0 [ 2938.157120][ C1] ? irqentry_enter+0x2b/0x60 [ 2938.157372][ C1] ? irqentry_enter+0x2b/0x60 [ 2938.157626][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2938.157870][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2938.158191][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2938.158535][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2938.158846][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2938.159184][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2938.159482][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2938.159818][ C1] netif_receive_skb+0x55/0x280 [ 2938.160083][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2938.160416][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2938.160767][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2938.161081][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2938.161377][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2938.161694][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2938.162020][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2938.162298][ C1] ? arch_stack_walk+0x68/0x100 [ 2938.162562][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2938.162842][ C1] ? irqentry_enter+0x2b/0x60 [ 2938.163096][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2938.163420][ C1] ? irqentry_enter+0x2b/0x60 [ 2938.163671][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2938.163995][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2938.164279][ C1] ? arch_stack_walk+0x68/0x100 [ 2938.164538][ C1] __tcf_classify+0x32c/0x7d0 [ 2938.164791][ C1] tcf_classify+0x283/0x930 [ 2938.165033][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2938.165301][ C1] tc_run+0x2e4/0x5d0 [ 2938.165515][ C1] ? __pfx_tc_run+0x10/0x10 [ 2938.165757][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2938.166023][ C1] ? irqentry_enter+0x2b/0x60 [ 2938.166275][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2938.166563][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2938.166891][ C1] ip_finish_output2+0x786/0x18e0 [ 2938.167162][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2938.167449][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2938.167718][ C1] ? __ip_finish_output+0x10f/0x770 [ 2938.167995][ C1] ip_output+0x16b/0x4f0 [ 2938.168223][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2938.168546][ C1] ? __pfx_ip_output+0x10/0x10 [ 2938.168802][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2938.169159][ C1] ? __pfx_ip_output+0x10/0x10 [ 2938.169419][ C1] __ip_queue_xmit+0x672/0x1910 [ 2938.169681][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2938.169962][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2938.170258][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2938.170545][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2938.170842][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2938.171132][ C1] tcp_delack_timer+0x84/0x240 [ 2938.171385][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2938.171676][ C1] call_timer_fn+0x176/0x430 [ 2938.171922][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2938.172200][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2938.172476][ C1] __run_timers.part.0+0x52d/0x890 [ 2938.172747][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2938.173038][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2938.173339][ C1] ? __pfx___schedule+0x10/0x10 [ 2938.173598][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2938.173916][ C1] run_timer_softirq+0x72/0x100 [ 2938.174179][ C1] __do_softirq+0x1bc/0x7ff [ 2938.174425][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2938.174701][ C1] run_ksoftirqd+0x2e/0x60 [ 2938.174940][ C1] smpboot_thread_fn+0x30e/0x840 [ 2938.175210][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2938.175501][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2938.175795][ C1] kthread+0x292/0x360 [ 2938.176012][ C1] ? __pfx_kthread+0x10/0x10 [ 2938.176261][ C1] ret_from_fork+0x34/0x70 [ 2938.176496][ C1] ? __pfx_kthread+0x10/0x10 [ 2938.176744][ C1] ret_from_fork_asm+0x1b/0x30 [ 2938.177003][ C1] [ 2964.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1654s! [swapper/0:0] [ 2964.527922][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2964.529132][ C0] irq event stamp: 27567077 [ 2964.529370][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2964.529897][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2964.530375][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2964.530883][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2964.531385][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2964.531875][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2964.532524][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2964.532867][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2964.533894][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2964.534224][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2964.534647][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2964.535070][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2964.535497][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2964.535923][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2964.536350][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2964.536822][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2964.537171][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2964.537592][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2964.538009][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2964.538429][ C0] Call Trace: [ 2964.538607][ C0] [ 2964.538762][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2964.539043][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2964.539295][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2964.539588][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2964.539870][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2964.540171][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2964.540450][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2964.540769][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2964.541045][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2964.541322][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2964.541658][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2964.541969][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2964.542302][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2964.542605][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2964.542912][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2964.543224][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2964.543553][ C0] ? get_stack_info+0x36/0xc0 [ 2964.543808][ C0] ? lock_acquire+0x1c1/0x220 [ 2964.544060][ C0] ? lock_release+0x1d5/0x250 [ 2964.544310][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2964.544571][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2964.544856][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2964.545154][ C0] ? lock_acquire+0x1c1/0x220 [ 2964.545405][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2964.545664][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2964.545938][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2964.546185][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2964.546443][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2964.546711][ C0] ? __inet_lookup_established+0x341/0x610 [ 2964.547025][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2964.547319][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2964.547611][ C0] ip_local_deliver+0x19d/0x480 [ 2964.547869][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2964.548152][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2964.548414][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2964.548694][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2964.548959][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2964.549294][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2964.549571][ C0] ip_rcv+0x564/0x740 [ 2964.549789][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2964.550035][ C0] ? set_track_prepare+0x8a/0xd0 [ 2964.550303][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2964.550592][ C0] ? rest_init+0x153/0x260 [ 2964.550831][ C0] ? skb_clone+0x10b/0x330 [ 2964.551069][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2964.551411][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2964.551738][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2964.552040][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2964.552352][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2964.552614][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2964.552857][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2964.553177][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2964.553477][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2964.553815][ C0] ? lock_acquire+0x1c1/0x220 [ 2964.554061][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2964.554368][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2964.554669][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2964.554998][ C0] ? __copy_skb_header+0xaf/0x490 [ 2964.555263][ C0] ? __skb_clone+0x57a/0x760 [ 2964.555507][ C0] netif_receive_skb+0x55/0x280 [ 2964.555770][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2964.556099][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2964.556448][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2964.556758][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2964.557051][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2964.557352][ C0] ? hlock_class+0x4e/0x130 [ 2964.557599][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2964.557932][ C0] ? place_entity+0x21/0x2f0 [ 2964.558181][ C0] ? resched_curr+0x219/0x280 [ 2964.558432][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2964.558698][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2964.558984][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2964.559263][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2964.559522][ C0] ? activate_task+0xf5/0x260 [ 2964.559774][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2964.560052][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2964.560323][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2964.560588][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2964.560885][ C0] ? get_stack_info+0x36/0xc0 [ 2964.561138][ C0] ? stack_access_ok+0xda/0x1f0 [ 2964.561395][ C0] ? get_reg+0x119/0x190 [ 2964.561627][ C0] __tcf_classify+0x32c/0x7d0 [ 2964.561878][ C0] tcf_classify+0x283/0x930 [ 2964.562119][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2964.562448][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2964.562718][ C0] ? arch_stack_walk+0x8c/0x100 [ 2964.562980][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2964.563272][ C0] tc_run+0x2e4/0x5d0 [ 2964.563486][ C0] ? __pfx_tc_run+0x10/0x10 [ 2964.563725][ C0] ? lock_acquire+0x1c1/0x220 [ 2964.563971][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2964.564245][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2964.564513][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2964.564796][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2964.565071][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2964.565389][ C0] ? neigh_hh_output+0x348/0x590 [ 2964.565657][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2964.565934][ C0] ip_finish_output2+0x786/0x18e0 [ 2964.566201][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2964.566489][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2964.566848][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2964.567140][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2964.567403][ C0] ? __ip_finish_output+0x10f/0x770 [ 2964.567683][ C0] ip_output+0x16b/0x4f0 [ 2964.567915][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2964.568199][ C0] ? __pfx_ip_output+0x10/0x10 [ 2964.568458][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2964.568758][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2964.569022][ C0] ? ip_local_out+0x114/0x3b0 [ 2964.569270][ C0] __ip_queue_xmit+0x672/0x1910 [ 2964.569530][ C0] ? __skb_clone+0x57a/0x760 [ 2964.569784][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2964.570069][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2964.570367][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2964.570687][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2964.570941][ C0] ? tcp_current_mss+0x40a/0x510 [ 2964.571208][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2964.571491][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2964.571777][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2964.572028][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2964.572301][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2964.572619][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2964.572894][ C0] ? ktime_get+0xb6/0x190 [ 2964.573125][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2964.573399][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2964.573682][ C0] tcp_write_timer+0x82/0x1d0 [ 2964.573930][ C0] call_timer_fn+0x176/0x430 [ 2964.574175][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2964.574452][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2964.574725][ C0] __run_timers.part.0+0x52d/0x890 [ 2964.575000][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2964.575282][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2964.575581][ C0] ? lock_acquire+0x1c1/0x220 [ 2964.575826][ C0] ? clockevents_program_event+0xf6/0x300 [ 2964.576130][ C0] ? lock_release+0x1d5/0x250 [ 2964.576380][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2964.576656][ C0] ? ktime_get+0xb6/0x190 [ 2964.576887][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2964.577184][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2964.577496][ C0] run_timer_softirq+0x72/0x100 [ 2964.577752][ C0] __do_softirq+0x1bc/0x7ff [ 2964.577993][ C0] irq_exit_rcu+0x98/0xc0 [ 2964.578222][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2964.578520][ C0] [ 2964.578680][ C0] [ 2964.578840][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2964.579165][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2964.579432][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2964.580446][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2964.580766][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2964.581186][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2964.581610][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2964.582034][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2964.582455][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2964.582877][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2964.583186][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2964.583462][ C0] default_idle_call+0x69/0xa0 [ 2964.583718][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2964.583985][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2964.584277][ C0] ? lock_release+0x1d5/0x250 [ 2964.584530][ C0] do_idle+0xfb/0x160 [ 2964.584743][ C0] cpu_startup_entry+0x55/0x60 [ 2964.584997][ C0] rest_init+0x153/0x260 [ 2964.585222][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2964.585512][ C0] arch_call_rest_init+0x13/0x40 [ 2964.585780][ C0] start_kernel+0x314/0x3d0 [ 2964.586020][ C0] x86_64_start_reservations+0x18/0x30 [ 2964.586310][ C0] x86_64_start_kernel+0xba/0x110 [ 2964.586582][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2964.586916][ C0] [ 2964.587086][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1654s! [ksoftirqd/1:22] [ 2964.587562][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2964.588757][ C1] irq event stamp: 3886976 [ 2964.588994][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2964.589500][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2964.590002][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2964.590505][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2964.590994][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2964.591494][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2964.592143][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2964.592486][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2964.593507][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 2964.593827][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2964.594249][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2964.594668][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2964.595088][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2964.595504][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2964.595921][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2964.596394][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2964.596749][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2964.597170][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2964.597596][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2964.598024][ C1] Call Trace: [ 2964.598207][ C1] [ 2964.598365][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2964.598642][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2964.598902][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2964.599196][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2964.599486][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2964.599791][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2964.600073][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2964.600399][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2964.600672][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2964.601000][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2964.601314][ C1] [ 2964.601472][ C1] [ 2964.601633][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2964.601969][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2964.602273][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2964.602582][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2964.602887][ C1] ? run_ksoftirqd+0xb/0x60 [ 2964.603134][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2964.603465][ C1] ? __orc_find+0x9c/0xf0 [ 2964.603695][ C1] ? lock_acquire+0x1c1/0x220 [ 2964.603947][ C1] ? irqentry_enter+0x2b/0x60 [ 2964.604200][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2964.604460][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2964.604743][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2964.605041][ C1] ? lock_acquire+0x1c1/0x220 [ 2964.605294][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2964.605551][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2964.605827][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2964.606074][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2964.606333][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2964.606604][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2964.606893][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2964.607187][ C1] ip_local_deliver+0x19d/0x480 [ 2964.607449][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2964.607736][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2964.608003][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2964.608280][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2964.608542][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2964.608881][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2964.609158][ C1] ip_rcv+0x564/0x740 [ 2964.609370][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2964.609614][ C1] ? set_track_prepare+0x8a/0xd0 [ 2964.609879][ C1] ? irqentry_enter+0x2b/0x60 [ 2964.610134][ C1] ? irqentry_enter+0x2b/0x60 [ 2964.610389][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2964.610634][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2964.610954][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2964.611297][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2964.611612][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2964.611957][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2964.612259][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2964.612592][ C1] netif_receive_skb+0x55/0x280 [ 2964.612851][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2964.613180][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2964.613527][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2964.613846][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2964.614136][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2964.614438][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2964.614767][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2964.615048][ C1] ? arch_stack_walk+0x68/0x100 [ 2964.615315][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2964.615595][ C1] ? irqentry_enter+0x2b/0x60 [ 2964.615849][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2964.616172][ C1] ? irqentry_enter+0x2b/0x60 [ 2964.616422][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2964.616746][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2964.617030][ C1] ? arch_stack_walk+0x68/0x100 [ 2964.617291][ C1] __tcf_classify+0x32c/0x7d0 [ 2964.617544][ C1] tcf_classify+0x283/0x930 [ 2964.617787][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2964.618056][ C1] tc_run+0x2e4/0x5d0 [ 2964.618270][ C1] ? __pfx_tc_run+0x10/0x10 [ 2964.618512][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2964.618778][ C1] ? irqentry_enter+0x2b/0x60 [ 2964.619033][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2964.619322][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2964.619646][ C1] ip_finish_output2+0x786/0x18e0 [ 2964.619917][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2964.620209][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2964.620478][ C1] ? __ip_finish_output+0x10f/0x770 [ 2964.620755][ C1] ip_output+0x16b/0x4f0 [ 2964.620981][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2964.621303][ C1] ? __pfx_ip_output+0x10/0x10 [ 2964.621564][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2964.621918][ C1] ? __pfx_ip_output+0x10/0x10 [ 2964.622176][ C1] __ip_queue_xmit+0x672/0x1910 [ 2964.622441][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2964.622726][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2964.623023][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2964.623313][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2964.623610][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2964.623900][ C1] tcp_delack_timer+0x84/0x240 [ 2964.624158][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2964.624440][ C1] call_timer_fn+0x176/0x430 [ 2964.624686][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2964.624963][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2964.625244][ C1] __run_timers.part.0+0x52d/0x890 [ 2964.625515][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2964.625804][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2964.626108][ C1] ? __pfx___schedule+0x10/0x10 [ 2964.626367][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2964.626686][ C1] run_timer_softirq+0x72/0x100 [ 2964.626952][ C1] __do_softirq+0x1bc/0x7ff [ 2964.627199][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2964.627476][ C1] run_ksoftirqd+0x2e/0x60 [ 2964.627714][ C1] smpboot_thread_fn+0x30e/0x840 [ 2964.627981][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2964.628272][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2964.628563][ C1] kthread+0x292/0x360 [ 2964.628784][ C1] ? __pfx_kthread+0x10/0x10 [ 2964.629035][ C1] ret_from_fork+0x34/0x70 [ 2964.629272][ C1] ? __pfx_kthread+0x10/0x10 [ 2964.629519][ C1] ret_from_fork_asm+0x1b/0x30 [ 2964.629777][ C1] [ 2992.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1681s! [swapper/0:0] [ 2992.527910][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2992.529096][ C0] irq event stamp: 27567077 [ 2992.529337][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 2992.529862][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 2992.530340][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 2992.530842][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 2992.531339][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 2992.531825][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2992.532476][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 2992.532816][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 2992.533835][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 2992.534155][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2992.534573][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 2992.534991][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 2992.535413][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 2992.535829][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 2992.536248][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 2992.536717][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2992.537069][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 2992.537492][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2992.537917][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2992.538338][ C0] Call Trace: [ 2992.538518][ C0] [ 2992.538678][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2992.538952][ C0] ? __run_hrtimer+0x1c3/0x710 [ 2992.539211][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2992.539500][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 2992.539787][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2992.540091][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2992.540373][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2992.540695][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 2992.540967][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 2992.541247][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2992.541580][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2992.541891][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2992.542221][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2992.542530][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 2992.542835][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2992.543141][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2992.543468][ C0] ? get_stack_info+0x36/0xc0 [ 2992.543719][ C0] ? lock_acquire+0x1c1/0x220 [ 2992.543967][ C0] ? lock_release+0x1d5/0x250 [ 2992.544214][ C0] do_raw_spin_lock+0x1ec/0x270 [ 2992.544472][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2992.544756][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2992.545055][ C0] ? lock_acquire+0x1c1/0x220 [ 2992.545305][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 2992.545561][ C0] _raw_spin_lock_nested+0x65/0x80 [ 2992.545840][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 2992.546084][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2992.546339][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 2992.546607][ C0] ? __inet_lookup_established+0x341/0x610 [ 2992.546919][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 2992.547210][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 2992.547505][ C0] ip_local_deliver+0x19d/0x480 [ 2992.547763][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 2992.548047][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2992.548311][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 2992.548589][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2992.548853][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2992.549185][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2992.549465][ C0] ip_rcv+0x564/0x740 [ 2992.549679][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2992.549922][ C0] ? set_track_prepare+0x8a/0xd0 [ 2992.550189][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 2992.550475][ C0] ? rest_init+0x153/0x260 [ 2992.550715][ C0] ? skb_clone+0x10b/0x330 [ 2992.550954][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2992.551292][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2992.551615][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 2992.551915][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2992.552227][ C0] ? __tcf_classify+0x32c/0x7d0 [ 2992.552487][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 2992.552729][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 2992.553047][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2992.553348][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2992.553685][ C0] ? lock_acquire+0x1c1/0x220 [ 2992.553930][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 2992.554239][ C0] netif_receive_skb_internal+0xb0/0x300 [ 2992.554540][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2992.554869][ C0] ? __copy_skb_header+0xaf/0x490 [ 2992.555134][ C0] ? __skb_clone+0x57a/0x760 [ 2992.555377][ C0] netif_receive_skb+0x55/0x280 [ 2992.555637][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2992.555966][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2992.556317][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2992.556627][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 2992.556917][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 2992.557220][ C0] ? hlock_class+0x4e/0x130 [ 2992.557468][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2992.557801][ C0] ? place_entity+0x21/0x2f0 [ 2992.558056][ C0] ? resched_curr+0x219/0x280 [ 2992.558308][ C0] ? __pfx_resched_curr+0x10/0x10 [ 2992.558575][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 2992.558856][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 2992.559137][ C0] ? wakeup_preempt+0x161/0x2c0 [ 2992.559398][ C0] ? activate_task+0xf5/0x260 [ 2992.559651][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 2992.559929][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 2992.560201][ C0] ? _raw_spin_unlock+0x23/0x40 [ 2992.560463][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2992.560756][ C0] ? get_stack_info+0x36/0xc0 [ 2992.561008][ C0] ? stack_access_ok+0xda/0x1f0 [ 2992.561266][ C0] ? get_reg+0x119/0x190 [ 2992.561502][ C0] __tcf_classify+0x32c/0x7d0 [ 2992.561750][ C0] tcf_classify+0x283/0x930 [ 2992.561994][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2992.562322][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 2992.562591][ C0] ? arch_stack_walk+0x8c/0x100 [ 2992.562858][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 2992.563150][ C0] tc_run+0x2e4/0x5d0 [ 2992.563363][ C0] ? __pfx_tc_run+0x10/0x10 [ 2992.563608][ C0] ? lock_acquire+0x1c1/0x220 [ 2992.563859][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 2992.564132][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 2992.564402][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2992.564686][ C0] ? ip_finish_output2+0x786/0x18e0 [ 2992.564963][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2992.565279][ C0] ? neigh_hh_output+0x348/0x590 [ 2992.565545][ C0] ? ip_finish_output2+0x262/0x18e0 [ 2992.565821][ C0] ip_finish_output2+0x786/0x18e0 [ 2992.566091][ C0] ? stack_depot_save_flags+0x45/0x550 [ 2992.566387][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2992.566742][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 2992.567035][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2992.567300][ C0] ? __ip_finish_output+0x10f/0x770 [ 2992.567580][ C0] ip_output+0x16b/0x4f0 [ 2992.567807][ C0] ? __run_timers.part.0+0x52d/0x890 [ 2992.568087][ C0] ? __pfx_ip_output+0x10/0x10 [ 2992.568342][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2992.568641][ C0] ? rcu_read_lock_held+0xe/0x50 [ 2992.568907][ C0] ? ip_local_out+0x114/0x3b0 [ 2992.569157][ C0] __ip_queue_xmit+0x672/0x1910 [ 2992.569413][ C0] ? __skb_clone+0x57a/0x760 [ 2992.569656][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 2992.569938][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2992.570234][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2992.570557][ C0] tcp_write_xmit+0xe42/0x24c0 [ 2992.570814][ C0] ? tcp_current_mss+0x40a/0x510 [ 2992.571078][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 2992.571356][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2992.571640][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 2992.571893][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 2992.572162][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2992.572489][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2992.572765][ C0] ? ktime_get+0xb6/0x190 [ 2992.572995][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 2992.573266][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2992.573547][ C0] tcp_write_timer+0x82/0x1d0 [ 2992.573795][ C0] call_timer_fn+0x176/0x430 [ 2992.574041][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 2992.574316][ C0] ? next_expiry_recalc+0xcd/0x220 [ 2992.574587][ C0] __run_timers.part.0+0x52d/0x890 [ 2992.574861][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 2992.575144][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 2992.575442][ C0] ? lock_acquire+0x1c1/0x220 [ 2992.575689][ C0] ? clockevents_program_event+0xf6/0x300 [ 2992.575996][ C0] ? lock_release+0x1d5/0x250 [ 2992.576246][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 2992.576518][ C0] ? ktime_get+0xb6/0x190 [ 2992.576747][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 2992.577044][ C0] ? clockevents_program_event+0x1ed/0x300 [ 2992.577357][ C0] run_timer_softirq+0x72/0x100 [ 2992.577614][ C0] __do_softirq+0x1bc/0x7ff [ 2992.577855][ C0] irq_exit_rcu+0x98/0xc0 [ 2992.578085][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 2992.578384][ C0] [ 2992.578543][ C0] [ 2992.578702][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2992.579026][ C0] RIP: 0010:default_idle+0xf/0x20 [ 2992.579293][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2992.580312][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 2992.580636][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 2992.581055][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 2992.581483][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 2992.581907][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 2992.582332][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 2992.582755][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2992.583061][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 2992.583337][ C0] default_idle_call+0x69/0xa0 [ 2992.583589][ C0] cpuidle_idle_call+0x1f6/0x280 [ 2992.583854][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2992.584148][ C0] ? lock_release+0x1d5/0x250 [ 2992.584404][ C0] do_idle+0xfb/0x160 [ 2992.584619][ C0] cpu_startup_entry+0x55/0x60 [ 2992.584874][ C0] rest_init+0x153/0x260 [ 2992.585102][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 2992.585397][ C0] arch_call_rest_init+0x13/0x40 [ 2992.585667][ C0] start_kernel+0x314/0x3d0 [ 2992.585908][ C0] x86_64_start_reservations+0x18/0x30 [ 2992.586201][ C0] x86_64_start_kernel+0xba/0x110 [ 2992.586471][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 2992.586801][ C0] [ 2992.586970][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1681s! [ksoftirqd/1:22] [ 2992.587441][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 2992.588648][ C1] irq event stamp: 3886976 [ 2992.588889][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 2992.589386][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 2992.589881][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 2992.590379][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 2992.590873][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 2992.591367][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2992.592026][ C1] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 2992.592332][ C1] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 2992.593351][ C1] RSP: 0018:ffffc9000019e9d0 EFLAGS: 00000282 [ 2992.593676][ C1] RAX: ffff88800a098e1c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 2992.594097][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 2992.594516][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 2992.594937][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 2992.595359][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 2992.595780][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2992.596253][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2992.596608][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 2992.597031][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2992.597456][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2992.597884][ C1] Call Trace: [ 2992.598072][ C1] [ 2992.598230][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2992.598507][ C1] ? __run_hrtimer+0x1c3/0x710 [ 2992.598764][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2992.599055][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2992.599346][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2992.599652][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2992.599936][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 2992.600262][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2992.600537][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 2992.600869][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 2992.601185][ C1] [ 2992.601343][ C1] [ 2992.601504][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2992.601841][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2992.602145][ C1] ? kasan_check_range+0x1a/0x1c0 [ 2992.602414][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 2992.602709][ C1] ? run_ksoftirqd+0xb/0x60 [ 2992.602952][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2992.603280][ C1] ? __orc_find+0x9c/0xf0 [ 2992.603514][ C1] ? lock_acquire+0x1c1/0x220 [ 2992.603771][ C1] ? irqentry_enter+0x2b/0x60 [ 2992.604028][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2992.604295][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2992.604587][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2992.604890][ C1] ? lock_acquire+0x1c1/0x220 [ 2992.605138][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 2992.605390][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2992.605664][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 2992.605915][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2992.606181][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2992.606456][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2992.606748][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 2992.607043][ C1] ip_local_deliver+0x19d/0x480 [ 2992.607302][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2992.607588][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2992.607854][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 2992.608138][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2992.608405][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2992.608741][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2992.609021][ C1] ip_rcv+0x564/0x740 [ 2992.609238][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2992.609485][ C1] ? set_track_prepare+0x8a/0xd0 [ 2992.609758][ C1] ? irqentry_enter+0x2b/0x60 [ 2992.610009][ C1] ? irqentry_enter+0x2b/0x60 [ 2992.610260][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2992.610502][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2992.610816][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2992.611159][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2992.611472][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2992.611811][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2992.612109][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2992.612445][ C1] netif_receive_skb+0x55/0x280 [ 2992.612712][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2992.613043][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2992.613395][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2992.613708][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 2992.614000][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2992.614306][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2992.614643][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2992.614928][ C1] ? arch_stack_walk+0x68/0x100 [ 2992.615189][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 2992.615466][ C1] ? irqentry_enter+0x2b/0x60 [ 2992.615717][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2992.616040][ C1] ? irqentry_enter+0x2b/0x60 [ 2992.616297][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2992.616621][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 2992.616901][ C1] ? arch_stack_walk+0x68/0x100 [ 2992.617166][ C1] __tcf_classify+0x32c/0x7d0 [ 2992.617425][ C1] tcf_classify+0x283/0x930 [ 2992.617674][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2992.617949][ C1] tc_run+0x2e4/0x5d0 [ 2992.618169][ C1] ? __pfx_tc_run+0x10/0x10 [ 2992.618420][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 2992.618690][ C1] ? irqentry_enter+0x2b/0x60 [ 2992.618939][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2992.619226][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2992.619552][ C1] ip_finish_output2+0x786/0x18e0 [ 2992.619824][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2992.620116][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2992.620381][ C1] ? __ip_finish_output+0x10f/0x770 [ 2992.620664][ C1] ip_output+0x16b/0x4f0 [ 2992.620897][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2992.621221][ C1] ? __pfx_ip_output+0x10/0x10 [ 2992.621487][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 2992.621843][ C1] ? __pfx_ip_output+0x10/0x10 [ 2992.622103][ C1] __ip_queue_xmit+0x672/0x1910 [ 2992.622365][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2992.622647][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2992.622946][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2992.623235][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2992.623532][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2992.623819][ C1] tcp_delack_timer+0x84/0x240 [ 2992.624077][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2992.624367][ C1] call_timer_fn+0x176/0x430 [ 2992.624619][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2992.624895][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 2992.625181][ C1] __run_timers.part.0+0x52d/0x890 [ 2992.625457][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2992.625745][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2992.626047][ C1] ? __pfx___schedule+0x10/0x10 [ 2992.626313][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2992.626636][ C1] run_timer_softirq+0x72/0x100 [ 2992.626894][ C1] __do_softirq+0x1bc/0x7ff [ 2992.627136][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 2992.627411][ C1] run_ksoftirqd+0x2e/0x60 [ 2992.627651][ C1] smpboot_thread_fn+0x30e/0x840 [ 2992.627917][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2992.628212][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 2992.628504][ C1] kthread+0x292/0x360 [ 2992.628722][ C1] ? __pfx_kthread+0x10/0x10 [ 2992.628970][ C1] ret_from_fork+0x34/0x70 [ 2992.629212][ C1] ? __pfx_kthread+0x10/0x10 [ 2992.629460][ C1] ret_from_fork_asm+0x1b/0x30 [ 2992.629724][ C1] [ 3016.178024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3016.178415][ C1] rcu: 1-....: (1817961 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=439054 [ 3016.179007][ C1] rcu: (t=1821869 jiffies g=1007429 q=31 ncpus=4) [ 3016.179358][ C1] Sending NMI from CPU 1 to CPUs 0: [ 3016.179642][ C0] NMI backtrace for cpu 0 [ 3016.179650][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3016.179654][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3016.179657][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3016.179666][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3016.179670][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3016.179673][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3016.179675][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3016.179677][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3016.179679][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3016.179681][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3016.179682][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3016.179684][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3016.179688][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3016.179690][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3016.179692][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3016.179693][ C0] Call Trace: [ 3016.179696][ C0] [ 3016.179708][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 3016.179715][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3016.179720][ C0] ? nmi_handle+0x156/0x420 [ 3016.179726][ C0] ? default_do_nmi+0x41/0x100 [ 3016.179730][ C0] ? exc_nmi+0xf3/0x120 [ 3016.179732][ C0] ? end_repeat_nmi+0xf/0x60 [ 3016.179737][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3016.179741][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3016.179745][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3016.179749][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3016.179752][ C0] [ 3016.179753][ C0] [ 3016.179755][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3016.179758][ C0] ? get_stack_info+0x36/0xc0 [ 3016.179763][ C0] ? lock_acquire+0x1c1/0x220 [ 3016.179767][ C0] ? lock_release+0x1d5/0x250 [ 3016.179771][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3016.179775][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3016.179778][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3016.179781][ C0] ? lock_acquire+0x1c1/0x220 [ 3016.179784][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3016.179789][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3016.179793][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3016.179800][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3016.179803][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3016.179807][ C0] ? __inet_lookup_established+0x341/0x610 [ 3016.179814][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3016.179821][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3016.179825][ C0] ip_local_deliver+0x19d/0x480 [ 3016.179828][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3016.179830][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3016.179836][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3016.179840][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3016.179843][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3016.179847][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3016.179858][ C0] ip_rcv+0x564/0x740 [ 3016.179861][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3016.179864][ C0] ? set_track_prepare+0x8a/0xd0 [ 3016.179869][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3016.179871][ C0] ? rest_init+0x153/0x260 [ 3016.179874][ C0] ? skb_clone+0x10b/0x330 [ 3016.179880][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3016.179886][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3016.179892][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3016.179897][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3016.179907][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3016.179910][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3016.179912][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3016.179917][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3016.179921][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3016.179924][ C0] ? lock_acquire+0x1c1/0x220 [ 3016.179927][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3016.179930][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3016.179933][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3016.179937][ C0] ? __copy_skb_header+0xaf/0x490 [ 3016.179940][ C0] ? __skb_clone+0x57a/0x760 [ 3016.179943][ C0] netif_receive_skb+0x55/0x280 [ 3016.179945][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3016.179954][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3016.179961][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3016.179968][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3016.179973][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3016.179982][ C0] ? hlock_class+0x4e/0x130 [ 3016.179987][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3016.179997][ C0] ? place_entity+0x21/0x2f0 [ 3016.180000][ C0] ? resched_curr+0x219/0x280 [ 3016.180004][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3016.180007][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3016.180011][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3016.180016][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3016.180018][ C0] ? activate_task+0xf5/0x260 [ 3016.180023][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3016.180028][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3016.180031][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3016.180035][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3016.180038][ C0] ? get_stack_info+0x36/0xc0 [ 3016.180042][ C0] ? stack_access_ok+0xda/0x1f0 [ 3016.180044][ C0] ? get_reg+0x119/0x190 [ 3016.180047][ C0] __tcf_classify+0x32c/0x7d0 [ 3016.180052][ C0] tcf_classify+0x283/0x930 [ 3016.180055][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3016.180060][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3016.180062][ C0] ? arch_stack_walk+0x8c/0x100 [ 3016.180066][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3016.180070][ C0] tc_run+0x2e4/0x5d0 [ 3016.180074][ C0] ? __pfx_tc_run+0x10/0x10 [ 3016.180077][ C0] ? lock_acquire+0x1c1/0x220 [ 3016.180080][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3016.180085][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3016.180090][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3016.180093][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3016.180097][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3016.180102][ C0] ? neigh_hh_output+0x348/0x590 [ 3016.180107][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3016.180111][ C0] ip_finish_output2+0x786/0x18e0 [ 3016.180114][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3016.180120][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3016.180128][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3016.180131][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3016.180135][ C0] ? __ip_finish_output+0x10f/0x770 [ 3016.180139][ C0] ip_output+0x16b/0x4f0 [ 3016.180142][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3016.180147][ C0] ? __pfx_ip_output+0x10/0x10 [ 3016.180150][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3016.180155][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3016.180158][ C0] ? ip_local_out+0x114/0x3b0 [ 3016.180162][ C0] __ip_queue_xmit+0x672/0x1910 [ 3016.180166][ C0] ? __skb_clone+0x57a/0x760 [ 3016.180169][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3016.180177][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3016.180181][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3016.180184][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3016.180190][ C0] ? tcp_current_mss+0x40a/0x510 [ 3016.180193][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3016.180195][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3016.180198][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3016.180200][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3016.180203][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3016.180207][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3016.180212][ C0] ? ktime_get+0xb6/0x190 [ 3016.180216][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3016.180220][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3016.180223][ C0] tcp_write_timer+0x82/0x1d0 [ 3016.180227][ C0] call_timer_fn+0x176/0x430 [ 3016.180231][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3016.180236][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3016.180240][ C0] __run_timers.part.0+0x52d/0x890 [ 3016.180243][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3016.180248][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3016.180251][ C0] ? lock_acquire+0x1c1/0x220 [ 3016.180253][ C0] ? clockevents_program_event+0xf6/0x300 [ 3016.180257][ C0] ? lock_release+0x1d5/0x250 [ 3016.180260][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3016.180263][ C0] ? ktime_get+0xb6/0x190 [ 3016.180266][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3016.180269][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3016.180274][ C0] run_timer_softirq+0x72/0x100 [ 3016.180277][ C0] __do_softirq+0x1bc/0x7ff [ 3016.180282][ C0] irq_exit_rcu+0x98/0xc0 [ 3016.180285][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3016.180289][ C0] [ 3016.180289][ C0] [ 3016.180291][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3016.180297][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3016.180301][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3016.180303][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3016.180305][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3016.180307][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3016.180309][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3016.180310][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3016.180312][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3016.180316][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3016.180320][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3016.180323][ C0] default_idle_call+0x69/0xa0 [ 3016.180325][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3016.180328][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3016.180333][ C0] ? lock_release+0x1d5/0x250 [ 3016.180337][ C0] do_idle+0xfb/0x160 [ 3016.180339][ C0] cpu_startup_entry+0x55/0x60 [ 3016.180342][ C0] rest_init+0x153/0x260 [ 3016.180344][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3016.180351][ C0] arch_call_rest_init+0x13/0x40 [ 3016.180357][ C0] start_kernel+0x314/0x3d0 [ 3016.180360][ C0] x86_64_start_reservations+0x18/0x30 [ 3016.180365][ C0] x86_64_start_kernel+0xba/0x110 [ 3016.180369][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3016.180377][ C0] [ 3016.180639][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3016.234901][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3016.235548][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3016.235897][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3016.236916][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3016.237241][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3016.237660][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3016.238081][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3016.238501][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3016.238921][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3016.239340][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3016.239808][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3016.240168][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3016.240588][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3016.241008][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3016.241436][ C1] Call Trace: [ 3016.241612][ C1] [ 3016.241768][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3016.242062][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3016.242326][ C1] ? check_cpu_stall+0x284/0x500 [ 3016.242595][ C1] ? rcu_pending+0x92/0x360 [ 3016.242839][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3016.243122][ C1] ? update_process_times+0xb9/0x110 [ 3016.243409][ C1] ? tick_sched_handle+0x67/0x130 [ 3016.243677][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3016.243975][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3016.244232][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3016.244557][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3016.244853][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3016.245161][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3016.245449][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3016.245775][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3016.246051][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3016.246377][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3016.246696][ C1] [ 3016.246853][ C1] [ 3016.247011][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3016.247343][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3016.247650][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3016.247965][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3016.248269][ C1] ? run_ksoftirqd+0xb/0x60 [ 3016.248513][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3016.248840][ C1] ? __orc_find+0x9c/0xf0 [ 3016.249074][ C1] ? lock_acquire+0x1c1/0x220 [ 3016.249335][ C1] ? irqentry_enter+0x2b/0x60 [ 3016.249591][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3016.249858][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3016.250150][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3016.250451][ C1] ? lock_acquire+0x1c1/0x220 [ 3016.250700][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3016.250951][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3016.251225][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3016.251476][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3016.251735][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3016.252005][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3016.252294][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3016.252583][ C1] ip_local_deliver+0x19d/0x480 [ 3016.252845][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3016.253136][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3016.253406][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3016.253684][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3016.253948][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3016.254289][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3016.254563][ C1] ip_rcv+0x564/0x740 [ 3016.254779][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3016.255022][ C1] ? set_track_prepare+0x8a/0xd0 [ 3016.255288][ C1] ? irqentry_enter+0x2b/0x60 [ 3016.255541][ C1] ? irqentry_enter+0x2b/0x60 [ 3016.255795][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3016.256042][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3016.256359][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3016.256703][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3016.257016][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3016.257355][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3016.257652][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3016.257988][ C1] netif_receive_skb+0x55/0x280 [ 3016.258255][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3016.258588][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3016.258940][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3016.259253][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3016.259545][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3016.259852][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3016.260185][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3016.260470][ C1] ? arch_stack_walk+0x68/0x100 [ 3016.260728][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3016.261003][ C1] ? irqentry_enter+0x2b/0x60 [ 3016.261253][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3016.261588][ C1] ? irqentry_enter+0x2b/0x60 [ 3016.261842][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3016.262164][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3016.262449][ C1] ? arch_stack_walk+0x68/0x100 [ 3016.262707][ C1] __tcf_classify+0x32c/0x7d0 [ 3016.262957][ C1] tcf_classify+0x283/0x930 [ 3016.263199][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3016.263467][ C1] tc_run+0x2e4/0x5d0 [ 3016.263683][ C1] ? __pfx_tc_run+0x10/0x10 [ 3016.263931][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3016.264199][ C1] ? irqentry_enter+0x2b/0x60 [ 3016.264452][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3016.264740][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3016.265068][ C1] ip_finish_output2+0x786/0x18e0 [ 3016.265336][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3016.265624][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3016.265892][ C1] ? __ip_finish_output+0x10f/0x770 [ 3016.266171][ C1] ip_output+0x16b/0x4f0 [ 3016.266397][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3016.266721][ C1] ? __pfx_ip_output+0x10/0x10 [ 3016.266979][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3016.267334][ C1] ? __pfx_ip_output+0x10/0x10 [ 3016.267592][ C1] __ip_queue_xmit+0x672/0x1910 [ 3016.267854][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3016.268134][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3016.268429][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3016.268715][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3016.269011][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3016.269297][ C1] tcp_delack_timer+0x84/0x240 [ 3016.269553][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3016.269841][ C1] call_timer_fn+0x176/0x430 [ 3016.270094][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3016.270373][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3016.270653][ C1] __run_timers.part.0+0x52d/0x890 [ 3016.270929][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3016.271222][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3016.271529][ C1] ? __pfx___schedule+0x10/0x10 [ 3016.271787][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3016.272106][ C1] run_timer_softirq+0x72/0x100 [ 3016.272367][ C1] __do_softirq+0x1bc/0x7ff [ 3016.272614][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3016.272891][ C1] run_ksoftirqd+0x2e/0x60 [ 3016.273129][ C1] smpboot_thread_fn+0x30e/0x840 [ 3016.273398][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3016.273690][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3016.273986][ C1] kthread+0x292/0x360 [ 3016.274202][ C1] ? __pfx_kthread+0x10/0x10 [ 3016.274454][ C1] ret_from_fork+0x34/0x70 [ 3016.274692][ C1] ? __pfx_kthread+0x10/0x10 [ 3016.274941][ C1] ret_from_fork_asm+0x1b/0x30 [ 3016.275202][ C1] [ 3040.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1725s! [swapper/0:0] [ 3040.527912][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3040.529114][ C0] irq event stamp: 27567077 [ 3040.529356][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3040.529887][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3040.530361][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3040.530860][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3040.531365][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3040.531849][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3040.532492][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3040.532831][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3040.533848][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3040.534170][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3040.534587][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3040.535003][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3040.535420][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3040.535837][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3040.536254][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3040.536717][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3040.537071][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3040.537489][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3040.537906][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3040.538331][ C0] Call Trace: [ 3040.538512][ C0] [ 3040.538669][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3040.538943][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3040.539200][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3040.539487][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3040.539774][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3040.540081][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3040.540363][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3040.540687][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3040.540960][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3040.541241][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3040.541569][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3040.541886][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3040.542217][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3040.542525][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3040.542836][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3040.543139][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3040.543463][ C0] ? get_stack_info+0x36/0xc0 [ 3040.543721][ C0] ? lock_acquire+0x1c1/0x220 [ 3040.543977][ C0] ? lock_release+0x1d5/0x250 [ 3040.544232][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3040.544499][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3040.544788][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3040.545090][ C0] ? lock_acquire+0x1c1/0x220 [ 3040.545337][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3040.545588][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3040.545861][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3040.546116][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3040.546380][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3040.546650][ C0] ? __inet_lookup_established+0x341/0x610 [ 3040.546968][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3040.547259][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3040.547553][ C0] ip_local_deliver+0x19d/0x480 [ 3040.547816][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3040.548104][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3040.548375][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3040.548649][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3040.548910][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3040.549253][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3040.549529][ C0] ip_rcv+0x564/0x740 [ 3040.549740][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3040.549979][ C0] ? set_track_prepare+0x8a/0xd0 [ 3040.550243][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3040.550537][ C0] ? rest_init+0x153/0x260 [ 3040.550771][ C0] ? skb_clone+0x10b/0x330 [ 3040.551013][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3040.551357][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3040.551678][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3040.551971][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3040.552280][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3040.552535][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3040.552774][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3040.553089][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3040.553386][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3040.553728][ C0] ? lock_acquire+0x1c1/0x220 [ 3040.553980][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3040.554295][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3040.554592][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3040.554926][ C0] ? __copy_skb_header+0xaf/0x490 [ 3040.555197][ C0] ? __skb_clone+0x57a/0x760 [ 3040.555449][ C0] netif_receive_skb+0x55/0x280 [ 3040.555706][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3040.556032][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3040.556378][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3040.556692][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3040.556976][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3040.557275][ C0] ? hlock_class+0x4e/0x130 [ 3040.557518][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3040.557846][ C0] ? place_entity+0x21/0x2f0 [ 3040.558094][ C0] ? resched_curr+0x219/0x280 [ 3040.558349][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3040.558619][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3040.558901][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3040.559184][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3040.559443][ C0] ? activate_task+0xf5/0x260 [ 3040.559691][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3040.559966][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3040.560243][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3040.560501][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3040.560792][ C0] ? get_stack_info+0x36/0xc0 [ 3040.561048][ C0] ? stack_access_ok+0xda/0x1f0 [ 3040.561316][ C0] ? get_reg+0x119/0x190 [ 3040.561541][ C0] __tcf_classify+0x32c/0x7d0 [ 3040.561796][ C0] tcf_classify+0x283/0x930 [ 3040.562042][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3040.562374][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3040.562639][ C0] ? arch_stack_walk+0x8c/0x100 [ 3040.562900][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3040.563191][ C0] tc_run+0x2e4/0x5d0 [ 3040.563406][ C0] ? __pfx_tc_run+0x10/0x10 [ 3040.563651][ C0] ? lock_acquire+0x1c1/0x220 [ 3040.563902][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3040.564182][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3040.564447][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3040.564733][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3040.565013][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3040.565334][ C0] ? neigh_hh_output+0x348/0x590 [ 3040.565598][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3040.565878][ C0] ip_finish_output2+0x786/0x18e0 [ 3040.566150][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3040.566443][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3040.566795][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3040.567087][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3040.567354][ C0] ? __ip_finish_output+0x10f/0x770 [ 3040.567630][ C0] ip_output+0x16b/0x4f0 [ 3040.567855][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3040.568139][ C0] ? __pfx_ip_output+0x10/0x10 [ 3040.568391][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3040.568694][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3040.568955][ C0] ? ip_local_out+0x114/0x3b0 [ 3040.569209][ C0] __ip_queue_xmit+0x672/0x1910 [ 3040.569471][ C0] ? __skb_clone+0x57a/0x760 [ 3040.569720][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3040.569998][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3040.570291][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3040.570606][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3040.570869][ C0] ? tcp_current_mss+0x40a/0x510 [ 3040.571132][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3040.571419][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3040.571697][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3040.571958][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3040.572229][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3040.572544][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3040.572823][ C0] ? ktime_get+0xb6/0x190 [ 3040.573058][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3040.573331][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3040.573608][ C0] tcp_write_timer+0x82/0x1d0 [ 3040.573860][ C0] call_timer_fn+0x176/0x430 [ 3040.574108][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3040.574384][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3040.574658][ C0] __run_timers.part.0+0x52d/0x890 [ 3040.574928][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3040.575212][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3040.575507][ C0] ? lock_acquire+0x1c1/0x220 [ 3040.575757][ C0] ? clockevents_program_event+0xf6/0x300 [ 3040.576069][ C0] ? lock_release+0x1d5/0x250 [ 3040.576322][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3040.576601][ C0] ? ktime_get+0xb6/0x190 [ 3040.576835][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3040.577137][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3040.577444][ C0] run_timer_softirq+0x72/0x100 [ 3040.577706][ C0] __do_softirq+0x1bc/0x7ff [ 3040.577952][ C0] irq_exit_rcu+0x98/0xc0 [ 3040.578187][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3040.578489][ C0] [ 3040.578646][ C0] [ 3040.578803][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3040.579125][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3040.579395][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3040.580418][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3040.580744][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3040.581169][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3040.581584][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3040.581999][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3040.582415][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3040.582832][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3040.583134][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3040.583404][ C0] default_idle_call+0x69/0xa0 [ 3040.583658][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3040.583922][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3040.584216][ C0] ? lock_release+0x1d5/0x250 [ 3040.584466][ C0] do_idle+0xfb/0x160 [ 3040.584677][ C0] cpu_startup_entry+0x55/0x60 [ 3040.584928][ C0] rest_init+0x153/0x260 [ 3040.585159][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3040.585447][ C0] arch_call_rest_init+0x13/0x40 [ 3040.585714][ C0] start_kernel+0x314/0x3d0 [ 3040.585960][ C0] x86_64_start_reservations+0x18/0x30 [ 3040.586255][ C0] x86_64_start_kernel+0xba/0x110 [ 3040.586522][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3040.586847][ C0] [ 3040.587010][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1725s! [ksoftirqd/1:22] [ 3040.587478][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3040.588677][ C1] irq event stamp: 3886976 [ 3040.588917][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3040.589415][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3040.589910][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3040.590410][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3040.590903][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3040.591405][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3040.592055][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3040.592400][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3040.593430][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3040.593755][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3040.594180][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3040.594606][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3040.595028][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3040.595451][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3040.595876][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3040.596353][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3040.596700][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3040.597129][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3040.597550][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3040.597968][ C1] Call Trace: [ 3040.598146][ C1] [ 3040.598305][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3040.598584][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3040.598838][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3040.599132][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3040.599419][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3040.599720][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3040.600002][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3040.600324][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3040.600600][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3040.600921][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3040.601238][ C1] [ 3040.601395][ C1] [ 3040.601551][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3040.601876][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3040.602184][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3040.602495][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3040.602795][ C1] ? run_ksoftirqd+0xb/0x60 [ 3040.603037][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3040.603359][ C1] ? __orc_find+0x9c/0xf0 [ 3040.603592][ C1] ? lock_acquire+0x1c1/0x220 [ 3040.603845][ C1] ? irqentry_enter+0x2b/0x60 [ 3040.604100][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3040.604361][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3040.604650][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3040.604953][ C1] ? lock_acquire+0x1c1/0x220 [ 3040.605202][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3040.605462][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3040.605734][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3040.605983][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3040.606246][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3040.606522][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3040.606815][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3040.607110][ C1] ip_local_deliver+0x19d/0x480 [ 3040.607368][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3040.607651][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3040.607914][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3040.608197][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3040.608463][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3040.608799][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3040.609078][ C1] ip_rcv+0x564/0x740 [ 3040.609295][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3040.609540][ C1] ? set_track_prepare+0x8a/0xd0 [ 3040.609812][ C1] ? irqentry_enter+0x2b/0x60 [ 3040.610064][ C1] ? irqentry_enter+0x2b/0x60 [ 3040.610316][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3040.610556][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3040.610870][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3040.611215][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3040.611527][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3040.611865][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3040.612164][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3040.612500][ C1] netif_receive_skb+0x55/0x280 [ 3040.612760][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3040.613092][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3040.613442][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3040.613754][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3040.614049][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3040.614360][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3040.614695][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3040.614980][ C1] ? arch_stack_walk+0x68/0x100 [ 3040.615243][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3040.615521][ C1] ? irqentry_enter+0x2b/0x60 [ 3040.615771][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3040.616090][ C1] ? irqentry_enter+0x2b/0x60 [ 3040.616341][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3040.616669][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3040.616950][ C1] ? arch_stack_walk+0x68/0x100 [ 3040.617214][ C1] __tcf_classify+0x32c/0x7d0 [ 3040.617468][ C1] tcf_classify+0x283/0x930 [ 3040.617716][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3040.617988][ C1] tc_run+0x2e4/0x5d0 [ 3040.618208][ C1] ? __pfx_tc_run+0x10/0x10 [ 3040.618455][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3040.618725][ C1] ? irqentry_enter+0x2b/0x60 [ 3040.618975][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3040.619263][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3040.619583][ C1] ip_finish_output2+0x786/0x18e0 [ 3040.619858][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3040.620152][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3040.620416][ C1] ? __ip_finish_output+0x10f/0x770 [ 3040.620697][ C1] ip_output+0x16b/0x4f0 [ 3040.620926][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3040.621249][ C1] ? __pfx_ip_output+0x10/0x10 [ 3040.621503][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3040.621862][ C1] ? __pfx_ip_output+0x10/0x10 [ 3040.622122][ C1] __ip_queue_xmit+0x672/0x1910 [ 3040.622384][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3040.622664][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3040.622958][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3040.623244][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3040.623537][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3040.623819][ C1] tcp_delack_timer+0x84/0x240 [ 3040.624074][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3040.624364][ C1] call_timer_fn+0x176/0x430 [ 3040.624615][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3040.624888][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3040.625170][ C1] __run_timers.part.0+0x52d/0x890 [ 3040.625444][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3040.625728][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3040.626031][ C1] ? __pfx___schedule+0x10/0x10 [ 3040.626295][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3040.626621][ C1] run_timer_softirq+0x72/0x100 [ 3040.626882][ C1] __do_softirq+0x1bc/0x7ff [ 3040.627127][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3040.627400][ C1] run_ksoftirqd+0x2e/0x60 [ 3040.627640][ C1] smpboot_thread_fn+0x30e/0x840 [ 3040.627905][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3040.628199][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3040.628488][ C1] kthread+0x292/0x360 [ 3040.628710][ C1] ? __pfx_kthread+0x10/0x10 [ 3040.628959][ C1] ret_from_fork+0x34/0x70 [ 3040.629200][ C1] ? __pfx_kthread+0x10/0x10 [ 3040.629444][ C1] ret_from_fork_asm+0x1b/0x30 [ 3040.629705][ C1] [ 3068.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1751s! [swapper/0:0] [ 3068.527929][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3068.529127][ C0] irq event stamp: 27567077 [ 3068.529369][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3068.529901][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3068.530374][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3068.530879][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3068.531383][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3068.531862][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3068.532500][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3068.532838][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3068.533852][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3068.534173][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3068.534589][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3068.535011][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3068.535433][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3068.535848][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3068.536265][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3068.536732][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3068.537081][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3068.537500][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3068.537924][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3068.538347][ C0] Call Trace: [ 3068.538529][ C0] [ 3068.538687][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3068.538962][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3068.539222][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3068.539512][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3068.539801][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3068.540105][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3068.540387][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3068.540712][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3068.540987][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3068.541271][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3068.541596][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3068.541910][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3068.542241][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3068.542546][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3068.542863][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3068.543164][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3068.543495][ C0] ? get_stack_info+0x36/0xc0 [ 3068.543753][ C0] ? lock_acquire+0x1c1/0x220 [ 3068.544006][ C0] ? lock_release+0x1d5/0x250 [ 3068.544259][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3068.544521][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3068.544808][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3068.545109][ C0] ? lock_acquire+0x1c1/0x220 [ 3068.545357][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3068.545609][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3068.545880][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3068.546128][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3068.546388][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3068.546662][ C0] ? __inet_lookup_established+0x341/0x610 [ 3068.546975][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3068.547262][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3068.547549][ C0] ip_local_deliver+0x19d/0x480 [ 3068.547811][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3068.548100][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3068.548369][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3068.548652][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3068.548915][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3068.549255][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3068.549535][ C0] ip_rcv+0x564/0x740 [ 3068.549749][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3068.549991][ C0] ? set_track_prepare+0x8a/0xd0 [ 3068.550257][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3068.550548][ C0] ? rest_init+0x153/0x260 [ 3068.550785][ C0] ? skb_clone+0x10b/0x330 [ 3068.551033][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3068.551372][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3068.551696][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3068.551990][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3068.552298][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3068.552557][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3068.552799][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3068.553111][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3068.553408][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3068.553751][ C0] ? lock_acquire+0x1c1/0x220 [ 3068.554004][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3068.554316][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3068.554611][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3068.554944][ C0] ? __copy_skb_header+0xaf/0x490 [ 3068.555215][ C0] ? __skb_clone+0x57a/0x760 [ 3068.555468][ C0] netif_receive_skb+0x55/0x280 [ 3068.555727][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3068.556054][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3068.556401][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3068.556720][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3068.557007][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3068.557308][ C0] ? hlock_class+0x4e/0x130 [ 3068.557554][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3068.557880][ C0] ? place_entity+0x21/0x2f0 [ 3068.558125][ C0] ? resched_curr+0x219/0x280 [ 3068.558379][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3068.558651][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3068.558936][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3068.559214][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3068.559471][ C0] ? activate_task+0xf5/0x260 [ 3068.559723][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3068.559999][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3068.560274][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3068.560533][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3068.560820][ C0] ? get_stack_info+0x36/0xc0 [ 3068.561080][ C0] ? stack_access_ok+0xda/0x1f0 [ 3068.561335][ C0] ? get_reg+0x119/0x190 [ 3068.561561][ C0] __tcf_classify+0x32c/0x7d0 [ 3068.561816][ C0] tcf_classify+0x283/0x930 [ 3068.562063][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3068.562398][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3068.562664][ C0] ? arch_stack_walk+0x8c/0x100 [ 3068.562922][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3068.563211][ C0] tc_run+0x2e4/0x5d0 [ 3068.563434][ C0] ? __pfx_tc_run+0x10/0x10 [ 3068.563680][ C0] ? lock_acquire+0x1c1/0x220 [ 3068.563932][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3068.564215][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3068.564479][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3068.564768][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3068.565048][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3068.565372][ C0] ? neigh_hh_output+0x348/0x590 [ 3068.565635][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3068.565915][ C0] ip_finish_output2+0x786/0x18e0 [ 3068.566186][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3068.566481][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3068.566833][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3068.567120][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3068.567386][ C0] ? __ip_finish_output+0x10f/0x770 [ 3068.567662][ C0] ip_output+0x16b/0x4f0 [ 3068.567887][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3068.568172][ C0] ? __pfx_ip_output+0x10/0x10 [ 3068.568428][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3068.568728][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3068.568991][ C0] ? ip_local_out+0x114/0x3b0 [ 3068.569248][ C0] __ip_queue_xmit+0x672/0x1910 [ 3068.569511][ C0] ? __skb_clone+0x57a/0x760 [ 3068.569761][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3068.570041][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3068.570336][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3068.570654][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3068.570916][ C0] ? tcp_current_mss+0x40a/0x510 [ 3068.571187][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3068.571469][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3068.571747][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3068.572006][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3068.572274][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3068.572593][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3068.572873][ C0] ? ktime_get+0xb6/0x190 [ 3068.573110][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3068.573387][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3068.573670][ C0] tcp_write_timer+0x82/0x1d0 [ 3068.573927][ C0] call_timer_fn+0x176/0x430 [ 3068.574177][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3068.574449][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3068.574727][ C0] __run_timers.part.0+0x52d/0x890 [ 3068.574999][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3068.575285][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3068.575584][ C0] ? lock_acquire+0x1c1/0x220 [ 3068.575838][ C0] ? clockevents_program_event+0xf6/0x300 [ 3068.576145][ C0] ? lock_release+0x1d5/0x250 [ 3068.576397][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3068.576680][ C0] ? ktime_get+0xb6/0x190 [ 3068.576913][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3068.577214][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3068.577524][ C0] run_timer_softirq+0x72/0x100 [ 3068.577789][ C0] __do_softirq+0x1bc/0x7ff [ 3068.578036][ C0] irq_exit_rcu+0x98/0xc0 [ 3068.578274][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3068.578577][ C0] [ 3068.578733][ C0] [ 3068.578889][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3068.579208][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3068.579482][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3068.580508][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3068.580834][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3068.581264][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3068.581680][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3068.582096][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3068.582513][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3068.582932][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3068.583234][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3068.583508][ C0] default_idle_call+0x69/0xa0 [ 3068.583774][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3068.584036][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3068.584329][ C0] ? lock_release+0x1d5/0x250 [ 3068.584578][ C0] do_idle+0xfb/0x160 [ 3068.584790][ C0] cpu_startup_entry+0x55/0x60 [ 3068.585049][ C0] rest_init+0x153/0x260 [ 3068.585274][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3068.585559][ C0] arch_call_rest_init+0x13/0x40 [ 3068.585825][ C0] start_kernel+0x314/0x3d0 [ 3068.586071][ C0] x86_64_start_reservations+0x18/0x30 [ 3068.586366][ C0] x86_64_start_kernel+0xba/0x110 [ 3068.586633][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3068.586961][ C0] [ 3068.587126][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1751s! [ksoftirqd/1:22] [ 3068.587601][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3068.588801][ C1] irq event stamp: 3886976 [ 3068.589041][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3068.589538][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3068.590032][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3068.590528][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3068.591029][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3068.591527][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3068.592177][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3068.592524][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3068.593554][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3068.593879][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3068.594307][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3068.594728][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3068.595153][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3068.595579][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3068.596005][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3068.596486][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3068.596835][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3068.597271][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3068.597692][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3068.598112][ C1] Call Trace: [ 3068.598290][ C1] [ 3068.598445][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3068.598726][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3068.598981][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3068.599276][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3068.599561][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3068.599863][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3068.600141][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3068.600461][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3068.600740][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3068.601070][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3068.601386][ C1] [ 3068.601543][ C1] [ 3068.601701][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3068.602031][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3068.602341][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3068.602654][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3068.602957][ C1] ? run_ksoftirqd+0xb/0x60 [ 3068.603206][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3068.603532][ C1] ? __orc_find+0x9c/0xf0 [ 3068.603769][ C1] ? lock_acquire+0x1c1/0x220 [ 3068.604023][ C1] ? irqentry_enter+0x2b/0x60 [ 3068.604278][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3068.604542][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3068.604832][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3068.605138][ C1] ? lock_acquire+0x1c1/0x220 [ 3068.605389][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3068.605644][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3068.605918][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3068.606170][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3068.606433][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3068.606709][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3068.607002][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3068.607297][ C1] ip_local_deliver+0x19d/0x480 [ 3068.607557][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3068.607841][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3068.608110][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3068.608392][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3068.608661][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3068.608996][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3068.609275][ C1] ip_rcv+0x564/0x740 [ 3068.609495][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3068.609742][ C1] ? set_track_prepare+0x8a/0xd0 [ 3068.610013][ C1] ? irqentry_enter+0x2b/0x60 [ 3068.610267][ C1] ? irqentry_enter+0x2b/0x60 [ 3068.610519][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3068.610763][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3068.611088][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3068.611433][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3068.611748][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3068.612088][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3068.612387][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3068.612724][ C1] netif_receive_skb+0x55/0x280 [ 3068.612986][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3068.613320][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3068.613675][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3068.613992][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3068.614287][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3068.614593][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3068.614928][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3068.615214][ C1] ? arch_stack_walk+0x68/0x100 [ 3068.615477][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3068.615755][ C1] ? irqentry_enter+0x2b/0x60 [ 3068.616006][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3068.616329][ C1] ? irqentry_enter+0x2b/0x60 [ 3068.616584][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3068.616910][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3068.617193][ C1] ? arch_stack_walk+0x68/0x100 [ 3068.617456][ C1] __tcf_classify+0x32c/0x7d0 [ 3068.617710][ C1] tcf_classify+0x283/0x930 [ 3068.617961][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3068.618236][ C1] tc_run+0x2e4/0x5d0 [ 3068.618458][ C1] ? __pfx_tc_run+0x10/0x10 [ 3068.618706][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3068.618977][ C1] ? irqentry_enter+0x2b/0x60 [ 3068.619231][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3068.619518][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3068.619840][ C1] ip_finish_output2+0x786/0x18e0 [ 3068.620118][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3068.620410][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3068.620674][ C1] ? __ip_finish_output+0x10f/0x770 [ 3068.620956][ C1] ip_output+0x16b/0x4f0 [ 3068.621197][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3068.621517][ C1] ? __pfx_ip_output+0x10/0x10 [ 3068.621773][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3068.622131][ C1] ? __pfx_ip_output+0x10/0x10 [ 3068.622390][ C1] __ip_queue_xmit+0x672/0x1910 [ 3068.622650][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3068.622931][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3068.623227][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3068.623511][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3068.623807][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3068.624095][ C1] tcp_delack_timer+0x84/0x240 [ 3068.624353][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3068.624644][ C1] call_timer_fn+0x176/0x430 [ 3068.624897][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3068.625173][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3068.625455][ C1] __run_timers.part.0+0x52d/0x890 [ 3068.625731][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3068.626020][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3068.626327][ C1] ? __pfx___schedule+0x10/0x10 [ 3068.626590][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3068.626915][ C1] run_timer_softirq+0x72/0x100 [ 3068.627176][ C1] __do_softirq+0x1bc/0x7ff [ 3068.627417][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3068.627691][ C1] run_ksoftirqd+0x2e/0x60 [ 3068.627933][ C1] smpboot_thread_fn+0x30e/0x840 [ 3068.628198][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3068.628497][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3068.628790][ C1] kthread+0x292/0x360 [ 3068.629009][ C1] ? __pfx_kthread+0x10/0x10 [ 3068.629255][ C1] ret_from_fork+0x34/0x70 [ 3068.629497][ C1] ? __pfx_kthread+0x10/0x10 [ 3068.629743][ C1] ret_from_fork_asm+0x1b/0x30 [ 3068.630007][ C1] [ 3094.277025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3094.277417][ C1] rcu: 1-....: (1895779 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=457604 [ 3094.278005][ C1] rcu: (t=1899968 jiffies g=1007429 q=31 ncpus=4) [ 3094.278358][ C1] Sending NMI from CPU 1 to CPUs 0: [ 3094.278642][ C0] NMI backtrace for cpu 0 [ 3094.278650][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3094.278655][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3094.278658][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3094.278667][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3094.278671][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3094.278674][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3094.278676][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3094.278677][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3094.278679][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3094.278681][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3094.278683][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3094.278686][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3094.278690][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3094.278692][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3094.278693][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3094.278695][ C0] Call Trace: [ 3094.278698][ C0] [ 3094.278702][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 3094.278708][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3094.278714][ C0] ? nmi_handle+0x156/0x420 [ 3094.278719][ C0] ? default_do_nmi+0x41/0x100 [ 3094.278724][ C0] ? exc_nmi+0xf3/0x120 [ 3094.278727][ C0] ? end_repeat_nmi+0xf/0x60 [ 3094.278731][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3094.278736][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3094.278739][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3094.278743][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3094.278746][ C0] [ 3094.278747][ C0] [ 3094.278748][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3094.278751][ C0] ? get_stack_info+0x36/0xc0 [ 3094.278756][ C0] ? lock_acquire+0x1c1/0x220 [ 3094.278761][ C0] ? lock_release+0x1d5/0x250 [ 3094.278764][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3094.278768][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3094.278771][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3094.278775][ C0] ? lock_acquire+0x1c1/0x220 [ 3094.278777][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3094.278783][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3094.278786][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3094.278794][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3094.278796][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3094.278800][ C0] ? __inet_lookup_established+0x341/0x610 [ 3094.278807][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3094.278815][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3094.278819][ C0] ip_local_deliver+0x19d/0x480 [ 3094.278822][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3094.278825][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3094.278831][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3094.278835][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3094.278838][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3094.278841][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3094.278852][ C0] ip_rcv+0x564/0x740 [ 3094.278855][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3094.278858][ C0] ? set_track_prepare+0x8a/0xd0 [ 3094.278863][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3094.278865][ C0] ? rest_init+0x153/0x260 [ 3094.278868][ C0] ? skb_clone+0x10b/0x330 [ 3094.278874][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3094.278880][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3094.278885][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3094.278890][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3094.278899][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3094.278902][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3094.278905][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3094.278909][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3094.278913][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3094.278916][ C0] ? lock_acquire+0x1c1/0x220 [ 3094.278918][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3094.278921][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3094.278925][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3094.278928][ C0] ? __copy_skb_header+0xaf/0x490 [ 3094.278932][ C0] ? __skb_clone+0x57a/0x760 [ 3094.278934][ C0] netif_receive_skb+0x55/0x280 [ 3094.278937][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3094.278946][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3094.278953][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3094.278960][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3094.278965][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3094.278974][ C0] ? hlock_class+0x4e/0x130 [ 3094.278980][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3094.278990][ C0] ? place_entity+0x21/0x2f0 [ 3094.278993][ C0] ? resched_curr+0x219/0x280 [ 3094.278997][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3094.279000][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3094.279003][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3094.279008][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3094.279010][ C0] ? activate_task+0xf5/0x260 [ 3094.279014][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3094.279019][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3094.279024][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3094.279028][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3094.279031][ C0] ? get_stack_info+0x36/0xc0 [ 3094.279034][ C0] ? stack_access_ok+0xda/0x1f0 [ 3094.279037][ C0] ? get_reg+0x119/0x190 [ 3094.279040][ C0] __tcf_classify+0x32c/0x7d0 [ 3094.279045][ C0] tcf_classify+0x283/0x930 [ 3094.279048][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3094.279054][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3094.279056][ C0] ? arch_stack_walk+0x8c/0x100 [ 3094.279061][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3094.279064][ C0] tc_run+0x2e4/0x5d0 [ 3094.279069][ C0] ? __pfx_tc_run+0x10/0x10 [ 3094.279072][ C0] ? lock_acquire+0x1c1/0x220 [ 3094.279074][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3094.279079][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3094.279085][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3094.279088][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3094.279092][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3094.279096][ C0] ? neigh_hh_output+0x348/0x590 [ 3094.279100][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3094.279104][ C0] ip_finish_output2+0x786/0x18e0 [ 3094.279108][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3094.279113][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3094.279121][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3094.279124][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3094.279128][ C0] ? __ip_finish_output+0x10f/0x770 [ 3094.279132][ C0] ip_output+0x16b/0x4f0 [ 3094.279135][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3094.279140][ C0] ? __pfx_ip_output+0x10/0x10 [ 3094.279143][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3094.279148][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3094.279151][ C0] ? ip_local_out+0x114/0x3b0 [ 3094.279155][ C0] __ip_queue_xmit+0x672/0x1910 [ 3094.279159][ C0] ? __skb_clone+0x57a/0x760 [ 3094.279162][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3094.279170][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3094.279174][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3094.279178][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3094.279184][ C0] ? tcp_current_mss+0x40a/0x510 [ 3094.279187][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3094.279190][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3094.279192][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3094.279195][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3094.279197][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3094.279201][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3094.279206][ C0] ? ktime_get+0xb6/0x190 [ 3094.279210][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3094.279214][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3094.279217][ C0] tcp_write_timer+0x82/0x1d0 [ 3094.279222][ C0] call_timer_fn+0x176/0x430 [ 3094.279225][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3094.279230][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3094.279234][ C0] __run_timers.part.0+0x52d/0x890 [ 3094.279237][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3094.279242][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3094.279245][ C0] ? lock_acquire+0x1c1/0x220 [ 3094.279247][ C0] ? clockevents_program_event+0xf6/0x300 [ 3094.279252][ C0] ? lock_release+0x1d5/0x250 [ 3094.279254][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3094.279257][ C0] ? ktime_get+0xb6/0x190 [ 3094.279260][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3094.279264][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3094.279268][ C0] run_timer_softirq+0x72/0x100 [ 3094.279272][ C0] __do_softirq+0x1bc/0x7ff [ 3094.279276][ C0] irq_exit_rcu+0x98/0xc0 [ 3094.279279][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3094.279282][ C0] [ 3094.279283][ C0] [ 3094.279284][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3094.279290][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3094.279293][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3094.279296][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3094.279298][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3094.279299][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3094.279301][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3094.279302][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3094.279303][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3094.279307][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3094.279310][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3094.279314][ C0] default_idle_call+0x69/0xa0 [ 3094.279316][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3094.279318][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3094.279324][ C0] ? lock_release+0x1d5/0x250 [ 3094.279328][ C0] do_idle+0xfb/0x160 [ 3094.279330][ C0] cpu_startup_entry+0x55/0x60 [ 3094.279333][ C0] rest_init+0x153/0x260 [ 3094.279335][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3094.279342][ C0] arch_call_rest_init+0x13/0x40 [ 3094.279347][ C0] start_kernel+0x314/0x3d0 [ 3094.279351][ C0] x86_64_start_reservations+0x18/0x30 [ 3094.279355][ C0] x86_64_start_kernel+0xba/0x110 [ 3094.279359][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3094.279367][ C0] [ 3094.279639][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3094.333801][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3094.334450][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3094.334795][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3094.335809][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3094.336134][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3094.336551][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3094.336976][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3094.337395][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3094.337812][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3094.338231][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3094.338700][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3094.339054][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3094.339474][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3094.339896][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3094.340321][ C1] Call Trace: [ 3094.340508][ C1] [ 3094.340666][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3094.340956][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3094.341221][ C1] ? check_cpu_stall+0x284/0x500 [ 3094.341486][ C1] ? rcu_pending+0x92/0x360 [ 3094.341726][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3094.342009][ C1] ? update_process_times+0xb9/0x110 [ 3094.342295][ C1] ? tick_sched_handle+0x67/0x130 [ 3094.342563][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3094.342858][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3094.343117][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3094.343442][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3094.343731][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3094.344038][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3094.344318][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3094.344639][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3094.344911][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3094.345241][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3094.345553][ C1] [ 3094.345712][ C1] [ 3094.345868][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3094.346198][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3094.346504][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3094.346816][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3094.347119][ C1] ? run_ksoftirqd+0xb/0x60 [ 3094.347359][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3094.347685][ C1] ? __orc_find+0x9c/0xf0 [ 3094.347917][ C1] ? lock_acquire+0x1c1/0x220 [ 3094.348175][ C1] ? irqentry_enter+0x2b/0x60 [ 3094.348431][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3094.348694][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3094.348981][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3094.349281][ C1] ? lock_acquire+0x1c1/0x220 [ 3094.349527][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3094.349777][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3094.350049][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3094.350300][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3094.350563][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3094.350836][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3094.351132][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3094.351421][ C1] ip_local_deliver+0x19d/0x480 [ 3094.351689][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3094.351978][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3094.352246][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3094.352521][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3094.352783][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3094.353126][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3094.353401][ C1] ip_rcv+0x564/0x740 [ 3094.353616][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3094.353856][ C1] ? set_track_prepare+0x8a/0xd0 [ 3094.354121][ C1] ? irqentry_enter+0x2b/0x60 [ 3094.354374][ C1] ? irqentry_enter+0x2b/0x60 [ 3094.354628][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3094.354872][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3094.355192][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3094.355537][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3094.355848][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3094.356186][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3094.356484][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3094.356821][ C1] netif_receive_skb+0x55/0x280 [ 3094.357085][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3094.357418][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3094.357768][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3094.358083][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3094.358379][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3094.358688][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3094.359018][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3094.359304][ C1] ? arch_stack_walk+0x68/0x100 [ 3094.359563][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3094.359837][ C1] ? irqentry_enter+0x2b/0x60 [ 3094.360086][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3094.360404][ C1] ? irqentry_enter+0x2b/0x60 [ 3094.360660][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3094.360987][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3094.361271][ C1] ? arch_stack_walk+0x68/0x100 [ 3094.361530][ C1] __tcf_classify+0x32c/0x7d0 [ 3094.361783][ C1] tcf_classify+0x283/0x930 [ 3094.362024][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3094.362292][ C1] tc_run+0x2e4/0x5d0 [ 3094.362505][ C1] ? __pfx_tc_run+0x10/0x10 [ 3094.362748][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3094.363013][ C1] ? irqentry_enter+0x2b/0x60 [ 3094.363267][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3094.363554][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3094.363880][ C1] ip_finish_output2+0x786/0x18e0 [ 3094.364151][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3094.364439][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3094.364710][ C1] ? __ip_finish_output+0x10f/0x770 [ 3094.364988][ C1] ip_output+0x16b/0x4f0 [ 3094.365216][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3094.365539][ C1] ? __pfx_ip_output+0x10/0x10 [ 3094.365795][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3094.366152][ C1] ? __pfx_ip_output+0x10/0x10 [ 3094.366413][ C1] __ip_queue_xmit+0x672/0x1910 [ 3094.366674][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3094.366957][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3094.367253][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3094.367540][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3094.367834][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3094.368119][ C1] tcp_delack_timer+0x84/0x240 [ 3094.368372][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3094.368659][ C1] call_timer_fn+0x176/0x430 [ 3094.368909][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3094.369187][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3094.369468][ C1] __run_timers.part.0+0x52d/0x890 [ 3094.369744][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3094.370030][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3094.370330][ C1] ? __pfx___schedule+0x10/0x10 [ 3094.370595][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3094.370921][ C1] run_timer_softirq+0x72/0x100 [ 3094.371186][ C1] __do_softirq+0x1bc/0x7ff [ 3094.371433][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3094.371710][ C1] run_ksoftirqd+0x2e/0x60 [ 3094.371948][ C1] smpboot_thread_fn+0x30e/0x840 [ 3094.372219][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3094.372510][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3094.372802][ C1] kthread+0x292/0x360 [ 3094.373019][ C1] ? __pfx_kthread+0x10/0x10 [ 3094.373269][ C1] ret_from_fork+0x34/0x70 [ 3094.373506][ C1] ? __pfx_kthread+0x10/0x10 [ 3094.373754][ C1] ret_from_fork_asm+0x1b/0x30 [ 3094.374014][ C1] [ 3120.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1800s! [swapper/0:0] [ 3120.527913][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3120.529103][ C0] irq event stamp: 27567077 [ 3120.529342][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3120.529868][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3120.530347][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3120.530858][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3120.531350][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3120.531828][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3120.532474][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3120.532817][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3120.533841][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3120.534165][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3120.534589][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3120.535009][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3120.535429][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3120.535852][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3120.536278][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3120.536750][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3120.537099][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3120.537531][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3120.537951][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3120.538373][ C0] Call Trace: [ 3120.538551][ C0] [ 3120.538705][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3120.538984][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3120.539238][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3120.539531][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3120.539815][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3120.540119][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3120.540395][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3120.540713][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3120.540995][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3120.541274][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3120.541599][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3120.541907][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3120.542241][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3120.542541][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3120.542850][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3120.543155][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3120.543483][ C0] ? get_stack_info+0x36/0xc0 [ 3120.543733][ C0] ? lock_acquire+0x1c1/0x220 [ 3120.543982][ C0] ? lock_release+0x1d5/0x250 [ 3120.544230][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3120.544489][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3120.544773][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3120.545071][ C0] ? lock_acquire+0x1c1/0x220 [ 3120.545323][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3120.545578][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3120.545854][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3120.546097][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3120.546355][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3120.546627][ C0] ? __inet_lookup_established+0x341/0x610 [ 3120.546939][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3120.547234][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3120.547528][ C0] ip_local_deliver+0x19d/0x480 [ 3120.547787][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3120.548072][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3120.548337][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3120.548616][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3120.548880][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3120.549213][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3120.549491][ C0] ip_rcv+0x564/0x740 [ 3120.549706][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3120.549949][ C0] ? set_track_prepare+0x8a/0xd0 [ 3120.550216][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3120.550502][ C0] ? rest_init+0x153/0x260 [ 3120.550743][ C0] ? skb_clone+0x10b/0x330 [ 3120.550991][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3120.551323][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3120.551641][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3120.551940][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3120.552252][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3120.552513][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3120.552757][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3120.553077][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3120.553379][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3120.553718][ C0] ? lock_acquire+0x1c1/0x220 [ 3120.553963][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3120.554271][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3120.554574][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3120.554910][ C0] ? __copy_skb_header+0xaf/0x490 [ 3120.555177][ C0] ? __skb_clone+0x57a/0x760 [ 3120.555419][ C0] netif_receive_skb+0x55/0x280 [ 3120.555680][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3120.556008][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3120.556360][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3120.556672][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3120.556962][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3120.557262][ C0] ? hlock_class+0x4e/0x130 [ 3120.557509][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3120.557843][ C0] ? place_entity+0x21/0x2f0 [ 3120.558093][ C0] ? resched_curr+0x219/0x280 [ 3120.558344][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3120.558610][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3120.558889][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3120.559171][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3120.559432][ C0] ? activate_task+0xf5/0x260 [ 3120.559684][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3120.559961][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3120.560231][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3120.560492][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3120.560792][ C0] ? get_stack_info+0x36/0xc0 [ 3120.561048][ C0] ? stack_access_ok+0xda/0x1f0 [ 3120.561311][ C0] ? get_reg+0x119/0x190 [ 3120.561538][ C0] __tcf_classify+0x32c/0x7d0 [ 3120.561787][ C0] tcf_classify+0x283/0x930 [ 3120.562026][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3120.562354][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3120.562623][ C0] ? arch_stack_walk+0x8c/0x100 [ 3120.562890][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3120.563183][ C0] tc_run+0x2e4/0x5d0 [ 3120.563396][ C0] ? __pfx_tc_run+0x10/0x10 [ 3120.563642][ C0] ? lock_acquire+0x1c1/0x220 [ 3120.563891][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3120.564165][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3120.564435][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3120.564719][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3120.564996][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3120.565313][ C0] ? neigh_hh_output+0x348/0x590 [ 3120.565580][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3120.565854][ C0] ip_finish_output2+0x786/0x18e0 [ 3120.566120][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3120.566412][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3120.566768][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3120.567062][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3120.567325][ C0] ? __ip_finish_output+0x10f/0x770 [ 3120.567605][ C0] ip_output+0x16b/0x4f0 [ 3120.567832][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3120.568110][ C0] ? __pfx_ip_output+0x10/0x10 [ 3120.568365][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3120.568665][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3120.568932][ C0] ? ip_local_out+0x114/0x3b0 [ 3120.569181][ C0] __ip_queue_xmit+0x672/0x1910 [ 3120.569438][ C0] ? __skb_clone+0x57a/0x760 [ 3120.569680][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3120.569963][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3120.570260][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3120.570582][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3120.570845][ C0] ? tcp_current_mss+0x40a/0x510 [ 3120.571109][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3120.571391][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3120.571665][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3120.571919][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3120.572189][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3120.572508][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3120.572787][ C0] ? ktime_get+0xb6/0x190 [ 3120.573017][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3120.573289][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3120.573572][ C0] tcp_write_timer+0x82/0x1d0 [ 3120.573822][ C0] call_timer_fn+0x176/0x430 [ 3120.574067][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3120.574343][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3120.574616][ C0] __run_timers.part.0+0x52d/0x890 [ 3120.574890][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3120.575174][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3120.575475][ C0] ? lock_acquire+0x1c1/0x220 [ 3120.575722][ C0] ? clockevents_program_event+0xf6/0x300 [ 3120.576025][ C0] ? lock_release+0x1d5/0x250 [ 3120.576279][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3120.576554][ C0] ? ktime_get+0xb6/0x190 [ 3120.576783][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3120.577081][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3120.577395][ C0] run_timer_softirq+0x72/0x100 [ 3120.577655][ C0] __do_softirq+0x1bc/0x7ff [ 3120.577897][ C0] irq_exit_rcu+0x98/0xc0 [ 3120.578127][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3120.578427][ C0] [ 3120.578585][ C0] [ 3120.578746][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3120.579069][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3120.579341][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3120.580354][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3120.580677][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3120.581108][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3120.581527][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3120.581950][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3120.582374][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3120.582795][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3120.583100][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3120.583382][ C0] default_idle_call+0x69/0xa0 [ 3120.583633][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3120.583898][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3120.584190][ C0] ? lock_release+0x1d5/0x250 [ 3120.584446][ C0] do_idle+0xfb/0x160 [ 3120.584661][ C0] cpu_startup_entry+0x55/0x60 [ 3120.584917][ C0] rest_init+0x153/0x260 [ 3120.585143][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3120.585435][ C0] arch_call_rest_init+0x13/0x40 [ 3120.585702][ C0] start_kernel+0x314/0x3d0 [ 3120.585942][ C0] x86_64_start_reservations+0x18/0x30 [ 3120.586232][ C0] x86_64_start_kernel+0xba/0x110 [ 3120.586502][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3120.586830][ C0] [ 3120.586998][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1800s! [ksoftirqd/1:22] [ 3120.587466][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3120.588658][ C1] irq event stamp: 3886976 [ 3120.588893][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3120.589396][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3120.589894][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3120.590398][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3120.590891][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3120.591382][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3120.592026][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3120.592366][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3120.593386][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3120.593710][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3120.594129][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3120.594547][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3120.594968][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3120.595388][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3120.595806][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3120.596277][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3120.596631][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3120.597053][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3120.597475][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3120.597902][ C1] Call Trace: [ 3120.598090][ C1] [ 3120.598247][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3120.598524][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3120.598781][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3120.599072][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3120.599363][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3120.599671][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3120.599956][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3120.600281][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3120.600556][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3120.600888][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3120.601200][ C1] [ 3120.601359][ C1] [ 3120.601519][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3120.601854][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3120.602160][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3120.602470][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3120.602775][ C1] ? run_ksoftirqd+0xb/0x60 [ 3120.603022][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3120.603354][ C1] ? __orc_find+0x9c/0xf0 [ 3120.603584][ C1] ? lock_acquire+0x1c1/0x220 [ 3120.603837][ C1] ? irqentry_enter+0x2b/0x60 [ 3120.604092][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3120.604354][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3120.604640][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3120.604939][ C1] ? lock_acquire+0x1c1/0x220 [ 3120.605192][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3120.605447][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3120.605723][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3120.605971][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3120.606232][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3120.606503][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3120.606790][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3120.607082][ C1] ip_local_deliver+0x19d/0x480 [ 3120.607347][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3120.607637][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3120.607904][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3120.608184][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3120.608447][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3120.608787][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3120.609062][ C1] ip_rcv+0x564/0x740 [ 3120.609275][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3120.609516][ C1] ? set_track_prepare+0x8a/0xd0 [ 3120.609781][ C1] ? irqentry_enter+0x2b/0x60 [ 3120.610035][ C1] ? irqentry_enter+0x2b/0x60 [ 3120.610289][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3120.610534][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3120.610858][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3120.611199][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3120.611509][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3120.611853][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3120.612158][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3120.612494][ C1] netif_receive_skb+0x55/0x280 [ 3120.612754][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3120.613085][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3120.613433][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3120.613751][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3120.614040][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3120.614344][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3120.614671][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3120.614951][ C1] ? arch_stack_walk+0x68/0x100 [ 3120.615215][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3120.615496][ C1] ? irqentry_enter+0x2b/0x60 [ 3120.615749][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3120.616076][ C1] ? irqentry_enter+0x2b/0x60 [ 3120.616328][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3120.616650][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3120.616934][ C1] ? arch_stack_walk+0x68/0x100 [ 3120.617196][ C1] __tcf_classify+0x32c/0x7d0 [ 3120.617449][ C1] tcf_classify+0x283/0x930 [ 3120.617692][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3120.617960][ C1] tc_run+0x2e4/0x5d0 [ 3120.618175][ C1] ? __pfx_tc_run+0x10/0x10 [ 3120.618419][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3120.618686][ C1] ? irqentry_enter+0x2b/0x60 [ 3120.618939][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3120.619228][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3120.619555][ C1] ip_finish_output2+0x786/0x18e0 [ 3120.619826][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3120.620116][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3120.620385][ C1] ? __ip_finish_output+0x10f/0x770 [ 3120.620664][ C1] ip_output+0x16b/0x4f0 [ 3120.620899][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3120.621222][ C1] ? __pfx_ip_output+0x10/0x10 [ 3120.621482][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3120.621834][ C1] ? __pfx_ip_output+0x10/0x10 [ 3120.622091][ C1] __ip_queue_xmit+0x672/0x1910 [ 3120.622360][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3120.622645][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3120.622947][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3120.623239][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3120.623538][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3120.623828][ C1] tcp_delack_timer+0x84/0x240 [ 3120.624088][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3120.624373][ C1] call_timer_fn+0x176/0x430 [ 3120.624620][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3120.624899][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3120.625177][ C1] __run_timers.part.0+0x52d/0x890 [ 3120.625449][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3120.625741][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3120.626045][ C1] ? __pfx___schedule+0x10/0x10 [ 3120.626305][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3120.626624][ C1] run_timer_softirq+0x72/0x100 [ 3120.626887][ C1] __do_softirq+0x1bc/0x7ff [ 3120.627135][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3120.627412][ C1] run_ksoftirqd+0x2e/0x60 [ 3120.627651][ C1] smpboot_thread_fn+0x30e/0x840 [ 3120.627920][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3120.628213][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3120.628506][ C1] kthread+0x292/0x360 [ 3120.628724][ C1] ? __pfx_kthread+0x10/0x10 [ 3120.628973][ C1] ret_from_fork+0x34/0x70 [ 3120.629211][ C1] ? __pfx_kthread+0x10/0x10 [ 3120.629459][ C1] ret_from_fork_asm+0x1b/0x30 [ 3120.629720][ C1] [ 3148.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1826s! [swapper/0:0] [ 3148.527924][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3148.529125][ C0] irq event stamp: 27567077 [ 3148.529368][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3148.529900][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3148.530375][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3148.530883][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3148.531390][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3148.531877][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3148.532529][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3148.532881][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3148.533910][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3148.534236][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3148.534656][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3148.535080][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3148.535504][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3148.535925][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3148.536346][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3148.536820][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3148.537167][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3148.537589][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3148.538008][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3148.538426][ C0] Call Trace: [ 3148.538606][ C0] [ 3148.538762][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3148.539039][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3148.539293][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3148.539587][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3148.539873][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3148.540174][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3148.540452][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3148.540777][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3148.541049][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3148.541330][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3148.541654][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3148.541965][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3148.542300][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3148.542603][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3148.542913][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3148.543220][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3148.543550][ C0] ? get_stack_info+0x36/0xc0 [ 3148.543804][ C0] ? lock_acquire+0x1c1/0x220 [ 3148.544056][ C0] ? lock_release+0x1d5/0x250 [ 3148.544308][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3148.544568][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3148.544853][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3148.545150][ C0] ? lock_acquire+0x1c1/0x220 [ 3148.545402][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3148.545663][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3148.545939][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3148.546185][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3148.546443][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3148.546710][ C0] ? __inet_lookup_established+0x341/0x610 [ 3148.547021][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3148.547316][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3148.547608][ C0] ip_local_deliver+0x19d/0x480 [ 3148.547864][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3148.548145][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3148.548409][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3148.548688][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3148.548956][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3148.549294][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3148.549570][ C0] ip_rcv+0x564/0x740 [ 3148.549790][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3148.550034][ C0] ? set_track_prepare+0x8a/0xd0 [ 3148.550305][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3148.550593][ C0] ? rest_init+0x153/0x260 [ 3148.550840][ C0] ? skb_clone+0x10b/0x330 [ 3148.551083][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3148.551418][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3148.551739][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3148.552040][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3148.552352][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3148.552618][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3148.552864][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3148.553182][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3148.553483][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3148.553823][ C0] ? lock_acquire+0x1c1/0x220 [ 3148.554073][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3148.554382][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3148.554683][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3148.555011][ C0] ? __copy_skb_header+0xaf/0x490 [ 3148.555279][ C0] ? __skb_clone+0x57a/0x760 [ 3148.555528][ C0] netif_receive_skb+0x55/0x280 [ 3148.555790][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3148.556125][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3148.556477][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3148.556789][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3148.557082][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3148.557388][ C0] ? hlock_class+0x4e/0x130 [ 3148.557639][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3148.557972][ C0] ? place_entity+0x21/0x2f0 [ 3148.558221][ C0] ? resched_curr+0x219/0x280 [ 3148.558472][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3148.558740][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3148.559022][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3148.559304][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3148.559565][ C0] ? activate_task+0xf5/0x260 [ 3148.559821][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3148.560101][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3148.560374][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3148.560646][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3148.560936][ C0] ? get_stack_info+0x36/0xc0 [ 3148.561191][ C0] ? stack_access_ok+0xda/0x1f0 [ 3148.561451][ C0] ? get_reg+0x119/0x190 [ 3148.561683][ C0] __tcf_classify+0x32c/0x7d0 [ 3148.561935][ C0] tcf_classify+0x283/0x930 [ 3148.562180][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3148.562507][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3148.562778][ C0] ? arch_stack_walk+0x8c/0x100 [ 3148.563041][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3148.563332][ C0] tc_run+0x2e4/0x5d0 [ 3148.563548][ C0] ? __pfx_tc_run+0x10/0x10 [ 3148.563789][ C0] ? lock_acquire+0x1c1/0x220 [ 3148.564037][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3148.564310][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3148.564578][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3148.564861][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3148.565136][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3148.565458][ C0] ? neigh_hh_output+0x348/0x590 [ 3148.565726][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3148.566003][ C0] ip_finish_output2+0x786/0x18e0 [ 3148.566270][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3148.566561][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3148.566918][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3148.567210][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3148.567473][ C0] ? __ip_finish_output+0x10f/0x770 [ 3148.567755][ C0] ip_output+0x16b/0x4f0 [ 3148.567986][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3148.568269][ C0] ? __pfx_ip_output+0x10/0x10 [ 3148.568527][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3148.568826][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3148.569092][ C0] ? ip_local_out+0x114/0x3b0 [ 3148.569344][ C0] __ip_queue_xmit+0x672/0x1910 [ 3148.569605][ C0] ? __skb_clone+0x57a/0x760 [ 3148.569854][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3148.570138][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3148.570439][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3148.570763][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3148.571023][ C0] ? tcp_current_mss+0x40a/0x510 [ 3148.571286][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3148.571571][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3148.571847][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3148.572102][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3148.572373][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3148.572697][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3148.572973][ C0] ? ktime_get+0xb6/0x190 [ 3148.573205][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3148.573479][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3148.573764][ C0] tcp_write_timer+0x82/0x1d0 [ 3148.574016][ C0] call_timer_fn+0x176/0x430 [ 3148.574263][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3148.574541][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3148.574814][ C0] __run_timers.part.0+0x52d/0x890 [ 3148.575089][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3148.575369][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3148.575675][ C0] ? lock_acquire+0x1c1/0x220 [ 3148.575926][ C0] ? clockevents_program_event+0xf6/0x300 [ 3148.576231][ C0] ? lock_release+0x1d5/0x250 [ 3148.576479][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3148.576756][ C0] ? ktime_get+0xb6/0x190 [ 3148.576986][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3148.577285][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3148.577599][ C0] run_timer_softirq+0x72/0x100 [ 3148.577858][ C0] __do_softirq+0x1bc/0x7ff [ 3148.578100][ C0] irq_exit_rcu+0x98/0xc0 [ 3148.578331][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3148.578629][ C0] [ 3148.578788][ C0] [ 3148.578949][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3148.579271][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3148.579538][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3148.580554][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3148.580882][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3148.581307][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3148.581730][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3148.582151][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3148.582568][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3148.582998][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3148.583304][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3148.583579][ C0] default_idle_call+0x69/0xa0 [ 3148.583833][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3148.584098][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3148.584386][ C0] ? lock_release+0x1d5/0x250 [ 3148.584638][ C0] do_idle+0xfb/0x160 [ 3148.584854][ C0] cpu_startup_entry+0x55/0x60 [ 3148.585112][ C0] rest_init+0x153/0x260 [ 3148.585337][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3148.585627][ C0] arch_call_rest_init+0x13/0x40 [ 3148.585898][ C0] start_kernel+0x314/0x3d0 [ 3148.586138][ C0] x86_64_start_reservations+0x18/0x30 [ 3148.586428][ C0] x86_64_start_kernel+0xba/0x110 [ 3148.586701][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3148.587033][ C0] [ 3148.587201][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1826s! [ksoftirqd/1:22] [ 3148.587675][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3148.588880][ C1] irq event stamp: 3886976 [ 3148.589121][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3148.589617][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3148.590114][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3148.590610][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3148.591110][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3148.591608][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3148.592257][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 3148.592559][ C1] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 3148.593588][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [ 3148.593917][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3148.594346][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3148.594766][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3148.595189][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3148.595617][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3148.596044][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3148.596517][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3148.596866][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3148.597295][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3148.597714][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3148.598133][ C1] Call Trace: [ 3148.598310][ C1] [ 3148.598466][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3148.598747][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3148.599002][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3148.599303][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3148.599586][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3148.599888][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3148.600166][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3148.600484][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3148.600766][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3148.601093][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3148.601408][ C1] [ 3148.601564][ C1] [ 3148.601721][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3148.602051][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3148.602359][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 3148.602654][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 3148.602952][ C1] ? run_ksoftirqd+0xb/0x60 [ 3148.603200][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3148.603533][ C1] ? __orc_find+0x9c/0xf0 [ 3148.603763][ C1] ? lock_acquire+0x1c1/0x220 [ 3148.604015][ C1] ? irqentry_enter+0x2b/0x60 [ 3148.604272][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3148.604533][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3148.604816][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3148.605115][ C1] ? lock_acquire+0x1c1/0x220 [ 3148.605369][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3148.605628][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3148.605905][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3148.606154][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3148.606412][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3148.606683][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3148.606972][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3148.607267][ C1] ip_local_deliver+0x19d/0x480 [ 3148.607528][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3148.607816][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3148.608084][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3148.608359][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3148.608621][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3148.608959][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3148.609235][ C1] ip_rcv+0x564/0x740 [ 3148.609447][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3148.609687][ C1] ? set_track_prepare+0x8a/0xd0 [ 3148.609951][ C1] ? irqentry_enter+0x2b/0x60 [ 3148.610206][ C1] ? irqentry_enter+0x2b/0x60 [ 3148.610465][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3148.610713][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3148.611029][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3148.611369][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3148.611679][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3148.612022][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3148.612326][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3148.612659][ C1] netif_receive_skb+0x55/0x280 [ 3148.612919][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3148.613249][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3148.613596][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3148.613914][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3148.614205][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3148.614510][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3148.614839][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3148.615120][ C1] ? arch_stack_walk+0x68/0x100 [ 3148.615388][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3148.615667][ C1] ? irqentry_enter+0x2b/0x60 [ 3148.615922][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3148.616247][ C1] ? irqentry_enter+0x2b/0x60 [ 3148.616500][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3148.616825][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3148.617111][ C1] ? arch_stack_walk+0x68/0x100 [ 3148.617371][ C1] __tcf_classify+0x32c/0x7d0 [ 3148.617625][ C1] tcf_classify+0x283/0x930 [ 3148.617870][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3148.618143][ C1] tc_run+0x2e4/0x5d0 [ 3148.618357][ C1] ? __pfx_tc_run+0x10/0x10 [ 3148.618599][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3148.618865][ C1] ? irqentry_enter+0x2b/0x60 [ 3148.619120][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3148.619410][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3148.619736][ C1] ip_finish_output2+0x786/0x18e0 [ 3148.620005][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3148.620299][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3148.620566][ C1] ? __ip_finish_output+0x10f/0x770 [ 3148.620855][ C1] ip_output+0x16b/0x4f0 [ 3148.621084][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3148.621400][ C1] ? __pfx_ip_output+0x10/0x10 [ 3148.621658][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3148.622011][ C1] ? __pfx_ip_output+0x10/0x10 [ 3148.622270][ C1] __ip_queue_xmit+0x672/0x1910 [ 3148.622535][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3148.622819][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3148.623118][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3148.623406][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3148.623703][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3148.623990][ C1] tcp_delack_timer+0x84/0x240 [ 3148.624248][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3148.624530][ C1] call_timer_fn+0x176/0x430 [ 3148.624775][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3148.625054][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3148.625332][ C1] __run_timers.part.0+0x52d/0x890 [ 3148.625603][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3148.625893][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3148.626198][ C1] ? __pfx___schedule+0x10/0x10 [ 3148.626456][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3148.626775][ C1] run_timer_softirq+0x72/0x100 [ 3148.627041][ C1] __do_softirq+0x1bc/0x7ff [ 3148.627287][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3148.627563][ C1] run_ksoftirqd+0x2e/0x60 [ 3148.627801][ C1] smpboot_thread_fn+0x30e/0x840 [ 3148.628069][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3148.628358][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3148.628648][ C1] kthread+0x292/0x360 [ 3148.628867][ C1] ? __pfx_kthread+0x10/0x10 [ 3148.629118][ C1] ret_from_fork+0x34/0x70 [ 3148.629354][ C1] ? __pfx_kthread+0x10/0x10 [ 3148.629602][ C1] ret_from_fork_asm+0x1b/0x30 [ 3148.629859][ C1] [ 3172.376025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3172.376411][ C1] rcu: 1-....: (1973597 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=474695 [ 3172.377001][ C1] rcu: (t=1978067 jiffies g=1007429 q=31 ncpus=4) [ 3172.377356][ C1] Sending NMI from CPU 1 to CPUs 0: [ 3172.377656][ C0] NMI backtrace for cpu 0 [ 3172.377663][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3172.377667][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3172.377670][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3172.377679][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3172.377683][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3172.377686][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3172.377688][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3172.377690][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3172.377691][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3172.377694][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3172.377695][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3172.377697][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3172.377701][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3172.377703][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3172.377704][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3172.377706][ C0] Call Trace: [ 3172.377708][ C0] [ 3172.377711][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 3172.377717][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3172.377723][ C0] ? nmi_handle+0x156/0x420 [ 3172.377728][ C0] ? default_do_nmi+0x41/0x100 [ 3172.377732][ C0] ? exc_nmi+0xf3/0x120 [ 3172.377734][ C0] ? end_repeat_nmi+0xf/0x60 [ 3172.377738][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3172.377742][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3172.377745][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3172.377749][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3172.377753][ C0] [ 3172.377754][ C0] [ 3172.377755][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3172.377758][ C0] ? get_stack_info+0x36/0xc0 [ 3172.377762][ C0] ? lock_acquire+0x1c1/0x220 [ 3172.377767][ C0] ? lock_release+0x1d5/0x250 [ 3172.377770][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3172.377774][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3172.377777][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3172.377781][ C0] ? lock_acquire+0x1c1/0x220 [ 3172.377783][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3172.377788][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3172.377792][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3172.377799][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3172.377802][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3172.377806][ C0] ? __inet_lookup_established+0x341/0x610 [ 3172.377813][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3172.377821][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3172.377824][ C0] ip_local_deliver+0x19d/0x480 [ 3172.377828][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3172.377831][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3172.377836][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3172.377839][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3172.377842][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3172.377846][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3172.377856][ C0] ip_rcv+0x564/0x740 [ 3172.377860][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3172.377863][ C0] ? set_track_prepare+0x8a/0xd0 [ 3172.377867][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3172.377870][ C0] ? rest_init+0x153/0x260 [ 3172.377872][ C0] ? skb_clone+0x10b/0x330 [ 3172.377877][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3172.377883][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3172.377888][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3172.377893][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3172.377903][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3172.377906][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3172.377909][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3172.377913][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3172.377916][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3172.377919][ C0] ? lock_acquire+0x1c1/0x220 [ 3172.377922][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3172.377925][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3172.377928][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3172.377931][ C0] ? __copy_skb_header+0xaf/0x490 [ 3172.377934][ C0] ? __skb_clone+0x57a/0x760 [ 3172.377937][ C0] netif_receive_skb+0x55/0x280 [ 3172.377939][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3172.377948][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3172.377955][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3172.377962][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3172.377967][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3172.377975][ C0] ? hlock_class+0x4e/0x130 [ 3172.377982][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3172.377992][ C0] ? place_entity+0x21/0x2f0 [ 3172.377995][ C0] ? resched_curr+0x219/0x280 [ 3172.377998][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3172.378001][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3172.378005][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3172.378009][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3172.378012][ C0] ? activate_task+0xf5/0x260 [ 3172.378015][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3172.378021][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3172.378024][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3172.378028][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3172.378031][ C0] ? get_stack_info+0x36/0xc0 [ 3172.378035][ C0] ? stack_access_ok+0xda/0x1f0 [ 3172.378037][ C0] ? get_reg+0x119/0x190 [ 3172.378041][ C0] __tcf_classify+0x32c/0x7d0 [ 3172.378045][ C0] tcf_classify+0x283/0x930 [ 3172.378049][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3172.378055][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3172.378057][ C0] ? arch_stack_walk+0x8c/0x100 [ 3172.378061][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3172.378064][ C0] tc_run+0x2e4/0x5d0 [ 3172.378069][ C0] ? __pfx_tc_run+0x10/0x10 [ 3172.378072][ C0] ? lock_acquire+0x1c1/0x220 [ 3172.378074][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3172.378079][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3172.378085][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3172.378088][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3172.378091][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3172.378096][ C0] ? neigh_hh_output+0x348/0x590 [ 3172.378100][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3172.378104][ C0] ip_finish_output2+0x786/0x18e0 [ 3172.378107][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3172.378113][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3172.378120][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3172.378123][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3172.378127][ C0] ? __ip_finish_output+0x10f/0x770 [ 3172.378131][ C0] ip_output+0x16b/0x4f0 [ 3172.378134][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3172.378139][ C0] ? __pfx_ip_output+0x10/0x10 [ 3172.378142][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3172.378147][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3172.378150][ C0] ? ip_local_out+0x114/0x3b0 [ 3172.378154][ C0] __ip_queue_xmit+0x672/0x1910 [ 3172.378159][ C0] ? __skb_clone+0x57a/0x760 [ 3172.378162][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3172.378170][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3172.378174][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3172.378178][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3172.378183][ C0] ? tcp_current_mss+0x40a/0x510 [ 3172.378186][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3172.378189][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3172.378192][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3172.378194][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3172.378197][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3172.378201][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3172.378205][ C0] ? ktime_get+0xb6/0x190 [ 3172.378210][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3172.378214][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3172.378217][ C0] tcp_write_timer+0x82/0x1d0 [ 3172.378222][ C0] call_timer_fn+0x176/0x430 [ 3172.378226][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3172.378231][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3172.378235][ C0] __run_timers.part.0+0x52d/0x890 [ 3172.378238][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3172.378242][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3172.378245][ C0] ? lock_acquire+0x1c1/0x220 [ 3172.378247][ C0] ? clockevents_program_event+0xf6/0x300 [ 3172.378252][ C0] ? lock_release+0x1d5/0x250 [ 3172.378254][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3172.378257][ C0] ? ktime_get+0xb6/0x190 [ 3172.378260][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3172.378264][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3172.378268][ C0] run_timer_softirq+0x72/0x100 [ 3172.378271][ C0] __do_softirq+0x1bc/0x7ff [ 3172.378276][ C0] irq_exit_rcu+0x98/0xc0 [ 3172.378278][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3172.378282][ C0] [ 3172.378283][ C0] [ 3172.378284][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3172.378290][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3172.378293][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3172.378295][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3172.378297][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3172.378299][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3172.378300][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3172.378301][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3172.378303][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3172.378306][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3172.378309][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3172.378313][ C0] default_idle_call+0x69/0xa0 [ 3172.378315][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3172.378317][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3172.378322][ C0] ? lock_release+0x1d5/0x250 [ 3172.378326][ C0] do_idle+0xfb/0x160 [ 3172.378329][ C0] cpu_startup_entry+0x55/0x60 [ 3172.378331][ C0] rest_init+0x153/0x260 [ 3172.378334][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3172.378339][ C0] arch_call_rest_init+0x13/0x40 [ 3172.378345][ C0] start_kernel+0x314/0x3d0 [ 3172.378348][ C0] x86_64_start_reservations+0x18/0x30 [ 3172.378353][ C0] x86_64_start_kernel+0xba/0x110 [ 3172.378357][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3172.378364][ C0] [ 3172.378646][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3172.432795][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3172.433444][ C1] RIP: 0010:kasan_check_range+0x77/0x1c0 [ 3172.433748][ C1] Code: ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 <48> 89 e8 49 8d 59 01 48 89 da 48 29 ea 48 83 fa 10 0f 8e c0 00 00 [ 3172.434778][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000286 [ 3172.435106][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3172.435533][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3172.435960][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: ffffed10014131c3 [ 3172.436384][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3172.436808][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3172.437238][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3172.437716][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3172.438065][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3172.438494][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3172.438917][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3172.439337][ C1] Call Trace: [ 3172.439516][ C1] [ 3172.439672][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3172.439962][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3172.440227][ C1] ? check_cpu_stall+0x284/0x500 [ 3172.440495][ C1] ? rcu_pending+0x92/0x360 [ 3172.440743][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3172.441028][ C1] ? update_process_times+0xb9/0x110 [ 3172.441309][ C1] ? tick_sched_handle+0x67/0x130 [ 3172.441584][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3172.441887][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3172.442143][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3172.442474][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3172.442760][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3172.443067][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3172.443344][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3172.443668][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3172.443944][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3172.444265][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3172.444576][ C1] [ 3172.444736][ C1] [ 3172.444897][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3172.445232][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3172.445536][ C1] ? kasan_check_range+0x77/0x1c0 [ 3172.445804][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 3172.446099][ C1] ? run_ksoftirqd+0xb/0x60 [ 3172.446341][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3172.446664][ C1] ? __orc_find+0x9c/0xf0 [ 3172.446899][ C1] ? lock_acquire+0x1c1/0x220 [ 3172.447155][ C1] ? irqentry_enter+0x2b/0x60 [ 3172.447409][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3172.447671][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3172.447958][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3172.448261][ C1] ? lock_acquire+0x1c1/0x220 [ 3172.448510][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3172.448763][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3172.449035][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3172.449284][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3172.449544][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3172.449819][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3172.450114][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3172.450408][ C1] ip_local_deliver+0x19d/0x480 [ 3172.450676][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3172.450965][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3172.451234][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3172.451510][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3172.451772][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3172.452114][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3172.452395][ C1] ip_rcv+0x564/0x740 [ 3172.452606][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3172.452846][ C1] ? set_track_prepare+0x8a/0xd0 [ 3172.453112][ C1] ? irqentry_enter+0x2b/0x60 [ 3172.453369][ C1] ? irqentry_enter+0x2b/0x60 [ 3172.453624][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3172.453868][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3172.454194][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3172.454537][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3172.454849][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3172.455189][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3172.455487][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3172.455823][ C1] netif_receive_skb+0x55/0x280 [ 3172.456086][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3172.456419][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3172.456769][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3172.457084][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3172.457377][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3172.457684][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3172.458019][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3172.458304][ C1] ? arch_stack_walk+0x68/0x100 [ 3172.458565][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3172.458842][ C1] ? irqentry_enter+0x2b/0x60 [ 3172.459098][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3172.459416][ C1] ? irqentry_enter+0x2b/0x60 [ 3172.459669][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3172.459997][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3172.460282][ C1] ? arch_stack_walk+0x68/0x100 [ 3172.460551][ C1] __tcf_classify+0x32c/0x7d0 [ 3172.460804][ C1] tcf_classify+0x283/0x930 [ 3172.461048][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3172.461317][ C1] tc_run+0x2e4/0x5d0 [ 3172.461530][ C1] ? __pfx_tc_run+0x10/0x10 [ 3172.461772][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3172.462038][ C1] ? irqentry_enter+0x2b/0x60 [ 3172.462293][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3172.462583][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3172.462907][ C1] ip_finish_output2+0x786/0x18e0 [ 3172.463178][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3172.463468][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3172.463736][ C1] ? __ip_finish_output+0x10f/0x770 [ 3172.464013][ C1] ip_output+0x16b/0x4f0 [ 3172.464240][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3172.464561][ C1] ? __pfx_ip_output+0x10/0x10 [ 3172.464816][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3172.465176][ C1] ? __pfx_ip_output+0x10/0x10 [ 3172.465435][ C1] __ip_queue_xmit+0x672/0x1910 [ 3172.465696][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3172.465976][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3172.466272][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3172.466556][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3172.466848][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3172.467131][ C1] tcp_delack_timer+0x84/0x240 [ 3172.467385][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3172.467675][ C1] call_timer_fn+0x176/0x430 [ 3172.467924][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3172.468197][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3172.468479][ C1] __run_timers.part.0+0x52d/0x890 [ 3172.468752][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3172.469038][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3172.469338][ C1] ? __pfx___schedule+0x10/0x10 [ 3172.469606][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3172.469931][ C1] run_timer_softirq+0x72/0x100 [ 3172.470192][ C1] __do_softirq+0x1bc/0x7ff [ 3172.470435][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3172.470717][ C1] run_ksoftirqd+0x2e/0x60 [ 3172.470956][ C1] smpboot_thread_fn+0x30e/0x840 [ 3172.471225][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3172.471513][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3172.471804][ C1] kthread+0x292/0x360 [ 3172.472022][ C1] ? __pfx_kthread+0x10/0x10 [ 3172.472274][ C1] ret_from_fork+0x34/0x70 [ 3172.472509][ C1] ? __pfx_kthread+0x10/0x10 [ 3172.472756][ C1] ret_from_fork_asm+0x1b/0x30 [ 3172.473014][ C1] [ 3196.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1870s! [swapper/0:0] [ 3196.527921][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3196.529113][ C0] irq event stamp: 27567077 [ 3196.529352][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3196.529880][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3196.530359][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3196.530869][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3196.531360][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3196.531842][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3196.532489][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3196.532833][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3196.533860][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3196.534186][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3196.534611][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3196.535032][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3196.535453][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3196.535878][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3196.536303][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3196.536776][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3196.537125][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3196.537552][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3196.537972][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3196.538389][ C0] Call Trace: [ 3196.538566][ C0] [ 3196.538722][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3196.539005][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3196.539264][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3196.539556][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3196.539839][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3196.540139][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3196.540428][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3196.540756][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3196.541029][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3196.541308][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3196.541634][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3196.541942][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3196.542282][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3196.542583][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3196.542890][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3196.543195][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3196.543527][ C0] ? get_stack_info+0x36/0xc0 [ 3196.543779][ C0] ? lock_acquire+0x1c1/0x220 [ 3196.544028][ C0] ? lock_release+0x1d5/0x250 [ 3196.544275][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3196.544536][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3196.544820][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3196.545117][ C0] ? lock_acquire+0x1c1/0x220 [ 3196.545367][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3196.545622][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3196.545898][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3196.546143][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3196.546400][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3196.546671][ C0] ? __inet_lookup_established+0x341/0x610 [ 3196.546982][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3196.547274][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3196.547568][ C0] ip_local_deliver+0x19d/0x480 [ 3196.547827][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3196.548111][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3196.548374][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3196.548653][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3196.548917][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3196.549250][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3196.549535][ C0] ip_rcv+0x564/0x740 [ 3196.549750][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3196.549993][ C0] ? set_track_prepare+0x8a/0xd0 [ 3196.550260][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3196.550553][ C0] ? rest_init+0x153/0x260 [ 3196.550788][ C0] ? skb_clone+0x10b/0x330 [ 3196.551040][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3196.551373][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3196.551691][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3196.551989][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3196.552303][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3196.552563][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3196.552808][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3196.553128][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3196.553431][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3196.553771][ C0] ? lock_acquire+0x1c1/0x220 [ 3196.554019][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3196.554328][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3196.554633][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3196.554965][ C0] ? __copy_skb_header+0xaf/0x490 [ 3196.555232][ C0] ? __skb_clone+0x57a/0x760 [ 3196.555476][ C0] netif_receive_skb+0x55/0x280 [ 3196.555737][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3196.556068][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3196.556421][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3196.556734][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3196.557025][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3196.557325][ C0] ? hlock_class+0x4e/0x130 [ 3196.557574][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3196.557909][ C0] ? place_entity+0x21/0x2f0 [ 3196.558159][ C0] ? resched_curr+0x219/0x280 [ 3196.558410][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3196.558676][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3196.558956][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3196.559238][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3196.559499][ C0] ? activate_task+0xf5/0x260 [ 3196.559755][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3196.560033][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3196.560305][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3196.560572][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3196.560860][ C0] ? get_stack_info+0x36/0xc0 [ 3196.561115][ C0] ? stack_access_ok+0xda/0x1f0 [ 3196.561378][ C0] ? get_reg+0x119/0x190 [ 3196.561606][ C0] __tcf_classify+0x32c/0x7d0 [ 3196.561854][ C0] tcf_classify+0x283/0x930 [ 3196.562093][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3196.562421][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3196.562689][ C0] ? arch_stack_walk+0x8c/0x100 [ 3196.562955][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3196.563246][ C0] tc_run+0x2e4/0x5d0 [ 3196.563459][ C0] ? __pfx_tc_run+0x10/0x10 [ 3196.563697][ C0] ? lock_acquire+0x1c1/0x220 [ 3196.563946][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3196.564219][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3196.564488][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3196.564772][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3196.565048][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3196.565364][ C0] ? neigh_hh_output+0x348/0x590 [ 3196.565630][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3196.565905][ C0] ip_finish_output2+0x786/0x18e0 [ 3196.566170][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3196.566464][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3196.566820][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3196.567112][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3196.567376][ C0] ? __ip_finish_output+0x10f/0x770 [ 3196.567657][ C0] ip_output+0x16b/0x4f0 [ 3196.567883][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3196.568163][ C0] ? __pfx_ip_output+0x10/0x10 [ 3196.568418][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3196.568718][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3196.568982][ C0] ? ip_local_out+0x114/0x3b0 [ 3196.569231][ C0] __ip_queue_xmit+0x672/0x1910 [ 3196.569488][ C0] ? __skb_clone+0x57a/0x760 [ 3196.569731][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3196.570015][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3196.570311][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3196.570643][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3196.570903][ C0] ? tcp_current_mss+0x40a/0x510 [ 3196.571165][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3196.571448][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3196.571723][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3196.571975][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3196.572245][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3196.572565][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3196.572840][ C0] ? ktime_get+0xb6/0x190 [ 3196.573071][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3196.573343][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3196.573626][ C0] tcp_write_timer+0x82/0x1d0 [ 3196.573877][ C0] call_timer_fn+0x176/0x430 [ 3196.574122][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3196.574399][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3196.574671][ C0] __run_timers.part.0+0x52d/0x890 [ 3196.574947][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3196.575231][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3196.575532][ C0] ? lock_acquire+0x1c1/0x220 [ 3196.575779][ C0] ? clockevents_program_event+0xf6/0x300 [ 3196.576084][ C0] ? lock_release+0x1d5/0x250 [ 3196.576334][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3196.576608][ C0] ? ktime_get+0xb6/0x190 [ 3196.576838][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3196.577136][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3196.577449][ C0] run_timer_softirq+0x72/0x100 [ 3196.577707][ C0] __do_softirq+0x1bc/0x7ff [ 3196.577949][ C0] irq_exit_rcu+0x98/0xc0 [ 3196.578180][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3196.578478][ C0] [ 3196.578636][ C0] [ 3196.578796][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3196.579119][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3196.579387][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3196.580415][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3196.580746][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3196.581168][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3196.581589][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3196.582013][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3196.582438][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3196.582859][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3196.583164][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3196.583439][ C0] default_idle_call+0x69/0xa0 [ 3196.583689][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3196.583954][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3196.584245][ C0] ? lock_release+0x1d5/0x250 [ 3196.584500][ C0] do_idle+0xfb/0x160 [ 3196.584714][ C0] cpu_startup_entry+0x55/0x60 [ 3196.584969][ C0] rest_init+0x153/0x260 [ 3196.585195][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3196.585485][ C0] arch_call_rest_init+0x13/0x40 [ 3196.585753][ C0] start_kernel+0x314/0x3d0 [ 3196.585993][ C0] x86_64_start_reservations+0x18/0x30 [ 3196.586284][ C0] x86_64_start_kernel+0xba/0x110 [ 3196.586555][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3196.586882][ C0] [ 3196.587050][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1871s! [ksoftirqd/1:22] [ 3196.587521][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3196.588725][ C1] irq event stamp: 3886976 [ 3196.588963][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3196.589461][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3196.589952][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3196.590454][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3196.590942][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3196.591439][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3196.592091][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 3196.592431][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 3196.593448][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3196.593770][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3196.594189][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3196.594606][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3196.595022][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3196.595440][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3196.595860][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3196.596327][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3196.596681][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3196.597101][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3196.597520][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3196.597940][ C1] Call Trace: [ 3196.598123][ C1] [ 3196.598282][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3196.598558][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3196.598814][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3196.599103][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3196.599391][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3196.599697][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3196.599978][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3196.600302][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3196.600583][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3196.600905][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3196.601216][ C1] [ 3196.601376][ C1] [ 3196.601536][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3196.601869][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3196.602173][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 3196.602479][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3196.602780][ C1] ? run_ksoftirqd+0xb/0x60 [ 3196.603023][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3196.603351][ C1] ? __orc_find+0x9c/0xf0 [ 3196.603583][ C1] ? lock_acquire+0x1c1/0x220 [ 3196.603838][ C1] ? irqentry_enter+0x2b/0x60 [ 3196.604095][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3196.604361][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3196.604650][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3196.604951][ C1] ? lock_acquire+0x1c1/0x220 [ 3196.605200][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3196.605450][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3196.605723][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3196.605972][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3196.606239][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3196.606513][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3196.606804][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3196.607099][ C1] ip_local_deliver+0x19d/0x480 [ 3196.607357][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3196.607642][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3196.607907][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3196.608188][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3196.608455][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3196.608788][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3196.609069][ C1] ip_rcv+0x564/0x740 [ 3196.609284][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3196.609531][ C1] ? set_track_prepare+0x8a/0xd0 [ 3196.609799][ C1] ? irqentry_enter+0x2b/0x60 [ 3196.610049][ C1] ? irqentry_enter+0x2b/0x60 [ 3196.610298][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3196.610548][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3196.610864][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3196.611212][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3196.611524][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3196.611866][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3196.612164][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3196.612501][ C1] netif_receive_skb+0x55/0x280 [ 3196.612767][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3196.613098][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3196.613450][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3196.613762][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3196.614055][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3196.614362][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3196.614694][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3196.614977][ C1] ? arch_stack_walk+0x68/0x100 [ 3196.615238][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3196.615513][ C1] ? irqentry_enter+0x2b/0x60 [ 3196.615763][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3196.616086][ C1] ? irqentry_enter+0x2b/0x60 [ 3196.616342][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3196.616664][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3196.616943][ C1] ? arch_stack_walk+0x68/0x100 [ 3196.617207][ C1] __tcf_classify+0x32c/0x7d0 [ 3196.617464][ C1] tcf_classify+0x283/0x930 [ 3196.617710][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3196.617983][ C1] tc_run+0x2e4/0x5d0 [ 3196.618202][ C1] ? __pfx_tc_run+0x10/0x10 [ 3196.618452][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3196.618721][ C1] ? irqentry_enter+0x2b/0x60 [ 3196.618971][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3196.619257][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3196.619581][ C1] ip_finish_output2+0x786/0x18e0 [ 3196.619855][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3196.620148][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3196.620418][ C1] ? __ip_finish_output+0x10f/0x770 [ 3196.620695][ C1] ip_output+0x16b/0x4f0 [ 3196.620922][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3196.621246][ C1] ? __pfx_ip_output+0x10/0x10 [ 3196.621504][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3196.621857][ C1] ? __pfx_ip_output+0x10/0x10 [ 3196.622116][ C1] __ip_queue_xmit+0x672/0x1910 [ 3196.622377][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3196.622656][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3196.622952][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3196.623239][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3196.623535][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3196.623821][ C1] tcp_delack_timer+0x84/0x240 [ 3196.624078][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3196.624366][ C1] call_timer_fn+0x176/0x430 [ 3196.624616][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3196.624890][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3196.625173][ C1] __run_timers.part.0+0x52d/0x890 [ 3196.625448][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3196.625736][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3196.626036][ C1] ? __pfx___schedule+0x10/0x10 [ 3196.626298][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3196.626620][ C1] run_timer_softirq+0x72/0x100 [ 3196.626877][ C1] __do_softirq+0x1bc/0x7ff [ 3196.627119][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3196.627393][ C1] run_ksoftirqd+0x2e/0x60 [ 3196.627633][ C1] smpboot_thread_fn+0x30e/0x840 [ 3196.627898][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3196.628191][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3196.628485][ C1] kthread+0x292/0x360 [ 3196.628703][ C1] ? __pfx_kthread+0x10/0x10 [ 3196.628947][ C1] ret_from_fork+0x34/0x70 [ 3196.629189][ C1] ? __pfx_kthread+0x10/0x10 [ 3196.629437][ C1] ret_from_fork_asm+0x1b/0x30 [ 3196.629700][ C1] [ 3224.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1897s! [swapper/0:0] [ 3224.527944][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3224.529134][ C0] irq event stamp: 27567077 [ 3224.529373][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3224.529909][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3224.530388][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3224.530898][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3224.531399][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3224.531885][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3224.532529][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3224.532867][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3224.533899][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3224.534225][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3224.534644][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3224.535064][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3224.535487][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3224.535912][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3224.536332][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3224.536800][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3224.537149][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3224.537572][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3224.537987][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3224.538402][ C0] Call Trace: [ 3224.538579][ C0] [ 3224.538732][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3224.539012][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3224.539262][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3224.539553][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3224.539834][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3224.540134][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3224.540417][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3224.540739][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3224.541010][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3224.541287][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3224.541606][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3224.541915][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3224.542246][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3224.542550][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3224.542856][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3224.543160][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3224.543487][ C0] ? get_stack_info+0x36/0xc0 [ 3224.543741][ C0] ? lock_acquire+0x1c1/0x220 [ 3224.543993][ C0] ? lock_release+0x1d5/0x250 [ 3224.544242][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3224.544501][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3224.544785][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3224.545080][ C0] ? lock_acquire+0x1c1/0x220 [ 3224.545329][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3224.545582][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3224.545855][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3224.546105][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3224.546362][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3224.546630][ C0] ? __inet_lookup_established+0x341/0x610 [ 3224.546940][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3224.547232][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3224.547523][ C0] ip_local_deliver+0x19d/0x480 [ 3224.547781][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3224.548062][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3224.548325][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3224.548604][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3224.548869][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3224.549204][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3224.549479][ C0] ip_rcv+0x564/0x740 [ 3224.549690][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3224.549928][ C0] ? set_track_prepare+0x8a/0xd0 [ 3224.550190][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3224.550488][ C0] ? rest_init+0x153/0x260 [ 3224.550727][ C0] ? skb_clone+0x10b/0x330 [ 3224.550966][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3224.551306][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3224.551625][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3224.551919][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3224.552225][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3224.552481][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3224.552719][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3224.553034][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3224.553330][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3224.553676][ C0] ? lock_acquire+0x1c1/0x220 [ 3224.553928][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3224.554242][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3224.554540][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3224.554875][ C0] ? __copy_skb_header+0xaf/0x490 [ 3224.555145][ C0] ? __skb_clone+0x57a/0x760 [ 3224.555394][ C0] netif_receive_skb+0x55/0x280 [ 3224.555651][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3224.555981][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3224.556330][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3224.556645][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3224.556931][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3224.557228][ C0] ? hlock_class+0x4e/0x130 [ 3224.557476][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3224.557806][ C0] ? place_entity+0x21/0x2f0 [ 3224.558054][ C0] ? resched_curr+0x219/0x280 [ 3224.558310][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3224.558579][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3224.558863][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3224.559139][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3224.559397][ C0] ? activate_task+0xf5/0x260 [ 3224.559644][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3224.559918][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3224.560191][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3224.560459][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3224.560753][ C0] ? get_stack_info+0x36/0xc0 [ 3224.561006][ C0] ? stack_access_ok+0xda/0x1f0 [ 3224.561264][ C0] ? get_reg+0x119/0x190 [ 3224.561489][ C0] __tcf_classify+0x32c/0x7d0 [ 3224.561744][ C0] tcf_classify+0x283/0x930 [ 3224.561988][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3224.562324][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3224.562588][ C0] ? arch_stack_walk+0x8c/0x100 [ 3224.562849][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3224.563140][ C0] tc_run+0x2e4/0x5d0 [ 3224.563356][ C0] ? __pfx_tc_run+0x10/0x10 [ 3224.563600][ C0] ? lock_acquire+0x1c1/0x220 [ 3224.563850][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3224.564127][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3224.564392][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3224.564679][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3224.564959][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3224.565278][ C0] ? neigh_hh_output+0x348/0x590 [ 3224.565541][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3224.565821][ C0] ip_finish_output2+0x786/0x18e0 [ 3224.566093][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3224.566388][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3224.566739][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3224.567029][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3224.567294][ C0] ? __ip_finish_output+0x10f/0x770 [ 3224.567570][ C0] ip_output+0x16b/0x4f0 [ 3224.567799][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3224.568085][ C0] ? __pfx_ip_output+0x10/0x10 [ 3224.568338][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3224.568642][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3224.568903][ C0] ? ip_local_out+0x114/0x3b0 [ 3224.569157][ C0] __ip_queue_xmit+0x672/0x1910 [ 3224.569420][ C0] ? __skb_clone+0x57a/0x760 [ 3224.569668][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3224.569947][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3224.570242][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3224.570573][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3224.570829][ C0] ? tcp_current_mss+0x40a/0x510 [ 3224.571093][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3224.571372][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3224.571650][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3224.571905][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3224.572171][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3224.572487][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3224.572769][ C0] ? ktime_get+0xb6/0x190 [ 3224.573003][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3224.573279][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3224.573557][ C0] tcp_write_timer+0x82/0x1d0 [ 3224.573813][ C0] call_timer_fn+0x176/0x430 [ 3224.574061][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3224.574335][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3224.574608][ C0] __run_timers.part.0+0x52d/0x890 [ 3224.574878][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3224.575162][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3224.575458][ C0] ? lock_acquire+0x1c1/0x220 [ 3224.575708][ C0] ? clockevents_program_event+0xf6/0x300 [ 3224.576018][ C0] ? lock_release+0x1d5/0x250 [ 3224.576273][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3224.576551][ C0] ? ktime_get+0xb6/0x190 [ 3224.576786][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3224.577087][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3224.577395][ C0] run_timer_softirq+0x72/0x100 [ 3224.577655][ C0] __do_softirq+0x1bc/0x7ff [ 3224.577900][ C0] irq_exit_rcu+0x98/0xc0 [ 3224.578132][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3224.578432][ C0] [ 3224.578588][ C0] [ 3224.578746][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3224.579066][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3224.579337][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3224.580363][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3224.580685][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3224.581102][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3224.581517][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3224.581932][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3224.582348][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3224.582764][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3224.583065][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3224.583336][ C0] default_idle_call+0x69/0xa0 [ 3224.583590][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3224.583851][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3224.584145][ C0] ? lock_release+0x1d5/0x250 [ 3224.584395][ C0] do_idle+0xfb/0x160 [ 3224.584605][ C0] cpu_startup_entry+0x55/0x60 [ 3224.584856][ C0] rest_init+0x153/0x260 [ 3224.585085][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3224.585373][ C0] arch_call_rest_init+0x13/0x40 [ 3224.585637][ C0] start_kernel+0x314/0x3d0 [ 3224.585881][ C0] x86_64_start_reservations+0x18/0x30 [ 3224.586173][ C0] x86_64_start_kernel+0xba/0x110 [ 3224.586440][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3224.586762][ C0] [ 3224.586925][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1897s! [ksoftirqd/1:22] [ 3224.587402][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3224.588598][ C1] irq event stamp: 3886976 [ 3224.588833][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3224.589339][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3224.589838][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3224.590349][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3224.590843][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3224.591336][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3224.591982][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 3224.592321][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 3224.593349][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3224.593680][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3224.594105][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3224.594529][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3224.594955][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3224.595386][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3224.595809][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3224.596282][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3224.596629][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3224.597053][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3224.597471][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3224.597889][ C1] Call Trace: [ 3224.598070][ C1] [ 3224.598226][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3224.598506][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3224.598760][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3224.599055][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3224.599338][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3224.599641][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3224.599923][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3224.600244][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3224.600529][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3224.600855][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3224.601170][ C1] [ 3224.601327][ C1] [ 3224.601484][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3224.601817][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3224.602124][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 3224.602432][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3224.602737][ C1] ? run_ksoftirqd+0xb/0x60 [ 3224.602984][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3224.603318][ C1] ? __orc_find+0x9c/0xf0 [ 3224.603548][ C1] ? lock_acquire+0x1c1/0x220 [ 3224.603800][ C1] ? irqentry_enter+0x2b/0x60 [ 3224.604053][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3224.604315][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3224.604600][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3224.604898][ C1] ? lock_acquire+0x1c1/0x220 [ 3224.605150][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3224.605404][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3224.605681][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3224.605928][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3224.606188][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3224.606459][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3224.606746][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3224.607037][ C1] ip_local_deliver+0x19d/0x480 [ 3224.607303][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3224.607591][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3224.607858][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3224.608137][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3224.608401][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3224.608741][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3224.609016][ C1] ip_rcv+0x564/0x740 [ 3224.609229][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3224.609470][ C1] ? set_track_prepare+0x8a/0xd0 [ 3224.609734][ C1] ? irqentry_enter+0x2b/0x60 [ 3224.609987][ C1] ? irqentry_enter+0x2b/0x60 [ 3224.610242][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3224.610489][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3224.610802][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3224.611143][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3224.611452][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3224.611798][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3224.612101][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3224.612434][ C1] netif_receive_skb+0x55/0x280 [ 3224.612694][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3224.613023][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3224.613370][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3224.613687][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3224.613974][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3224.614277][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3224.614604][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3224.614882][ C1] ? arch_stack_walk+0x68/0x100 [ 3224.615148][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3224.615428][ C1] ? irqentry_enter+0x2b/0x60 [ 3224.615681][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3224.616005][ C1] ? irqentry_enter+0x2b/0x60 [ 3224.616258][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3224.616579][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3224.616863][ C1] ? arch_stack_walk+0x68/0x100 [ 3224.617126][ C1] __tcf_classify+0x32c/0x7d0 [ 3224.617380][ C1] tcf_classify+0x283/0x930 [ 3224.617621][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3224.617890][ C1] tc_run+0x2e4/0x5d0 [ 3224.618106][ C1] ? __pfx_tc_run+0x10/0x10 [ 3224.618350][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3224.618617][ C1] ? irqentry_enter+0x2b/0x60 [ 3224.618869][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3224.619159][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3224.619487][ C1] ip_finish_output2+0x786/0x18e0 [ 3224.619757][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3224.620047][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3224.620322][ C1] ? __ip_finish_output+0x10f/0x770 [ 3224.620602][ C1] ip_output+0x16b/0x4f0 [ 3224.620834][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3224.621156][ C1] ? __pfx_ip_output+0x10/0x10 [ 3224.621415][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3224.621767][ C1] ? __pfx_ip_output+0x10/0x10 [ 3224.622022][ C1] __ip_queue_xmit+0x672/0x1910 [ 3224.622291][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3224.622574][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3224.622876][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3224.623168][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3224.623466][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3224.623754][ C1] tcp_delack_timer+0x84/0x240 [ 3224.624012][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3224.624297][ C1] call_timer_fn+0x176/0x430 [ 3224.624542][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3224.624819][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3224.625097][ C1] __run_timers.part.0+0x52d/0x890 [ 3224.625369][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3224.625659][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3224.625961][ C1] ? __pfx___schedule+0x10/0x10 [ 3224.626224][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3224.626542][ C1] run_timer_softirq+0x72/0x100 [ 3224.626804][ C1] __do_softirq+0x1bc/0x7ff [ 3224.627052][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3224.627328][ C1] run_ksoftirqd+0x2e/0x60 [ 3224.627566][ C1] smpboot_thread_fn+0x30e/0x840 [ 3224.627835][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3224.628127][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3224.628419][ C1] kthread+0x292/0x360 [ 3224.628635][ C1] ? __pfx_kthread+0x10/0x10 [ 3224.628883][ C1] ret_from_fork+0x34/0x70 [ 3224.629120][ C1] ? __pfx_kthread+0x10/0x10 [ 3224.629369][ C1] ret_from_fork_asm+0x1b/0x30 [ 3224.629629][ C1] [ 3250.474025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3250.474413][ C1] rcu: 1-....: (2051415 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=491389 [ 3250.474997][ C1] rcu: (t=2056165 jiffies g=1007429 q=31 ncpus=4) [ 3250.475353][ C1] Sending NMI from CPU 1 to CPUs 0: [ 3250.475647][ C0] NMI backtrace for cpu 0 [ 3250.475655][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3250.475660][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3250.475663][ C0] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 3250.475673][ C0] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 3250.475676][ C0] RSP: 0018:ffffc900000069c0 EFLAGS: 00000286 [ 3250.475680][ C0] RAX: ffff88800a099b5c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3250.475682][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3250.475684][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3250.475685][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3250.475687][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3250.475689][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3250.475691][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3250.475695][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3250.475697][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3250.475698][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3250.475700][ C0] Call Trace: [ 3250.475703][ C0] [ 3250.475706][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 3250.475712][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3250.475718][ C0] ? nmi_handle+0x156/0x420 [ 3250.475724][ C0] ? default_do_nmi+0x41/0x100 [ 3250.475728][ C0] ? exc_nmi+0xf3/0x120 [ 3250.475730][ C0] ? end_repeat_nmi+0xf/0x60 [ 3250.475734][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3250.475740][ C0] ? kasan_check_range+0x1a/0x1c0 [ 3250.475744][ C0] ? kasan_check_range+0x1a/0x1c0 [ 3250.475748][ C0] ? kasan_check_range+0x1a/0x1c0 [ 3250.475751][ C0] [ 3250.475753][ C0] [ 3250.475754][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 3250.475758][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3250.475761][ C0] ? get_stack_info+0x36/0xc0 [ 3250.475768][ C0] ? lock_acquire+0x1c1/0x220 [ 3250.475773][ C0] ? lock_release+0x1d5/0x250 [ 3250.475777][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3250.475781][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3250.475784][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3250.475787][ C0] ? lock_acquire+0x1c1/0x220 [ 3250.475790][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3250.475796][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3250.475799][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3250.475807][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3250.475810][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3250.475815][ C0] ? __inet_lookup_established+0x341/0x610 [ 3250.475821][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3250.475828][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3250.475832][ C0] ip_local_deliver+0x19d/0x480 [ 3250.475835][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3250.475838][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3250.475843][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3250.475847][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3250.475850][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3250.475853][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3250.475864][ C0] ip_rcv+0x564/0x740 [ 3250.475867][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3250.475870][ C0] ? set_track_prepare+0x8a/0xd0 [ 3250.475875][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3250.475877][ C0] ? rest_init+0x153/0x260 [ 3250.475879][ C0] ? skb_clone+0x10b/0x330 [ 3250.475885][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3250.475891][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3250.475896][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3250.475901][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3250.475910][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3250.475913][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3250.475916][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3250.475920][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3250.475923][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3250.475927][ C0] ? lock_acquire+0x1c1/0x220 [ 3250.475929][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3250.475933][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3250.475935][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3250.475939][ C0] ? __copy_skb_header+0xaf/0x490 [ 3250.475942][ C0] ? __skb_clone+0x57a/0x760 [ 3250.475945][ C0] netif_receive_skb+0x55/0x280 [ 3250.475947][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3250.475955][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3250.475963][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3250.475969][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3250.475974][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3250.475983][ C0] ? hlock_class+0x4e/0x130 [ 3250.475990][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3250.476000][ C0] ? place_entity+0x21/0x2f0 [ 3250.476003][ C0] ? resched_curr+0x219/0x280 [ 3250.476008][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3250.476010][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3250.476014][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3250.476019][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3250.476022][ C0] ? activate_task+0xf5/0x260 [ 3250.476025][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3250.476031][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3250.476034][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3250.476037][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3250.476040][ C0] ? get_stack_info+0x36/0xc0 [ 3250.476044][ C0] ? stack_access_ok+0xda/0x1f0 [ 3250.476046][ C0] ? get_reg+0x119/0x190 [ 3250.476050][ C0] __tcf_classify+0x32c/0x7d0 [ 3250.476054][ C0] tcf_classify+0x283/0x930 [ 3250.476058][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3250.476063][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3250.476065][ C0] ? arch_stack_walk+0x8c/0x100 [ 3250.476069][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3250.476072][ C0] tc_run+0x2e4/0x5d0 [ 3250.476076][ C0] ? __pfx_tc_run+0x10/0x10 [ 3250.476079][ C0] ? lock_acquire+0x1c1/0x220 [ 3250.476081][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3250.476087][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3250.476093][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3250.476096][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3250.476099][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3250.476104][ C0] ? neigh_hh_output+0x348/0x590 [ 3250.476108][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3250.476112][ C0] ip_finish_output2+0x786/0x18e0 [ 3250.476116][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3250.476121][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3250.476129][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3250.476132][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3250.476136][ C0] ? __ip_finish_output+0x10f/0x770 [ 3250.476140][ C0] ip_output+0x16b/0x4f0 [ 3250.476144][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3250.476148][ C0] ? __pfx_ip_output+0x10/0x10 [ 3250.476151][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3250.476156][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3250.476159][ C0] ? ip_local_out+0x114/0x3b0 [ 3250.476163][ C0] __ip_queue_xmit+0x672/0x1910 [ 3250.476167][ C0] ? __skb_clone+0x57a/0x760 [ 3250.476171][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3250.476178][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3250.476183][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3250.476187][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3250.476192][ C0] ? tcp_current_mss+0x40a/0x510 [ 3250.476195][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3250.476198][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3250.476201][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3250.476203][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3250.476206][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3250.476209][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3250.476214][ C0] ? ktime_get+0xb6/0x190 [ 3250.476219][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3250.476223][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3250.476226][ C0] tcp_write_timer+0x82/0x1d0 [ 3250.476230][ C0] call_timer_fn+0x176/0x430 [ 3250.476234][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3250.476239][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3250.476243][ C0] __run_timers.part.0+0x52d/0x890 [ 3250.476246][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3250.476251][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3250.476254][ C0] ? lock_acquire+0x1c1/0x220 [ 3250.476256][ C0] ? clockevents_program_event+0xf6/0x300 [ 3250.476260][ C0] ? lock_release+0x1d5/0x250 [ 3250.476263][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3250.476265][ C0] ? ktime_get+0xb6/0x190 [ 3250.476268][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3250.476272][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3250.476276][ C0] run_timer_softirq+0x72/0x100 [ 3250.476280][ C0] __do_softirq+0x1bc/0x7ff [ 3250.476284][ C0] irq_exit_rcu+0x98/0xc0 [ 3250.476287][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3250.476291][ C0] [ 3250.476292][ C0] [ 3250.476293][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3250.476300][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3250.476303][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3250.476306][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3250.476308][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3250.476310][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3250.476311][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3250.476313][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3250.476315][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3250.476318][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3250.476322][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3250.476325][ C0] default_idle_call+0x69/0xa0 [ 3250.476327][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3250.476330][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3250.476335][ C0] ? lock_release+0x1d5/0x250 [ 3250.476339][ C0] do_idle+0xfb/0x160 [ 3250.476342][ C0] cpu_startup_entry+0x55/0x60 [ 3250.476344][ C0] rest_init+0x153/0x260 [ 3250.476346][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3250.476352][ C0] arch_call_rest_init+0x13/0x40 [ 3250.476358][ C0] start_kernel+0x314/0x3d0 [ 3250.476362][ C0] x86_64_start_reservations+0x18/0x30 [ 3250.476367][ C0] x86_64_start_kernel+0xba/0x110 [ 3250.476370][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3250.476378][ C0] [ 3250.476640][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3250.531107][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3250.531758][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3250.532113][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3250.533143][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3250.533471][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3250.533898][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3250.534322][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3250.534746][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3250.535174][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3250.535602][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3250.536078][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3250.536428][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3250.536859][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3250.537280][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3250.537700][ C1] Call Trace: [ 3250.537877][ C1] [ 3250.538034][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3250.538327][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3250.538590][ C1] ? check_cpu_stall+0x284/0x500 [ 3250.538858][ C1] ? rcu_pending+0x92/0x360 [ 3250.539103][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3250.539385][ C1] ? update_process_times+0xb9/0x110 [ 3250.539672][ C1] ? tick_sched_handle+0x67/0x130 [ 3250.539940][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3250.540244][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3250.540498][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3250.540832][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3250.541117][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3250.541421][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3250.541701][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3250.542020][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3250.542299][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3250.542620][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3250.542929][ C1] [ 3250.543090][ C1] [ 3250.543250][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3250.543583][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3250.543885][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3250.544197][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3250.544504][ C1] ? run_ksoftirqd+0xb/0x60 [ 3250.544753][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3250.545083][ C1] ? __orc_find+0x9c/0xf0 [ 3250.545314][ C1] ? lock_acquire+0x1c1/0x220 [ 3250.545563][ C1] ? irqentry_enter+0x2b/0x60 [ 3250.545811][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3250.546072][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3250.546358][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3250.546656][ C1] ? lock_acquire+0x1c1/0x220 [ 3250.546908][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3250.547165][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3250.547440][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3250.547684][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3250.547942][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3250.548214][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3250.548502][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3250.548790][ C1] ip_local_deliver+0x19d/0x480 [ 3250.549054][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3250.549343][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3250.549613][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3250.549891][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3250.550160][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3250.550497][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3250.550776][ C1] ip_rcv+0x564/0x740 [ 3250.550997][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3250.551244][ C1] ? set_track_prepare+0x8a/0xd0 [ 3250.551514][ C1] ? irqentry_enter+0x2b/0x60 [ 3250.551765][ C1] ? irqentry_enter+0x2b/0x60 [ 3250.552017][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3250.552261][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3250.552574][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3250.552915][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3250.553225][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3250.553567][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3250.553868][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3250.554198][ C1] netif_receive_skb+0x55/0x280 [ 3250.554464][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3250.554790][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3250.555138][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3250.555453][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3250.555741][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3250.556044][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3250.556371][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3250.556650][ C1] ? arch_stack_walk+0x68/0x100 [ 3250.556913][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3250.557195][ C1] ? irqentry_enter+0x2b/0x60 [ 3250.557451][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3250.557776][ C1] ? irqentry_enter+0x2b/0x60 [ 3250.558028][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3250.558350][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3250.558634][ C1] ? arch_stack_walk+0x68/0x100 [ 3250.558892][ C1] __tcf_classify+0x32c/0x7d0 [ 3250.559144][ C1] tcf_classify+0x283/0x930 [ 3250.559385][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3250.559653][ C1] tc_run+0x2e4/0x5d0 [ 3250.559870][ C1] ? __pfx_tc_run+0x10/0x10 [ 3250.560116][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3250.560391][ C1] ? irqentry_enter+0x2b/0x60 [ 3250.560643][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3250.560930][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3250.561253][ C1] ip_finish_output2+0x786/0x18e0 [ 3250.561528][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3250.561820][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3250.562084][ C1] ? __ip_finish_output+0x10f/0x770 [ 3250.562366][ C1] ip_output+0x16b/0x4f0 [ 3250.562601][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3250.562919][ C1] ? __pfx_ip_output+0x10/0x10 [ 3250.563182][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3250.563535][ C1] ? __pfx_ip_output+0x10/0x10 [ 3250.563792][ C1] __ip_queue_xmit+0x672/0x1910 [ 3250.564058][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3250.564343][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3250.564642][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3250.564933][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3250.565236][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3250.565530][ C1] tcp_delack_timer+0x84/0x240 [ 3250.565790][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3250.566077][ C1] call_timer_fn+0x176/0x430 [ 3250.566328][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3250.566604][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3250.566880][ C1] __run_timers.part.0+0x52d/0x890 [ 3250.567154][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3250.567446][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3250.567750][ C1] ? __pfx___schedule+0x10/0x10 [ 3250.568008][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3250.568328][ C1] run_timer_softirq+0x72/0x100 [ 3250.568590][ C1] __do_softirq+0x1bc/0x7ff [ 3250.568836][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3250.569114][ C1] run_ksoftirqd+0x2e/0x60 [ 3250.569351][ C1] smpboot_thread_fn+0x30e/0x840 [ 3250.569621][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3250.569913][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3250.570214][ C1] kthread+0x292/0x360 [ 3250.570434][ C1] ? __pfx_kthread+0x10/0x10 [ 3250.570679][ C1] ret_from_fork+0x34/0x70 [ 3250.570920][ C1] ? __pfx_kthread+0x10/0x10 [ 3250.571166][ C1] ret_from_fork_asm+0x1b/0x30 [ 3250.571432][ C1] [ 3276.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1945s! [swapper/0:0] [ 3276.527924][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3276.529125][ C0] irq event stamp: 27567077 [ 3276.529369][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3276.529905][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3276.530384][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3276.530887][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3276.531387][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3276.531874][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3276.532518][ C0] RIP: 0010:kasan_check_range+0x161/0x1c0 [ 3276.532824][ C0] Code: 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 48 83 c0 01 48 39 d0 74 a5 <80> 38 00 74 f2 e9 74 ff ff ff b8 01 00 00 00 c3 cc cc cc cc 48 29 [ 3276.533839][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000286 [ 3276.534160][ C0] RAX: ffffed100141336b RBX: ffffed100141336c RCX: ffffffff90c7aaa0 [ 3276.534577][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3276.534997][ C0] RBP: ffffed100141336b R08: 0000000000000000 R09: ffffed100141336b [ 3276.535415][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3276.535831][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3276.536249][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3276.536720][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3276.537072][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3276.537493][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3276.537916][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3276.538340][ C0] Call Trace: [ 3276.538521][ C0] [ 3276.538678][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3276.538953][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3276.539212][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3276.539504][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3276.539798][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3276.540107][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3276.540385][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3276.540704][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3276.540979][ C0] ? hrtimer_interrupt+0x31a/0x770 [ 3276.541252][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3276.541530][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3276.541852][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3276.542162][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3276.542498][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3276.542800][ C0] ? kasan_check_range+0x161/0x1c0 [ 3276.543074][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 3276.543375][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3276.543703][ C0] ? get_stack_info+0x36/0xc0 [ 3276.543955][ C0] ? lock_acquire+0x1c1/0x220 [ 3276.544206][ C0] ? lock_release+0x1d5/0x250 [ 3276.544457][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3276.544715][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3276.544999][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3276.545296][ C0] ? lock_acquire+0x1c1/0x220 [ 3276.545547][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3276.545801][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3276.546077][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3276.546324][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3276.546582][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3276.546849][ C0] ? __inet_lookup_established+0x341/0x610 [ 3276.547160][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3276.547454][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3276.547747][ C0] ip_local_deliver+0x19d/0x480 [ 3276.548005][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3276.548288][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3276.548551][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3276.548831][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3276.549101][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3276.549436][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3276.549714][ C0] ip_rcv+0x564/0x740 [ 3276.549930][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3276.550177][ C0] ? set_track_prepare+0x8a/0xd0 [ 3276.550442][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3276.550734][ C0] ? rest_init+0x153/0x260 [ 3276.550969][ C0] ? skb_clone+0x10b/0x330 [ 3276.551210][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3276.551543][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3276.551862][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3276.552163][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3276.552479][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3276.552741][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3276.552986][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3276.553314][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3276.553616][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3276.553954][ C0] ? lock_acquire+0x1c1/0x220 [ 3276.554201][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3276.554509][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3276.554816][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3276.555148][ C0] ? __copy_skb_header+0xaf/0x490 [ 3276.555414][ C0] ? __skb_clone+0x57a/0x760 [ 3276.555660][ C0] netif_receive_skb+0x55/0x280 [ 3276.555923][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3276.556253][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3276.556607][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3276.556918][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3276.557207][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3276.557509][ C0] ? hlock_class+0x4e/0x130 [ 3276.557756][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3276.558089][ C0] ? place_entity+0x21/0x2f0 [ 3276.558339][ C0] ? resched_curr+0x219/0x280 [ 3276.558590][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3276.558856][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3276.559135][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3276.559414][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3276.559674][ C0] ? activate_task+0xf5/0x260 [ 3276.559925][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3276.560210][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3276.560483][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3276.560741][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3276.561031][ C0] ? get_stack_info+0x36/0xc0 [ 3276.561287][ C0] ? stack_access_ok+0xda/0x1f0 [ 3276.561553][ C0] ? get_reg+0x119/0x190 [ 3276.561781][ C0] __tcf_classify+0x32c/0x7d0 [ 3276.562032][ C0] tcf_classify+0x283/0x930 [ 3276.562277][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3276.562603][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3276.562872][ C0] ? arch_stack_walk+0x8c/0x100 [ 3276.563136][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3276.563429][ C0] tc_run+0x2e4/0x5d0 [ 3276.563642][ C0] ? __pfx_tc_run+0x10/0x10 [ 3276.563882][ C0] ? lock_acquire+0x1c1/0x220 [ 3276.564129][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3276.564408][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3276.564676][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3276.564959][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3276.565235][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3276.565553][ C0] ? neigh_hh_output+0x348/0x590 [ 3276.565822][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3276.566100][ C0] ip_finish_output2+0x786/0x18e0 [ 3276.566367][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3276.566655][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3276.567013][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3276.567306][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3276.567569][ C0] ? __ip_finish_output+0x10f/0x770 [ 3276.567849][ C0] ip_output+0x16b/0x4f0 [ 3276.568078][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3276.568363][ C0] ? __pfx_ip_output+0x10/0x10 [ 3276.568622][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3276.568921][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3276.569186][ C0] ? ip_local_out+0x114/0x3b0 [ 3276.569433][ C0] __ip_queue_xmit+0x672/0x1910 [ 3276.569693][ C0] ? __skb_clone+0x57a/0x760 [ 3276.569939][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3276.570230][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3276.570524][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3276.570841][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3276.571100][ C0] ? tcp_current_mss+0x40a/0x510 [ 3276.571361][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3276.571645][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3276.571924][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3276.572175][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3276.572448][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3276.572767][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3276.573042][ C0] ? ktime_get+0xb6/0x190 [ 3276.573274][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3276.573548][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3276.573832][ C0] tcp_write_timer+0x82/0x1d0 [ 3276.574082][ C0] call_timer_fn+0x176/0x430 [ 3276.574325][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3276.574601][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3276.574874][ C0] __run_timers.part.0+0x52d/0x890 [ 3276.575152][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3276.575433][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3276.575732][ C0] ? lock_acquire+0x1c1/0x220 [ 3276.575978][ C0] ? clockevents_program_event+0xf6/0x300 [ 3276.576281][ C0] ? lock_release+0x1d5/0x250 [ 3276.576533][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3276.576809][ C0] ? ktime_get+0xb6/0x190 [ 3276.577044][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3276.577341][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3276.577654][ C0] run_timer_softirq+0x72/0x100 [ 3276.577910][ C0] __do_softirq+0x1bc/0x7ff [ 3276.578151][ C0] irq_exit_rcu+0x98/0xc0 [ 3276.578381][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3276.578678][ C0] [ 3276.578839][ C0] [ 3276.578999][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3276.579327][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3276.579595][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3276.580620][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3276.580945][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3276.581366][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3276.581788][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3276.582212][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3276.582630][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3276.583051][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3276.583358][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3276.583631][ C0] default_idle_call+0x69/0xa0 [ 3276.583883][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3276.584150][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3276.584441][ C0] ? lock_release+0x1d5/0x250 [ 3276.584693][ C0] do_idle+0xfb/0x160 [ 3276.584906][ C0] cpu_startup_entry+0x55/0x60 [ 3276.585160][ C0] rest_init+0x153/0x260 [ 3276.585385][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3276.585676][ C0] arch_call_rest_init+0x13/0x40 [ 3276.585941][ C0] start_kernel+0x314/0x3d0 [ 3276.586181][ C0] x86_64_start_reservations+0x18/0x30 [ 3276.586468][ C0] x86_64_start_kernel+0xba/0x110 [ 3276.586740][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3276.587069][ C0] [ 3276.587238][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1945s! [ksoftirqd/1:22] [ 3276.587715][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3276.588928][ C1] irq event stamp: 3886976 [ 3276.589169][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3276.589671][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3276.590186][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3276.590694][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3276.591187][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3276.591687][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3276.592343][ C1] RIP: 0010:kasan_check_range+0x81/0x1c0 [ 3276.592649][ C1] Code: 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 89 da <48> 29 ea 48 83 fa 10 0f 8e c0 00 00 00 41 89 eb 41 83 e3 07 75 7d [ 3276.593669][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000286 [ 3276.593991][ C1] RAX: ffffed10014131c3 RBX: ffffed10014131c4 RCX: ffffffff90c7aaa0 [ 3276.594413][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3276.594834][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: ffffed10014131c3 [ 3276.595255][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3276.595674][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3276.596096][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3276.596568][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3276.596921][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3276.597346][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3276.597778][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3276.598207][ C1] Call Trace: [ 3276.598390][ C1] [ 3276.598549][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3276.598827][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3276.599089][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3276.599381][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3276.599673][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3276.599979][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3276.600267][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3276.600587][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3276.600867][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3276.601194][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3276.601502][ C1] [ 3276.601664][ C1] [ 3276.601826][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3276.602165][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3276.602468][ C1] ? kasan_check_range+0x81/0x1c0 [ 3276.602737][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 3276.603031][ C1] ? run_ksoftirqd+0xb/0x60 [ 3276.603273][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3276.603601][ C1] ? __orc_find+0x9c/0xf0 [ 3276.603835][ C1] ? lock_acquire+0x1c1/0x220 [ 3276.604095][ C1] ? irqentry_enter+0x2b/0x60 [ 3276.604357][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3276.604622][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3276.604911][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3276.605213][ C1] ? lock_acquire+0x1c1/0x220 [ 3276.605461][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3276.605712][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3276.605985][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3276.606239][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3276.606503][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3276.606778][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3276.607075][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3276.607372][ C1] ip_local_deliver+0x19d/0x480 [ 3276.607632][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3276.607918][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3276.608185][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3276.608466][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3276.608731][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3276.609066][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3276.609347][ C1] ip_rcv+0x564/0x740 [ 3276.609561][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3276.609807][ C1] ? set_track_prepare+0x8a/0xd0 [ 3276.610082][ C1] ? irqentry_enter+0x2b/0x60 [ 3276.610336][ C1] ? irqentry_enter+0x2b/0x60 [ 3276.610590][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3276.610835][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3276.611157][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3276.611504][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3276.611817][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3276.612157][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3276.612456][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3276.612794][ C1] netif_receive_skb+0x55/0x280 [ 3276.613060][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3276.613395][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3276.613747][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3276.614065][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3276.614358][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3276.614669][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3276.615001][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3276.615288][ C1] ? arch_stack_walk+0x68/0x100 [ 3276.615548][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3276.615824][ C1] ? irqentry_enter+0x2b/0x60 [ 3276.616074][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3276.616392][ C1] ? irqentry_enter+0x2b/0x60 [ 3276.616646][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3276.616975][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3276.617257][ C1] ? arch_stack_walk+0x68/0x100 [ 3276.617524][ C1] __tcf_classify+0x32c/0x7d0 [ 3276.617783][ C1] tcf_classify+0x283/0x930 [ 3276.618031][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3276.618306][ C1] tc_run+0x2e4/0x5d0 [ 3276.618522][ C1] ? __pfx_tc_run+0x10/0x10 [ 3276.618770][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3276.619040][ C1] ? irqentry_enter+0x2b/0x60 [ 3276.619289][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3276.619573][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3276.619893][ C1] ip_finish_output2+0x786/0x18e0 [ 3276.620174][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3276.620464][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3276.620733][ C1] ? __ip_finish_output+0x10f/0x770 [ 3276.621013][ C1] ip_output+0x16b/0x4f0 [ 3276.621243][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3276.621567][ C1] ? __pfx_ip_output+0x10/0x10 [ 3276.621825][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3276.622184][ C1] ? __pfx_ip_output+0x10/0x10 [ 3276.622447][ C1] __ip_queue_xmit+0x672/0x1910 [ 3276.622710][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3276.622991][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3276.623290][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3276.623582][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3276.623878][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3276.624164][ C1] tcp_delack_timer+0x84/0x240 [ 3276.624417][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3276.624704][ C1] call_timer_fn+0x176/0x430 [ 3276.624955][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3276.625231][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3276.625513][ C1] __run_timers.part.0+0x52d/0x890 [ 3276.625789][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3276.626077][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3276.626376][ C1] ? __pfx___schedule+0x10/0x10 [ 3276.626642][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3276.626963][ C1] run_timer_softirq+0x72/0x100 [ 3276.627224][ C1] __do_softirq+0x1bc/0x7ff [ 3276.627466][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3276.627739][ C1] run_ksoftirqd+0x2e/0x60 [ 3276.627982][ C1] smpboot_thread_fn+0x30e/0x840 [ 3276.628250][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3276.628544][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3276.628832][ C1] kthread+0x292/0x360 [ 3276.629056][ C1] ? __pfx_kthread+0x10/0x10 [ 3276.629302][ C1] ret_from_fork+0x34/0x70 [ 3276.629544][ C1] ? __pfx_kthread+0x10/0x10 [ 3276.629788][ C1] ret_from_fork_asm+0x1b/0x30 [ 3276.630061][ C1] [ 3304.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 1971s! [swapper/0:0] [ 3304.527928][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3304.529117][ C0] irq event stamp: 27567077 [ 3304.529357][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3304.529881][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3304.530363][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3304.530866][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3304.531358][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3304.531836][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3304.532485][ C0] RIP: 0010:kasan_check_range+0x54/0x1c0 [ 3304.532791][ C0] Code: ff fe 48 39 c7 77 23 44 89 c2 e8 57 e8 ff ff 83 f0 01 5b 5d 41 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd <4c> 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 [ 3304.533807][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000216 [ 3304.534128][ C0] RAX: ffff7fffffffffff RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3304.534547][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3304.534972][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3304.535389][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3304.535805][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3304.536224][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3304.536693][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3304.537046][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3304.537468][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3304.537894][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3304.538317][ C0] Call Trace: [ 3304.538496][ C0] [ 3304.538656][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3304.538932][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3304.539190][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3304.539478][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3304.539765][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3304.540073][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3304.540350][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3304.540672][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3304.540944][ C0] ? hrtimer_interrupt+0x31a/0x770 [ 3304.541214][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3304.541492][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3304.541812][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3304.542121][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3304.542455][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3304.542757][ C0] ? kasan_check_range+0x54/0x1c0 [ 3304.543023][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 3304.543317][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3304.543641][ C0] ? get_stack_info+0x36/0xc0 [ 3304.543898][ C0] ? lock_acquire+0x1c1/0x220 [ 3304.544156][ C0] ? lock_release+0x1d5/0x250 [ 3304.544410][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3304.544672][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3304.544957][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3304.545256][ C0] ? lock_acquire+0x1c1/0x220 [ 3304.545501][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3304.545750][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3304.546019][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3304.546269][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3304.546530][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3304.546799][ C0] ? __inet_lookup_established+0x341/0x610 [ 3304.547114][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3304.547404][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3304.547693][ C0] ip_local_deliver+0x19d/0x480 [ 3304.547952][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3304.548238][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3304.548509][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3304.548785][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3304.549046][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3304.549382][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3304.549655][ C0] ip_rcv+0x564/0x740 [ 3304.549868][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3304.550117][ C0] ? set_track_prepare+0x8a/0xd0 [ 3304.550384][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3304.550672][ C0] ? rest_init+0x153/0x260 [ 3304.550909][ C0] ? skb_clone+0x10b/0x330 [ 3304.551149][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3304.551485][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3304.551810][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3304.552105][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3304.552413][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3304.552670][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3304.552910][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3304.553222][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3304.553518][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3304.553861][ C0] ? lock_acquire+0x1c1/0x220 [ 3304.554116][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3304.554428][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3304.554725][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3304.555059][ C0] ? __copy_skb_header+0xaf/0x490 [ 3304.555331][ C0] ? __skb_clone+0x57a/0x760 [ 3304.555579][ C0] netif_receive_skb+0x55/0x280 [ 3304.555837][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3304.556165][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3304.556510][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3304.556824][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3304.557108][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3304.557405][ C0] ? hlock_class+0x4e/0x130 [ 3304.557648][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3304.557973][ C0] ? place_entity+0x21/0x2f0 [ 3304.558218][ C0] ? resched_curr+0x219/0x280 [ 3304.558473][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3304.558742][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3304.559026][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3304.559301][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3304.559562][ C0] ? activate_task+0xf5/0x260 [ 3304.559809][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3304.560092][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3304.560364][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3304.560629][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3304.560925][ C0] ? get_stack_info+0x36/0xc0 [ 3304.561175][ C0] ? stack_access_ok+0xda/0x1f0 [ 3304.561431][ C0] ? get_reg+0x119/0x190 [ 3304.561660][ C0] __tcf_classify+0x32c/0x7d0 [ 3304.561915][ C0] tcf_classify+0x283/0x930 [ 3304.562159][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3304.562489][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3304.562753][ C0] ? arch_stack_walk+0x8c/0x100 [ 3304.563013][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3304.563299][ C0] tc_run+0x2e4/0x5d0 [ 3304.563517][ C0] ? __pfx_tc_run+0x10/0x10 [ 3304.563761][ C0] ? lock_acquire+0x1c1/0x220 [ 3304.564011][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3304.564288][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3304.564556][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3304.564842][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3304.565120][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3304.565443][ C0] ? neigh_hh_output+0x348/0x590 [ 3304.565706][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3304.565986][ C0] ip_finish_output2+0x786/0x18e0 [ 3304.566258][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3304.566554][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3304.566903][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3304.567192][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3304.567457][ C0] ? __ip_finish_output+0x10f/0x770 [ 3304.567733][ C0] ip_output+0x16b/0x4f0 [ 3304.567960][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3304.568246][ C0] ? __pfx_ip_output+0x10/0x10 [ 3304.568502][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3304.568804][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3304.569065][ C0] ? ip_local_out+0x114/0x3b0 [ 3304.569320][ C0] __ip_queue_xmit+0x672/0x1910 [ 3304.569586][ C0] ? __skb_clone+0x57a/0x760 [ 3304.569835][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3304.570123][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3304.570420][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3304.570741][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3304.570995][ C0] ? tcp_current_mss+0x40a/0x510 [ 3304.571262][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3304.571543][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3304.571822][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3304.572076][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3304.572342][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3304.572660][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3304.572940][ C0] ? ktime_get+0xb6/0x190 [ 3304.573175][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3304.573452][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3304.573732][ C0] tcp_write_timer+0x82/0x1d0 [ 3304.573986][ C0] call_timer_fn+0x176/0x430 [ 3304.574235][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3304.574507][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3304.574783][ C0] __run_timers.part.0+0x52d/0x890 [ 3304.575053][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3304.575338][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3304.575634][ C0] ? lock_acquire+0x1c1/0x220 [ 3304.575887][ C0] ? clockevents_program_event+0xf6/0x300 [ 3304.576197][ C0] ? lock_release+0x1d5/0x250 [ 3304.576448][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3304.576727][ C0] ? ktime_get+0xb6/0x190 [ 3304.576958][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3304.577260][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3304.577570][ C0] run_timer_softirq+0x72/0x100 [ 3304.577831][ C0] __do_softirq+0x1bc/0x7ff [ 3304.578078][ C0] irq_exit_rcu+0x98/0xc0 [ 3304.578311][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3304.578611][ C0] [ 3304.578766][ C0] [ 3304.578921][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3304.579237][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3304.579506][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3304.580533][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3304.580852][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3304.581270][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3304.581685][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3304.582103][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3304.582516][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3304.582932][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3304.583232][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3304.583504][ C0] default_idle_call+0x69/0xa0 [ 3304.583762][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3304.584024][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3304.584317][ C0] ? lock_release+0x1d5/0x250 [ 3304.584564][ C0] do_idle+0xfb/0x160 [ 3304.584775][ C0] cpu_startup_entry+0x55/0x60 [ 3304.585027][ C0] rest_init+0x153/0x260 [ 3304.585257][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3304.585541][ C0] arch_call_rest_init+0x13/0x40 [ 3304.585804][ C0] start_kernel+0x314/0x3d0 [ 3304.586049][ C0] x86_64_start_reservations+0x18/0x30 [ 3304.586342][ C0] x86_64_start_kernel+0xba/0x110 [ 3304.586607][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3304.586933][ C0] [ 3304.587098][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1971s! [ksoftirqd/1:22] [ 3304.587577][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3304.588774][ C1] irq event stamp: 3886976 [ 3304.589012][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3304.589519][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3304.590023][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3304.590527][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3304.591021][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3304.591517][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3304.592160][ C1] RIP: 0010:__kasan_check_read+0x8/0x20 [ 3304.592455][ C1] Code: 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 48 8b 0c 24 <89> f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f [ 3304.593477][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [ 3304.593800][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3304.594224][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3304.594644][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3304.595066][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3304.595485][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3304.595906][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3304.596379][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3304.596732][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3304.597159][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3304.597586][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3304.598010][ C1] Call Trace: [ 3304.598191][ C1] [ 3304.598352][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3304.598628][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3304.598887][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3304.599179][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3304.599467][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3304.599772][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3304.600062][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3304.600387][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3304.600665][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3304.600985][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3304.601297][ C1] [ 3304.601458][ C1] [ 3304.601619][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3304.601953][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3304.602259][ C1] ? __kasan_check_read+0x8/0x20 [ 3304.602523][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 3304.602819][ C1] ? run_ksoftirqd+0xb/0x60 [ 3304.603068][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3304.603400][ C1] ? __orc_find+0x9c/0xf0 [ 3304.603630][ C1] ? lock_acquire+0x1c1/0x220 [ 3304.603885][ C1] ? irqentry_enter+0x2b/0x60 [ 3304.604140][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3304.604401][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3304.604686][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3304.604983][ C1] ? lock_acquire+0x1c1/0x220 [ 3304.605239][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3304.605496][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3304.605772][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3304.606018][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3304.606278][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3304.606549][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3304.606840][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3304.607133][ C1] ip_local_deliver+0x19d/0x480 [ 3304.607398][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3304.607686][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3304.607952][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3304.608234][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3304.608496][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3304.608835][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3304.609111][ C1] ip_rcv+0x564/0x740 [ 3304.609323][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3304.609562][ C1] ? set_track_prepare+0x8a/0xd0 [ 3304.609826][ C1] ? irqentry_enter+0x2b/0x60 [ 3304.610085][ C1] ? irqentry_enter+0x2b/0x60 [ 3304.610334][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3304.610573][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3304.610889][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3304.611230][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3304.611537][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3304.611881][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3304.612187][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3304.612520][ C1] netif_receive_skb+0x55/0x280 [ 3304.612779][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3304.613108][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3304.613458][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3304.613777][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3304.614068][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3304.614371][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3304.614700][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3304.614981][ C1] ? arch_stack_walk+0x68/0x100 [ 3304.615248][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3304.615528][ C1] ? irqentry_enter+0x2b/0x60 [ 3304.615784][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3304.616109][ C1] ? irqentry_enter+0x2b/0x60 [ 3304.616358][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3304.616682][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3304.616966][ C1] ? arch_stack_walk+0x68/0x100 [ 3304.617227][ C1] __tcf_classify+0x32c/0x7d0 [ 3304.617481][ C1] tcf_classify+0x283/0x930 [ 3304.617724][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3304.617992][ C1] tc_run+0x2e4/0x5d0 [ 3304.618208][ C1] ? __pfx_tc_run+0x10/0x10 [ 3304.618453][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3304.618718][ C1] ? irqentry_enter+0x2b/0x60 [ 3304.618976][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3304.619266][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3304.619591][ C1] ip_finish_output2+0x786/0x18e0 [ 3304.619861][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3304.620158][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3304.620423][ C1] ? __ip_finish_output+0x10f/0x770 [ 3304.620708][ C1] ip_output+0x16b/0x4f0 [ 3304.620936][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3304.621254][ C1] ? __pfx_ip_output+0x10/0x10 [ 3304.621513][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3304.621867][ C1] ? __pfx_ip_output+0x10/0x10 [ 3304.622127][ C1] __ip_queue_xmit+0x672/0x1910 [ 3304.622392][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3304.622679][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3304.622977][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3304.623266][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3304.623564][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3304.623852][ C1] tcp_delack_timer+0x84/0x240 [ 3304.624112][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3304.624394][ C1] call_timer_fn+0x176/0x430 [ 3304.624640][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3304.624918][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3304.625197][ C1] __run_timers.part.0+0x52d/0x890 [ 3304.625468][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3304.625757][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3304.626064][ C1] ? __pfx___schedule+0x10/0x10 [ 3304.626324][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3304.626643][ C1] run_timer_softirq+0x72/0x100 [ 3304.626909][ C1] __do_softirq+0x1bc/0x7ff [ 3304.627157][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3304.627439][ C1] run_ksoftirqd+0x2e/0x60 [ 3304.627679][ C1] smpboot_thread_fn+0x30e/0x840 [ 3304.627948][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3304.628236][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3304.628531][ C1] kthread+0x292/0x360 [ 3304.628750][ C1] ? __pfx_kthread+0x10/0x10 [ 3304.629000][ C1] ret_from_fork+0x34/0x70 [ 3304.629243][ C1] ? __pfx_kthread+0x10/0x10 [ 3304.629491][ C1] ret_from_fork_asm+0x1b/0x30 [ 3304.629748][ C1] [ 3328.572031][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3328.572441][ C0] rcu: 0-....: (2132338 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=509663 [ 3328.572958][ C0] rcu: (t=2134263 jiffies g=1007429 q=31 ncpus=4) [ 3328.573307][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3328.573784][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3328.574431][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3328.574779][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3328.575802][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3328.576128][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3328.576552][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3328.576976][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3328.577397][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3328.577816][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3328.578240][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3328.578716][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3328.579063][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3328.579490][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3328.579919][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3328.580344][ C0] Call Trace: [ 3328.580524][ C0] [ 3328.580684][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3328.580971][ C0] ? print_cpu_stall+0x263/0x6a0 [ 3328.581235][ C0] ? check_cpu_stall+0x284/0x500 [ 3328.581499][ C0] ? rcu_pending+0x92/0x360 [ 3328.581737][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3328.582017][ C0] ? update_process_times+0xb9/0x110 [ 3328.582303][ C0] ? tick_sched_handle+0x67/0x130 [ 3328.582570][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3328.582868][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3328.583124][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3328.583451][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3328.583739][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3328.584044][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3328.584324][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3328.584652][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3328.584923][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3328.585203][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3328.585527][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3328.585836][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3328.586169][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3328.586470][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3328.586778][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3328.587082][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3328.587415][ C0] ? get_stack_info+0x36/0xc0 [ 3328.587667][ C0] ? lock_acquire+0x1c1/0x220 [ 3328.587917][ C0] ? lock_release+0x1d5/0x250 [ 3328.588165][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3328.588422][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3328.588704][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3328.589001][ C0] ? lock_acquire+0x1c1/0x220 [ 3328.589254][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3328.589511][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3328.589793][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3328.590041][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3328.590300][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3328.590574][ C0] ? __inet_lookup_established+0x341/0x610 [ 3328.590886][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3328.591179][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3328.591470][ C0] ip_local_deliver+0x19d/0x480 [ 3328.591730][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3328.592012][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3328.592275][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3328.592553][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3328.592819][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3328.593154][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3328.593431][ C0] ip_rcv+0x564/0x740 [ 3328.593642][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3328.593880][ C0] ? set_track_prepare+0x8a/0xd0 [ 3328.594142][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3328.594434][ C0] ? rest_init+0x153/0x260 [ 3328.594669][ C0] ? skb_clone+0x10b/0x330 [ 3328.594911][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3328.595243][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3328.595560][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3328.595860][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3328.596176][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3328.596437][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3328.596681][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3328.597002][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3328.597302][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3328.597640][ C0] ? lock_acquire+0x1c1/0x220 [ 3328.597886][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3328.598198][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3328.598498][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3328.598832][ C0] ? __copy_skb_header+0xaf/0x490 [ 3328.599100][ C0] ? __skb_clone+0x57a/0x760 [ 3328.599344][ C0] netif_receive_skb+0x55/0x280 [ 3328.599608][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3328.599940][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3328.600288][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3328.600601][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3328.600885][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3328.601182][ C0] ? hlock_class+0x4e/0x130 [ 3328.601423][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3328.601751][ C0] ? place_entity+0x21/0x2f0 [ 3328.601997][ C0] ? resched_curr+0x219/0x280 [ 3328.602252][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3328.602519][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3328.602806][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3328.603082][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3328.603339][ C0] ? activate_task+0xf5/0x260 [ 3328.603588][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3328.603862][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3328.604137][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3328.604395][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3328.604685][ C0] ? get_stack_info+0x36/0xc0 [ 3328.604942][ C0] ? stack_access_ok+0xda/0x1f0 [ 3328.605203][ C0] ? get_reg+0x119/0x190 [ 3328.605430][ C0] __tcf_classify+0x32c/0x7d0 [ 3328.605681][ C0] tcf_classify+0x283/0x930 [ 3328.605927][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3328.606252][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3328.606521][ C0] ? arch_stack_walk+0x8c/0x100 [ 3328.606785][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3328.607077][ C0] tc_run+0x2e4/0x5d0 [ 3328.607291][ C0] ? __pfx_tc_run+0x10/0x10 [ 3328.607531][ C0] ? lock_acquire+0x1c1/0x220 [ 3328.607778][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3328.608054][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3328.608323][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3328.608608][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3328.608884][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3328.609204][ C0] ? neigh_hh_output+0x348/0x590 [ 3328.609472][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3328.609751][ C0] ip_finish_output2+0x786/0x18e0 [ 3328.610027][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3328.610322][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3328.610676][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3328.610965][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3328.611232][ C0] ? __ip_finish_output+0x10f/0x770 [ 3328.611508][ C0] ip_output+0x16b/0x4f0 [ 3328.611732][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3328.612017][ C0] ? __pfx_ip_output+0x10/0x10 [ 3328.612271][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3328.612575][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3328.612843][ C0] ? ip_local_out+0x114/0x3b0 [ 3328.613095][ C0] __ip_queue_xmit+0x672/0x1910 [ 3328.613357][ C0] ? __skb_clone+0x57a/0x760 [ 3328.613605][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3328.613884][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3328.614177][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3328.614491][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3328.614750][ C0] ? tcp_current_mss+0x40a/0x510 [ 3328.615014][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3328.615297][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3328.615570][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3328.615821][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3328.616093][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3328.616413][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3328.616686][ C0] ? ktime_get+0xb6/0x190 [ 3328.616917][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3328.617191][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3328.617474][ C0] tcp_write_timer+0x82/0x1d0 [ 3328.617722][ C0] call_timer_fn+0x176/0x430 [ 3328.617966][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3328.618242][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3328.618513][ C0] __run_timers.part.0+0x52d/0x890 [ 3328.618790][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3328.619069][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3328.619366][ C0] ? lock_acquire+0x1c1/0x220 [ 3328.619612][ C0] ? clockevents_program_event+0xf6/0x300 [ 3328.619922][ C0] ? lock_release+0x1d5/0x250 [ 3328.620177][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3328.620455][ C0] ? ktime_get+0xb6/0x190 [ 3328.620692][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3328.620992][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3328.621299][ C0] run_timer_softirq+0x72/0x100 [ 3328.621559][ C0] __do_softirq+0x1bc/0x7ff [ 3328.621804][ C0] irq_exit_rcu+0x98/0xc0 [ 3328.622042][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3328.622343][ C0] [ 3328.622500][ C0] [ 3328.622657][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3328.622978][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3328.623249][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3328.624273][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3328.624599][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3328.625021][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3328.625442][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3328.625865][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3328.626283][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3328.626703][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3328.627007][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3328.627282][ C0] default_idle_call+0x69/0xa0 [ 3328.627534][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3328.627800][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3328.628092][ C0] ? lock_release+0x1d5/0x250 [ 3328.628344][ C0] do_idle+0xfb/0x160 [ 3328.628557][ C0] cpu_startup_entry+0x55/0x60 [ 3328.628811][ C0] rest_init+0x153/0x260 [ 3328.629036][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3328.629325][ C0] arch_call_rest_init+0x13/0x40 [ 3328.629592][ C0] start_kernel+0x314/0x3d0 [ 3328.629837][ C0] x86_64_start_reservations+0x18/0x30 [ 3328.630130][ C0] x86_64_start_kernel+0xba/0x110 [ 3328.630398][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3328.630724][ C0] [ 3328.630887][ C0] Sending NMI from CPU 0 to CPUs 1: [ 3328.631188][ C1] NMI backtrace for cpu 1 [ 3328.631197][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3328.631202][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3328.631206][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3328.631216][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3328.631219][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3328.631223][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3328.631225][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3328.631227][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3328.631229][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3328.631232][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3328.631234][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3328.631236][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3328.631240][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3328.631242][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3328.631243][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3328.631245][ C1] Call Trace: [ 3328.631249][ C1] [ 3328.631253][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 3328.631260][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3328.631267][ C1] ? nmi_handle+0x156/0x420 [ 3328.631273][ C1] ? default_do_nmi+0x41/0x100 [ 3328.631277][ C1] ? exc_nmi+0xf3/0x120 [ 3328.631280][ C1] ? end_repeat_nmi+0xf/0x60 [ 3328.631284][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3328.631288][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3328.631292][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3328.631295][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3328.631299][ C1] [ 3328.631300][ C1] [ 3328.631301][ C1] ? run_ksoftirqd+0xb/0x60 [ 3328.631307][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3328.631310][ C1] ? __orc_find+0x9c/0xf0 [ 3328.631313][ C1] ? lock_acquire+0x1c1/0x220 [ 3328.631318][ C1] ? irqentry_enter+0x2b/0x60 [ 3328.631323][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3328.631328][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3328.631331][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3328.631334][ C1] ? lock_acquire+0x1c1/0x220 [ 3328.631336][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3328.631342][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3328.631346][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3328.631354][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3328.631357][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3328.631363][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3328.631371][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3328.631375][ C1] ip_local_deliver+0x19d/0x480 [ 3328.631379][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3328.631381][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3328.631386][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3328.631390][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3328.631393][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3328.631396][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3328.631407][ C1] ip_rcv+0x564/0x740 [ 3328.631411][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3328.631414][ C1] ? set_track_prepare+0x8a/0xd0 [ 3328.631419][ C1] ? irqentry_enter+0x2b/0x60 [ 3328.631423][ C1] ? irqentry_enter+0x2b/0x60 [ 3328.631427][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3328.631429][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3328.631434][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3328.631437][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3328.631440][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3328.631443][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3328.631446][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3328.631451][ C1] netif_receive_skb+0x55/0x280 [ 3328.631455][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3328.631464][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3328.631471][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3328.631478][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3328.631485][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3328.631497][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3328.631507][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3328.631509][ C1] ? arch_stack_walk+0x68/0x100 [ 3328.631515][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3328.631518][ C1] ? irqentry_enter+0x2b/0x60 [ 3328.631522][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3328.631527][ C1] ? irqentry_enter+0x2b/0x60 [ 3328.631530][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3328.631538][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3328.631541][ C1] ? arch_stack_walk+0x68/0x100 [ 3328.631545][ C1] __tcf_classify+0x32c/0x7d0 [ 3328.631551][ C1] tcf_classify+0x283/0x930 [ 3328.631555][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3328.631559][ C1] tc_run+0x2e4/0x5d0 [ 3328.631564][ C1] ? __pfx_tc_run+0x10/0x10 [ 3328.631569][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3328.631576][ C1] ? irqentry_enter+0x2b/0x60 [ 3328.631579][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3328.631582][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3328.631589][ C1] ip_finish_output2+0x786/0x18e0 [ 3328.631595][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3328.631599][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3328.631603][ C1] ? __ip_finish_output+0x10f/0x770 [ 3328.631607][ C1] ip_output+0x16b/0x4f0 [ 3328.631611][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3328.631614][ C1] ? __pfx_ip_output+0x10/0x10 [ 3328.631619][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3328.631626][ C1] ? __pfx_ip_output+0x10/0x10 [ 3328.631631][ C1] __ip_queue_xmit+0x672/0x1910 [ 3328.631636][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3328.631643][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3328.631648][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3328.631652][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3328.631656][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3328.631660][ C1] tcp_delack_timer+0x84/0x240 [ 3328.631663][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3328.631666][ C1] call_timer_fn+0x176/0x430 [ 3328.631671][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3328.631676][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3328.631680][ C1] __run_timers.part.0+0x52d/0x890 [ 3328.631683][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3328.631688][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3328.631693][ C1] ? __pfx___schedule+0x10/0x10 [ 3328.631697][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3328.631702][ C1] run_timer_softirq+0x72/0x100 [ 3328.631705][ C1] __do_softirq+0x1bc/0x7ff [ 3328.631709][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3328.631713][ C1] run_ksoftirqd+0x2e/0x60 [ 3328.631716][ C1] smpboot_thread_fn+0x30e/0x840 [ 3328.631720][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3328.631723][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3328.631726][ C1] kthread+0x292/0x360 [ 3328.631729][ C1] ? __pfx_kthread+0x10/0x10 [ 3328.631731][ C1] ret_from_fork+0x34/0x70 [ 3328.631734][ C1] ? __pfx_kthread+0x10/0x10 [ 3328.631736][ C1] ret_from_fork_asm+0x1b/0x30 [ 3328.631743][ C1] [ 3356.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2020s! [swapper/0:0] [ 3356.527926][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3356.529127][ C0] irq event stamp: 27567077 [ 3356.529373][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3356.529912][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3356.530389][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3356.530901][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3356.531401][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3356.531883][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3356.532522][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3356.532860][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3356.533881][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3356.534203][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3356.534621][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3356.535041][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3356.535460][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3356.535878][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3356.536297][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3356.536768][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3356.537120][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3356.537542][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3356.537968][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3356.538395][ C0] Call Trace: [ 3356.538577][ C0] [ 3356.538735][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3356.539011][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3356.539272][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3356.539563][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3356.539855][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3356.540157][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3356.540434][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3356.540753][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3356.541033][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3356.541308][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3356.541634][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3356.541950][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3356.542283][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3356.542589][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3356.542904][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3356.543206][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3356.543532][ C0] ? get_stack_info+0x36/0xc0 [ 3356.543792][ C0] ? lock_acquire+0x1c1/0x220 [ 3356.544045][ C0] ? lock_release+0x1d5/0x250 [ 3356.544297][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3356.544560][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3356.544846][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3356.545147][ C0] ? lock_acquire+0x1c1/0x220 [ 3356.545396][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3356.545649][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3356.545921][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3356.546169][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3356.546429][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3356.546702][ C0] ? __inet_lookup_established+0x341/0x610 [ 3356.547018][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3356.547310][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3356.547600][ C0] ip_local_deliver+0x19d/0x480 [ 3356.547861][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3356.548150][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3356.548420][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3356.548698][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3356.548960][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3356.549299][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3356.549573][ C0] ip_rcv+0x564/0x740 [ 3356.549801][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3356.550046][ C0] ? set_track_prepare+0x8a/0xd0 [ 3356.550316][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3356.550608][ C0] ? rest_init+0x153/0x260 [ 3356.550849][ C0] ? skb_clone+0x10b/0x330 [ 3356.551090][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3356.551427][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3356.551752][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3356.552049][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3356.552355][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3356.552615][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3356.552857][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3356.553170][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3356.553466][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3356.553811][ C0] ? lock_acquire+0x1c1/0x220 [ 3356.554065][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3356.554376][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3356.554674][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3356.555007][ C0] ? __copy_skb_header+0xaf/0x490 [ 3356.555279][ C0] ? __skb_clone+0x57a/0x760 [ 3356.555528][ C0] netif_receive_skb+0x55/0x280 [ 3356.555786][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3356.556113][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3356.556460][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3356.556778][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3356.557065][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3356.557365][ C0] ? hlock_class+0x4e/0x130 [ 3356.557612][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3356.557938][ C0] ? place_entity+0x21/0x2f0 [ 3356.558183][ C0] ? resched_curr+0x219/0x280 [ 3356.558437][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3356.558709][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3356.558994][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3356.559271][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3356.559528][ C0] ? activate_task+0xf5/0x260 [ 3356.559786][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3356.560065][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3356.560339][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3356.560602][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3356.560894][ C0] ? get_stack_info+0x36/0xc0 [ 3356.561144][ C0] ? stack_access_ok+0xda/0x1f0 [ 3356.561400][ C0] ? get_reg+0x119/0x190 [ 3356.561626][ C0] __tcf_classify+0x32c/0x7d0 [ 3356.561881][ C0] tcf_classify+0x283/0x930 [ 3356.562128][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3356.562460][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3356.562726][ C0] ? arch_stack_walk+0x8c/0x100 [ 3356.562985][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3356.563274][ C0] tc_run+0x2e4/0x5d0 [ 3356.563495][ C0] ? __pfx_tc_run+0x10/0x10 [ 3356.563740][ C0] ? lock_acquire+0x1c1/0x220 [ 3356.563994][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3356.564272][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3356.564538][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3356.564828][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3356.565108][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3356.565434][ C0] ? neigh_hh_output+0x348/0x590 [ 3356.565698][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3356.565979][ C0] ip_finish_output2+0x786/0x18e0 [ 3356.566249][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3356.566546][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3356.566897][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3356.567185][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3356.567452][ C0] ? __ip_finish_output+0x10f/0x770 [ 3356.567728][ C0] ip_output+0x16b/0x4f0 [ 3356.567954][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3356.568240][ C0] ? __pfx_ip_output+0x10/0x10 [ 3356.568495][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3356.568796][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3356.569061][ C0] ? ip_local_out+0x114/0x3b0 [ 3356.569317][ C0] __ip_queue_xmit+0x672/0x1910 [ 3356.569580][ C0] ? __skb_clone+0x57a/0x760 [ 3356.569837][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3356.570122][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3356.570422][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3356.570742][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3356.570998][ C0] ? tcp_current_mss+0x40a/0x510 [ 3356.571267][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3356.571549][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3356.571831][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3356.572089][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3356.572357][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3356.572677][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3356.572958][ C0] ? ktime_get+0xb6/0x190 [ 3356.573195][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3356.573470][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3356.573752][ C0] tcp_write_timer+0x82/0x1d0 [ 3356.574009][ C0] call_timer_fn+0x176/0x430 [ 3356.574259][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3356.574531][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3356.574808][ C0] __run_timers.part.0+0x52d/0x890 [ 3356.575084][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3356.575370][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3356.575669][ C0] ? lock_acquire+0x1c1/0x220 [ 3356.575923][ C0] ? clockevents_program_event+0xf6/0x300 [ 3356.576233][ C0] ? lock_release+0x1d5/0x250 [ 3356.576484][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3356.576763][ C0] ? ktime_get+0xb6/0x190 [ 3356.576996][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3356.577297][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3356.577607][ C0] run_timer_softirq+0x72/0x100 [ 3356.577872][ C0] __do_softirq+0x1bc/0x7ff [ 3356.578120][ C0] irq_exit_rcu+0x98/0xc0 [ 3356.578353][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3356.578661][ C0] [ 3356.578817][ C0] [ 3356.578973][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3356.579290][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3356.579562][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3356.580584][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3356.580904][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3356.581325][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3356.581742][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3356.582157][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3356.582573][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3356.582992][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3356.583302][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3356.583575][ C0] default_idle_call+0x69/0xa0 [ 3356.583830][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3356.584093][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3356.584386][ C0] ? lock_release+0x1d5/0x250 [ 3356.584633][ C0] do_idle+0xfb/0x160 [ 3356.584844][ C0] cpu_startup_entry+0x55/0x60 [ 3356.585100][ C0] rest_init+0x153/0x260 [ 3356.585325][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3356.585609][ C0] arch_call_rest_init+0x13/0x40 [ 3356.585875][ C0] start_kernel+0x314/0x3d0 [ 3356.586120][ C0] x86_64_start_reservations+0x18/0x30 [ 3356.586414][ C0] x86_64_start_kernel+0xba/0x110 [ 3356.586681][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3356.587008][ C0] [ 3356.587173][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2020s! [ksoftirqd/1:22] [ 3356.587650][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3356.588863][ C1] irq event stamp: 3886976 [ 3356.589109][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3356.589609][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3356.590117][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3356.590625][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3356.591121][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3356.591625][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3356.592277][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3356.592623][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3356.593658][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3356.593987][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3356.594417][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3356.594846][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3356.595270][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3356.595695][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3356.596124][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3356.596604][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3356.596953][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3356.597384][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3356.597808][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3356.598230][ C1] Call Trace: [ 3356.598409][ C1] [ 3356.598567][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3356.598848][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3356.599107][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3356.599402][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3356.599696][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3356.600005][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3356.600289][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3356.600616][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3356.600890][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3356.601221][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3356.601537][ C1] [ 3356.601694][ C1] [ 3356.601851][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3356.602182][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3356.602491][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3356.602804][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3356.603112][ C1] ? run_ksoftirqd+0xb/0x60 [ 3356.603354][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3356.603681][ C1] ? __orc_find+0x9c/0xf0 [ 3356.603915][ C1] ? lock_acquire+0x1c1/0x220 [ 3356.604173][ C1] ? irqentry_enter+0x2b/0x60 [ 3356.604430][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3356.604693][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3356.604981][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3356.605283][ C1] ? lock_acquire+0x1c1/0x220 [ 3356.605534][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3356.605792][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3356.606067][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3356.606316][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3356.606578][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3356.606855][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3356.607151][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3356.607447][ C1] ip_local_deliver+0x19d/0x480 [ 3356.607708][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3356.607996][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3356.608263][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3356.608546][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3356.608813][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3356.609152][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3356.609429][ C1] ip_rcv+0x564/0x740 [ 3356.609653][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3356.609899][ C1] ? set_track_prepare+0x8a/0xd0 [ 3356.610168][ C1] ? irqentry_enter+0x2b/0x60 [ 3356.610423][ C1] ? irqentry_enter+0x2b/0x60 [ 3356.610679][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3356.610924][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3356.611248][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3356.611591][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3356.611906][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3356.612251][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3356.612550][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3356.612889][ C1] netif_receive_skb+0x55/0x280 [ 3356.613153][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3356.613486][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3356.613838][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3356.614155][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3356.614454][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3356.614761][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3356.615100][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3356.615385][ C1] ? arch_stack_walk+0x68/0x100 [ 3356.615648][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3356.615928][ C1] ? irqentry_enter+0x2b/0x60 [ 3356.616183][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3356.616503][ C1] ? irqentry_enter+0x2b/0x60 [ 3356.616757][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3356.617087][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3356.617371][ C1] ? arch_stack_walk+0x68/0x100 [ 3356.617636][ C1] __tcf_classify+0x32c/0x7d0 [ 3356.617893][ C1] tcf_classify+0x283/0x930 [ 3356.618144][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3356.618416][ C1] tc_run+0x2e4/0x5d0 [ 3356.618637][ C1] ? __pfx_tc_run+0x10/0x10 [ 3356.618887][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3356.619160][ C1] ? irqentry_enter+0x2b/0x60 [ 3356.619412][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3356.619702][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3356.620035][ C1] ip_finish_output2+0x786/0x18e0 [ 3356.620306][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3356.620600][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3356.620869][ C1] ? __ip_finish_output+0x10f/0x770 [ 3356.621150][ C1] ip_output+0x16b/0x4f0 [ 3356.621377][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3356.621700][ C1] ? __pfx_ip_output+0x10/0x10 [ 3356.621956][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3356.622318][ C1] ? __pfx_ip_output+0x10/0x10 [ 3356.622579][ C1] __ip_queue_xmit+0x672/0x1910 [ 3356.622843][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3356.623125][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3356.623423][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3356.623709][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3356.624004][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3356.624290][ C1] tcp_delack_timer+0x84/0x240 [ 3356.624546][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3356.624837][ C1] call_timer_fn+0x176/0x430 [ 3356.625090][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3356.625366][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3356.625651][ C1] __run_timers.part.0+0x52d/0x890 [ 3356.625927][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3356.626216][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3356.626519][ C1] ? __pfx___schedule+0x10/0x10 [ 3356.626784][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3356.627112][ C1] run_timer_softirq+0x72/0x100 [ 3356.627374][ C1] __do_softirq+0x1bc/0x7ff [ 3356.627620][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3356.627894][ C1] run_ksoftirqd+0x2e/0x60 [ 3356.628138][ C1] smpboot_thread_fn+0x30e/0x840 [ 3356.628404][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3356.628698][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3356.628988][ C1] kthread+0x292/0x360 [ 3356.629215][ C1] ? __pfx_kthread+0x10/0x10 [ 3356.629465][ C1] ret_from_fork+0x34/0x70 [ 3356.629709][ C1] ? __pfx_kthread+0x10/0x10 [ 3356.629958][ C1] ret_from_fork_asm+0x1b/0x30 [ 3356.630219][ C1] [ 3384.527469][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2046s! [swapper/0:0] [ 3384.527937][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3384.529131][ C0] irq event stamp: 27567077 [ 3384.529375][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3384.529916][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3384.530386][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3384.530887][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3384.531385][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3384.531870][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3384.532516][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 3384.532853][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 3384.533869][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3384.534192][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3384.534610][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3384.535028][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3384.535446][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3384.535865][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3384.536283][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3384.536749][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3384.537103][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3384.537524][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3384.537944][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3384.538366][ C0] Call Trace: [ 3384.538548][ C0] [ 3384.538712][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3384.538993][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3384.539246][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3384.539544][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3384.539834][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3384.540142][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3384.540425][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3384.540745][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3384.541018][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3384.541298][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3384.541620][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3384.541930][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3384.542267][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3384.542570][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 3384.542871][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3384.543173][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3384.543505][ C0] ? get_stack_info+0x36/0xc0 [ 3384.543761][ C0] ? lock_acquire+0x1c1/0x220 [ 3384.544024][ C0] ? lock_release+0x1d5/0x250 [ 3384.544278][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3384.544540][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3384.544827][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3384.545131][ C0] ? lock_acquire+0x1c1/0x220 [ 3384.545380][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3384.545633][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3384.545905][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3384.546155][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3384.546416][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3384.546690][ C0] ? __inet_lookup_established+0x341/0x610 [ 3384.547005][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3384.547295][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3384.547583][ C0] ip_local_deliver+0x19d/0x480 [ 3384.547845][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3384.548134][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3384.548403][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3384.548681][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3384.548944][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3384.549284][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3384.549567][ C0] ip_rcv+0x564/0x740 [ 3384.549789][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3384.550035][ C0] ? set_track_prepare+0x8a/0xd0 [ 3384.550305][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3384.550594][ C0] ? rest_init+0x153/0x260 [ 3384.550834][ C0] ? skb_clone+0x10b/0x330 [ 3384.551074][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3384.551414][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3384.551741][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3384.552040][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3384.552347][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3384.552605][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3384.552847][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3384.553162][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3384.553458][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3384.553803][ C0] ? lock_acquire+0x1c1/0x220 [ 3384.554058][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3384.554368][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3384.554665][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3384.554998][ C0] ? __copy_skb_header+0xaf/0x490 [ 3384.555270][ C0] ? __skb_clone+0x57a/0x760 [ 3384.555518][ C0] netif_receive_skb+0x55/0x280 [ 3384.555776][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3384.556108][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3384.556453][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3384.556770][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3384.557057][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3384.557356][ C0] ? hlock_class+0x4e/0x130 [ 3384.557603][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3384.557929][ C0] ? place_entity+0x21/0x2f0 [ 3384.558173][ C0] ? resched_curr+0x219/0x280 [ 3384.558425][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3384.558698][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3384.558983][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3384.559258][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3384.559521][ C0] ? activate_task+0xf5/0x260 [ 3384.559776][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3384.560055][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3384.560327][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3384.560589][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3384.560880][ C0] ? get_stack_info+0x36/0xc0 [ 3384.561130][ C0] ? stack_access_ok+0xda/0x1f0 [ 3384.561385][ C0] ? get_reg+0x119/0x190 [ 3384.561611][ C0] __tcf_classify+0x32c/0x7d0 [ 3384.561864][ C0] tcf_classify+0x283/0x930 [ 3384.562111][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3384.562441][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3384.562707][ C0] ? arch_stack_walk+0x8c/0x100 [ 3384.562965][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3384.563254][ C0] tc_run+0x2e4/0x5d0 [ 3384.563477][ C0] ? __pfx_tc_run+0x10/0x10 [ 3384.563722][ C0] ? lock_acquire+0x1c1/0x220 [ 3384.563979][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3384.564258][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3384.564523][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3384.564816][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3384.565099][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3384.565424][ C0] ? neigh_hh_output+0x348/0x590 [ 3384.565687][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3384.565969][ C0] ip_finish_output2+0x786/0x18e0 [ 3384.566241][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3384.566538][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3384.566890][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3384.567177][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3384.567445][ C0] ? __ip_finish_output+0x10f/0x770 [ 3384.567721][ C0] ip_output+0x16b/0x4f0 [ 3384.567947][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3384.568232][ C0] ? __pfx_ip_output+0x10/0x10 [ 3384.568487][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3384.568794][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3384.569058][ C0] ? ip_local_out+0x114/0x3b0 [ 3384.569314][ C0] __ip_queue_xmit+0x672/0x1910 [ 3384.569584][ C0] ? __skb_clone+0x57a/0x760 [ 3384.569832][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3384.570116][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3384.570416][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3384.570736][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3384.570992][ C0] ? tcp_current_mss+0x40a/0x510 [ 3384.571261][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3384.571545][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3384.571824][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3384.572082][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3384.572349][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3384.572667][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3384.572947][ C0] ? ktime_get+0xb6/0x190 [ 3384.573182][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3384.573459][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3384.573740][ C0] tcp_write_timer+0x82/0x1d0 [ 3384.574001][ C0] call_timer_fn+0x176/0x430 [ 3384.574252][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3384.574524][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3384.574801][ C0] __run_timers.part.0+0x52d/0x890 [ 3384.575073][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3384.575362][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3384.575661][ C0] ? lock_acquire+0x1c1/0x220 [ 3384.575918][ C0] ? clockevents_program_event+0xf6/0x300 [ 3384.576226][ C0] ? lock_release+0x1d5/0x250 [ 3384.576478][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3384.576758][ C0] ? ktime_get+0xb6/0x190 [ 3384.576991][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3384.577292][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3384.577603][ C0] run_timer_softirq+0x72/0x100 [ 3384.577869][ C0] __do_softirq+0x1bc/0x7ff [ 3384.578117][ C0] irq_exit_rcu+0x98/0xc0 [ 3384.578356][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3384.578659][ C0] [ 3384.578816][ C0] [ 3384.578973][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3384.579291][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3384.579569][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3384.580583][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3384.580903][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3384.581322][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3384.581741][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3384.582157][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3384.582575][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3384.582995][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3384.583297][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3384.583572][ C0] default_idle_call+0x69/0xa0 [ 3384.583829][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3384.584091][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3384.584385][ C0] ? lock_release+0x1d5/0x250 [ 3384.584634][ C0] do_idle+0xfb/0x160 [ 3384.584846][ C0] cpu_startup_entry+0x55/0x60 [ 3384.585105][ C0] rest_init+0x153/0x260 [ 3384.585333][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3384.585619][ C0] arch_call_rest_init+0x13/0x40 [ 3384.585885][ C0] start_kernel+0x314/0x3d0 [ 3384.586131][ C0] x86_64_start_reservations+0x18/0x30 [ 3384.586427][ C0] x86_64_start_kernel+0xba/0x110 [ 3384.586695][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3384.587022][ C0] [ 3384.587187][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2046s! [ksoftirqd/1:22] [ 3384.587665][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3384.588856][ C1] irq event stamp: 3886976 [ 3384.589092][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3384.589596][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3384.590092][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3384.590587][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3384.591081][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3384.591573][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3384.592218][ C1] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 3384.592521][ C1] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 3384.593549][ C1] RSP: 0018:ffffc9000019e9d8 EFLAGS: 00000202 [ 3384.593879][ C1] RAX: ffff88800a098e18 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3384.594303][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3384.594727][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3384.595154][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3384.595582][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3384.596006][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3384.596481][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3384.596830][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3384.597254][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3384.597674][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3384.598093][ C1] Call Trace: [ 3384.598272][ C1] [ 3384.598427][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3384.598707][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3384.598960][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3384.599254][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3384.599542][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3384.599850][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3384.600134][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3384.600458][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3384.600733][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3384.601061][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3384.601374][ C1] [ 3384.601530][ C1] [ 3384.601686][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3384.602020][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3384.602330][ C1] ? kasan_check_range+0x12/0x1c0 [ 3384.602602][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 3384.602899][ C1] ? run_ksoftirqd+0xb/0x60 [ 3384.603150][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3384.603479][ C1] ? __orc_find+0x9c/0xf0 [ 3384.603708][ C1] ? lock_acquire+0x1c1/0x220 [ 3384.603957][ C1] ? irqentry_enter+0x2b/0x60 [ 3384.604208][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3384.604467][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3384.604753][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3384.605051][ C1] ? lock_acquire+0x1c1/0x220 [ 3384.605304][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3384.605560][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3384.605835][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3384.606082][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3384.606341][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3384.606611][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3384.606897][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3384.607186][ C1] ip_local_deliver+0x19d/0x480 [ 3384.607447][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3384.607739][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3384.608008][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3384.608291][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3384.608553][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3384.608892][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3384.609167][ C1] ip_rcv+0x564/0x740 [ 3384.609382][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3384.609630][ C1] ? set_track_prepare+0x8a/0xd0 [ 3384.609900][ C1] ? irqentry_enter+0x2b/0x60 [ 3384.610152][ C1] ? irqentry_enter+0x2b/0x60 [ 3384.610404][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3384.610646][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3384.610958][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3384.611299][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3384.611607][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3384.611948][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3384.612249][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3384.612579][ C1] netif_receive_skb+0x55/0x280 [ 3384.612837][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3384.613162][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3384.613510][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3384.613824][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3384.614113][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3384.614414][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3384.614740][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3384.615020][ C1] ? arch_stack_walk+0x68/0x100 [ 3384.615284][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3384.615563][ C1] ? irqentry_enter+0x2b/0x60 [ 3384.615816][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3384.616142][ C1] ? irqentry_enter+0x2b/0x60 [ 3384.616393][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3384.616713][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3384.616996][ C1] ? arch_stack_walk+0x68/0x100 [ 3384.617255][ C1] __tcf_classify+0x32c/0x7d0 [ 3384.617505][ C1] tcf_classify+0x283/0x930 [ 3384.617746][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3384.618015][ C1] tc_run+0x2e4/0x5d0 [ 3384.618232][ C1] ? __pfx_tc_run+0x10/0x10 [ 3384.618477][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3384.618744][ C1] ? irqentry_enter+0x2b/0x60 [ 3384.618997][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3384.619286][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3384.619613][ C1] ip_finish_output2+0x786/0x18e0 [ 3384.619888][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3384.620182][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3384.620445][ C1] ? __ip_finish_output+0x10f/0x770 [ 3384.620726][ C1] ip_output+0x16b/0x4f0 [ 3384.620955][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3384.621274][ C1] ? __pfx_ip_output+0x10/0x10 [ 3384.621534][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3384.621888][ C1] ? __pfx_ip_output+0x10/0x10 [ 3384.622143][ C1] __ip_queue_xmit+0x672/0x1910 [ 3384.622407][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3384.622691][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3384.622988][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3384.623279][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3384.623580][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3384.623870][ C1] tcp_delack_timer+0x84/0x240 [ 3384.624130][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3384.624416][ C1] call_timer_fn+0x176/0x430 [ 3384.624666][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3384.624945][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3384.625223][ C1] __run_timers.part.0+0x52d/0x890 [ 3384.625498][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3384.625789][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3384.626093][ C1] ? __pfx___schedule+0x10/0x10 [ 3384.626350][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3384.626667][ C1] run_timer_softirq+0x72/0x100 [ 3384.626929][ C1] __do_softirq+0x1bc/0x7ff [ 3384.627174][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3384.627451][ C1] run_ksoftirqd+0x2e/0x60 [ 3384.627688][ C1] smpboot_thread_fn+0x30e/0x840 [ 3384.627955][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3384.628247][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3384.628543][ C1] kthread+0x292/0x360 [ 3384.628758][ C1] ? __pfx_kthread+0x10/0x10 [ 3384.629006][ C1] ret_from_fork+0x34/0x70 [ 3384.629245][ C1] ? __pfx_kthread+0x10/0x10 [ 3384.629494][ C1] ret_from_fork_asm+0x1b/0x30 [ 3384.629764][ C1] [ 3406.635025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3406.635418][ C1] rcu: 1-....: (2207074 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=527632 [ 3406.636010][ C1] rcu: (t=2212326 jiffies g=1007429 q=31 ncpus=4) [ 3406.636361][ C1] Sending NMI from CPU 1 to CPUs 0: [ 3406.636647][ C0] NMI backtrace for cpu 0 [ 3406.636655][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3406.636659][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3406.636662][ C0] RIP: 0010:kasan_check_range+0x66/0x1c0 [ 3406.636672][ C0] Code: 5b 5d 41 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df <4d> 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d [ 3406.636675][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000216 [ 3406.636679][ C0] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3406.636681][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3406.636683][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3406.636685][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3406.636687][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3406.636689][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3406.636691][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3406.636695][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3406.636697][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3406.636698][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3406.636700][ C0] Call Trace: [ 3406.636703][ C0] [ 3406.636706][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 3406.636713][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3406.636718][ C0] ? nmi_handle+0x156/0x420 [ 3406.636724][ C0] ? default_do_nmi+0x41/0x100 [ 3406.636728][ C0] ? exc_nmi+0xf3/0x120 [ 3406.636730][ C0] ? end_repeat_nmi+0xf/0x60 [ 3406.636735][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3406.636742][ C0] ? kasan_check_range+0x66/0x1c0 [ 3406.636745][ C0] ? kasan_check_range+0x66/0x1c0 [ 3406.636749][ C0] ? kasan_check_range+0x66/0x1c0 [ 3406.636753][ C0] [ 3406.636754][ C0] [ 3406.636755][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 3406.636759][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3406.636762][ C0] ? get_stack_info+0x36/0xc0 [ 3406.636768][ C0] ? lock_acquire+0x1c1/0x220 [ 3406.636774][ C0] ? lock_release+0x1d5/0x250 [ 3406.636777][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3406.636781][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3406.636784][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3406.636787][ C0] ? lock_acquire+0x1c1/0x220 [ 3406.636790][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3406.636795][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3406.636799][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3406.636806][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3406.636809][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3406.636814][ C0] ? __inet_lookup_established+0x341/0x610 [ 3406.636820][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3406.636827][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3406.636831][ C0] ip_local_deliver+0x19d/0x480 [ 3406.636835][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3406.636837][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3406.636844][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3406.636848][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3406.636850][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3406.636854][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3406.636864][ C0] ip_rcv+0x564/0x740 [ 3406.636868][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3406.636871][ C0] ? set_track_prepare+0x8a/0xd0 [ 3406.636876][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3406.636878][ C0] ? rest_init+0x153/0x260 [ 3406.636880][ C0] ? skb_clone+0x10b/0x330 [ 3406.636885][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3406.636892][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3406.636897][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3406.636903][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3406.636912][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3406.636915][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3406.636918][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3406.636922][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3406.636925][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3406.636929][ C0] ? lock_acquire+0x1c1/0x220 [ 3406.636931][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3406.636934][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3406.636937][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3406.636940][ C0] ? __copy_skb_header+0xaf/0x490 [ 3406.636943][ C0] ? __skb_clone+0x57a/0x760 [ 3406.636946][ C0] netif_receive_skb+0x55/0x280 [ 3406.636948][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3406.636957][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3406.636964][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3406.636970][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3406.636976][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3406.636984][ C0] ? hlock_class+0x4e/0x130 [ 3406.636991][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3406.637001][ C0] ? place_entity+0x21/0x2f0 [ 3406.637004][ C0] ? resched_curr+0x219/0x280 [ 3406.637008][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3406.637011][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3406.637015][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3406.637019][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3406.637023][ C0] ? activate_task+0xf5/0x260 [ 3406.637026][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3406.637031][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3406.637035][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3406.637039][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3406.637042][ C0] ? get_stack_info+0x36/0xc0 [ 3406.637045][ C0] ? stack_access_ok+0xda/0x1f0 [ 3406.637048][ C0] ? get_reg+0x119/0x190 [ 3406.637052][ C0] __tcf_classify+0x32c/0x7d0 [ 3406.637056][ C0] tcf_classify+0x283/0x930 [ 3406.637060][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3406.637064][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3406.637066][ C0] ? arch_stack_walk+0x8c/0x100 [ 3406.637071][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3406.637074][ C0] tc_run+0x2e4/0x5d0 [ 3406.637078][ C0] ? __pfx_tc_run+0x10/0x10 [ 3406.637081][ C0] ? lock_acquire+0x1c1/0x220 [ 3406.637083][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3406.637088][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3406.637094][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3406.637097][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3406.637101][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3406.637106][ C0] ? neigh_hh_output+0x348/0x590 [ 3406.637110][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3406.637114][ C0] ip_finish_output2+0x786/0x18e0 [ 3406.637117][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3406.637124][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3406.637132][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3406.637135][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3406.637139][ C0] ? __ip_finish_output+0x10f/0x770 [ 3406.637143][ C0] ip_output+0x16b/0x4f0 [ 3406.637146][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3406.637151][ C0] ? __pfx_ip_output+0x10/0x10 [ 3406.637154][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3406.637158][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3406.637161][ C0] ? ip_local_out+0x114/0x3b0 [ 3406.637165][ C0] __ip_queue_xmit+0x672/0x1910 [ 3406.637170][ C0] ? __skb_clone+0x57a/0x760 [ 3406.637173][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3406.637180][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3406.637184][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3406.637188][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3406.637193][ C0] ? tcp_current_mss+0x40a/0x510 [ 3406.637196][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3406.637199][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3406.637202][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3406.637204][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3406.637207][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3406.637211][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3406.637215][ C0] ? ktime_get+0xb6/0x190 [ 3406.637220][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3406.637224][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3406.637227][ C0] tcp_write_timer+0x82/0x1d0 [ 3406.637231][ C0] call_timer_fn+0x176/0x430 [ 3406.637235][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3406.637240][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3406.637244][ C0] __run_timers.part.0+0x52d/0x890 [ 3406.637247][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3406.637252][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3406.637255][ C0] ? lock_acquire+0x1c1/0x220 [ 3406.637257][ C0] ? clockevents_program_event+0xf6/0x300 [ 3406.637263][ C0] ? lock_release+0x1d5/0x250 [ 3406.637265][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3406.637268][ C0] ? ktime_get+0xb6/0x190 [ 3406.637271][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3406.637275][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3406.637279][ C0] run_timer_softirq+0x72/0x100 [ 3406.637283][ C0] __do_softirq+0x1bc/0x7ff [ 3406.637287][ C0] irq_exit_rcu+0x98/0xc0 [ 3406.637290][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3406.637294][ C0] [ 3406.637295][ C0] [ 3406.637296][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3406.637300][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3406.637303][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3406.637305][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3406.637307][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3406.637309][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3406.637311][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3406.637312][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3406.637314][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3406.637317][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3406.637321][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3406.637325][ C0] default_idle_call+0x69/0xa0 [ 3406.637327][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3406.637329][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3406.637334][ C0] ? lock_release+0x1d5/0x250 [ 3406.637338][ C0] do_idle+0xfb/0x160 [ 3406.637341][ C0] cpu_startup_entry+0x55/0x60 [ 3406.637344][ C0] rest_init+0x153/0x260 [ 3406.637346][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3406.637352][ C0] arch_call_rest_init+0x13/0x40 [ 3406.637358][ C0] start_kernel+0x314/0x3d0 [ 3406.637361][ C0] x86_64_start_reservations+0x18/0x30 [ 3406.637366][ C0] x86_64_start_kernel+0xba/0x110 [ 3406.637369][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3406.637377][ C0] [ 3406.637644][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3406.692166][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3406.692809][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3406.693156][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3406.694179][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3406.694504][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3406.694926][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3406.695346][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3406.695765][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3406.696183][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3406.696607][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3406.697079][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3406.697434][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3406.697858][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3406.698287][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3406.698713][ C1] Call Trace: [ 3406.698893][ C1] [ 3406.699057][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3406.699344][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3406.699618][ C1] ? check_cpu_stall+0x284/0x500 [ 3406.699885][ C1] ? rcu_pending+0x92/0x360 [ 3406.700128][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3406.700409][ C1] ? update_process_times+0xb9/0x110 [ 3406.700698][ C1] ? tick_sched_handle+0x67/0x130 [ 3406.700968][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3406.701268][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3406.701523][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3406.701850][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3406.702139][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3406.702446][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3406.702728][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3406.703054][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3406.703328][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3406.703654][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3406.703969][ C1] [ 3406.704126][ C1] [ 3406.704283][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3406.704612][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3406.704925][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3406.705239][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3406.705541][ C1] ? run_ksoftirqd+0xb/0x60 [ 3406.705787][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3406.706113][ C1] ? __orc_find+0x9c/0xf0 [ 3406.706352][ C1] ? lock_acquire+0x1c1/0x220 [ 3406.706605][ C1] ? irqentry_enter+0x2b/0x60 [ 3406.706860][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3406.707125][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3406.707414][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3406.707717][ C1] ? lock_acquire+0x1c1/0x220 [ 3406.707968][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3406.708224][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3406.708497][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3406.708747][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3406.709010][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3406.709287][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3406.709586][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3406.709878][ C1] ip_local_deliver+0x19d/0x480 [ 3406.710140][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3406.710428][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3406.710696][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3406.710973][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3406.711238][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3406.711577][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3406.711851][ C1] ip_rcv+0x564/0x740 [ 3406.712066][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3406.712306][ C1] ? set_track_prepare+0x8a/0xd0 [ 3406.712572][ C1] ? irqentry_enter+0x2b/0x60 [ 3406.712828][ C1] ? irqentry_enter+0x2b/0x60 [ 3406.713086][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3406.713331][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3406.713651][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3406.713997][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3406.714312][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3406.714650][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3406.714948][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3406.715286][ C1] netif_receive_skb+0x55/0x280 [ 3406.715549][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3406.715879][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3406.716233][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3406.716545][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3406.716837][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3406.717143][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3406.717476][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3406.717760][ C1] ? arch_stack_walk+0x68/0x100 [ 3406.718020][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3406.718296][ C1] ? irqentry_enter+0x2b/0x60 [ 3406.718547][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3406.718865][ C1] ? irqentry_enter+0x2b/0x60 [ 3406.719121][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3406.719451][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3406.719734][ C1] ? arch_stack_walk+0x68/0x100 [ 3406.719995][ C1] __tcf_classify+0x32c/0x7d0 [ 3406.720246][ C1] tcf_classify+0x283/0x930 [ 3406.720487][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3406.720756][ C1] tc_run+0x2e4/0x5d0 [ 3406.720972][ C1] ? __pfx_tc_run+0x10/0x10 [ 3406.721215][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3406.721481][ C1] ? irqentry_enter+0x2b/0x60 [ 3406.721737][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3406.722028][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3406.722351][ C1] ip_finish_output2+0x786/0x18e0 [ 3406.722620][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3406.722910][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3406.723178][ C1] ? __ip_finish_output+0x10f/0x770 [ 3406.723454][ C1] ip_output+0x16b/0x4f0 [ 3406.723682][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3406.724004][ C1] ? __pfx_ip_output+0x10/0x10 [ 3406.724260][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3406.724617][ C1] ? __pfx_ip_output+0x10/0x10 [ 3406.724875][ C1] __ip_queue_xmit+0x672/0x1910 [ 3406.725136][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3406.725416][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3406.725710][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3406.725994][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3406.726289][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3406.726575][ C1] tcp_delack_timer+0x84/0x240 [ 3406.726832][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3406.727122][ C1] call_timer_fn+0x176/0x430 [ 3406.727373][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3406.727647][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3406.727928][ C1] __run_timers.part.0+0x52d/0x890 [ 3406.728206][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3406.728493][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3406.728791][ C1] ? __pfx___schedule+0x10/0x10 [ 3406.729053][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3406.729381][ C1] run_timer_softirq+0x72/0x100 [ 3406.729647][ C1] __do_softirq+0x1bc/0x7ff [ 3406.729894][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3406.730171][ C1] run_ksoftirqd+0x2e/0x60 [ 3406.730408][ C1] smpboot_thread_fn+0x30e/0x840 [ 3406.730674][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3406.730962][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3406.731258][ C1] kthread+0x292/0x360 [ 3406.731477][ C1] ? __pfx_kthread+0x10/0x10 [ 3406.731726][ C1] ret_from_fork+0x34/0x70 [ 3406.731965][ C1] ? __pfx_kthread+0x10/0x10 [ 3406.732213][ C1] ret_from_fork_asm+0x1b/0x30 [ 3406.732471][ C1] [ 3432.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2090s! [swapper/0:0] [ 3432.527924][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3432.529113][ C0] irq event stamp: 27567077 [ 3432.529357][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3432.529891][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3432.530361][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3432.530863][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3432.531357][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3432.531836][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3432.532482][ C0] RIP: 0010:kasan_check_range+0x158/0x1c0 [ 3432.532791][ C0] Code: 11 80 38 00 74 ef 4d 8d 1c 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 <48> 83 c0 01 48 39 d0 74 a5 80 38 00 74 f2 e9 74 ff ff ff b8 01 00 [ 3432.533818][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000246 [ 3432.534143][ C0] RAX: ffffed100141336b RBX: ffffed100141336c RCX: ffffffff90c7aaa0 [ 3432.534567][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3432.534991][ C0] RBP: ffffed100141336b R08: 0000000000000000 R09: ffffed100141336b [ 3432.535411][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3432.535834][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3432.536258][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3432.536735][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3432.537083][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3432.537509][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3432.537930][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3432.538348][ C0] Call Trace: [ 3432.538525][ C0] [ 3432.538681][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3432.538959][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3432.539215][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3432.539514][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3432.539804][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3432.540108][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3432.540390][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3432.540717][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3432.540988][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3432.541268][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3432.541591][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3432.541900][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3432.542237][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3432.542540][ C0] ? kasan_check_range+0x158/0x1c0 [ 3432.542812][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 3432.543109][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3432.543439][ C0] ? get_stack_info+0x36/0xc0 [ 3432.543692][ C0] ? lock_acquire+0x1c1/0x220 [ 3432.543943][ C0] ? lock_release+0x1d5/0x250 [ 3432.544193][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3432.544451][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3432.544735][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3432.545033][ C0] ? lock_acquire+0x1c1/0x220 [ 3432.545289][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3432.545548][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3432.545823][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3432.546068][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3432.546325][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3432.546594][ C0] ? __inet_lookup_established+0x341/0x610 [ 3432.546904][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3432.547197][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3432.547489][ C0] ip_local_deliver+0x19d/0x480 [ 3432.547747][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3432.548033][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3432.548299][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3432.548580][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3432.548847][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3432.549183][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3432.549468][ C0] ip_rcv+0x564/0x740 [ 3432.549688][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3432.549930][ C0] ? set_track_prepare+0x8a/0xd0 [ 3432.550195][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3432.550489][ C0] ? rest_init+0x153/0x260 [ 3432.550726][ C0] ? skb_clone+0x10b/0x330 [ 3432.550969][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3432.551300][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3432.551617][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3432.551913][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3432.552226][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3432.552488][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3432.552733][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3432.553048][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3432.553349][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3432.553692][ C0] ? lock_acquire+0x1c1/0x220 [ 3432.553940][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3432.554249][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3432.554550][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3432.554880][ C0] ? __copy_skb_header+0xaf/0x490 [ 3432.555147][ C0] ? __skb_clone+0x57a/0x760 [ 3432.555391][ C0] netif_receive_skb+0x55/0x280 [ 3432.555651][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3432.555984][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3432.556335][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3432.556647][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3432.556940][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3432.557241][ C0] ? hlock_class+0x4e/0x130 [ 3432.557490][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3432.557820][ C0] ? place_entity+0x21/0x2f0 [ 3432.558069][ C0] ? resched_curr+0x219/0x280 [ 3432.558317][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3432.558582][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3432.558867][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3432.559152][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3432.559420][ C0] ? activate_task+0xf5/0x260 [ 3432.559670][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3432.559943][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3432.560218][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3432.560478][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3432.560764][ C0] ? get_stack_info+0x36/0xc0 [ 3432.561016][ C0] ? stack_access_ok+0xda/0x1f0 [ 3432.561279][ C0] ? get_reg+0x119/0x190 [ 3432.561509][ C0] __tcf_classify+0x32c/0x7d0 [ 3432.561759][ C0] tcf_classify+0x283/0x930 [ 3432.561999][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3432.562328][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3432.562599][ C0] ? arch_stack_walk+0x8c/0x100 [ 3432.562866][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3432.563159][ C0] tc_run+0x2e4/0x5d0 [ 3432.563376][ C0] ? __pfx_tc_run+0x10/0x10 [ 3432.563618][ C0] ? lock_acquire+0x1c1/0x220 [ 3432.563866][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3432.564139][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3432.564407][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3432.564692][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3432.564966][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3432.565286][ C0] ? neigh_hh_output+0x348/0x590 [ 3432.565552][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3432.565827][ C0] ip_finish_output2+0x786/0x18e0 [ 3432.566095][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3432.566387][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3432.566741][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3432.567030][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3432.567294][ C0] ? __ip_finish_output+0x10f/0x770 [ 3432.567573][ C0] ip_output+0x16b/0x4f0 [ 3432.567808][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3432.568089][ C0] ? __pfx_ip_output+0x10/0x10 [ 3432.568345][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3432.568644][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3432.568912][ C0] ? ip_local_out+0x114/0x3b0 [ 3432.569163][ C0] __ip_queue_xmit+0x672/0x1910 [ 3432.569434][ C0] ? __skb_clone+0x57a/0x760 [ 3432.569683][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3432.569965][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3432.570259][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3432.570581][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3432.570841][ C0] ? tcp_current_mss+0x40a/0x510 [ 3432.571103][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3432.571386][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3432.571662][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3432.571915][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3432.572184][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3432.572505][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3432.572781][ C0] ? ktime_get+0xb6/0x190 [ 3432.573010][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3432.573282][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3432.573565][ C0] tcp_write_timer+0x82/0x1d0 [ 3432.573817][ C0] call_timer_fn+0x176/0x430 [ 3432.574065][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3432.574340][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3432.574610][ C0] __run_timers.part.0+0x52d/0x890 [ 3432.574883][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3432.575165][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3432.575466][ C0] ? lock_acquire+0x1c1/0x220 [ 3432.575715][ C0] ? clockevents_program_event+0xf6/0x300 [ 3432.576016][ C0] ? lock_release+0x1d5/0x250 [ 3432.576266][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3432.576540][ C0] ? ktime_get+0xb6/0x190 [ 3432.576770][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3432.577066][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3432.577380][ C0] run_timer_softirq+0x72/0x100 [ 3432.577638][ C0] __do_softirq+0x1bc/0x7ff [ 3432.577881][ C0] irq_exit_rcu+0x98/0xc0 [ 3432.578111][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3432.578410][ C0] [ 3432.578569][ C0] [ 3432.578732][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3432.579051][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3432.579324][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3432.580348][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3432.580673][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3432.581099][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3432.581520][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3432.581941][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3432.582365][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3432.582793][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3432.583097][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3432.583375][ C0] default_idle_call+0x69/0xa0 [ 3432.583629][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3432.583892][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3432.584181][ C0] ? lock_release+0x1d5/0x250 [ 3432.584435][ C0] do_idle+0xfb/0x160 [ 3432.584654][ C0] cpu_startup_entry+0x55/0x60 [ 3432.584910][ C0] rest_init+0x153/0x260 [ 3432.585136][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3432.585429][ C0] arch_call_rest_init+0x13/0x40 [ 3432.585702][ C0] start_kernel+0x314/0x3d0 [ 3432.585946][ C0] x86_64_start_reservations+0x18/0x30 [ 3432.586238][ C0] x86_64_start_kernel+0xba/0x110 [ 3432.586509][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3432.586841][ C0] [ 3432.587007][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2090s! [ksoftirqd/1:22] [ 3432.587483][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3432.588689][ C1] irq event stamp: 3886976 [ 3432.588929][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3432.589440][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3432.589940][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3432.590447][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3432.590938][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3432.591438][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3432.592091][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 3432.592431][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 3432.593453][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3432.593772][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3432.594191][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3432.594611][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3432.595029][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3432.595447][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3432.595864][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3432.596336][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3432.596687][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3432.597111][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3432.597536][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3432.597962][ C1] Call Trace: [ 3432.598144][ C1] [ 3432.598303][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3432.598580][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3432.598839][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3432.599133][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3432.599426][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3432.599729][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3432.600006][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3432.600327][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3432.600606][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3432.600931][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3432.601241][ C1] [ 3432.601402][ C1] [ 3432.601563][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3432.601898][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3432.602204][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 3432.602507][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3432.602809][ C1] ? run_ksoftirqd+0xb/0x60 [ 3432.603051][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3432.603376][ C1] ? __orc_find+0x9c/0xf0 [ 3432.603611][ C1] ? lock_acquire+0x1c1/0x220 [ 3432.603866][ C1] ? irqentry_enter+0x2b/0x60 [ 3432.604122][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3432.604386][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3432.604674][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3432.604980][ C1] ? lock_acquire+0x1c1/0x220 [ 3432.605232][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3432.605487][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3432.605760][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3432.606010][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3432.606273][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3432.606550][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3432.606844][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3432.607141][ C1] ip_local_deliver+0x19d/0x480 [ 3432.607400][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3432.607685][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3432.607948][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3432.608232][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3432.608499][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3432.608836][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3432.609115][ C1] ip_rcv+0x564/0x740 [ 3432.609337][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3432.609578][ C1] ? set_track_prepare+0x8a/0xd0 [ 3432.609848][ C1] ? irqentry_enter+0x2b/0x60 [ 3432.610105][ C1] ? irqentry_enter+0x2b/0x60 [ 3432.610361][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3432.610607][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3432.610930][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3432.611276][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3432.611589][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3432.611928][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3432.612232][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3432.612570][ C1] netif_receive_skb+0x55/0x280 [ 3432.612833][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3432.613168][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3432.613524][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3432.613838][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3432.614132][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3432.614439][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3432.614775][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3432.615064][ C1] ? arch_stack_walk+0x68/0x100 [ 3432.615327][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3432.615607][ C1] ? irqentry_enter+0x2b/0x60 [ 3432.615860][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3432.616180][ C1] ? irqentry_enter+0x2b/0x60 [ 3432.616434][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3432.616762][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3432.617050][ C1] ? arch_stack_walk+0x68/0x100 [ 3432.617314][ C1] __tcf_classify+0x32c/0x7d0 [ 3432.617571][ C1] tcf_classify+0x283/0x930 [ 3432.617820][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3432.618092][ C1] tc_run+0x2e4/0x5d0 [ 3432.618312][ C1] ? __pfx_tc_run+0x10/0x10 [ 3432.618563][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3432.618834][ C1] ? irqentry_enter+0x2b/0x60 [ 3432.619086][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3432.619377][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3432.619703][ C1] ip_finish_output2+0x786/0x18e0 [ 3432.619974][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3432.620267][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3432.620534][ C1] ? __ip_finish_output+0x10f/0x770 [ 3432.620812][ C1] ip_output+0x16b/0x4f0 [ 3432.621040][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3432.621363][ C1] ? __pfx_ip_output+0x10/0x10 [ 3432.621618][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3432.621977][ C1] ? __pfx_ip_output+0x10/0x10 [ 3432.622239][ C1] __ip_queue_xmit+0x672/0x1910 [ 3432.622501][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3432.622781][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3432.623078][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3432.623363][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3432.623657][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3432.623940][ C1] tcp_delack_timer+0x84/0x240 [ 3432.624196][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3432.624487][ C1] call_timer_fn+0x176/0x430 [ 3432.624739][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3432.625013][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3432.625297][ C1] __run_timers.part.0+0x52d/0x890 [ 3432.625575][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3432.625861][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3432.626164][ C1] ? __pfx___schedule+0x10/0x10 [ 3432.626426][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3432.626751][ C1] run_timer_softirq+0x72/0x100 [ 3432.627012][ C1] __do_softirq+0x1bc/0x7ff [ 3432.627258][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3432.627531][ C1] run_ksoftirqd+0x2e/0x60 [ 3432.627774][ C1] smpboot_thread_fn+0x30e/0x840 [ 3432.628040][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3432.628332][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3432.628622][ C1] kthread+0x292/0x360 [ 3432.628845][ C1] ? __pfx_kthread+0x10/0x10 [ 3432.629096][ C1] ret_from_fork+0x34/0x70 [ 3432.629343][ C1] ? __pfx_kthread+0x10/0x10 [ 3432.629593][ C1] ret_from_fork_asm+0x1b/0x30 [ 3432.629852][ C1] [ 3460.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2116s! [swapper/0:0] [ 3460.527930][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3460.529131][ C0] irq event stamp: 27567077 [ 3460.529382][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3460.529902][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3460.530380][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3460.530881][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3460.531376][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3460.531856][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3460.532495][ C0] RIP: 0010:__kasan_check_read+0x0/0x20 [ 3460.532789][ C0] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 3460.533805][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000202 [ 3460.534125][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3460.534543][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3460.534959][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3460.535375][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3460.535794][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3460.536214][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3460.536682][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3460.537034][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3460.537456][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3460.537881][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3460.538301][ C0] Call Trace: [ 3460.538479][ C0] [ 3460.538639][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3460.538914][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3460.539178][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3460.539471][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3460.539760][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3460.540059][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3460.540333][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3460.540653][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3460.540927][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3460.541199][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3460.541528][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3460.541838][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3460.542167][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3460.542471][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 3460.542768][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 3460.543067][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3460.543395][ C0] ? get_stack_info+0x36/0xc0 [ 3460.543650][ C0] ? lock_acquire+0x1c1/0x220 [ 3460.543901][ C0] ? lock_release+0x1d5/0x250 [ 3460.544151][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3460.544410][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3460.544692][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3460.544988][ C0] ? lock_acquire+0x1c1/0x220 [ 3460.545241][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3460.545496][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3460.545772][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3460.546015][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3460.546274][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3460.546541][ C0] ? __inet_lookup_established+0x341/0x610 [ 3460.546850][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3460.547141][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3460.547432][ C0] ip_local_deliver+0x19d/0x480 [ 3460.547686][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3460.547967][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3460.548233][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3460.548512][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3460.548778][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3460.549113][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3460.549393][ C0] ip_rcv+0x564/0x740 [ 3460.549605][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3460.549844][ C0] ? set_track_prepare+0x8a/0xd0 [ 3460.550108][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3460.550398][ C0] ? rest_init+0x153/0x260 [ 3460.550635][ C0] ? skb_clone+0x10b/0x330 [ 3460.550875][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3460.551208][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3460.551528][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3460.551829][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3460.552139][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3460.552403][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3460.552645][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3460.552960][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3460.553258][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3460.553594][ C0] ? lock_acquire+0x1c1/0x220 [ 3460.553842][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3460.554148][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3460.554446][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3460.554772][ C0] ? __copy_skb_header+0xaf/0x490 [ 3460.555036][ C0] ? __skb_clone+0x57a/0x760 [ 3460.555282][ C0] netif_receive_skb+0x55/0x280 [ 3460.555543][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3460.555876][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3460.556222][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3460.556535][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3460.556824][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3460.557130][ C0] ? hlock_class+0x4e/0x130 [ 3460.557377][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3460.557706][ C0] ? place_entity+0x21/0x2f0 [ 3460.557955][ C0] ? resched_curr+0x219/0x280 [ 3460.558202][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3460.558466][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3460.558744][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3460.559024][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3460.559286][ C0] ? activate_task+0xf5/0x260 [ 3460.559531][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3460.559803][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3460.560078][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3460.560335][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3460.560623][ C0] ? get_stack_info+0x36/0xc0 [ 3460.560875][ C0] ? stack_access_ok+0xda/0x1f0 [ 3460.561134][ C0] ? get_reg+0x119/0x190 [ 3460.561363][ C0] __tcf_classify+0x32c/0x7d0 [ 3460.561614][ C0] tcf_classify+0x283/0x930 [ 3460.561854][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3460.562178][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3460.562449][ C0] ? arch_stack_walk+0x8c/0x100 [ 3460.562711][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3460.563000][ C0] tc_run+0x2e4/0x5d0 [ 3460.563214][ C0] ? __pfx_tc_run+0x10/0x10 [ 3460.563455][ C0] ? lock_acquire+0x1c1/0x220 [ 3460.563700][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3460.563970][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3460.564236][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3460.564518][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3460.564791][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3460.565110][ C0] ? neigh_hh_output+0x348/0x590 [ 3460.565375][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3460.565654][ C0] ip_finish_output2+0x786/0x18e0 [ 3460.565919][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3460.566208][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3460.566570][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3460.566860][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3460.567122][ C0] ? __ip_finish_output+0x10f/0x770 [ 3460.567402][ C0] ip_output+0x16b/0x4f0 [ 3460.567631][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3460.567912][ C0] ? __pfx_ip_output+0x10/0x10 [ 3460.568169][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3460.568466][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3460.568731][ C0] ? ip_local_out+0x114/0x3b0 [ 3460.568981][ C0] __ip_queue_xmit+0x672/0x1910 [ 3460.569247][ C0] ? __skb_clone+0x57a/0x760 [ 3460.569496][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3460.569774][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3460.570068][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3460.570382][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3460.570640][ C0] ? tcp_current_mss+0x40a/0x510 [ 3460.570901][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3460.571185][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3460.571457][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3460.571708][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3460.571978][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3460.572298][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3460.572571][ C0] ? ktime_get+0xb6/0x190 [ 3460.572800][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3460.573072][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3460.573357][ C0] tcp_write_timer+0x82/0x1d0 [ 3460.573606][ C0] call_timer_fn+0x176/0x430 [ 3460.573850][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3460.574127][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3460.574398][ C0] __run_timers.part.0+0x52d/0x890 [ 3460.574670][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3460.574953][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3460.575255][ C0] ? lock_acquire+0x1c1/0x220 [ 3460.575505][ C0] ? clockevents_program_event+0xf6/0x300 [ 3460.575807][ C0] ? lock_release+0x1d5/0x250 [ 3460.576053][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3460.576326][ C0] ? ktime_get+0xb6/0x190 [ 3460.576554][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3460.576850][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3460.577166][ C0] run_timer_softirq+0x72/0x100 [ 3460.577423][ C0] __do_softirq+0x1bc/0x7ff [ 3460.577662][ C0] irq_exit_rcu+0x98/0xc0 [ 3460.577890][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3460.578185][ C0] [ 3460.578343][ C0] [ 3460.578503][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3460.578823][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3460.579089][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3460.580116][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3460.580439][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3460.580861][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3460.581285][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3460.581703][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3460.582123][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3460.582549][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3460.582855][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3460.583131][ C0] default_idle_call+0x69/0xa0 [ 3460.583385][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3460.583650][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3460.583938][ C0] ? lock_release+0x1d5/0x250 [ 3460.584190][ C0] do_idle+0xfb/0x160 [ 3460.584405][ C0] cpu_startup_entry+0x55/0x60 [ 3460.584663][ C0] rest_init+0x153/0x260 [ 3460.584887][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3460.585176][ C0] arch_call_rest_init+0x13/0x40 [ 3460.585444][ C0] start_kernel+0x314/0x3d0 [ 3460.585683][ C0] x86_64_start_reservations+0x18/0x30 [ 3460.585973][ C0] x86_64_start_kernel+0xba/0x110 [ 3460.586244][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3460.586575][ C0] [ 3460.586742][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2116s! [ksoftirqd/1:22] [ 3460.587220][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3460.588420][ C1] irq event stamp: 3886976 [ 3460.588660][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3460.589162][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3460.589663][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3460.590168][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3460.590657][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3460.591158][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3460.591808][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3460.592154][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3460.593182][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3460.593508][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3460.593931][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3460.594358][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3460.594778][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3460.595200][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3460.595624][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3460.596101][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3460.596447][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3460.596876][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3460.597297][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3460.597712][ C1] Call Trace: [ 3460.597890][ C1] [ 3460.598047][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3460.598326][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3460.598581][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3460.598880][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3460.599175][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3460.599482][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3460.599764][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3460.600096][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3460.600369][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3460.600698][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3460.601009][ C1] [ 3460.601168][ C1] [ 3460.601323][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3460.601651][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3460.601958][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3460.602271][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3460.602575][ C1] ? run_ksoftirqd+0xb/0x60 [ 3460.602817][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3460.603140][ C1] ? __orc_find+0x9c/0xf0 [ 3460.603375][ C1] ? lock_acquire+0x1c1/0x220 [ 3460.603629][ C1] ? irqentry_enter+0x2b/0x60 [ 3460.603884][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3460.604147][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3460.604434][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3460.604735][ C1] ? lock_acquire+0x1c1/0x220 [ 3460.604986][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3460.605240][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3460.605511][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3460.605762][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3460.606023][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3460.606300][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3460.606594][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3460.606887][ C1] ip_local_deliver+0x19d/0x480 [ 3460.607147][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3460.607429][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3460.607692][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3460.607972][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3460.608239][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3460.608578][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3460.608853][ C1] ip_rcv+0x564/0x740 [ 3460.609072][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3460.609323][ C1] ? set_track_prepare+0x8a/0xd0 [ 3460.609587][ C1] ? irqentry_enter+0x2b/0x60 [ 3460.609841][ C1] ? irqentry_enter+0x2b/0x60 [ 3460.610099][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3460.610347][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3460.610669][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3460.611010][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3460.611324][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3460.611662][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3460.611960][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3460.612300][ C1] netif_receive_skb+0x55/0x280 [ 3460.612561][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3460.612892][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3460.613245][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3460.613558][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3460.613852][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3460.614159][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3460.614493][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3460.614777][ C1] ? arch_stack_walk+0x68/0x100 [ 3460.615039][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3460.615316][ C1] ? irqentry_enter+0x2b/0x60 [ 3460.615567][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3460.615883][ C1] ? irqentry_enter+0x2b/0x60 [ 3460.616140][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3460.616466][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3460.616748][ C1] ? arch_stack_walk+0x68/0x100 [ 3460.617011][ C1] __tcf_classify+0x32c/0x7d0 [ 3460.617268][ C1] tcf_classify+0x283/0x930 [ 3460.617515][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3460.617786][ C1] tc_run+0x2e4/0x5d0 [ 3460.618004][ C1] ? __pfx_tc_run+0x10/0x10 [ 3460.618253][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3460.618523][ C1] ? irqentry_enter+0x2b/0x60 [ 3460.618774][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3460.619063][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3460.619388][ C1] ip_finish_output2+0x786/0x18e0 [ 3460.619658][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3460.619949][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3460.620218][ C1] ? __ip_finish_output+0x10f/0x770 [ 3460.620496][ C1] ip_output+0x16b/0x4f0 [ 3460.620721][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3460.621044][ C1] ? __pfx_ip_output+0x10/0x10 [ 3460.621298][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3460.621656][ C1] ? __pfx_ip_output+0x10/0x10 [ 3460.621915][ C1] __ip_queue_xmit+0x672/0x1910 [ 3460.622179][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3460.622458][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3460.622753][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3460.623039][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3460.623333][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3460.623616][ C1] tcp_delack_timer+0x84/0x240 [ 3460.623871][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3460.624162][ C1] call_timer_fn+0x176/0x430 [ 3460.624413][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3460.624686][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3460.624967][ C1] __run_timers.part.0+0x52d/0x890 [ 3460.625242][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3460.625527][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3460.625828][ C1] ? __pfx___schedule+0x10/0x10 [ 3460.626092][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3460.626420][ C1] run_timer_softirq+0x72/0x100 [ 3460.626680][ C1] __do_softirq+0x1bc/0x7ff [ 3460.626925][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3460.627198][ C1] run_ksoftirqd+0x2e/0x60 [ 3460.627440][ C1] smpboot_thread_fn+0x30e/0x840 [ 3460.627703][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3460.627995][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3460.628285][ C1] kthread+0x292/0x360 [ 3460.628507][ C1] ? __pfx_kthread+0x10/0x10 [ 3460.628755][ C1] ret_from_fork+0x34/0x70 [ 3460.628994][ C1] ? __pfx_kthread+0x10/0x10 [ 3460.629246][ C1] ret_from_fork_asm+0x1b/0x30 [ 3460.629505][ C1] [ 3484.733025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3484.733411][ C1] rcu: 1-....: (2284891 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=544309 [ 3484.734000][ C1] rcu: (t=2290424 jiffies g=1007429 q=31 ncpus=4) [ 3484.734349][ C1] Sending NMI from CPU 1 to CPUs 0: [ 3484.734635][ C0] NMI backtrace for cpu 0 [ 3484.734643][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3484.734647][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3484.734650][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3484.734659][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3484.734663][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3484.734666][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3484.734668][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3484.734670][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3484.734672][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3484.734674][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3484.734675][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3484.734678][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3484.734681][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3484.734683][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3484.734684][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3484.734686][ C0] Call Trace: [ 3484.734688][ C0] [ 3484.734691][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 3484.734698][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3484.734703][ C0] ? nmi_handle+0x156/0x420 [ 3484.734709][ C0] ? default_do_nmi+0x41/0x100 [ 3484.734713][ C0] ? exc_nmi+0xf3/0x120 [ 3484.734715][ C0] ? end_repeat_nmi+0xf/0x60 [ 3484.734720][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3484.734724][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3484.734727][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3484.734731][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3484.734734][ C0] [ 3484.734735][ C0] [ 3484.734737][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3484.734740][ C0] ? get_stack_info+0x36/0xc0 [ 3484.734745][ C0] ? lock_acquire+0x1c1/0x220 [ 3484.734749][ C0] ? lock_release+0x1d5/0x250 [ 3484.734753][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3484.734757][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3484.734760][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3484.734764][ C0] ? lock_acquire+0x1c1/0x220 [ 3484.734766][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3484.734772][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3484.734776][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3484.734783][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3484.734786][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3484.734790][ C0] ? __inet_lookup_established+0x341/0x610 [ 3484.734797][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3484.734805][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3484.734808][ C0] ip_local_deliver+0x19d/0x480 [ 3484.734812][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3484.734814][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3484.734819][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3484.734823][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3484.734826][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3484.734829][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3484.734839][ C0] ip_rcv+0x564/0x740 [ 3484.734842][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3484.734845][ C0] ? set_track_prepare+0x8a/0xd0 [ 3484.734850][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3484.734853][ C0] ? rest_init+0x153/0x260 [ 3484.734855][ C0] ? skb_clone+0x10b/0x330 [ 3484.734860][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3484.734866][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3484.734872][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3484.734877][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3484.734886][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3484.734889][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3484.734892][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3484.734896][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3484.734900][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3484.734903][ C0] ? lock_acquire+0x1c1/0x220 [ 3484.734905][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3484.734909][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3484.734912][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3484.734915][ C0] ? __copy_skb_header+0xaf/0x490 [ 3484.734918][ C0] ? __skb_clone+0x57a/0x760 [ 3484.734921][ C0] netif_receive_skb+0x55/0x280 [ 3484.734923][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3484.734931][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3484.734938][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3484.734945][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3484.734950][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3484.734959][ C0] ? hlock_class+0x4e/0x130 [ 3484.734964][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3484.734975][ C0] ? place_entity+0x21/0x2f0 [ 3484.734978][ C0] ? resched_curr+0x219/0x280 [ 3484.734981][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3484.734984][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3484.734987][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3484.734991][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3484.734993][ C0] ? activate_task+0xf5/0x260 [ 3484.734996][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3484.735001][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3484.735004][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3484.735008][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3484.735011][ C0] ? get_stack_info+0x36/0xc0 [ 3484.735014][ C0] ? stack_access_ok+0xda/0x1f0 [ 3484.735016][ C0] ? get_reg+0x119/0x190 [ 3484.735021][ C0] __tcf_classify+0x32c/0x7d0 [ 3484.735026][ C0] tcf_classify+0x283/0x930 [ 3484.735028][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3484.735033][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3484.735035][ C0] ? arch_stack_walk+0x8c/0x100 [ 3484.735041][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3484.735044][ C0] tc_run+0x2e4/0x5d0 [ 3484.735048][ C0] ? __pfx_tc_run+0x10/0x10 [ 3484.735052][ C0] ? lock_acquire+0x1c1/0x220 [ 3484.735054][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3484.735059][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3484.735065][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3484.735068][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3484.735071][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3484.735076][ C0] ? neigh_hh_output+0x348/0x590 [ 3484.735081][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3484.735085][ C0] ip_finish_output2+0x786/0x18e0 [ 3484.735088][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3484.735095][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3484.735102][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3484.735106][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3484.735110][ C0] ? __ip_finish_output+0x10f/0x770 [ 3484.735114][ C0] ip_output+0x16b/0x4f0 [ 3484.735117][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3484.735122][ C0] ? __pfx_ip_output+0x10/0x10 [ 3484.735125][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3484.735130][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3484.735133][ C0] ? ip_local_out+0x114/0x3b0 [ 3484.735137][ C0] __ip_queue_xmit+0x672/0x1910 [ 3484.735141][ C0] ? __skb_clone+0x57a/0x760 [ 3484.735144][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3484.735152][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3484.735156][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3484.735160][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3484.735165][ C0] ? tcp_current_mss+0x40a/0x510 [ 3484.735168][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3484.735171][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3484.735174][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3484.735176][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3484.735179][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3484.735182][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3484.735187][ C0] ? ktime_get+0xb6/0x190 [ 3484.735191][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3484.735195][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3484.735199][ C0] tcp_write_timer+0x82/0x1d0 [ 3484.735202][ C0] call_timer_fn+0x176/0x430 [ 3484.735206][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3484.735210][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3484.735214][ C0] __run_timers.part.0+0x52d/0x890 [ 3484.735217][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3484.735222][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3484.735225][ C0] ? lock_acquire+0x1c1/0x220 [ 3484.735227][ C0] ? clockevents_program_event+0xf6/0x300 [ 3484.735233][ C0] ? lock_release+0x1d5/0x250 [ 3484.735236][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3484.735238][ C0] ? ktime_get+0xb6/0x190 [ 3484.735242][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3484.735245][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3484.735250][ C0] run_timer_softirq+0x72/0x100 [ 3484.735253][ C0] __do_softirq+0x1bc/0x7ff [ 3484.735258][ C0] irq_exit_rcu+0x98/0xc0 [ 3484.735261][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3484.735265][ C0] [ 3484.735266][ C0] [ 3484.735267][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3484.735273][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3484.735277][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3484.735279][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3484.735281][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3484.735283][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3484.735285][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3484.735287][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3484.735288][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3484.735292][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3484.735295][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3484.735299][ C0] default_idle_call+0x69/0xa0 [ 3484.735301][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3484.735304][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3484.735309][ C0] ? lock_release+0x1d5/0x250 [ 3484.735313][ C0] do_idle+0xfb/0x160 [ 3484.735316][ C0] cpu_startup_entry+0x55/0x60 [ 3484.735319][ C0] rest_init+0x153/0x260 [ 3484.735321][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3484.735327][ C0] arch_call_rest_init+0x13/0x40 [ 3484.735333][ C0] start_kernel+0x314/0x3d0 [ 3484.735337][ C0] x86_64_start_reservations+0x18/0x30 [ 3484.735341][ C0] x86_64_start_kernel+0xba/0x110 [ 3484.735345][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3484.735353][ C0] [ 3484.735631][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3484.789593][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3484.790234][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3484.790577][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3484.791594][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3484.791919][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3484.792339][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3484.792758][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3484.793178][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3484.793599][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3484.794018][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3484.794488][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3484.794844][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3484.795269][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3484.795691][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3484.796115][ C1] Call Trace: [ 3484.796300][ C1] [ 3484.796458][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3484.796745][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3484.797012][ C1] ? check_cpu_stall+0x284/0x500 [ 3484.797275][ C1] ? rcu_pending+0x92/0x360 [ 3484.797521][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3484.797806][ C1] ? update_process_times+0xb9/0x110 [ 3484.798091][ C1] ? tick_sched_handle+0x67/0x130 [ 3484.798363][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3484.798662][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3484.798913][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3484.799248][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3484.799535][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3484.799840][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3484.800124][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3484.800446][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3484.800720][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3484.801047][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3484.801359][ C1] [ 3484.801515][ C1] [ 3484.801671][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3484.802001][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3484.802307][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3484.802621][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3484.802923][ C1] ? run_ksoftirqd+0xb/0x60 [ 3484.803171][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3484.803497][ C1] ? __orc_find+0x9c/0xf0 [ 3484.803729][ C1] ? lock_acquire+0x1c1/0x220 [ 3484.803983][ C1] ? irqentry_enter+0x2b/0x60 [ 3484.804239][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3484.804504][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3484.804796][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3484.805097][ C1] ? lock_acquire+0x1c1/0x220 [ 3484.805344][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3484.805593][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3484.805864][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3484.806114][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3484.806378][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3484.806651][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3484.806940][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3484.807232][ C1] ip_local_deliver+0x19d/0x480 [ 3484.807489][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3484.807773][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3484.808038][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3484.808319][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3484.808584][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3484.808918][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3484.809199][ C1] ip_rcv+0x564/0x740 [ 3484.809414][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3484.809656][ C1] ? set_track_prepare+0x8a/0xd0 [ 3484.809919][ C1] ? irqentry_enter+0x2b/0x60 [ 3484.810173][ C1] ? irqentry_enter+0x2b/0x60 [ 3484.810426][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3484.810671][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3484.810987][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3484.811331][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3484.811642][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3484.811980][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3484.812278][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3484.812612][ C1] netif_receive_skb+0x55/0x280 [ 3484.812877][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3484.813207][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3484.813558][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3484.813869][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3484.814164][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3484.814470][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3484.814802][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3484.815086][ C1] ? arch_stack_walk+0x68/0x100 [ 3484.815344][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3484.815618][ C1] ? irqentry_enter+0x2b/0x60 [ 3484.815866][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3484.816188][ C1] ? irqentry_enter+0x2b/0x60 [ 3484.816443][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3484.816764][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3484.817043][ C1] ? arch_stack_walk+0x68/0x100 [ 3484.817306][ C1] __tcf_classify+0x32c/0x7d0 [ 3484.817562][ C1] tcf_classify+0x283/0x930 [ 3484.817807][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3484.818081][ C1] tc_run+0x2e4/0x5d0 [ 3484.818298][ C1] ? __pfx_tc_run+0x10/0x10 [ 3484.818545][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3484.818813][ C1] ? irqentry_enter+0x2b/0x60 [ 3484.819075][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3484.819362][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3484.819687][ C1] ip_finish_output2+0x786/0x18e0 [ 3484.819956][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3484.820243][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3484.820509][ C1] ? __ip_finish_output+0x10f/0x770 [ 3484.820784][ C1] ip_output+0x16b/0x4f0 [ 3484.821009][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3484.821336][ C1] ? __pfx_ip_output+0x10/0x10 [ 3484.821592][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3484.821945][ C1] ? __pfx_ip_output+0x10/0x10 [ 3484.822203][ C1] __ip_queue_xmit+0x672/0x1910 [ 3484.822462][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3484.822740][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3484.823034][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3484.823318][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3484.823616][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3484.823901][ C1] tcp_delack_timer+0x84/0x240 [ 3484.824157][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3484.824444][ C1] call_timer_fn+0x176/0x430 [ 3484.824693][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3484.824966][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3484.825248][ C1] __run_timers.part.0+0x52d/0x890 [ 3484.825523][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3484.825809][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3484.826109][ C1] ? __pfx___schedule+0x10/0x10 [ 3484.826371][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3484.826693][ C1] run_timer_softirq+0x72/0x100 [ 3484.826949][ C1] __do_softirq+0x1bc/0x7ff [ 3484.827191][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3484.827465][ C1] run_ksoftirqd+0x2e/0x60 [ 3484.827706][ C1] smpboot_thread_fn+0x30e/0x840 [ 3484.827972][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3484.828266][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3484.828555][ C1] kthread+0x292/0x360 [ 3484.828773][ C1] ? __pfx_kthread+0x10/0x10 [ 3484.829015][ C1] ret_from_fork+0x34/0x70 [ 3484.829264][ C1] ? __pfx_kthread+0x10/0x10 [ 3484.829513][ C1] ret_from_fork_asm+0x1b/0x30 [ 3484.829773][ C1] [ 3512.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2165s! [swapper/0:0] [ 3512.527916][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3512.529115][ C0] irq event stamp: 27567077 [ 3512.529357][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3512.529889][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3512.530356][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3512.530855][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3512.531346][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3512.531824][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3512.532468][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3512.532810][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3512.533833][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3512.534158][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3512.534581][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3512.535004][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3512.535431][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3512.535848][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3512.536268][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3512.536741][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3512.537086][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3512.537507][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3512.537922][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3512.538338][ C0] Call Trace: [ 3512.538517][ C0] [ 3512.538673][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3512.538959][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3512.539214][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3512.539502][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3512.539791][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3512.540101][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3512.540387][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3512.540706][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3512.540976][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3512.541254][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3512.541574][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3512.541883][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3512.542213][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3512.542514][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3512.542822][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3512.543127][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3512.543455][ C0] ? get_stack_info+0x36/0xc0 [ 3512.543712][ C0] ? lock_acquire+0x1c1/0x220 [ 3512.543962][ C0] ? lock_release+0x1d5/0x250 [ 3512.544212][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3512.544471][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3512.544753][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3512.545048][ C0] ? lock_acquire+0x1c1/0x220 [ 3512.545299][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3512.545554][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3512.545829][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3512.546073][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3512.546330][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3512.546596][ C0] ? __inet_lookup_established+0x341/0x610 [ 3512.546911][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3512.547202][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3512.547493][ C0] ip_local_deliver+0x19d/0x480 [ 3512.547747][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3512.548027][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3512.548291][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3512.548570][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3512.548837][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3512.549181][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3512.549454][ C0] ip_rcv+0x564/0x740 [ 3512.549665][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3512.549910][ C0] ? set_track_prepare+0x8a/0xd0 [ 3512.550174][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3512.550463][ C0] ? rest_init+0x153/0x260 [ 3512.550699][ C0] ? skb_clone+0x10b/0x330 [ 3512.550940][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3512.551271][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3512.551590][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3512.551887][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3512.552196][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3512.552459][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3512.552702][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3512.553017][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3512.553315][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3512.553651][ C0] ? lock_acquire+0x1c1/0x220 [ 3512.553902][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3512.554209][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3512.554506][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3512.554831][ C0] ? __copy_skb_header+0xaf/0x490 [ 3512.555096][ C0] ? __skb_clone+0x57a/0x760 [ 3512.555342][ C0] netif_receive_skb+0x55/0x280 [ 3512.555602][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3512.555932][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3512.556280][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3512.556590][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3512.556879][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3512.557185][ C0] ? hlock_class+0x4e/0x130 [ 3512.557433][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3512.557763][ C0] ? place_entity+0x21/0x2f0 [ 3512.558011][ C0] ? resched_curr+0x219/0x280 [ 3512.558262][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3512.558528][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3512.558807][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3512.559090][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3512.559345][ C0] ? activate_task+0xf5/0x260 [ 3512.559591][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3512.559864][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3512.560140][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3512.560398][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3512.560686][ C0] ? get_stack_info+0x36/0xc0 [ 3512.560940][ C0] ? stack_access_ok+0xda/0x1f0 [ 3512.561199][ C0] ? get_reg+0x119/0x190 [ 3512.561429][ C0] __tcf_classify+0x32c/0x7d0 [ 3512.561680][ C0] tcf_classify+0x283/0x930 [ 3512.561921][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3512.562248][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3512.562517][ C0] ? arch_stack_walk+0x8c/0x100 [ 3512.562780][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3512.563075][ C0] tc_run+0x2e4/0x5d0 [ 3512.563290][ C0] ? __pfx_tc_run+0x10/0x10 [ 3512.563529][ C0] ? lock_acquire+0x1c1/0x220 [ 3512.563774][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3512.564049][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3512.564315][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3512.564597][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3512.564871][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3512.565192][ C0] ? neigh_hh_output+0x348/0x590 [ 3512.565457][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3512.565733][ C0] ip_finish_output2+0x786/0x18e0 [ 3512.566000][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3512.566291][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3512.566648][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3512.566938][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3512.567200][ C0] ? __ip_finish_output+0x10f/0x770 [ 3512.567482][ C0] ip_output+0x16b/0x4f0 [ 3512.567712][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3512.567996][ C0] ? __pfx_ip_output+0x10/0x10 [ 3512.568254][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3512.568552][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3512.568818][ C0] ? ip_local_out+0x114/0x3b0 [ 3512.569075][ C0] __ip_queue_xmit+0x672/0x1910 [ 3512.569341][ C0] ? __skb_clone+0x57a/0x760 [ 3512.569591][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3512.569870][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3512.570164][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3512.570480][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3512.570738][ C0] ? tcp_current_mss+0x40a/0x510 [ 3512.571005][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3512.571289][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3512.571563][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3512.571813][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3512.572085][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3512.572406][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3512.572679][ C0] ? ktime_get+0xb6/0x190 [ 3512.572908][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3512.573180][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3512.573463][ C0] tcp_write_timer+0x82/0x1d0 [ 3512.573713][ C0] call_timer_fn+0x176/0x430 [ 3512.573958][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3512.574234][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3512.574506][ C0] __run_timers.part.0+0x52d/0x890 [ 3512.574778][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3512.575057][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3512.575357][ C0] ? lock_acquire+0x1c1/0x220 [ 3512.575606][ C0] ? clockevents_program_event+0xf6/0x300 [ 3512.575906][ C0] ? lock_release+0x1d5/0x250 [ 3512.576154][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3512.576432][ C0] ? ktime_get+0xb6/0x190 [ 3512.576661][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3512.576958][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3512.577270][ C0] run_timer_softirq+0x72/0x100 [ 3512.577529][ C0] __do_softirq+0x1bc/0x7ff [ 3512.577774][ C0] irq_exit_rcu+0x98/0xc0 [ 3512.578003][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3512.578299][ C0] [ 3512.578459][ C0] [ 3512.578619][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3512.578947][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3512.579219][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3512.580243][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3512.580567][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3512.580990][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3512.581414][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3512.581833][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3512.582252][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3512.582679][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3512.582990][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3512.583266][ C0] default_idle_call+0x69/0xa0 [ 3512.583519][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3512.583783][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3512.584073][ C0] ? lock_release+0x1d5/0x250 [ 3512.584324][ C0] do_idle+0xfb/0x160 [ 3512.584540][ C0] cpu_startup_entry+0x55/0x60 [ 3512.584798][ C0] rest_init+0x153/0x260 [ 3512.585022][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3512.585310][ C0] arch_call_rest_init+0x13/0x40 [ 3512.585582][ C0] start_kernel+0x314/0x3d0 [ 3512.585822][ C0] x86_64_start_reservations+0x18/0x30 [ 3512.586111][ C0] x86_64_start_kernel+0xba/0x110 [ 3512.586383][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3512.586715][ C0] [ 3512.586882][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2165s! [ksoftirqd/1:22] [ 3512.587360][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3512.588555][ C1] irq event stamp: 3886976 [ 3512.588792][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3512.589295][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3512.589791][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3512.590290][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3512.590785][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3512.591277][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3512.591920][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3512.592261][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3512.593279][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3512.593600][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3512.594019][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3512.594440][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3512.594858][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3512.595275][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3512.595690][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3512.596160][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3512.596509][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3512.596928][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3512.597355][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3512.597784][ C1] Call Trace: [ 3512.597965][ C1] [ 3512.598123][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3512.598400][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3512.598660][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3512.598956][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3512.599246][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3512.599548][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3512.599827][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3512.600147][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3512.600426][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3512.600751][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3512.601060][ C1] [ 3512.601224][ C1] [ 3512.601384][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3512.601718][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3512.602022][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3512.602332][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3512.602639][ C1] ? run_ksoftirqd+0xb/0x60 [ 3512.602886][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3512.603218][ C1] ? __orc_find+0x9c/0xf0 [ 3512.603450][ C1] ? lock_acquire+0x1c1/0x220 [ 3512.603702][ C1] ? irqentry_enter+0x2b/0x60 [ 3512.603955][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3512.604217][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3512.604500][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3512.604798][ C1] ? lock_acquire+0x1c1/0x220 [ 3512.605054][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3512.605313][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3512.605591][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3512.605836][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3512.606100][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3512.606370][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3512.606659][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3512.606951][ C1] ip_local_deliver+0x19d/0x480 [ 3512.607216][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3512.607504][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3512.607771][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3512.608048][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3512.608311][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3512.608652][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3512.608931][ C1] ip_rcv+0x564/0x740 [ 3512.609146][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3512.609391][ C1] ? set_track_prepare+0x8a/0xd0 [ 3512.609658][ C1] ? irqentry_enter+0x2b/0x60 [ 3512.609907][ C1] ? irqentry_enter+0x2b/0x60 [ 3512.610157][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3512.610398][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3512.610714][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3512.611055][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3512.611363][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3512.611707][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3512.612011][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3512.612345][ C1] netif_receive_skb+0x55/0x280 [ 3512.612604][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3512.612932][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3512.613280][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3512.613598][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3512.613887][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3512.614192][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3512.614520][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3512.614801][ C1] ? arch_stack_walk+0x68/0x100 [ 3512.615073][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3512.615353][ C1] ? irqentry_enter+0x2b/0x60 [ 3512.615609][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3512.615932][ C1] ? irqentry_enter+0x2b/0x60 [ 3512.616183][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3512.616507][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3512.616792][ C1] ? arch_stack_walk+0x68/0x100 [ 3512.617056][ C1] __tcf_classify+0x32c/0x7d0 [ 3512.617309][ C1] tcf_classify+0x283/0x930 [ 3512.617553][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3512.617823][ C1] tc_run+0x2e4/0x5d0 [ 3512.618037][ C1] ? __pfx_tc_run+0x10/0x10 [ 3512.618281][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3512.618546][ C1] ? irqentry_enter+0x2b/0x60 [ 3512.618802][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3512.619097][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3512.619419][ C1] ip_finish_output2+0x786/0x18e0 [ 3512.619692][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3512.619986][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3512.620252][ C1] ? __ip_finish_output+0x10f/0x770 [ 3512.620535][ C1] ip_output+0x16b/0x4f0 [ 3512.620762][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3512.621079][ C1] ? __pfx_ip_output+0x10/0x10 [ 3512.621339][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3512.621692][ C1] ? __pfx_ip_output+0x10/0x10 [ 3512.621950][ C1] __ip_queue_xmit+0x672/0x1910 [ 3512.622217][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3512.622502][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3512.622801][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3512.623091][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3512.623389][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3512.623677][ C1] tcp_delack_timer+0x84/0x240 [ 3512.623934][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3512.624218][ C1] call_timer_fn+0x176/0x430 [ 3512.624464][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3512.624743][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3512.625021][ C1] __run_timers.part.0+0x52d/0x890 [ 3512.625294][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3512.625583][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3512.625890][ C1] ? __pfx___schedule+0x10/0x10 [ 3512.626150][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3512.626469][ C1] run_timer_softirq+0x72/0x100 [ 3512.626735][ C1] __do_softirq+0x1bc/0x7ff [ 3512.626982][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3512.627260][ C1] run_ksoftirqd+0x2e/0x60 [ 3512.627499][ C1] smpboot_thread_fn+0x30e/0x840 [ 3512.627766][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3512.628056][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3512.628348][ C1] kthread+0x292/0x360 [ 3512.628567][ C1] ? __pfx_kthread+0x10/0x10 [ 3512.628817][ C1] ret_from_fork+0x34/0x70 [ 3512.629060][ C1] ? __pfx_kthread+0x10/0x10 [ 3512.629305][ C1] ret_from_fork_asm+0x1b/0x30 [ 3512.629568][ C1] [ 3540.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2191s! [swapper/0:0] [ 3540.527915][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3540.529129][ C0] irq event stamp: 27567077 [ 3540.529365][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3540.529888][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3540.530365][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3540.530874][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3540.531371][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3540.531850][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3540.532486][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3540.532824][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3540.533835][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3540.534156][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3540.534574][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3540.534992][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3540.535410][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3540.535828][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3540.536245][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3540.536713][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3540.537062][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3540.537485][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3540.537906][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3540.538330][ C0] Call Trace: [ 3540.538510][ C0] [ 3540.538667][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3540.538951][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3540.539204][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3540.539498][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3540.539783][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3540.540085][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3540.540361][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3540.540680][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3540.540957][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3540.541235][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3540.541560][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3540.541872][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3540.542205][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3540.542509][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3540.542822][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3540.543126][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3540.543451][ C0] ? get_stack_info+0x36/0xc0 [ 3540.543709][ C0] ? lock_acquire+0x1c1/0x220 [ 3540.543962][ C0] ? lock_release+0x1d5/0x250 [ 3540.544216][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3540.544478][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3540.544766][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3540.545068][ C0] ? lock_acquire+0x1c1/0x220 [ 3540.545317][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3540.545570][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3540.545841][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3540.546091][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3540.546351][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3540.546624][ C0] ? __inet_lookup_established+0x341/0x610 [ 3540.546938][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3540.547225][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3540.547513][ C0] ip_local_deliver+0x19d/0x480 [ 3540.547774][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3540.548063][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3540.548336][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3540.548612][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3540.548880][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3540.549213][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3540.549489][ C0] ip_rcv+0x564/0x740 [ 3540.549708][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3540.549952][ C0] ? set_track_prepare+0x8a/0xd0 [ 3540.550220][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3540.550506][ C0] ? rest_init+0x153/0x260 [ 3540.550744][ C0] ? skb_clone+0x10b/0x330 [ 3540.550981][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3540.551317][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3540.551640][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3540.551933][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3540.552239][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3540.552496][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3540.552737][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3540.553051][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3540.553348][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3540.553690][ C0] ? lock_acquire+0x1c1/0x220 [ 3540.553943][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3540.554255][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3540.554550][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3540.554883][ C0] ? __copy_skb_header+0xaf/0x490 [ 3540.555155][ C0] ? __skb_clone+0x57a/0x760 [ 3540.555403][ C0] netif_receive_skb+0x55/0x280 [ 3540.555660][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3540.555985][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3540.556331][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3540.556646][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3540.556932][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3540.557230][ C0] ? hlock_class+0x4e/0x130 [ 3540.557475][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3540.557800][ C0] ? place_entity+0x21/0x2f0 [ 3540.558043][ C0] ? resched_curr+0x219/0x280 [ 3540.558294][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3540.558566][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3540.558853][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3540.559136][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3540.559396][ C0] ? activate_task+0xf5/0x260 [ 3540.559650][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3540.559926][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3540.560198][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3540.560460][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3540.560751][ C0] ? get_stack_info+0x36/0xc0 [ 3540.560998][ C0] ? stack_access_ok+0xda/0x1f0 [ 3540.561253][ C0] ? get_reg+0x119/0x190 [ 3540.561479][ C0] __tcf_classify+0x32c/0x7d0 [ 3540.561733][ C0] tcf_classify+0x283/0x930 [ 3540.561978][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3540.562314][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3540.562579][ C0] ? arch_stack_walk+0x8c/0x100 [ 3540.562836][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3540.563129][ C0] tc_run+0x2e4/0x5d0 [ 3540.563350][ C0] ? __pfx_tc_run+0x10/0x10 [ 3540.563601][ C0] ? lock_acquire+0x1c1/0x220 [ 3540.563853][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3540.564132][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3540.564396][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3540.564686][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3540.564966][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3540.565289][ C0] ? neigh_hh_output+0x348/0x590 [ 3540.565553][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3540.565833][ C0] ip_finish_output2+0x786/0x18e0 [ 3540.566103][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3540.566399][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3540.566751][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3540.567037][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3540.567304][ C0] ? __ip_finish_output+0x10f/0x770 [ 3540.567580][ C0] ip_output+0x16b/0x4f0 [ 3540.567806][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3540.568092][ C0] ? __pfx_ip_output+0x10/0x10 [ 3540.568347][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3540.568652][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3540.568920][ C0] ? ip_local_out+0x114/0x3b0 [ 3540.569172][ C0] __ip_queue_xmit+0x672/0x1910 [ 3540.569432][ C0] ? __skb_clone+0x57a/0x760 [ 3540.569680][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3540.569962][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3540.570263][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3540.570584][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3540.570839][ C0] ? tcp_current_mss+0x40a/0x510 [ 3540.571107][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3540.571389][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3540.571667][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3540.571924][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3540.572195][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3540.572514][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3540.572794][ C0] ? ktime_get+0xb6/0x190 [ 3540.573029][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3540.573305][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3540.573586][ C0] tcp_write_timer+0x82/0x1d0 [ 3540.573841][ C0] call_timer_fn+0x176/0x430 [ 3540.574092][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3540.574363][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3540.574638][ C0] __run_timers.part.0+0x52d/0x890 [ 3540.574910][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3540.575200][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3540.575501][ C0] ? lock_acquire+0x1c1/0x220 [ 3540.575755][ C0] ? clockevents_program_event+0xf6/0x300 [ 3540.576066][ C0] ? lock_release+0x1d5/0x250 [ 3540.576317][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3540.576595][ C0] ? ktime_get+0xb6/0x190 [ 3540.576828][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3540.577128][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3540.577436][ C0] run_timer_softirq+0x72/0x100 [ 3540.577700][ C0] __do_softirq+0x1bc/0x7ff [ 3540.577947][ C0] irq_exit_rcu+0x98/0xc0 [ 3540.578180][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3540.578482][ C0] [ 3540.578637][ C0] [ 3540.578798][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3540.579121][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3540.579387][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3540.580400][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3540.580719][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3540.581137][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3540.581554][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3540.581969][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3540.582385][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3540.582804][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3540.583105][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3540.583377][ C0] default_idle_call+0x69/0xa0 [ 3540.583633][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3540.583894][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3540.584187][ C0] ? lock_release+0x1d5/0x250 [ 3540.584435][ C0] do_idle+0xfb/0x160 [ 3540.584647][ C0] cpu_startup_entry+0x55/0x60 [ 3540.584901][ C0] rest_init+0x153/0x260 [ 3540.585128][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3540.585413][ C0] arch_call_rest_init+0x13/0x40 [ 3540.585678][ C0] start_kernel+0x314/0x3d0 [ 3540.585922][ C0] x86_64_start_reservations+0x18/0x30 [ 3540.586218][ C0] x86_64_start_kernel+0xba/0x110 [ 3540.586484][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3540.586810][ C0] [ 3540.586975][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2191s! [ksoftirqd/1:22] [ 3540.587444][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3540.588647][ C1] irq event stamp: 3886976 [ 3540.588892][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3540.589396][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3540.589892][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3540.590392][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3540.590882][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3540.591376][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3540.592024][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3540.592367][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3540.593388][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3540.593717][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3540.594139][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3540.594561][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3540.594986][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3540.595413][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3540.595833][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3540.596306][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3540.596654][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3540.597078][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3540.597497][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3540.597915][ C1] Call Trace: [ 3540.598096][ C1] [ 3540.598251][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3540.598530][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3540.598788][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3540.599079][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3540.599369][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3540.599675][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3540.599958][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3540.600282][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3540.600556][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3540.600880][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3540.601194][ C1] [ 3540.601351][ C1] [ 3540.601507][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3540.601839][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3540.602145][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3540.602459][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3540.602760][ C1] ? run_ksoftirqd+0xb/0x60 [ 3540.603001][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3540.603328][ C1] ? __orc_find+0x9c/0xf0 [ 3540.603560][ C1] ? lock_acquire+0x1c1/0x220 [ 3540.603816][ C1] ? irqentry_enter+0x2b/0x60 [ 3540.604077][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3540.604345][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3540.604633][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3540.604934][ C1] ? lock_acquire+0x1c1/0x220 [ 3540.605183][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3540.605434][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3540.605706][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3540.605955][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3540.606222][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3540.606495][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3540.606785][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3540.607078][ C1] ip_local_deliver+0x19d/0x480 [ 3540.607337][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3540.607625][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3540.607890][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3540.608172][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3540.608441][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3540.608782][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3540.609057][ C1] ip_rcv+0x564/0x740 [ 3540.609272][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3540.609515][ C1] ? set_track_prepare+0x8a/0xd0 [ 3540.609779][ C1] ? irqentry_enter+0x2b/0x60 [ 3540.610033][ C1] ? irqentry_enter+0x2b/0x60 [ 3540.610286][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3540.610532][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3540.610847][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3540.611192][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3540.611507][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3540.611846][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3540.612143][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3540.612480][ C1] netif_receive_skb+0x55/0x280 [ 3540.612745][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3540.613075][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3540.613426][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3540.613737][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3540.614027][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3540.614332][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3540.614663][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3540.614945][ C1] ? arch_stack_walk+0x68/0x100 [ 3540.615205][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3540.615480][ C1] ? irqentry_enter+0x2b/0x60 [ 3540.615729][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3540.616051][ C1] ? irqentry_enter+0x2b/0x60 [ 3540.616306][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3540.616628][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3540.616907][ C1] ? arch_stack_walk+0x68/0x100 [ 3540.617170][ C1] __tcf_classify+0x32c/0x7d0 [ 3540.617426][ C1] tcf_classify+0x283/0x930 [ 3540.617671][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3540.617943][ C1] tc_run+0x2e4/0x5d0 [ 3540.618160][ C1] ? __pfx_tc_run+0x10/0x10 [ 3540.618408][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3540.618677][ C1] ? irqentry_enter+0x2b/0x60 [ 3540.618937][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3540.619225][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3540.619552][ C1] ip_finish_output2+0x786/0x18e0 [ 3540.619824][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3540.620114][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3540.620381][ C1] ? __ip_finish_output+0x10f/0x770 [ 3540.620658][ C1] ip_output+0x16b/0x4f0 [ 3540.620885][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3540.621209][ C1] ? __pfx_ip_output+0x10/0x10 [ 3540.621466][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3540.621819][ C1] ? __pfx_ip_output+0x10/0x10 [ 3540.622077][ C1] __ip_queue_xmit+0x672/0x1910 [ 3540.622341][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3540.622620][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3540.622916][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3540.623203][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3540.623500][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3540.623788][ C1] tcp_delack_timer+0x84/0x240 [ 3540.624044][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3540.624332][ C1] call_timer_fn+0x176/0x430 [ 3540.624582][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3540.624855][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3540.625136][ C1] __run_timers.part.0+0x52d/0x890 [ 3540.625412][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3540.625699][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3540.625998][ C1] ? __pfx___schedule+0x10/0x10 [ 3540.626261][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3540.626583][ C1] run_timer_softirq+0x72/0x100 [ 3540.626840][ C1] __do_softirq+0x1bc/0x7ff [ 3540.627082][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3540.627357][ C1] run_ksoftirqd+0x2e/0x60 [ 3540.627595][ C1] smpboot_thread_fn+0x30e/0x840 [ 3540.627861][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3540.628154][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3540.628444][ C1] kthread+0x292/0x360 [ 3540.628661][ C1] ? __pfx_kthread+0x10/0x10 [ 3540.628910][ C1] ret_from_fork+0x34/0x70 [ 3540.629150][ C1] ? __pfx_kthread+0x10/0x10 [ 3540.629399][ C1] ret_from_fork_asm+0x1b/0x30 [ 3540.629659][ C1] [ 3562.831025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3562.831408][ C1] rcu: 1-....: (2362710 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=562106 [ 3562.831991][ C1] rcu: (t=2368522 jiffies g=1007429 q=31 ncpus=4) [ 3562.832337][ C1] Sending NMI from CPU 1 to CPUs 0: [ 3562.832628][ C0] NMI backtrace for cpu 0 [ 3562.832644][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3562.832649][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3562.832652][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3562.832660][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3562.832663][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3562.832666][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3562.832668][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3562.832670][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3562.832672][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3562.832674][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3562.832676][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3562.832679][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3562.832682][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3562.832684][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3562.832686][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3562.832687][ C0] Call Trace: [ 3562.832690][ C0] [ 3562.832693][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 3562.832700][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3562.832705][ C0] ? nmi_handle+0x156/0x420 [ 3562.832711][ C0] ? default_do_nmi+0x41/0x100 [ 3562.832715][ C0] ? exc_nmi+0xf3/0x120 [ 3562.832717][ C0] ? end_repeat_nmi+0xf/0x60 [ 3562.832722][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3562.832726][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3562.832730][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3562.832733][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3562.832737][ C0] [ 3562.832738][ C0] [ 3562.832739][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3562.832742][ C0] ? get_stack_info+0x36/0xc0 [ 3562.832747][ C0] ? lock_acquire+0x1c1/0x220 [ 3562.832751][ C0] ? lock_release+0x1d5/0x250 [ 3562.832755][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3562.832759][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3562.832761][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3562.832765][ C0] ? lock_acquire+0x1c1/0x220 [ 3562.832767][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3562.832772][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3562.832775][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3562.832782][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3562.832785][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3562.832789][ C0] ? __inet_lookup_established+0x341/0x610 [ 3562.832795][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3562.832802][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3562.832806][ C0] ip_local_deliver+0x19d/0x480 [ 3562.832809][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3562.832812][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3562.832818][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3562.832822][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3562.832825][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3562.832828][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3562.832839][ C0] ip_rcv+0x564/0x740 [ 3562.832842][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3562.832845][ C0] ? set_track_prepare+0x8a/0xd0 [ 3562.832850][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3562.832852][ C0] ? rest_init+0x153/0x260 [ 3562.832854][ C0] ? skb_clone+0x10b/0x330 [ 3562.832859][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3562.832865][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3562.832870][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3562.832875][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3562.832884][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3562.832887][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3562.832890][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3562.832894][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3562.832897][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3562.832901][ C0] ? lock_acquire+0x1c1/0x220 [ 3562.832903][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3562.832907][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3562.832910][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3562.832913][ C0] ? __copy_skb_header+0xaf/0x490 [ 3562.832916][ C0] ? __skb_clone+0x57a/0x760 [ 3562.832919][ C0] netif_receive_skb+0x55/0x280 [ 3562.832921][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3562.832930][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3562.832937][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3562.832944][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3562.832949][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3562.832958][ C0] ? hlock_class+0x4e/0x130 [ 3562.832965][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3562.832975][ C0] ? place_entity+0x21/0x2f0 [ 3562.832978][ C0] ? resched_curr+0x219/0x280 [ 3562.832982][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3562.832985][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3562.832989][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3562.832993][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3562.832996][ C0] ? activate_task+0xf5/0x260 [ 3562.832999][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3562.833004][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3562.833007][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3562.833011][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3562.833014][ C0] ? get_stack_info+0x36/0xc0 [ 3562.833018][ C0] ? stack_access_ok+0xda/0x1f0 [ 3562.833021][ C0] ? get_reg+0x119/0x190 [ 3562.833025][ C0] __tcf_classify+0x32c/0x7d0 [ 3562.833029][ C0] tcf_classify+0x283/0x930 [ 3562.833032][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3562.833038][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3562.833040][ C0] ? arch_stack_walk+0x8c/0x100 [ 3562.833045][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3562.833049][ C0] tc_run+0x2e4/0x5d0 [ 3562.833054][ C0] ? __pfx_tc_run+0x10/0x10 [ 3562.833058][ C0] ? lock_acquire+0x1c1/0x220 [ 3562.833060][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3562.833064][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3562.833070][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3562.833073][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3562.833077][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3562.833082][ C0] ? neigh_hh_output+0x348/0x590 [ 3562.833086][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3562.833090][ C0] ip_finish_output2+0x786/0x18e0 [ 3562.833093][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3562.833100][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3562.833107][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3562.833111][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3562.833115][ C0] ? __ip_finish_output+0x10f/0x770 [ 3562.833119][ C0] ip_output+0x16b/0x4f0 [ 3562.833122][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3562.833127][ C0] ? __pfx_ip_output+0x10/0x10 [ 3562.833130][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3562.833134][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3562.833137][ C0] ? ip_local_out+0x114/0x3b0 [ 3562.833141][ C0] __ip_queue_xmit+0x672/0x1910 [ 3562.833145][ C0] ? __skb_clone+0x57a/0x760 [ 3562.833149][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3562.833156][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3562.833160][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3562.833164][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3562.833169][ C0] ? tcp_current_mss+0x40a/0x510 [ 3562.833172][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3562.833175][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3562.833178][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3562.833180][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3562.833183][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3562.833187][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3562.833192][ C0] ? ktime_get+0xb6/0x190 [ 3562.833196][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3562.833200][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3562.833204][ C0] tcp_write_timer+0x82/0x1d0 [ 3562.833208][ C0] call_timer_fn+0x176/0x430 [ 3562.833212][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3562.833217][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3562.833221][ C0] __run_timers.part.0+0x52d/0x890 [ 3562.833225][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3562.833229][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3562.833232][ C0] ? lock_acquire+0x1c1/0x220 [ 3562.833235][ C0] ? clockevents_program_event+0xf6/0x300 [ 3562.833240][ C0] ? lock_release+0x1d5/0x250 [ 3562.833243][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3562.833246][ C0] ? ktime_get+0xb6/0x190 [ 3562.833249][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3562.833253][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3562.833257][ C0] run_timer_softirq+0x72/0x100 [ 3562.833261][ C0] __do_softirq+0x1bc/0x7ff [ 3562.833265][ C0] irq_exit_rcu+0x98/0xc0 [ 3562.833268][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3562.833271][ C0] [ 3562.833272][ C0] [ 3562.833274][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3562.833280][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3562.833283][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3562.833285][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3562.833288][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3562.833290][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3562.833291][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3562.833293][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3562.833294][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3562.833298][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3562.833301][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3562.833305][ C0] default_idle_call+0x69/0xa0 [ 3562.833307][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3562.833309][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3562.833315][ C0] ? lock_release+0x1d5/0x250 [ 3562.833319][ C0] do_idle+0xfb/0x160 [ 3562.833322][ C0] cpu_startup_entry+0x55/0x60 [ 3562.833324][ C0] rest_init+0x153/0x260 [ 3562.833326][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3562.833332][ C0] arch_call_rest_init+0x13/0x40 [ 3562.833338][ C0] start_kernel+0x314/0x3d0 [ 3562.833342][ C0] x86_64_start_reservations+0x18/0x30 [ 3562.833347][ C0] x86_64_start_kernel+0xba/0x110 [ 3562.833350][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3562.833358][ C0] [ 3562.833624][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3562.887658][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3562.888307][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3562.888650][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3562.889680][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3562.890006][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3562.890426][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3562.890850][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3562.891274][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3562.891694][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3562.892115][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3562.892592][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3562.892940][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3562.893365][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3562.893784][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3562.894204][ C1] Call Trace: [ 3562.894383][ C1] [ 3562.894540][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3562.894829][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3562.895094][ C1] ? check_cpu_stall+0x284/0x500 [ 3562.895358][ C1] ? rcu_pending+0x92/0x360 [ 3562.895597][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3562.895878][ C1] ? update_process_times+0xb9/0x110 [ 3562.896164][ C1] ? tick_sched_handle+0x67/0x130 [ 3562.896431][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3562.896729][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3562.896986][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3562.897318][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3562.897608][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3562.897911][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3562.898194][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3562.898518][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3562.898798][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3562.899123][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3562.899431][ C1] [ 3562.899590][ C1] [ 3562.899751][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3562.900088][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3562.900389][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3562.900696][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3562.901000][ C1] ? run_ksoftirqd+0xb/0x60 [ 3562.901246][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3562.901576][ C1] ? __orc_find+0x9c/0xf0 [ 3562.901805][ C1] ? lock_acquire+0x1c1/0x220 [ 3562.902059][ C1] ? irqentry_enter+0x2b/0x60 [ 3562.902312][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3562.902571][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3562.902853][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3562.903150][ C1] ? lock_acquire+0x1c1/0x220 [ 3562.903406][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3562.903661][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3562.903938][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3562.904183][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3562.904441][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3562.904712][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3562.905000][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3562.905292][ C1] ip_local_deliver+0x19d/0x480 [ 3562.905554][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3562.905840][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3562.906105][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3562.906383][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3562.906645][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3562.906983][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3562.907256][ C1] ip_rcv+0x564/0x740 [ 3562.907467][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3562.907706][ C1] ? set_track_prepare+0x8a/0xd0 [ 3562.907969][ C1] ? irqentry_enter+0x2b/0x60 [ 3562.908223][ C1] ? irqentry_enter+0x2b/0x60 [ 3562.908478][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3562.908726][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3562.909042][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3562.909379][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3562.909687][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3562.910030][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3562.910331][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3562.910662][ C1] netif_receive_skb+0x55/0x280 [ 3562.910920][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3562.911248][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3562.911593][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3562.911910][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3562.912198][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3562.912501][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3562.912827][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3562.913110][ C1] ? arch_stack_walk+0x68/0x100 [ 3562.913376][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3562.913655][ C1] ? irqentry_enter+0x2b/0x60 [ 3562.913909][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3562.914231][ C1] ? irqentry_enter+0x2b/0x60 [ 3562.914479][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3562.914804][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3562.915088][ C1] ? arch_stack_walk+0x68/0x100 [ 3562.915347][ C1] __tcf_classify+0x32c/0x7d0 [ 3562.915599][ C1] tcf_classify+0x283/0x930 [ 3562.915841][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3562.916109][ C1] tc_run+0x2e4/0x5d0 [ 3562.916321][ C1] ? __pfx_tc_run+0x10/0x10 [ 3562.916563][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3562.916827][ C1] ? irqentry_enter+0x2b/0x60 [ 3562.917082][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3562.917370][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3562.917694][ C1] ip_finish_output2+0x786/0x18e0 [ 3562.917962][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3562.918253][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3562.918519][ C1] ? __ip_finish_output+0x10f/0x770 [ 3562.918801][ C1] ip_output+0x16b/0x4f0 [ 3562.919028][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3562.919342][ C1] ? __pfx_ip_output+0x10/0x10 [ 3562.919599][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3562.919951][ C1] ? __pfx_ip_output+0x10/0x10 [ 3562.920208][ C1] __ip_queue_xmit+0x672/0x1910 [ 3562.920472][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3562.920755][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3562.921053][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3562.921341][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3562.921639][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3562.921929][ C1] tcp_delack_timer+0x84/0x240 [ 3562.922186][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3562.922468][ C1] call_timer_fn+0x176/0x430 [ 3562.922712][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3562.922988][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3562.923265][ C1] __run_timers.part.0+0x52d/0x890 [ 3562.923535][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3562.923825][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3562.924128][ C1] ? __pfx___schedule+0x10/0x10 [ 3562.924387][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3562.924705][ C1] run_timer_softirq+0x72/0x100 [ 3562.924969][ C1] __do_softirq+0x1bc/0x7ff [ 3562.925215][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3562.925495][ C1] run_ksoftirqd+0x2e/0x60 [ 3562.925734][ C1] smpboot_thread_fn+0x30e/0x840 [ 3562.926000][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3562.926288][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3562.926578][ C1] kthread+0x292/0x360 [ 3562.926797][ C1] ? __pfx_kthread+0x10/0x10 [ 3562.927046][ C1] ret_from_fork+0x34/0x70 [ 3562.927282][ C1] ? __pfx_kthread+0x10/0x10 [ 3562.927529][ C1] ret_from_fork_asm+0x1b/0x30 [ 3562.927785][ C1] [ 3588.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2236s! [swapper/0:0] [ 3588.527919][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3588.529117][ C0] irq event stamp: 27567077 [ 3588.529360][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3588.529892][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3588.530363][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3588.530863][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3588.531366][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3588.531841][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3588.532487][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3588.532835][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3588.533852][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3588.534175][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3588.534592][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3588.535016][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3588.535434][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3588.535851][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3588.536269][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3588.536738][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3588.537091][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3588.537508][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3588.537929][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3588.538353][ C0] Call Trace: [ 3588.538551][ C0] [ 3588.538707][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3588.538987][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3588.539239][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3588.539530][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3588.539813][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3588.540113][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3588.540391][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3588.540706][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3588.540983][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3588.541260][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3588.541585][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3588.541899][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3588.542227][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3588.542532][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3588.542844][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3588.543145][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3588.543475][ C0] ? get_stack_info+0x36/0xc0 [ 3588.543734][ C0] ? lock_acquire+0x1c1/0x220 [ 3588.543990][ C0] ? lock_release+0x1d5/0x250 [ 3588.544246][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3588.544511][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3588.544798][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3588.545097][ C0] ? lock_acquire+0x1c1/0x220 [ 3588.545342][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3588.545592][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3588.545863][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3588.546118][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3588.546379][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3588.546654][ C0] ? __inet_lookup_established+0x341/0x610 [ 3588.546969][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3588.547258][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3588.547547][ C0] ip_local_deliver+0x19d/0x480 [ 3588.547812][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3588.548098][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3588.548366][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3588.548647][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3588.548913][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3588.549248][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3588.549524][ C0] ip_rcv+0x564/0x740 [ 3588.549742][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3588.549985][ C0] ? set_track_prepare+0x8a/0xd0 [ 3588.550251][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3588.550539][ C0] ? rest_init+0x153/0x260 [ 3588.550776][ C0] ? skb_clone+0x10b/0x330 [ 3588.551013][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3588.551349][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3588.551675][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3588.551968][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3588.552275][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3588.552531][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3588.552769][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3588.553081][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3588.553377][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3588.553718][ C0] ? lock_acquire+0x1c1/0x220 [ 3588.553970][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3588.554292][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3588.554587][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3588.554924][ C0] ? __copy_skb_header+0xaf/0x490 [ 3588.555195][ C0] ? __skb_clone+0x57a/0x760 [ 3588.555445][ C0] netif_receive_skb+0x55/0x280 [ 3588.555703][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3588.556028][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3588.556374][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3588.556688][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3588.556973][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3588.557271][ C0] ? hlock_class+0x4e/0x130 [ 3588.557512][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3588.557837][ C0] ? place_entity+0x21/0x2f0 [ 3588.558083][ C0] ? resched_curr+0x219/0x280 [ 3588.558335][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3588.558608][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3588.558888][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3588.559167][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3588.559426][ C0] ? activate_task+0xf5/0x260 [ 3588.559678][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3588.559956][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3588.560228][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3588.560494][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3588.560785][ C0] ? get_stack_info+0x36/0xc0 [ 3588.561038][ C0] ? stack_access_ok+0xda/0x1f0 [ 3588.561296][ C0] ? get_reg+0x119/0x190 [ 3588.561524][ C0] __tcf_classify+0x32c/0x7d0 [ 3588.561780][ C0] tcf_classify+0x283/0x930 [ 3588.562025][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3588.562355][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3588.562619][ C0] ? arch_stack_walk+0x8c/0x100 [ 3588.562879][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3588.563166][ C0] tc_run+0x2e4/0x5d0 [ 3588.563385][ C0] ? __pfx_tc_run+0x10/0x10 [ 3588.563629][ C0] ? lock_acquire+0x1c1/0x220 [ 3588.563880][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3588.564158][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3588.564423][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3588.564709][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3588.564990][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3588.565315][ C0] ? neigh_hh_output+0x348/0x590 [ 3588.565578][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3588.565860][ C0] ip_finish_output2+0x786/0x18e0 [ 3588.566132][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3588.566427][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3588.566777][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3588.567067][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3588.567332][ C0] ? __ip_finish_output+0x10f/0x770 [ 3588.567607][ C0] ip_output+0x16b/0x4f0 [ 3588.567833][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3588.568119][ C0] ? __pfx_ip_output+0x10/0x10 [ 3588.568374][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3588.568684][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3588.568947][ C0] ? ip_local_out+0x114/0x3b0 [ 3588.569197][ C0] __ip_queue_xmit+0x672/0x1910 [ 3588.569455][ C0] ? __skb_clone+0x57a/0x760 [ 3588.569699][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3588.569983][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3588.570279][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3588.570599][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3588.570853][ C0] ? tcp_current_mss+0x40a/0x510 [ 3588.571119][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3588.571397][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3588.571676][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3588.571928][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3588.572194][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3588.572510][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3588.572792][ C0] ? ktime_get+0xb6/0x190 [ 3588.573026][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3588.573300][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3588.573580][ C0] tcp_write_timer+0x82/0x1d0 [ 3588.573834][ C0] call_timer_fn+0x176/0x430 [ 3588.574082][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3588.574353][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3588.574628][ C0] __run_timers.part.0+0x52d/0x890 [ 3588.574899][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3588.575182][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3588.575477][ C0] ? lock_acquire+0x1c1/0x220 [ 3588.575729][ C0] ? clockevents_program_event+0xf6/0x300 [ 3588.576038][ C0] ? lock_release+0x1d5/0x250 [ 3588.576288][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3588.576570][ C0] ? ktime_get+0xb6/0x190 [ 3588.576801][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3588.577103][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3588.577410][ C0] run_timer_softirq+0x72/0x100 [ 3588.577675][ C0] __do_softirq+0x1bc/0x7ff [ 3588.577922][ C0] irq_exit_rcu+0x98/0xc0 [ 3588.578155][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3588.578454][ C0] [ 3588.578616][ C0] [ 3588.578776][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3588.579101][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3588.579366][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3588.580379][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3588.580699][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3588.581117][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3588.581535][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3588.581952][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3588.582373][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3588.582793][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3588.583095][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3588.583369][ C0] default_idle_call+0x69/0xa0 [ 3588.583627][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3588.583890][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3588.584185][ C0] ? lock_release+0x1d5/0x250 [ 3588.584434][ C0] do_idle+0xfb/0x160 [ 3588.584646][ C0] cpu_startup_entry+0x55/0x60 [ 3588.584899][ C0] rest_init+0x153/0x260 [ 3588.585129][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3588.585417][ C0] arch_call_rest_init+0x13/0x40 [ 3588.585680][ C0] start_kernel+0x314/0x3d0 [ 3588.585925][ C0] x86_64_start_reservations+0x18/0x30 [ 3588.586219][ C0] x86_64_start_kernel+0xba/0x110 [ 3588.586485][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3588.586813][ C0] [ 3588.586979][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2236s! [ksoftirqd/1:22] [ 3588.587453][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3588.588655][ C1] irq event stamp: 3886976 [ 3588.588889][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3588.589390][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3588.589886][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3588.590387][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3588.590874][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3588.591370][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3588.592018][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3588.592361][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3588.593385][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3588.593711][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3588.594133][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3588.594557][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3588.594982][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3588.595404][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3588.595825][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3588.596300][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3588.596648][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3588.597072][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3588.597491][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3588.597909][ C1] Call Trace: [ 3588.598089][ C1] [ 3588.598246][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3588.598524][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3588.598783][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3588.599073][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3588.599362][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3588.599668][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3588.599950][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3588.600272][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3588.600544][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3588.600873][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3588.601185][ C1] [ 3588.601342][ C1] [ 3588.601499][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3588.601829][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3588.602136][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3588.602449][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3588.602749][ C1] ? run_ksoftirqd+0xb/0x60 [ 3588.602991][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3588.603318][ C1] ? __orc_find+0x9c/0xf0 [ 3588.603551][ C1] ? lock_acquire+0x1c1/0x220 [ 3588.603808][ C1] ? irqentry_enter+0x2b/0x60 [ 3588.604066][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3588.604330][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3588.604617][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3588.604918][ C1] ? lock_acquire+0x1c1/0x220 [ 3588.605167][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3588.605417][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3588.605688][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3588.605939][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3588.606202][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3588.606475][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3588.606768][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3588.607064][ C1] ip_local_deliver+0x19d/0x480 [ 3588.607323][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3588.607607][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3588.607871][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3588.608151][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3588.608415][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3588.608756][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3588.609030][ C1] ip_rcv+0x564/0x740 [ 3588.609242][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3588.609482][ C1] ? set_track_prepare+0x8a/0xd0 [ 3588.609745][ C1] ? irqentry_enter+0x2b/0x60 [ 3588.609997][ C1] ? irqentry_enter+0x2b/0x60 [ 3588.610250][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3588.610494][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3588.610813][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3588.611159][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3588.611469][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3588.611808][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3588.612106][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3588.612442][ C1] netif_receive_skb+0x55/0x280 [ 3588.612704][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3588.613037][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3588.613388][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3588.613701][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3588.613994][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3588.614304][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3588.614634][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3588.614918][ C1] ? arch_stack_walk+0x68/0x100 [ 3588.615180][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3588.615455][ C1] ? irqentry_enter+0x2b/0x60 [ 3588.615703][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3588.616020][ C1] ? irqentry_enter+0x2b/0x60 [ 3588.616276][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3588.616603][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3588.616882][ C1] ? arch_stack_walk+0x68/0x100 [ 3588.617149][ C1] __tcf_classify+0x32c/0x7d0 [ 3588.617406][ C1] tcf_classify+0x283/0x930 [ 3588.617652][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3588.617925][ C1] tc_run+0x2e4/0x5d0 [ 3588.618141][ C1] ? __pfx_tc_run+0x10/0x10 [ 3588.618390][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3588.618662][ C1] ? irqentry_enter+0x2b/0x60 [ 3588.618915][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3588.619202][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3588.619528][ C1] ip_finish_output2+0x786/0x18e0 [ 3588.619799][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3588.620088][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3588.620356][ C1] ? __ip_finish_output+0x10f/0x770 [ 3588.620634][ C1] ip_output+0x16b/0x4f0 [ 3588.620864][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3588.621189][ C1] ? __pfx_ip_output+0x10/0x10 [ 3588.621446][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3588.621802][ C1] ? __pfx_ip_output+0x10/0x10 [ 3588.622064][ C1] __ip_queue_xmit+0x672/0x1910 [ 3588.622325][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3588.622606][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3588.622900][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3588.623190][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3588.623484][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3588.623765][ C1] tcp_delack_timer+0x84/0x240 [ 3588.624017][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3588.624305][ C1] call_timer_fn+0x176/0x430 [ 3588.624554][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3588.624828][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3588.625109][ C1] __run_timers.part.0+0x52d/0x890 [ 3588.625384][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3588.625668][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3588.625966][ C1] ? __pfx___schedule+0x10/0x10 [ 3588.626231][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3588.626551][ C1] run_timer_softirq+0x72/0x100 [ 3588.626810][ C1] __do_softirq+0x1bc/0x7ff [ 3588.627051][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3588.627321][ C1] run_ksoftirqd+0x2e/0x60 [ 3588.627562][ C1] smpboot_thread_fn+0x30e/0x840 [ 3588.627826][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3588.628118][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3588.628405][ C1] kthread+0x292/0x360 [ 3588.628631][ C1] ? __pfx_kthread+0x10/0x10 [ 3588.628878][ C1] ret_from_fork+0x34/0x70 [ 3588.629114][ C1] ? __pfx_kthread+0x10/0x10 [ 3588.629362][ C1] ret_from_fork_asm+0x1b/0x30 [ 3588.629621][ C1] [ 3616.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2262s! [swapper/0:0] [ 3616.527916][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3616.529119][ C0] irq event stamp: 27567077 [ 3616.529356][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3616.529878][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3616.530353][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3616.530866][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3616.531366][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3616.531851][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3616.532494][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3616.532836][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3616.533846][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3616.534165][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3616.534579][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3616.535000][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3616.535416][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3616.535830][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3616.536244][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3616.536710][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3616.537059][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3616.537479][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3616.537902][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3616.538327][ C0] Call Trace: [ 3616.538513][ C0] [ 3616.538669][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3616.538945][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3616.539196][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3616.539491][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3616.539775][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3616.540077][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3616.540354][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3616.540672][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3616.540947][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3616.541223][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3616.541548][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3616.541860][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3616.542191][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3616.542493][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3616.542806][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3616.543112][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3616.543436][ C0] ? get_stack_info+0x36/0xc0 [ 3616.543691][ C0] ? lock_acquire+0x1c1/0x220 [ 3616.543944][ C0] ? lock_release+0x1d5/0x250 [ 3616.544195][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3616.544457][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3616.544742][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3616.545043][ C0] ? lock_acquire+0x1c1/0x220 [ 3616.545291][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3616.545543][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3616.545812][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3616.546062][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3616.546321][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3616.546596][ C0] ? __inet_lookup_established+0x341/0x610 [ 3616.546913][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3616.547200][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3616.547486][ C0] ip_local_deliver+0x19d/0x480 [ 3616.547746][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3616.548033][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3616.548302][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3616.548586][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3616.548852][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3616.549187][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3616.549463][ C0] ip_rcv+0x564/0x740 [ 3616.549683][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3616.549928][ C0] ? set_track_prepare+0x8a/0xd0 [ 3616.550196][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3616.550483][ C0] ? rest_init+0x153/0x260 [ 3616.550722][ C0] ? skb_clone+0x10b/0x330 [ 3616.550959][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3616.551295][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3616.551617][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3616.551912][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3616.552219][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3616.552477][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3616.552719][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3616.553031][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3616.553325][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3616.553668][ C0] ? lock_acquire+0x1c1/0x220 [ 3616.553925][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3616.554236][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3616.554532][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3616.554864][ C0] ? __copy_skb_header+0xaf/0x490 [ 3616.555135][ C0] ? __skb_clone+0x57a/0x760 [ 3616.555382][ C0] netif_receive_skb+0x55/0x280 [ 3616.555639][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3616.555964][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3616.556310][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3616.556625][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3616.556911][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3616.557211][ C0] ? hlock_class+0x4e/0x130 [ 3616.557456][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3616.557780][ C0] ? place_entity+0x21/0x2f0 [ 3616.558023][ C0] ? resched_curr+0x219/0x280 [ 3616.558275][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3616.558552][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3616.558833][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3616.559115][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3616.559377][ C0] ? activate_task+0xf5/0x260 [ 3616.559631][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3616.559908][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3616.560180][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3616.560442][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3616.560732][ C0] ? get_stack_info+0x36/0xc0 [ 3616.560981][ C0] ? stack_access_ok+0xda/0x1f0 [ 3616.561236][ C0] ? get_reg+0x119/0x190 [ 3616.561461][ C0] __tcf_classify+0x32c/0x7d0 [ 3616.561714][ C0] tcf_classify+0x283/0x930 [ 3616.561958][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3616.562289][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3616.562553][ C0] ? arch_stack_walk+0x8c/0x100 [ 3616.562810][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3616.563097][ C0] tc_run+0x2e4/0x5d0 [ 3616.563319][ C0] ? __pfx_tc_run+0x10/0x10 [ 3616.563564][ C0] ? lock_acquire+0x1c1/0x220 [ 3616.563816][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3616.564094][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3616.564358][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3616.564646][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3616.564929][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3616.565253][ C0] ? neigh_hh_output+0x348/0x590 [ 3616.565515][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3616.565794][ C0] ip_finish_output2+0x786/0x18e0 [ 3616.566064][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3616.566363][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3616.566711][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3616.566996][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3616.567262][ C0] ? __ip_finish_output+0x10f/0x770 [ 3616.567536][ C0] ip_output+0x16b/0x4f0 [ 3616.567760][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3616.568044][ C0] ? __pfx_ip_output+0x10/0x10 [ 3616.568297][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3616.568601][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3616.568865][ C0] ? ip_local_out+0x114/0x3b0 [ 3616.569115][ C0] __ip_queue_xmit+0x672/0x1910 [ 3616.569372][ C0] ? __skb_clone+0x57a/0x760 [ 3616.569618][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3616.569899][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3616.570199][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3616.570515][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3616.570768][ C0] ? tcp_current_mss+0x40a/0x510 [ 3616.571035][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3616.571316][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3616.571592][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3616.571849][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3616.572114][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3616.572432][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3616.572713][ C0] ? ktime_get+0xb6/0x190 [ 3616.572945][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3616.573219][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3616.573499][ C0] tcp_write_timer+0x82/0x1d0 [ 3616.573752][ C0] call_timer_fn+0x176/0x430 [ 3616.574004][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3616.574277][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3616.574552][ C0] __run_timers.part.0+0x52d/0x890 [ 3616.574822][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3616.575106][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3616.575402][ C0] ? lock_acquire+0x1c1/0x220 [ 3616.575655][ C0] ? clockevents_program_event+0xf6/0x300 [ 3616.575961][ C0] ? lock_release+0x1d5/0x250 [ 3616.576212][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3616.576489][ C0] ? ktime_get+0xb6/0x190 [ 3616.576721][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3616.577020][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3616.577329][ C0] run_timer_softirq+0x72/0x100 [ 3616.577593][ C0] __do_softirq+0x1bc/0x7ff [ 3616.577839][ C0] irq_exit_rcu+0x98/0xc0 [ 3616.578077][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3616.578378][ C0] [ 3616.578543][ C0] [ 3616.578704][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3616.579024][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3616.579290][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3616.580304][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3616.580622][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3616.581040][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3616.581456][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3616.581870][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3616.582285][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3616.582705][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3616.583007][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3616.583278][ C0] default_idle_call+0x69/0xa0 [ 3616.583535][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3616.583795][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3616.584088][ C0] ? lock_release+0x1d5/0x250 [ 3616.584335][ C0] do_idle+0xfb/0x160 [ 3616.584546][ C0] cpu_startup_entry+0x55/0x60 [ 3616.584800][ C0] rest_init+0x153/0x260 [ 3616.585025][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3616.585309][ C0] arch_call_rest_init+0x13/0x40 [ 3616.585573][ C0] start_kernel+0x314/0x3d0 [ 3616.585817][ C0] x86_64_start_reservations+0x18/0x30 [ 3616.586112][ C0] x86_64_start_kernel+0xba/0x110 [ 3616.586379][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3616.586703][ C0] [ 3616.586867][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2262s! [ksoftirqd/1:22] [ 3616.587338][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3616.588535][ C1] irq event stamp: 3886976 [ 3616.588774][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3616.589270][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3616.589765][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3616.590266][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3616.590759][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3616.591251][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3616.591894][ C1] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 3616.592198][ C1] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 3616.593225][ C1] RSP: 0018:ffffc9000019e9d0 EFLAGS: 00000282 [ 3616.593554][ C1] RAX: ffff88800a098e1c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3616.593980][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3616.594404][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3616.594829][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3616.595258][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3616.595679][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3616.596151][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3616.596499][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3616.596920][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3616.597342][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3616.597760][ C1] Call Trace: [ 3616.597938][ C1] [ 3616.598093][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3616.598374][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3616.598634][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3616.598923][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3616.599212][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3616.599518][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3616.599800][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3616.600123][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3616.600397][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3616.600723][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3616.601036][ C1] [ 3616.601193][ C1] [ 3616.601350][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3616.601681][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3616.601987][ C1] ? kasan_check_range+0x1a/0x1c0 [ 3616.602263][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 3616.602561][ C1] ? run_ksoftirqd+0xb/0x60 [ 3616.602808][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3616.603139][ C1] ? __orc_find+0x9c/0xf0 [ 3616.603368][ C1] ? lock_acquire+0x1c1/0x220 [ 3616.603617][ C1] ? irqentry_enter+0x2b/0x60 [ 3616.603867][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3616.604128][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3616.604413][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3616.604712][ C1] ? lock_acquire+0x1c1/0x220 [ 3616.604964][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3616.605220][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3616.605495][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3616.605739][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3616.605998][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3616.606270][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3616.606557][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3616.606844][ C1] ip_local_deliver+0x19d/0x480 [ 3616.607106][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3616.607395][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3616.607665][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3616.607943][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3616.608208][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3616.608549][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3616.608826][ C1] ip_rcv+0x564/0x740 [ 3616.609049][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3616.609295][ C1] ? set_track_prepare+0x8a/0xd0 [ 3616.609564][ C1] ? irqentry_enter+0x2b/0x60 [ 3616.609815][ C1] ? irqentry_enter+0x2b/0x60 [ 3616.610067][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3616.610310][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3616.610622][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3616.610966][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3616.611276][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3616.611618][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3616.611918][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3616.612249][ C1] netif_receive_skb+0x55/0x280 [ 3616.612507][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3616.612831][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3616.613179][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3616.613495][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3616.613782][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3616.614084][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3616.614410][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3616.614688][ C1] ? arch_stack_walk+0x68/0x100 [ 3616.614954][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3616.615235][ C1] ? irqentry_enter+0x2b/0x60 [ 3616.615488][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3616.615815][ C1] ? irqentry_enter+0x2b/0x60 [ 3616.616068][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3616.616387][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3616.616673][ C1] ? arch_stack_walk+0x68/0x100 [ 3616.616930][ C1] __tcf_classify+0x32c/0x7d0 [ 3616.617180][ C1] tcf_classify+0x283/0x930 [ 3616.617420][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3616.617689][ C1] tc_run+0x2e4/0x5d0 [ 3616.617905][ C1] ? __pfx_tc_run+0x10/0x10 [ 3616.618153][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3616.618423][ C1] ? irqentry_enter+0x2b/0x60 [ 3616.618674][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3616.618959][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3616.619282][ C1] ip_finish_output2+0x786/0x18e0 [ 3616.619556][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3616.619849][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3616.620113][ C1] ? __ip_finish_output+0x10f/0x770 [ 3616.620394][ C1] ip_output+0x16b/0x4f0 [ 3616.620625][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3616.620942][ C1] ? __pfx_ip_output+0x10/0x10 [ 3616.621204][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3616.621555][ C1] ? __pfx_ip_output+0x10/0x10 [ 3616.621808][ C1] __ip_queue_xmit+0x672/0x1910 [ 3616.622075][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3616.622359][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3616.622656][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3616.622946][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3616.623249][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3616.623539][ C1] tcp_delack_timer+0x84/0x240 [ 3616.623797][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3616.624087][ C1] call_timer_fn+0x176/0x430 [ 3616.624337][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3616.624613][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3616.624889][ C1] __run_timers.part.0+0x52d/0x890 [ 3616.625162][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3616.625453][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3616.625756][ C1] ? __pfx___schedule+0x10/0x10 [ 3616.626012][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3616.626330][ C1] run_timer_softirq+0x72/0x100 [ 3616.626592][ C1] __do_softirq+0x1bc/0x7ff [ 3616.626837][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3616.627116][ C1] run_ksoftirqd+0x2e/0x60 [ 3616.627353][ C1] smpboot_thread_fn+0x30e/0x840 [ 3616.627622][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3616.627914][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3616.628208][ C1] kthread+0x292/0x360 [ 3616.628431][ C1] ? __pfx_kthread+0x10/0x10 [ 3616.628676][ C1] ret_from_fork+0x34/0x70 [ 3616.628917][ C1] ? __pfx_kthread+0x10/0x10 [ 3616.629164][ C1] ret_from_fork_asm+0x1b/0x30 [ 3616.629429][ C1] [ 3640.930025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3640.930435][ C1] rcu: 1-....: (2440530 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=580095 [ 3640.931028][ C1] rcu: (t=2446621 jiffies g=1007429 q=31 ncpus=4) [ 3640.931376][ C1] Sending NMI from CPU 1 to CPUs 0: [ 3640.931660][ C0] NMI backtrace for cpu 0 [ 3640.931669][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3640.931673][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3640.931676][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3640.931685][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3640.931688][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3640.931692][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3640.931694][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3640.931696][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3640.931698][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3640.931700][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3640.931702][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3640.931704][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3640.931707][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3640.931709][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3640.931710][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3640.931712][ C0] Call Trace: [ 3640.931715][ C0] [ 3640.931719][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 3640.931726][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3640.931731][ C0] ? nmi_handle+0x156/0x420 [ 3640.931737][ C0] ? default_do_nmi+0x41/0x100 [ 3640.931741][ C0] ? exc_nmi+0xf3/0x120 [ 3640.931743][ C0] ? end_repeat_nmi+0xf/0x60 [ 3640.931748][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3640.931752][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3640.931755][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3640.931759][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3640.931762][ C0] [ 3640.931763][ C0] [ 3640.931765][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3640.931768][ C0] ? get_stack_info+0x36/0xc0 [ 3640.931773][ C0] ? lock_acquire+0x1c1/0x220 [ 3640.931777][ C0] ? lock_release+0x1d5/0x250 [ 3640.931781][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3640.931785][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3640.931788][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3640.931792][ C0] ? lock_acquire+0x1c1/0x220 [ 3640.931794][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3640.931799][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3640.931803][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3640.931810][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3640.931813][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3640.931817][ C0] ? __inet_lookup_established+0x341/0x610 [ 3640.931824][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3640.931832][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3640.931836][ C0] ip_local_deliver+0x19d/0x480 [ 3640.931839][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3640.931842][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3640.931847][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3640.931851][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3640.931855][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3640.931858][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3640.931869][ C0] ip_rcv+0x564/0x740 [ 3640.931872][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3640.931875][ C0] ? set_track_prepare+0x8a/0xd0 [ 3640.931880][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3640.931882][ C0] ? rest_init+0x153/0x260 [ 3640.931885][ C0] ? skb_clone+0x10b/0x330 [ 3640.931890][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3640.931897][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3640.931902][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3640.931908][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3640.931917][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3640.931921][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3640.931924][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3640.931928][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3640.931932][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3640.931935][ C0] ? lock_acquire+0x1c1/0x220 [ 3640.931938][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3640.931942][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3640.931945][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3640.931948][ C0] ? __copy_skb_header+0xaf/0x490 [ 3640.931951][ C0] ? __skb_clone+0x57a/0x760 [ 3640.931954][ C0] netif_receive_skb+0x55/0x280 [ 3640.931956][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3640.931964][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3640.931972][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3640.931978][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3640.931983][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3640.931992][ C0] ? hlock_class+0x4e/0x130 [ 3640.931999][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3640.932009][ C0] ? place_entity+0x21/0x2f0 [ 3640.932012][ C0] ? resched_curr+0x219/0x280 [ 3640.932016][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3640.932019][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3640.932025][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3640.932029][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3640.932032][ C0] ? activate_task+0xf5/0x260 [ 3640.932035][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3640.932041][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3640.932044][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3640.932047][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3640.932050][ C0] ? get_stack_info+0x36/0xc0 [ 3640.932054][ C0] ? stack_access_ok+0xda/0x1f0 [ 3640.932056][ C0] ? get_reg+0x119/0x190 [ 3640.932060][ C0] __tcf_classify+0x32c/0x7d0 [ 3640.932064][ C0] tcf_classify+0x283/0x930 [ 3640.932067][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3640.932073][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3640.932075][ C0] ? arch_stack_walk+0x8c/0x100 [ 3640.932082][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3640.932085][ C0] tc_run+0x2e4/0x5d0 [ 3640.932091][ C0] ? __pfx_tc_run+0x10/0x10 [ 3640.932095][ C0] ? lock_acquire+0x1c1/0x220 [ 3640.932097][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3640.932102][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3640.932107][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3640.932110][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3640.932114][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3640.932120][ C0] ? neigh_hh_output+0x348/0x590 [ 3640.932125][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3640.932129][ C0] ip_finish_output2+0x786/0x18e0 [ 3640.932132][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3640.932138][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3640.932145][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3640.932148][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3640.932152][ C0] ? __ip_finish_output+0x10f/0x770 [ 3640.932157][ C0] ip_output+0x16b/0x4f0 [ 3640.932160][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3640.932165][ C0] ? __pfx_ip_output+0x10/0x10 [ 3640.932169][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3640.932173][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3640.932176][ C0] ? ip_local_out+0x114/0x3b0 [ 3640.932180][ C0] __ip_queue_xmit+0x672/0x1910 [ 3640.932185][ C0] ? __skb_clone+0x57a/0x760 [ 3640.932188][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3640.932195][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3640.932199][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3640.932203][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3640.932208][ C0] ? tcp_current_mss+0x40a/0x510 [ 3640.932211][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3640.932214][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3640.932217][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3640.932219][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3640.932222][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3640.932226][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3640.932231][ C0] ? ktime_get+0xb6/0x190 [ 3640.932235][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3640.932239][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3640.932243][ C0] tcp_write_timer+0x82/0x1d0 [ 3640.932247][ C0] call_timer_fn+0x176/0x430 [ 3640.932250][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3640.932255][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3640.932259][ C0] __run_timers.part.0+0x52d/0x890 [ 3640.932262][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3640.932267][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3640.932270][ C0] ? lock_acquire+0x1c1/0x220 [ 3640.932272][ C0] ? clockevents_program_event+0xf6/0x300 [ 3640.932277][ C0] ? lock_release+0x1d5/0x250 [ 3640.932279][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3640.932282][ C0] ? ktime_get+0xb6/0x190 [ 3640.932285][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3640.932289][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3640.932293][ C0] run_timer_softirq+0x72/0x100 [ 3640.932297][ C0] __do_softirq+0x1bc/0x7ff [ 3640.932301][ C0] irq_exit_rcu+0x98/0xc0 [ 3640.932304][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3640.932308][ C0] [ 3640.932309][ C0] [ 3640.932310][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3640.932315][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3640.932318][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3640.932320][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3640.932322][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3640.932324][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3640.932325][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3640.932326][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3640.932328][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3640.932331][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3640.932334][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3640.932338][ C0] default_idle_call+0x69/0xa0 [ 3640.932340][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3640.932343][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3640.932348][ C0] ? lock_release+0x1d5/0x250 [ 3640.932352][ C0] do_idle+0xfb/0x160 [ 3640.932355][ C0] cpu_startup_entry+0x55/0x60 [ 3640.932358][ C0] rest_init+0x153/0x260 [ 3640.932360][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3640.932366][ C0] arch_call_rest_init+0x13/0x40 [ 3640.932371][ C0] start_kernel+0x314/0x3d0 [ 3640.932375][ C0] x86_64_start_reservations+0x18/0x30 [ 3640.932380][ C0] x86_64_start_kernel+0xba/0x110 [ 3640.932384][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3640.932392][ C0] [ 3640.932657][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3640.986749][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3640.987397][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3640.987748][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3640.988778][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3640.989098][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3640.989515][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3640.989931][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3640.990346][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3640.990762][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3640.991179][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3640.991648][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3640.992000][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3640.992422][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3640.992845][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3640.993266][ C1] Call Trace: [ 3640.993444][ C1] [ 3640.993604][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3640.993889][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3640.994154][ C1] ? check_cpu_stall+0x284/0x500 [ 3640.994416][ C1] ? rcu_pending+0x92/0x360 [ 3640.994660][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3640.994943][ C1] ? update_process_times+0xb9/0x110 [ 3640.995226][ C1] ? tick_sched_handle+0x67/0x130 [ 3640.995499][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3640.995802][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3640.996053][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3640.996382][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3640.996669][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3640.996973][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3640.997250][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3640.997566][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3640.997842][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3640.998161][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3640.998474][ C1] [ 3640.998631][ C1] [ 3640.998787][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3640.999116][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3640.999423][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3640.999734][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3641.000035][ C1] ? run_ksoftirqd+0xb/0x60 [ 3641.000277][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3641.000601][ C1] ? __orc_find+0x9c/0xf0 [ 3641.000835][ C1] ? lock_acquire+0x1c1/0x220 [ 3641.001087][ C1] ? irqentry_enter+0x2b/0x60 [ 3641.001343][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3641.001605][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3641.001893][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3641.002195][ C1] ? lock_acquire+0x1c1/0x220 [ 3641.002443][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3641.002695][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3641.002967][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3641.003217][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3641.003478][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3641.003751][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3641.004043][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3641.004337][ C1] ip_local_deliver+0x19d/0x480 [ 3641.004593][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3641.004873][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3641.005136][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3641.005415][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3641.005681][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3641.006013][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3641.006289][ C1] ip_rcv+0x564/0x740 [ 3641.006508][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3641.006752][ C1] ? set_track_prepare+0x8a/0xd0 [ 3641.007024][ C1] ? irqentry_enter+0x2b/0x60 [ 3641.007273][ C1] ? irqentry_enter+0x2b/0x60 [ 3641.007524][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3641.007765][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3641.008077][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3641.008421][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3641.008735][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3641.009072][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3641.009369][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3641.009702][ C1] netif_receive_skb+0x55/0x280 [ 3641.009964][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3641.010295][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3641.010646][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3641.010957][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3641.011249][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3641.011552][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3641.011883][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3641.012166][ C1] ? arch_stack_walk+0x68/0x100 [ 3641.012425][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3641.012699][ C1] ? irqentry_enter+0x2b/0x60 [ 3641.012949][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3641.013268][ C1] ? irqentry_enter+0x2b/0x60 [ 3641.013521][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3641.013845][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3641.014123][ C1] ? arch_stack_walk+0x68/0x100 [ 3641.014384][ C1] __tcf_classify+0x32c/0x7d0 [ 3641.014637][ C1] tcf_classify+0x283/0x930 [ 3641.014881][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3641.015152][ C1] tc_run+0x2e4/0x5d0 [ 3641.015372][ C1] ? __pfx_tc_run+0x10/0x10 [ 3641.015618][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3641.015887][ C1] ? irqentry_enter+0x2b/0x60 [ 3641.016138][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3641.016422][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3641.016741][ C1] ip_finish_output2+0x786/0x18e0 [ 3641.017014][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3641.017305][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3641.017567][ C1] ? __ip_finish_output+0x10f/0x770 [ 3641.017846][ C1] ip_output+0x16b/0x4f0 [ 3641.018076][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3641.018399][ C1] ? __pfx_ip_output+0x10/0x10 [ 3641.018653][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3641.019008][ C1] ? __pfx_ip_output+0x10/0x10 [ 3641.019265][ C1] __ip_queue_xmit+0x672/0x1910 [ 3641.019523][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3641.019800][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3641.020092][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3641.020373][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3641.020666][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3641.020950][ C1] tcp_delack_timer+0x84/0x240 [ 3641.021206][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3641.021494][ C1] call_timer_fn+0x176/0x430 [ 3641.021743][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3641.022015][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3641.022295][ C1] __run_timers.part.0+0x52d/0x890 [ 3641.022569][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3641.022855][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3641.023154][ C1] ? __pfx___schedule+0x10/0x10 [ 3641.023414][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3641.023737][ C1] run_timer_softirq+0x72/0x100 [ 3641.023996][ C1] __do_softirq+0x1bc/0x7ff [ 3641.024240][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3641.024512][ C1] run_ksoftirqd+0x2e/0x60 [ 3641.024753][ C1] smpboot_thread_fn+0x30e/0x840 [ 3641.025015][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3641.025310][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3641.025599][ C1] kthread+0x292/0x360 [ 3641.025817][ C1] ? __pfx_kthread+0x10/0x10 [ 3641.026062][ C1] ret_from_fork+0x34/0x70 [ 3641.026301][ C1] ? __pfx_kthread+0x10/0x10 [ 3641.026544][ C1] ret_from_fork_asm+0x1b/0x30 [ 3641.026807][ C1] [ 3668.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2310s! [swapper/0:0] [ 3668.527930][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3668.529139][ C0] irq event stamp: 27567077 [ 3668.529379][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3668.529912][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3668.530392][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3668.530909][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3668.531413][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3668.531903][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3668.532550][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3668.532892][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3668.533922][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3668.534249][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3668.534671][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3668.535094][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3668.535518][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3668.535940][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3668.536363][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3668.536837][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3668.537194][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3668.537617][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3668.538044][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3668.538475][ C0] Call Trace: [ 3668.538660][ C0] [ 3668.538816][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3668.539100][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3668.539355][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3668.539650][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3668.539935][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3668.540239][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3668.540526][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3668.540846][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3668.541126][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3668.541404][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3668.541732][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3668.542049][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3668.542381][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3668.542689][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3668.543004][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3668.543307][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3668.543636][ C0] ? get_stack_info+0x36/0xc0 [ 3668.543897][ C0] ? lock_acquire+0x1c1/0x220 [ 3668.544155][ C0] ? lock_release+0x1d5/0x250 [ 3668.544411][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3668.544681][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3668.544970][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3668.545273][ C0] ? lock_acquire+0x1c1/0x220 [ 3668.545522][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3668.545772][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3668.546045][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3668.546298][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3668.546561][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3668.546833][ C0] ? __inet_lookup_established+0x341/0x610 [ 3668.547150][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3668.547440][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3668.547731][ C0] ip_local_deliver+0x19d/0x480 [ 3668.547994][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3668.548290][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3668.548555][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3668.548837][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3668.549104][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3668.549440][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3668.549718][ C0] ip_rcv+0x564/0x740 [ 3668.549935][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3668.550182][ C0] ? set_track_prepare+0x8a/0xd0 [ 3668.550451][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3668.550741][ C0] ? rest_init+0x153/0x260 [ 3668.550981][ C0] ? skb_clone+0x10b/0x330 [ 3668.551221][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3668.551560][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3668.551886][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3668.552183][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3668.552490][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3668.552750][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3668.552990][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3668.553303][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3668.553600][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3668.553948][ C0] ? lock_acquire+0x1c1/0x220 [ 3668.554203][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3668.554516][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3668.554813][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3668.555148][ C0] ? __copy_skb_header+0xaf/0x490 [ 3668.555420][ C0] ? __skb_clone+0x57a/0x760 [ 3668.555671][ C0] netif_receive_skb+0x55/0x280 [ 3668.555930][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3668.556259][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3668.556606][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3668.556924][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3668.557211][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3668.557512][ C0] ? hlock_class+0x4e/0x130 [ 3668.557758][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3668.558086][ C0] ? place_entity+0x21/0x2f0 [ 3668.558342][ C0] ? resched_curr+0x219/0x280 [ 3668.558595][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3668.558864][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3668.559144][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3668.559430][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3668.559691][ C0] ? activate_task+0xf5/0x260 [ 3668.559944][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3668.560225][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3668.560499][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3668.560766][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3668.561063][ C0] ? get_stack_info+0x36/0xc0 [ 3668.561315][ C0] ? stack_access_ok+0xda/0x1f0 [ 3668.561574][ C0] ? get_reg+0x119/0x190 [ 3668.561806][ C0] __tcf_classify+0x32c/0x7d0 [ 3668.562066][ C0] tcf_classify+0x283/0x930 [ 3668.562313][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3668.562645][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3668.562916][ C0] ? arch_stack_walk+0x8c/0x100 [ 3668.563177][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3668.563464][ C0] tc_run+0x2e4/0x5d0 [ 3668.563684][ C0] ? __pfx_tc_run+0x10/0x10 [ 3668.563930][ C0] ? lock_acquire+0x1c1/0x220 [ 3668.564183][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3668.564462][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3668.564728][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3668.565016][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3668.565299][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3668.565624][ C0] ? neigh_hh_output+0x348/0x590 [ 3668.565888][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3668.566171][ C0] ip_finish_output2+0x786/0x18e0 [ 3668.566442][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3668.566738][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3668.567091][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3668.567381][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3668.567648][ C0] ? __ip_finish_output+0x10f/0x770 [ 3668.567925][ C0] ip_output+0x16b/0x4f0 [ 3668.568159][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3668.568450][ C0] ? __pfx_ip_output+0x10/0x10 [ 3668.568711][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3668.569013][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3668.569279][ C0] ? ip_local_out+0x114/0x3b0 [ 3668.569529][ C0] __ip_queue_xmit+0x672/0x1910 [ 3668.569789][ C0] ? __skb_clone+0x57a/0x760 [ 3668.570037][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3668.570324][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3668.570623][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3668.570947][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3668.571203][ C0] ? tcp_current_mss+0x40a/0x510 [ 3668.571471][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3668.571753][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3668.572034][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3668.572290][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3668.572557][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3668.572876][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3668.573159][ C0] ? ktime_get+0xb6/0x190 [ 3668.573396][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3668.573679][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3668.573960][ C0] tcp_write_timer+0x82/0x1d0 [ 3668.574216][ C0] call_timer_fn+0x176/0x430 [ 3668.574466][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3668.574739][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3668.575016][ C0] __run_timers.part.0+0x52d/0x890 [ 3668.575289][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3668.575574][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3668.575872][ C0] ? lock_acquire+0x1c1/0x220 [ 3668.576126][ C0] ? clockevents_program_event+0xf6/0x300 [ 3668.576438][ C0] ? lock_release+0x1d5/0x250 [ 3668.576691][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3668.576972][ C0] ? ktime_get+0xb6/0x190 [ 3668.577210][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3668.577514][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3668.577823][ C0] run_timer_softirq+0x72/0x100 [ 3668.578087][ C0] __do_softirq+0x1bc/0x7ff [ 3668.578340][ C0] irq_exit_rcu+0x98/0xc0 [ 3668.578571][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3668.578873][ C0] [ 3668.579034][ C0] [ 3668.579196][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3668.579520][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3668.579787][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3668.580811][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3668.581135][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3668.581557][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3668.581979][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3668.582400][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3668.582820][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3668.583244][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3668.583549][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3668.583824][ C0] default_idle_call+0x69/0xa0 [ 3668.584084][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3668.584346][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3668.584642][ C0] ? lock_release+0x1d5/0x250 [ 3668.584892][ C0] do_idle+0xfb/0x160 [ 3668.585105][ C0] cpu_startup_entry+0x55/0x60 [ 3668.585358][ C0] rest_init+0x153/0x260 [ 3668.585589][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3668.585877][ C0] arch_call_rest_init+0x13/0x40 [ 3668.586144][ C0] start_kernel+0x314/0x3d0 [ 3668.586391][ C0] x86_64_start_reservations+0x18/0x30 [ 3668.586685][ C0] x86_64_start_kernel+0xba/0x110 [ 3668.586952][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3668.587281][ C0] [ 3668.587448][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2310s! [ksoftirqd/1:22] [ 3668.587922][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3668.589132][ C1] irq event stamp: 3886976 [ 3668.589375][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3668.589873][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3668.590366][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3668.590863][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3668.591358][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3668.591855][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3668.592502][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3668.592844][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3668.593867][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3668.594193][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3668.594613][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3668.595037][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3668.595457][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3668.595881][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3668.596304][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3668.596777][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3668.597136][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3668.597559][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3668.597981][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3668.598409][ C1] Call Trace: [ 3668.598588][ C1] [ 3668.598744][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3668.599024][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3668.599281][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3668.599574][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3668.599859][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3668.600162][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3668.600439][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3668.600758][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3668.601038][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3668.601361][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3668.601670][ C1] [ 3668.601829][ C1] [ 3668.601989][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3668.602324][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3668.602629][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3668.602941][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3668.603248][ C1] ? run_ksoftirqd+0xb/0x60 [ 3668.603497][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3668.603827][ C1] ? __orc_find+0x9c/0xf0 [ 3668.604060][ C1] ? lock_acquire+0x1c1/0x220 [ 3668.604309][ C1] ? irqentry_enter+0x2b/0x60 [ 3668.604559][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3668.604820][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3668.605107][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3668.605407][ C1] ? lock_acquire+0x1c1/0x220 [ 3668.605660][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3668.605917][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3668.606196][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3668.606442][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3668.606701][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3668.606974][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3668.607264][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3668.607553][ C1] ip_local_deliver+0x19d/0x480 [ 3668.607816][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3668.608107][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3668.608382][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3668.608663][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3668.608932][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3668.609270][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3668.609548][ C1] ip_rcv+0x564/0x740 [ 3668.609770][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3668.610016][ C1] ? set_track_prepare+0x8a/0xd0 [ 3668.610290][ C1] ? irqentry_enter+0x2b/0x60 [ 3668.610542][ C1] ? irqentry_enter+0x2b/0x60 [ 3668.610795][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3668.611039][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3668.611353][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3668.611692][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3668.612002][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3668.612346][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3668.612648][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3668.612978][ C1] netif_receive_skb+0x55/0x280 [ 3668.613237][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3668.613564][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3668.613912][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3668.614229][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3668.614518][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3668.614820][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3668.615151][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3668.615431][ C1] ? arch_stack_walk+0x68/0x100 [ 3668.615701][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3668.615985][ C1] ? irqentry_enter+0x2b/0x60 [ 3668.616242][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3668.616567][ C1] ? irqentry_enter+0x2b/0x60 [ 3668.616819][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3668.617143][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3668.617427][ C1] ? arch_stack_walk+0x68/0x100 [ 3668.617685][ C1] __tcf_classify+0x32c/0x7d0 [ 3668.617935][ C1] tcf_classify+0x283/0x930 [ 3668.618183][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3668.618457][ C1] tc_run+0x2e4/0x5d0 [ 3668.618680][ C1] ? __pfx_tc_run+0x10/0x10 [ 3668.618928][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3668.619202][ C1] ? irqentry_enter+0x2b/0x60 [ 3668.619454][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3668.619742][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3668.620066][ C1] ip_finish_output2+0x786/0x18e0 [ 3668.620342][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3668.620635][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3668.620900][ C1] ? __ip_finish_output+0x10f/0x770 [ 3668.621184][ C1] ip_output+0x16b/0x4f0 [ 3668.621417][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3668.621739][ C1] ? __pfx_ip_output+0x10/0x10 [ 3668.622001][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3668.622353][ C1] ? __pfx_ip_output+0x10/0x10 [ 3668.622609][ C1] __ip_queue_xmit+0x672/0x1910 [ 3668.622874][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3668.623162][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3668.623461][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3668.623752][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3668.624056][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3668.624347][ C1] tcp_delack_timer+0x84/0x240 [ 3668.624607][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3668.624893][ C1] call_timer_fn+0x176/0x430 [ 3668.625144][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3668.625421][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3668.625698][ C1] __run_timers.part.0+0x52d/0x890 [ 3668.625971][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3668.626266][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3668.626573][ C1] ? __pfx___schedule+0x10/0x10 [ 3668.626831][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3668.627151][ C1] run_timer_softirq+0x72/0x100 [ 3668.627415][ C1] __do_softirq+0x1bc/0x7ff [ 3668.627662][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3668.627943][ C1] run_ksoftirqd+0x2e/0x60 [ 3668.628188][ C1] smpboot_thread_fn+0x30e/0x840 [ 3668.628453][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3668.628751][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3668.629044][ C1] kthread+0x292/0x360 [ 3668.629264][ C1] ? __pfx_kthread+0x10/0x10 [ 3668.629511][ C1] ret_from_fork+0x34/0x70 [ 3668.629753][ C1] ? __pfx_kthread+0x10/0x10 [ 3668.630000][ C1] ret_from_fork_asm+0x1b/0x30 [ 3668.630266][ C1] [ 3696.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2336s! [swapper/0:0] [ 3696.527926][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3696.529137][ C0] irq event stamp: 27567077 [ 3696.529379][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3696.529917][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3696.530392][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3696.530893][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3696.531391][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3696.531874][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3696.532528][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 3696.532869][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 3696.533889][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3696.534212][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3696.534631][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3696.535050][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3696.535469][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3696.535888][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3696.536313][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3696.536780][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3696.537138][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3696.537560][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3696.537980][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3696.538406][ C0] Call Trace: [ 3696.538584][ C0] [ 3696.538739][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3696.539018][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3696.539273][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3696.539566][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3696.539849][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3696.540149][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3696.540426][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3696.540744][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3696.541020][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3696.541297][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3696.541624][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3696.541939][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3696.542269][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3696.542577][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 3696.542883][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3696.543190][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3696.543518][ C0] ? get_stack_info+0x36/0xc0 [ 3696.543771][ C0] ? lock_acquire+0x1c1/0x220 [ 3696.544024][ C0] ? lock_release+0x1d5/0x250 [ 3696.544274][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3696.544535][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3696.544820][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3696.545118][ C0] ? lock_acquire+0x1c1/0x220 [ 3696.545369][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3696.545625][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3696.545901][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3696.546149][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3696.546407][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3696.546675][ C0] ? __inet_lookup_established+0x341/0x610 [ 3696.546990][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3696.547285][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3696.547578][ C0] ip_local_deliver+0x19d/0x480 [ 3696.547838][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3696.548130][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3696.548398][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3696.548675][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3696.548937][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3696.549278][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3696.549552][ C0] ip_rcv+0x564/0x740 [ 3696.549764][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3696.550003][ C0] ? set_track_prepare+0x8a/0xd0 [ 3696.550267][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3696.550560][ C0] ? rest_init+0x153/0x260 [ 3696.550795][ C0] ? skb_clone+0x10b/0x330 [ 3696.551038][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3696.551372][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3696.551691][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3696.551994][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3696.552305][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3696.552568][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3696.552817][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3696.553138][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3696.553439][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3696.553779][ C0] ? lock_acquire+0x1c1/0x220 [ 3696.554027][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3696.554341][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3696.554643][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3696.554976][ C0] ? __copy_skb_header+0xaf/0x490 [ 3696.555245][ C0] ? __skb_clone+0x57a/0x760 [ 3696.555492][ C0] netif_receive_skb+0x55/0x280 [ 3696.555757][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3696.556087][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3696.556438][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3696.556748][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3696.557039][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3696.557343][ C0] ? hlock_class+0x4e/0x130 [ 3696.557592][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3696.557925][ C0] ? place_entity+0x21/0x2f0 [ 3696.558187][ C0] ? resched_curr+0x219/0x280 [ 3696.558444][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3696.558714][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3696.558999][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3696.559275][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3696.559533][ C0] ? activate_task+0xf5/0x260 [ 3696.559783][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3696.560059][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3696.560334][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3696.560592][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3696.560888][ C0] ? get_stack_info+0x36/0xc0 [ 3696.561145][ C0] ? stack_access_ok+0xda/0x1f0 [ 3696.561406][ C0] ? get_reg+0x119/0x190 [ 3696.561636][ C0] __tcf_classify+0x32c/0x7d0 [ 3696.561888][ C0] tcf_classify+0x283/0x930 [ 3696.562129][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3696.562454][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3696.562726][ C0] ? arch_stack_walk+0x8c/0x100 [ 3696.562992][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3696.563285][ C0] tc_run+0x2e4/0x5d0 [ 3696.563499][ C0] ? __pfx_tc_run+0x10/0x10 [ 3696.563739][ C0] ? lock_acquire+0x1c1/0x220 [ 3696.563986][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3696.564261][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3696.564530][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3696.564814][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3696.565090][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3696.565414][ C0] ? neigh_hh_output+0x348/0x590 [ 3696.565684][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3696.565963][ C0] ip_finish_output2+0x786/0x18e0 [ 3696.566232][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3696.566522][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3696.566880][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3696.567173][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3696.567438][ C0] ? __ip_finish_output+0x10f/0x770 [ 3696.567719][ C0] ip_output+0x16b/0x4f0 [ 3696.567948][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3696.568240][ C0] ? __pfx_ip_output+0x10/0x10 [ 3696.568495][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3696.568800][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3696.569063][ C0] ? ip_local_out+0x114/0x3b0 [ 3696.569318][ C0] __ip_queue_xmit+0x672/0x1910 [ 3696.569582][ C0] ? __skb_clone+0x57a/0x760 [ 3696.569832][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3696.570112][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3696.570404][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3696.570721][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3696.570981][ C0] ? tcp_current_mss+0x40a/0x510 [ 3696.571244][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3696.571529][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3696.571804][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3696.572057][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3696.572330][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3696.572650][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3696.572926][ C0] ? ktime_get+0xb6/0x190 [ 3696.573159][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3696.573433][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3696.573718][ C0] tcp_write_timer+0x82/0x1d0 [ 3696.573967][ C0] call_timer_fn+0x176/0x430 [ 3696.574213][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3696.574495][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3696.574769][ C0] __run_timers.part.0+0x52d/0x890 [ 3696.575048][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3696.575331][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3696.575632][ C0] ? lock_acquire+0x1c1/0x220 [ 3696.575878][ C0] ? clockevents_program_event+0xf6/0x300 [ 3696.576186][ C0] ? lock_release+0x1d5/0x250 [ 3696.576437][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3696.576715][ C0] ? ktime_get+0xb6/0x190 [ 3696.576946][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3696.577246][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3696.577560][ C0] run_timer_softirq+0x72/0x100 [ 3696.577823][ C0] __do_softirq+0x1bc/0x7ff [ 3696.578071][ C0] irq_exit_rcu+0x98/0xc0 [ 3696.578308][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3696.578611][ C0] [ 3696.578767][ C0] [ 3696.578925][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3696.579248][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3696.579519][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3696.580549][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3696.580883][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3696.581307][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3696.581734][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3696.582165][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3696.582586][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3696.583010][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3696.583318][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3696.583594][ C0] default_idle_call+0x69/0xa0 [ 3696.583848][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3696.584115][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3696.584407][ C0] ? lock_release+0x1d5/0x250 [ 3696.584660][ C0] do_idle+0xfb/0x160 [ 3696.584874][ C0] cpu_startup_entry+0x55/0x60 [ 3696.585129][ C0] rest_init+0x153/0x260 [ 3696.585354][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3696.585646][ C0] arch_call_rest_init+0x13/0x40 [ 3696.585913][ C0] start_kernel+0x314/0x3d0 [ 3696.586154][ C0] x86_64_start_reservations+0x18/0x30 [ 3696.586443][ C0] x86_64_start_kernel+0xba/0x110 [ 3696.586715][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3696.587046][ C0] [ 3696.587214][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2336s! [ksoftirqd/1:22] [ 3696.587690][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3696.588895][ C1] irq event stamp: 3886976 [ 3696.589134][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3696.589636][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3696.590136][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3696.590638][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3696.591129][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3696.591626][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3696.592274][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3696.592621][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3696.593648][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3696.593973][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3696.594401][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3696.594822][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3696.595246][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3696.595672][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3696.596103][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3696.596578][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3696.596928][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3696.597360][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3696.597781][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3696.598207][ C1] Call Trace: [ 3696.598388][ C1] [ 3696.598548][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3696.598824][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3696.599083][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3696.599373][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3696.599660][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3696.599965][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3696.600247][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3696.600572][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3696.600846][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3696.601173][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3696.601487][ C1] [ 3696.601643][ C1] [ 3696.601799][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3696.602128][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3696.602435][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3696.602747][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3696.603051][ C1] ? run_ksoftirqd+0xb/0x60 [ 3696.603294][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3696.603619][ C1] ? __orc_find+0x9c/0xf0 [ 3696.603853][ C1] ? lock_acquire+0x1c1/0x220 [ 3696.604107][ C1] ? irqentry_enter+0x2b/0x60 [ 3696.604361][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3696.604627][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3696.604916][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3696.605220][ C1] ? lock_acquire+0x1c1/0x220 [ 3696.605470][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3696.605724][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3696.605996][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3696.606246][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3696.606507][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3696.606782][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3696.607074][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3696.607366][ C1] ip_local_deliver+0x19d/0x480 [ 3696.607622][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3696.607903][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3696.608175][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3696.608452][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3696.608715][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3696.609054][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3696.609327][ C1] ip_rcv+0x564/0x740 [ 3696.609540][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3696.609779][ C1] ? set_track_prepare+0x8a/0xd0 [ 3696.610044][ C1] ? irqentry_enter+0x2b/0x60 [ 3696.610299][ C1] ? irqentry_enter+0x2b/0x60 [ 3696.610554][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3696.610802][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3696.611121][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3696.611464][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3696.611777][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3696.612116][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3696.612413][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3696.612748][ C1] netif_receive_skb+0x55/0x280 [ 3696.613010][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3696.613341][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3696.613694][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3696.614006][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3696.614297][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3696.614601][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3696.614932][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3696.615217][ C1] ? arch_stack_walk+0x68/0x100 [ 3696.615478][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3696.615752][ C1] ? irqentry_enter+0x2b/0x60 [ 3696.616002][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3696.616324][ C1] ? irqentry_enter+0x2b/0x60 [ 3696.616579][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3696.616902][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3696.617182][ C1] ? arch_stack_walk+0x68/0x100 [ 3696.617447][ C1] __tcf_classify+0x32c/0x7d0 [ 3696.617700][ C1] tcf_classify+0x283/0x930 [ 3696.617945][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3696.618222][ C1] tc_run+0x2e4/0x5d0 [ 3696.618437][ C1] ? __pfx_tc_run+0x10/0x10 [ 3696.618679][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3696.618946][ C1] ? irqentry_enter+0x2b/0x60 [ 3696.619203][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3696.619495][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3696.619817][ C1] ip_finish_output2+0x786/0x18e0 [ 3696.620087][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3696.620377][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3696.620643][ C1] ? __ip_finish_output+0x10f/0x770 [ 3696.620919][ C1] ip_output+0x16b/0x4f0 [ 3696.621149][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3696.621470][ C1] ? __pfx_ip_output+0x10/0x10 [ 3696.621725][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3696.622082][ C1] ? __pfx_ip_output+0x10/0x10 [ 3696.622342][ C1] __ip_queue_xmit+0x672/0x1910 [ 3696.622602][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3696.622881][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3696.623175][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3696.623458][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3696.623754][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3696.624040][ C1] tcp_delack_timer+0x84/0x240 [ 3696.624297][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3696.624587][ C1] call_timer_fn+0x176/0x430 [ 3696.624838][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3696.625114][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3696.625394][ C1] __run_timers.part.0+0x52d/0x890 [ 3696.625670][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3696.625958][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3696.626259][ C1] ? __pfx___schedule+0x10/0x10 [ 3696.626520][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3696.626844][ C1] run_timer_softirq+0x72/0x100 [ 3696.627104][ C1] __do_softirq+0x1bc/0x7ff [ 3696.627345][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3696.627618][ C1] run_ksoftirqd+0x2e/0x60 [ 3696.627860][ C1] smpboot_thread_fn+0x30e/0x840 [ 3696.628128][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3696.628418][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3696.628713][ C1] kthread+0x292/0x360 [ 3696.628931][ C1] ? __pfx_kthread+0x10/0x10 [ 3696.629185][ C1] ret_from_fork+0x34/0x70 [ 3696.629423][ C1] ? __pfx_kthread+0x10/0x10 [ 3696.629671][ C1] ret_from_fork_asm+0x1b/0x30 [ 3696.629930][ C1] [ 3719.028027][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3719.028410][ C1] rcu: 1-....: (2518347 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=598507 [ 3719.029002][ C1] rcu: (t=2524719 jiffies g=1007429 q=31 ncpus=4) [ 3719.029347][ C1] Sending NMI from CPU 1 to CPUs 0: [ 3719.029637][ C0] NMI backtrace for cpu 0 [ 3719.029646][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3719.029651][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3719.029654][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3719.029664][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3719.029668][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3719.029672][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3719.029673][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3719.029675][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3719.029678][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3719.029679][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3719.029681][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3719.029683][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3719.029687][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3719.029689][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3719.029690][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3719.029692][ C0] Call Trace: [ 3719.029696][ C0] [ 3719.029700][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 3719.029706][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3719.029712][ C0] ? nmi_handle+0x156/0x420 [ 3719.029717][ C0] ? default_do_nmi+0x41/0x100 [ 3719.029721][ C0] ? exc_nmi+0xf3/0x120 [ 3719.029724][ C0] ? end_repeat_nmi+0xf/0x60 [ 3719.029728][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3719.029732][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3719.029735][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3719.029739][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3719.029742][ C0] [ 3719.029743][ C0] [ 3719.029745][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3719.029748][ C0] ? get_stack_info+0x36/0xc0 [ 3719.029753][ C0] ? lock_acquire+0x1c1/0x220 [ 3719.029759][ C0] ? lock_release+0x1d5/0x250 [ 3719.029762][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3719.029767][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3719.029770][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3719.029773][ C0] ? lock_acquire+0x1c1/0x220 [ 3719.029775][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3719.029782][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3719.029786][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3719.029793][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3719.029796][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3719.029801][ C0] ? __inet_lookup_established+0x341/0x610 [ 3719.029807][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3719.029815][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3719.029819][ C0] ip_local_deliver+0x19d/0x480 [ 3719.029822][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3719.029825][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3719.029830][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3719.029834][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3719.029837][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3719.029841][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3719.029852][ C0] ip_rcv+0x564/0x740 [ 3719.029856][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3719.029858][ C0] ? set_track_prepare+0x8a/0xd0 [ 3719.029864][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3719.029866][ C0] ? rest_init+0x153/0x260 [ 3719.029869][ C0] ? skb_clone+0x10b/0x330 [ 3719.029875][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3719.029881][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3719.029887][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3719.029891][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3719.029901][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3719.029904][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3719.029906][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3719.029912][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3719.029915][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3719.029919][ C0] ? lock_acquire+0x1c1/0x220 [ 3719.029921][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3719.029924][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3719.029927][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3719.029931][ C0] ? __copy_skb_header+0xaf/0x490 [ 3719.029934][ C0] ? __skb_clone+0x57a/0x760 [ 3719.029936][ C0] netif_receive_skb+0x55/0x280 [ 3719.029939][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3719.029947][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3719.029954][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3719.029961][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3719.029966][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3719.029975][ C0] ? hlock_class+0x4e/0x130 [ 3719.029981][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3719.029991][ C0] ? place_entity+0x21/0x2f0 [ 3719.029994][ C0] ? resched_curr+0x219/0x280 [ 3719.029998][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3719.030001][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3719.030005][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3719.030010][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3719.030012][ C0] ? activate_task+0xf5/0x260 [ 3719.030015][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3719.030022][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3719.030026][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3719.030029][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3719.030032][ C0] ? get_stack_info+0x36/0xc0 [ 3719.030036][ C0] ? stack_access_ok+0xda/0x1f0 [ 3719.030038][ C0] ? get_reg+0x119/0x190 [ 3719.030041][ C0] __tcf_classify+0x32c/0x7d0 [ 3719.030046][ C0] tcf_classify+0x283/0x930 [ 3719.030049][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3719.030054][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3719.030056][ C0] ? arch_stack_walk+0x8c/0x100 [ 3719.030061][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3719.030064][ C0] tc_run+0x2e4/0x5d0 [ 3719.030069][ C0] ? __pfx_tc_run+0x10/0x10 [ 3719.030072][ C0] ? lock_acquire+0x1c1/0x220 [ 3719.030074][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3719.030079][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3719.030085][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3719.030088][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3719.030091][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3719.030096][ C0] ? neigh_hh_output+0x348/0x590 [ 3719.030100][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3719.030104][ C0] ip_finish_output2+0x786/0x18e0 [ 3719.030107][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3719.030114][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3719.030121][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3719.030124][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3719.030128][ C0] ? __ip_finish_output+0x10f/0x770 [ 3719.030133][ C0] ip_output+0x16b/0x4f0 [ 3719.030136][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3719.030141][ C0] ? __pfx_ip_output+0x10/0x10 [ 3719.030144][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3719.030149][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3719.030152][ C0] ? ip_local_out+0x114/0x3b0 [ 3719.030156][ C0] __ip_queue_xmit+0x672/0x1910 [ 3719.030160][ C0] ? __skb_clone+0x57a/0x760 [ 3719.030163][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3719.030171][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3719.030176][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3719.030180][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3719.030185][ C0] ? tcp_current_mss+0x40a/0x510 [ 3719.030188][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3719.030191][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3719.030194][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3719.030196][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3719.030199][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3719.030203][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3719.030208][ C0] ? ktime_get+0xb6/0x190 [ 3719.030212][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3719.030216][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3719.030219][ C0] tcp_write_timer+0x82/0x1d0 [ 3719.030223][ C0] call_timer_fn+0x176/0x430 [ 3719.030227][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3719.030232][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3719.030236][ C0] __run_timers.part.0+0x52d/0x890 [ 3719.030239][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3719.030244][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3719.030247][ C0] ? lock_acquire+0x1c1/0x220 [ 3719.030249][ C0] ? clockevents_program_event+0xf6/0x300 [ 3719.030254][ C0] ? lock_release+0x1d5/0x250 [ 3719.030256][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3719.030259][ C0] ? ktime_get+0xb6/0x190 [ 3719.030262][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3719.030265][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3719.030270][ C0] run_timer_softirq+0x72/0x100 [ 3719.030273][ C0] __do_softirq+0x1bc/0x7ff [ 3719.030278][ C0] irq_exit_rcu+0x98/0xc0 [ 3719.030281][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3719.030285][ C0] [ 3719.030286][ C0] [ 3719.030287][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3719.030292][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3719.030296][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3719.030298][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3719.030300][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3719.030302][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3719.030303][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3719.030305][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3719.030306][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3719.030310][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3719.030313][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3719.030317][ C0] default_idle_call+0x69/0xa0 [ 3719.030319][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3719.030322][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3719.030327][ C0] ? lock_release+0x1d5/0x250 [ 3719.030331][ C0] do_idle+0xfb/0x160 [ 3719.030334][ C0] cpu_startup_entry+0x55/0x60 [ 3719.030337][ C0] rest_init+0x153/0x260 [ 3719.030339][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3719.030345][ C0] arch_call_rest_init+0x13/0x40 [ 3719.030351][ C0] start_kernel+0x314/0x3d0 [ 3719.030355][ C0] x86_64_start_reservations+0x18/0x30 [ 3719.030360][ C0] x86_64_start_kernel+0xba/0x110 [ 3719.030364][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3719.030372][ C0] [ 3719.030632][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3719.084582][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3719.085228][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3719.085572][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3719.086589][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3719.086913][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3719.087331][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3719.087748][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3719.088171][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3719.088596][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3719.089023][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3719.089499][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3719.089848][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3719.090277][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3719.090696][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3719.091114][ C1] Call Trace: [ 3719.091289][ C1] [ 3719.091444][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3719.091733][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3719.091995][ C1] ? check_cpu_stall+0x284/0x500 [ 3719.092264][ C1] ? rcu_pending+0x92/0x360 [ 3719.092507][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3719.092788][ C1] ? update_process_times+0xb9/0x110 [ 3719.093075][ C1] ? tick_sched_handle+0x67/0x130 [ 3719.093343][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3719.093640][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3719.093896][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3719.094223][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3719.094513][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3719.094819][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3719.095102][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3719.095424][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3719.095698][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3719.096024][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3719.096337][ C1] [ 3719.096496][ C1] [ 3719.096653][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3719.096984][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3719.097291][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3719.097605][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3719.097906][ C1] ? run_ksoftirqd+0xb/0x60 [ 3719.098158][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3719.098488][ C1] ? __orc_find+0x9c/0xf0 [ 3719.098718][ C1] ? lock_acquire+0x1c1/0x220 [ 3719.098967][ C1] ? irqentry_enter+0x2b/0x60 [ 3719.099217][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3719.099476][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3719.099761][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3719.100059][ C1] ? lock_acquire+0x1c1/0x220 [ 3719.100310][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3719.100566][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3719.100842][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3719.101086][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3719.101344][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3719.101613][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3719.101900][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3719.102188][ C1] ip_local_deliver+0x19d/0x480 [ 3719.102450][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3719.102738][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3719.103007][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3719.103285][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3719.103548][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3719.103887][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3719.104160][ C1] ip_rcv+0x564/0x740 [ 3719.104374][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3719.104616][ C1] ? set_track_prepare+0x8a/0xd0 [ 3719.104881][ C1] ? irqentry_enter+0x2b/0x60 [ 3719.105135][ C1] ? irqentry_enter+0x2b/0x60 [ 3719.105388][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3719.105634][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3719.105950][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3719.106294][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3719.106606][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3719.106944][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3719.107242][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3719.107577][ C1] netif_receive_skb+0x55/0x280 [ 3719.107842][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3719.108174][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3719.108522][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3719.108837][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3719.109124][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3719.109423][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3719.109748][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3719.110026][ C1] ? arch_stack_walk+0x68/0x100 [ 3719.110292][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3719.110571][ C1] ? irqentry_enter+0x2b/0x60 [ 3719.110825][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3719.111149][ C1] ? irqentry_enter+0x2b/0x60 [ 3719.111400][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3719.111720][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3719.112003][ C1] ? arch_stack_walk+0x68/0x100 [ 3719.112261][ C1] __tcf_classify+0x32c/0x7d0 [ 3719.112511][ C1] tcf_classify+0x283/0x930 [ 3719.112751][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3719.113020][ C1] tc_run+0x2e4/0x5d0 [ 3719.113236][ C1] ? __pfx_tc_run+0x10/0x10 [ 3719.113485][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3719.113751][ C1] ? irqentry_enter+0x2b/0x60 [ 3719.114004][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3719.114293][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3719.114619][ C1] ip_finish_output2+0x786/0x18e0 [ 3719.114888][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3719.115177][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3719.115444][ C1] ? __ip_finish_output+0x10f/0x770 [ 3719.115720][ C1] ip_output+0x16b/0x4f0 [ 3719.115947][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3719.116270][ C1] ? __pfx_ip_output+0x10/0x10 [ 3719.116527][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3719.116880][ C1] ? __pfx_ip_output+0x10/0x10 [ 3719.117138][ C1] __ip_queue_xmit+0x672/0x1910 [ 3719.117399][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3719.117678][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3719.117975][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3719.118267][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3719.118566][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3719.118855][ C1] tcp_delack_timer+0x84/0x240 [ 3719.119114][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3719.119399][ C1] call_timer_fn+0x176/0x430 [ 3719.119647][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3719.119922][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3719.120197][ C1] __run_timers.part.0+0x52d/0x890 [ 3719.120473][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3719.120764][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3719.121066][ C1] ? __pfx___schedule+0x10/0x10 [ 3719.121323][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3719.121643][ C1] run_timer_softirq+0x72/0x100 [ 3719.121904][ C1] __do_softirq+0x1bc/0x7ff [ 3719.122150][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3719.122426][ C1] run_ksoftirqd+0x2e/0x60 [ 3719.122662][ C1] smpboot_thread_fn+0x30e/0x840 [ 3719.122930][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3719.123222][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3719.123515][ C1] kthread+0x292/0x360 [ 3719.123731][ C1] ? __pfx_kthread+0x10/0x10 [ 3719.123979][ C1] ret_from_fork+0x34/0x70 [ 3719.124218][ C1] ? __pfx_kthread+0x10/0x10 [ 3719.124467][ C1] ret_from_fork_asm+0x1b/0x30 [ 3719.124727][ C1] [ 3744.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2381s! [swapper/0:0] [ 3744.527929][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3744.529136][ C0] irq event stamp: 27567077 [ 3744.529379][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3744.529912][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3744.530388][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3744.530891][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3744.531385][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3744.531862][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3744.532509][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3744.532852][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3744.533883][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3744.534211][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3744.534632][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3744.535060][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3744.535487][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3744.535907][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3744.536328][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3744.536801][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3744.537149][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3744.537572][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3744.537997][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3744.538423][ C0] Call Trace: [ 3744.538610][ C0] [ 3744.538766][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3744.539041][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3744.539298][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3744.539586][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3744.539884][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3744.540192][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3744.540473][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3744.540794][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3744.541066][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3744.541345][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3744.541667][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3744.541976][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3744.542311][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3744.542613][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3744.542922][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3744.543229][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3744.543559][ C0] ? get_stack_info+0x36/0xc0 [ 3744.543813][ C0] ? lock_acquire+0x1c1/0x220 [ 3744.544066][ C0] ? lock_release+0x1d5/0x250 [ 3744.544316][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3744.544575][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3744.544857][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3744.545154][ C0] ? lock_acquire+0x1c1/0x220 [ 3744.545407][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3744.545665][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3744.545942][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3744.546187][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3744.546445][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3744.546714][ C0] ? __inet_lookup_established+0x341/0x610 [ 3744.547025][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3744.547316][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3744.547611][ C0] ip_local_deliver+0x19d/0x480 [ 3744.547875][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3744.548164][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3744.548433][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3744.548709][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3744.548971][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3744.549309][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3744.549583][ C0] ip_rcv+0x564/0x740 [ 3744.549795][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3744.550035][ C0] ? set_track_prepare+0x8a/0xd0 [ 3744.550300][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3744.550590][ C0] ? rest_init+0x153/0x260 [ 3744.550826][ C0] ? skb_clone+0x10b/0x330 [ 3744.551070][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3744.551403][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3744.551724][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3744.552023][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3744.552339][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3744.552604][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3744.552848][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3744.553165][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3744.553463][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3744.553801][ C0] ? lock_acquire+0x1c1/0x220 [ 3744.554051][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3744.554360][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3744.554659][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3744.554986][ C0] ? __copy_skb_header+0xaf/0x490 [ 3744.555253][ C0] ? __skb_clone+0x57a/0x760 [ 3744.555500][ C0] netif_receive_skb+0x55/0x280 [ 3744.555762][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3744.556098][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3744.556447][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3744.556761][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3744.557053][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3744.557358][ C0] ? hlock_class+0x4e/0x130 [ 3744.557607][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3744.557944][ C0] ? place_entity+0x21/0x2f0 [ 3744.558191][ C0] ? resched_curr+0x219/0x280 [ 3744.558443][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3744.558712][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3744.558997][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3744.559274][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3744.559530][ C0] ? activate_task+0xf5/0x260 [ 3744.559779][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3744.560052][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3744.560327][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3744.560587][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3744.560876][ C0] ? get_stack_info+0x36/0xc0 [ 3744.561131][ C0] ? stack_access_ok+0xda/0x1f0 [ 3744.561391][ C0] ? get_reg+0x119/0x190 [ 3744.561621][ C0] __tcf_classify+0x32c/0x7d0 [ 3744.561872][ C0] tcf_classify+0x283/0x930 [ 3744.562116][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3744.562442][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3744.562713][ C0] ? arch_stack_walk+0x8c/0x100 [ 3744.562976][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3744.563267][ C0] tc_run+0x2e4/0x5d0 [ 3744.563481][ C0] ? __pfx_tc_run+0x10/0x10 [ 3744.563721][ C0] ? lock_acquire+0x1c1/0x220 [ 3744.563968][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3744.564241][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3744.564508][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3744.564791][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3744.565068][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3744.565389][ C0] ? neigh_hh_output+0x348/0x590 [ 3744.565656][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3744.565931][ C0] ip_finish_output2+0x786/0x18e0 [ 3744.566198][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3744.566490][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3744.566845][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3744.567137][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3744.567399][ C0] ? __ip_finish_output+0x10f/0x770 [ 3744.567679][ C0] ip_output+0x16b/0x4f0 [ 3744.567918][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3744.568205][ C0] ? __pfx_ip_output+0x10/0x10 [ 3744.568460][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3744.568762][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3744.569024][ C0] ? ip_local_out+0x114/0x3b0 [ 3744.569280][ C0] __ip_queue_xmit+0x672/0x1910 [ 3744.569546][ C0] ? __skb_clone+0x57a/0x760 [ 3744.569796][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3744.570074][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3744.570368][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3744.570684][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3744.570942][ C0] ? tcp_current_mss+0x40a/0x510 [ 3744.571205][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3744.571490][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3744.571763][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3744.572016][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3744.572288][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3744.572612][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3744.572891][ C0] ? ktime_get+0xb6/0x190 [ 3744.573123][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3744.573396][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3744.573679][ C0] tcp_write_timer+0x82/0x1d0 [ 3744.573930][ C0] call_timer_fn+0x176/0x430 [ 3744.574177][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3744.574454][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3744.574727][ C0] __run_timers.part.0+0x52d/0x890 [ 3744.575001][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3744.575282][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3744.575583][ C0] ? lock_acquire+0x1c1/0x220 [ 3744.575833][ C0] ? clockevents_program_event+0xf6/0x300 [ 3744.576138][ C0] ? lock_release+0x1d5/0x250 [ 3744.576385][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3744.576660][ C0] ? ktime_get+0xb6/0x190 [ 3744.576890][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3744.577189][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3744.577503][ C0] run_timer_softirq+0x72/0x100 [ 3744.577767][ C0] __do_softirq+0x1bc/0x7ff [ 3744.578044][ C0] irq_exit_rcu+0x98/0xc0 [ 3744.578280][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3744.578583][ C0] [ 3744.578739][ C0] [ 3744.578895][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3744.579213][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3744.579487][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3744.580520][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3744.580843][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3744.581267][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3744.581691][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3744.582110][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3744.582529][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3744.582952][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3744.583260][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3744.583535][ C0] default_idle_call+0x69/0xa0 [ 3744.583790][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3744.584057][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3744.584346][ C0] ? lock_release+0x1d5/0x250 [ 3744.584598][ C0] do_idle+0xfb/0x160 [ 3744.584814][ C0] cpu_startup_entry+0x55/0x60 [ 3744.585073][ C0] rest_init+0x153/0x260 [ 3744.585298][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3744.585586][ C0] arch_call_rest_init+0x13/0x40 [ 3744.585854][ C0] start_kernel+0x314/0x3d0 [ 3744.586100][ C0] x86_64_start_reservations+0x18/0x30 [ 3744.586390][ C0] x86_64_start_kernel+0xba/0x110 [ 3744.586662][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3744.586994][ C0] [ 3744.587162][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2381s! [ksoftirqd/1:22] [ 3744.587627][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3744.588824][ C1] irq event stamp: 3886976 [ 3744.589058][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3744.589561][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3744.590058][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3744.590556][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3744.591044][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3744.591539][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3744.592190][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3744.592534][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3744.593567][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3744.593897][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3744.594320][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3744.594744][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3744.595171][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3744.595600][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3744.596024][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3744.596497][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3744.596846][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3744.597271][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3744.597694][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3744.598120][ C1] Call Trace: [ 3744.598305][ C1] [ 3744.598464][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3744.598739][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3744.598997][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3744.599286][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3744.599573][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3744.599883][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3744.600167][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3744.600491][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3744.600767][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3744.601094][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3744.601407][ C1] [ 3744.601567][ C1] [ 3744.601724][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3744.602056][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3744.602362][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3744.602678][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3744.602980][ C1] ? run_ksoftirqd+0xb/0x60 [ 3744.603223][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3744.603554][ C1] ? __orc_find+0x9c/0xf0 [ 3744.603786][ C1] ? lock_acquire+0x1c1/0x220 [ 3744.604042][ C1] ? irqentry_enter+0x2b/0x60 [ 3744.604298][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3744.604564][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3744.604854][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3744.605156][ C1] ? lock_acquire+0x1c1/0x220 [ 3744.605403][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3744.605654][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3744.605927][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3744.606177][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3744.606442][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3744.606714][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3744.607004][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3744.607297][ C1] ip_local_deliver+0x19d/0x480 [ 3744.607555][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3744.607844][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3744.608114][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3744.608392][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3744.608656][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3744.608998][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3744.609273][ C1] ip_rcv+0x564/0x740 [ 3744.609487][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3744.609730][ C1] ? set_track_prepare+0x8a/0xd0 [ 3744.609995][ C1] ? irqentry_enter+0x2b/0x60 [ 3744.610248][ C1] ? irqentry_enter+0x2b/0x60 [ 3744.610501][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3744.610747][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3744.611064][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3744.611408][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3744.611720][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3744.612059][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3744.612355][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3744.612691][ C1] netif_receive_skb+0x55/0x280 [ 3744.612956][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3744.613287][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3744.613638][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3744.613950][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3744.614242][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3744.614547][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3744.614882][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3744.615166][ C1] ? arch_stack_walk+0x68/0x100 [ 3744.615426][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3744.615702][ C1] ? irqentry_enter+0x2b/0x60 [ 3744.615951][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3744.616275][ C1] ? irqentry_enter+0x2b/0x60 [ 3744.616531][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3744.616854][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3744.617134][ C1] ? arch_stack_walk+0x68/0x100 [ 3744.617397][ C1] __tcf_classify+0x32c/0x7d0 [ 3744.617654][ C1] tcf_classify+0x283/0x930 [ 3744.617906][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3744.618176][ C1] tc_run+0x2e4/0x5d0 [ 3744.618393][ C1] ? __pfx_tc_run+0x10/0x10 [ 3744.618639][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3744.618906][ C1] ? irqentry_enter+0x2b/0x60 [ 3744.619161][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3744.619449][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3744.619777][ C1] ip_finish_output2+0x786/0x18e0 [ 3744.620048][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3744.620335][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3744.620603][ C1] ? __ip_finish_output+0x10f/0x770 [ 3744.620880][ C1] ip_output+0x16b/0x4f0 [ 3744.621108][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3744.621431][ C1] ? __pfx_ip_output+0x10/0x10 [ 3744.621689][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3744.622046][ C1] ? __pfx_ip_output+0x10/0x10 [ 3744.622303][ C1] __ip_queue_xmit+0x672/0x1910 [ 3744.622564][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3744.622844][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3744.623140][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3744.623427][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3744.623723][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3744.624009][ C1] tcp_delack_timer+0x84/0x240 [ 3744.624265][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3744.624554][ C1] call_timer_fn+0x176/0x430 [ 3744.624809][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3744.625085][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3744.625365][ C1] __run_timers.part.0+0x52d/0x890 [ 3744.625640][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3744.625929][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3744.626230][ C1] ? __pfx___schedule+0x10/0x10 [ 3744.626492][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3744.626814][ C1] run_timer_softirq+0x72/0x100 [ 3744.627072][ C1] __do_softirq+0x1bc/0x7ff [ 3744.627313][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3744.627587][ C1] run_ksoftirqd+0x2e/0x60 [ 3744.627838][ C1] smpboot_thread_fn+0x30e/0x840 [ 3744.628107][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3744.628402][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3744.628695][ C1] kthread+0x292/0x360 [ 3744.628918][ C1] ? __pfx_kthread+0x10/0x10 [ 3744.629168][ C1] ret_from_fork+0x34/0x70 [ 3744.629406][ C1] ? __pfx_kthread+0x10/0x10 [ 3744.629655][ C1] ret_from_fork_asm+0x1b/0x30 [ 3744.629915][ C1] [ 3772.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2407s! [swapper/0:0] [ 3772.527935][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3772.529146][ C0] irq event stamp: 27567077 [ 3772.529388][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3772.529920][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3772.530394][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3772.530897][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3772.531391][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3772.531868][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3772.532518][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3772.532862][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3772.533891][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3772.534218][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3772.534645][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3772.535071][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3772.535493][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3772.535915][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3772.536342][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3772.536819][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3772.537167][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3772.537595][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3772.538026][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3772.538452][ C0] Call Trace: [ 3772.538635][ C0] [ 3772.538793][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3772.539069][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3772.539330][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3772.539620][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3772.539910][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3772.540214][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3772.540495][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3772.540820][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3772.541093][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3772.541373][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3772.541697][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3772.542007][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3772.542342][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3772.542644][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3772.542953][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3772.543259][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3772.543588][ C0] ? get_stack_info+0x36/0xc0 [ 3772.543840][ C0] ? lock_acquire+0x1c1/0x220 [ 3772.544091][ C0] ? lock_release+0x1d5/0x250 [ 3772.544340][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3772.544597][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3772.544880][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3772.545179][ C0] ? lock_acquire+0x1c1/0x220 [ 3772.545433][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3772.545691][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3772.545965][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3772.546211][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3772.546466][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3772.546735][ C0] ? __inet_lookup_established+0x341/0x610 [ 3772.547045][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3772.547336][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3772.547629][ C0] ip_local_deliver+0x19d/0x480 [ 3772.547892][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3772.548182][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3772.548450][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3772.548727][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3772.548990][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3772.549329][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3772.549604][ C0] ip_rcv+0x564/0x740 [ 3772.549819][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3772.550062][ C0] ? set_track_prepare+0x8a/0xd0 [ 3772.550327][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3772.550619][ C0] ? rest_init+0x153/0x260 [ 3772.550856][ C0] ? skb_clone+0x10b/0x330 [ 3772.551100][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3772.551432][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3772.551749][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3772.552048][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3772.552360][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3772.552623][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3772.552869][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3772.553186][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3772.553487][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3772.553828][ C0] ? lock_acquire+0x1c1/0x220 [ 3772.554079][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3772.554386][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3772.554687][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3772.555018][ C0] ? __copy_skb_header+0xaf/0x490 [ 3772.555286][ C0] ? __skb_clone+0x57a/0x760 [ 3772.555529][ C0] netif_receive_skb+0x55/0x280 [ 3772.555789][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3772.556121][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3772.556474][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3772.556787][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3772.557080][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3772.557383][ C0] ? hlock_class+0x4e/0x130 [ 3772.557633][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3772.557969][ C0] ? place_entity+0x21/0x2f0 [ 3772.558215][ C0] ? resched_curr+0x219/0x280 [ 3772.558468][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3772.558741][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3772.559028][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3772.559304][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3772.559562][ C0] ? activate_task+0xf5/0x260 [ 3772.559814][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3772.560090][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3772.560365][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3772.560624][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3772.560912][ C0] ? get_stack_info+0x36/0xc0 [ 3772.561166][ C0] ? stack_access_ok+0xda/0x1f0 [ 3772.561427][ C0] ? get_reg+0x119/0x190 [ 3772.561658][ C0] __tcf_classify+0x32c/0x7d0 [ 3772.561908][ C0] tcf_classify+0x283/0x930 [ 3772.562151][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3772.562480][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3772.562750][ C0] ? arch_stack_walk+0x8c/0x100 [ 3772.563013][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3772.563308][ C0] tc_run+0x2e4/0x5d0 [ 3772.563525][ C0] ? __pfx_tc_run+0x10/0x10 [ 3772.563768][ C0] ? lock_acquire+0x1c1/0x220 [ 3772.564017][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3772.564292][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3772.564562][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3772.564849][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3772.565126][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3772.565442][ C0] ? neigh_hh_output+0x348/0x590 [ 3772.565709][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3772.565985][ C0] ip_finish_output2+0x786/0x18e0 [ 3772.566254][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3772.566547][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3772.566903][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3772.567195][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3772.567459][ C0] ? __ip_finish_output+0x10f/0x770 [ 3772.567741][ C0] ip_output+0x16b/0x4f0 [ 3772.567968][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3772.568256][ C0] ? __pfx_ip_output+0x10/0x10 [ 3772.568511][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3772.568811][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3772.569076][ C0] ? ip_local_out+0x114/0x3b0 [ 3772.569332][ C0] __ip_queue_xmit+0x672/0x1910 [ 3772.569596][ C0] ? __skb_clone+0x57a/0x760 [ 3772.569846][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3772.570129][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3772.570425][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3772.570743][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3772.571007][ C0] ? tcp_current_mss+0x40a/0x510 [ 3772.571272][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3772.571557][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3772.571838][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3772.572095][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3772.572367][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3772.572691][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3772.572969][ C0] ? ktime_get+0xb6/0x190 [ 3772.573202][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3772.573475][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3772.573760][ C0] tcp_write_timer+0x82/0x1d0 [ 3772.574013][ C0] call_timer_fn+0x176/0x430 [ 3772.574264][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3772.574541][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3772.574814][ C0] __run_timers.part.0+0x52d/0x890 [ 3772.575092][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3772.575375][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3772.575679][ C0] ? lock_acquire+0x1c1/0x220 [ 3772.575931][ C0] ? clockevents_program_event+0xf6/0x300 [ 3772.576237][ C0] ? lock_release+0x1d5/0x250 [ 3772.576485][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3772.576761][ C0] ? ktime_get+0xb6/0x190 [ 3772.576991][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3772.577291][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3772.577607][ C0] run_timer_softirq+0x72/0x100 [ 3772.577877][ C0] __do_softirq+0x1bc/0x7ff [ 3772.578126][ C0] irq_exit_rcu+0x98/0xc0 [ 3772.578361][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3772.578666][ C0] [ 3772.578823][ C0] [ 3772.578979][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3772.579297][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3772.579570][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3772.580595][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3772.580924][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3772.581352][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3772.581773][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3772.582195][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3772.582625][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3772.583053][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3772.583359][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3772.583635][ C0] default_idle_call+0x69/0xa0 [ 3772.583889][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3772.584155][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3772.584444][ C0] ? lock_release+0x1d5/0x250 [ 3772.584698][ C0] do_idle+0xfb/0x160 [ 3772.584919][ C0] cpu_startup_entry+0x55/0x60 [ 3772.585176][ C0] rest_init+0x153/0x260 [ 3772.585399][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3772.585692][ C0] arch_call_rest_init+0x13/0x40 [ 3772.585962][ C0] start_kernel+0x314/0x3d0 [ 3772.586206][ C0] x86_64_start_reservations+0x18/0x30 [ 3772.586499][ C0] x86_64_start_kernel+0xba/0x110 [ 3772.586770][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3772.587102][ C0] [ 3772.587269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2407s! [ksoftirqd/1:22] [ 3772.587741][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3772.588925][ C1] irq event stamp: 3886976 [ 3772.589159][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3772.589658][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3772.590155][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3772.590655][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3772.591143][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3772.591637][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3772.592282][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3772.592625][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3772.593647][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3772.593977][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3772.594397][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3772.594820][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3772.595245][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3772.595665][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3772.596085][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3772.596562][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3772.596908][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3772.597330][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3772.597755][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3772.598178][ C1] Call Trace: [ 3772.598363][ C1] [ 3772.598520][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3772.598795][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3772.599051][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3772.599339][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3772.599627][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3772.599931][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3772.600213][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3772.600533][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3772.600805][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3772.601133][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3772.601443][ C1] [ 3772.601599][ C1] [ 3772.601755][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3772.602084][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3772.602389][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3772.602701][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3772.603004][ C1] ? run_ksoftirqd+0xb/0x60 [ 3772.603245][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3772.603570][ C1] ? __orc_find+0x9c/0xf0 [ 3772.603802][ C1] ? lock_acquire+0x1c1/0x220 [ 3772.604058][ C1] ? irqentry_enter+0x2b/0x60 [ 3772.604314][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3772.604577][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3772.604863][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3772.605162][ C1] ? lock_acquire+0x1c1/0x220 [ 3772.605407][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3772.605656][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3772.605925][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3772.606175][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3772.606435][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3772.606708][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3772.607000][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3772.607295][ C1] ip_local_deliver+0x19d/0x480 [ 3772.607553][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3772.607844][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3772.608110][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3772.608385][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3772.608646][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3772.608983][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3772.609256][ C1] ip_rcv+0x564/0x740 [ 3772.609468][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3772.609716][ C1] ? set_track_prepare+0x8a/0xd0 [ 3772.609980][ C1] ? irqentry_enter+0x2b/0x60 [ 3772.610232][ C1] ? irqentry_enter+0x2b/0x60 [ 3772.610484][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3772.610727][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3772.611045][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3772.611388][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3772.611698][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3772.612034][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3772.612332][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3772.612666][ C1] netif_receive_skb+0x55/0x280 [ 3772.612926][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3772.613258][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3772.613607][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3772.613919][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3772.614212][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3772.614518][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3772.614847][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3772.615130][ C1] ? arch_stack_walk+0x68/0x100 [ 3772.615390][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3772.615664][ C1] ? irqentry_enter+0x2b/0x60 [ 3772.615916][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3772.616233][ C1] ? irqentry_enter+0x2b/0x60 [ 3772.616486][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3772.616812][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3772.617091][ C1] ? arch_stack_walk+0x68/0x100 [ 3772.617357][ C1] __tcf_classify+0x32c/0x7d0 [ 3772.617613][ C1] tcf_classify+0x283/0x930 [ 3772.617858][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3772.618126][ C1] tc_run+0x2e4/0x5d0 [ 3772.618338][ C1] ? __pfx_tc_run+0x10/0x10 [ 3772.618580][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3772.618844][ C1] ? irqentry_enter+0x2b/0x60 [ 3772.619096][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3772.619386][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3772.619712][ C1] ip_finish_output2+0x786/0x18e0 [ 3772.619980][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3772.620267][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3772.620535][ C1] ? __ip_finish_output+0x10f/0x770 [ 3772.620812][ C1] ip_output+0x16b/0x4f0 [ 3772.621038][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3772.621359][ C1] ? __pfx_ip_output+0x10/0x10 [ 3772.621613][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3772.621967][ C1] ? __pfx_ip_output+0x10/0x10 [ 3772.622227][ C1] __ip_queue_xmit+0x672/0x1910 [ 3772.622491][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3772.622770][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3772.623065][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3772.623349][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3772.623642][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3772.623924][ C1] tcp_delack_timer+0x84/0x240 [ 3772.624176][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3772.624461][ C1] call_timer_fn+0x176/0x430 [ 3772.624709][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3772.624982][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3772.625262][ C1] __run_timers.part.0+0x52d/0x890 [ 3772.625535][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3772.625818][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3772.626116][ C1] ? __pfx___schedule+0x10/0x10 [ 3772.626381][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3772.626699][ C1] run_timer_softirq+0x72/0x100 [ 3772.626957][ C1] __do_softirq+0x1bc/0x7ff [ 3772.627197][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3772.627469][ C1] run_ksoftirqd+0x2e/0x60 [ 3772.627713][ C1] smpboot_thread_fn+0x30e/0x840 [ 3772.627980][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3772.628270][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3772.628560][ C1] kthread+0x292/0x360 [ 3772.628776][ C1] ? __pfx_kthread+0x10/0x10 [ 3772.629024][ C1] ret_from_fork+0x34/0x70 [ 3772.629259][ C1] ? __pfx_kthread+0x10/0x10 [ 3772.629506][ C1] ret_from_fork_asm+0x1b/0x30 [ 3772.629766][ C1] [ 3797.126023][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3797.126413][ C1] rcu: 1-....: (2596165 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=617836 [ 3797.126996][ C1] rcu: (t=2602817 jiffies g=1007429 q=31 ncpus=4) [ 3797.127339][ C1] Sending NMI from CPU 1 to CPUs 0: [ 3797.127635][ C0] NMI backtrace for cpu 0 [ 3797.127645][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3797.127650][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3797.127653][ C0] RIP: 0010:__kasan_check_read+0x0/0x20 [ 3797.127662][ C0] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 3797.127665][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000202 [ 3797.127669][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3797.127671][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3797.127673][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3797.127675][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3797.127677][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3797.127679][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3797.127681][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3797.127685][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3797.127687][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3797.127688][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3797.127690][ C0] Call Trace: [ 3797.127693][ C0] [ 3797.127697][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 3797.127704][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3797.127709][ C0] ? nmi_handle+0x156/0x420 [ 3797.127715][ C0] ? default_do_nmi+0x41/0x100 [ 3797.127719][ C0] ? exc_nmi+0xf3/0x120 [ 3797.127722][ C0] ? end_repeat_nmi+0xf/0x60 [ 3797.127726][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3797.127733][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 3797.127736][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 3797.127739][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 3797.127742][ C0] [ 3797.127743][ C0] [ 3797.127743][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 3797.127748][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3797.127751][ C0] ? get_stack_info+0x36/0xc0 [ 3797.127758][ C0] ? lock_acquire+0x1c1/0x220 [ 3797.127763][ C0] ? lock_release+0x1d5/0x250 [ 3797.127767][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3797.127771][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3797.127773][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3797.127777][ C0] ? lock_acquire+0x1c1/0x220 [ 3797.127779][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3797.127785][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3797.127789][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3797.127796][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3797.127799][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3797.127804][ C0] ? __inet_lookup_established+0x341/0x610 [ 3797.127810][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3797.127818][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3797.127822][ C0] ip_local_deliver+0x19d/0x480 [ 3797.127825][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3797.127828][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3797.127834][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3797.127838][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3797.127841][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3797.127844][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3797.127854][ C0] ip_rcv+0x564/0x740 [ 3797.127858][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3797.127861][ C0] ? set_track_prepare+0x8a/0xd0 [ 3797.127865][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3797.127868][ C0] ? rest_init+0x153/0x260 [ 3797.127870][ C0] ? skb_clone+0x10b/0x330 [ 3797.127877][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3797.127884][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3797.127889][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3797.127895][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3797.127904][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3797.127908][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3797.127910][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3797.127915][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3797.127918][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3797.127921][ C0] ? lock_acquire+0x1c1/0x220 [ 3797.127923][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3797.127927][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3797.127930][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3797.127933][ C0] ? __copy_skb_header+0xaf/0x490 [ 3797.127937][ C0] ? __skb_clone+0x57a/0x760 [ 3797.127939][ C0] netif_receive_skb+0x55/0x280 [ 3797.127942][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3797.127951][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3797.127958][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3797.127965][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3797.127970][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3797.127979][ C0] ? hlock_class+0x4e/0x130 [ 3797.127986][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3797.127996][ C0] ? place_entity+0x21/0x2f0 [ 3797.128000][ C0] ? resched_curr+0x219/0x280 [ 3797.128003][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3797.128006][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3797.128010][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3797.128014][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3797.128016][ C0] ? activate_task+0xf5/0x260 [ 3797.128021][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3797.128026][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3797.128030][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3797.128033][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3797.128036][ C0] ? get_stack_info+0x36/0xc0 [ 3797.128040][ C0] ? stack_access_ok+0xda/0x1f0 [ 3797.128042][ C0] ? get_reg+0x119/0x190 [ 3797.128046][ C0] __tcf_classify+0x32c/0x7d0 [ 3797.128051][ C0] tcf_classify+0x283/0x930 [ 3797.128054][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3797.128059][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3797.128061][ C0] ? arch_stack_walk+0x8c/0x100 [ 3797.128067][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3797.128070][ C0] tc_run+0x2e4/0x5d0 [ 3797.128075][ C0] ? __pfx_tc_run+0x10/0x10 [ 3797.128079][ C0] ? lock_acquire+0x1c1/0x220 [ 3797.128081][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3797.128086][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3797.128092][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3797.128095][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3797.128099][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3797.128104][ C0] ? neigh_hh_output+0x348/0x590 [ 3797.128108][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3797.128112][ C0] ip_finish_output2+0x786/0x18e0 [ 3797.128116][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3797.128122][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3797.128129][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3797.128133][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3797.128137][ C0] ? __ip_finish_output+0x10f/0x770 [ 3797.128141][ C0] ip_output+0x16b/0x4f0 [ 3797.128145][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3797.128150][ C0] ? __pfx_ip_output+0x10/0x10 [ 3797.128153][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3797.128158][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3797.128161][ C0] ? ip_local_out+0x114/0x3b0 [ 3797.128165][ C0] __ip_queue_xmit+0x672/0x1910 [ 3797.128169][ C0] ? __skb_clone+0x57a/0x760 [ 3797.128173][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3797.128180][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3797.128184][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3797.128188][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3797.128194][ C0] ? tcp_current_mss+0x40a/0x510 [ 3797.128196][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3797.128199][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3797.128202][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3797.128204][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3797.128207][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3797.128211][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3797.128216][ C0] ? ktime_get+0xb6/0x190 [ 3797.128220][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3797.128224][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3797.128227][ C0] tcp_write_timer+0x82/0x1d0 [ 3797.128231][ C0] call_timer_fn+0x176/0x430 [ 3797.128234][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3797.128239][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3797.128243][ C0] __run_timers.part.0+0x52d/0x890 [ 3797.128246][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3797.128251][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3797.128254][ C0] ? lock_acquire+0x1c1/0x220 [ 3797.128256][ C0] ? clockevents_program_event+0xf6/0x300 [ 3797.128261][ C0] ? lock_release+0x1d5/0x250 [ 3797.128263][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3797.128266][ C0] ? ktime_get+0xb6/0x190 [ 3797.128269][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3797.128273][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3797.128277][ C0] run_timer_softirq+0x72/0x100 [ 3797.128280][ C0] __do_softirq+0x1bc/0x7ff [ 3797.128285][ C0] irq_exit_rcu+0x98/0xc0 [ 3797.128289][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3797.128293][ C0] [ 3797.128294][ C0] [ 3797.128295][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3797.128302][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3797.128306][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3797.128308][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3797.128311][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3797.128313][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3797.128315][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3797.128316][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3797.128318][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3797.128322][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3797.128326][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3797.128330][ C0] default_idle_call+0x69/0xa0 [ 3797.128332][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3797.128334][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3797.128340][ C0] ? lock_release+0x1d5/0x250 [ 3797.128344][ C0] do_idle+0xfb/0x160 [ 3797.128346][ C0] cpu_startup_entry+0x55/0x60 [ 3797.128349][ C0] rest_init+0x153/0x260 [ 3797.128351][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3797.128358][ C0] arch_call_rest_init+0x13/0x40 [ 3797.128364][ C0] start_kernel+0x314/0x3d0 [ 3797.128368][ C0] x86_64_start_reservations+0x18/0x30 [ 3797.128373][ C0] x86_64_start_kernel+0xba/0x110 [ 3797.128377][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3797.128385][ C0] [ 3797.128631][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3797.182751][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3797.183400][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3797.183749][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3797.184779][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3797.185108][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3797.185529][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3797.185954][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3797.186379][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3797.186801][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3797.187224][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3797.187700][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3797.188053][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3797.188472][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3797.188893][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3797.189318][ C1] Call Trace: [ 3797.189504][ C1] [ 3797.189661][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3797.189948][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3797.190216][ C1] ? check_cpu_stall+0x284/0x500 [ 3797.190479][ C1] ? rcu_pending+0x92/0x360 [ 3797.190722][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3797.191007][ C1] ? update_process_times+0xb9/0x110 [ 3797.191291][ C1] ? tick_sched_handle+0x67/0x130 [ 3797.191564][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3797.191866][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3797.192121][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3797.192452][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3797.192737][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3797.193038][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3797.193315][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3797.193634][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3797.193912][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3797.194237][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3797.194545][ C1] [ 3797.194706][ C1] [ 3797.194867][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3797.195200][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3797.195505][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3797.195813][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3797.196120][ C1] ? run_ksoftirqd+0xb/0x60 [ 3797.196367][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3797.196696][ C1] ? __orc_find+0x9c/0xf0 [ 3797.196925][ C1] ? lock_acquire+0x1c1/0x220 [ 3797.197177][ C1] ? irqentry_enter+0x2b/0x60 [ 3797.197429][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3797.197697][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3797.197984][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3797.198283][ C1] ? lock_acquire+0x1c1/0x220 [ 3797.198529][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3797.198778][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3797.199049][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3797.199299][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3797.199559][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3797.199833][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3797.200126][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3797.200419][ C1] ip_local_deliver+0x19d/0x480 [ 3797.200677][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3797.200962][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3797.201225][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3797.201505][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3797.201768][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3797.202103][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3797.202383][ C1] ip_rcv+0x564/0x740 [ 3797.202598][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3797.202842][ C1] ? set_track_prepare+0x8a/0xd0 [ 3797.203109][ C1] ? irqentry_enter+0x2b/0x60 [ 3797.203356][ C1] ? irqentry_enter+0x2b/0x60 [ 3797.203603][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3797.203841][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3797.204161][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3797.204499][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3797.204805][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3797.205148][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3797.205451][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3797.205783][ C1] netif_receive_skb+0x55/0x280 [ 3797.206042][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3797.206369][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3797.206715][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3797.207032][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3797.207320][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3797.207628][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3797.207958][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3797.208241][ C1] ? arch_stack_walk+0x68/0x100 [ 3797.208500][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3797.208775][ C1] ? irqentry_enter+0x2b/0x60 [ 3797.209023][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3797.209339][ C1] ? irqentry_enter+0x2b/0x60 [ 3797.209592][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3797.209918][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3797.210199][ C1] ? arch_stack_walk+0x68/0x100 [ 3797.210464][ C1] __tcf_classify+0x32c/0x7d0 [ 3797.210721][ C1] tcf_classify+0x283/0x930 [ 3797.210967][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3797.211240][ C1] tc_run+0x2e4/0x5d0 [ 3797.211455][ C1] ? __pfx_tc_run+0x10/0x10 [ 3797.211701][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3797.211969][ C1] ? irqentry_enter+0x2b/0x60 [ 3797.212216][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3797.212498][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3797.212816][ C1] ip_finish_output2+0x786/0x18e0 [ 3797.213088][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3797.213381][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3797.213645][ C1] ? __ip_finish_output+0x10f/0x770 [ 3797.213926][ C1] ip_output+0x16b/0x4f0 [ 3797.214154][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3797.214469][ C1] ? __pfx_ip_output+0x10/0x10 [ 3797.214727][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3797.215083][ C1] ? __pfx_ip_output+0x10/0x10 [ 3797.215341][ C1] __ip_queue_xmit+0x672/0x1910 [ 3797.215604][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3797.215889][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3797.216188][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3797.216475][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3797.216771][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3797.217058][ C1] tcp_delack_timer+0x84/0x240 [ 3797.217315][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3797.217602][ C1] call_timer_fn+0x176/0x430 [ 3797.217851][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3797.218125][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3797.218406][ C1] __run_timers.part.0+0x52d/0x890 [ 3797.218682][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3797.218966][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3797.219264][ C1] ? __pfx___schedule+0x10/0x10 [ 3797.219529][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3797.219849][ C1] run_timer_softirq+0x72/0x100 [ 3797.220108][ C1] __do_softirq+0x1bc/0x7ff [ 3797.220348][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3797.220618][ C1] run_ksoftirqd+0x2e/0x60 [ 3797.220858][ C1] smpboot_thread_fn+0x30e/0x840 [ 3797.221123][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3797.221416][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3797.221703][ C1] kthread+0x292/0x360 [ 3797.221924][ C1] ? __pfx_kthread+0x10/0x10 [ 3797.222170][ C1] ret_from_fork+0x34/0x70 [ 3797.222411][ C1] ? __pfx_kthread+0x10/0x10 [ 3797.222654][ C1] ret_from_fork_asm+0x1b/0x30 [ 3797.222916][ C1] [ 3824.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2455s! [swapper/0:0] [ 3824.527929][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3824.529131][ C0] irq event stamp: 27567077 [ 3824.529374][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3824.529911][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3824.530381][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3824.530883][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3824.531379][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3824.531857][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3824.532513][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3824.532858][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3824.533887][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3824.534216][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3824.534640][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3824.535067][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3824.535493][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3824.535914][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3824.536336][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3824.536810][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3824.537160][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3824.537587][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3824.538009][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3824.538434][ C0] Call Trace: [ 3824.538621][ C0] [ 3824.538779][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3824.539055][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3824.539310][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3824.539599][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3824.539888][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3824.540194][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3824.540478][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3824.540799][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3824.541073][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3824.541352][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3824.541675][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3824.541990][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3824.542331][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3824.542634][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3824.542943][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3824.543252][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3824.543583][ C0] ? get_stack_info+0x36/0xc0 [ 3824.543836][ C0] ? lock_acquire+0x1c1/0x220 [ 3824.544088][ C0] ? lock_release+0x1d5/0x250 [ 3824.544339][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3824.544599][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3824.544883][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3824.545181][ C0] ? lock_acquire+0x1c1/0x220 [ 3824.545435][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3824.545693][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3824.545969][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3824.546215][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3824.546473][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3824.546741][ C0] ? __inet_lookup_established+0x341/0x610 [ 3824.547053][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3824.547345][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3824.547643][ C0] ip_local_deliver+0x19d/0x480 [ 3824.547903][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3824.548190][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3824.548459][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3824.548735][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3824.548997][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3824.549335][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3824.549609][ C0] ip_rcv+0x564/0x740 [ 3824.549822][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3824.550063][ C0] ? set_track_prepare+0x8a/0xd0 [ 3824.550328][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3824.550624][ C0] ? rest_init+0x153/0x260 [ 3824.550861][ C0] ? skb_clone+0x10b/0x330 [ 3824.551105][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3824.551441][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3824.551762][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3824.552062][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3824.552378][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3824.552644][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3824.552888][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3824.553206][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3824.553506][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3824.553843][ C0] ? lock_acquire+0x1c1/0x220 [ 3824.554094][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3824.554401][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3824.554700][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3824.555029][ C0] ? __copy_skb_header+0xaf/0x490 [ 3824.555295][ C0] ? __skb_clone+0x57a/0x760 [ 3824.555542][ C0] netif_receive_skb+0x55/0x280 [ 3824.555803][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3824.556139][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3824.556488][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3824.556801][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3824.557093][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3824.557398][ C0] ? hlock_class+0x4e/0x130 [ 3824.557651][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3824.557977][ C0] ? place_entity+0x21/0x2f0 [ 3824.558222][ C0] ? resched_curr+0x219/0x280 [ 3824.558475][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3824.558744][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3824.559030][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3824.559305][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3824.559561][ C0] ? activate_task+0xf5/0x260 [ 3824.559808][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3824.560081][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3824.560356][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3824.560614][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3824.560904][ C0] ? get_stack_info+0x36/0xc0 [ 3824.561157][ C0] ? stack_access_ok+0xda/0x1f0 [ 3824.561416][ C0] ? get_reg+0x119/0x190 [ 3824.561646][ C0] __tcf_classify+0x32c/0x7d0 [ 3824.561898][ C0] tcf_classify+0x283/0x930 [ 3824.562140][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3824.562465][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3824.562739][ C0] ? arch_stack_walk+0x8c/0x100 [ 3824.563001][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3824.563293][ C0] tc_run+0x2e4/0x5d0 [ 3824.563508][ C0] ? __pfx_tc_run+0x10/0x10 [ 3824.563748][ C0] ? lock_acquire+0x1c1/0x220 [ 3824.563993][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3824.564266][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3824.564532][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3824.564814][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3824.565089][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3824.565409][ C0] ? neigh_hh_output+0x348/0x590 [ 3824.565676][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3824.565952][ C0] ip_finish_output2+0x786/0x18e0 [ 3824.566219][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3824.566510][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3824.566864][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3824.567155][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3824.567423][ C0] ? __ip_finish_output+0x10f/0x770 [ 3824.567700][ C0] ip_output+0x16b/0x4f0 [ 3824.567927][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3824.568215][ C0] ? __pfx_ip_output+0x10/0x10 [ 3824.568471][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3824.568773][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3824.569036][ C0] ? ip_local_out+0x114/0x3b0 [ 3824.569292][ C0] __ip_queue_xmit+0x672/0x1910 [ 3824.569558][ C0] ? __skb_clone+0x57a/0x760 [ 3824.569814][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3824.570093][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3824.570387][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3824.570703][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3824.570961][ C0] ? tcp_current_mss+0x40a/0x510 [ 3824.571228][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3824.571520][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3824.571796][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3824.572053][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3824.572326][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3824.572649][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3824.572925][ C0] ? ktime_get+0xb6/0x190 [ 3824.573160][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3824.573433][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3824.573718][ C0] tcp_write_timer+0x82/0x1d0 [ 3824.573969][ C0] call_timer_fn+0x176/0x430 [ 3824.574218][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3824.574496][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3824.574770][ C0] __run_timers.part.0+0x52d/0x890 [ 3824.575045][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3824.575325][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3824.575626][ C0] ? lock_acquire+0x1c1/0x220 [ 3824.575876][ C0] ? clockevents_program_event+0xf6/0x300 [ 3824.576183][ C0] ? lock_release+0x1d5/0x250 [ 3824.576431][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3824.576707][ C0] ? ktime_get+0xb6/0x190 [ 3824.576937][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3824.577236][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3824.577553][ C0] run_timer_softirq+0x72/0x100 [ 3824.577816][ C0] __do_softirq+0x1bc/0x7ff [ 3824.578063][ C0] irq_exit_rcu+0x98/0xc0 [ 3824.578297][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3824.578598][ C0] [ 3824.578754][ C0] [ 3824.578910][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3824.579227][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3824.579499][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3824.580522][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3824.580846][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3824.581270][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3824.581692][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3824.582111][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3824.582529][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3824.582954][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3824.583262][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3824.583537][ C0] default_idle_call+0x69/0xa0 [ 3824.583791][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3824.584055][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3824.584343][ C0] ? lock_release+0x1d5/0x250 [ 3824.584594][ C0] do_idle+0xfb/0x160 [ 3824.584810][ C0] cpu_startup_entry+0x55/0x60 [ 3824.585068][ C0] rest_init+0x153/0x260 [ 3824.585293][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3824.585583][ C0] arch_call_rest_init+0x13/0x40 [ 3824.585851][ C0] start_kernel+0x314/0x3d0 [ 3824.586092][ C0] x86_64_start_reservations+0x18/0x30 [ 3824.586381][ C0] x86_64_start_kernel+0xba/0x110 [ 3824.586653][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3824.586988][ C0] [ 3824.587157][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2455s! [ksoftirqd/1:22] [ 3824.587637][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3824.588829][ C1] irq event stamp: 3886976 [ 3824.589066][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3824.589568][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3824.590068][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3824.590571][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3824.591060][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3824.591559][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3824.592206][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3824.592550][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3824.593575][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3824.593900][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3824.594325][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3824.594750][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3824.595170][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3824.595591][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3824.596014][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3824.596489][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3824.596835][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3824.597262][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3824.597688][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3824.598112][ C1] Call Trace: [ 3824.598292][ C1] [ 3824.598450][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3824.598726][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3824.598985][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3824.599277][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3824.599566][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3824.599871][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3824.600152][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3824.600478][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3824.600751][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3824.601083][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3824.601395][ C1] [ 3824.601552][ C1] [ 3824.601708][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3824.602035][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3824.602341][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3824.602652][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3824.602953][ C1] ? run_ksoftirqd+0xb/0x60 [ 3824.603195][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3824.603518][ C1] ? __orc_find+0x9c/0xf0 [ 3824.603752][ C1] ? lock_acquire+0x1c1/0x220 [ 3824.604005][ C1] ? irqentry_enter+0x2b/0x60 [ 3824.604260][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3824.604523][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3824.604810][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3824.605111][ C1] ? lock_acquire+0x1c1/0x220 [ 3824.605361][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3824.605614][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3824.605888][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3824.606137][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3824.606397][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3824.606672][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3824.606965][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3824.607259][ C1] ip_local_deliver+0x19d/0x480 [ 3824.607526][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3824.607813][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3824.608080][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3824.608355][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3824.608618][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3824.608957][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3824.609235][ C1] ip_rcv+0x564/0x740 [ 3824.609448][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3824.609688][ C1] ? set_track_prepare+0x8a/0xd0 [ 3824.609953][ C1] ? irqentry_enter+0x2b/0x60 [ 3824.610208][ C1] ? irqentry_enter+0x2b/0x60 [ 3824.610462][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3824.610707][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3824.611027][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3824.611367][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3824.611678][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3824.612015][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3824.612314][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3824.612650][ C1] netif_receive_skb+0x55/0x280 [ 3824.612911][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3824.613243][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3824.613593][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3824.613907][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3824.614201][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3824.614510][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3824.614844][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3824.615131][ C1] ? arch_stack_walk+0x68/0x100 [ 3824.615393][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3824.615670][ C1] ? irqentry_enter+0x2b/0x60 [ 3824.615921][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3824.616240][ C1] ? irqentry_enter+0x2b/0x60 [ 3824.616491][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3824.616817][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3824.617099][ C1] ? arch_stack_walk+0x68/0x100 [ 3824.617362][ C1] __tcf_classify+0x32c/0x7d0 [ 3824.617621][ C1] tcf_classify+0x283/0x930 [ 3824.617864][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3824.618133][ C1] tc_run+0x2e4/0x5d0 [ 3824.618346][ C1] ? __pfx_tc_run+0x10/0x10 [ 3824.618588][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3824.618853][ C1] ? irqentry_enter+0x2b/0x60 [ 3824.619109][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3824.619398][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3824.619723][ C1] ip_finish_output2+0x786/0x18e0 [ 3824.619992][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3824.620283][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3824.620550][ C1] ? __ip_finish_output+0x10f/0x770 [ 3824.620826][ C1] ip_output+0x16b/0x4f0 [ 3824.621052][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3824.621373][ C1] ? __pfx_ip_output+0x10/0x10 [ 3824.621626][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3824.621982][ C1] ? __pfx_ip_output+0x10/0x10 [ 3824.622242][ C1] __ip_queue_xmit+0x672/0x1910 [ 3824.622508][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3824.622786][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3824.623082][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3824.623366][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3824.623658][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3824.623940][ C1] tcp_delack_timer+0x84/0x240 [ 3824.624196][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3824.624484][ C1] call_timer_fn+0x176/0x430 [ 3824.624736][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3824.625009][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3824.625291][ C1] __run_timers.part.0+0x52d/0x890 [ 3824.625564][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3824.625846][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3824.626147][ C1] ? __pfx___schedule+0x10/0x10 [ 3824.626415][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3824.626743][ C1] run_timer_softirq+0x72/0x100 [ 3824.627003][ C1] __do_softirq+0x1bc/0x7ff [ 3824.627247][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3824.627524][ C1] run_ksoftirqd+0x2e/0x60 [ 3824.627763][ C1] smpboot_thread_fn+0x30e/0x840 [ 3824.628030][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3824.628319][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3824.628610][ C1] kthread+0x292/0x360 [ 3824.628829][ C1] ? __pfx_kthread+0x10/0x10 [ 3824.629081][ C1] ret_from_fork+0x34/0x70 [ 3824.629317][ C1] ? __pfx_kthread+0x10/0x10 [ 3824.629564][ C1] ret_from_fork_asm+0x1b/0x30 [ 3824.629822][ C1] [ 3852.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2481s! [swapper/0:0] [ 3852.527924][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3852.529128][ C0] irq event stamp: 27567077 [ 3852.529371][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3852.529904][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3852.530376][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3852.530880][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3852.531376][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3852.531855][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3852.532504][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3852.532847][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3852.533876][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3852.534205][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3852.534628][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3852.535053][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3852.535483][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3852.535903][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3852.536329][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3852.536804][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3852.537152][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3852.537580][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3852.538002][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3852.538426][ C0] Call Trace: [ 3852.538613][ C0] [ 3852.538771][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3852.539047][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3852.539303][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3852.539591][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3852.539880][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3852.540195][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3852.540477][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3852.540798][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3852.541071][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3852.541351][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3852.541673][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3852.541983][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3852.542319][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3852.542622][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3852.542932][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3852.543239][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3852.543569][ C0] ? get_stack_info+0x36/0xc0 [ 3852.543824][ C0] ? lock_acquire+0x1c1/0x220 [ 3852.544077][ C0] ? lock_release+0x1d5/0x250 [ 3852.544330][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3852.544589][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3852.544872][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3852.545169][ C0] ? lock_acquire+0x1c1/0x220 [ 3852.545423][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3852.545681][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3852.545956][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3852.546203][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3852.546462][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3852.546731][ C0] ? __inet_lookup_established+0x341/0x610 [ 3852.547042][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3852.547338][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3852.547628][ C0] ip_local_deliver+0x19d/0x480 [ 3852.547892][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3852.548179][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3852.548447][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3852.548722][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3852.548986][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3852.549324][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3852.549599][ C0] ip_rcv+0x564/0x740 [ 3852.549812][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3852.550052][ C0] ? set_track_prepare+0x8a/0xd0 [ 3852.550318][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3852.550610][ C0] ? rest_init+0x153/0x260 [ 3852.550847][ C0] ? skb_clone+0x10b/0x330 [ 3852.551093][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3852.551427][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3852.551749][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3852.552050][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3852.552360][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3852.552625][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3852.552869][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3852.553189][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3852.553491][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3852.553829][ C0] ? lock_acquire+0x1c1/0x220 [ 3852.554079][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3852.554388][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3852.554687][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3852.555014][ C0] ? __copy_skb_header+0xaf/0x490 [ 3852.555281][ C0] ? __skb_clone+0x57a/0x760 [ 3852.555529][ C0] netif_receive_skb+0x55/0x280 [ 3852.555797][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3852.556130][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3852.556483][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3852.556796][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3852.557088][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3852.557396][ C0] ? hlock_class+0x4e/0x130 [ 3852.557640][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3852.557967][ C0] ? place_entity+0x21/0x2f0 [ 3852.558213][ C0] ? resched_curr+0x219/0x280 [ 3852.558472][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3852.558741][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3852.559026][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3852.559302][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3852.559557][ C0] ? activate_task+0xf5/0x260 [ 3852.559804][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3852.560079][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3852.560354][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3852.560613][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3852.560902][ C0] ? get_stack_info+0x36/0xc0 [ 3852.561158][ C0] ? stack_access_ok+0xda/0x1f0 [ 3852.561416][ C0] ? get_reg+0x119/0x190 [ 3852.561648][ C0] __tcf_classify+0x32c/0x7d0 [ 3852.561900][ C0] tcf_classify+0x283/0x930 [ 3852.562143][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3852.562469][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3852.562741][ C0] ? arch_stack_walk+0x8c/0x100 [ 3852.563004][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3852.563296][ C0] tc_run+0x2e4/0x5d0 [ 3852.563512][ C0] ? __pfx_tc_run+0x10/0x10 [ 3852.563752][ C0] ? lock_acquire+0x1c1/0x220 [ 3852.564003][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3852.564277][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3852.564544][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3852.564825][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3852.565103][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3852.565425][ C0] ? neigh_hh_output+0x348/0x590 [ 3852.565691][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3852.565971][ C0] ip_finish_output2+0x786/0x18e0 [ 3852.566238][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3852.566528][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3852.566883][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3852.567175][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3852.567446][ C0] ? __ip_finish_output+0x10f/0x770 [ 3852.567721][ C0] ip_output+0x16b/0x4f0 [ 3852.567949][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3852.568234][ C0] ? __pfx_ip_output+0x10/0x10 [ 3852.568489][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3852.568792][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3852.569057][ C0] ? ip_local_out+0x114/0x3b0 [ 3852.569312][ C0] __ip_queue_xmit+0x672/0x1910 [ 3852.569579][ C0] ? __skb_clone+0x57a/0x760 [ 3852.569828][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3852.570108][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3852.570403][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3852.570719][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3852.570977][ C0] ? tcp_current_mss+0x40a/0x510 [ 3852.571242][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3852.571527][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3852.571802][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3852.572055][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3852.572327][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3852.572649][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3852.572928][ C0] ? ktime_get+0xb6/0x190 [ 3852.573161][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3852.573433][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3852.573717][ C0] tcp_write_timer+0x82/0x1d0 [ 3852.573968][ C0] call_timer_fn+0x176/0x430 [ 3852.574215][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3852.574493][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3852.574765][ C0] __run_timers.part.0+0x52d/0x890 [ 3852.575040][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3852.575320][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3852.575626][ C0] ? lock_acquire+0x1c1/0x220 [ 3852.575875][ C0] ? clockevents_program_event+0xf6/0x300 [ 3852.576180][ C0] ? lock_release+0x1d5/0x250 [ 3852.576428][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3852.576701][ C0] ? ktime_get+0xb6/0x190 [ 3852.576930][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3852.577228][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3852.577544][ C0] run_timer_softirq+0x72/0x100 [ 3852.577806][ C0] __do_softirq+0x1bc/0x7ff [ 3852.578052][ C0] irq_exit_rcu+0x98/0xc0 [ 3852.578285][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3852.578585][ C0] [ 3852.578740][ C0] [ 3852.578895][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3852.579213][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3852.579482][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3852.580507][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3852.580831][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3852.581256][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3852.581681][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3852.582102][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3852.582531][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3852.582955][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3852.583262][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3852.583538][ C0] default_idle_call+0x69/0xa0 [ 3852.583793][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3852.584059][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3852.584347][ C0] ? lock_release+0x1d5/0x250 [ 3852.584599][ C0] do_idle+0xfb/0x160 [ 3852.584817][ C0] cpu_startup_entry+0x55/0x60 [ 3852.585076][ C0] rest_init+0x153/0x260 [ 3852.585301][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3852.585591][ C0] arch_call_rest_init+0x13/0x40 [ 3852.585859][ C0] start_kernel+0x314/0x3d0 [ 3852.586101][ C0] x86_64_start_reservations+0x18/0x30 [ 3852.586391][ C0] x86_64_start_kernel+0xba/0x110 [ 3852.586663][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3852.586996][ C0] [ 3852.587165][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2481s! [ksoftirqd/1:22] [ 3852.587639][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3852.588842][ C1] irq event stamp: 3886976 [ 3852.589082][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3852.589578][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3852.590071][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3852.590565][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3852.591058][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3852.591550][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3852.592194][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3852.592532][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3852.593549][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3852.593872][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3852.594291][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3852.594707][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3852.595126][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3852.595543][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3852.595962][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3852.596429][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3852.596780][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3852.597198][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3852.597622][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3852.598038][ C1] Call Trace: [ 3852.598216][ C1] [ 3852.598370][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3852.598649][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3852.598902][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3852.599193][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3852.599477][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3852.599778][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3852.600059][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3852.600378][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3852.600654][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3852.600978][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3852.601287][ C1] [ 3852.601445][ C1] [ 3852.601604][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3852.601939][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3852.602242][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3852.602551][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3852.602855][ C1] ? run_ksoftirqd+0xb/0x60 [ 3852.603102][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3852.603432][ C1] ? __orc_find+0x9c/0xf0 [ 3852.603665][ C1] ? lock_acquire+0x1c1/0x220 [ 3852.603917][ C1] ? irqentry_enter+0x2b/0x60 [ 3852.604169][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3852.604430][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3852.604714][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3852.605013][ C1] ? lock_acquire+0x1c1/0x220 [ 3852.605264][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3852.605518][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3852.605793][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3852.606040][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3852.606299][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3852.606570][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3852.606856][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3852.607146][ C1] ip_local_deliver+0x19d/0x480 [ 3852.607415][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3852.607700][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3852.607964][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3852.608246][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3852.608511][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3852.608845][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3852.609124][ C1] ip_rcv+0x564/0x740 [ 3852.609338][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3852.609584][ C1] ? set_track_prepare+0x8a/0xd0 [ 3852.609852][ C1] ? irqentry_enter+0x2b/0x60 [ 3852.610101][ C1] ? irqentry_enter+0x2b/0x60 [ 3852.610351][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3852.610595][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3852.610908][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3852.611247][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3852.611555][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3852.611897][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3852.612199][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3852.612532][ C1] netif_receive_skb+0x55/0x280 [ 3852.612790][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3852.613118][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3852.613464][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3852.613779][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3852.614066][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3852.614371][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3852.614696][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3852.614975][ C1] ? arch_stack_walk+0x68/0x100 [ 3852.615237][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3852.615517][ C1] ? irqentry_enter+0x2b/0x60 [ 3852.615769][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3852.616093][ C1] ? irqentry_enter+0x2b/0x60 [ 3852.616345][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3852.616665][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3852.616948][ C1] ? arch_stack_walk+0x68/0x100 [ 3852.617207][ C1] __tcf_classify+0x32c/0x7d0 [ 3852.617467][ C1] tcf_classify+0x283/0x930 [ 3852.617713][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3852.617985][ C1] tc_run+0x2e4/0x5d0 [ 3852.618201][ C1] ? __pfx_tc_run+0x10/0x10 [ 3852.618449][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3852.618718][ C1] ? irqentry_enter+0x2b/0x60 [ 3852.618966][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3852.619250][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3852.619574][ C1] ip_finish_output2+0x786/0x18e0 [ 3852.619845][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3852.620136][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3852.620400][ C1] ? __ip_finish_output+0x10f/0x770 [ 3852.620680][ C1] ip_output+0x16b/0x4f0 [ 3852.620913][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3852.621233][ C1] ? __pfx_ip_output+0x10/0x10 [ 3852.621492][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3852.621842][ C1] ? __pfx_ip_output+0x10/0x10 [ 3852.622097][ C1] __ip_queue_xmit+0x672/0x1910 [ 3852.622365][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3852.622648][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3852.622949][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3852.623242][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3852.623539][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3852.623827][ C1] tcp_delack_timer+0x84/0x240 [ 3852.624085][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3852.624369][ C1] call_timer_fn+0x176/0x430 [ 3852.624615][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3852.624892][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3852.625169][ C1] __run_timers.part.0+0x52d/0x890 [ 3852.625439][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3852.625731][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3852.626033][ C1] ? __pfx___schedule+0x10/0x10 [ 3852.626292][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3852.626609][ C1] run_timer_softirq+0x72/0x100 [ 3852.626871][ C1] __do_softirq+0x1bc/0x7ff [ 3852.627117][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3852.627399][ C1] run_ksoftirqd+0x2e/0x60 [ 3852.627639][ C1] smpboot_thread_fn+0x30e/0x840 [ 3852.627904][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3852.628198][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3852.628489][ C1] kthread+0x292/0x360 [ 3852.628706][ C1] ? __pfx_kthread+0x10/0x10 [ 3852.628950][ C1] ret_from_fork+0x34/0x70 [ 3852.629192][ C1] ? __pfx_kthread+0x10/0x10 [ 3852.629439][ C1] ret_from_fork_asm+0x1b/0x30 [ 3852.629701][ C1] [ 3875.224024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3875.224413][ C1] rcu: 1-....: (2673983 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=637163 [ 3875.225000][ C1] rcu: (t=2680915 jiffies g=1007429 q=31 ncpus=4) [ 3875.225348][ C1] Sending NMI from CPU 1 to CPUs 0: [ 3875.225633][ C0] NMI backtrace for cpu 0 [ 3875.225642][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3875.225646][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3875.225649][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3875.225660][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3875.225664][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3875.225667][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3875.225669][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3875.225671][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3875.225673][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3875.225675][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3875.225677][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3875.225679][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3875.225683][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3875.225685][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3875.225687][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3875.225689][ C0] Call Trace: [ 3875.225693][ C0] [ 3875.225696][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 3875.225703][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3875.225708][ C0] ? nmi_handle+0x156/0x420 [ 3875.225713][ C0] ? default_do_nmi+0x41/0x100 [ 3875.225718][ C0] ? exc_nmi+0xf3/0x120 [ 3875.225721][ C0] ? end_repeat_nmi+0xf/0x60 [ 3875.225726][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3875.225730][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3875.225734][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3875.225737][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3875.225741][ C0] [ 3875.225742][ C0] [ 3875.225743][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3875.225746][ C0] ? get_stack_info+0x36/0xc0 [ 3875.225751][ C0] ? lock_acquire+0x1c1/0x220 [ 3875.225757][ C0] ? lock_release+0x1d5/0x250 [ 3875.225761][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3875.225765][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3875.225768][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3875.225771][ C0] ? lock_acquire+0x1c1/0x220 [ 3875.225773][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3875.225779][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3875.225782][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3875.225790][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3875.225793][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3875.225797][ C0] ? __inet_lookup_established+0x341/0x610 [ 3875.225803][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3875.225811][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3875.225815][ C0] ip_local_deliver+0x19d/0x480 [ 3875.225818][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3875.225820][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3875.225826][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3875.225830][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3875.225833][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3875.225837][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3875.225848][ C0] ip_rcv+0x564/0x740 [ 3875.225851][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3875.225854][ C0] ? set_track_prepare+0x8a/0xd0 [ 3875.225859][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3875.225861][ C0] ? rest_init+0x153/0x260 [ 3875.225864][ C0] ? skb_clone+0x10b/0x330 [ 3875.225870][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3875.225876][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3875.225881][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3875.225886][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3875.225896][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3875.225899][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3875.225902][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3875.225906][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3875.225909][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3875.225913][ C0] ? lock_acquire+0x1c1/0x220 [ 3875.225915][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3875.225918][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3875.225922][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3875.225925][ C0] ? __copy_skb_header+0xaf/0x490 [ 3875.225928][ C0] ? __skb_clone+0x57a/0x760 [ 3875.225931][ C0] netif_receive_skb+0x55/0x280 [ 3875.225933][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3875.225942][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3875.225949][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3875.225956][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3875.225961][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3875.225970][ C0] ? hlock_class+0x4e/0x130 [ 3875.225976][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3875.225986][ C0] ? place_entity+0x21/0x2f0 [ 3875.225990][ C0] ? resched_curr+0x219/0x280 [ 3875.225994][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3875.225997][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3875.226001][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3875.226005][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3875.226008][ C0] ? activate_task+0xf5/0x260 [ 3875.226011][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3875.226017][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3875.226022][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3875.226025][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3875.226028][ C0] ? get_stack_info+0x36/0xc0 [ 3875.226032][ C0] ? stack_access_ok+0xda/0x1f0 [ 3875.226034][ C0] ? get_reg+0x119/0x190 [ 3875.226038][ C0] __tcf_classify+0x32c/0x7d0 [ 3875.226042][ C0] tcf_classify+0x283/0x930 [ 3875.226045][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3875.226051][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3875.226053][ C0] ? arch_stack_walk+0x8c/0x100 [ 3875.226059][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3875.226062][ C0] tc_run+0x2e4/0x5d0 [ 3875.226067][ C0] ? __pfx_tc_run+0x10/0x10 [ 3875.226070][ C0] ? lock_acquire+0x1c1/0x220 [ 3875.226073][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3875.226078][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3875.226083][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3875.226086][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3875.226090][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3875.226095][ C0] ? neigh_hh_output+0x348/0x590 [ 3875.226100][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3875.226104][ C0] ip_finish_output2+0x786/0x18e0 [ 3875.226107][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3875.226114][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3875.226121][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3875.226124][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3875.226128][ C0] ? __ip_finish_output+0x10f/0x770 [ 3875.226132][ C0] ip_output+0x16b/0x4f0 [ 3875.226136][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3875.226140][ C0] ? __pfx_ip_output+0x10/0x10 [ 3875.226143][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3875.226148][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3875.226151][ C0] ? ip_local_out+0x114/0x3b0 [ 3875.226155][ C0] __ip_queue_xmit+0x672/0x1910 [ 3875.226159][ C0] ? __skb_clone+0x57a/0x760 [ 3875.226162][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3875.226170][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3875.226174][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3875.226178][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3875.226183][ C0] ? tcp_current_mss+0x40a/0x510 [ 3875.226186][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3875.226189][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3875.226192][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3875.226194][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3875.226197][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3875.226201][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3875.226205][ C0] ? ktime_get+0xb6/0x190 [ 3875.226209][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3875.226213][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3875.226216][ C0] tcp_write_timer+0x82/0x1d0 [ 3875.226220][ C0] call_timer_fn+0x176/0x430 [ 3875.226223][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3875.226228][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3875.226232][ C0] __run_timers.part.0+0x52d/0x890 [ 3875.226236][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3875.226240][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3875.226243][ C0] ? lock_acquire+0x1c1/0x220 [ 3875.226246][ C0] ? clockevents_program_event+0xf6/0x300 [ 3875.226250][ C0] ? lock_release+0x1d5/0x250 [ 3875.226253][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3875.226256][ C0] ? ktime_get+0xb6/0x190 [ 3875.226259][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3875.226262][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3875.226267][ C0] run_timer_softirq+0x72/0x100 [ 3875.226270][ C0] __do_softirq+0x1bc/0x7ff [ 3875.226275][ C0] irq_exit_rcu+0x98/0xc0 [ 3875.226278][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3875.226282][ C0] [ 3875.226282][ C0] [ 3875.226284][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3875.226290][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3875.226294][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3875.226296][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3875.226298][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3875.226300][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3875.226301][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3875.226303][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3875.226304][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3875.226308][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3875.226311][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3875.226316][ C0] default_idle_call+0x69/0xa0 [ 3875.226318][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3875.226320][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3875.226325][ C0] ? lock_release+0x1d5/0x250 [ 3875.226329][ C0] do_idle+0xfb/0x160 [ 3875.226332][ C0] cpu_startup_entry+0x55/0x60 [ 3875.226335][ C0] rest_init+0x153/0x260 [ 3875.226337][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3875.226343][ C0] arch_call_rest_init+0x13/0x40 [ 3875.226348][ C0] start_kernel+0x314/0x3d0 [ 3875.226352][ C0] x86_64_start_reservations+0x18/0x30 [ 3875.226357][ C0] x86_64_start_kernel+0xba/0x110 [ 3875.226361][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3875.226370][ C0] [ 3875.226629][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3875.226636][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3875.281222][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3875.281569][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3875.282585][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3875.282908][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3875.283327][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3875.283745][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3875.284163][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3875.284581][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3875.284999][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3875.285470][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3875.285825][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3875.286247][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3875.286666][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3875.287089][ C1] Call Trace: [ 3875.287274][ C1] [ 3875.287430][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3875.287719][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3875.287981][ C1] ? check_cpu_stall+0x284/0x500 [ 3875.288250][ C1] ? rcu_pending+0x92/0x360 [ 3875.288492][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3875.288772][ C1] ? update_process_times+0xb9/0x110 [ 3875.289058][ C1] ? tick_sched_handle+0x67/0x130 [ 3875.289330][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3875.289627][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3875.289882][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3875.290211][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3875.290499][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3875.290805][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3875.291088][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3875.291411][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3875.291685][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3875.292011][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3875.292325][ C1] [ 3875.292481][ C1] [ 3875.292638][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3875.292969][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3875.293275][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3875.293589][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3875.293890][ C1] ? run_ksoftirqd+0xb/0x60 [ 3875.294133][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3875.294459][ C1] ? __orc_find+0x9c/0xf0 [ 3875.294690][ C1] ? lock_acquire+0x1c1/0x220 [ 3875.294946][ C1] ? irqentry_enter+0x2b/0x60 [ 3875.295202][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3875.295468][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3875.295756][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3875.296058][ C1] ? lock_acquire+0x1c1/0x220 [ 3875.296305][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3875.296556][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3875.296828][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3875.297079][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3875.297344][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3875.297615][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3875.297902][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3875.298190][ C1] ip_local_deliver+0x19d/0x480 [ 3875.298451][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3875.298739][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3875.299008][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3875.299285][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3875.299547][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3875.299886][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3875.300159][ C1] ip_rcv+0x564/0x740 [ 3875.300376][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3875.300619][ C1] ? set_track_prepare+0x8a/0xd0 [ 3875.300883][ C1] ? irqentry_enter+0x2b/0x60 [ 3875.301136][ C1] ? irqentry_enter+0x2b/0x60 [ 3875.301389][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3875.301634][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3875.301950][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3875.302294][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3875.302607][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3875.302948][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3875.303245][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3875.303580][ C1] netif_receive_skb+0x55/0x280 [ 3875.303847][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3875.304178][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3875.304529][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3875.304840][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3875.305131][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3875.305435][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3875.305766][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3875.306048][ C1] ? arch_stack_walk+0x68/0x100 [ 3875.306306][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3875.306580][ C1] ? irqentry_enter+0x2b/0x60 [ 3875.306828][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3875.307150][ C1] ? irqentry_enter+0x2b/0x60 [ 3875.307407][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3875.307725][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3875.308007][ C1] ? arch_stack_walk+0x68/0x100 [ 3875.308263][ C1] __tcf_classify+0x32c/0x7d0 [ 3875.308512][ C1] tcf_classify+0x283/0x930 [ 3875.308751][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3875.309018][ C1] tc_run+0x2e4/0x5d0 [ 3875.309233][ C1] ? __pfx_tc_run+0x10/0x10 [ 3875.309476][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3875.309741][ C1] ? irqentry_enter+0x2b/0x60 [ 3875.309993][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3875.310282][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3875.310608][ C1] ip_finish_output2+0x786/0x18e0 [ 3875.310876][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3875.311161][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3875.311428][ C1] ? __ip_finish_output+0x10f/0x770 [ 3875.311703][ C1] ip_output+0x16b/0x4f0 [ 3875.311929][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3875.312251][ C1] ? __pfx_ip_output+0x10/0x10 [ 3875.312507][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3875.312859][ C1] ? __pfx_ip_output+0x10/0x10 [ 3875.313116][ C1] __ip_queue_xmit+0x672/0x1910 [ 3875.313375][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3875.313653][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3875.313946][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3875.314231][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3875.314524][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3875.314808][ C1] tcp_delack_timer+0x84/0x240 [ 3875.315062][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3875.315350][ C1] call_timer_fn+0x176/0x430 [ 3875.315599][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3875.315871][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3875.316151][ C1] __run_timers.part.0+0x52d/0x890 [ 3875.316424][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3875.316710][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3875.317009][ C1] ? __pfx___schedule+0x10/0x10 [ 3875.317273][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3875.317592][ C1] run_timer_softirq+0x72/0x100 [ 3875.317853][ C1] __do_softirq+0x1bc/0x7ff [ 3875.318098][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3875.318374][ C1] run_ksoftirqd+0x2e/0x60 [ 3875.318611][ C1] smpboot_thread_fn+0x30e/0x840 [ 3875.318878][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3875.319173][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3875.319466][ C1] kthread+0x292/0x360 [ 3875.319680][ C1] ? __pfx_kthread+0x10/0x10 [ 3875.319932][ C1] ret_from_fork+0x34/0x70 [ 3875.320170][ C1] ? __pfx_kthread+0x10/0x10 [ 3875.320418][ C1] ret_from_fork_asm+0x1b/0x30 [ 3875.320678][ C1] [ 3900.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2526s! [swapper/0:0] [ 3900.527922][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3900.529124][ C0] irq event stamp: 27567077 [ 3900.529366][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3900.529897][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3900.530371][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3900.530873][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3900.531364][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3900.531838][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3900.532485][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3900.532828][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3900.533850][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3900.534176][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3900.534599][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3900.535024][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3900.535444][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3900.535864][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3900.536286][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3900.536760][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3900.537113][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3900.537534][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3900.537956][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3900.538381][ C0] Call Trace: [ 3900.538563][ C0] [ 3900.538720][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3900.538995][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3900.539254][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3900.539545][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3900.539835][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3900.540139][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3900.540420][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3900.540744][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3900.541016][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3900.541295][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3900.541619][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3900.541927][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3900.542264][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3900.542566][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3900.542875][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3900.543180][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3900.543510][ C0] ? get_stack_info+0x36/0xc0 [ 3900.543761][ C0] ? lock_acquire+0x1c1/0x220 [ 3900.544010][ C0] ? lock_release+0x1d5/0x250 [ 3900.544259][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3900.544516][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3900.544797][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3900.545095][ C0] ? lock_acquire+0x1c1/0x220 [ 3900.545349][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3900.545611][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3900.545887][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3900.546132][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3900.546388][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3900.546656][ C0] ? __inet_lookup_established+0x341/0x610 [ 3900.546975][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3900.547272][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3900.547560][ C0] ip_local_deliver+0x19d/0x480 [ 3900.547822][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3900.548111][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3900.548380][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3900.548658][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3900.548920][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3900.549258][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3900.549531][ C0] ip_rcv+0x564/0x740 [ 3900.549744][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3900.549986][ C0] ? set_track_prepare+0x8a/0xd0 [ 3900.550251][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3900.550542][ C0] ? rest_init+0x153/0x260 [ 3900.550778][ C0] ? skb_clone+0x10b/0x330 [ 3900.551019][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3900.551350][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3900.551667][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3900.551964][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3900.552276][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3900.552538][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3900.552782][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3900.553097][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3900.553397][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3900.553734][ C0] ? lock_acquire+0x1c1/0x220 [ 3900.553982][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3900.554289][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3900.554589][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3900.554918][ C0] ? __copy_skb_header+0xaf/0x490 [ 3900.555184][ C0] ? __skb_clone+0x57a/0x760 [ 3900.555427][ C0] netif_receive_skb+0x55/0x280 [ 3900.555686][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3900.556021][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3900.556371][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3900.556683][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3900.556974][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3900.557280][ C0] ? hlock_class+0x4e/0x130 [ 3900.557525][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3900.557850][ C0] ? place_entity+0x21/0x2f0 [ 3900.558094][ C0] ? resched_curr+0x219/0x280 [ 3900.558350][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3900.558620][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3900.558904][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3900.559178][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3900.559433][ C0] ? activate_task+0xf5/0x260 [ 3900.559682][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3900.559954][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3900.560228][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3900.560484][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3900.560771][ C0] ? get_stack_info+0x36/0xc0 [ 3900.561022][ C0] ? stack_access_ok+0xda/0x1f0 [ 3900.561283][ C0] ? get_reg+0x119/0x190 [ 3900.561514][ C0] __tcf_classify+0x32c/0x7d0 [ 3900.561761][ C0] tcf_classify+0x283/0x930 [ 3900.562002][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3900.562331][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3900.562598][ C0] ? arch_stack_walk+0x8c/0x100 [ 3900.562861][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3900.563162][ C0] tc_run+0x2e4/0x5d0 [ 3900.563376][ C0] ? __pfx_tc_run+0x10/0x10 [ 3900.563618][ C0] ? lock_acquire+0x1c1/0x220 [ 3900.563865][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3900.564136][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3900.564403][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3900.564686][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3900.564960][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3900.565276][ C0] ? neigh_hh_output+0x348/0x590 [ 3900.565540][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3900.565814][ C0] ip_finish_output2+0x786/0x18e0 [ 3900.566082][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3900.566373][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3900.566725][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3900.567013][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3900.567283][ C0] ? __ip_finish_output+0x10f/0x770 [ 3900.567556][ C0] ip_output+0x16b/0x4f0 [ 3900.567780][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3900.568064][ C0] ? __pfx_ip_output+0x10/0x10 [ 3900.568317][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3900.568615][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3900.568877][ C0] ? ip_local_out+0x114/0x3b0 [ 3900.569133][ C0] __ip_queue_xmit+0x672/0x1910 [ 3900.569398][ C0] ? __skb_clone+0x57a/0x760 [ 3900.569645][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3900.569926][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3900.570219][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3900.570534][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3900.570793][ C0] ? tcp_current_mss+0x40a/0x510 [ 3900.571056][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3900.571338][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3900.571612][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3900.571867][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3900.572138][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3900.572458][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3900.572734][ C0] ? ktime_get+0xb6/0x190 [ 3900.572963][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3900.573234][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3900.573516][ C0] tcp_write_timer+0x82/0x1d0 [ 3900.573766][ C0] call_timer_fn+0x176/0x430 [ 3900.574012][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3900.574286][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3900.574557][ C0] __run_timers.part.0+0x52d/0x890 [ 3900.574830][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3900.575111][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3900.575412][ C0] ? lock_acquire+0x1c1/0x220 [ 3900.575660][ C0] ? clockevents_program_event+0xf6/0x300 [ 3900.575962][ C0] ? lock_release+0x1d5/0x250 [ 3900.576208][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3900.576481][ C0] ? ktime_get+0xb6/0x190 [ 3900.576713][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3900.577009][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3900.577326][ C0] run_timer_softirq+0x72/0x100 [ 3900.577589][ C0] __do_softirq+0x1bc/0x7ff [ 3900.577835][ C0] irq_exit_rcu+0x98/0xc0 [ 3900.578068][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3900.578367][ C0] [ 3900.578523][ C0] [ 3900.578679][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3900.578994][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3900.579266][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3900.580288][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3900.580612][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3900.581038][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3900.581458][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3900.581878][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3900.582306][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3900.582732][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3900.583037][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3900.583312][ C0] default_idle_call+0x69/0xa0 [ 3900.583566][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3900.583829][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3900.584120][ C0] ? lock_release+0x1d5/0x250 [ 3900.584374][ C0] do_idle+0xfb/0x160 [ 3900.584592][ C0] cpu_startup_entry+0x55/0x60 [ 3900.584849][ C0] rest_init+0x153/0x260 [ 3900.585073][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3900.585363][ C0] arch_call_rest_init+0x13/0x40 [ 3900.585634][ C0] start_kernel+0x314/0x3d0 [ 3900.585878][ C0] x86_64_start_reservations+0x18/0x30 [ 3900.586170][ C0] x86_64_start_kernel+0xba/0x110 [ 3900.586439][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3900.586769][ C0] [ 3900.586935][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2526s! [ksoftirqd/1:22] [ 3900.587407][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3900.588593][ C1] irq event stamp: 3886976 [ 3900.588827][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3900.589327][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3900.589824][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3900.590323][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3900.590809][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3900.591306][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3900.591951][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3900.592296][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3900.593321][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3900.593646][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3900.594072][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3900.594493][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3900.594913][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3900.595342][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3900.595769][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3900.596242][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3900.596590][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3900.597019][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3900.597450][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3900.597869][ C1] Call Trace: [ 3900.598048][ C1] [ 3900.598207][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3900.598482][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3900.598741][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3900.599030][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3900.599319][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3900.599623][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3900.599904][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3900.600230][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3900.600503][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3900.600831][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3900.601145][ C1] [ 3900.601302][ C1] [ 3900.601458][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3900.601787][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3900.602094][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3900.602406][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3900.602711][ C1] ? run_ksoftirqd+0xb/0x60 [ 3900.602956][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3900.603281][ C1] ? __orc_find+0x9c/0xf0 [ 3900.603515][ C1] ? lock_acquire+0x1c1/0x220 [ 3900.603768][ C1] ? irqentry_enter+0x2b/0x60 [ 3900.604021][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3900.604284][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3900.604573][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3900.604876][ C1] ? lock_acquire+0x1c1/0x220 [ 3900.605126][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3900.605379][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3900.605656][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3900.605905][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3900.606166][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3900.606444][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3900.606735][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3900.607027][ C1] ip_local_deliver+0x19d/0x480 [ 3900.607289][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3900.607576][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3900.607845][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3900.608121][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3900.608385][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3900.608722][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3900.608995][ C1] ip_rcv+0x564/0x740 [ 3900.609209][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3900.609448][ C1] ? set_track_prepare+0x8a/0xd0 [ 3900.609712][ C1] ? irqentry_enter+0x2b/0x60 [ 3900.609967][ C1] ? irqentry_enter+0x2b/0x60 [ 3900.610225][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3900.610469][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3900.610786][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3900.611131][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3900.611444][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3900.611785][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3900.612083][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3900.612418][ C1] netif_receive_skb+0x55/0x280 [ 3900.612679][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3900.613008][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3900.613360][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3900.613672][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3900.613963][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3900.614269][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3900.614600][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3900.614883][ C1] ? arch_stack_walk+0x68/0x100 [ 3900.615144][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3900.615419][ C1] ? irqentry_enter+0x2b/0x60 [ 3900.615670][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3900.615988][ C1] ? irqentry_enter+0x2b/0x60 [ 3900.616243][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3900.616568][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3900.616846][ C1] ? arch_stack_walk+0x68/0x100 [ 3900.617115][ C1] __tcf_classify+0x32c/0x7d0 [ 3900.617367][ C1] tcf_classify+0x283/0x930 [ 3900.617608][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3900.617875][ C1] tc_run+0x2e4/0x5d0 [ 3900.618091][ C1] ? __pfx_tc_run+0x10/0x10 [ 3900.618333][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3900.618599][ C1] ? irqentry_enter+0x2b/0x60 [ 3900.618854][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3900.619143][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3900.619465][ C1] ip_finish_output2+0x786/0x18e0 [ 3900.619735][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3900.620026][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3900.620291][ C1] ? __ip_finish_output+0x10f/0x770 [ 3900.620567][ C1] ip_output+0x16b/0x4f0 [ 3900.620795][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3900.621113][ C1] ? __pfx_ip_output+0x10/0x10 [ 3900.621367][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3900.621722][ C1] ? __pfx_ip_output+0x10/0x10 [ 3900.621979][ C1] __ip_queue_xmit+0x672/0x1910 [ 3900.622238][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3900.622516][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3900.622811][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3900.623095][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3900.623390][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3900.623675][ C1] tcp_delack_timer+0x84/0x240 [ 3900.623934][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3900.624223][ C1] call_timer_fn+0x176/0x430 [ 3900.624474][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3900.624746][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3900.625026][ C1] __run_timers.part.0+0x52d/0x890 [ 3900.625300][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3900.625587][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3900.625885][ C1] ? __pfx___schedule+0x10/0x10 [ 3900.626148][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3900.626470][ C1] run_timer_softirq+0x72/0x100 [ 3900.626732][ C1] __do_softirq+0x1bc/0x7ff [ 3900.626973][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3900.627254][ C1] run_ksoftirqd+0x2e/0x60 [ 3900.627490][ C1] smpboot_thread_fn+0x30e/0x840 [ 3900.627756][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3900.628045][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3900.628339][ C1] kthread+0x292/0x360 [ 3900.628557][ C1] ? __pfx_kthread+0x10/0x10 [ 3900.628805][ C1] ret_from_fork+0x34/0x70 [ 3900.629044][ C1] ? __pfx_kthread+0x10/0x10 [ 3900.629291][ C1] ret_from_fork_asm+0x1b/0x30 [ 3900.629550][ C1] [ 3928.527459][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2552s! [swapper/0:0] [ 3928.527920][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3928.529122][ C0] irq event stamp: 27567077 [ 3928.529364][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3928.529893][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3928.530365][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3928.530865][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3928.531357][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3928.531835][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3928.532482][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3928.532825][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3928.533849][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3928.534179][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3928.534604][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3928.535029][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3928.535449][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3928.535870][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3928.536295][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3928.536768][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3928.537122][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3928.537541][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3928.537965][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3928.538395][ C0] Call Trace: [ 3928.538576][ C0] [ 3928.538733][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3928.539008][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3928.539267][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3928.539559][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3928.539849][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3928.540153][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3928.540434][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3928.540758][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3928.541030][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3928.541311][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3928.541632][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3928.541946][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3928.542280][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3928.542581][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3928.542889][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3928.543194][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3928.543522][ C0] ? get_stack_info+0x36/0xc0 [ 3928.543773][ C0] ? lock_acquire+0x1c1/0x220 [ 3928.544023][ C0] ? lock_release+0x1d5/0x250 [ 3928.544272][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3928.544528][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3928.544809][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3928.545108][ C0] ? lock_acquire+0x1c1/0x220 [ 3928.545362][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3928.545625][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3928.545899][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3928.546144][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3928.546400][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3928.546668][ C0] ? __inet_lookup_established+0x341/0x610 [ 3928.546989][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3928.547278][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3928.547566][ C0] ip_local_deliver+0x19d/0x480 [ 3928.547832][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3928.548120][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3928.548394][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3928.548670][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3928.548933][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3928.549273][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3928.549547][ C0] ip_rcv+0x564/0x740 [ 3928.549760][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3928.550003][ C0] ? set_track_prepare+0x8a/0xd0 [ 3928.550269][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3928.550563][ C0] ? rest_init+0x153/0x260 [ 3928.550800][ C0] ? skb_clone+0x10b/0x330 [ 3928.551042][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3928.551372][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3928.551688][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3928.551985][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3928.552298][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3928.552560][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3928.552805][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3928.553121][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3928.553422][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3928.553760][ C0] ? lock_acquire+0x1c1/0x220 [ 3928.554009][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3928.554316][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3928.554617][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3928.554947][ C0] ? __copy_skb_header+0xaf/0x490 [ 3928.555214][ C0] ? __skb_clone+0x57a/0x760 [ 3928.555458][ C0] netif_receive_skb+0x55/0x280 [ 3928.555718][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3928.556051][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3928.556400][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3928.556711][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3928.557006][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3928.557311][ C0] ? hlock_class+0x4e/0x130 [ 3928.557557][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3928.557884][ C0] ? place_entity+0x21/0x2f0 [ 3928.558129][ C0] ? resched_curr+0x219/0x280 [ 3928.558381][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3928.558653][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3928.558939][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3928.559215][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3928.559472][ C0] ? activate_task+0xf5/0x260 [ 3928.559727][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3928.560000][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3928.560275][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3928.560533][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3928.560824][ C0] ? get_stack_info+0x36/0xc0 [ 3928.561078][ C0] ? stack_access_ok+0xda/0x1f0 [ 3928.561339][ C0] ? get_reg+0x119/0x190 [ 3928.561569][ C0] __tcf_classify+0x32c/0x7d0 [ 3928.561824][ C0] tcf_classify+0x283/0x930 [ 3928.562066][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3928.562395][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3928.562662][ C0] ? arch_stack_walk+0x8c/0x100 [ 3928.562924][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3928.563218][ C0] tc_run+0x2e4/0x5d0 [ 3928.563434][ C0] ? __pfx_tc_run+0x10/0x10 [ 3928.563675][ C0] ? lock_acquire+0x1c1/0x220 [ 3928.563924][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3928.564197][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3928.564465][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3928.564749][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3928.565025][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3928.565342][ C0] ? neigh_hh_output+0x348/0x590 [ 3928.565608][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3928.565883][ C0] ip_finish_output2+0x786/0x18e0 [ 3928.566151][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3928.566445][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3928.566799][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3928.567098][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3928.567368][ C0] ? __ip_finish_output+0x10f/0x770 [ 3928.567644][ C0] ip_output+0x16b/0x4f0 [ 3928.567870][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3928.568157][ C0] ? __pfx_ip_output+0x10/0x10 [ 3928.568411][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3928.568712][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3928.568975][ C0] ? ip_local_out+0x114/0x3b0 [ 3928.569232][ C0] __ip_queue_xmit+0x672/0x1910 [ 3928.569498][ C0] ? __skb_clone+0x57a/0x760 [ 3928.569745][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3928.570025][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3928.570320][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3928.570636][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3928.570898][ C0] ? tcp_current_mss+0x40a/0x510 [ 3928.571163][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3928.571446][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3928.571721][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3928.571976][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3928.572246][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3928.572568][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3928.572844][ C0] ? ktime_get+0xb6/0x190 [ 3928.573076][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3928.573348][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3928.573631][ C0] tcp_write_timer+0x82/0x1d0 [ 3928.573882][ C0] call_timer_fn+0x176/0x430 [ 3928.574130][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3928.574405][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3928.574677][ C0] __run_timers.part.0+0x52d/0x890 [ 3928.574951][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3928.575233][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3928.575535][ C0] ? lock_acquire+0x1c1/0x220 [ 3928.575785][ C0] ? clockevents_program_event+0xf6/0x300 [ 3928.576089][ C0] ? lock_release+0x1d5/0x250 [ 3928.576335][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3928.576609][ C0] ? ktime_get+0xb6/0x190 [ 3928.576839][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3928.577145][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3928.577454][ C0] run_timer_softirq+0x72/0x100 [ 3928.577718][ C0] __do_softirq+0x1bc/0x7ff [ 3928.577964][ C0] irq_exit_rcu+0x98/0xc0 [ 3928.578198][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3928.578499][ C0] [ 3928.578655][ C0] [ 3928.578811][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3928.579128][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3928.579404][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3928.580433][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3928.580759][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3928.581187][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3928.581609][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3928.582032][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3928.582456][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3928.582883][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3928.583190][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3928.583465][ C0] default_idle_call+0x69/0xa0 [ 3928.583719][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3928.583983][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3928.584273][ C0] ? lock_release+0x1d5/0x250 [ 3928.584529][ C0] do_idle+0xfb/0x160 [ 3928.584749][ C0] cpu_startup_entry+0x55/0x60 [ 3928.585008][ C0] rest_init+0x153/0x260 [ 3928.585233][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3928.585527][ C0] arch_call_rest_init+0x13/0x40 [ 3928.585797][ C0] start_kernel+0x314/0x3d0 [ 3928.586041][ C0] x86_64_start_reservations+0x18/0x30 [ 3928.586336][ C0] x86_64_start_kernel+0xba/0x110 [ 3928.586607][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3928.586946][ C0] [ 3928.587113][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2552s! [ksoftirqd/1:22] [ 3928.587575][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3928.588763][ C1] irq event stamp: 3886976 [ 3928.588997][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3928.589498][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3928.589993][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3928.590492][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3928.590977][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3928.591472][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3928.592120][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3928.592462][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3928.593485][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3928.593814][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3928.594235][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3928.594658][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3928.595083][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3928.595501][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3928.595920][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3928.596393][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3928.596740][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3928.597165][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3928.597585][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3928.598008][ C1] Call Trace: [ 3928.598194][ C1] [ 3928.598351][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3928.598625][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3928.598882][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3928.599170][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3928.599458][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3928.599763][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3928.600046][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3928.600365][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3928.600637][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3928.600965][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3928.601275][ C1] [ 3928.601431][ C1] [ 3928.601587][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3928.601916][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3928.602222][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3928.602534][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3928.602838][ C1] ? run_ksoftirqd+0xb/0x60 [ 3928.603078][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3928.603404][ C1] ? __orc_find+0x9c/0xf0 [ 3928.603636][ C1] ? lock_acquire+0x1c1/0x220 [ 3928.603892][ C1] ? irqentry_enter+0x2b/0x60 [ 3928.604148][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3928.604410][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3928.604696][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3928.604995][ C1] ? lock_acquire+0x1c1/0x220 [ 3928.605242][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3928.605491][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3928.605761][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3928.606011][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3928.606271][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3928.606545][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3928.606836][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3928.607139][ C1] ip_local_deliver+0x19d/0x480 [ 3928.607403][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3928.607690][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3928.607956][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3928.608232][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3928.608495][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3928.608831][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3928.609105][ C1] ip_rcv+0x564/0x740 [ 3928.609321][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3928.609561][ C1] ? set_track_prepare+0x8a/0xd0 [ 3928.609824][ C1] ? irqentry_enter+0x2b/0x60 [ 3928.610076][ C1] ? irqentry_enter+0x2b/0x60 [ 3928.610328][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3928.610571][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3928.610890][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3928.611234][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3928.611544][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3928.611881][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3928.612179][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3928.612515][ C1] netif_receive_skb+0x55/0x280 [ 3928.612776][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3928.613108][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3928.613457][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3928.613770][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3928.614061][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3928.614368][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3928.614697][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3928.614979][ C1] ? arch_stack_walk+0x68/0x100 [ 3928.615241][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3928.615516][ C1] ? irqentry_enter+0x2b/0x60 [ 3928.615763][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3928.616080][ C1] ? irqentry_enter+0x2b/0x60 [ 3928.616332][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3928.616658][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3928.616945][ C1] ? arch_stack_walk+0x68/0x100 [ 3928.617204][ C1] __tcf_classify+0x32c/0x7d0 [ 3928.617456][ C1] tcf_classify+0x283/0x930 [ 3928.617696][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3928.617963][ C1] tc_run+0x2e4/0x5d0 [ 3928.618176][ C1] ? __pfx_tc_run+0x10/0x10 [ 3928.618418][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3928.618681][ C1] ? irqentry_enter+0x2b/0x60 [ 3928.618931][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3928.619218][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3928.619542][ C1] ip_finish_output2+0x786/0x18e0 [ 3928.619812][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3928.620098][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3928.620365][ C1] ? __ip_finish_output+0x10f/0x770 [ 3928.620642][ C1] ip_output+0x16b/0x4f0 [ 3928.620867][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3928.621188][ C1] ? __pfx_ip_output+0x10/0x10 [ 3928.621444][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3928.621799][ C1] ? __pfx_ip_output+0x10/0x10 [ 3928.622058][ C1] __ip_queue_xmit+0x672/0x1910 [ 3928.622322][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3928.622605][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3928.622899][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3928.623186][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3928.623479][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3928.623762][ C1] tcp_delack_timer+0x84/0x240 [ 3928.624014][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3928.624301][ C1] call_timer_fn+0x176/0x430 [ 3928.624550][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3928.624822][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3928.625102][ C1] __run_timers.part.0+0x52d/0x890 [ 3928.625377][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3928.625662][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3928.625960][ C1] ? __pfx___schedule+0x10/0x10 [ 3928.626225][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3928.626544][ C1] run_timer_softirq+0x72/0x100 [ 3928.626802][ C1] __do_softirq+0x1bc/0x7ff [ 3928.627052][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3928.627327][ C1] run_ksoftirqd+0x2e/0x60 [ 3928.627564][ C1] smpboot_thread_fn+0x30e/0x840 [ 3928.627831][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3928.628121][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3928.628411][ C1] kthread+0x292/0x360 [ 3928.628627][ C1] ? __pfx_kthread+0x10/0x10 [ 3928.628874][ C1] ret_from_fork+0x34/0x70 [ 3928.629109][ C1] ? __pfx_kthread+0x10/0x10 [ 3928.629356][ C1] ret_from_fork_asm+0x1b/0x30 [ 3928.629616][ C1] [ 3953.322023][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3953.322413][ C0] rcu: 0-....: (2756092 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=656460 [ 3953.322928][ C0] rcu: (t=2759013 jiffies g=1007429 q=31 ncpus=4) [ 3953.323278][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3953.323757][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3953.324409][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3953.324759][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3953.325787][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3953.326120][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3953.326546][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3953.326972][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3953.327389][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3953.327808][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3953.328226][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3953.328691][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3953.329046][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3953.329467][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3953.329886][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3953.330307][ C0] Call Trace: [ 3953.330489][ C0] [ 3953.330646][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3953.330930][ C0] ? print_cpu_stall+0x263/0x6a0 [ 3953.331197][ C0] ? check_cpu_stall+0x284/0x500 [ 3953.331459][ C0] ? rcu_pending+0x92/0x360 [ 3953.331705][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3953.331990][ C0] ? update_process_times+0xb9/0x110 [ 3953.332272][ C0] ? tick_sched_handle+0x67/0x130 [ 3953.332545][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3953.332844][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3953.333096][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3953.333424][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3953.333706][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3953.334006][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3953.334286][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3953.334603][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3953.334879][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3953.335155][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3953.335485][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3953.335799][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3953.336129][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3953.336438][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3953.336749][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3953.337062][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3953.337394][ C0] ? get_stack_info+0x36/0xc0 [ 3953.337646][ C0] ? lock_acquire+0x1c1/0x220 [ 3953.337898][ C0] ? lock_release+0x1d5/0x250 [ 3953.338148][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3953.338408][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3953.338692][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3953.338988][ C0] ? lock_acquire+0x1c1/0x220 [ 3953.339238][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3953.339495][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3953.339770][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3953.340016][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3953.340274][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3953.340540][ C0] ? __inet_lookup_established+0x341/0x610 [ 3953.340856][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3953.341152][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3953.341446][ C0] ip_local_deliver+0x19d/0x480 [ 3953.341708][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3953.341990][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3953.342254][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3953.342534][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3953.342800][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3953.343136][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3953.343413][ C0] ip_rcv+0x564/0x740 [ 3953.343629][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3953.343873][ C0] ? set_track_prepare+0x8a/0xd0 [ 3953.344142][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3953.344431][ C0] ? rest_init+0x153/0x260 [ 3953.344669][ C0] ? skb_clone+0x10b/0x330 [ 3953.344909][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3953.345260][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3953.345584][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3953.345879][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3953.346187][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3953.346445][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3953.346684][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3953.347005][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3953.347307][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3953.347644][ C0] ? lock_acquire+0x1c1/0x220 [ 3953.347890][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3953.348199][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3953.348499][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3953.348829][ C0] ? __copy_skb_header+0xaf/0x490 [ 3953.349095][ C0] ? __skb_clone+0x57a/0x760 [ 3953.349342][ C0] netif_receive_skb+0x55/0x280 [ 3953.349606][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3953.349935][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3953.350287][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3953.350598][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3953.350887][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3953.351189][ C0] ? hlock_class+0x4e/0x130 [ 3953.351436][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3953.351773][ C0] ? place_entity+0x21/0x2f0 [ 3953.352023][ C0] ? resched_curr+0x219/0x280 [ 3953.352274][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3953.352540][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3953.352819][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3953.353103][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3953.353361][ C0] ? activate_task+0xf5/0x260 [ 3953.353613][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3953.353890][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3953.354163][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3953.354430][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3953.354722][ C0] ? get_stack_info+0x36/0xc0 [ 3953.354972][ C0] ? stack_access_ok+0xda/0x1f0 [ 3953.355229][ C0] ? get_reg+0x119/0x190 [ 3953.355457][ C0] __tcf_classify+0x32c/0x7d0 [ 3953.355712][ C0] tcf_classify+0x283/0x930 [ 3953.355956][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3953.356286][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3953.356550][ C0] ? arch_stack_walk+0x8c/0x100 [ 3953.356810][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3953.357109][ C0] tc_run+0x2e4/0x5d0 [ 3953.357322][ C0] ? __pfx_tc_run+0x10/0x10 [ 3953.357562][ C0] ? lock_acquire+0x1c1/0x220 [ 3953.357809][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3953.358083][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3953.358352][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3953.358635][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3953.358911][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3953.359231][ C0] ? neigh_hh_output+0x348/0x590 [ 3953.359499][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3953.359777][ C0] ip_finish_output2+0x786/0x18e0 [ 3953.360045][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3953.360334][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3953.360691][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3953.360983][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3953.361246][ C0] ? __ip_finish_output+0x10f/0x770 [ 3953.361525][ C0] ip_output+0x16b/0x4f0 [ 3953.361753][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3953.362034][ C0] ? __pfx_ip_output+0x10/0x10 [ 3953.362292][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3953.362591][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3953.362854][ C0] ? ip_local_out+0x114/0x3b0 [ 3953.363103][ C0] __ip_queue_xmit+0x672/0x1910 [ 3953.363361][ C0] ? __skb_clone+0x57a/0x760 [ 3953.363606][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3953.363891][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3953.364188][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3953.364515][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3953.364768][ C0] ? tcp_current_mss+0x40a/0x510 [ 3953.365035][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3953.365315][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3953.365593][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3953.365848][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3953.366114][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3953.366430][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3953.366709][ C0] ? ktime_get+0xb6/0x190 [ 3953.366955][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3953.367228][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3953.367511][ C0] tcp_write_timer+0x82/0x1d0 [ 3953.367758][ C0] call_timer_fn+0x176/0x430 [ 3953.368001][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3953.368279][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3953.368550][ C0] __run_timers.part.0+0x52d/0x890 [ 3953.368825][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3953.369105][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3953.369404][ C0] ? lock_acquire+0x1c1/0x220 [ 3953.369649][ C0] ? clockevents_program_event+0xf6/0x300 [ 3953.369953][ C0] ? lock_release+0x1d5/0x250 [ 3953.370203][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3953.370478][ C0] ? ktime_get+0xb6/0x190 [ 3953.370707][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3953.371003][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3953.371314][ C0] run_timer_softirq+0x72/0x100 [ 3953.371570][ C0] __do_softirq+0x1bc/0x7ff [ 3953.371810][ C0] irq_exit_rcu+0x98/0xc0 [ 3953.372040][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3953.372338][ C0] [ 3953.372497][ C0] [ 3953.372657][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3953.372979][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3953.373246][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3953.374258][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3953.374579][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3953.374995][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3953.375413][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3953.375829][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3953.376248][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3953.376666][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3953.376972][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3953.377248][ C0] default_idle_call+0x69/0xa0 [ 3953.377500][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3953.377767][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3953.378058][ C0] ? lock_release+0x1d5/0x250 [ 3953.378311][ C0] do_idle+0xfb/0x160 [ 3953.378524][ C0] cpu_startup_entry+0x55/0x60 [ 3953.378779][ C0] rest_init+0x153/0x260 [ 3953.379003][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3953.379294][ C0] arch_call_rest_init+0x13/0x40 [ 3953.379559][ C0] start_kernel+0x314/0x3d0 [ 3953.379798][ C0] x86_64_start_reservations+0x18/0x30 [ 3953.380087][ C0] x86_64_start_kernel+0xba/0x110 [ 3953.380358][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3953.380686][ C0] [ 3953.380854][ C0] Sending NMI from CPU 0 to CPUs 1: [ 3953.381141][ C1] NMI backtrace for cpu 1 [ 3953.381149][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3953.381154][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3953.381157][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3953.381166][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3953.381169][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 3953.381173][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3953.381175][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3953.381177][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3953.381178][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3953.381181][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3953.381182][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3953.381184][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3953.381188][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3953.381190][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3953.381191][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3953.381193][ C1] Call Trace: [ 3953.381196][ C1] [ 3953.381201][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 3953.381207][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3953.381213][ C1] ? nmi_handle+0x156/0x420 [ 3953.381219][ C1] ? default_do_nmi+0x41/0x100 [ 3953.381223][ C1] ? exc_nmi+0xf3/0x120 [ 3953.381225][ C1] ? end_repeat_nmi+0xf/0x60 [ 3953.381230][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3953.381235][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3953.381238][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3953.381242][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3953.381245][ C1] [ 3953.381246][ C1] [ 3953.381247][ C1] ? run_ksoftirqd+0xb/0x60 [ 3953.381253][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3953.381256][ C1] ? __orc_find+0x9c/0xf0 [ 3953.381259][ C1] ? lock_acquire+0x1c1/0x220 [ 3953.381263][ C1] ? irqentry_enter+0x2b/0x60 [ 3953.381268][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3953.381272][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3953.381275][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3953.381278][ C1] ? lock_acquire+0x1c1/0x220 [ 3953.381281][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3953.381286][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3953.381290][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3953.381297][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3953.381300][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3953.381306][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3953.381314][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3953.381318][ C1] ip_local_deliver+0x19d/0x480 [ 3953.381321][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3953.381324][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3953.381328][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3953.381332][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3953.381335][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3953.381339][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3953.381348][ C1] ip_rcv+0x564/0x740 [ 3953.381352][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3953.381355][ C1] ? set_track_prepare+0x8a/0xd0 [ 3953.381360][ C1] ? irqentry_enter+0x2b/0x60 [ 3953.381363][ C1] ? irqentry_enter+0x2b/0x60 [ 3953.381367][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3953.381369][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3953.381373][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3953.381377][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3953.381380][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3953.381383][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3953.381386][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3953.381391][ C1] netif_receive_skb+0x55/0x280 [ 3953.381394][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3953.381403][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3953.381410][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3953.381417][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3953.381424][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3953.381436][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3953.381446][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3953.381449][ C1] ? arch_stack_walk+0x68/0x100 [ 3953.381454][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3953.381457][ C1] ? irqentry_enter+0x2b/0x60 [ 3953.381461][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3953.381466][ C1] ? irqentry_enter+0x2b/0x60 [ 3953.381469][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3953.381476][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3953.381479][ C1] ? arch_stack_walk+0x68/0x100 [ 3953.381483][ C1] __tcf_classify+0x32c/0x7d0 [ 3953.381488][ C1] tcf_classify+0x283/0x930 [ 3953.381492][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3953.381496][ C1] tc_run+0x2e4/0x5d0 [ 3953.381501][ C1] ? __pfx_tc_run+0x10/0x10 [ 3953.381506][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3953.381512][ C1] ? irqentry_enter+0x2b/0x60 [ 3953.381515][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3953.381518][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3953.381525][ C1] ip_finish_output2+0x786/0x18e0 [ 3953.381531][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3953.381534][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3953.381538][ C1] ? __ip_finish_output+0x10f/0x770 [ 3953.381542][ C1] ip_output+0x16b/0x4f0 [ 3953.381545][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3953.381549][ C1] ? __pfx_ip_output+0x10/0x10 [ 3953.381553][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3953.381560][ C1] ? __pfx_ip_output+0x10/0x10 [ 3953.381564][ C1] __ip_queue_xmit+0x672/0x1910 [ 3953.381569][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3953.381576][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3953.381580][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3953.381584][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3953.381588][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3953.381591][ C1] tcp_delack_timer+0x84/0x240 [ 3953.381595][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3953.381598][ C1] call_timer_fn+0x176/0x430 [ 3953.381603][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3953.381608][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3953.381612][ C1] __run_timers.part.0+0x52d/0x890 [ 3953.381615][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3953.381620][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3953.381624][ C1] ? __pfx___schedule+0x10/0x10 [ 3953.381628][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3953.381633][ C1] run_timer_softirq+0x72/0x100 [ 3953.381636][ C1] __do_softirq+0x1bc/0x7ff [ 3953.381640][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3953.381644][ C1] run_ksoftirqd+0x2e/0x60 [ 3953.381647][ C1] smpboot_thread_fn+0x30e/0x840 [ 3953.381651][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3953.381655][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3953.381658][ C1] kthread+0x292/0x360 [ 3953.381660][ C1] ? __pfx_kthread+0x10/0x10 [ 3953.381663][ C1] ret_from_fork+0x34/0x70 [ 3953.381666][ C1] ? __pfx_kthread+0x10/0x10 [ 3953.381668][ C1] ret_from_fork_asm+0x1b/0x30 [ 3953.381676][ C1] [ 3980.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2601s! [swapper/0:0] [ 3980.527922][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3980.529122][ C0] irq event stamp: 27567077 [ 3980.529364][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 3980.529898][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 3980.530372][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 3980.530874][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 3980.531366][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 3980.531843][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3980.532498][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3980.532839][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3980.533861][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 3980.534193][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3980.534614][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 3980.535036][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 3980.535460][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 3980.535883][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 3980.536303][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 3980.536777][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3980.537132][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 3980.537551][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3980.537967][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3980.538388][ C0] Call Trace: [ 3980.538571][ C0] [ 3980.538731][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3980.539005][ C0] ? __run_hrtimer+0x1c3/0x710 [ 3980.539263][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3980.539551][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 3980.539842][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3980.540147][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3980.540429][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3980.540752][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 3980.541023][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 3980.541302][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3980.541627][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3980.541938][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3980.542275][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3980.542578][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3980.542885][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3980.543197][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3980.543524][ C0] ? get_stack_info+0x36/0xc0 [ 3980.543778][ C0] ? lock_acquire+0x1c1/0x220 [ 3980.544029][ C0] ? lock_release+0x1d5/0x250 [ 3980.544280][ C0] do_raw_spin_lock+0x1ec/0x270 [ 3980.544551][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3980.544836][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3980.545133][ C0] ? lock_acquire+0x1c1/0x220 [ 3980.545383][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 3980.545637][ C0] _raw_spin_lock_nested+0x65/0x80 [ 3980.545912][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 3980.546160][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3980.546418][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 3980.546685][ C0] ? __inet_lookup_established+0x341/0x610 [ 3980.547012][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 3980.547302][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 3980.547594][ C0] ip_local_deliver+0x19d/0x480 [ 3980.547855][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 3980.548143][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3980.548410][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 3980.548685][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3980.548946][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3980.549284][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3980.549558][ C0] ip_rcv+0x564/0x740 [ 3980.549769][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3980.550008][ C0] ? set_track_prepare+0x8a/0xd0 [ 3980.550271][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 3980.550564][ C0] ? rest_init+0x153/0x260 [ 3980.550798][ C0] ? skb_clone+0x10b/0x330 [ 3980.551040][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3980.551374][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3980.551692][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 3980.551993][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3980.552304][ C0] ? __tcf_classify+0x32c/0x7d0 [ 3980.552565][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 3980.552808][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 3980.553129][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3980.553429][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3980.553767][ C0] ? lock_acquire+0x1c1/0x220 [ 3980.554012][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 3980.554322][ C0] netif_receive_skb_internal+0xb0/0x300 [ 3980.554621][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3980.554952][ C0] ? __copy_skb_header+0xaf/0x490 [ 3980.555219][ C0] ? __skb_clone+0x57a/0x760 [ 3980.555463][ C0] netif_receive_skb+0x55/0x280 [ 3980.555727][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3980.556058][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3980.556409][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3980.556724][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 3980.557009][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 3980.557305][ C0] ? hlock_class+0x4e/0x130 [ 3980.557550][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3980.557879][ C0] ? place_entity+0x21/0x2f0 [ 3980.558128][ C0] ? resched_curr+0x219/0x280 [ 3980.558383][ C0] ? __pfx_resched_curr+0x10/0x10 [ 3980.558653][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 3980.558938][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 3980.559214][ C0] ? wakeup_preempt+0x161/0x2c0 [ 3980.559472][ C0] ? activate_task+0xf5/0x260 [ 3980.559719][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 3980.559995][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 3980.560269][ C0] ? _raw_spin_unlock+0x23/0x40 [ 3980.560527][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3980.560818][ C0] ? get_stack_info+0x36/0xc0 [ 3980.561074][ C0] ? stack_access_ok+0xda/0x1f0 [ 3980.561335][ C0] ? get_reg+0x119/0x190 [ 3980.561564][ C0] __tcf_classify+0x32c/0x7d0 [ 3980.561816][ C0] tcf_classify+0x283/0x930 [ 3980.562056][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3980.562380][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 3980.562651][ C0] ? arch_stack_walk+0x8c/0x100 [ 3980.562915][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 3980.563207][ C0] tc_run+0x2e4/0x5d0 [ 3980.563421][ C0] ? __pfx_tc_run+0x10/0x10 [ 3980.563661][ C0] ? lock_acquire+0x1c1/0x220 [ 3980.563908][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 3980.564184][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 3980.564453][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3980.564736][ C0] ? ip_finish_output2+0x786/0x18e0 [ 3980.565012][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3980.565332][ C0] ? neigh_hh_output+0x348/0x590 [ 3980.565600][ C0] ? ip_finish_output2+0x262/0x18e0 [ 3980.565878][ C0] ip_finish_output2+0x786/0x18e0 [ 3980.566147][ C0] ? stack_depot_save_flags+0x45/0x550 [ 3980.566437][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3980.566798][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 3980.567090][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3980.567357][ C0] ? __ip_finish_output+0x10f/0x770 [ 3980.567634][ C0] ip_output+0x16b/0x4f0 [ 3980.567859][ C0] ? __run_timers.part.0+0x52d/0x890 [ 3980.568145][ C0] ? __pfx_ip_output+0x10/0x10 [ 3980.568398][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3980.568703][ C0] ? rcu_read_lock_held+0xe/0x50 [ 3980.568966][ C0] ? ip_local_out+0x114/0x3b0 [ 3980.569220][ C0] __ip_queue_xmit+0x672/0x1910 [ 3980.569483][ C0] ? __skb_clone+0x57a/0x760 [ 3980.569733][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 3980.570011][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3980.570304][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 3980.570624][ C0] tcp_write_xmit+0xe42/0x24c0 [ 3980.570882][ C0] ? tcp_current_mss+0x40a/0x510 [ 3980.571145][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 3980.571429][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 3980.571704][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 3980.571955][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 3980.572228][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3980.572547][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3980.572823][ C0] ? ktime_get+0xb6/0x190 [ 3980.573056][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 3980.573329][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3980.573613][ C0] tcp_write_timer+0x82/0x1d0 [ 3980.573862][ C0] call_timer_fn+0x176/0x430 [ 3980.574107][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 3980.574384][ C0] ? next_expiry_recalc+0xcd/0x220 [ 3980.574657][ C0] __run_timers.part.0+0x52d/0x890 [ 3980.574934][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 3980.575222][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 3980.575521][ C0] ? lock_acquire+0x1c1/0x220 [ 3980.575767][ C0] ? clockevents_program_event+0xf6/0x300 [ 3980.576076][ C0] ? lock_release+0x1d5/0x250 [ 3980.576327][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 3980.576602][ C0] ? ktime_get+0xb6/0x190 [ 3980.576837][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 3980.577139][ C0] ? clockevents_program_event+0x1ed/0x300 [ 3980.577448][ C0] run_timer_softirq+0x72/0x100 [ 3980.577709][ C0] __do_softirq+0x1bc/0x7ff [ 3980.577956][ C0] irq_exit_rcu+0x98/0xc0 [ 3980.578190][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 3980.578492][ C0] [ 3980.578648][ C0] [ 3980.578805][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3980.579127][ C0] RIP: 0010:default_idle+0xf/0x20 [ 3980.579397][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3980.580423][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 3980.580750][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 3980.581173][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 3980.581598][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 3980.582022][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 3980.582443][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 3980.582867][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3980.583175][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 3980.583450][ C0] default_idle_call+0x69/0xa0 [ 3980.583702][ C0] cpuidle_idle_call+0x1f6/0x280 [ 3980.583970][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3980.584263][ C0] ? lock_release+0x1d5/0x250 [ 3980.584516][ C0] do_idle+0xfb/0x160 [ 3980.584730][ C0] cpu_startup_entry+0x55/0x60 [ 3980.584986][ C0] rest_init+0x153/0x260 [ 3980.585212][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 3980.585503][ C0] arch_call_rest_init+0x13/0x40 [ 3980.585772][ C0] start_kernel+0x314/0x3d0 [ 3980.586013][ C0] x86_64_start_reservations+0x18/0x30 [ 3980.586303][ C0] x86_64_start_kernel+0xba/0x110 [ 3980.586576][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 3980.586911][ C0] [ 3980.587076][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2601s! [ksoftirqd/1:22] [ 3980.587546][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 3980.588742][ C1] irq event stamp: 3886976 [ 3980.588975][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 3980.589476][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 3980.589972][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 3980.590478][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 3980.590965][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 3980.591458][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3980.592108][ C1] RIP: 0010:kasan_check_range+0x16/0x1c0 [ 3980.592413][ C1] Code: 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 <48> 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe [ 3980.593430][ C1] RSP: 0018:ffffc9000019e9d8 EFLAGS: 00000202 [ 3980.593753][ C1] RAX: ffff88800a098e18 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 3980.594172][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 3980.594588][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 3980.595005][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 3980.595423][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 3980.595843][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3980.596314][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3980.596667][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 3980.597095][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3980.597512][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3980.597928][ C1] Call Trace: [ 3980.598107][ C1] [ 3980.598264][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3980.598545][ C1] ? __run_hrtimer+0x1c3/0x710 [ 3980.598799][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3980.599091][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3980.599373][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3980.599674][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3980.599953][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 3980.600271][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3980.600549][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 3980.600876][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 3980.601184][ C1] [ 3980.601342][ C1] [ 3980.601501][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3980.601836][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3980.602139][ C1] ? kasan_check_range+0x16/0x1c0 [ 3980.602408][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 3980.602702][ C1] ? run_ksoftirqd+0xb/0x60 [ 3980.602944][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3980.603275][ C1] ? __orc_find+0x9c/0xf0 [ 3980.603508][ C1] ? lock_acquire+0x1c1/0x220 [ 3980.603764][ C1] ? irqentry_enter+0x2b/0x60 [ 3980.604020][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3980.604286][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3980.604575][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3980.604876][ C1] ? lock_acquire+0x1c1/0x220 [ 3980.605125][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 3980.605375][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3980.605649][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 3980.605899][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3980.606164][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3980.606437][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3980.606732][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 3980.607021][ C1] ip_local_deliver+0x19d/0x480 [ 3980.607284][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3980.607575][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3980.607843][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 3980.608122][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3980.608385][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3980.608724][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3980.609002][ C1] ip_rcv+0x564/0x740 [ 3980.609217][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3980.609459][ C1] ? set_track_prepare+0x8a/0xd0 [ 3980.609727][ C1] ? irqentry_enter+0x2b/0x60 [ 3980.609980][ C1] ? irqentry_enter+0x2b/0x60 [ 3980.610234][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3980.610483][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3980.610799][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3980.611144][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3980.611456][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3980.611794][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3980.612092][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3980.612427][ C1] netif_receive_skb+0x55/0x280 [ 3980.612692][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3980.613021][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3980.613372][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3980.613687][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 3980.613980][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3980.614286][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3980.614617][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3980.614899][ C1] ? arch_stack_walk+0x68/0x100 [ 3980.615158][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 3980.615432][ C1] ? irqentry_enter+0x2b/0x60 [ 3980.615680][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3980.616000][ C1] ? irqentry_enter+0x2b/0x60 [ 3980.616256][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3980.616579][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 3980.616864][ C1] ? arch_stack_walk+0x68/0x100 [ 3980.617122][ C1] __tcf_classify+0x32c/0x7d0 [ 3980.617370][ C1] tcf_classify+0x283/0x930 [ 3980.617611][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3980.617879][ C1] tc_run+0x2e4/0x5d0 [ 3980.618095][ C1] ? __pfx_tc_run+0x10/0x10 [ 3980.618340][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 3980.618606][ C1] ? irqentry_enter+0x2b/0x60 [ 3980.618859][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3980.619148][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3980.619474][ C1] ip_finish_output2+0x786/0x18e0 [ 3980.619744][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3980.620032][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3980.620299][ C1] ? __ip_finish_output+0x10f/0x770 [ 3980.620576][ C1] ip_output+0x16b/0x4f0 [ 3980.620802][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3980.621126][ C1] ? __pfx_ip_output+0x10/0x10 [ 3980.621383][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 3980.621738][ C1] ? __pfx_ip_output+0x10/0x10 [ 3980.621997][ C1] __ip_queue_xmit+0x672/0x1910 [ 3980.622258][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3980.622536][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3980.622830][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3980.623118][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3980.623413][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3980.623698][ C1] tcp_delack_timer+0x84/0x240 [ 3980.623953][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3980.624242][ C1] call_timer_fn+0x176/0x430 [ 3980.624492][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3980.624767][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 3980.625048][ C1] __run_timers.part.0+0x52d/0x890 [ 3980.625323][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3980.625611][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3980.625910][ C1] ? __pfx___schedule+0x10/0x10 [ 3980.626173][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3980.626495][ C1] run_timer_softirq+0x72/0x100 [ 3980.626759][ C1] __do_softirq+0x1bc/0x7ff [ 3980.627005][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 3980.627282][ C1] run_ksoftirqd+0x2e/0x60 [ 3980.627519][ C1] smpboot_thread_fn+0x30e/0x840 [ 3980.627787][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3980.628080][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 3980.628373][ C1] kthread+0x292/0x360 [ 3980.628588][ C1] ? __pfx_kthread+0x10/0x10 [ 3980.628836][ C1] ret_from_fork+0x34/0x70 [ 3980.629076][ C1] ? __pfx_kthread+0x10/0x10 [ 3980.629325][ C1] ret_from_fork_asm+0x1b/0x30 [ 3980.629586][ C1] [ 4008.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2627s! [swapper/0:0] [ 4008.527921][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4008.529117][ C0] irq event stamp: 27567077 [ 4008.529358][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4008.529890][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4008.530377][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4008.530888][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4008.531392][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4008.531879][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4008.532525][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4008.532867][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4008.533889][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4008.534213][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4008.534632][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4008.535051][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4008.535468][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4008.535889][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4008.536309][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4008.536786][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4008.537138][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4008.537571][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4008.537998][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4008.538416][ C0] Call Trace: [ 4008.538595][ C0] [ 4008.538751][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4008.539031][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4008.539287][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4008.539581][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4008.539866][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4008.540168][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4008.540447][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4008.540767][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4008.541047][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4008.541324][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4008.541655][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4008.541971][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4008.542301][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4008.542611][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4008.542924][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4008.543228][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4008.543555][ C0] ? get_stack_info+0x36/0xc0 [ 4008.543815][ C0] ? lock_acquire+0x1c1/0x220 [ 4008.544074][ C0] ? lock_release+0x1d5/0x250 [ 4008.544329][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4008.544597][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4008.544888][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4008.545192][ C0] ? lock_acquire+0x1c1/0x220 [ 4008.545440][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4008.545693][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4008.545968][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4008.546221][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4008.546487][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4008.546765][ C0] ? __inet_lookup_established+0x341/0x610 [ 4008.547079][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4008.547380][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4008.547677][ C0] ip_local_deliver+0x19d/0x480 [ 4008.547936][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4008.548223][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4008.548487][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4008.548769][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4008.549036][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4008.549370][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4008.549651][ C0] ip_rcv+0x564/0x740 [ 4008.549866][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4008.550112][ C0] ? set_track_prepare+0x8a/0xd0 [ 4008.550379][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4008.550668][ C0] ? rest_init+0x153/0x260 [ 4008.550911][ C0] ? skb_clone+0x10b/0x330 [ 4008.551152][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4008.551491][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4008.551813][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4008.552109][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4008.552418][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4008.552676][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4008.552915][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4008.553233][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4008.553533][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4008.553877][ C0] ? lock_acquire+0x1c1/0x220 [ 4008.554130][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4008.554445][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4008.554744][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4008.555081][ C0] ? __copy_skb_header+0xaf/0x490 [ 4008.555354][ C0] ? __skb_clone+0x57a/0x760 [ 4008.555604][ C0] netif_receive_skb+0x55/0x280 [ 4008.555862][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4008.556189][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4008.556537][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4008.556856][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4008.557148][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4008.557450][ C0] ? hlock_class+0x4e/0x130 [ 4008.557700][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4008.558036][ C0] ? place_entity+0x21/0x2f0 [ 4008.558287][ C0] ? resched_curr+0x219/0x280 [ 4008.558540][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4008.558807][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4008.559094][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4008.559376][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4008.559638][ C0] ? activate_task+0xf5/0x260 [ 4008.559893][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4008.560173][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4008.560445][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4008.560707][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4008.561003][ C0] ? get_stack_info+0x36/0xc0 [ 4008.561256][ C0] ? stack_access_ok+0xda/0x1f0 [ 4008.561514][ C0] ? get_reg+0x119/0x190 [ 4008.561740][ C0] __tcf_classify+0x32c/0x7d0 [ 4008.561997][ C0] tcf_classify+0x283/0x930 [ 4008.562244][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4008.562577][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4008.562842][ C0] ? arch_stack_walk+0x8c/0x100 [ 4008.563105][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4008.563395][ C0] tc_run+0x2e4/0x5d0 [ 4008.563613][ C0] ? __pfx_tc_run+0x10/0x10 [ 4008.563858][ C0] ? lock_acquire+0x1c1/0x220 [ 4008.564111][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4008.564389][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4008.564655][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4008.564943][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4008.565226][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4008.565548][ C0] ? neigh_hh_output+0x348/0x590 [ 4008.565814][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4008.566096][ C0] ip_finish_output2+0x786/0x18e0 [ 4008.566370][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4008.566672][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4008.567029][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4008.567324][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4008.567589][ C0] ? __ip_finish_output+0x10f/0x770 [ 4008.567871][ C0] ip_output+0x16b/0x4f0 [ 4008.568099][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4008.568380][ C0] ? __pfx_ip_output+0x10/0x10 [ 4008.568638][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4008.568939][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4008.569207][ C0] ? ip_local_out+0x114/0x3b0 [ 4008.569457][ C0] __ip_queue_xmit+0x672/0x1910 [ 4008.569714][ C0] ? __skb_clone+0x57a/0x760 [ 4008.569958][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4008.570246][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4008.570543][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4008.570867][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4008.571126][ C0] ? tcp_current_mss+0x40a/0x510 [ 4008.571392][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4008.571671][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4008.571950][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4008.572208][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4008.572475][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4008.572792][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4008.573073][ C0] ? ktime_get+0xb6/0x190 [ 4008.573308][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4008.573584][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4008.573862][ C0] tcp_write_timer+0x82/0x1d0 [ 4008.574117][ C0] call_timer_fn+0x176/0x430 [ 4008.574366][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4008.574640][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4008.574916][ C0] __run_timers.part.0+0x52d/0x890 [ 4008.575189][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4008.575474][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4008.575773][ C0] ? lock_acquire+0x1c1/0x220 [ 4008.576025][ C0] ? clockevents_program_event+0xf6/0x300 [ 4008.576336][ C0] ? lock_release+0x1d5/0x250 [ 4008.576596][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4008.576871][ C0] ? ktime_get+0xb6/0x190 [ 4008.577101][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4008.577398][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4008.577715][ C0] run_timer_softirq+0x72/0x100 [ 4008.577974][ C0] __do_softirq+0x1bc/0x7ff [ 4008.578218][ C0] irq_exit_rcu+0x98/0xc0 [ 4008.578447][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4008.578747][ C0] [ 4008.578906][ C0] [ 4008.579066][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4008.579391][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4008.579659][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4008.580678][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4008.581003][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4008.581421][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4008.581839][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4008.582260][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4008.582684][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4008.583105][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4008.583408][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4008.583681][ C0] default_idle_call+0x69/0xa0 [ 4008.583937][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4008.584202][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4008.584497][ C0] ? lock_release+0x1d5/0x250 [ 4008.584749][ C0] do_idle+0xfb/0x160 [ 4008.584961][ C0] cpu_startup_entry+0x55/0x60 [ 4008.585213][ C0] rest_init+0x153/0x260 [ 4008.585443][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4008.585732][ C0] arch_call_rest_init+0x13/0x40 [ 4008.585998][ C0] start_kernel+0x314/0x3d0 [ 4008.586245][ C0] x86_64_start_reservations+0x18/0x30 [ 4008.586540][ C0] x86_64_start_kernel+0xba/0x110 [ 4008.586816][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4008.587148][ C0] [ 4008.587318][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2627s! [ksoftirqd/1:22] [ 4008.587796][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4008.588990][ C1] irq event stamp: 3886976 [ 4008.589228][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4008.589730][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4008.590228][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4008.590729][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4008.591217][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4008.591714][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4008.592361][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4008.592708][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4008.593731][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4008.594056][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4008.594481][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4008.594902][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4008.595323][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4008.595748][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4008.596176][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4008.596654][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4008.597007][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4008.597431][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4008.597857][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4008.598277][ C1] Call Trace: [ 4008.598457][ C1] [ 4008.598617][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4008.598893][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4008.599151][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4008.599441][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4008.599730][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4008.600035][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4008.600317][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4008.600641][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4008.600914][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4008.601239][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4008.601552][ C1] [ 4008.601708][ C1] [ 4008.601864][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4008.602194][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4008.602501][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4008.602813][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4008.603115][ C1] ? run_ksoftirqd+0xb/0x60 [ 4008.603359][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4008.603683][ C1] ? __orc_find+0x9c/0xf0 [ 4008.603918][ C1] ? lock_acquire+0x1c1/0x220 [ 4008.604171][ C1] ? irqentry_enter+0x2b/0x60 [ 4008.604424][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4008.604686][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4008.604975][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4008.605278][ C1] ? lock_acquire+0x1c1/0x220 [ 4008.605529][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4008.605786][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4008.606060][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4008.606309][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4008.606576][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4008.606847][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4008.607136][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4008.607426][ C1] ip_local_deliver+0x19d/0x480 [ 4008.607687][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4008.607972][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4008.608241][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4008.608517][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4008.608779][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4008.609119][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4008.609392][ C1] ip_rcv+0x564/0x740 [ 4008.609606][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4008.609846][ C1] ? set_track_prepare+0x8a/0xd0 [ 4008.610112][ C1] ? irqentry_enter+0x2b/0x60 [ 4008.610367][ C1] ? irqentry_enter+0x2b/0x60 [ 4008.610623][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4008.610867][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4008.611186][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4008.611529][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4008.611841][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4008.612179][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4008.612476][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4008.612811][ C1] netif_receive_skb+0x55/0x280 [ 4008.613073][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4008.613405][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4008.613758][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4008.614070][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4008.614362][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4008.614668][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4008.615003][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4008.615287][ C1] ? arch_stack_walk+0x68/0x100 [ 4008.615547][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4008.615822][ C1] ? irqentry_enter+0x2b/0x60 [ 4008.616073][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4008.616391][ C1] ? irqentry_enter+0x2b/0x60 [ 4008.616649][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4008.616969][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4008.617253][ C1] ? arch_stack_walk+0x68/0x100 [ 4008.617514][ C1] __tcf_classify+0x32c/0x7d0 [ 4008.617764][ C1] tcf_classify+0x283/0x930 [ 4008.618007][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4008.618275][ C1] tc_run+0x2e4/0x5d0 [ 4008.618491][ C1] ? __pfx_tc_run+0x10/0x10 [ 4008.618733][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4008.619000][ C1] ? irqentry_enter+0x2b/0x60 [ 4008.619256][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4008.619545][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4008.619868][ C1] ip_finish_output2+0x786/0x18e0 [ 4008.620137][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4008.620425][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4008.620690][ C1] ? __ip_finish_output+0x10f/0x770 [ 4008.620966][ C1] ip_output+0x16b/0x4f0 [ 4008.621195][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4008.621518][ C1] ? __pfx_ip_output+0x10/0x10 [ 4008.621773][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4008.622129][ C1] ? __pfx_ip_output+0x10/0x10 [ 4008.622387][ C1] __ip_queue_xmit+0x672/0x1910 [ 4008.622646][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4008.622925][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4008.623217][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4008.623501][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4008.623793][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4008.624080][ C1] tcp_delack_timer+0x84/0x240 [ 4008.624336][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4008.624625][ C1] call_timer_fn+0x176/0x430 [ 4008.624876][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4008.625150][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4008.625429][ C1] __run_timers.part.0+0x52d/0x890 [ 4008.625704][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4008.625993][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4008.626293][ C1] ? __pfx___schedule+0x10/0x10 [ 4008.626554][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4008.626882][ C1] run_timer_softirq+0x72/0x100 [ 4008.627145][ C1] __do_softirq+0x1bc/0x7ff [ 4008.627392][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4008.627666][ C1] run_ksoftirqd+0x2e/0x60 [ 4008.627902][ C1] smpboot_thread_fn+0x30e/0x840 [ 4008.628169][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4008.628458][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4008.628752][ C1] kthread+0x292/0x360 [ 4008.628971][ C1] ? __pfx_kthread+0x10/0x10 [ 4008.629220][ C1] ret_from_fork+0x34/0x70 [ 4008.629458][ C1] ? __pfx_kthread+0x10/0x10 [ 4008.629706][ C1] ret_from_fork_asm+0x1b/0x30 [ 4008.629964][ C1] [ 4031.385024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4031.385405][ C1] rcu: 1-....: (2829644 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=675736 [ 4031.385990][ C1] rcu: (t=2837076 jiffies g=1007429 q=31 ncpus=4) [ 4031.386333][ C1] Sending NMI from CPU 1 to CPUs 0: [ 4031.386624][ C0] NMI backtrace for cpu 0 [ 4031.386633][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4031.386638][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4031.386641][ C0] RIP: 0010:kasan_check_range+0x84/0x1c0 [ 4031.386653][ C0] Code: 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 89 da 48 29 ea <48> 83 fa 10 0f 8e c0 00 00 00 41 89 eb 41 83 e3 07 75 7d 48 85 d2 [ 4031.386655][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000202 [ 4031.386660][ C0] RAX: ffffed100141336b RBX: ffffed100141336c RCX: ffffffff90c7aaa0 [ 4031.386662][ C0] RDX: 0000000000000001 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4031.386664][ C0] RBP: ffffed100141336b R08: 0000000000000000 R09: ffffed100141336b [ 4031.386666][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4031.386667][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4031.386669][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4031.386671][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4031.386675][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4031.386677][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4031.386678][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4031.386680][ C0] Call Trace: [ 4031.386684][ C0] [ 4031.386687][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 4031.386693][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4031.386699][ C0] ? nmi_handle+0x156/0x420 [ 4031.386705][ C0] ? default_do_nmi+0x41/0x100 [ 4031.386709][ C0] ? exc_nmi+0xf3/0x120 [ 4031.386712][ C0] ? end_repeat_nmi+0xf/0x60 [ 4031.386717][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4031.386723][ C0] ? kasan_check_range+0x84/0x1c0 [ 4031.386727][ C0] ? kasan_check_range+0x84/0x1c0 [ 4031.386731][ C0] ? kasan_check_range+0x84/0x1c0 [ 4031.386734][ C0] [ 4031.386735][ C0] [ 4031.386737][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 4031.386740][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4031.386743][ C0] ? get_stack_info+0x36/0xc0 [ 4031.386750][ C0] ? lock_acquire+0x1c1/0x220 [ 4031.386756][ C0] ? lock_release+0x1d5/0x250 [ 4031.386759][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4031.386764][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4031.386767][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4031.386770][ C0] ? lock_acquire+0x1c1/0x220 [ 4031.386772][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4031.386778][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4031.386782][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4031.386789][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4031.386792][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4031.386797][ C0] ? __inet_lookup_established+0x341/0x610 [ 4031.386803][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4031.386811][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4031.386815][ C0] ip_local_deliver+0x19d/0x480 [ 4031.386818][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4031.386821][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4031.386827][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4031.386831][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4031.386834][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4031.386838][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4031.386848][ C0] ip_rcv+0x564/0x740 [ 4031.386851][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4031.386854][ C0] ? set_track_prepare+0x8a/0xd0 [ 4031.386859][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4031.386861][ C0] ? rest_init+0x153/0x260 [ 4031.386864][ C0] ? skb_clone+0x10b/0x330 [ 4031.386870][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4031.386876][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4031.386882][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4031.386888][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4031.386897][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4031.386900][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4031.386903][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4031.386908][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4031.386911][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4031.386915][ C0] ? lock_acquire+0x1c1/0x220 [ 4031.386917][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4031.386920][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4031.386923][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4031.386927][ C0] ? __copy_skb_header+0xaf/0x490 [ 4031.386930][ C0] ? __skb_clone+0x57a/0x760 [ 4031.386932][ C0] netif_receive_skb+0x55/0x280 [ 4031.386935][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4031.386944][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4031.386951][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4031.386957][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4031.386962][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4031.386971][ C0] ? hlock_class+0x4e/0x130 [ 4031.386978][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4031.386988][ C0] ? place_entity+0x21/0x2f0 [ 4031.386992][ C0] ? resched_curr+0x219/0x280 [ 4031.386996][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4031.386998][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4031.387002][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4031.387006][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4031.387009][ C0] ? activate_task+0xf5/0x260 [ 4031.387012][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4031.387017][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4031.387022][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4031.387026][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4031.387029][ C0] ? get_stack_info+0x36/0xc0 [ 4031.387032][ C0] ? stack_access_ok+0xda/0x1f0 [ 4031.387035][ C0] ? get_reg+0x119/0x190 [ 4031.387038][ C0] __tcf_classify+0x32c/0x7d0 [ 4031.387043][ C0] tcf_classify+0x283/0x930 [ 4031.387046][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4031.387051][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4031.387053][ C0] ? arch_stack_walk+0x8c/0x100 [ 4031.387058][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4031.387062][ C0] tc_run+0x2e4/0x5d0 [ 4031.387066][ C0] ? __pfx_tc_run+0x10/0x10 [ 4031.387070][ C0] ? lock_acquire+0x1c1/0x220 [ 4031.387072][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4031.387078][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4031.387084][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4031.387087][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4031.387090][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4031.387095][ C0] ? neigh_hh_output+0x348/0x590 [ 4031.387100][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4031.387104][ C0] ip_finish_output2+0x786/0x18e0 [ 4031.387108][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4031.387114][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4031.387121][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4031.387124][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4031.387129][ C0] ? __ip_finish_output+0x10f/0x770 [ 4031.387133][ C0] ip_output+0x16b/0x4f0 [ 4031.387136][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4031.387141][ C0] ? __pfx_ip_output+0x10/0x10 [ 4031.387144][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4031.387148][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4031.387151][ C0] ? ip_local_out+0x114/0x3b0 [ 4031.387156][ C0] __ip_queue_xmit+0x672/0x1910 [ 4031.387160][ C0] ? __skb_clone+0x57a/0x760 [ 4031.387164][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4031.387172][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4031.387176][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4031.387180][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4031.387186][ C0] ? tcp_current_mss+0x40a/0x510 [ 4031.387189][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4031.387192][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4031.387194][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4031.387196][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4031.387199][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4031.387203][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4031.387208][ C0] ? ktime_get+0xb6/0x190 [ 4031.387212][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4031.387216][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4031.387219][ C0] tcp_write_timer+0x82/0x1d0 [ 4031.387223][ C0] call_timer_fn+0x176/0x430 [ 4031.387227][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4031.387231][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4031.387235][ C0] __run_timers.part.0+0x52d/0x890 [ 4031.387238][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4031.387243][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4031.387246][ C0] ? lock_acquire+0x1c1/0x220 [ 4031.387248][ C0] ? clockevents_program_event+0xf6/0x300 [ 4031.387254][ C0] ? lock_release+0x1d5/0x250 [ 4031.387256][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4031.387259][ C0] ? ktime_get+0xb6/0x190 [ 4031.387262][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4031.387266][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4031.387270][ C0] run_timer_softirq+0x72/0x100 [ 4031.387273][ C0] __do_softirq+0x1bc/0x7ff [ 4031.387278][ C0] irq_exit_rcu+0x98/0xc0 [ 4031.387281][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4031.387285][ C0] [ 4031.387286][ C0] [ 4031.387287][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4031.387294][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4031.387297][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4031.387300][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4031.387302][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4031.387304][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4031.387306][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4031.387308][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4031.387309][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4031.387313][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4031.387316][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4031.387321][ C0] default_idle_call+0x69/0xa0 [ 4031.387323][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4031.387325][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4031.387331][ C0] ? lock_release+0x1d5/0x250 [ 4031.387335][ C0] do_idle+0xfb/0x160 [ 4031.387338][ C0] cpu_startup_entry+0x55/0x60 [ 4031.387340][ C0] rest_init+0x153/0x260 [ 4031.387342][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4031.387349][ C0] arch_call_rest_init+0x13/0x40 [ 4031.387355][ C0] start_kernel+0x314/0x3d0 [ 4031.387359][ C0] x86_64_start_reservations+0x18/0x30 [ 4031.387365][ C0] x86_64_start_kernel+0xba/0x110 [ 4031.387368][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4031.387377][ C0] [ 4031.387619][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4031.441829][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4031.442474][ C1] RIP: 0010:__kasan_check_read+0x8/0x20 [ 4031.442774][ C1] Code: 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 48 8b 0c 24 <89> f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f [ 4031.443787][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [ 4031.444108][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4031.444527][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4031.444943][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4031.445360][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4031.445777][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4031.446196][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4031.446671][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4031.447019][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4031.447446][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4031.447870][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4031.448287][ C1] Call Trace: [ 4031.448463][ C1] [ 4031.448619][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4031.448909][ C1] ? print_cpu_stall+0x263/0x6a0 [ 4031.449172][ C1] ? check_cpu_stall+0x284/0x500 [ 4031.449438][ C1] ? rcu_pending+0x92/0x360 [ 4031.449677][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4031.449957][ C1] ? update_process_times+0xb9/0x110 [ 4031.450241][ C1] ? tick_sched_handle+0x67/0x130 [ 4031.450509][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4031.450806][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4031.451061][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4031.451386][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4031.451673][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4031.451975][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4031.452256][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4031.452579][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4031.452852][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4031.453177][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4031.453491][ C1] [ 4031.453647][ C1] [ 4031.453803][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4031.454132][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4031.454439][ C1] ? __kasan_check_read+0x8/0x20 [ 4031.454703][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 4031.454995][ C1] ? run_ksoftirqd+0xb/0x60 [ 4031.455237][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4031.455557][ C1] ? __orc_find+0x9c/0xf0 [ 4031.455790][ C1] ? lock_acquire+0x1c1/0x220 [ 4031.456043][ C1] ? irqentry_enter+0x2b/0x60 [ 4031.456296][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4031.456563][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4031.456846][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4031.457143][ C1] ? lock_acquire+0x1c1/0x220 [ 4031.457397][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4031.457653][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4031.457928][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4031.458173][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4031.458431][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4031.458699][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4031.458987][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4031.459277][ C1] ip_local_deliver+0x19d/0x480 [ 4031.459538][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4031.459823][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4031.460088][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4031.460362][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4031.460624][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4031.460966][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4031.461240][ C1] ip_rcv+0x564/0x740 [ 4031.461451][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4031.461689][ C1] ? set_track_prepare+0x8a/0xd0 [ 4031.461951][ C1] ? irqentry_enter+0x2b/0x60 [ 4031.462205][ C1] ? irqentry_enter+0x2b/0x60 [ 4031.462459][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4031.462702][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4031.463021][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4031.463362][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4031.463672][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4031.464008][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4031.464305][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4031.464639][ C1] netif_receive_skb+0x55/0x280 [ 4031.464899][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4031.465234][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4031.465583][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4031.465894][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4031.466188][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4031.466496][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4031.466823][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4031.467102][ C1] ? arch_stack_walk+0x68/0x100 [ 4031.467368][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4031.467646][ C1] ? irqentry_enter+0x2b/0x60 [ 4031.467901][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4031.468222][ C1] ? irqentry_enter+0x2b/0x60 [ 4031.468469][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4031.468791][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4031.469074][ C1] ? arch_stack_walk+0x68/0x100 [ 4031.469333][ C1] __tcf_classify+0x32c/0x7d0 [ 4031.469585][ C1] tcf_classify+0x283/0x930 [ 4031.469828][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4031.470096][ C1] tc_run+0x2e4/0x5d0 [ 4031.470308][ C1] ? __pfx_tc_run+0x10/0x10 [ 4031.470549][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4031.470812][ C1] ? irqentry_enter+0x2b/0x60 [ 4031.471065][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4031.471353][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4031.471675][ C1] ip_finish_output2+0x786/0x18e0 [ 4031.471942][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4031.472232][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4031.472497][ C1] ? __ip_finish_output+0x10f/0x770 [ 4031.472772][ C1] ip_output+0x16b/0x4f0 [ 4031.472997][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4031.473318][ C1] ? __pfx_ip_output+0x10/0x10 [ 4031.473571][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4031.473927][ C1] ? __pfx_ip_output+0x10/0x10 [ 4031.474186][ C1] __ip_queue_xmit+0x672/0x1910 [ 4031.474445][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4031.474723][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4031.475016][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4031.475299][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4031.475590][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4031.475871][ C1] tcp_delack_timer+0x84/0x240 [ 4031.476124][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4031.476413][ C1] call_timer_fn+0x176/0x430 [ 4031.476668][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4031.476945][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4031.477222][ C1] __run_timers.part.0+0x52d/0x890 [ 4031.477492][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4031.477779][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4031.478082][ C1] ? __pfx___schedule+0x10/0x10 [ 4031.478341][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4031.478658][ C1] run_timer_softirq+0x72/0x100 [ 4031.478922][ C1] __do_softirq+0x1bc/0x7ff [ 4031.479170][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4031.479444][ C1] run_ksoftirqd+0x2e/0x60 [ 4031.479681][ C1] smpboot_thread_fn+0x30e/0x840 [ 4031.479947][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4031.480234][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4031.480523][ C1] kthread+0x292/0x360 [ 4031.480740][ C1] ? __pfx_kthread+0x10/0x10 [ 4031.480988][ C1] ret_from_fork+0x34/0x70 [ 4031.481224][ C1] ? __pfx_kthread+0x10/0x10 [ 4031.481470][ C1] ret_from_fork_asm+0x1b/0x30 [ 4031.481725][ C1] [ 4056.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2671s! [swapper/0:0] [ 4056.527925][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4056.529132][ C0] irq event stamp: 27567077 [ 4056.529376][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4056.529910][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4056.530384][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4056.530898][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4056.531392][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4056.531871][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4056.532521][ C0] RIP: 0010:kasan_check_range+0x84/0x1c0 [ 4056.532827][ C0] Code: 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 89 da 48 29 ea <48> 83 fa 10 0f 8e c0 00 00 00 41 89 eb 41 83 e3 07 75 7d 48 85 d2 [ 4056.533845][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000202 [ 4056.534168][ C0] RAX: ffffed100141336b RBX: ffffed100141336c RCX: ffffffff90c7aaa0 [ 4056.534589][ C0] RDX: 0000000000000001 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4056.535009][ C0] RBP: ffffed100141336b R08: 0000000000000000 R09: ffffed100141336b [ 4056.535428][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4056.535846][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4056.536265][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4056.536747][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4056.537095][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4056.537524][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4056.537947][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4056.538366][ C0] Call Trace: [ 4056.538544][ C0] [ 4056.538700][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4056.538979][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4056.539237][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4056.539532][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4056.539817][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4056.540121][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4056.540399][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4056.540722][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4056.540996][ C0] ? hrtimer_interrupt+0x31a/0x770 [ 4056.541271][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4056.541551][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4056.541876][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4056.542189][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4056.542524][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4056.542829][ C0] ? kasan_check_range+0x84/0x1c0 [ 4056.543099][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 4056.543394][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4056.543723][ C0] ? get_stack_info+0x36/0xc0 [ 4056.543981][ C0] ? lock_acquire+0x1c1/0x220 [ 4056.544240][ C0] ? lock_release+0x1d5/0x250 [ 4056.544498][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4056.544763][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4056.545053][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4056.545354][ C0] ? lock_acquire+0x1c1/0x220 [ 4056.545601][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4056.545853][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4056.546126][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4056.546384][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4056.546649][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4056.546918][ C0] ? __inet_lookup_established+0x341/0x610 [ 4056.547232][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4056.547527][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4056.547822][ C0] ip_local_deliver+0x19d/0x480 [ 4056.548083][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4056.548367][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4056.548631][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4056.548912][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4056.549180][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4056.549518][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4056.549797][ C0] ip_rcv+0x564/0x740 [ 4056.550016][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4056.550262][ C0] ? set_track_prepare+0x8a/0xd0 [ 4056.550532][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4056.550823][ C0] ? rest_init+0x153/0x260 [ 4056.551065][ C0] ? skb_clone+0x10b/0x330 [ 4056.551304][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4056.551644][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4056.551970][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4056.552271][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4056.552580][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4056.552839][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4056.553079][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4056.553392][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4056.553690][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4056.554035][ C0] ? lock_acquire+0x1c1/0x220 [ 4056.554289][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4056.554602][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4056.554900][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4056.555237][ C0] ? __copy_skb_header+0xaf/0x490 [ 4056.555513][ C0] ? __skb_clone+0x57a/0x760 [ 4056.555764][ C0] netif_receive_skb+0x55/0x280 [ 4056.556023][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4056.556358][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4056.556710][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4056.557022][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4056.557311][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4056.557615][ C0] ? hlock_class+0x4e/0x130 [ 4056.557866][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4056.558202][ C0] ? place_entity+0x21/0x2f0 [ 4056.558451][ C0] ? resched_curr+0x219/0x280 [ 4056.558704][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4056.558971][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4056.559251][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4056.559531][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4056.559790][ C0] ? activate_task+0xf5/0x260 [ 4056.560045][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4056.560329][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4056.560602][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4056.560867][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4056.561162][ C0] ? get_stack_info+0x36/0xc0 [ 4056.561414][ C0] ? stack_access_ok+0xda/0x1f0 [ 4056.561672][ C0] ? get_reg+0x119/0x190 [ 4056.561901][ C0] __tcf_classify+0x32c/0x7d0 [ 4056.562161][ C0] tcf_classify+0x283/0x930 [ 4056.562409][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4056.562739][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4056.563006][ C0] ? arch_stack_walk+0x8c/0x100 [ 4056.563267][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4056.563556][ C0] tc_run+0x2e4/0x5d0 [ 4056.563775][ C0] ? __pfx_tc_run+0x10/0x10 [ 4056.564021][ C0] ? lock_acquire+0x1c1/0x220 [ 4056.564274][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4056.564552][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4056.564818][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4056.565107][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4056.565388][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4056.565714][ C0] ? neigh_hh_output+0x348/0x590 [ 4056.565980][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4056.566264][ C0] ip_finish_output2+0x786/0x18e0 [ 4056.566540][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4056.566832][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4056.567192][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4056.567486][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4056.567749][ C0] ? __ip_finish_output+0x10f/0x770 [ 4056.568031][ C0] ip_output+0x16b/0x4f0 [ 4056.568259][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4056.568541][ C0] ? __pfx_ip_output+0x10/0x10 [ 4056.568802][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4056.569102][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4056.569368][ C0] ? ip_local_out+0x114/0x3b0 [ 4056.569620][ C0] __ip_queue_xmit+0x672/0x1910 [ 4056.569880][ C0] ? __skb_clone+0x57a/0x760 [ 4056.570128][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4056.570413][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4056.570712][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4056.571034][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4056.571290][ C0] ? tcp_current_mss+0x40a/0x510 [ 4056.571558][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4056.571839][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4056.572120][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4056.572377][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4056.572644][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4056.572962][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4056.573244][ C0] ? ktime_get+0xb6/0x190 [ 4056.573481][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4056.573757][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4056.574039][ C0] tcp_write_timer+0x82/0x1d0 [ 4056.574295][ C0] call_timer_fn+0x176/0x430 [ 4056.574546][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4056.574819][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4056.575096][ C0] __run_timers.part.0+0x52d/0x890 [ 4056.575367][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4056.575653][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4056.575950][ C0] ? lock_acquire+0x1c1/0x220 [ 4056.576205][ C0] ? clockevents_program_event+0xf6/0x300 [ 4056.576523][ C0] ? lock_release+0x1d5/0x250 [ 4056.576775][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4056.577052][ C0] ? ktime_get+0xb6/0x190 [ 4056.577284][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4056.577582][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4056.577898][ C0] run_timer_softirq+0x72/0x100 [ 4056.578156][ C0] __do_softirq+0x1bc/0x7ff [ 4056.578398][ C0] irq_exit_rcu+0x98/0xc0 [ 4056.578628][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4056.578928][ C0] [ 4056.579090][ C0] [ 4056.579251][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4056.579574][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4056.579840][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4056.580854][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4056.581175][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4056.581593][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4056.582010][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4056.582432][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4056.582850][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4056.583270][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4056.583572][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4056.583845][ C0] default_idle_call+0x69/0xa0 [ 4056.584104][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4056.584367][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4056.584660][ C0] ? lock_release+0x1d5/0x250 [ 4056.584910][ C0] do_idle+0xfb/0x160 [ 4056.585122][ C0] cpu_startup_entry+0x55/0x60 [ 4056.585374][ C0] rest_init+0x153/0x260 [ 4056.585605][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4056.585892][ C0] arch_call_rest_init+0x13/0x40 [ 4056.586159][ C0] start_kernel+0x314/0x3d0 [ 4056.586411][ C0] x86_64_start_reservations+0x18/0x30 [ 4056.586700][ C0] x86_64_start_kernel+0xba/0x110 [ 4056.586972][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4056.587302][ C0] [ 4056.587472][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2671s! [ksoftirqd/1:22] [ 4056.587946][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4056.589138][ C1] irq event stamp: 3886976 [ 4056.589374][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4056.589878][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4056.590377][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4056.590878][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4056.591367][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4056.591865][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4056.592514][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4056.592861][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4056.593891][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4056.594217][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4056.594644][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4056.595066][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4056.595488][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4056.595913][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4056.596344][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4056.596815][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4056.597168][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4056.597591][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4056.598017][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4056.598440][ C1] Call Trace: [ 4056.598619][ C1] [ 4056.598780][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4056.599056][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4056.599317][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4056.599607][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4056.599895][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4056.600201][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4056.600483][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4056.600809][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4056.601084][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4056.601410][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4056.601726][ C1] [ 4056.601883][ C1] [ 4056.602041][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4056.602370][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4056.602679][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4056.602993][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4056.603297][ C1] ? run_ksoftirqd+0xb/0x60 [ 4056.603543][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4056.603869][ C1] ? __orc_find+0x9c/0xf0 [ 4056.604105][ C1] ? lock_acquire+0x1c1/0x220 [ 4056.604358][ C1] ? irqentry_enter+0x2b/0x60 [ 4056.604610][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4056.604874][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4056.605164][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4056.605467][ C1] ? lock_acquire+0x1c1/0x220 [ 4056.605717][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4056.605970][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4056.606245][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4056.606500][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4056.606757][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4056.607029][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4056.607318][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4056.607609][ C1] ip_local_deliver+0x19d/0x480 [ 4056.607870][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4056.608157][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4056.608426][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4056.608702][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4056.608966][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4056.609305][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4056.609579][ C1] ip_rcv+0x564/0x740 [ 4056.609792][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4056.610034][ C1] ? set_track_prepare+0x8a/0xd0 [ 4056.610300][ C1] ? irqentry_enter+0x2b/0x60 [ 4056.610556][ C1] ? irqentry_enter+0x2b/0x60 [ 4056.610812][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4056.611058][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4056.611375][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4056.611719][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4056.612033][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4056.612372][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4056.612670][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4056.613005][ C1] netif_receive_skb+0x55/0x280 [ 4056.613268][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4056.613598][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4056.613951][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4056.614263][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4056.614555][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4056.614861][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4056.615194][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4056.615478][ C1] ? arch_stack_walk+0x68/0x100 [ 4056.615739][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4056.616015][ C1] ? irqentry_enter+0x2b/0x60 [ 4056.616267][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4056.616593][ C1] ? irqentry_enter+0x2b/0x60 [ 4056.616844][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4056.617164][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4056.617448][ C1] ? arch_stack_walk+0x68/0x100 [ 4056.617711][ C1] __tcf_classify+0x32c/0x7d0 [ 4056.617963][ C1] tcf_classify+0x283/0x930 [ 4056.618205][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4056.618474][ C1] tc_run+0x2e4/0x5d0 [ 4056.618689][ C1] ? __pfx_tc_run+0x10/0x10 [ 4056.618931][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4056.619199][ C1] ? irqentry_enter+0x2b/0x60 [ 4056.619455][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4056.619745][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4056.620070][ C1] ip_finish_output2+0x786/0x18e0 [ 4056.620339][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4056.620629][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4056.620895][ C1] ? __ip_finish_output+0x10f/0x770 [ 4056.621172][ C1] ip_output+0x16b/0x4f0 [ 4056.621400][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4056.621718][ C1] ? __pfx_ip_output+0x10/0x10 [ 4056.621973][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4056.622331][ C1] ? __pfx_ip_output+0x10/0x10 [ 4056.622589][ C1] __ip_queue_xmit+0x672/0x1910 [ 4056.622848][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4056.623128][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4056.623421][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4056.623704][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4056.623998][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4056.624285][ C1] tcp_delack_timer+0x84/0x240 [ 4056.624542][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4056.624836][ C1] call_timer_fn+0x176/0x430 [ 4056.625089][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4056.625363][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4056.625644][ C1] __run_timers.part.0+0x52d/0x890 [ 4056.625920][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4056.626208][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4056.626514][ C1] ? __pfx___schedule+0x10/0x10 [ 4056.626773][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4056.627095][ C1] run_timer_softirq+0x72/0x100 [ 4056.627359][ C1] __do_softirq+0x1bc/0x7ff [ 4056.627607][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4056.627882][ C1] run_ksoftirqd+0x2e/0x60 [ 4056.628120][ C1] smpboot_thread_fn+0x30e/0x840 [ 4056.628386][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4056.628676][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4056.628971][ C1] kthread+0x292/0x360 [ 4056.629191][ C1] ? __pfx_kthread+0x10/0x10 [ 4056.629440][ C1] ret_from_fork+0x34/0x70 [ 4056.629679][ C1] ? __pfx_kthread+0x10/0x10 [ 4056.629928][ C1] ret_from_fork_asm+0x1b/0x30 [ 4056.630187][ C1] [ 4084.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2698s! [swapper/0:0] [ 4084.527933][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4084.529133][ C0] irq event stamp: 27567077 [ 4084.529376][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4084.529907][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4084.530380][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4084.530879][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4084.531373][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4084.531854][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4084.532503][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4084.532849][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4084.533875][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4084.534201][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4084.534627][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4084.535049][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4084.535470][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4084.535893][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4084.536327][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4084.536796][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4084.537150][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4084.537575][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4084.538004][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4084.538427][ C0] Call Trace: [ 4084.538607][ C0] [ 4084.538766][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4084.539042][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4084.539300][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4084.539590][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4084.539877][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4084.540182][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4084.540464][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4084.540787][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4084.541061][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4084.541342][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4084.541665][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4084.541972][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4084.542306][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4084.542607][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4084.542915][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4084.543219][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4084.543547][ C0] ? get_stack_info+0x36/0xc0 [ 4084.543797][ C0] ? lock_acquire+0x1c1/0x220 [ 4084.544045][ C0] ? lock_release+0x1d5/0x250 [ 4084.544291][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4084.544549][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4084.544834][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4084.545133][ C0] ? lock_acquire+0x1c1/0x220 [ 4084.545385][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4084.545640][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4084.545915][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4084.546160][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4084.546423][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4084.546696][ C0] ? __inet_lookup_established+0x341/0x610 [ 4084.547010][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4084.547298][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4084.547594][ C0] ip_local_deliver+0x19d/0x480 [ 4084.547862][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4084.548151][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4084.548422][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4084.548698][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4084.548960][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4084.549300][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4084.549575][ C0] ip_rcv+0x564/0x740 [ 4084.549786][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4084.550026][ C0] ? set_track_prepare+0x8a/0xd0 [ 4084.550289][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4084.550579][ C0] ? rest_init+0x153/0x260 [ 4084.550814][ C0] ? skb_clone+0x10b/0x330 [ 4084.551058][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4084.551391][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4084.551709][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4084.552007][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4084.552319][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4084.552581][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4084.552825][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4084.553146][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4084.553448][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4084.553787][ C0] ? lock_acquire+0x1c1/0x220 [ 4084.554035][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4084.554346][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4084.554648][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4084.554980][ C0] ? __copy_skb_header+0xaf/0x490 [ 4084.555247][ C0] ? __skb_clone+0x57a/0x760 [ 4084.555490][ C0] netif_receive_skb+0x55/0x280 [ 4084.555751][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4084.556082][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4084.556439][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4084.556756][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4084.557043][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4084.557345][ C0] ? hlock_class+0x4e/0x130 [ 4084.557590][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4084.557923][ C0] ? place_entity+0x21/0x2f0 [ 4084.558169][ C0] ? resched_curr+0x219/0x280 [ 4084.558427][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4084.558698][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4084.558982][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4084.559264][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4084.559522][ C0] ? activate_task+0xf5/0x260 [ 4084.559772][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4084.560047][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4084.560323][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4084.560578][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4084.560866][ C0] ? get_stack_info+0x36/0xc0 [ 4084.561122][ C0] ? stack_access_ok+0xda/0x1f0 [ 4084.561385][ C0] ? get_reg+0x119/0x190 [ 4084.561611][ C0] __tcf_classify+0x32c/0x7d0 [ 4084.561859][ C0] tcf_classify+0x283/0x930 [ 4084.562099][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4084.562428][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4084.562696][ C0] ? arch_stack_walk+0x8c/0x100 [ 4084.562962][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4084.563255][ C0] tc_run+0x2e4/0x5d0 [ 4084.563468][ C0] ? __pfx_tc_run+0x10/0x10 [ 4084.563709][ C0] ? lock_acquire+0x1c1/0x220 [ 4084.563959][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4084.564236][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4084.564507][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4084.564791][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4084.565069][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4084.565386][ C0] ? neigh_hh_output+0x348/0x590 [ 4084.565653][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4084.565929][ C0] ip_finish_output2+0x786/0x18e0 [ 4084.566196][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4084.566498][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4084.566853][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4084.567141][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4084.567409][ C0] ? __ip_finish_output+0x10f/0x770 [ 4084.567686][ C0] ip_output+0x16b/0x4f0 [ 4084.567912][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4084.568197][ C0] ? __pfx_ip_output+0x10/0x10 [ 4084.568449][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4084.568752][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4084.569014][ C0] ? ip_local_out+0x114/0x3b0 [ 4084.569267][ C0] __ip_queue_xmit+0x672/0x1910 [ 4084.569530][ C0] ? __skb_clone+0x57a/0x760 [ 4084.569777][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4084.570057][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4084.570351][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4084.570669][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4084.570928][ C0] ? tcp_current_mss+0x40a/0x510 [ 4084.571192][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4084.571474][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4084.571749][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4084.572002][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4084.572271][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4084.572592][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4084.572867][ C0] ? ktime_get+0xb6/0x190 [ 4084.573099][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4084.573374][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4084.573657][ C0] tcp_write_timer+0x82/0x1d0 [ 4084.573906][ C0] call_timer_fn+0x176/0x430 [ 4084.574152][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4084.574428][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4084.574699][ C0] __run_timers.part.0+0x52d/0x890 [ 4084.574974][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4084.575258][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4084.575559][ C0] ? lock_acquire+0x1c1/0x220 [ 4084.575806][ C0] ? clockevents_program_event+0xf6/0x300 [ 4084.576111][ C0] ? lock_release+0x1d5/0x250 [ 4084.576366][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4084.576645][ C0] ? ktime_get+0xb6/0x190 [ 4084.576879][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4084.577180][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4084.577489][ C0] run_timer_softirq+0x72/0x100 [ 4084.577752][ C0] __do_softirq+0x1bc/0x7ff [ 4084.578000][ C0] irq_exit_rcu+0x98/0xc0 [ 4084.578233][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4084.578536][ C0] [ 4084.578692][ C0] [ 4084.578849][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4084.579169][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4084.579442][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4084.580470][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4084.580798][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4084.581220][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4084.581641][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4084.582067][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4084.582497][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4084.582921][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4084.583227][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4084.583505][ C0] default_idle_call+0x69/0xa0 [ 4084.583757][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4084.584027][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4084.584321][ C0] ? lock_release+0x1d5/0x250 [ 4084.584577][ C0] do_idle+0xfb/0x160 [ 4084.584792][ C0] cpu_startup_entry+0x55/0x60 [ 4084.585050][ C0] rest_init+0x153/0x260 [ 4084.585282][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4084.585574][ C0] arch_call_rest_init+0x13/0x40 [ 4084.585847][ C0] start_kernel+0x314/0x3d0 [ 4084.586089][ C0] x86_64_start_reservations+0x18/0x30 [ 4084.586388][ C0] x86_64_start_kernel+0xba/0x110 [ 4084.586655][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4084.586981][ C0] [ 4084.587146][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2698s! [ksoftirqd/1:22] [ 4084.587621][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4084.588826][ C1] irq event stamp: 3886976 [ 4084.589066][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4084.589563][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4084.590058][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4084.590555][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4084.591053][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4084.591545][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4084.592191][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4084.592533][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4084.593562][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4084.593886][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4084.594306][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4084.594726][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4084.595155][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4084.595574][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4084.595992][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4084.596468][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4084.596818][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4084.597248][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4084.597669][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4084.598093][ C1] Call Trace: [ 4084.598270][ C1] [ 4084.598428][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4084.598709][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4084.598965][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4084.599260][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4084.599544][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4084.599847][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4084.600124][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4084.600443][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4084.600721][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4084.601045][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4084.601355][ C1] [ 4084.601517][ C1] [ 4084.601678][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4084.602013][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4084.602323][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4084.602634][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4084.602942][ C1] ? run_ksoftirqd+0xb/0x60 [ 4084.603192][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4084.603522][ C1] ? __orc_find+0x9c/0xf0 [ 4084.603753][ C1] ? lock_acquire+0x1c1/0x220 [ 4084.604003][ C1] ? irqentry_enter+0x2b/0x60 [ 4084.604253][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4084.604513][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4084.604798][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4084.605098][ C1] ? lock_acquire+0x1c1/0x220 [ 4084.605351][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4084.605609][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4084.605885][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4084.606134][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4084.606398][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4084.606675][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4084.606967][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4084.607262][ C1] ip_local_deliver+0x19d/0x480 [ 4084.607519][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4084.607802][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4084.608067][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4084.608348][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4084.608615][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4084.608950][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4084.609230][ C1] ip_rcv+0x564/0x740 [ 4084.609450][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4084.609695][ C1] ? set_track_prepare+0x8a/0xd0 [ 4084.609965][ C1] ? irqentry_enter+0x2b/0x60 [ 4084.610218][ C1] ? irqentry_enter+0x2b/0x60 [ 4084.610470][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4084.610713][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4084.611027][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4084.611367][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4084.611677][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4084.612020][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4084.612320][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4084.612649][ C1] netif_receive_skb+0x55/0x280 [ 4084.612908][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4084.613235][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4084.613583][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4084.613898][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4084.614187][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4084.614489][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4084.614816][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4084.615098][ C1] ? arch_stack_walk+0x68/0x100 [ 4084.615361][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4084.615641][ C1] ? irqentry_enter+0x2b/0x60 [ 4084.615894][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4084.616227][ C1] ? irqentry_enter+0x2b/0x60 [ 4084.616482][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4084.616807][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4084.617088][ C1] ? arch_stack_walk+0x68/0x100 [ 4084.617350][ C1] __tcf_classify+0x32c/0x7d0 [ 4084.617605][ C1] tcf_classify+0x283/0x930 [ 4084.617851][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4084.618124][ C1] tc_run+0x2e4/0x5d0 [ 4084.618345][ C1] ? __pfx_tc_run+0x10/0x10 [ 4084.618593][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4084.618865][ C1] ? irqentry_enter+0x2b/0x60 [ 4084.619118][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4084.619404][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4084.619726][ C1] ip_finish_output2+0x786/0x18e0 [ 4084.620001][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4084.620299][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4084.620562][ C1] ? __ip_finish_output+0x10f/0x770 [ 4084.620843][ C1] ip_output+0x16b/0x4f0 [ 4084.621075][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4084.621393][ C1] ? __pfx_ip_output+0x10/0x10 [ 4084.621654][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4084.622006][ C1] ? __pfx_ip_output+0x10/0x10 [ 4084.622261][ C1] __ip_queue_xmit+0x672/0x1910 [ 4084.622526][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4084.622811][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4084.623113][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4084.623404][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4084.623706][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4084.623997][ C1] tcp_delack_timer+0x84/0x240 [ 4084.624256][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4084.624542][ C1] call_timer_fn+0x176/0x430 [ 4084.624792][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4084.625069][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4084.625347][ C1] __run_timers.part.0+0x52d/0x890 [ 4084.625621][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4084.625913][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4084.626225][ C1] ? __pfx___schedule+0x10/0x10 [ 4084.626487][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4084.626813][ C1] run_timer_softirq+0x72/0x100 [ 4084.627074][ C1] __do_softirq+0x1bc/0x7ff [ 4084.627317][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4084.627592][ C1] run_ksoftirqd+0x2e/0x60 [ 4084.627835][ C1] smpboot_thread_fn+0x30e/0x840 [ 4084.628101][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4084.628398][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4084.628689][ C1] kthread+0x292/0x360 [ 4084.628911][ C1] ? __pfx_kthread+0x10/0x10 [ 4084.629159][ C1] ret_from_fork+0x34/0x70 [ 4084.629402][ C1] ? __pfx_kthread+0x10/0x10 [ 4084.629647][ C1] ret_from_fork_asm+0x1b/0x30 [ 4084.629912][ C1] [ 4109.483024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4109.483401][ C1] rcu: 1-....: (2907461 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=694887 [ 4109.483982][ C1] rcu: (t=2915174 jiffies g=1007429 q=31 ncpus=4) [ 4109.484327][ C1] Sending NMI from CPU 1 to CPUs 0: [ 4109.484618][ C0] NMI backtrace for cpu 0 [ 4109.484626][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4109.484630][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4109.484633][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4109.484644][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4109.484647][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4109.484651][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4109.484653][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4109.484655][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4109.484657][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4109.484659][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4109.484661][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4109.484663][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4109.484667][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4109.484668][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4109.484670][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4109.484671][ C0] Call Trace: [ 4109.484674][ C0] [ 4109.484677][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 4109.484684][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4109.484690][ C0] ? nmi_handle+0x156/0x420 [ 4109.484695][ C0] ? default_do_nmi+0x41/0x100 [ 4109.484700][ C0] ? exc_nmi+0xf3/0x120 [ 4109.484703][ C0] ? end_repeat_nmi+0xf/0x60 [ 4109.484708][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4109.484712][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4109.484715][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4109.484718][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4109.484722][ C0] [ 4109.484723][ C0] [ 4109.484724][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4109.484727][ C0] ? get_stack_info+0x36/0xc0 [ 4109.484733][ C0] ? lock_acquire+0x1c1/0x220 [ 4109.484738][ C0] ? lock_release+0x1d5/0x250 [ 4109.484741][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4109.484746][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4109.484749][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4109.484752][ C0] ? lock_acquire+0x1c1/0x220 [ 4109.484754][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4109.484761][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4109.484765][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4109.484772][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4109.484775][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4109.484779][ C0] ? __inet_lookup_established+0x341/0x610 [ 4109.484786][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4109.484793][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4109.484797][ C0] ip_local_deliver+0x19d/0x480 [ 4109.484800][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4109.484803][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4109.484808][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4109.484812][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4109.484815][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4109.484819][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4109.484829][ C0] ip_rcv+0x564/0x740 [ 4109.484833][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4109.484836][ C0] ? set_track_prepare+0x8a/0xd0 [ 4109.484841][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4109.484843][ C0] ? rest_init+0x153/0x260 [ 4109.484845][ C0] ? skb_clone+0x10b/0x330 [ 4109.484851][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4109.484858][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4109.484864][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4109.484869][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4109.484878][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4109.484881][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4109.484884][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4109.484888][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4109.484892][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4109.484895][ C0] ? lock_acquire+0x1c1/0x220 [ 4109.484897][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4109.484901][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4109.484904][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4109.484907][ C0] ? __copy_skb_header+0xaf/0x490 [ 4109.484910][ C0] ? __skb_clone+0x57a/0x760 [ 4109.484913][ C0] netif_receive_skb+0x55/0x280 [ 4109.484915][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4109.484923][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4109.484930][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4109.484937][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4109.484942][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4109.484951][ C0] ? hlock_class+0x4e/0x130 [ 4109.484958][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4109.484968][ C0] ? place_entity+0x21/0x2f0 [ 4109.484971][ C0] ? resched_curr+0x219/0x280 [ 4109.484975][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4109.484978][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4109.484983][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4109.484988][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4109.484990][ C0] ? activate_task+0xf5/0x260 [ 4109.484993][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4109.484999][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4109.485003][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4109.485006][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4109.485009][ C0] ? get_stack_info+0x36/0xc0 [ 4109.485013][ C0] ? stack_access_ok+0xda/0x1f0 [ 4109.485015][ C0] ? get_reg+0x119/0x190 [ 4109.485019][ C0] __tcf_classify+0x32c/0x7d0 [ 4109.485024][ C0] tcf_classify+0x283/0x930 [ 4109.485027][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4109.485033][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4109.485035][ C0] ? arch_stack_walk+0x8c/0x100 [ 4109.485040][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4109.485043][ C0] tc_run+0x2e4/0x5d0 [ 4109.485048][ C0] ? __pfx_tc_run+0x10/0x10 [ 4109.485052][ C0] ? lock_acquire+0x1c1/0x220 [ 4109.485054][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4109.485059][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4109.485064][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4109.485067][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4109.485071][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4109.485077][ C0] ? neigh_hh_output+0x348/0x590 [ 4109.485081][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4109.485086][ C0] ip_finish_output2+0x786/0x18e0 [ 4109.485089][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4109.485095][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4109.485103][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4109.485106][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4109.485110][ C0] ? __ip_finish_output+0x10f/0x770 [ 4109.485114][ C0] ip_output+0x16b/0x4f0 [ 4109.485117][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4109.485122][ C0] ? __pfx_ip_output+0x10/0x10 [ 4109.485125][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4109.485130][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4109.485133][ C0] ? ip_local_out+0x114/0x3b0 [ 4109.485137][ C0] __ip_queue_xmit+0x672/0x1910 [ 4109.485141][ C0] ? __skb_clone+0x57a/0x760 [ 4109.485144][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4109.485152][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4109.485156][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4109.485159][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4109.485165][ C0] ? tcp_current_mss+0x40a/0x510 [ 4109.485168][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4109.485171][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4109.485173][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4109.485176][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4109.485179][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4109.485182][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4109.485188][ C0] ? ktime_get+0xb6/0x190 [ 4109.485192][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4109.485196][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4109.485199][ C0] tcp_write_timer+0x82/0x1d0 [ 4109.485203][ C0] call_timer_fn+0x176/0x430 [ 4109.485207][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4109.485211][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4109.485215][ C0] __run_timers.part.0+0x52d/0x890 [ 4109.485218][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4109.485223][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4109.485226][ C0] ? lock_acquire+0x1c1/0x220 [ 4109.485228][ C0] ? clockevents_program_event+0xf6/0x300 [ 4109.485234][ C0] ? lock_release+0x1d5/0x250 [ 4109.485236][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4109.485239][ C0] ? ktime_get+0xb6/0x190 [ 4109.485242][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4109.485246][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4109.485250][ C0] run_timer_softirq+0x72/0x100 [ 4109.485254][ C0] __do_softirq+0x1bc/0x7ff [ 4109.485259][ C0] irq_exit_rcu+0x98/0xc0 [ 4109.485262][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4109.485266][ C0] [ 4109.485266][ C0] [ 4109.485268][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4109.485274][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4109.485278][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4109.485280][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4109.485282][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4109.485284][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4109.485285][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4109.485287][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4109.485288][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4109.485292][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4109.485295][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4109.485299][ C0] default_idle_call+0x69/0xa0 [ 4109.485301][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4109.485304][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4109.485309][ C0] ? lock_release+0x1d5/0x250 [ 4109.485313][ C0] do_idle+0xfb/0x160 [ 4109.485316][ C0] cpu_startup_entry+0x55/0x60 [ 4109.485319][ C0] rest_init+0x153/0x260 [ 4109.485321][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4109.485328][ C0] arch_call_rest_init+0x13/0x40 [ 4109.485333][ C0] start_kernel+0x314/0x3d0 [ 4109.485337][ C0] x86_64_start_reservations+0x18/0x30 [ 4109.485342][ C0] x86_64_start_kernel+0xba/0x110 [ 4109.485346][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4109.485355][ C0] [ 4109.485614][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4109.539720][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4109.540371][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4109.540718][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4109.541745][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4109.542075][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4109.542497][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4109.542918][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4109.543342][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4109.543768][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4109.544188][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4109.544659][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4109.545007][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4109.545429][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4109.545846][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4109.546269][ C1] Call Trace: [ 4109.546451][ C1] [ 4109.546608][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4109.546892][ C1] ? print_cpu_stall+0x263/0x6a0 [ 4109.547160][ C1] ? check_cpu_stall+0x284/0x500 [ 4109.547423][ C1] ? rcu_pending+0x92/0x360 [ 4109.547668][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4109.547954][ C1] ? update_process_times+0xb9/0x110 [ 4109.548236][ C1] ? tick_sched_handle+0x67/0x130 [ 4109.548509][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4109.548808][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4109.549060][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4109.549388][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4109.549671][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4109.549971][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4109.550250][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4109.550568][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4109.550845][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4109.551167][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4109.551482][ C1] [ 4109.551640][ C1] [ 4109.551802][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4109.552136][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4109.552438][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4109.552747][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4109.553052][ C1] ? run_ksoftirqd+0xb/0x60 [ 4109.553297][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4109.553627][ C1] ? __orc_find+0x9c/0xf0 [ 4109.553856][ C1] ? lock_acquire+0x1c1/0x220 [ 4109.554108][ C1] ? irqentry_enter+0x2b/0x60 [ 4109.554360][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4109.554621][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4109.554906][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4109.555205][ C1] ? lock_acquire+0x1c1/0x220 [ 4109.555456][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4109.555710][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4109.555987][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4109.556244][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4109.556508][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4109.556781][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4109.557077][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4109.557369][ C1] ip_local_deliver+0x19d/0x480 [ 4109.557626][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4109.557911][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4109.558175][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4109.558455][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4109.558724][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4109.559059][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4109.559338][ C1] ip_rcv+0x564/0x740 [ 4109.559554][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4109.559799][ C1] ? set_track_prepare+0x8a/0xd0 [ 4109.560067][ C1] ? irqentry_enter+0x2b/0x60 [ 4109.560315][ C1] ? irqentry_enter+0x2b/0x60 [ 4109.560564][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4109.560803][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4109.561119][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4109.561457][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4109.561764][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4109.562107][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4109.562408][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4109.562739][ C1] netif_receive_skb+0x55/0x280 [ 4109.562998][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4109.563326][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4109.563672][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4109.563987][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4109.564274][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4109.564576][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4109.564901][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4109.565178][ C1] ? arch_stack_walk+0x68/0x100 [ 4109.565441][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4109.565720][ C1] ? irqentry_enter+0x2b/0x60 [ 4109.565972][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4109.566303][ C1] ? irqentry_enter+0x2b/0x60 [ 4109.566561][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4109.566884][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4109.567161][ C1] ? arch_stack_walk+0x68/0x100 [ 4109.567424][ C1] __tcf_classify+0x32c/0x7d0 [ 4109.567680][ C1] tcf_classify+0x283/0x930 [ 4109.567926][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4109.568200][ C1] tc_run+0x2e4/0x5d0 [ 4109.568417][ C1] ? __pfx_tc_run+0x10/0x10 [ 4109.568665][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4109.568933][ C1] ? irqentry_enter+0x2b/0x60 [ 4109.569182][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4109.569465][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4109.569788][ C1] ip_finish_output2+0x786/0x18e0 [ 4109.570061][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4109.570351][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4109.570615][ C1] ? __ip_finish_output+0x10f/0x770 [ 4109.570895][ C1] ip_output+0x16b/0x4f0 [ 4109.571127][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4109.571446][ C1] ? __pfx_ip_output+0x10/0x10 [ 4109.571704][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4109.572054][ C1] ? __pfx_ip_output+0x10/0x10 [ 4109.572308][ C1] __ip_queue_xmit+0x672/0x1910 [ 4109.572574][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4109.572858][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4109.573158][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4109.573448][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4109.573746][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4109.574034][ C1] tcp_delack_timer+0x84/0x240 [ 4109.574290][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4109.574573][ C1] call_timer_fn+0x176/0x430 [ 4109.574817][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4109.575094][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4109.575368][ C1] __run_timers.part.0+0x52d/0x890 [ 4109.575638][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4109.575927][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4109.576232][ C1] ? __pfx___schedule+0x10/0x10 [ 4109.576496][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4109.576818][ C1] run_timer_softirq+0x72/0x100 [ 4109.577075][ C1] __do_softirq+0x1bc/0x7ff [ 4109.577316][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4109.577589][ C1] run_ksoftirqd+0x2e/0x60 [ 4109.577828][ C1] smpboot_thread_fn+0x30e/0x840 [ 4109.578094][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4109.578388][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4109.578676][ C1] kthread+0x292/0x360 [ 4109.578893][ C1] ? __pfx_kthread+0x10/0x10 [ 4109.579137][ C1] ret_from_fork+0x34/0x70 [ 4109.579377][ C1] ? __pfx_kthread+0x10/0x10 [ 4109.579622][ C1] ret_from_fork_asm+0x1b/0x30 [ 4109.579884][ C1] [ 4136.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2746s! [swapper/0:0] [ 4136.527927][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4136.529137][ C0] irq event stamp: 27567077 [ 4136.529381][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4136.529915][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4136.530389][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4136.530894][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4136.531388][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4136.531867][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4136.532516][ C0] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 4136.532822][ C0] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 4136.533845][ C0] RSP: 0018:ffffc900000069c8 EFLAGS: 00000202 [ 4136.534167][ C0] RAX: ffff88800a099b58 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4136.534585][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4136.535002][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4136.535418][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4136.535833][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4136.536261][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4136.536737][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4136.537085][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4136.537512][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4136.537930][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4136.538347][ C0] Call Trace: [ 4136.538525][ C0] [ 4136.538681][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4136.538960][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4136.539217][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4136.539510][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4136.539796][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4136.540095][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4136.540372][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4136.540696][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4136.540971][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4136.541248][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4136.541578][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4136.541890][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4136.542224][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4136.542529][ C0] ? kasan_check_range+0x12/0x1c0 [ 4136.542803][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 4136.543102][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4136.543431][ C0] ? get_stack_info+0x36/0xc0 [ 4136.543683][ C0] ? lock_acquire+0x1c1/0x220 [ 4136.543937][ C0] ? lock_release+0x1d5/0x250 [ 4136.544187][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4136.544445][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4136.544727][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4136.545030][ C0] ? lock_acquire+0x1c1/0x220 [ 4136.545285][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4136.545544][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4136.545823][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4136.546074][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4136.546334][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4136.546607][ C0] ? __inet_lookup_established+0x341/0x610 [ 4136.546920][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4136.547210][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4136.547497][ C0] ip_local_deliver+0x19d/0x480 [ 4136.547758][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4136.548046][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4136.548314][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4136.548591][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4136.548854][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4136.549192][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4136.549465][ C0] ip_rcv+0x564/0x740 [ 4136.549679][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4136.549921][ C0] ? set_track_prepare+0x8a/0xd0 [ 4136.550185][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4136.550474][ C0] ? rest_init+0x153/0x260 [ 4136.550710][ C0] ? skb_clone+0x10b/0x330 [ 4136.550950][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4136.551281][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4136.551598][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4136.551894][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4136.552207][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4136.552469][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4136.552714][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4136.553030][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4136.553331][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4136.553669][ C0] ? lock_acquire+0x1c1/0x220 [ 4136.553919][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4136.554226][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4136.554527][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4136.554856][ C0] ? __copy_skb_header+0xaf/0x490 [ 4136.555124][ C0] ? __skb_clone+0x57a/0x760 [ 4136.555367][ C0] netif_receive_skb+0x55/0x280 [ 4136.555626][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4136.555961][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4136.556314][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4136.556633][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4136.556920][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4136.557225][ C0] ? hlock_class+0x4e/0x130 [ 4136.557472][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4136.557798][ C0] ? place_entity+0x21/0x2f0 [ 4136.558043][ C0] ? resched_curr+0x219/0x280 [ 4136.558295][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4136.558566][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4136.558852][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4136.559128][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4136.559384][ C0] ? activate_task+0xf5/0x260 [ 4136.559634][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4136.559907][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4136.560183][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4136.560441][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4136.560728][ C0] ? get_stack_info+0x36/0xc0 [ 4136.560980][ C0] ? stack_access_ok+0xda/0x1f0 [ 4136.561241][ C0] ? get_reg+0x119/0x190 [ 4136.561473][ C0] __tcf_classify+0x32c/0x7d0 [ 4136.561723][ C0] tcf_classify+0x283/0x930 [ 4136.561964][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4136.562294][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4136.562563][ C0] ? arch_stack_walk+0x8c/0x100 [ 4136.562828][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4136.563122][ C0] tc_run+0x2e4/0x5d0 [ 4136.563339][ C0] ? __pfx_tc_run+0x10/0x10 [ 4136.563585][ C0] ? lock_acquire+0x1c1/0x220 [ 4136.563833][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4136.564108][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4136.564377][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4136.564661][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4136.564936][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4136.565255][ C0] ? neigh_hh_output+0x348/0x590 [ 4136.565520][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4136.565800][ C0] ip_finish_output2+0x786/0x18e0 [ 4136.566075][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4136.566372][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4136.566723][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4136.567010][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4136.567277][ C0] ? __ip_finish_output+0x10f/0x770 [ 4136.567552][ C0] ip_output+0x16b/0x4f0 [ 4136.567778][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4136.568064][ C0] ? __pfx_ip_output+0x10/0x10 [ 4136.568318][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4136.568627][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4136.568890][ C0] ? ip_local_out+0x114/0x3b0 [ 4136.569146][ C0] __ip_queue_xmit+0x672/0x1910 [ 4136.569409][ C0] ? __skb_clone+0x57a/0x760 [ 4136.569658][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4136.569939][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4136.570234][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4136.570551][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4136.570812][ C0] ? tcp_current_mss+0x40a/0x510 [ 4136.571079][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4136.571363][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4136.571641][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4136.571895][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4136.572166][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4136.572489][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4136.572766][ C0] ? ktime_get+0xb6/0x190 [ 4136.572997][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4136.573271][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4136.573553][ C0] tcp_write_timer+0x82/0x1d0 [ 4136.573804][ C0] call_timer_fn+0x176/0x430 [ 4136.574054][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4136.574329][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4136.574601][ C0] __run_timers.part.0+0x52d/0x890 [ 4136.574875][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4136.575158][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4136.575460][ C0] ? lock_acquire+0x1c1/0x220 [ 4136.575711][ C0] ? clockevents_program_event+0xf6/0x300 [ 4136.576018][ C0] ? lock_release+0x1d5/0x250 [ 4136.576273][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4136.576554][ C0] ? ktime_get+0xb6/0x190 [ 4136.576786][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4136.577092][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4136.577403][ C0] run_timer_softirq+0x72/0x100 [ 4136.577667][ C0] __do_softirq+0x1bc/0x7ff [ 4136.577914][ C0] irq_exit_rcu+0x98/0xc0 [ 4136.578149][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4136.578451][ C0] [ 4136.578606][ C0] [ 4136.578763][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4136.579082][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4136.579355][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4136.580379][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4136.580705][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4136.581130][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4136.581551][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4136.581972][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4136.582398][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4136.582826][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4136.583131][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4136.583407][ C0] default_idle_call+0x69/0xa0 [ 4136.583661][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4136.583925][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4136.584215][ C0] ? lock_release+0x1d5/0x250 [ 4136.584470][ C0] do_idle+0xfb/0x160 [ 4136.584689][ C0] cpu_startup_entry+0x55/0x60 [ 4136.584947][ C0] rest_init+0x153/0x260 [ 4136.585172][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4136.585463][ C0] arch_call_rest_init+0x13/0x40 [ 4136.585733][ C0] start_kernel+0x314/0x3d0 [ 4136.585991][ C0] x86_64_start_reservations+0x18/0x30 [ 4136.586287][ C0] x86_64_start_kernel+0xba/0x110 [ 4136.586555][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4136.586886][ C0] [ 4136.587052][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2746s! [ksoftirqd/1:22] [ 4136.587536][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4136.588737][ C1] irq event stamp: 3886976 [ 4136.588976][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4136.589482][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4136.589983][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4136.590489][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4136.590981][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4136.591484][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4136.592134][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4136.592483][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4136.593515][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4136.593843][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4136.594273][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4136.594697][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4136.595120][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4136.595547][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4136.595983][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4136.596456][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4136.596810][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4136.597236][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4136.597666][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4136.598090][ C1] Call Trace: [ 4136.598271][ C1] [ 4136.598433][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4136.598712][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4136.598972][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4136.599263][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4136.599554][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4136.599861][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4136.600147][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4136.600475][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4136.600755][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4136.601083][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4136.601399][ C1] [ 4136.601556][ C1] [ 4136.601713][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4136.602045][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4136.602355][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4136.602670][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4136.602974][ C1] ? run_ksoftirqd+0xb/0x60 [ 4136.603220][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4136.603550][ C1] ? __orc_find+0x9c/0xf0 [ 4136.603786][ C1] ? lock_acquire+0x1c1/0x220 [ 4136.604041][ C1] ? irqentry_enter+0x2b/0x60 [ 4136.604295][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4136.604560][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4136.604850][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4136.605156][ C1] ? lock_acquire+0x1c1/0x220 [ 4136.605408][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4136.605662][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4136.605936][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4136.606189][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4136.606448][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4136.606720][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4136.607011][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4136.607302][ C1] ip_local_deliver+0x19d/0x480 [ 4136.607564][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4136.607853][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4136.608122][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4136.608399][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4136.608664][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4136.609003][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4136.609279][ C1] ip_rcv+0x564/0x740 [ 4136.609493][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4136.609735][ C1] ? set_track_prepare+0x8a/0xd0 [ 4136.610002][ C1] ? irqentry_enter+0x2b/0x60 [ 4136.610259][ C1] ? irqentry_enter+0x2b/0x60 [ 4136.610516][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4136.610762][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4136.611084][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4136.611429][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4136.611744][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4136.612085][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4136.612383][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4136.612720][ C1] netif_receive_skb+0x55/0x280 [ 4136.612983][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4136.613316][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4136.613671][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4136.613985][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4136.614279][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4136.614587][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4136.614921][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4136.615207][ C1] ? arch_stack_walk+0x68/0x100 [ 4136.615468][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4136.615746][ C1] ? irqentry_enter+0x2b/0x60 [ 4136.616006][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4136.616330][ C1] ? irqentry_enter+0x2b/0x60 [ 4136.616579][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4136.616901][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4136.617188][ C1] ? arch_stack_walk+0x68/0x100 [ 4136.617448][ C1] __tcf_classify+0x32c/0x7d0 [ 4136.617700][ C1] tcf_classify+0x283/0x930 [ 4136.617944][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4136.618212][ C1] tc_run+0x2e4/0x5d0 [ 4136.618429][ C1] ? __pfx_tc_run+0x10/0x10 [ 4136.618672][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4136.618940][ C1] ? irqentry_enter+0x2b/0x60 [ 4136.619197][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4136.619489][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4136.619813][ C1] ip_finish_output2+0x786/0x18e0 [ 4136.620083][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4136.620374][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4136.620642][ C1] ? __ip_finish_output+0x10f/0x770 [ 4136.620919][ C1] ip_output+0x16b/0x4f0 [ 4136.621149][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4136.621469][ C1] ? __pfx_ip_output+0x10/0x10 [ 4136.621726][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4136.622084][ C1] ? __pfx_ip_output+0x10/0x10 [ 4136.622343][ C1] __ip_queue_xmit+0x672/0x1910 [ 4136.622604][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4136.622884][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4136.623179][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4136.623464][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4136.623761][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4136.624049][ C1] tcp_delack_timer+0x84/0x240 [ 4136.624307][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4136.624602][ C1] call_timer_fn+0x176/0x430 [ 4136.624854][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4136.625128][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4136.625413][ C1] __run_timers.part.0+0x52d/0x890 [ 4136.625693][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4136.625986][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4136.626294][ C1] ? __pfx___schedule+0x10/0x10 [ 4136.626555][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4136.626880][ C1] run_timer_softirq+0x72/0x100 [ 4136.627145][ C1] __do_softirq+0x1bc/0x7ff [ 4136.627394][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4136.627671][ C1] run_ksoftirqd+0x2e/0x60 [ 4136.627909][ C1] smpboot_thread_fn+0x30e/0x840 [ 4136.628179][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4136.628470][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4136.628766][ C1] kthread+0x292/0x360 [ 4136.628986][ C1] ? __pfx_kthread+0x10/0x10 [ 4136.629237][ C1] ret_from_fork+0x34/0x70 [ 4136.629476][ C1] ? __pfx_kthread+0x10/0x10 [ 4136.629726][ C1] ret_from_fork_asm+0x1b/0x30 [ 4136.629986][ C1] [ 4164.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2772s! [swapper/0:0] [ 4164.527922][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4164.529141][ C0] irq event stamp: 27567077 [ 4164.529385][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4164.529918][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4164.530393][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4164.530895][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4164.531388][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4164.531865][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4164.532513][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4164.532855][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4164.533880][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4164.534207][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4164.534628][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4164.535056][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4164.535479][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4164.535909][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4164.536327][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4164.536794][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4164.537174][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4164.537593][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4164.538013][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4164.538437][ C0] Call Trace: [ 4164.538624][ C0] [ 4164.538779][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4164.539054][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4164.539309][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4164.539597][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4164.539886][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4164.540193][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4164.540478][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4164.540800][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4164.541073][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4164.541352][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4164.541673][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4164.541983][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4164.542318][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4164.542621][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4164.542930][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4164.543236][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4164.543565][ C0] ? get_stack_info+0x36/0xc0 [ 4164.543819][ C0] ? lock_acquire+0x1c1/0x220 [ 4164.544072][ C0] ? lock_release+0x1d5/0x250 [ 4164.544322][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4164.544581][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4164.544864][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4164.545160][ C0] ? lock_acquire+0x1c1/0x220 [ 4164.545413][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4164.545671][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4164.545961][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4164.546213][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4164.546476][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4164.546747][ C0] ? __inet_lookup_established+0x341/0x610 [ 4164.547064][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4164.547352][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4164.547643][ C0] ip_local_deliver+0x19d/0x480 [ 4164.547902][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4164.548190][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4164.548463][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4164.548740][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4164.549002][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4164.549342][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4164.549615][ C0] ip_rcv+0x564/0x740 [ 4164.549828][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4164.550069][ C0] ? set_track_prepare+0x8a/0xd0 [ 4164.550334][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4164.550625][ C0] ? rest_init+0x153/0x260 [ 4164.550862][ C0] ? skb_clone+0x10b/0x330 [ 4164.551106][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4164.551439][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4164.551759][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4164.552059][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4164.552371][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4164.552638][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4164.552883][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4164.553201][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4164.553500][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4164.553837][ C0] ? lock_acquire+0x1c1/0x220 [ 4164.554088][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4164.554396][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4164.554696][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4164.555023][ C0] ? __copy_skb_header+0xaf/0x490 [ 4164.555289][ C0] ? __skb_clone+0x57a/0x760 [ 4164.555536][ C0] netif_receive_skb+0x55/0x280 [ 4164.555798][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4164.556132][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4164.556479][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4164.556794][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4164.557080][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4164.557379][ C0] ? hlock_class+0x4e/0x130 [ 4164.557622][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4164.557949][ C0] ? place_entity+0x21/0x2f0 [ 4164.558194][ C0] ? resched_curr+0x219/0x280 [ 4164.558448][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4164.558718][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4164.559001][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4164.559276][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4164.559532][ C0] ? activate_task+0xf5/0x260 [ 4164.559781][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4164.560057][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4164.560333][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4164.560592][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4164.560883][ C0] ? get_stack_info+0x36/0xc0 [ 4164.561139][ C0] ? stack_access_ok+0xda/0x1f0 [ 4164.561400][ C0] ? get_reg+0x119/0x190 [ 4164.561631][ C0] __tcf_classify+0x32c/0x7d0 [ 4164.561882][ C0] tcf_classify+0x283/0x930 [ 4164.562127][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4164.562455][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4164.562727][ C0] ? arch_stack_walk+0x8c/0x100 [ 4164.562991][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4164.563284][ C0] tc_run+0x2e4/0x5d0 [ 4164.563499][ C0] ? __pfx_tc_run+0x10/0x10 [ 4164.563740][ C0] ? lock_acquire+0x1c1/0x220 [ 4164.563987][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4164.564262][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4164.564529][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4164.564812][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4164.565089][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4164.565412][ C0] ? neigh_hh_output+0x348/0x590 [ 4164.565681][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4164.565966][ C0] ip_finish_output2+0x786/0x18e0 [ 4164.566239][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4164.566534][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4164.566885][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4164.567175][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4164.567440][ C0] ? __ip_finish_output+0x10f/0x770 [ 4164.567715][ C0] ip_output+0x16b/0x4f0 [ 4164.567942][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4164.568228][ C0] ? __pfx_ip_output+0x10/0x10 [ 4164.568484][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4164.568786][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4164.569048][ C0] ? ip_local_out+0x114/0x3b0 [ 4164.569303][ C0] __ip_queue_xmit+0x672/0x1910 [ 4164.569568][ C0] ? __skb_clone+0x57a/0x760 [ 4164.569818][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4164.570098][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4164.570392][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4164.570708][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4164.570966][ C0] ? tcp_current_mss+0x40a/0x510 [ 4164.571230][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4164.571514][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4164.571788][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4164.572041][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4164.572312][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4164.572634][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4164.572911][ C0] ? ktime_get+0xb6/0x190 [ 4164.573146][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4164.573420][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4164.573704][ C0] tcp_write_timer+0x82/0x1d0 [ 4164.573954][ C0] call_timer_fn+0x176/0x430 [ 4164.574201][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4164.574478][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4164.574751][ C0] __run_timers.part.0+0x52d/0x890 [ 4164.575025][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4164.575306][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4164.575607][ C0] ? lock_acquire+0x1c1/0x220 [ 4164.575860][ C0] ? clockevents_program_event+0xf6/0x300 [ 4164.576172][ C0] ? lock_release+0x1d5/0x250 [ 4164.576426][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4164.576705][ C0] ? ktime_get+0xb6/0x190 [ 4164.576938][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4164.577241][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4164.577550][ C0] run_timer_softirq+0x72/0x100 [ 4164.577811][ C0] __do_softirq+0x1bc/0x7ff [ 4164.578063][ C0] irq_exit_rcu+0x98/0xc0 [ 4164.578297][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4164.578597][ C0] [ 4164.578753][ C0] [ 4164.578909][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4164.579227][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4164.579498][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4164.580536][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4164.580860][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4164.581289][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4164.581713][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4164.582133][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4164.582553][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4164.582977][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4164.583286][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4164.583562][ C0] default_idle_call+0x69/0xa0 [ 4164.583817][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4164.584083][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4164.584372][ C0] ? lock_release+0x1d5/0x250 [ 4164.584623][ C0] do_idle+0xfb/0x160 [ 4164.584839][ C0] cpu_startup_entry+0x55/0x60 [ 4164.585099][ C0] rest_init+0x153/0x260 [ 4164.585324][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4164.585614][ C0] arch_call_rest_init+0x13/0x40 [ 4164.585889][ C0] start_kernel+0x314/0x3d0 [ 4164.586135][ C0] x86_64_start_reservations+0x18/0x30 [ 4164.586428][ C0] x86_64_start_kernel+0xba/0x110 [ 4164.586695][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4164.587020][ C0] [ 4164.587186][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2772s! [ksoftirqd/1:22] [ 4164.587658][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4164.588870][ C1] irq event stamp: 3886976 [ 4164.589109][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4164.589606][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4164.590099][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4164.590598][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4164.591094][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4164.591588][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4164.592230][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4164.592570][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4164.593592][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4164.593915][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4164.594336][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4164.594757][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4164.595179][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4164.595600][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4164.596027][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4164.596505][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4164.596854][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4164.597282][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4164.597702][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4164.598125][ C1] Call Trace: [ 4164.598304][ C1] [ 4164.598461][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4164.598741][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4164.598995][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4164.599292][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4164.599578][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4164.599881][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4164.600160][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4164.600481][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4164.600760][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4164.601085][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4164.601394][ C1] [ 4164.601555][ C1] [ 4164.601715][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4164.602051][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4164.602354][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4164.602664][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4164.602970][ C1] ? run_ksoftirqd+0xb/0x60 [ 4164.603217][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4164.603550][ C1] ? __orc_find+0x9c/0xf0 [ 4164.603784][ C1] ? lock_acquire+0x1c1/0x220 [ 4164.604039][ C1] ? irqentry_enter+0x2b/0x60 [ 4164.604292][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4164.604555][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4164.604839][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4164.605140][ C1] ? lock_acquire+0x1c1/0x220 [ 4164.605394][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4164.605651][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4164.605934][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4164.606190][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4164.606454][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4164.606729][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4164.607023][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4164.607320][ C1] ip_local_deliver+0x19d/0x480 [ 4164.607581][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4164.607867][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4164.608135][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4164.608415][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4164.608681][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4164.609017][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4164.609297][ C1] ip_rcv+0x564/0x740 [ 4164.609511][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4164.609757][ C1] ? set_track_prepare+0x8a/0xd0 [ 4164.610026][ C1] ? irqentry_enter+0x2b/0x60 [ 4164.610276][ C1] ? irqentry_enter+0x2b/0x60 [ 4164.610527][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4164.610768][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4164.611086][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4164.611430][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4164.611739][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4164.612085][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4164.612389][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4164.612724][ C1] netif_receive_skb+0x55/0x280 [ 4164.612987][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4164.613317][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4164.613664][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4164.613984][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4164.614275][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4164.614580][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4164.614911][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4164.615193][ C1] ? arch_stack_walk+0x68/0x100 [ 4164.615462][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4164.615743][ C1] ? irqentry_enter+0x2b/0x60 [ 4164.616003][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4164.616323][ C1] ? irqentry_enter+0x2b/0x60 [ 4164.616578][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4164.616906][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4164.617188][ C1] ? arch_stack_walk+0x68/0x100 [ 4164.617455][ C1] __tcf_classify+0x32c/0x7d0 [ 4164.617717][ C1] tcf_classify+0x283/0x930 [ 4164.617964][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4164.618239][ C1] tc_run+0x2e4/0x5d0 [ 4164.618457][ C1] ? __pfx_tc_run+0x10/0x10 [ 4164.618705][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4164.618975][ C1] ? irqentry_enter+0x2b/0x60 [ 4164.619226][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4164.619514][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4164.619836][ C1] ip_finish_output2+0x786/0x18e0 [ 4164.620113][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4164.620409][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4164.620674][ C1] ? __ip_finish_output+0x10f/0x770 [ 4164.620957][ C1] ip_output+0x16b/0x4f0 [ 4164.621187][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4164.621505][ C1] ? __pfx_ip_output+0x10/0x10 [ 4164.621764][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4164.622121][ C1] ? __pfx_ip_output+0x10/0x10 [ 4164.622380][ C1] __ip_queue_xmit+0x672/0x1910 [ 4164.622646][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4164.622933][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4164.623234][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4164.623524][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4164.623823][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4164.624113][ C1] tcp_delack_timer+0x84/0x240 [ 4164.624371][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4164.624656][ C1] call_timer_fn+0x176/0x430 [ 4164.624903][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4164.625183][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4164.625462][ C1] __run_timers.part.0+0x52d/0x890 [ 4164.625735][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4164.626034][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4164.626335][ C1] ? __pfx___schedule+0x10/0x10 [ 4164.626601][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4164.626924][ C1] run_timer_softirq+0x72/0x100 [ 4164.627185][ C1] __do_softirq+0x1bc/0x7ff [ 4164.627428][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4164.627702][ C1] run_ksoftirqd+0x2e/0x60 [ 4164.627946][ C1] smpboot_thread_fn+0x30e/0x840 [ 4164.628212][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4164.628506][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4164.628797][ C1] kthread+0x292/0x360 [ 4164.629019][ C1] ? __pfx_kthread+0x10/0x10 [ 4164.629267][ C1] ret_from_fork+0x34/0x70 [ 4164.629511][ C1] ? __pfx_kthread+0x10/0x10 [ 4164.629756][ C1] ret_from_fork_asm+0x1b/0x30 [ 4164.630021][ C1] [ 4187.581024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4187.581415][ C1] rcu: 1-....: (2985277 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=714117 [ 4187.582008][ C1] rcu: (t=2993272 jiffies g=1007429 q=31 ncpus=4) [ 4187.582358][ C1] Sending NMI from CPU 1 to CPUs 0: [ 4187.582643][ C0] NMI backtrace for cpu 0 [ 4187.582650][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4187.582655][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4187.582658][ C0] RIP: 0010:kasan_check_range+0x106/0x1c0 [ 4187.582669][ C0] Code: 00 74 f2 48 89 c2 b8 01 00 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff <5b> b8 01 00 00 00 5d 41 5c c3 cc cc cc cc 41 bc 08 00 00 00 45 29 [ 4187.582673][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000246 [ 4187.582676][ C0] RAX: ffffed100141336c RBX: ffffed100141336c RCX: ffffffff90c7aaa0 [ 4187.582678][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4187.582680][ C0] RBP: ffffed100141336b R08: 0000000000000000 R09: ffffed100141336b [ 4187.582682][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4187.582684][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4187.582686][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4187.582688][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4187.582692][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4187.582694][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4187.582695][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4187.582697][ C0] Call Trace: [ 4187.582701][ C0] [ 4187.582704][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 4187.582711][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4187.582716][ C0] ? nmi_handle+0x156/0x420 [ 4187.582722][ C0] ? default_do_nmi+0x41/0x100 [ 4187.582727][ C0] ? exc_nmi+0xf3/0x120 [ 4187.582730][ C0] ? end_repeat_nmi+0xf/0x60 [ 4187.582734][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4187.582741][ C0] ? kasan_check_range+0x106/0x1c0 [ 4187.582745][ C0] ? kasan_check_range+0x106/0x1c0 [ 4187.582748][ C0] ? kasan_check_range+0x106/0x1c0 [ 4187.582752][ C0] [ 4187.582753][ C0] [ 4187.582754][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 4187.582758][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4187.582761][ C0] ? get_stack_info+0x36/0xc0 [ 4187.582768][ C0] ? lock_acquire+0x1c1/0x220 [ 4187.582773][ C0] ? lock_release+0x1d5/0x250 [ 4187.582776][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4187.582780][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4187.582783][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4187.582787][ C0] ? lock_acquire+0x1c1/0x220 [ 4187.582789][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4187.582795][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4187.582799][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4187.582806][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4187.582809][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4187.582814][ C0] ? __inet_lookup_established+0x341/0x610 [ 4187.582820][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4187.582827][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4187.582831][ C0] ip_local_deliver+0x19d/0x480 [ 4187.582834][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4187.582837][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4187.582842][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4187.582846][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4187.582849][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4187.582853][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4187.582863][ C0] ip_rcv+0x564/0x740 [ 4187.582866][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4187.582869][ C0] ? set_track_prepare+0x8a/0xd0 [ 4187.582874][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4187.582876][ C0] ? rest_init+0x153/0x260 [ 4187.582878][ C0] ? skb_clone+0x10b/0x330 [ 4187.582884][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4187.582891][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4187.582896][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4187.582901][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4187.582910][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4187.582913][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4187.582916][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4187.582921][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4187.582924][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4187.582928][ C0] ? lock_acquire+0x1c1/0x220 [ 4187.582930][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4187.582933][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4187.582936][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4187.582939][ C0] ? __copy_skb_header+0xaf/0x490 [ 4187.582942][ C0] ? __skb_clone+0x57a/0x760 [ 4187.582945][ C0] netif_receive_skb+0x55/0x280 [ 4187.582947][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4187.582956][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4187.582963][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4187.582970][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4187.582975][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4187.582984][ C0] ? hlock_class+0x4e/0x130 [ 4187.582991][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4187.583001][ C0] ? place_entity+0x21/0x2f0 [ 4187.583004][ C0] ? resched_curr+0x219/0x280 [ 4187.583008][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4187.583011][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4187.583016][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4187.583021][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4187.583024][ C0] ? activate_task+0xf5/0x260 [ 4187.583028][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4187.583033][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4187.583036][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4187.583040][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4187.583043][ C0] ? get_stack_info+0x36/0xc0 [ 4187.583047][ C0] ? stack_access_ok+0xda/0x1f0 [ 4187.583049][ C0] ? get_reg+0x119/0x190 [ 4187.583053][ C0] __tcf_classify+0x32c/0x7d0 [ 4187.583058][ C0] tcf_classify+0x283/0x930 [ 4187.583061][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4187.583066][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4187.583068][ C0] ? arch_stack_walk+0x8c/0x100 [ 4187.583074][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4187.583078][ C0] tc_run+0x2e4/0x5d0 [ 4187.583082][ C0] ? __pfx_tc_run+0x10/0x10 [ 4187.583085][ C0] ? lock_acquire+0x1c1/0x220 [ 4187.583088][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4187.583092][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4187.583098][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4187.583101][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4187.583105][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4187.583110][ C0] ? neigh_hh_output+0x348/0x590 [ 4187.583114][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4187.583118][ C0] ip_finish_output2+0x786/0x18e0 [ 4187.583122][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4187.583128][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4187.583135][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4187.583138][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4187.583142][ C0] ? __ip_finish_output+0x10f/0x770 [ 4187.583146][ C0] ip_output+0x16b/0x4f0 [ 4187.583150][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4187.583155][ C0] ? __pfx_ip_output+0x10/0x10 [ 4187.583158][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4187.583163][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4187.583166][ C0] ? ip_local_out+0x114/0x3b0 [ 4187.583170][ C0] __ip_queue_xmit+0x672/0x1910 [ 4187.583174][ C0] ? __skb_clone+0x57a/0x760 [ 4187.583177][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4187.583184][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4187.583189][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4187.583192][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4187.583197][ C0] ? tcp_current_mss+0x40a/0x510 [ 4187.583200][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4187.583203][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4187.583206][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4187.583208][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4187.583211][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4187.583215][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4187.583220][ C0] ? ktime_get+0xb6/0x190 [ 4187.583224][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4187.583228][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4187.583231][ C0] tcp_write_timer+0x82/0x1d0 [ 4187.583235][ C0] call_timer_fn+0x176/0x430 [ 4187.583239][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4187.583244][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4187.583248][ C0] __run_timers.part.0+0x52d/0x890 [ 4187.583251][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4187.583256][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4187.583259][ C0] ? lock_acquire+0x1c1/0x220 [ 4187.583261][ C0] ? clockevents_program_event+0xf6/0x300 [ 4187.583266][ C0] ? lock_release+0x1d5/0x250 [ 4187.583268][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4187.583271][ C0] ? ktime_get+0xb6/0x190 [ 4187.583274][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4187.583277][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4187.583282][ C0] run_timer_softirq+0x72/0x100 [ 4187.583285][ C0] __do_softirq+0x1bc/0x7ff [ 4187.583290][ C0] irq_exit_rcu+0x98/0xc0 [ 4187.583293][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4187.583297][ C0] [ 4187.583298][ C0] [ 4187.583299][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4187.583304][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4187.583307][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4187.583309][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4187.583311][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4187.583313][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4187.583314][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4187.583316][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4187.583317][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4187.583320][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4187.583324][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4187.583328][ C0] default_idle_call+0x69/0xa0 [ 4187.583330][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4187.583333][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4187.583339][ C0] ? lock_release+0x1d5/0x250 [ 4187.583343][ C0] do_idle+0xfb/0x160 [ 4187.583346][ C0] cpu_startup_entry+0x55/0x60 [ 4187.583349][ C0] rest_init+0x153/0x260 [ 4187.583351][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4187.583357][ C0] arch_call_rest_init+0x13/0x40 [ 4187.583362][ C0] start_kernel+0x314/0x3d0 [ 4187.583366][ C0] x86_64_start_reservations+0x18/0x30 [ 4187.583371][ C0] x86_64_start_kernel+0xba/0x110 [ 4187.583374][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4187.583383][ C0] [ 4187.583640][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4187.638111][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4187.638755][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4187.639101][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4187.640124][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4187.640446][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4187.640866][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4187.641285][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4187.641704][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4187.642122][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4187.642541][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4187.643011][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4187.643366][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4187.643789][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4187.644217][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4187.644639][ C1] Call Trace: [ 4187.644818][ C1] [ 4187.644979][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4187.645266][ C1] ? print_cpu_stall+0x263/0x6a0 [ 4187.645533][ C1] ? check_cpu_stall+0x284/0x500 [ 4187.645802][ C1] ? rcu_pending+0x92/0x360 [ 4187.646044][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4187.646326][ C1] ? update_process_times+0xb9/0x110 [ 4187.646613][ C1] ? tick_sched_handle+0x67/0x130 [ 4187.646883][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4187.647183][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4187.647441][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4187.647769][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4187.648060][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4187.648366][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4187.648648][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4187.648974][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4187.649251][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4187.649580][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4187.649897][ C1] [ 4187.650054][ C1] [ 4187.650212][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4187.650541][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4187.650850][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4187.651163][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4187.651466][ C1] ? run_ksoftirqd+0xb/0x60 [ 4187.651710][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4187.652036][ C1] ? __orc_find+0x9c/0xf0 [ 4187.652272][ C1] ? lock_acquire+0x1c1/0x220 [ 4187.652528][ C1] ? irqentry_enter+0x2b/0x60 [ 4187.652782][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4187.653046][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4187.653338][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4187.653642][ C1] ? lock_acquire+0x1c1/0x220 [ 4187.653893][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4187.654147][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4187.654424][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4187.654674][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4187.654937][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4187.655214][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4187.655507][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4187.655805][ C1] ip_local_deliver+0x19d/0x480 [ 4187.656068][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4187.656356][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4187.656625][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4187.656901][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4187.657166][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4187.657507][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4187.657781][ C1] ip_rcv+0x564/0x740 [ 4187.657995][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4187.658236][ C1] ? set_track_prepare+0x8a/0xd0 [ 4187.658501][ C1] ? irqentry_enter+0x2b/0x60 [ 4187.658757][ C1] ? irqentry_enter+0x2b/0x60 [ 4187.659015][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4187.659265][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4187.659585][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4187.659929][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4187.660244][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4187.660583][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4187.660881][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4187.661218][ C1] netif_receive_skb+0x55/0x280 [ 4187.661482][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4187.661818][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4187.662173][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4187.662486][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4187.662780][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4187.663086][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4187.663419][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4187.663704][ C1] ? arch_stack_walk+0x68/0x100 [ 4187.663964][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4187.664241][ C1] ? irqentry_enter+0x2b/0x60 [ 4187.664493][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4187.664813][ C1] ? irqentry_enter+0x2b/0x60 [ 4187.665069][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4187.665395][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4187.665674][ C1] ? arch_stack_walk+0x68/0x100 [ 4187.665944][ C1] __tcf_classify+0x32c/0x7d0 [ 4187.666197][ C1] tcf_classify+0x283/0x930 [ 4187.666439][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4187.666706][ C1] tc_run+0x2e4/0x5d0 [ 4187.666922][ C1] ? __pfx_tc_run+0x10/0x10 [ 4187.667165][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4187.667432][ C1] ? irqentry_enter+0x2b/0x60 [ 4187.667688][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4187.667983][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4187.668308][ C1] ip_finish_output2+0x786/0x18e0 [ 4187.668578][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4187.668867][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4187.669133][ C1] ? __ip_finish_output+0x10f/0x770 [ 4187.669410][ C1] ip_output+0x16b/0x4f0 [ 4187.669639][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4187.669959][ C1] ? __pfx_ip_output+0x10/0x10 [ 4187.670215][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4187.670572][ C1] ? __pfx_ip_output+0x10/0x10 [ 4187.670830][ C1] __ip_queue_xmit+0x672/0x1910 [ 4187.671090][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4187.671370][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4187.671663][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4187.671947][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4187.672242][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4187.672528][ C1] tcp_delack_timer+0x84/0x240 [ 4187.672785][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4187.673076][ C1] call_timer_fn+0x176/0x430 [ 4187.673328][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4187.673602][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4187.673883][ C1] __run_timers.part.0+0x52d/0x890 [ 4187.674161][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4187.674449][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4187.674750][ C1] ? __pfx___schedule+0x10/0x10 [ 4187.675012][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4187.675337][ C1] run_timer_softirq+0x72/0x100 [ 4187.675597][ C1] __do_softirq+0x1bc/0x7ff [ 4187.675851][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4187.676128][ C1] run_ksoftirqd+0x2e/0x60 [ 4187.676365][ C1] smpboot_thread_fn+0x30e/0x840 [ 4187.676632][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4187.676922][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4187.677218][ C1] kthread+0x292/0x360 [ 4187.677437][ C1] ? __pfx_kthread+0x10/0x10 [ 4187.677687][ C1] ret_from_fork+0x34/0x70 [ 4187.677926][ C1] ? __pfx_kthread+0x10/0x10 [ 4187.678175][ C1] ret_from_fork_asm+0x1b/0x30 [ 4187.678434][ C1] [ 4212.527476][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2817s! [swapper/0:0] [ 4212.527933][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4212.529130][ C0] irq event stamp: 27567077 [ 4212.529379][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4212.529909][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4212.530394][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4212.530890][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4212.531378][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4212.531850][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4212.532477][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4212.532825][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4212.533841][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4212.534173][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4212.534578][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4212.534983][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4212.535416][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4212.535841][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4212.536261][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4212.536730][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4212.537077][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4212.537498][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4212.537916][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4212.538333][ C0] Call Trace: [ 4212.538512][ C0] [ 4212.538666][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4212.538946][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4212.539200][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4212.539492][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4212.539775][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4212.540077][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4212.540356][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4212.540675][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4212.540958][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4212.541237][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4212.541564][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4212.541880][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4212.542212][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4212.542519][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4212.542831][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4212.543134][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4212.543461][ C0] ? get_stack_info+0x36/0xc0 [ 4212.543720][ C0] ? lock_acquire+0x1c1/0x220 [ 4212.543978][ C0] ? lock_release+0x1d5/0x250 [ 4212.544234][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4212.544498][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4212.544785][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4212.545086][ C0] ? lock_acquire+0x1c1/0x220 [ 4212.545333][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4212.545582][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4212.545860][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4212.546107][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4212.546365][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4212.546632][ C0] ? __inet_lookup_established+0x341/0x610 [ 4212.546943][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4212.547241][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4212.547534][ C0] ip_local_deliver+0x19d/0x480 [ 4212.547793][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4212.548076][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4212.548344][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4212.548625][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4212.548891][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4212.549227][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4212.549504][ C0] ip_rcv+0x564/0x740 [ 4212.549721][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4212.549971][ C0] ? set_track_prepare+0x8a/0xd0 [ 4212.550238][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4212.550527][ C0] ? rest_init+0x153/0x260 [ 4212.550766][ C0] ? skb_clone+0x10b/0x330 [ 4212.551005][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4212.551344][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4212.551667][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4212.551961][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4212.552269][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4212.552527][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4212.552767][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4212.553079][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4212.553375][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4212.553722][ C0] ? lock_acquire+0x1c1/0x220 [ 4212.553977][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4212.554290][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4212.554587][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4212.554920][ C0] ? __copy_skb_header+0xaf/0x490 [ 4212.555192][ C0] ? __skb_clone+0x57a/0x760 [ 4212.555442][ C0] netif_receive_skb+0x55/0x280 [ 4212.555706][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4212.556037][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4212.556389][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4212.556699][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4212.556989][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4212.557291][ C0] ? hlock_class+0x4e/0x130 [ 4212.557539][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4212.557876][ C0] ? place_entity+0x21/0x2f0 [ 4212.558126][ C0] ? resched_curr+0x219/0x280 [ 4212.558377][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4212.558643][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4212.558922][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4212.559203][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4212.559464][ C0] ? activate_task+0xf5/0x260 [ 4212.559717][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4212.559996][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4212.560269][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4212.560535][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4212.560828][ C0] ? get_stack_info+0x36/0xc0 [ 4212.561081][ C0] ? stack_access_ok+0xda/0x1f0 [ 4212.561338][ C0] ? get_reg+0x119/0x190 [ 4212.561566][ C0] __tcf_classify+0x32c/0x7d0 [ 4212.561823][ C0] tcf_classify+0x283/0x930 [ 4212.562069][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4212.562400][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4212.562666][ C0] ? arch_stack_walk+0x8c/0x100 [ 4212.562926][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4212.563216][ C0] tc_run+0x2e4/0x5d0 [ 4212.563436][ C0] ? __pfx_tc_run+0x10/0x10 [ 4212.563685][ C0] ? lock_acquire+0x1c1/0x220 [ 4212.563937][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4212.564216][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4212.564482][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4212.564769][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4212.565049][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4212.565375][ C0] ? neigh_hh_output+0x348/0x590 [ 4212.565647][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4212.565926][ C0] ip_finish_output2+0x786/0x18e0 [ 4212.566196][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4212.566487][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4212.566846][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4212.567140][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4212.567404][ C0] ? __ip_finish_output+0x10f/0x770 [ 4212.567684][ C0] ip_output+0x16b/0x4f0 [ 4212.567912][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4212.568196][ C0] ? __pfx_ip_output+0x10/0x10 [ 4212.568455][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4212.568755][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4212.569020][ C0] ? ip_local_out+0x114/0x3b0 [ 4212.569270][ C0] __ip_queue_xmit+0x672/0x1910 [ 4212.569529][ C0] ? __skb_clone+0x57a/0x760 [ 4212.569775][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4212.570061][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4212.570358][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4212.570680][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4212.570934][ C0] ? tcp_current_mss+0x40a/0x510 [ 4212.571202][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4212.571483][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4212.571764][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4212.572019][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4212.572287][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4212.572605][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4212.572886][ C0] ? ktime_get+0xb6/0x190 [ 4212.573124][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4212.573400][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4212.573681][ C0] tcp_write_timer+0x82/0x1d0 [ 4212.573939][ C0] call_timer_fn+0x176/0x430 [ 4212.574191][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4212.574465][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4212.574742][ C0] __run_timers.part.0+0x52d/0x890 [ 4212.575013][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4212.575299][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4212.575595][ C0] ? lock_acquire+0x1c1/0x220 [ 4212.575851][ C0] ? clockevents_program_event+0xf6/0x300 [ 4212.576162][ C0] ? lock_release+0x1d5/0x250 [ 4212.576413][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4212.576689][ C0] ? ktime_get+0xb6/0x190 [ 4212.576919][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4212.577218][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4212.577531][ C0] run_timer_softirq+0x72/0x100 [ 4212.577788][ C0] __do_softirq+0x1bc/0x7ff [ 4212.578031][ C0] irq_exit_rcu+0x98/0xc0 [ 4212.578265][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4212.578564][ C0] [ 4212.578735][ C0] [ 4212.578896][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4212.579221][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4212.579489][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4212.580515][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4212.580836][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4212.581255][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4212.581674][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4212.582091][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4212.582508][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4212.582926][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4212.583227][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4212.583500][ C0] default_idle_call+0x69/0xa0 [ 4212.583759][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4212.584022][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4212.584318][ C0] ? lock_release+0x1d5/0x250 [ 4212.584568][ C0] do_idle+0xfb/0x160 [ 4212.584781][ C0] cpu_startup_entry+0x55/0x60 [ 4212.585034][ C0] rest_init+0x153/0x260 [ 4212.585264][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4212.585552][ C0] arch_call_rest_init+0x13/0x40 [ 4212.585824][ C0] start_kernel+0x314/0x3d0 [ 4212.586067][ C0] x86_64_start_reservations+0x18/0x30 [ 4212.586358][ C0] x86_64_start_kernel+0xba/0x110 [ 4212.586631][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4212.586960][ C0] [ 4212.587130][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2817s! [ksoftirqd/1:22] [ 4212.587608][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4212.588820][ C1] irq event stamp: 3886976 [ 4212.589060][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4212.589558][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4212.590053][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4212.590551][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4212.591048][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4212.591539][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4212.592184][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4212.592526][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4212.593548][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4212.593872][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4212.594292][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4212.594712][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4212.595132][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4212.595553][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4212.595984][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4212.596461][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4212.596813][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4212.597240][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4212.597658][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4212.598076][ C1] Call Trace: [ 4212.598253][ C1] [ 4212.598407][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4212.598687][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4212.598946][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4212.599240][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4212.599524][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4212.599826][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4212.600106][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4212.600425][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4212.600703][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4212.601027][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4212.601337][ C1] [ 4212.601496][ C1] [ 4212.601657][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4212.601990][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4212.602295][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4212.602606][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4212.602913][ C1] ? run_ksoftirqd+0xb/0x60 [ 4212.603162][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4212.603494][ C1] ? __orc_find+0x9c/0xf0 [ 4212.603725][ C1] ? lock_acquire+0x1c1/0x220 [ 4212.603977][ C1] ? irqentry_enter+0x2b/0x60 [ 4212.604228][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4212.604488][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4212.604774][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4212.605075][ C1] ? lock_acquire+0x1c1/0x220 [ 4212.605328][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4212.605586][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4212.605867][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4212.606119][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4212.606382][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4212.606659][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4212.606952][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4212.607247][ C1] ip_local_deliver+0x19d/0x480 [ 4212.607505][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4212.607788][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4212.608054][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4212.608336][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4212.608608][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4212.608944][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4212.609223][ C1] ip_rcv+0x564/0x740 [ 4212.609444][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4212.609689][ C1] ? set_track_prepare+0x8a/0xd0 [ 4212.609960][ C1] ? irqentry_enter+0x2b/0x60 [ 4212.610213][ C1] ? irqentry_enter+0x2b/0x60 [ 4212.610465][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4212.610707][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4212.611022][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4212.611363][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4212.611672][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4212.612014][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4212.612315][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4212.612645][ C1] netif_receive_skb+0x55/0x280 [ 4212.612903][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4212.613230][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4212.613578][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4212.613893][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4212.614181][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4212.614483][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4212.614811][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4212.615092][ C1] ? arch_stack_walk+0x68/0x100 [ 4212.615355][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4212.615639][ C1] ? irqentry_enter+0x2b/0x60 [ 4212.615891][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4212.616212][ C1] ? irqentry_enter+0x2b/0x60 [ 4212.616468][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4212.616794][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4212.617075][ C1] ? arch_stack_walk+0x68/0x100 [ 4212.617337][ C1] __tcf_classify+0x32c/0x7d0 [ 4212.617592][ C1] tcf_classify+0x283/0x930 [ 4212.617838][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4212.618111][ C1] tc_run+0x2e4/0x5d0 [ 4212.618333][ C1] ? __pfx_tc_run+0x10/0x10 [ 4212.618581][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4212.618853][ C1] ? irqentry_enter+0x2b/0x60 [ 4212.619106][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4212.619394][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4212.619718][ C1] ip_finish_output2+0x786/0x18e0 [ 4212.619995][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4212.620288][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4212.620551][ C1] ? __ip_finish_output+0x10f/0x770 [ 4212.620834][ C1] ip_output+0x16b/0x4f0 [ 4212.621065][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4212.621384][ C1] ? __pfx_ip_output+0x10/0x10 [ 4212.621646][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4212.621999][ C1] ? __pfx_ip_output+0x10/0x10 [ 4212.622255][ C1] __ip_queue_xmit+0x672/0x1910 [ 4212.622520][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4212.622806][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4212.623104][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4212.623397][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4212.623698][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4212.623989][ C1] tcp_delack_timer+0x84/0x240 [ 4212.624250][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4212.624536][ C1] call_timer_fn+0x176/0x430 [ 4212.624787][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4212.625064][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4212.625341][ C1] __run_timers.part.0+0x52d/0x890 [ 4212.625623][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4212.625913][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4212.626215][ C1] ? __pfx___schedule+0x10/0x10 [ 4212.626478][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4212.626804][ C1] run_timer_softirq+0x72/0x100 [ 4212.627064][ C1] __do_softirq+0x1bc/0x7ff [ 4212.627307][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4212.627581][ C1] run_ksoftirqd+0x2e/0x60 [ 4212.627824][ C1] smpboot_thread_fn+0x30e/0x840 [ 4212.628090][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4212.628389][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4212.628683][ C1] kthread+0x292/0x360 [ 4212.628903][ C1] ? __pfx_kthread+0x10/0x10 [ 4212.629151][ C1] ret_from_fork+0x34/0x70 [ 4212.629394][ C1] ? __pfx_kthread+0x10/0x10 [ 4212.629642][ C1] ret_from_fork_asm+0x1b/0x30 [ 4212.629909][ C1] [ 4240.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2843s! [swapper/0:0] [ 4240.527920][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4240.529115][ C0] irq event stamp: 27567077 [ 4240.529354][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4240.529883][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4240.530364][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4240.530882][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4240.531384][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4240.531868][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4240.532515][ C0] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 4240.532815][ C0] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 4240.533844][ C0] RSP: 0018:ffffc900000069c8 EFLAGS: 00000202 [ 4240.534171][ C0] RAX: ffff88800a099b58 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4240.534597][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4240.535024][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4240.535447][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4240.535873][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4240.536293][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4240.536765][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4240.537121][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4240.537543][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4240.537969][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4240.538398][ C0] Call Trace: [ 4240.538580][ C0] [ 4240.538738][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4240.539013][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4240.539275][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4240.539566][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4240.539857][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4240.540163][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4240.540446][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4240.540771][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4240.541044][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4240.541324][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4240.541647][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4240.541957][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4240.542294][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4240.542596][ C0] ? kasan_check_range+0x12/0x1c0 [ 4240.542863][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 4240.543160][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4240.543486][ C0] ? get_stack_info+0x36/0xc0 [ 4240.543742][ C0] ? lock_acquire+0x1c1/0x220 [ 4240.543999][ C0] ? lock_release+0x1d5/0x250 [ 4240.544253][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4240.544515][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4240.544801][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4240.545104][ C0] ? lock_acquire+0x1c1/0x220 [ 4240.545354][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4240.545612][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4240.545888][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4240.546138][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4240.546396][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4240.546665][ C0] ? __inet_lookup_established+0x341/0x610 [ 4240.546974][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4240.547270][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4240.547562][ C0] ip_local_deliver+0x19d/0x480 [ 4240.547818][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4240.548101][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4240.548371][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4240.548651][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4240.548918][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4240.549254][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4240.549531][ C0] ip_rcv+0x564/0x740 [ 4240.549751][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4240.549996][ C0] ? set_track_prepare+0x8a/0xd0 [ 4240.550266][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4240.550555][ C0] ? rest_init+0x153/0x260 [ 4240.550795][ C0] ? skb_clone+0x10b/0x330 [ 4240.551033][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4240.551372][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4240.551701][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4240.551997][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4240.552308][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4240.552568][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4240.552810][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4240.553124][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4240.553426][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4240.553773][ C0] ? lock_acquire+0x1c1/0x220 [ 4240.554028][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4240.554340][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4240.554637][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4240.554973][ C0] ? __copy_skb_header+0xaf/0x490 [ 4240.555248][ C0] ? __skb_clone+0x57a/0x760 [ 4240.555503][ C0] netif_receive_skb+0x55/0x280 [ 4240.555765][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4240.556100][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4240.556450][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4240.556763][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4240.557060][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4240.557365][ C0] ? hlock_class+0x4e/0x130 [ 4240.557614][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4240.557944][ C0] ? place_entity+0x21/0x2f0 [ 4240.558194][ C0] ? resched_curr+0x219/0x280 [ 4240.558443][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4240.558709][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4240.558991][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4240.559277][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4240.559540][ C0] ? activate_task+0xf5/0x260 [ 4240.559794][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4240.560078][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4240.560349][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4240.560616][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4240.560909][ C0] ? get_stack_info+0x36/0xc0 [ 4240.561159][ C0] ? stack_access_ok+0xda/0x1f0 [ 4240.561414][ C0] ? get_reg+0x119/0x190 [ 4240.561641][ C0] __tcf_classify+0x32c/0x7d0 [ 4240.561895][ C0] tcf_classify+0x283/0x930 [ 4240.562142][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4240.562474][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4240.562740][ C0] ? arch_stack_walk+0x8c/0x100 [ 4240.562998][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4240.563288][ C0] tc_run+0x2e4/0x5d0 [ 4240.563511][ C0] ? __pfx_tc_run+0x10/0x10 [ 4240.563756][ C0] ? lock_acquire+0x1c1/0x220 [ 4240.564010][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4240.564289][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4240.564552][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4240.564841][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4240.565122][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4240.565446][ C0] ? neigh_hh_output+0x348/0x590 [ 4240.565720][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4240.565996][ C0] ip_finish_output2+0x786/0x18e0 [ 4240.566268][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4240.566560][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4240.566916][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4240.567208][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4240.567470][ C0] ? __ip_finish_output+0x10f/0x770 [ 4240.567752][ C0] ip_output+0x16b/0x4f0 [ 4240.567981][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4240.568266][ C0] ? __pfx_ip_output+0x10/0x10 [ 4240.568525][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4240.568823][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4240.569093][ C0] ? ip_local_out+0x114/0x3b0 [ 4240.569345][ C0] __ip_queue_xmit+0x672/0x1910 [ 4240.569604][ C0] ? __skb_clone+0x57a/0x760 [ 4240.569852][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4240.570137][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4240.570437][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4240.570756][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4240.571011][ C0] ? tcp_current_mss+0x40a/0x510 [ 4240.571281][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4240.571562][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4240.571841][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4240.572101][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4240.572368][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4240.572687][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4240.572970][ C0] ? ktime_get+0xb6/0x190 [ 4240.573207][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4240.573483][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4240.573765][ C0] tcp_write_timer+0x82/0x1d0 [ 4240.574021][ C0] call_timer_fn+0x176/0x430 [ 4240.574273][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4240.574551][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4240.574828][ C0] __run_timers.part.0+0x52d/0x890 [ 4240.575101][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4240.575387][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4240.575689][ C0] ? lock_acquire+0x1c1/0x220 [ 4240.575938][ C0] ? clockevents_program_event+0xf6/0x300 [ 4240.576242][ C0] ? lock_release+0x1d5/0x250 [ 4240.576495][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4240.576769][ C0] ? ktime_get+0xb6/0x190 [ 4240.576999][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4240.577298][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4240.577610][ C0] run_timer_softirq+0x72/0x100 [ 4240.577870][ C0] __do_softirq+0x1bc/0x7ff [ 4240.578114][ C0] irq_exit_rcu+0x98/0xc0 [ 4240.578343][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4240.578640][ C0] [ 4240.578801][ C0] [ 4240.578962][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4240.579286][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4240.579554][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4240.580573][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4240.580893][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4240.581313][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4240.581729][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4240.582147][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4240.582563][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4240.582988][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4240.583293][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4240.583566][ C0] default_idle_call+0x69/0xa0 [ 4240.583825][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4240.584089][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4240.584383][ C0] ? lock_release+0x1d5/0x250 [ 4240.584632][ C0] do_idle+0xfb/0x160 [ 4240.584845][ C0] cpu_startup_entry+0x55/0x60 [ 4240.585102][ C0] rest_init+0x153/0x260 [ 4240.585328][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4240.585618][ C0] arch_call_rest_init+0x13/0x40 [ 4240.585888][ C0] start_kernel+0x314/0x3d0 [ 4240.586130][ C0] x86_64_start_reservations+0x18/0x30 [ 4240.586420][ C0] x86_64_start_kernel+0xba/0x110 [ 4240.586692][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4240.587026][ C0] [ 4240.587196][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2843s! [ksoftirqd/1:22] [ 4240.587677][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4240.588876][ C1] irq event stamp: 3886976 [ 4240.589115][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4240.589624][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4240.590127][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4240.590633][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4240.591127][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4240.591634][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4240.592288][ C1] RIP: 0010:kasan_check_range+0x4/0x1c0 [ 4240.592596][ C1] Code: 6a 00 5b 5d 41 5c 41 5d c3 cc cc cc cc 66 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 <48> 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 [ 4240.593637][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000246 [ 4240.593963][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4240.594393][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4240.594815][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4240.595240][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4240.595667][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4240.596092][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4240.596565][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4240.596921][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4240.597350][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4240.597780][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4240.598207][ C1] Call Trace: [ 4240.598388][ C1] [ 4240.598549][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4240.598828][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4240.599088][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4240.599380][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4240.599670][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4240.599975][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4240.600261][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4240.600588][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4240.600865][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4240.601194][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4240.601512][ C1] [ 4240.601669][ C1] [ 4240.601827][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4240.602159][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4240.602469][ C1] ? kasan_check_range+0x4/0x1c0 [ 4240.602736][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 4240.603032][ C1] ? run_ksoftirqd+0xb/0x60 [ 4240.603276][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4240.603604][ C1] ? __orc_find+0x9c/0xf0 [ 4240.603840][ C1] ? lock_acquire+0x1c1/0x220 [ 4240.604096][ C1] ? irqentry_enter+0x2b/0x60 [ 4240.604352][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4240.604616][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4240.604906][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4240.605214][ C1] ? lock_acquire+0x1c1/0x220 [ 4240.605466][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4240.605728][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4240.606012][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4240.606259][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4240.606520][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4240.606792][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4240.607084][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4240.607379][ C1] ip_local_deliver+0x19d/0x480 [ 4240.607646][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4240.607936][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4240.608206][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4240.608484][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4240.608747][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4240.609090][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4240.609367][ C1] ip_rcv+0x564/0x740 [ 4240.609580][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4240.609822][ C1] ? set_track_prepare+0x8a/0xd0 [ 4240.610088][ C1] ? irqentry_enter+0x2b/0x60 [ 4240.610344][ C1] ? irqentry_enter+0x2b/0x60 [ 4240.610602][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4240.610849][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4240.611174][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4240.611520][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4240.611834][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4240.612179][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4240.612483][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4240.612823][ C1] netif_receive_skb+0x55/0x280 [ 4240.613087][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4240.613422][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4240.613776][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4240.614092][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4240.614388][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4240.614696][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4240.615033][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4240.615319][ C1] ? arch_stack_walk+0x68/0x100 [ 4240.615597][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4240.615877][ C1] ? irqentry_enter+0x2b/0x60 [ 4240.616136][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4240.616461][ C1] ? irqentry_enter+0x2b/0x60 [ 4240.616710][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4240.617036][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4240.617322][ C1] ? arch_stack_walk+0x68/0x100 [ 4240.617584][ C1] __tcf_classify+0x32c/0x7d0 [ 4240.617839][ C1] tcf_classify+0x283/0x930 [ 4240.618084][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4240.618358][ C1] tc_run+0x2e4/0x5d0 [ 4240.618573][ C1] ? __pfx_tc_run+0x10/0x10 [ 4240.618816][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4240.619082][ C1] ? irqentry_enter+0x2b/0x60 [ 4240.619338][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4240.619629][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4240.619956][ C1] ip_finish_output2+0x786/0x18e0 [ 4240.620227][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4240.620520][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4240.620788][ C1] ? __ip_finish_output+0x10f/0x770 [ 4240.621066][ C1] ip_output+0x16b/0x4f0 [ 4240.621292][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4240.621614][ C1] ? __pfx_ip_output+0x10/0x10 [ 4240.621869][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4240.622230][ C1] ? __pfx_ip_output+0x10/0x10 [ 4240.622491][ C1] __ip_queue_xmit+0x672/0x1910 [ 4240.622754][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4240.623035][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4240.623332][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4240.623618][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4240.623913][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4240.624198][ C1] tcp_delack_timer+0x84/0x240 [ 4240.624453][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4240.624744][ C1] call_timer_fn+0x176/0x430 [ 4240.624998][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4240.625274][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4240.625563][ C1] __run_timers.part.0+0x52d/0x890 [ 4240.625837][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4240.626128][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4240.626437][ C1] ? __pfx___schedule+0x10/0x10 [ 4240.626700][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4240.627021][ C1] run_timer_softirq+0x72/0x100 [ 4240.627288][ C1] __do_softirq+0x1bc/0x7ff [ 4240.627536][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4240.627816][ C1] run_ksoftirqd+0x2e/0x60 [ 4240.628058][ C1] smpboot_thread_fn+0x30e/0x840 [ 4240.628327][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4240.628618][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4240.628911][ C1] kthread+0x292/0x360 [ 4240.629133][ C1] ? __pfx_kthread+0x10/0x10 [ 4240.629384][ C1] ret_from_fork+0x34/0x70 [ 4240.629622][ C1] ? __pfx_kthread+0x10/0x10 [ 4240.629872][ C1] ret_from_fork_asm+0x1b/0x30 [ 4240.630132][ C1] [ 4265.680023][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4265.680413][ C1] rcu: 1-....: (3063094 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=732524 [ 4265.680998][ C1] rcu: (t=3071371 jiffies g=1007429 q=31 ncpus=4) [ 4265.681346][ C1] Sending NMI from CPU 1 to CPUs 0: [ 4265.681636][ C0] NMI backtrace for cpu 0 [ 4265.681645][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4265.681650][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4265.681653][ C0] RIP: 0010:__kasan_check_read+0x0/0x20 [ 4265.681661][ C0] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 4265.681665][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000202 [ 4265.681669][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4265.681670][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4265.681672][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4265.681674][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4265.681676][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4265.681678][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4265.681680][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4265.681684][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4265.681686][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4265.681688][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4265.681689][ C0] Call Trace: [ 4265.681693][ C0] [ 4265.681698][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 4265.681705][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4265.681711][ C0] ? nmi_handle+0x156/0x420 [ 4265.681716][ C0] ? default_do_nmi+0x41/0x100 [ 4265.681722][ C0] ? exc_nmi+0xf3/0x120 [ 4265.681724][ C0] ? end_repeat_nmi+0xf/0x60 [ 4265.681729][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4265.681736][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 4265.681739][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 4265.681742][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 4265.681745][ C0] [ 4265.681746][ C0] [ 4265.681747][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 4265.681751][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4265.681754][ C0] ? get_stack_info+0x36/0xc0 [ 4265.681760][ C0] ? lock_acquire+0x1c1/0x220 [ 4265.681766][ C0] ? lock_release+0x1d5/0x250 [ 4265.681770][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4265.681774][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4265.681777][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4265.681781][ C0] ? lock_acquire+0x1c1/0x220 [ 4265.681783][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4265.681790][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4265.681793][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4265.681801][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4265.681803][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4265.681808][ C0] ? __inet_lookup_established+0x341/0x610 [ 4265.681814][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4265.681822][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4265.681826][ C0] ip_local_deliver+0x19d/0x480 [ 4265.681829][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4265.681831][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4265.681838][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4265.681842][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4265.681845][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4265.681848][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4265.681859][ C0] ip_rcv+0x564/0x740 [ 4265.681862][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4265.681865][ C0] ? set_track_prepare+0x8a/0xd0 [ 4265.681870][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4265.681872][ C0] ? rest_init+0x153/0x260 [ 4265.681876][ C0] ? skb_clone+0x10b/0x330 [ 4265.681882][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4265.681888][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4265.681894][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4265.681900][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4265.681909][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4265.681912][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4265.681915][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4265.681919][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4265.681923][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4265.681926][ C0] ? lock_acquire+0x1c1/0x220 [ 4265.681929][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4265.681932][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4265.681935][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4265.681938][ C0] ? __copy_skb_header+0xaf/0x490 [ 4265.681941][ C0] ? __skb_clone+0x57a/0x760 [ 4265.681944][ C0] netif_receive_skb+0x55/0x280 [ 4265.681946][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4265.681955][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4265.681962][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4265.681968][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4265.681974][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4265.681983][ C0] ? hlock_class+0x4e/0x130 [ 4265.681988][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4265.681998][ C0] ? place_entity+0x21/0x2f0 [ 4265.682002][ C0] ? resched_curr+0x219/0x280 [ 4265.682005][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4265.682008][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4265.682012][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4265.682017][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4265.682019][ C0] ? activate_task+0xf5/0x260 [ 4265.682023][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4265.682028][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4265.682032][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4265.682035][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4265.682038][ C0] ? get_stack_info+0x36/0xc0 [ 4265.682042][ C0] ? stack_access_ok+0xda/0x1f0 [ 4265.682044][ C0] ? get_reg+0x119/0x190 [ 4265.682048][ C0] __tcf_classify+0x32c/0x7d0 [ 4265.682052][ C0] tcf_classify+0x283/0x930 [ 4265.682056][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4265.682060][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4265.682062][ C0] ? arch_stack_walk+0x8c/0x100 [ 4265.682066][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4265.682069][ C0] tc_run+0x2e4/0x5d0 [ 4265.682074][ C0] ? __pfx_tc_run+0x10/0x10 [ 4265.682078][ C0] ? lock_acquire+0x1c1/0x220 [ 4265.682080][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4265.682085][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4265.682090][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4265.682093][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4265.682097][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4265.682103][ C0] ? neigh_hh_output+0x348/0x590 [ 4265.682107][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4265.682111][ C0] ip_finish_output2+0x786/0x18e0 [ 4265.682114][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4265.682121][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4265.682128][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4265.682131][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4265.682135][ C0] ? __ip_finish_output+0x10f/0x770 [ 4265.682140][ C0] ip_output+0x16b/0x4f0 [ 4265.682143][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4265.682148][ C0] ? __pfx_ip_output+0x10/0x10 [ 4265.682151][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4265.682156][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4265.682159][ C0] ? ip_local_out+0x114/0x3b0 [ 4265.682163][ C0] __ip_queue_xmit+0x672/0x1910 [ 4265.682167][ C0] ? __skb_clone+0x57a/0x760 [ 4265.682171][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4265.682178][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4265.682183][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4265.682187][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4265.682192][ C0] ? tcp_current_mss+0x40a/0x510 [ 4265.682195][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4265.682199][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4265.682202][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4265.682204][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4265.682207][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4265.682210][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4265.682215][ C0] ? ktime_get+0xb6/0x190 [ 4265.682220][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4265.682224][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4265.682227][ C0] tcp_write_timer+0x82/0x1d0 [ 4265.682231][ C0] call_timer_fn+0x176/0x430 [ 4265.682234][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4265.682239][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4265.682243][ C0] __run_timers.part.0+0x52d/0x890 [ 4265.682246][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4265.682251][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4265.682254][ C0] ? lock_acquire+0x1c1/0x220 [ 4265.682256][ C0] ? clockevents_program_event+0xf6/0x300 [ 4265.682261][ C0] ? lock_release+0x1d5/0x250 [ 4265.682263][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4265.682266][ C0] ? ktime_get+0xb6/0x190 [ 4265.682269][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4265.682273][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4265.682277][ C0] run_timer_softirq+0x72/0x100 [ 4265.682280][ C0] __do_softirq+0x1bc/0x7ff [ 4265.682285][ C0] irq_exit_rcu+0x98/0xc0 [ 4265.682288][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4265.682292][ C0] [ 4265.682293][ C0] [ 4265.682294][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4265.682301][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4265.682305][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4265.682307][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4265.682309][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4265.682311][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4265.682313][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4265.682315][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4265.682316][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4265.682320][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4265.682323][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4265.682327][ C0] default_idle_call+0x69/0xa0 [ 4265.682329][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4265.682332][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4265.682338][ C0] ? lock_release+0x1d5/0x250 [ 4265.682342][ C0] do_idle+0xfb/0x160 [ 4265.682345][ C0] cpu_startup_entry+0x55/0x60 [ 4265.682347][ C0] rest_init+0x153/0x260 [ 4265.682350][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4265.682356][ C0] arch_call_rest_init+0x13/0x40 [ 4265.682362][ C0] start_kernel+0x314/0x3d0 [ 4265.682366][ C0] x86_64_start_reservations+0x18/0x30 [ 4265.682371][ C0] x86_64_start_kernel+0xba/0x110 [ 4265.682375][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4265.682383][ C0] [ 4265.682633][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4265.737241][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4265.737905][ C1] RIP: 0010:kasan_check_range+0x4f/0x1c0 [ 4265.738217][ C1] Code: ff ff ff ff ff ff fe 48 39 c7 77 23 44 89 c2 e8 57 e8 ff ff 83 f0 01 5b 5d 41 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff <48> 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff [ 4265.739242][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000282 [ 4265.739568][ C1] RAX: ffff7fffffffffff RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4265.739993][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4265.740412][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4265.740832][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4265.741251][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4265.741669][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4265.742138][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4265.742492][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4265.742912][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4265.743336][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4265.743763][ C1] Call Trace: [ 4265.743950][ C1] [ 4265.744108][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4265.744397][ C1] ? print_cpu_stall+0x263/0x6a0 [ 4265.744668][ C1] ? check_cpu_stall+0x284/0x500 [ 4265.744932][ C1] ? rcu_pending+0x92/0x360 [ 4265.745178][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4265.745471][ C1] ? update_process_times+0xb9/0x110 [ 4265.745760][ C1] ? tick_sched_handle+0x67/0x130 [ 4265.746031][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4265.746330][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4265.746590][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4265.746919][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4265.747215][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4265.747530][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4265.747815][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4265.748139][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4265.748414][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4265.748745][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4265.749061][ C1] [ 4265.749218][ C1] [ 4265.749375][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4265.749707][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4265.750016][ C1] ? kasan_check_range+0x4f/0x1c0 [ 4265.750291][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 4265.750589][ C1] ? run_ksoftirqd+0xb/0x60 [ 4265.750836][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4265.751170][ C1] ? __orc_find+0x9c/0xf0 [ 4265.751401][ C1] ? lock_acquire+0x1c1/0x220 [ 4265.751656][ C1] ? irqentry_enter+0x2b/0x60 [ 4265.751912][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4265.752175][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4265.752463][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4265.752762][ C1] ? lock_acquire+0x1c1/0x220 [ 4265.753016][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4265.753272][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4265.753550][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4265.753799][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4265.754059][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4265.754331][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4265.754621][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4265.754913][ C1] ip_local_deliver+0x19d/0x480 [ 4265.755180][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4265.755475][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4265.755742][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4265.756026][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4265.756294][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4265.756631][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4265.756912][ C1] ip_rcv+0x564/0x740 [ 4265.757129][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4265.757377][ C1] ? set_track_prepare+0x8a/0xd0 [ 4265.757645][ C1] ? irqentry_enter+0x2b/0x60 [ 4265.757896][ C1] ? irqentry_enter+0x2b/0x60 [ 4265.758147][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4265.758388][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4265.758702][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4265.759043][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4265.759352][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4265.759696][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4265.760000][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4265.760335][ C1] netif_receive_skb+0x55/0x280 [ 4265.760596][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4265.760927][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4265.761278][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4265.761597][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4265.761886][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4265.762191][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4265.762519][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4265.762798][ C1] ? arch_stack_walk+0x68/0x100 [ 4265.763066][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4265.763348][ C1] ? irqentry_enter+0x2b/0x60 [ 4265.763602][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4265.763928][ C1] ? irqentry_enter+0x2b/0x60 [ 4265.764181][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4265.764504][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4265.764788][ C1] ? arch_stack_walk+0x68/0x100 [ 4265.765050][ C1] __tcf_classify+0x32c/0x7d0 [ 4265.765303][ C1] tcf_classify+0x283/0x930 [ 4265.765554][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4265.765830][ C1] tc_run+0x2e4/0x5d0 [ 4265.766048][ C1] ? __pfx_tc_run+0x10/0x10 [ 4265.766298][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4265.766569][ C1] ? irqentry_enter+0x2b/0x60 [ 4265.766820][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4265.767107][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4265.767433][ C1] ip_finish_output2+0x786/0x18e0 [ 4265.767708][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4265.768002][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4265.768269][ C1] ? __ip_finish_output+0x10f/0x770 [ 4265.768551][ C1] ip_output+0x16b/0x4f0 [ 4265.768784][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4265.769110][ C1] ? __pfx_ip_output+0x10/0x10 [ 4265.769372][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4265.769724][ C1] ? __pfx_ip_output+0x10/0x10 [ 4265.769981][ C1] __ip_queue_xmit+0x672/0x1910 [ 4265.770250][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4265.770536][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4265.770839][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4265.771132][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4265.771435][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4265.771725][ C1] tcp_delack_timer+0x84/0x240 [ 4265.771986][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4265.772270][ C1] call_timer_fn+0x176/0x430 [ 4265.772517][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4265.772799][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4265.773077][ C1] __run_timers.part.0+0x52d/0x890 [ 4265.773350][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4265.773640][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4265.773944][ C1] ? __pfx___schedule+0x10/0x10 [ 4265.774204][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4265.774523][ C1] run_timer_softirq+0x72/0x100 [ 4265.774787][ C1] __do_softirq+0x1bc/0x7ff [ 4265.775035][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4265.775313][ C1] run_ksoftirqd+0x2e/0x60 [ 4265.775559][ C1] smpboot_thread_fn+0x30e/0x840 [ 4265.775827][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4265.776122][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4265.776413][ C1] kthread+0x292/0x360 [ 4265.776632][ C1] ? __pfx_kthread+0x10/0x10 [ 4265.776876][ C1] ret_from_fork+0x34/0x70 [ 4265.777119][ C1] ? __pfx_kthread+0x10/0x10 [ 4265.777367][ C1] ret_from_fork_asm+0x1b/0x30 [ 4265.777633][ C1] [ 4292.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2891s! [swapper/0:0] [ 4292.527924][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4292.529128][ C0] irq event stamp: 27567077 [ 4292.529371][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4292.529908][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4292.530384][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4292.530893][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4292.531384][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4292.531860][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4292.532508][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 4292.532847][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 4292.533866][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4292.534189][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4292.534607][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4292.535028][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4292.535456][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4292.535877][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4292.536302][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4292.536777][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4292.537125][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4292.537549][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4292.537967][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4292.538385][ C0] Call Trace: [ 4292.538566][ C0] [ 4292.538721][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4292.539000][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4292.539254][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4292.539548][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4292.539834][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4292.540135][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4292.540411][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4292.540731][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4292.541007][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4292.541283][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4292.541610][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4292.541925][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4292.542257][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4292.542562][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 4292.542870][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4292.543175][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4292.543505][ C0] ? get_stack_info+0x36/0xc0 [ 4292.543757][ C0] ? lock_acquire+0x1c1/0x220 [ 4292.544006][ C0] ? lock_release+0x1d5/0x250 [ 4292.544255][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4292.544512][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4292.544795][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4292.545094][ C0] ? lock_acquire+0x1c1/0x220 [ 4292.545353][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4292.545607][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4292.545878][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4292.546128][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4292.546388][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4292.546662][ C0] ? __inet_lookup_established+0x341/0x610 [ 4292.546980][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4292.547268][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4292.547555][ C0] ip_local_deliver+0x19d/0x480 [ 4292.547817][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4292.548107][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4292.548377][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4292.548655][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4292.548918][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4292.549258][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4292.549533][ C0] ip_rcv+0x564/0x740 [ 4292.549747][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4292.549989][ C0] ? set_track_prepare+0x8a/0xd0 [ 4292.550254][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4292.550544][ C0] ? rest_init+0x153/0x260 [ 4292.550780][ C0] ? skb_clone+0x10b/0x330 [ 4292.551021][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4292.551352][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4292.551670][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4292.551968][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4292.552281][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4292.552545][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4292.552790][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4292.553106][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4292.553408][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4292.553751][ C0] ? lock_acquire+0x1c1/0x220 [ 4292.554001][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4292.554310][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4292.554611][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4292.554941][ C0] ? __copy_skb_header+0xaf/0x490 [ 4292.555212][ C0] ? __skb_clone+0x57a/0x760 [ 4292.555463][ C0] netif_receive_skb+0x55/0x280 [ 4292.555720][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4292.556047][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4292.556393][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4292.556713][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4292.556999][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4292.557303][ C0] ? hlock_class+0x4e/0x130 [ 4292.557550][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4292.557876][ C0] ? place_entity+0x21/0x2f0 [ 4292.558122][ C0] ? resched_curr+0x219/0x280 [ 4292.558374][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4292.558646][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4292.558932][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4292.559208][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4292.559465][ C0] ? activate_task+0xf5/0x260 [ 4292.559715][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4292.559988][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4292.560264][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4292.560522][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4292.560808][ C0] ? get_stack_info+0x36/0xc0 [ 4292.561061][ C0] ? stack_access_ok+0xda/0x1f0 [ 4292.561321][ C0] ? get_reg+0x119/0x190 [ 4292.561553][ C0] __tcf_classify+0x32c/0x7d0 [ 4292.561802][ C0] tcf_classify+0x283/0x930 [ 4292.562043][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4292.562371][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4292.562639][ C0] ? arch_stack_walk+0x8c/0x100 [ 4292.562904][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4292.563198][ C0] tc_run+0x2e4/0x5d0 [ 4292.563415][ C0] ? __pfx_tc_run+0x10/0x10 [ 4292.563657][ C0] ? lock_acquire+0x1c1/0x220 [ 4292.563905][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4292.564179][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4292.564448][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4292.564733][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4292.565008][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4292.565345][ C0] ? neigh_hh_output+0x348/0x590 [ 4292.565609][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4292.565890][ C0] ip_finish_output2+0x786/0x18e0 [ 4292.566161][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4292.566457][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4292.566807][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4292.567094][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4292.567366][ C0] ? __ip_finish_output+0x10f/0x770 [ 4292.567641][ C0] ip_output+0x16b/0x4f0 [ 4292.567867][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4292.568152][ C0] ? __pfx_ip_output+0x10/0x10 [ 4292.568406][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4292.568706][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4292.568969][ C0] ? ip_local_out+0x114/0x3b0 [ 4292.569225][ C0] __ip_queue_xmit+0x672/0x1910 [ 4292.569488][ C0] ? __skb_clone+0x57a/0x760 [ 4292.569736][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4292.570016][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4292.570311][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4292.570627][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4292.570892][ C0] ? tcp_current_mss+0x40a/0x510 [ 4292.571156][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4292.571439][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4292.571716][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4292.571970][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4292.572241][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4292.572564][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4292.572840][ C0] ? ktime_get+0xb6/0x190 [ 4292.573071][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4292.573344][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4292.573628][ C0] tcp_write_timer+0x82/0x1d0 [ 4292.573878][ C0] call_timer_fn+0x176/0x430 [ 4292.574128][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4292.574403][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4292.574675][ C0] __run_timers.part.0+0x52d/0x890 [ 4292.574950][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4292.575234][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4292.575542][ C0] ? lock_acquire+0x1c1/0x220 [ 4292.575795][ C0] ? clockevents_program_event+0xf6/0x300 [ 4292.576105][ C0] ? lock_release+0x1d5/0x250 [ 4292.576357][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4292.576637][ C0] ? ktime_get+0xb6/0x190 [ 4292.576871][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4292.577172][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4292.577487][ C0] run_timer_softirq+0x72/0x100 [ 4292.577752][ C0] __do_softirq+0x1bc/0x7ff [ 4292.577999][ C0] irq_exit_rcu+0x98/0xc0 [ 4292.578235][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4292.578538][ C0] [ 4292.578694][ C0] [ 4292.578851][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4292.579168][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4292.579442][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4292.580467][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4292.580792][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4292.581218][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4292.581637][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4292.582058][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4292.582483][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4292.582909][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4292.583217][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4292.583493][ C0] default_idle_call+0x69/0xa0 [ 4292.583747][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4292.584011][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4292.584303][ C0] ? lock_release+0x1d5/0x250 [ 4292.584558][ C0] do_idle+0xfb/0x160 [ 4292.584778][ C0] cpu_startup_entry+0x55/0x60 [ 4292.585036][ C0] rest_init+0x153/0x260 [ 4292.585265][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4292.585552][ C0] arch_call_rest_init+0x13/0x40 [ 4292.585817][ C0] start_kernel+0x314/0x3d0 [ 4292.586066][ C0] x86_64_start_reservations+0x18/0x30 [ 4292.586361][ C0] x86_64_start_kernel+0xba/0x110 [ 4292.586628][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4292.586954][ C0] [ 4292.587120][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2891s! [ksoftirqd/1:22] [ 4292.587593][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4292.588801][ C1] irq event stamp: 3886976 [ 4292.589042][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4292.589539][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4292.590033][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4292.590530][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4292.591042][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4292.591530][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4292.592174][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4292.592521][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4292.593543][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4292.593870][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4292.594290][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4292.594711][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4292.595126][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4292.595553][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4292.595975][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4292.596445][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4292.596792][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4292.597218][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4292.597636][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4292.598053][ C1] Call Trace: [ 4292.598237][ C1] [ 4292.598391][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4292.598677][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4292.598936][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4292.599229][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4292.599518][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4292.599819][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4292.600096][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4292.600421][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4292.600701][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4292.601022][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4292.601331][ C1] [ 4292.601489][ C1] [ 4292.601648][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4292.601981][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4292.602284][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4292.602593][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4292.602899][ C1] ? run_ksoftirqd+0xb/0x60 [ 4292.603148][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4292.603483][ C1] ? __orc_find+0x9c/0xf0 [ 4292.603715][ C1] ? lock_acquire+0x1c1/0x220 [ 4292.603965][ C1] ? irqentry_enter+0x2b/0x60 [ 4292.604215][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4292.604475][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4292.604767][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4292.605068][ C1] ? lock_acquire+0x1c1/0x220 [ 4292.605328][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4292.605587][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4292.605864][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4292.606113][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4292.606375][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4292.606656][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4292.606952][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4292.607246][ C1] ip_local_deliver+0x19d/0x480 [ 4292.607503][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4292.607785][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4292.608051][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4292.608331][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4292.608599][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4292.608934][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4292.609218][ C1] ip_rcv+0x564/0x740 [ 4292.609441][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4292.609686][ C1] ? set_track_prepare+0x8a/0xd0 [ 4292.609956][ C1] ? irqentry_enter+0x2b/0x60 [ 4292.610214][ C1] ? irqentry_enter+0x2b/0x60 [ 4292.610467][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4292.610709][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4292.611022][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4292.611370][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4292.611679][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4292.612019][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4292.612326][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4292.612657][ C1] netif_receive_skb+0x55/0x280 [ 4292.612915][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4292.613248][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4292.613597][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4292.613913][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4292.614209][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4292.614512][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4292.614842][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4292.615122][ C1] ? arch_stack_walk+0x68/0x100 [ 4292.615391][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4292.615666][ C1] ? irqentry_enter+0x2b/0x60 [ 4292.615916][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4292.616234][ C1] ? irqentry_enter+0x2b/0x60 [ 4292.616488][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4292.616812][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4292.617091][ C1] ? arch_stack_walk+0x68/0x100 [ 4292.617352][ C1] __tcf_classify+0x32c/0x7d0 [ 4292.617606][ C1] tcf_classify+0x283/0x930 [ 4292.617851][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4292.618124][ C1] tc_run+0x2e4/0x5d0 [ 4292.618346][ C1] ? __pfx_tc_run+0x10/0x10 [ 4292.618601][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4292.618874][ C1] ? irqentry_enter+0x2b/0x60 [ 4292.619125][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4292.619410][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4292.619740][ C1] ip_finish_output2+0x786/0x18e0 [ 4292.620015][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4292.620306][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4292.620569][ C1] ? __ip_finish_output+0x10f/0x770 [ 4292.620850][ C1] ip_output+0x16b/0x4f0 [ 4292.621088][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4292.621407][ C1] ? __pfx_ip_output+0x10/0x10 [ 4292.621672][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4292.622030][ C1] ? __pfx_ip_output+0x10/0x10 [ 4292.622287][ C1] __ip_queue_xmit+0x672/0x1910 [ 4292.622552][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4292.622835][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4292.623140][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4292.623431][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4292.623731][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4292.624025][ C1] tcp_delack_timer+0x84/0x240 [ 4292.624284][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4292.624569][ C1] call_timer_fn+0x176/0x430 [ 4292.624825][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4292.625105][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4292.625390][ C1] __run_timers.part.0+0x52d/0x890 [ 4292.625666][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4292.625953][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4292.626263][ C1] ? __pfx___schedule+0x10/0x10 [ 4292.626527][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4292.626851][ C1] run_timer_softirq+0x72/0x100 [ 4292.627119][ C1] __do_softirq+0x1bc/0x7ff [ 4292.627366][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4292.627640][ C1] run_ksoftirqd+0x2e/0x60 [ 4292.627881][ C1] smpboot_thread_fn+0x30e/0x840 [ 4292.628153][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4292.628452][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4292.628752][ C1] kthread+0x292/0x360 [ 4292.628972][ C1] ? __pfx_kthread+0x10/0x10 [ 4292.629222][ C1] ret_from_fork+0x34/0x70 [ 4292.629463][ C1] ? __pfx_kthread+0x10/0x10 [ 4292.629708][ C1] ret_from_fork_asm+0x1b/0x30 [ 4292.629973][ C1] [ 4320.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2917s! [swapper/0:0] [ 4320.527930][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4320.529134][ C0] irq event stamp: 27567077 [ 4320.529378][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4320.529911][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4320.530385][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4320.530889][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4320.531382][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4320.531860][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4320.532509][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4320.532856][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4320.533884][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4320.534213][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4320.534639][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4320.535066][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4320.535490][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4320.535907][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4320.536326][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4320.536797][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4320.537149][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4320.537571][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4320.537996][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4320.538424][ C0] Call Trace: [ 4320.538606][ C0] [ 4320.538765][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4320.539042][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4320.539302][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4320.539593][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4320.539884][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4320.540190][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4320.540473][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4320.540804][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4320.541077][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4320.541357][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4320.541680][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4320.541989][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4320.542325][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4320.542627][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4320.542935][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4320.543240][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4320.543570][ C0] ? get_stack_info+0x36/0xc0 [ 4320.543821][ C0] ? lock_acquire+0x1c1/0x220 [ 4320.544072][ C0] ? lock_release+0x1d5/0x250 [ 4320.544320][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4320.544577][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4320.544859][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4320.545163][ C0] ? lock_acquire+0x1c1/0x220 [ 4320.545415][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4320.545667][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4320.545937][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4320.546187][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4320.546448][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4320.546722][ C0] ? __inet_lookup_established+0x341/0x610 [ 4320.547037][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4320.547326][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4320.547614][ C0] ip_local_deliver+0x19d/0x480 [ 4320.547875][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4320.548164][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4320.548438][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4320.548716][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4320.548978][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4320.549317][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4320.549590][ C0] ip_rcv+0x564/0x740 [ 4320.549804][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4320.550047][ C0] ? set_track_prepare+0x8a/0xd0 [ 4320.550312][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4320.550603][ C0] ? rest_init+0x153/0x260 [ 4320.550840][ C0] ? skb_clone+0x10b/0x330 [ 4320.551082][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4320.551412][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4320.551729][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4320.552029][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4320.552343][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4320.552606][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4320.552852][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4320.553168][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4320.553469][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4320.553816][ C0] ? lock_acquire+0x1c1/0x220 [ 4320.554067][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4320.554374][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4320.554679][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4320.555008][ C0] ? __copy_skb_header+0xaf/0x490 [ 4320.555283][ C0] ? __skb_clone+0x57a/0x760 [ 4320.555533][ C0] netif_receive_skb+0x55/0x280 [ 4320.555791][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4320.556118][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4320.556464][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4320.556782][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4320.557070][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4320.557370][ C0] ? hlock_class+0x4e/0x130 [ 4320.557617][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4320.557944][ C0] ? place_entity+0x21/0x2f0 [ 4320.558188][ C0] ? resched_curr+0x219/0x280 [ 4320.558442][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4320.558714][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4320.558999][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4320.559276][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4320.559534][ C0] ? activate_task+0xf5/0x260 [ 4320.559783][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4320.560057][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4320.560333][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4320.560592][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4320.560880][ C0] ? get_stack_info+0x36/0xc0 [ 4320.561134][ C0] ? stack_access_ok+0xda/0x1f0 [ 4320.561395][ C0] ? get_reg+0x119/0x190 [ 4320.561627][ C0] __tcf_classify+0x32c/0x7d0 [ 4320.561877][ C0] tcf_classify+0x283/0x930 [ 4320.562119][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4320.562448][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4320.562717][ C0] ? arch_stack_walk+0x8c/0x100 [ 4320.562982][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4320.563277][ C0] tc_run+0x2e4/0x5d0 [ 4320.563493][ C0] ? __pfx_tc_run+0x10/0x10 [ 4320.563736][ C0] ? lock_acquire+0x1c1/0x220 [ 4320.563985][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4320.564260][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4320.564530][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4320.564815][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4320.565092][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4320.565420][ C0] ? neigh_hh_output+0x348/0x590 [ 4320.565683][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4320.565964][ C0] ip_finish_output2+0x786/0x18e0 [ 4320.566235][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4320.566532][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4320.566884][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4320.567171][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4320.567439][ C0] ? __ip_finish_output+0x10f/0x770 [ 4320.567715][ C0] ip_output+0x16b/0x4f0 [ 4320.567941][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4320.568230][ C0] ? __pfx_ip_output+0x10/0x10 [ 4320.568485][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4320.568785][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4320.569049][ C0] ? ip_local_out+0x114/0x3b0 [ 4320.569306][ C0] __ip_queue_xmit+0x672/0x1910 [ 4320.569569][ C0] ? __skb_clone+0x57a/0x760 [ 4320.569818][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4320.570101][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4320.570396][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4320.570713][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4320.570973][ C0] ? tcp_current_mss+0x40a/0x510 [ 4320.571237][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4320.571520][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4320.571797][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4320.572052][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4320.572322][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4320.572644][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4320.572922][ C0] ? ktime_get+0xb6/0x190 [ 4320.573152][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4320.573424][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4320.573707][ C0] tcp_write_timer+0x82/0x1d0 [ 4320.573959][ C0] call_timer_fn+0x176/0x430 [ 4320.574209][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4320.574485][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4320.574756][ C0] __run_timers.part.0+0x52d/0x890 [ 4320.575031][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4320.575318][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4320.575616][ C0] ? lock_acquire+0x1c1/0x220 [ 4320.575872][ C0] ? clockevents_program_event+0xf6/0x300 [ 4320.576181][ C0] ? lock_release+0x1d5/0x250 [ 4320.576431][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4320.576710][ C0] ? ktime_get+0xb6/0x190 [ 4320.576943][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4320.577245][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4320.577555][ C0] run_timer_softirq+0x72/0x100 [ 4320.577820][ C0] __do_softirq+0x1bc/0x7ff [ 4320.578068][ C0] irq_exit_rcu+0x98/0xc0 [ 4320.578303][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4320.578610][ C0] [ 4320.578766][ C0] [ 4320.578923][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4320.579241][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4320.579513][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4320.580543][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4320.580870][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4320.581298][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4320.581720][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4320.582142][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4320.582574][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4320.583000][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4320.583305][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4320.583580][ C0] default_idle_call+0x69/0xa0 [ 4320.583838][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4320.584103][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4320.584396][ C0] ? lock_release+0x1d5/0x250 [ 4320.584652][ C0] do_idle+0xfb/0x160 [ 4320.584871][ C0] cpu_startup_entry+0x55/0x60 [ 4320.585136][ C0] rest_init+0x153/0x260 [ 4320.585364][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4320.585648][ C0] arch_call_rest_init+0x13/0x40 [ 4320.585917][ C0] start_kernel+0x314/0x3d0 [ 4320.586164][ C0] x86_64_start_reservations+0x18/0x30 [ 4320.586460][ C0] x86_64_start_kernel+0xba/0x110 [ 4320.586727][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4320.587055][ C0] [ 4320.587220][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2917s! [ksoftirqd/1:22] [ 4320.587695][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4320.588900][ C1] irq event stamp: 3886976 [ 4320.589140][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4320.589637][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4320.590132][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4320.590631][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4320.591128][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4320.591623][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4320.592266][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4320.592608][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4320.593629][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4320.593950][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4320.594369][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4320.594790][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4320.595218][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4320.595641][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4320.596066][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4320.596543][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4320.596892][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4320.597319][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4320.597740][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4320.598161][ C1] Call Trace: [ 4320.598342][ C1] [ 4320.598499][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4320.598779][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4320.599033][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4320.599331][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4320.599620][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4320.599923][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4320.600206][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4320.600528][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4320.600807][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4320.601133][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4320.601442][ C1] [ 4320.601603][ C1] [ 4320.601764][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4320.602098][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4320.602401][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4320.602710][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4320.603015][ C1] ? run_ksoftirqd+0xb/0x60 [ 4320.603261][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4320.603593][ C1] ? __orc_find+0x9c/0xf0 [ 4320.603823][ C1] ? lock_acquire+0x1c1/0x220 [ 4320.604075][ C1] ? irqentry_enter+0x2b/0x60 [ 4320.604327][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4320.604587][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4320.604871][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4320.605169][ C1] ? lock_acquire+0x1c1/0x220 [ 4320.605416][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4320.605666][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4320.605941][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4320.606193][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4320.606455][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4320.606729][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4320.607023][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4320.607318][ C1] ip_local_deliver+0x19d/0x480 [ 4320.607578][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4320.607864][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4320.608129][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4320.608410][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4320.608675][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4320.609010][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4320.609290][ C1] ip_rcv+0x564/0x740 [ 4320.609505][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4320.609750][ C1] ? set_track_prepare+0x8a/0xd0 [ 4320.610017][ C1] ? irqentry_enter+0x2b/0x60 [ 4320.610267][ C1] ? irqentry_enter+0x2b/0x60 [ 4320.610516][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4320.610756][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4320.611073][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4320.611413][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4320.611721][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4320.612066][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4320.612370][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4320.612706][ C1] netif_receive_skb+0x55/0x280 [ 4320.612966][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4320.613296][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4320.613643][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4320.613963][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4320.614256][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4320.614560][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4320.614891][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4320.615179][ C1] ? arch_stack_walk+0x68/0x100 [ 4320.615443][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4320.615719][ C1] ? irqentry_enter+0x2b/0x60 [ 4320.615968][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4320.616287][ C1] ? irqentry_enter+0x2b/0x60 [ 4320.616541][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4320.616869][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4320.617150][ C1] ? arch_stack_walk+0x68/0x100 [ 4320.617418][ C1] __tcf_classify+0x32c/0x7d0 [ 4320.617677][ C1] tcf_classify+0x283/0x930 [ 4320.617924][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4320.618198][ C1] tc_run+0x2e4/0x5d0 [ 4320.618414][ C1] ? __pfx_tc_run+0x10/0x10 [ 4320.618660][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4320.618929][ C1] ? irqentry_enter+0x2b/0x60 [ 4320.619178][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4320.619461][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4320.619782][ C1] ip_finish_output2+0x786/0x18e0 [ 4320.620057][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4320.620353][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4320.620619][ C1] ? __ip_finish_output+0x10f/0x770 [ 4320.620903][ C1] ip_output+0x16b/0x4f0 [ 4320.621132][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4320.621449][ C1] ? __pfx_ip_output+0x10/0x10 [ 4320.621708][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4320.622064][ C1] ? __pfx_ip_output+0x10/0x10 [ 4320.622323][ C1] __ip_queue_xmit+0x672/0x1910 [ 4320.622589][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4320.622875][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4320.623175][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4320.623465][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4320.623764][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4320.624054][ C1] tcp_delack_timer+0x84/0x240 [ 4320.624311][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4320.624596][ C1] call_timer_fn+0x176/0x430 [ 4320.624844][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4320.625129][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4320.625416][ C1] __run_timers.part.0+0x52d/0x890 [ 4320.625694][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4320.625981][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4320.626283][ C1] ? __pfx___schedule+0x10/0x10 [ 4320.626550][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4320.626872][ C1] run_timer_softirq+0x72/0x100 [ 4320.627133][ C1] __do_softirq+0x1bc/0x7ff [ 4320.627374][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4320.627649][ C1] run_ksoftirqd+0x2e/0x60 [ 4320.627891][ C1] smpboot_thread_fn+0x30e/0x840 [ 4320.628160][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4320.628455][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4320.628744][ C1] kthread+0x292/0x360 [ 4320.628967][ C1] ? __pfx_kthread+0x10/0x10 [ 4320.629214][ C1] ret_from_fork+0x34/0x70 [ 4320.629457][ C1] ? __pfx_kthread+0x10/0x10 [ 4320.629703][ C1] ret_from_fork_asm+0x1b/0x30 [ 4320.629967][ C1] [ 4343.778023][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4343.778406][ C0] rcu: 0-....: (3145899 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=751636 [ 4343.778925][ C0] rcu: (t=3149469 jiffies g=1007429 q=31 ncpus=4) [ 4343.779274][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4343.779756][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4343.780408][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4343.780759][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4343.781787][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4343.782114][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4343.782545][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4343.782971][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4343.783394][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4343.783817][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4343.784243][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4343.784715][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4343.785070][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4343.785493][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4343.785919][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4343.786342][ C0] Call Trace: [ 4343.786522][ C0] [ 4343.786680][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4343.786964][ C0] ? print_cpu_stall+0x263/0x6a0 [ 4343.787232][ C0] ? check_cpu_stall+0x284/0x500 [ 4343.787496][ C0] ? rcu_pending+0x92/0x360 [ 4343.787741][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4343.788028][ C0] ? update_process_times+0xb9/0x110 [ 4343.788310][ C0] ? tick_sched_handle+0x67/0x130 [ 4343.788584][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4343.788885][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4343.789137][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4343.789473][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4343.789757][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4343.790059][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4343.790337][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4343.790657][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4343.790934][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4343.791210][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4343.791538][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4343.791857][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4343.792186][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4343.792494][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4343.792806][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4343.793109][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4343.793435][ C0] ? get_stack_info+0x36/0xc0 [ 4343.793691][ C0] ? lock_acquire+0x1c1/0x220 [ 4343.793947][ C0] ? lock_release+0x1d5/0x250 [ 4343.794202][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4343.794469][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4343.794759][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4343.795068][ C0] ? lock_acquire+0x1c1/0x220 [ 4343.795321][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4343.795577][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4343.795853][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4343.796099][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4343.796357][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4343.796627][ C0] ? __inet_lookup_established+0x341/0x610 [ 4343.796940][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4343.797235][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4343.797530][ C0] ip_local_deliver+0x19d/0x480 [ 4343.797790][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4343.798076][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4343.798341][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4343.798622][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4343.798887][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4343.799222][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4343.799502][ C0] ip_rcv+0x564/0x740 [ 4343.799716][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4343.799961][ C0] ? set_track_prepare+0x8a/0xd0 [ 4343.800228][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4343.800514][ C0] ? rest_init+0x153/0x260 [ 4343.800755][ C0] ? skb_clone+0x10b/0x330 [ 4343.800995][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4343.801335][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4343.801657][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4343.801951][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4343.802261][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4343.802519][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4343.802758][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4343.803075][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4343.803374][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4343.803718][ C0] ? lock_acquire+0x1c1/0x220 [ 4343.803970][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4343.804292][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4343.804591][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4343.804926][ C0] ? __copy_skb_header+0xaf/0x490 [ 4343.805202][ C0] ? __skb_clone+0x57a/0x760 [ 4343.805446][ C0] netif_receive_skb+0x55/0x280 [ 4343.805709][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4343.806041][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4343.806394][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4343.806706][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4343.806995][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4343.807296][ C0] ? hlock_class+0x4e/0x130 [ 4343.807546][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4343.807880][ C0] ? place_entity+0x21/0x2f0 [ 4343.808132][ C0] ? resched_curr+0x219/0x280 [ 4343.808383][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4343.808651][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4343.808932][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4343.809214][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4343.809477][ C0] ? activate_task+0xf5/0x260 [ 4343.809730][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4343.810009][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4343.810282][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4343.810544][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4343.810844][ C0] ? get_stack_info+0x36/0xc0 [ 4343.811096][ C0] ? stack_access_ok+0xda/0x1f0 [ 4343.811355][ C0] ? get_reg+0x119/0x190 [ 4343.811581][ C0] __tcf_classify+0x32c/0x7d0 [ 4343.811837][ C0] tcf_classify+0x283/0x930 [ 4343.812082][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4343.812419][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4343.812686][ C0] ? arch_stack_walk+0x8c/0x100 [ 4343.812952][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4343.813243][ C0] tc_run+0x2e4/0x5d0 [ 4343.813458][ C0] ? __pfx_tc_run+0x10/0x10 [ 4343.813706][ C0] ? lock_acquire+0x1c1/0x220 [ 4343.813957][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4343.814235][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4343.814500][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4343.814788][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4343.815073][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4343.815390][ C0] ? neigh_hh_output+0x348/0x590 [ 4343.815659][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4343.815934][ C0] ip_finish_output2+0x786/0x18e0 [ 4343.816201][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4343.816493][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4343.816848][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4343.817142][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4343.817406][ C0] ? __ip_finish_output+0x10f/0x770 [ 4343.817686][ C0] ip_output+0x16b/0x4f0 [ 4343.817912][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4343.818191][ C0] ? __pfx_ip_output+0x10/0x10 [ 4343.818447][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4343.818746][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4343.819012][ C0] ? ip_local_out+0x114/0x3b0 [ 4343.819262][ C0] __ip_queue_xmit+0x672/0x1910 [ 4343.819519][ C0] ? __skb_clone+0x57a/0x760 [ 4343.819762][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4343.820047][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4343.820343][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4343.820666][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4343.820925][ C0] ? tcp_current_mss+0x40a/0x510 [ 4343.821190][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4343.821468][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4343.821745][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4343.822006][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4343.822274][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4343.822590][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4343.822869][ C0] ? ktime_get+0xb6/0x190 [ 4343.823104][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4343.823378][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4343.823657][ C0] tcp_write_timer+0x82/0x1d0 [ 4343.823915][ C0] call_timer_fn+0x176/0x430 [ 4343.824168][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4343.824442][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4343.824718][ C0] __run_timers.part.0+0x52d/0x890 [ 4343.824988][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4343.825287][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4343.825587][ C0] ? lock_acquire+0x1c1/0x220 [ 4343.825835][ C0] ? clockevents_program_event+0xf6/0x300 [ 4343.826140][ C0] ? lock_release+0x1d5/0x250 [ 4343.826389][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4343.826663][ C0] ? ktime_get+0xb6/0x190 [ 4343.826893][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4343.827190][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4343.827504][ C0] run_timer_softirq+0x72/0x100 [ 4343.827761][ C0] __do_softirq+0x1bc/0x7ff [ 4343.828004][ C0] irq_exit_rcu+0x98/0xc0 [ 4343.828234][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4343.828533][ C0] [ 4343.828691][ C0] [ 4343.828850][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4343.829175][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4343.829443][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4343.830463][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4343.830788][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4343.831208][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4343.831627][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4343.832048][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4343.832467][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4343.832888][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4343.833191][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4343.833463][ C0] default_idle_call+0x69/0xa0 [ 4343.833718][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4343.833982][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4343.834277][ C0] ? lock_release+0x1d5/0x250 [ 4343.834529][ C0] do_idle+0xfb/0x160 [ 4343.834741][ C0] cpu_startup_entry+0x55/0x60 [ 4343.834993][ C0] rest_init+0x153/0x260 [ 4343.835230][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4343.835524][ C0] arch_call_rest_init+0x13/0x40 [ 4343.835792][ C0] start_kernel+0x314/0x3d0 [ 4343.836035][ C0] x86_64_start_reservations+0x18/0x30 [ 4343.836326][ C0] x86_64_start_kernel+0xba/0x110 [ 4343.836597][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4343.836926][ C0] [ 4343.837094][ C0] Sending NMI from CPU 0 to CPUs 1: [ 4343.837382][ C1] NMI backtrace for cpu 1 [ 4343.837390][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4343.837395][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4343.837398][ C1] RIP: 0010:kasan_check_range+0x4f/0x1c0 [ 4343.837408][ C1] Code: ff ff ff ff ff ff fe 48 39 c7 77 23 44 89 c2 e8 57 e8 ff ff 83 f0 01 5b 5d 41 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff <48> 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff [ 4343.837411][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000282 [ 4343.837416][ C1] RAX: ffff7fffffffffff RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4343.837418][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4343.837419][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4343.837421][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4343.837423][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4343.837424][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4343.837427][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4343.837430][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4343.837432][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4343.837434][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4343.837435][ C1] Call Trace: [ 4343.837439][ C1] [ 4343.837443][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 4343.837449][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4343.837455][ C1] ? nmi_handle+0x156/0x420 [ 4343.837461][ C1] ? default_do_nmi+0x41/0x100 [ 4343.837465][ C1] ? exc_nmi+0xf3/0x120 [ 4343.837468][ C1] ? end_repeat_nmi+0xf/0x60 [ 4343.837472][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4343.837478][ C1] ? kasan_check_range+0x4f/0x1c0 [ 4343.837481][ C1] ? kasan_check_range+0x4f/0x1c0 [ 4343.837485][ C1] ? kasan_check_range+0x4f/0x1c0 [ 4343.837488][ C1] [ 4343.837489][ C1] [ 4343.837490][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 4343.837494][ C1] ? run_ksoftirqd+0xb/0x60 [ 4343.837499][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4343.837502][ C1] ? __orc_find+0x9c/0xf0 [ 4343.837505][ C1] ? lock_acquire+0x1c1/0x220 [ 4343.837509][ C1] ? irqentry_enter+0x2b/0x60 [ 4343.837514][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4343.837518][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4343.837521][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4343.837524][ C1] ? lock_acquire+0x1c1/0x220 [ 4343.837526][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4343.837532][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4343.837535][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4343.837543][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4343.837545][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4343.837551][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4343.837558][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4343.837562][ C1] ip_local_deliver+0x19d/0x480 [ 4343.837565][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4343.837568][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4343.837572][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4343.837576][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4343.837579][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4343.837582][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4343.837591][ C1] ip_rcv+0x564/0x740 [ 4343.837595][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4343.837598][ C1] ? set_track_prepare+0x8a/0xd0 [ 4343.837602][ C1] ? irqentry_enter+0x2b/0x60 [ 4343.837606][ C1] ? irqentry_enter+0x2b/0x60 [ 4343.837609][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4343.837612][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4343.837616][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4343.837620][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4343.837623][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4343.837626][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4343.837629][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4343.837633][ C1] netif_receive_skb+0x55/0x280 [ 4343.837636][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4343.837645][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4343.837652][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4343.837658][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4343.837665][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4343.837677][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4343.837686][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4343.837689][ C1] ? arch_stack_walk+0x68/0x100 [ 4343.837694][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4343.837697][ C1] ? irqentry_enter+0x2b/0x60 [ 4343.837700][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4343.837705][ C1] ? irqentry_enter+0x2b/0x60 [ 4343.837708][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4343.837715][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4343.837718][ C1] ? arch_stack_walk+0x68/0x100 [ 4343.837722][ C1] __tcf_classify+0x32c/0x7d0 [ 4343.837727][ C1] tcf_classify+0x283/0x930 [ 4343.837731][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4343.837735][ C1] tc_run+0x2e4/0x5d0 [ 4343.837739][ C1] ? __pfx_tc_run+0x10/0x10 [ 4343.837745][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4343.837750][ C1] ? irqentry_enter+0x2b/0x60 [ 4343.837753][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4343.837756][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4343.837763][ C1] ip_finish_output2+0x786/0x18e0 [ 4343.837768][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4343.837771][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4343.837775][ C1] ? __ip_finish_output+0x10f/0x770 [ 4343.837779][ C1] ip_output+0x16b/0x4f0 [ 4343.837782][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4343.837785][ C1] ? __pfx_ip_output+0x10/0x10 [ 4343.837789][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4343.837797][ C1] ? __pfx_ip_output+0x10/0x10 [ 4343.837801][ C1] __ip_queue_xmit+0x672/0x1910 [ 4343.837806][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4343.837814][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4343.837818][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4343.837822][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4343.837826][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4343.837829][ C1] tcp_delack_timer+0x84/0x240 [ 4343.837833][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4343.837835][ C1] call_timer_fn+0x176/0x430 [ 4343.837841][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4343.837846][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4343.837849][ C1] __run_timers.part.0+0x52d/0x890 [ 4343.837853][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4343.837857][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4343.837862][ C1] ? __pfx___schedule+0x10/0x10 [ 4343.837865][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4343.837870][ C1] run_timer_softirq+0x72/0x100 [ 4343.837873][ C1] __do_softirq+0x1bc/0x7ff [ 4343.837877][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4343.837881][ C1] run_ksoftirqd+0x2e/0x60 [ 4343.837884][ C1] smpboot_thread_fn+0x30e/0x840 [ 4343.837888][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4343.837892][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4343.837895][ C1] kthread+0x292/0x360 [ 4343.837897][ C1] ? __pfx_kthread+0x10/0x10 [ 4343.837900][ C1] ret_from_fork+0x34/0x70 [ 4343.837903][ C1] ? __pfx_kthread+0x10/0x10 [ 4343.837905][ C1] ret_from_fork_asm+0x1b/0x30 [ 4343.837912][ C1] [ 4368.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2962s! [swapper/0:0] [ 4368.527928][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4368.529131][ C0] irq event stamp: 27567077 [ 4368.529375][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4368.529905][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4368.530380][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4368.530880][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4368.531374][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4368.531856][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4368.532507][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 4368.532847][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 4368.533866][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4368.534187][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4368.534607][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4368.535035][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4368.535455][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4368.535877][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4368.536303][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4368.536779][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4368.537125][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4368.537552][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4368.537971][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4368.538387][ C0] Call Trace: [ 4368.538564][ C0] [ 4368.538720][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4368.538999][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4368.539255][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4368.539548][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4368.539837][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4368.540141][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4368.540418][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4368.540742][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4368.541018][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4368.541294][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4368.541625][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4368.541937][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4368.542268][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4368.542576][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 4368.542883][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4368.543189][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4368.543518][ C0] ? get_stack_info+0x36/0xc0 [ 4368.543770][ C0] ? lock_acquire+0x1c1/0x220 [ 4368.544019][ C0] ? lock_release+0x1d5/0x250 [ 4368.544267][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4368.544527][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4368.544811][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4368.545116][ C0] ? lock_acquire+0x1c1/0x220 [ 4368.545366][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4368.545620][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4368.545892][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4368.546147][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4368.546409][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4368.546682][ C0] ? __inet_lookup_established+0x341/0x610 [ 4368.546996][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4368.547284][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4368.547578][ C0] ip_local_deliver+0x19d/0x480 [ 4368.547842][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4368.548132][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4368.548400][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4368.548677][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4368.548939][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4368.549279][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4368.549552][ C0] ip_rcv+0x564/0x740 [ 4368.549764][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4368.550005][ C0] ? set_track_prepare+0x8a/0xd0 [ 4368.550271][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4368.550563][ C0] ? rest_init+0x153/0x260 [ 4368.550798][ C0] ? skb_clone+0x10b/0x330 [ 4368.551042][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4368.551376][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4368.551693][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4368.551993][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4368.552306][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4368.552567][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4368.552810][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4368.553130][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4368.553431][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4368.553770][ C0] ? lock_acquire+0x1c1/0x220 [ 4368.554017][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4368.554328][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4368.554636][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4368.554975][ C0] ? __copy_skb_header+0xaf/0x490 [ 4368.555246][ C0] ? __skb_clone+0x57a/0x760 [ 4368.555498][ C0] netif_receive_skb+0x55/0x280 [ 4368.555754][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4368.556079][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4368.556426][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4368.556746][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4368.557034][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4368.557332][ C0] ? hlock_class+0x4e/0x130 [ 4368.557576][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4368.557905][ C0] ? place_entity+0x21/0x2f0 [ 4368.558151][ C0] ? resched_curr+0x219/0x280 [ 4368.558405][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4368.558677][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4368.558962][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4368.559241][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4368.559499][ C0] ? activate_task+0xf5/0x260 [ 4368.559749][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4368.560024][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4368.560300][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4368.560557][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4368.560844][ C0] ? get_stack_info+0x36/0xc0 [ 4368.561100][ C0] ? stack_access_ok+0xda/0x1f0 [ 4368.561365][ C0] ? get_reg+0x119/0x190 [ 4368.561592][ C0] __tcf_classify+0x32c/0x7d0 [ 4368.561840][ C0] tcf_classify+0x283/0x930 [ 4368.562081][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4368.562408][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4368.562676][ C0] ? arch_stack_walk+0x8c/0x100 [ 4368.562943][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4368.563237][ C0] tc_run+0x2e4/0x5d0 [ 4368.563450][ C0] ? __pfx_tc_run+0x10/0x10 [ 4368.563691][ C0] ? lock_acquire+0x1c1/0x220 [ 4368.563940][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4368.564214][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4368.564485][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4368.564770][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4368.565054][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4368.565376][ C0] ? neigh_hh_output+0x348/0x590 [ 4368.565638][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4368.565917][ C0] ip_finish_output2+0x786/0x18e0 [ 4368.566189][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4368.566489][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4368.566839][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4368.567126][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4368.567393][ C0] ? __ip_finish_output+0x10f/0x770 [ 4368.567671][ C0] ip_output+0x16b/0x4f0 [ 4368.567897][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4368.568181][ C0] ? __pfx_ip_output+0x10/0x10 [ 4368.568433][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4368.568740][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4368.569003][ C0] ? ip_local_out+0x114/0x3b0 [ 4368.569260][ C0] __ip_queue_xmit+0x672/0x1910 [ 4368.569522][ C0] ? __skb_clone+0x57a/0x760 [ 4368.569770][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4368.570051][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4368.570345][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4368.570665][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4368.570925][ C0] ? tcp_current_mss+0x40a/0x510 [ 4368.571188][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4368.571471][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4368.571745][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4368.571998][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4368.572269][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4368.572589][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4368.572865][ C0] ? ktime_get+0xb6/0x190 [ 4368.573096][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4368.573368][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4368.573650][ C0] tcp_write_timer+0x82/0x1d0 [ 4368.573898][ C0] call_timer_fn+0x176/0x430 [ 4368.574143][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4368.574419][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4368.574691][ C0] __run_timers.part.0+0x52d/0x890 [ 4368.574974][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4368.575262][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4368.575559][ C0] ? lock_acquire+0x1c1/0x220 [ 4368.575811][ C0] ? clockevents_program_event+0xf6/0x300 [ 4368.576118][ C0] ? lock_release+0x1d5/0x250 [ 4368.576372][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4368.576652][ C0] ? ktime_get+0xb6/0x190 [ 4368.576886][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4368.577187][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4368.577497][ C0] run_timer_softirq+0x72/0x100 [ 4368.577760][ C0] __do_softirq+0x1bc/0x7ff [ 4368.578008][ C0] irq_exit_rcu+0x98/0xc0 [ 4368.578240][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4368.578543][ C0] [ 4368.578700][ C0] [ 4368.578856][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4368.579176][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4368.579449][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4368.580479][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4368.580807][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4368.581229][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4368.581650][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4368.582075][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4368.582501][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4368.582923][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4368.583228][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4368.583504][ C0] default_idle_call+0x69/0xa0 [ 4368.583755][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4368.584022][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4368.584313][ C0] ? lock_release+0x1d5/0x250 [ 4368.584570][ C0] do_idle+0xfb/0x160 [ 4368.584785][ C0] cpu_startup_entry+0x55/0x60 [ 4368.585047][ C0] rest_init+0x153/0x260 [ 4368.585275][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4368.585563][ C0] arch_call_rest_init+0x13/0x40 [ 4368.585827][ C0] start_kernel+0x314/0x3d0 [ 4368.586075][ C0] x86_64_start_reservations+0x18/0x30 [ 4368.586370][ C0] x86_64_start_kernel+0xba/0x110 [ 4368.586639][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4368.586962][ C0] [ 4368.587127][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2962s! [ksoftirqd/1:22] [ 4368.587600][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4368.588801][ C1] irq event stamp: 3886976 [ 4368.589040][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4368.589537][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4368.590032][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4368.590530][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4368.591025][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4368.591518][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4368.592165][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4368.592506][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4368.593528][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4368.593852][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4368.594274][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4368.594693][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4368.595120][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4368.595545][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4368.595973][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4368.596447][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4368.596797][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4368.597228][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4368.597649][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4368.598068][ C1] Call Trace: [ 4368.598245][ C1] [ 4368.598400][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4368.598681][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4368.598937][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4368.599231][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4368.599517][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4368.599820][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4368.600100][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4368.600420][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4368.600698][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4368.601021][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4368.601332][ C1] [ 4368.601492][ C1] [ 4368.601652][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4368.601986][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4368.602292][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4368.602603][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4368.602910][ C1] ? run_ksoftirqd+0xb/0x60 [ 4368.603159][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4368.603489][ C1] ? __orc_find+0x9c/0xf0 [ 4368.603720][ C1] ? lock_acquire+0x1c1/0x220 [ 4368.603970][ C1] ? irqentry_enter+0x2b/0x60 [ 4368.604220][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4368.604480][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4368.604765][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4368.605071][ C1] ? lock_acquire+0x1c1/0x220 [ 4368.605322][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4368.605576][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4368.605850][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4368.606101][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4368.606363][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4368.606640][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4368.606934][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4368.607228][ C1] ip_local_deliver+0x19d/0x480 [ 4368.607488][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4368.607771][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4368.608037][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4368.608318][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4368.608586][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4368.608922][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4368.609201][ C1] ip_rcv+0x564/0x740 [ 4368.609421][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4368.609667][ C1] ? set_track_prepare+0x8a/0xd0 [ 4368.609936][ C1] ? irqentry_enter+0x2b/0x60 [ 4368.610188][ C1] ? irqentry_enter+0x2b/0x60 [ 4368.610442][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4368.610685][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4368.610999][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4368.611340][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4368.611652][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4368.611995][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4368.612296][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4368.612626][ C1] netif_receive_skb+0x55/0x280 [ 4368.612885][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4368.613211][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4368.613561][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4368.613876][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4368.614165][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4368.614466][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4368.614793][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4368.615085][ C1] ? arch_stack_walk+0x68/0x100 [ 4368.615347][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4368.615625][ C1] ? irqentry_enter+0x2b/0x60 [ 4368.615877][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4368.616197][ C1] ? irqentry_enter+0x2b/0x60 [ 4368.616453][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4368.616780][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4368.617061][ C1] ? arch_stack_walk+0x68/0x100 [ 4368.617324][ C1] __tcf_classify+0x32c/0x7d0 [ 4368.617581][ C1] tcf_classify+0x283/0x930 [ 4368.617828][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4368.618102][ C1] tc_run+0x2e4/0x5d0 [ 4368.618326][ C1] ? __pfx_tc_run+0x10/0x10 [ 4368.618574][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4368.618848][ C1] ? irqentry_enter+0x2b/0x60 [ 4368.619102][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4368.619389][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4368.619712][ C1] ip_finish_output2+0x786/0x18e0 [ 4368.619987][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4368.620281][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4368.620545][ C1] ? __ip_finish_output+0x10f/0x770 [ 4368.620827][ C1] ip_output+0x16b/0x4f0 [ 4368.621060][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4368.621378][ C1] ? __pfx_ip_output+0x10/0x10 [ 4368.621640][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4368.621993][ C1] ? __pfx_ip_output+0x10/0x10 [ 4368.622248][ C1] __ip_queue_xmit+0x672/0x1910 [ 4368.622513][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4368.622798][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4368.623098][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4368.623389][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4368.623691][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4368.623982][ C1] tcp_delack_timer+0x84/0x240 [ 4368.624244][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4368.624530][ C1] call_timer_fn+0x176/0x430 [ 4368.624781][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4368.625061][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4368.625344][ C1] __run_timers.part.0+0x52d/0x890 [ 4368.625620][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4368.625910][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4368.626213][ C1] ? __pfx___schedule+0x10/0x10 [ 4368.626475][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4368.626801][ C1] run_timer_softirq+0x72/0x100 [ 4368.627063][ C1] __do_softirq+0x1bc/0x7ff [ 4368.627306][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4368.627581][ C1] run_ksoftirqd+0x2e/0x60 [ 4368.627824][ C1] smpboot_thread_fn+0x30e/0x840 [ 4368.628090][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4368.628387][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4368.628680][ C1] kthread+0x292/0x360 [ 4368.628900][ C1] ? __pfx_kthread+0x10/0x10 [ 4368.629147][ C1] ret_from_fork+0x34/0x70 [ 4368.629392][ C1] ? __pfx_kthread+0x10/0x10 [ 4368.629638][ C1] ret_from_fork_asm+0x1b/0x30 [ 4368.629904][ C1] [ 4396.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 2988s! [swapper/0:0] [ 4396.527918][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4396.529121][ C0] irq event stamp: 27567077 [ 4396.529368][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4396.529904][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4396.530378][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4396.530878][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4396.531369][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4396.531849][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4396.532501][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4396.532844][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4396.533872][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4396.534203][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4396.534625][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4396.535053][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4396.535471][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4396.535890][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4396.536309][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4396.536776][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4396.537133][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4396.537556][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4396.537977][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4396.538400][ C0] Call Trace: [ 4396.538586][ C0] [ 4396.538743][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4396.539017][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4396.539274][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4396.539562][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4396.539850][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4396.540157][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4396.540438][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4396.540763][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4396.541037][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4396.541315][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4396.541635][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4396.541948][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4396.542284][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4396.542586][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4396.542893][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4396.543200][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4396.543528][ C0] ? get_stack_info+0x36/0xc0 [ 4396.543782][ C0] ? lock_acquire+0x1c1/0x220 [ 4396.544034][ C0] ? lock_release+0x1d5/0x250 [ 4396.544285][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4396.544545][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4396.544837][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4396.545139][ C0] ? lock_acquire+0x1c1/0x220 [ 4396.545391][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4396.545641][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4396.545913][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4396.546163][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4396.546426][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4396.546696][ C0] ? __inet_lookup_established+0x341/0x610 [ 4396.547012][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4396.547300][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4396.547591][ C0] ip_local_deliver+0x19d/0x480 [ 4396.547853][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4396.548140][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4396.548405][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4396.548679][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4396.548941][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4396.549282][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4396.549556][ C0] ip_rcv+0x564/0x740 [ 4396.549767][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4396.550007][ C0] ? set_track_prepare+0x8a/0xd0 [ 4396.550270][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4396.550563][ C0] ? rest_init+0x153/0x260 [ 4396.550799][ C0] ? skb_clone+0x10b/0x330 [ 4396.551042][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4396.551376][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4396.551695][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4396.551996][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4396.552309][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4396.552570][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4396.552814][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4396.553139][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4396.553440][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4396.553782][ C0] ? lock_acquire+0x1c1/0x220 [ 4396.554029][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4396.554337][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4396.554637][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4396.554981][ C0] ? __copy_skb_header+0xaf/0x490 [ 4396.555252][ C0] ? __skb_clone+0x57a/0x760 [ 4396.555500][ C0] netif_receive_skb+0x55/0x280 [ 4396.555757][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4396.556083][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4396.556430][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4396.556745][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4396.557031][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4396.557327][ C0] ? hlock_class+0x4e/0x130 [ 4396.557571][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4396.557900][ C0] ? place_entity+0x21/0x2f0 [ 4396.558148][ C0] ? resched_curr+0x219/0x280 [ 4396.558403][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4396.558672][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4396.558956][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4396.559232][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4396.559488][ C0] ? activate_task+0xf5/0x260 [ 4396.559736][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4396.560011][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4396.560286][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4396.560543][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4396.560834][ C0] ? get_stack_info+0x36/0xc0 [ 4396.561091][ C0] ? stack_access_ok+0xda/0x1f0 [ 4396.561351][ C0] ? get_reg+0x119/0x190 [ 4396.561579][ C0] __tcf_classify+0x32c/0x7d0 [ 4396.561831][ C0] tcf_classify+0x283/0x930 [ 4396.562072][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4396.562397][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4396.562666][ C0] ? arch_stack_walk+0x8c/0x100 [ 4396.562930][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4396.563221][ C0] tc_run+0x2e4/0x5d0 [ 4396.563434][ C0] ? __pfx_tc_run+0x10/0x10 [ 4396.563674][ C0] ? lock_acquire+0x1c1/0x220 [ 4396.563921][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4396.564195][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4396.564463][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4396.564746][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4396.565033][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4396.565352][ C0] ? neigh_hh_output+0x348/0x590 [ 4396.565615][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4396.565895][ C0] ip_finish_output2+0x786/0x18e0 [ 4396.566167][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4396.566460][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4396.566811][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4396.567101][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4396.567367][ C0] ? __ip_finish_output+0x10f/0x770 [ 4396.567642][ C0] ip_output+0x16b/0x4f0 [ 4396.567865][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4396.568150][ C0] ? __pfx_ip_output+0x10/0x10 [ 4396.568401][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4396.568704][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4396.568965][ C0] ? ip_local_out+0x114/0x3b0 [ 4396.569218][ C0] __ip_queue_xmit+0x672/0x1910 [ 4396.569481][ C0] ? __skb_clone+0x57a/0x760 [ 4396.569729][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4396.570007][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4396.570299][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4396.570613][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4396.570870][ C0] ? tcp_current_mss+0x40a/0x510 [ 4396.571132][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4396.571414][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4396.571687][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4396.571936][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4396.572208][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4396.572526][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4396.572799][ C0] ? ktime_get+0xb6/0x190 [ 4396.573030][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4396.573302][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4396.573586][ C0] tcp_write_timer+0x82/0x1d0 [ 4396.573833][ C0] call_timer_fn+0x176/0x430 [ 4396.574077][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4396.574353][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4396.574626][ C0] __run_timers.part.0+0x52d/0x890 [ 4396.574905][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4396.575190][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4396.575486][ C0] ? lock_acquire+0x1c1/0x220 [ 4396.575736][ C0] ? clockevents_program_event+0xf6/0x300 [ 4396.576046][ C0] ? lock_release+0x1d5/0x250 [ 4396.576300][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4396.576578][ C0] ? ktime_get+0xb6/0x190 [ 4396.576812][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4396.577112][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4396.577421][ C0] run_timer_softirq+0x72/0x100 [ 4396.577682][ C0] __do_softirq+0x1bc/0x7ff [ 4396.577928][ C0] irq_exit_rcu+0x98/0xc0 [ 4396.578160][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4396.578461][ C0] [ 4396.578621][ C0] [ 4396.578778][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4396.579099][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4396.579369][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4396.580398][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4396.580724][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4396.581144][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4396.581565][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4396.581988][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4396.582407][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4396.582829][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4396.583135][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4396.583408][ C0] default_idle_call+0x69/0xa0 [ 4396.583660][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4396.583932][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4396.584227][ C0] ? lock_release+0x1d5/0x250 [ 4396.584481][ C0] do_idle+0xfb/0x160 [ 4396.584695][ C0] cpu_startup_entry+0x55/0x60 [ 4396.584956][ C0] rest_init+0x153/0x260 [ 4396.585186][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4396.585474][ C0] arch_call_rest_init+0x13/0x40 [ 4396.585739][ C0] start_kernel+0x314/0x3d0 [ 4396.585982][ C0] x86_64_start_reservations+0x18/0x30 [ 4396.586276][ C0] x86_64_start_kernel+0xba/0x110 [ 4396.586541][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4396.586865][ C0] [ 4396.587028][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2988s! [ksoftirqd/1:22] [ 4396.587496][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4396.588699][ C1] irq event stamp: 3886976 [ 4396.588937][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4396.589434][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4396.589927][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4396.590426][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4396.590921][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4396.591415][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4396.592060][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 4396.592354][ C1] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 4396.593372][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [ 4396.593692][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4396.594111][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4396.594531][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4396.594961][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4396.595385][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4396.595809][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4396.596286][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4396.596634][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4396.597059][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4396.597480][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4396.597900][ C1] Call Trace: [ 4396.598081][ C1] [ 4396.598238][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4396.598517][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4396.598772][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4396.599068][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4396.599355][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4396.599657][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4396.599936][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4396.600258][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4396.600537][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4396.600862][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4396.601171][ C1] [ 4396.601332][ C1] [ 4396.601497][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4396.601832][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4396.602136][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 4396.602429][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 4396.602723][ C1] ? run_ksoftirqd+0xb/0x60 [ 4396.602966][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4396.603295][ C1] ? __orc_find+0x9c/0xf0 [ 4396.603529][ C1] ? lock_acquire+0x1c1/0x220 [ 4396.603787][ C1] ? irqentry_enter+0x2b/0x60 [ 4396.604045][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4396.604312][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4396.604602][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4396.604909][ C1] ? lock_acquire+0x1c1/0x220 [ 4396.605163][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4396.605420][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4396.605696][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4396.605940][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4396.606201][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4396.606472][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4396.606760][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4396.607050][ C1] ip_local_deliver+0x19d/0x480 [ 4396.607313][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4396.607602][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4396.607872][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4396.608151][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4396.608414][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4396.608754][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4396.609029][ C1] ip_rcv+0x564/0x740 [ 4396.609244][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4396.609487][ C1] ? set_track_prepare+0x8a/0xd0 [ 4396.609752][ C1] ? irqentry_enter+0x2b/0x60 [ 4396.610005][ C1] ? irqentry_enter+0x2b/0x60 [ 4396.610261][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4396.610506][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4396.610823][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4396.611168][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4396.611480][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4396.611820][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4396.612118][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4396.612459][ C1] netif_receive_skb+0x55/0x280 [ 4396.612725][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4396.613058][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4396.613411][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4396.613723][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4396.614015][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4396.614322][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4396.614654][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4396.614943][ C1] ? arch_stack_walk+0x68/0x100 [ 4396.615207][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4396.615487][ C1] ? irqentry_enter+0x2b/0x60 [ 4396.615740][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4396.616066][ C1] ? irqentry_enter+0x2b/0x60 [ 4396.616316][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4396.616637][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4396.616920][ C1] ? arch_stack_walk+0x68/0x100 [ 4396.617180][ C1] __tcf_classify+0x32c/0x7d0 [ 4396.617430][ C1] tcf_classify+0x283/0x930 [ 4396.617671][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4396.617940][ C1] tc_run+0x2e4/0x5d0 [ 4396.618158][ C1] ? __pfx_tc_run+0x10/0x10 [ 4396.618404][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4396.618670][ C1] ? irqentry_enter+0x2b/0x60 [ 4396.618923][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4396.619214][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4396.619542][ C1] ip_finish_output2+0x786/0x18e0 [ 4396.619813][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4396.620101][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4396.620369][ C1] ? __ip_finish_output+0x10f/0x770 [ 4396.620648][ C1] ip_output+0x16b/0x4f0 [ 4396.620874][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4396.621199][ C1] ? __pfx_ip_output+0x10/0x10 [ 4396.621457][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4396.621813][ C1] ? __pfx_ip_output+0x10/0x10 [ 4396.622072][ C1] __ip_queue_xmit+0x672/0x1910 [ 4396.622332][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4396.622616][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4396.622911][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4396.623202][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4396.623502][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4396.623790][ C1] tcp_delack_timer+0x84/0x240 [ 4396.624047][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4396.624337][ C1] call_timer_fn+0x176/0x430 [ 4396.624590][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4396.624873][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4396.625152][ C1] __run_timers.part.0+0x52d/0x890 [ 4396.625427][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4396.625720][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4396.626024][ C1] ? __pfx___schedule+0x10/0x10 [ 4396.626283][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4396.626602][ C1] run_timer_softirq+0x72/0x100 [ 4396.626865][ C1] __do_softirq+0x1bc/0x7ff [ 4396.627112][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4396.627390][ C1] run_ksoftirqd+0x2e/0x60 [ 4396.627628][ C1] smpboot_thread_fn+0x30e/0x840 [ 4396.627897][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4396.628194][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4396.628488][ C1] kthread+0x292/0x360 [ 4396.628704][ C1] ? __pfx_kthread+0x10/0x10 [ 4396.628953][ C1] ret_from_fork+0x34/0x70 [ 4396.629193][ C1] ? __pfx_kthread+0x10/0x10 [ 4396.629443][ C1] ret_from_fork_asm+0x1b/0x30 [ 4396.629705][ C1] [ 4421.841024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4421.841408][ C0] rcu: 0-....: (3223785 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=769977 [ 4421.841923][ C0] rcu: (t=3227532 jiffies g=1007429 q=31 ncpus=4) [ 4421.842274][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4421.842751][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4421.843398][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4421.843747][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4421.844777][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4421.845097][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4421.845518][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4421.845935][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4421.846351][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4421.846766][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4421.847181][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4421.847649][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4421.847999][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4421.848418][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4421.848842][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4421.849267][ C0] Call Trace: [ 4421.849447][ C0] [ 4421.849604][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4421.849891][ C0] ? print_cpu_stall+0x263/0x6a0 [ 4421.850159][ C0] ? check_cpu_stall+0x284/0x500 [ 4421.850421][ C0] ? rcu_pending+0x92/0x360 [ 4421.850664][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4421.850949][ C0] ? update_process_times+0xb9/0x110 [ 4421.851230][ C0] ? tick_sched_handle+0x67/0x130 [ 4421.851502][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4421.851804][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4421.852057][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4421.852388][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4421.852673][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4421.852972][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4421.853248][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4421.853570][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4421.853843][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4421.854117][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4421.854447][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4421.854762][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4421.855096][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4421.855396][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4421.855703][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4421.856007][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4421.856336][ C0] ? get_stack_info+0x36/0xc0 [ 4421.856589][ C0] ? lock_acquire+0x1c1/0x220 [ 4421.856839][ C0] ? lock_release+0x1d5/0x250 [ 4421.857092][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4421.857349][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4421.857629][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4421.857927][ C0] ? lock_acquire+0x1c1/0x220 [ 4421.858181][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4421.858439][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4421.858713][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4421.858956][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4421.859212][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4421.859479][ C0] ? __inet_lookup_established+0x341/0x610 [ 4421.859787][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4421.860078][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4421.860369][ C0] ip_local_deliver+0x19d/0x480 [ 4421.860629][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4421.860913][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4421.861177][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4421.861457][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4421.861722][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4421.862056][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4421.862333][ C0] ip_rcv+0x564/0x740 [ 4421.862548][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4421.862792][ C0] ? set_track_prepare+0x8a/0xd0 [ 4421.863059][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4421.863343][ C0] ? rest_init+0x153/0x260 [ 4421.863581][ C0] ? skb_clone+0x10b/0x330 [ 4421.863820][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4421.864156][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4421.864476][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4421.864778][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4421.865089][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4421.865351][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4421.865597][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4421.865912][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4421.866214][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4421.866551][ C0] ? lock_acquire+0x1c1/0x220 [ 4421.866800][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4421.867111][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4421.867411][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4421.867740][ C0] ? __copy_skb_header+0xaf/0x490 [ 4421.868006][ C0] ? __skb_clone+0x57a/0x760 [ 4421.868249][ C0] netif_receive_skb+0x55/0x280 [ 4421.868509][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4421.868838][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4421.869188][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4421.869501][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4421.869793][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4421.870094][ C0] ? hlock_class+0x4e/0x130 [ 4421.870343][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4421.870672][ C0] ? place_entity+0x21/0x2f0 [ 4421.870920][ C0] ? resched_curr+0x219/0x280 [ 4421.871167][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4421.871431][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4421.871714][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4421.871993][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4421.872256][ C0] ? activate_task+0xf5/0x260 [ 4421.872511][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4421.872786][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4421.873058][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4421.873317][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4421.873607][ C0] ? get_stack_info+0x36/0xc0 [ 4421.873854][ C0] ? stack_access_ok+0xda/0x1f0 [ 4421.874110][ C0] ? get_reg+0x119/0x190 [ 4421.874336][ C0] __tcf_classify+0x32c/0x7d0 [ 4421.874588][ C0] tcf_classify+0x283/0x930 [ 4421.874834][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4421.875165][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4421.875433][ C0] ? arch_stack_walk+0x8c/0x100 [ 4421.875697][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4421.875990][ C0] tc_run+0x2e4/0x5d0 [ 4421.876209][ C0] ? __pfx_tc_run+0x10/0x10 [ 4421.876451][ C0] ? lock_acquire+0x1c1/0x220 [ 4421.876699][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4421.876971][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4421.877239][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4421.877522][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4421.877797][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4421.878115][ C0] ? neigh_hh_output+0x348/0x590 [ 4421.878379][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4421.878653][ C0] ip_finish_output2+0x786/0x18e0 [ 4421.878919][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4421.879213][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4421.879565][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4421.879854][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4421.880117][ C0] ? __ip_finish_output+0x10f/0x770 [ 4421.880396][ C0] ip_output+0x16b/0x4f0 [ 4421.880625][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4421.880904][ C0] ? __pfx_ip_output+0x10/0x10 [ 4421.881159][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4421.881456][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4421.881723][ C0] ? ip_local_out+0x114/0x3b0 [ 4421.881973][ C0] __ip_queue_xmit+0x672/0x1910 [ 4421.882238][ C0] ? __skb_clone+0x57a/0x760 [ 4421.882486][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4421.882769][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4421.883066][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4421.883387][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4421.883644][ C0] ? tcp_current_mss+0x40a/0x510 [ 4421.883909][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4421.884187][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4421.884470][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4421.884734][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4421.885003][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4421.885326][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4421.885603][ C0] ? ktime_get+0xb6/0x190 [ 4421.885834][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4421.886107][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4421.886390][ C0] tcp_write_timer+0x82/0x1d0 [ 4421.886642][ C0] call_timer_fn+0x176/0x430 [ 4421.886891][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4421.887167][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4421.887440][ C0] __run_timers.part.0+0x52d/0x890 [ 4421.887715][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4421.887997][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4421.888300][ C0] ? lock_acquire+0x1c1/0x220 [ 4421.888550][ C0] ? clockevents_program_event+0xf6/0x300 [ 4421.888854][ C0] ? lock_release+0x1d5/0x250 [ 4421.889102][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4421.889376][ C0] ? ktime_get+0xb6/0x190 [ 4421.889606][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4421.889903][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4421.890219][ C0] run_timer_softirq+0x72/0x100 [ 4421.890479][ C0] __do_softirq+0x1bc/0x7ff [ 4421.890723][ C0] irq_exit_rcu+0x98/0xc0 [ 4421.890954][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4421.891255][ C0] [ 4421.891413][ C0] [ 4421.891572][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4421.891891][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4421.892165][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4421.893178][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4421.893499][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4421.893914][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4421.894330][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4421.894752][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4421.895174][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4421.895599][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4421.895902][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4421.896179][ C0] default_idle_call+0x69/0xa0 [ 4421.896431][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4421.896694][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4421.896984][ C0] ? lock_release+0x1d5/0x250 [ 4421.897239][ C0] do_idle+0xfb/0x160 [ 4421.897458][ C0] cpu_startup_entry+0x55/0x60 [ 4421.897714][ C0] rest_init+0x153/0x260 [ 4421.897938][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4421.898229][ C0] arch_call_rest_init+0x13/0x40 [ 4421.898498][ C0] start_kernel+0x314/0x3d0 [ 4421.898740][ C0] x86_64_start_reservations+0x18/0x30 [ 4421.899031][ C0] x86_64_start_kernel+0xba/0x110 [ 4421.899301][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4421.899630][ C0] [ 4421.899795][ C0] Sending NMI from CPU 0 to CPUs 1: [ 4421.900082][ C1] NMI backtrace for cpu 1 [ 4421.900091][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4421.900096][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4421.900099][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4421.900108][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4421.900111][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4421.900115][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4421.900117][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4421.900119][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4421.900120][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4421.900122][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4421.900124][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4421.900126][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4421.900130][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4421.900131][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4421.900133][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4421.900134][ C1] Call Trace: [ 4421.900137][ C1] [ 4421.900141][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 4421.900147][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4421.900152][ C1] ? nmi_handle+0x156/0x420 [ 4421.900157][ C1] ? default_do_nmi+0x41/0x100 [ 4421.900161][ C1] ? exc_nmi+0xf3/0x120 [ 4421.900163][ C1] ? end_repeat_nmi+0xf/0x60 [ 4421.900168][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4421.900172][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4421.900176][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4421.900179][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4421.900183][ C1] [ 4421.900183][ C1] [ 4421.900184][ C1] ? run_ksoftirqd+0xb/0x60 [ 4421.900190][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4421.900193][ C1] ? __orc_find+0x9c/0xf0 [ 4421.900197][ C1] ? lock_acquire+0x1c1/0x220 [ 4421.900201][ C1] ? irqentry_enter+0x2b/0x60 [ 4421.900206][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4421.900211][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4421.900214][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4421.900217][ C1] ? lock_acquire+0x1c1/0x220 [ 4421.900219][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4421.900224][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4421.900228][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4421.900236][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4421.900238][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4421.900245][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4421.900252][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4421.900257][ C1] ip_local_deliver+0x19d/0x480 [ 4421.900260][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4421.900262][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4421.900267][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4421.900271][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4421.900274][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4421.900278][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4421.900288][ C1] ip_rcv+0x564/0x740 [ 4421.900291][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4421.900294][ C1] ? set_track_prepare+0x8a/0xd0 [ 4421.900299][ C1] ? irqentry_enter+0x2b/0x60 [ 4421.900302][ C1] ? irqentry_enter+0x2b/0x60 [ 4421.900306][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4421.900308][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4421.900313][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4421.900316][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4421.900319][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4421.900322][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4421.900325][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4421.900329][ C1] netif_receive_skb+0x55/0x280 [ 4421.900333][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4421.900342][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4421.900349][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4421.900356][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4421.900363][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4421.900375][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4421.900385][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4421.900388][ C1] ? arch_stack_walk+0x68/0x100 [ 4421.900393][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4421.900397][ C1] ? irqentry_enter+0x2b/0x60 [ 4421.900400][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4421.900405][ C1] ? irqentry_enter+0x2b/0x60 [ 4421.900408][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4421.900415][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4421.900417][ C1] ? arch_stack_walk+0x68/0x100 [ 4421.900422][ C1] __tcf_classify+0x32c/0x7d0 [ 4421.900427][ C1] tcf_classify+0x283/0x930 [ 4421.900431][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4421.900435][ C1] tc_run+0x2e4/0x5d0 [ 4421.900440][ C1] ? __pfx_tc_run+0x10/0x10 [ 4421.900445][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4421.900451][ C1] ? irqentry_enter+0x2b/0x60 [ 4421.900454][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4421.900457][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4421.900464][ C1] ip_finish_output2+0x786/0x18e0 [ 4421.900470][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4421.900472][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4421.900476][ C1] ? __ip_finish_output+0x10f/0x770 [ 4421.900480][ C1] ip_output+0x16b/0x4f0 [ 4421.900483][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4421.900486][ C1] ? __pfx_ip_output+0x10/0x10 [ 4421.900491][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4421.900498][ C1] ? __pfx_ip_output+0x10/0x10 [ 4421.900502][ C1] __ip_queue_xmit+0x672/0x1910 [ 4421.900508][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4421.900515][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4421.900519][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4421.900522][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4421.900526][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4421.900529][ C1] tcp_delack_timer+0x84/0x240 [ 4421.900533][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4421.900536][ C1] call_timer_fn+0x176/0x430 [ 4421.900540][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4421.900545][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4421.900549][ C1] __run_timers.part.0+0x52d/0x890 [ 4421.900552][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4421.900557][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4421.900562][ C1] ? __pfx___schedule+0x10/0x10 [ 4421.900565][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4421.900570][ C1] run_timer_softirq+0x72/0x100 [ 4421.900574][ C1] __do_softirq+0x1bc/0x7ff [ 4421.900578][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4421.900581][ C1] run_ksoftirqd+0x2e/0x60 [ 4421.900585][ C1] smpboot_thread_fn+0x30e/0x840 [ 4421.900589][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4421.900593][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4421.900595][ C1] kthread+0x292/0x360 [ 4421.900598][ C1] ? __pfx_kthread+0x10/0x10 [ 4421.900601][ C1] ret_from_fork+0x34/0x70 [ 4421.900603][ C1] ? __pfx_kthread+0x10/0x10 [ 4421.900605][ C1] ret_from_fork_asm+0x1b/0x30 [ 4421.900613][ C1] [ 4448.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3037s! [swapper/0:0] [ 4448.527930][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4448.529130][ C0] irq event stamp: 27567077 [ 4448.529373][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4448.529907][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4448.530379][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4448.530882][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4448.531378][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4448.531856][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4448.532503][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4448.532846][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4448.533873][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4448.534201][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4448.534629][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4448.535047][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4448.535466][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4448.535888][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4448.536304][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4448.536771][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4448.537123][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4448.537541][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4448.537960][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4448.538385][ C0] Call Trace: [ 4448.538571][ C0] [ 4448.538728][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4448.539005][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4448.539262][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4448.539551][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4448.539841][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4448.540148][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4448.540430][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4448.540752][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4448.541026][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4448.541306][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4448.541629][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4448.541941][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4448.542274][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4448.542579][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4448.542888][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4448.543196][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4448.543526][ C0] ? get_stack_info+0x36/0xc0 [ 4448.543779][ C0] ? lock_acquire+0x1c1/0x220 [ 4448.544032][ C0] ? lock_release+0x1d5/0x250 [ 4448.544284][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4448.544549][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4448.544837][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4448.545136][ C0] ? lock_acquire+0x1c1/0x220 [ 4448.545388][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4448.545638][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4448.545910][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4448.546160][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4448.546423][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4448.546693][ C0] ? __inet_lookup_established+0x341/0x610 [ 4448.547007][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4448.547296][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4448.547585][ C0] ip_local_deliver+0x19d/0x480 [ 4448.547846][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4448.548132][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4448.548400][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4448.548676][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4448.548949][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4448.549290][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4448.549563][ C0] ip_rcv+0x564/0x740 [ 4448.549777][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4448.550017][ C0] ? set_track_prepare+0x8a/0xd0 [ 4448.550282][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4448.550575][ C0] ? rest_init+0x153/0x260 [ 4448.550813][ C0] ? skb_clone+0x10b/0x330 [ 4448.551057][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4448.551390][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4448.551719][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4448.552019][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4448.552329][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4448.552596][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4448.552841][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4448.553159][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4448.553459][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4448.553798][ C0] ? lock_acquire+0x1c1/0x220 [ 4448.554048][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4448.554356][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4448.554661][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4448.554995][ C0] ? __copy_skb_header+0xaf/0x490 [ 4448.555268][ C0] ? __skb_clone+0x57a/0x760 [ 4448.555518][ C0] netif_receive_skb+0x55/0x280 [ 4448.555776][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4448.556104][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4448.556452][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4448.556771][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4448.557058][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4448.557356][ C0] ? hlock_class+0x4e/0x130 [ 4448.557601][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4448.557927][ C0] ? place_entity+0x21/0x2f0 [ 4448.558173][ C0] ? resched_curr+0x219/0x280 [ 4448.558427][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4448.558697][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4448.558982][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4448.559259][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4448.559514][ C0] ? activate_task+0xf5/0x260 [ 4448.559761][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4448.560034][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4448.560310][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4448.560570][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4448.560858][ C0] ? get_stack_info+0x36/0xc0 [ 4448.561112][ C0] ? stack_access_ok+0xda/0x1f0 [ 4448.561373][ C0] ? get_reg+0x119/0x190 [ 4448.561604][ C0] __tcf_classify+0x32c/0x7d0 [ 4448.561856][ C0] tcf_classify+0x283/0x930 [ 4448.562099][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4448.562426][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4448.562697][ C0] ? arch_stack_walk+0x8c/0x100 [ 4448.562960][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4448.563252][ C0] tc_run+0x2e4/0x5d0 [ 4448.563469][ C0] ? __pfx_tc_run+0x10/0x10 [ 4448.563709][ C0] ? lock_acquire+0x1c1/0x220 [ 4448.563956][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4448.564230][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4448.564497][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4448.564786][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4448.565067][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4448.565392][ C0] ? neigh_hh_output+0x348/0x590 [ 4448.565656][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4448.565937][ C0] ip_finish_output2+0x786/0x18e0 [ 4448.566208][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4448.566502][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4448.566853][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4448.567143][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4448.567409][ C0] ? __ip_finish_output+0x10f/0x770 [ 4448.567685][ C0] ip_output+0x16b/0x4f0 [ 4448.567912][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4448.568201][ C0] ? __pfx_ip_output+0x10/0x10 [ 4448.568461][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4448.568763][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4448.569025][ C0] ? ip_local_out+0x114/0x3b0 [ 4448.569280][ C0] __ip_queue_xmit+0x672/0x1910 [ 4448.569545][ C0] ? __skb_clone+0x57a/0x760 [ 4448.569800][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4448.570078][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4448.570371][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4448.570686][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4448.570942][ C0] ? tcp_current_mss+0x40a/0x510 [ 4448.571205][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4448.571487][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4448.571761][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4448.572012][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4448.572283][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4448.572605][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4448.572879][ C0] ? ktime_get+0xb6/0x190 [ 4448.573111][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4448.573383][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4448.573666][ C0] tcp_write_timer+0x82/0x1d0 [ 4448.573916][ C0] call_timer_fn+0x176/0x430 [ 4448.574165][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4448.574441][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4448.574720][ C0] __run_timers.part.0+0x52d/0x890 [ 4448.574996][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4448.575281][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4448.575578][ C0] ? lock_acquire+0x1c1/0x220 [ 4448.575832][ C0] ? clockevents_program_event+0xf6/0x300 [ 4448.576143][ C0] ? lock_release+0x1d5/0x250 [ 4448.576394][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4448.576675][ C0] ? ktime_get+0xb6/0x190 [ 4448.576907][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4448.577213][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4448.577523][ C0] run_timer_softirq+0x72/0x100 [ 4448.577786][ C0] __do_softirq+0x1bc/0x7ff [ 4448.578034][ C0] irq_exit_rcu+0x98/0xc0 [ 4448.578269][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4448.578569][ C0] [ 4448.578724][ C0] [ 4448.578880][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4448.579198][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4448.579469][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4448.580495][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4448.580818][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4448.581241][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4448.581664][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4448.582084][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4448.582503][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4448.582926][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4448.583234][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4448.583510][ C0] default_idle_call+0x69/0xa0 [ 4448.583764][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4448.584029][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4448.584319][ C0] ? lock_release+0x1d5/0x250 [ 4448.584582][ C0] do_idle+0xfb/0x160 [ 4448.584794][ C0] cpu_startup_entry+0x55/0x60 [ 4448.585051][ C0] rest_init+0x153/0x260 [ 4448.585282][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4448.585568][ C0] arch_call_rest_init+0x13/0x40 [ 4448.585832][ C0] start_kernel+0x314/0x3d0 [ 4448.586080][ C0] x86_64_start_reservations+0x18/0x30 [ 4448.586374][ C0] x86_64_start_kernel+0xba/0x110 [ 4448.586641][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4448.586968][ C0] [ 4448.587135][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3037s! [ksoftirqd/1:22] [ 4448.587606][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4448.588811][ C1] irq event stamp: 3886976 [ 4448.589051][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4448.589549][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4448.590042][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4448.590539][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4448.591034][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4448.591530][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4448.592173][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4448.592516][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4448.593535][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4448.593859][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4448.594281][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4448.594706][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4448.595129][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4448.595554][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4448.595980][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4448.596455][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4448.596804][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4448.597233][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4448.597652][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4448.598072][ C1] Call Trace: [ 4448.598249][ C1] [ 4448.598404][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4448.598686][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4448.598941][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4448.599235][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4448.599519][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4448.599820][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4448.600099][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4448.600418][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4448.600696][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4448.601017][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4448.601326][ C1] [ 4448.601486][ C1] [ 4448.601645][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4448.601978][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4448.602283][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4448.602593][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4448.602899][ C1] ? run_ksoftirqd+0xb/0x60 [ 4448.603148][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4448.603477][ C1] ? __orc_find+0x9c/0xf0 [ 4448.603707][ C1] ? lock_acquire+0x1c1/0x220 [ 4448.603956][ C1] ? irqentry_enter+0x2b/0x60 [ 4448.604206][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4448.604466][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4448.604759][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4448.605063][ C1] ? lock_acquire+0x1c1/0x220 [ 4448.605314][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4448.605567][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4448.605841][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4448.606092][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4448.606356][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4448.606632][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4448.606924][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4448.607218][ C1] ip_local_deliver+0x19d/0x480 [ 4448.607475][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4448.607758][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4448.608024][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4448.608306][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4448.608574][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4448.608910][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4448.609188][ C1] ip_rcv+0x564/0x740 [ 4448.609408][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4448.609657][ C1] ? set_track_prepare+0x8a/0xd0 [ 4448.609927][ C1] ? irqentry_enter+0x2b/0x60 [ 4448.610179][ C1] ? irqentry_enter+0x2b/0x60 [ 4448.610432][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4448.610676][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4448.610989][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4448.611329][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4448.611638][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4448.611982][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4448.612284][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4448.612614][ C1] netif_receive_skb+0x55/0x280 [ 4448.612873][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4448.613200][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4448.613547][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4448.613865][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4448.614155][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4448.614457][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4448.614792][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4448.615077][ C1] ? arch_stack_walk+0x68/0x100 [ 4448.615338][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4448.615615][ C1] ? irqentry_enter+0x2b/0x60 [ 4448.615866][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4448.616186][ C1] ? irqentry_enter+0x2b/0x60 [ 4448.616441][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4448.616766][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4448.617047][ C1] ? arch_stack_walk+0x68/0x100 [ 4448.617309][ C1] __tcf_classify+0x32c/0x7d0 [ 4448.617563][ C1] tcf_classify+0x283/0x930 [ 4448.617808][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4448.618081][ C1] tc_run+0x2e4/0x5d0 [ 4448.618303][ C1] ? __pfx_tc_run+0x10/0x10 [ 4448.618550][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4448.618821][ C1] ? irqentry_enter+0x2b/0x60 [ 4448.619074][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4448.619360][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4448.619681][ C1] ip_finish_output2+0x786/0x18e0 [ 4448.619956][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4448.620252][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4448.620516][ C1] ? __ip_finish_output+0x10f/0x770 [ 4448.620796][ C1] ip_output+0x16b/0x4f0 [ 4448.621028][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4448.621347][ C1] ? __pfx_ip_output+0x10/0x10 [ 4448.621607][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4448.621958][ C1] ? __pfx_ip_output+0x10/0x10 [ 4448.622212][ C1] __ip_queue_xmit+0x672/0x1910 [ 4448.622479][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4448.622762][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4448.623060][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4448.623348][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4448.623647][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4448.623937][ C1] tcp_delack_timer+0x84/0x240 [ 4448.624196][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4448.624481][ C1] call_timer_fn+0x176/0x430 [ 4448.624737][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4448.625011][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4448.625292][ C1] __run_timers.part.0+0x52d/0x890 [ 4448.625567][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4448.625853][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4448.626154][ C1] ? __pfx___schedule+0x10/0x10 [ 4448.626415][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4448.626738][ C1] run_timer_softirq+0x72/0x100 [ 4448.626997][ C1] __do_softirq+0x1bc/0x7ff [ 4448.627240][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4448.627513][ C1] run_ksoftirqd+0x2e/0x60 [ 4448.627754][ C1] smpboot_thread_fn+0x30e/0x840 [ 4448.628017][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4448.628312][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4448.628603][ C1] kthread+0x292/0x360 [ 4448.628822][ C1] ? __pfx_kthread+0x10/0x10 [ 4448.629067][ C1] ret_from_fork+0x34/0x70 [ 4448.629307][ C1] ? __pfx_kthread+0x10/0x10 [ 4448.629552][ C1] ret_from_fork_asm+0x1b/0x30 [ 4448.629815][ C1] [ 4476.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3063s! [swapper/0:0] [ 4476.527926][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4476.529130][ C0] irq event stamp: 27567077 [ 4476.529374][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4476.529909][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4476.530382][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4476.530886][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4476.531382][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4476.531861][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4476.532512][ C0] RIP: 0010:kasan_check_range+0x161/0x1c0 [ 4476.532822][ C0] Code: 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 48 83 c0 01 48 39 d0 74 a5 <80> 38 00 74 f2 e9 74 ff ff ff b8 01 00 00 00 c3 cc cc cc cc 48 29 [ 4476.533855][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000286 [ 4476.534182][ C0] RAX: ffffed100141336b RBX: ffffed100141336c RCX: ffffffff90c7aaa0 [ 4476.534609][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4476.535027][ C0] RBP: ffffed100141336b R08: 0000000000000000 R09: ffffed100141336b [ 4476.535446][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4476.535864][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4476.536283][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4476.536755][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4476.537108][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4476.537530][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4476.537959][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4476.538387][ C0] Call Trace: [ 4476.538569][ C0] [ 4476.538727][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4476.539003][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4476.539264][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4476.539556][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4476.539845][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4476.540151][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4476.540433][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4476.540760][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4476.541032][ C0] ? hrtimer_interrupt+0x31a/0x770 [ 4476.541308][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4476.541582][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4476.541909][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4476.542225][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4476.542553][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4476.542860][ C0] ? kasan_check_range+0x161/0x1c0 [ 4476.543136][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 4476.543432][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4476.543758][ C0] ? get_stack_info+0x36/0xc0 [ 4476.544017][ C0] ? lock_acquire+0x1c1/0x220 [ 4476.544274][ C0] ? lock_release+0x1d5/0x250 [ 4476.544533][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4476.544794][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4476.545081][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4476.545378][ C0] ? lock_acquire+0x1c1/0x220 [ 4476.545633][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4476.545889][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4476.546167][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4476.546413][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4476.546672][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4476.546941][ C0] ? __inet_lookup_established+0x341/0x610 [ 4476.547254][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4476.547554][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4476.547848][ C0] ip_local_deliver+0x19d/0x480 [ 4476.548108][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4476.548391][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4476.548656][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4476.548937][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4476.549205][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4476.549543][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4476.549821][ C0] ip_rcv+0x564/0x740 [ 4476.550040][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4476.550287][ C0] ? set_track_prepare+0x8a/0xd0 [ 4476.550557][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4476.550846][ C0] ? rest_init+0x153/0x260 [ 4476.551086][ C0] ? skb_clone+0x10b/0x330 [ 4476.551325][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4476.551663][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4476.551989][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4476.552286][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4476.552593][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4476.552852][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4476.553093][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4476.553406][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4476.553703][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4476.554049][ C0] ? lock_acquire+0x1c1/0x220 [ 4476.554304][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4476.554622][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4476.554924][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4476.555256][ C0] ? __copy_skb_header+0xaf/0x490 [ 4476.555523][ C0] ? __skb_clone+0x57a/0x760 [ 4476.555769][ C0] netif_receive_skb+0x55/0x280 [ 4476.556035][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4476.556367][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4476.556720][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4476.557032][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4476.557323][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4476.557624][ C0] ? hlock_class+0x4e/0x130 [ 4476.557872][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4476.558207][ C0] ? place_entity+0x21/0x2f0 [ 4476.558457][ C0] ? resched_curr+0x219/0x280 [ 4476.558709][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4476.558976][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4476.559257][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4476.559537][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4476.559798][ C0] ? activate_task+0xf5/0x260 [ 4476.560051][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4476.560331][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4476.560604][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4476.560871][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4476.561165][ C0] ? get_stack_info+0x36/0xc0 [ 4476.561416][ C0] ? stack_access_ok+0xda/0x1f0 [ 4476.561677][ C0] ? get_reg+0x119/0x190 [ 4476.561909][ C0] __tcf_classify+0x32c/0x7d0 [ 4476.562165][ C0] tcf_classify+0x283/0x930 [ 4476.562410][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4476.562740][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4476.563005][ C0] ? arch_stack_walk+0x8c/0x100 [ 4476.563267][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4476.563555][ C0] tc_run+0x2e4/0x5d0 [ 4476.563773][ C0] ? __pfx_tc_run+0x10/0x10 [ 4476.564020][ C0] ? lock_acquire+0x1c1/0x220 [ 4476.564274][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4476.564557][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4476.564825][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4476.565109][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4476.565384][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4476.565703][ C0] ? neigh_hh_output+0x348/0x590 [ 4476.565972][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4476.566252][ C0] ip_finish_output2+0x786/0x18e0 [ 4476.566522][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4476.566811][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4476.567170][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4476.567463][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4476.567726][ C0] ? __ip_finish_output+0x10f/0x770 [ 4476.568004][ C0] ip_output+0x16b/0x4f0 [ 4476.568236][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4476.568518][ C0] ? __pfx_ip_output+0x10/0x10 [ 4476.568777][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4476.569081][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4476.569345][ C0] ? ip_local_out+0x114/0x3b0 [ 4476.569593][ C0] __ip_queue_xmit+0x672/0x1910 [ 4476.569852][ C0] ? __skb_clone+0x57a/0x760 [ 4476.570098][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4476.570383][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4476.570680][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4476.571000][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4476.571255][ C0] ? tcp_current_mss+0x40a/0x510 [ 4476.571520][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4476.571800][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4476.572080][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4476.572335][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4476.572601][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4476.572918][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4476.573199][ C0] ? ktime_get+0xb6/0x190 [ 4476.573433][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4476.573708][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4476.573988][ C0] tcp_write_timer+0x82/0x1d0 [ 4476.574244][ C0] call_timer_fn+0x176/0x430 [ 4476.574496][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4476.574777][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4476.575052][ C0] __run_timers.part.0+0x52d/0x890 [ 4476.575329][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4476.575609][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4476.575909][ C0] ? lock_acquire+0x1c1/0x220 [ 4476.576157][ C0] ? clockevents_program_event+0xf6/0x300 [ 4476.576460][ C0] ? lock_release+0x1d5/0x250 [ 4476.576710][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4476.576986][ C0] ? ktime_get+0xb6/0x190 [ 4476.577217][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4476.577519][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4476.577831][ C0] run_timer_softirq+0x72/0x100 [ 4476.578087][ C0] __do_softirq+0x1bc/0x7ff [ 4476.578329][ C0] irq_exit_rcu+0x98/0xc0 [ 4476.578559][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4476.578857][ C0] [ 4476.579018][ C0] [ 4476.579179][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4476.579503][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4476.579770][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4476.580785][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4476.581104][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4476.581520][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4476.581937][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4476.582355][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4476.582771][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4476.583189][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4476.583490][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4476.583763][ C0] default_idle_call+0x69/0xa0 [ 4476.584025][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4476.584287][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4476.584586][ C0] ? lock_release+0x1d5/0x250 [ 4476.584842][ C0] do_idle+0xfb/0x160 [ 4476.585061][ C0] cpu_startup_entry+0x55/0x60 [ 4476.585317][ C0] rest_init+0x153/0x260 [ 4476.585543][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4476.585834][ C0] arch_call_rest_init+0x13/0x40 [ 4476.586102][ C0] start_kernel+0x314/0x3d0 [ 4476.586343][ C0] x86_64_start_reservations+0x18/0x30 [ 4476.586633][ C0] x86_64_start_kernel+0xba/0x110 [ 4476.586906][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4476.587237][ C0] [ 4476.587406][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3063s! [ksoftirqd/1:22] [ 4476.587875][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4476.589083][ C1] irq event stamp: 3886976 [ 4476.589324][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4476.589823][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4476.590318][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4476.590815][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4476.591316][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4476.591809][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4476.592457][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4476.592799][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4476.593819][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4476.594145][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4476.594574][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4476.594999][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4476.595430][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4476.595860][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4476.596287][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4476.596765][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4476.597117][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4476.597544][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4476.597965][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4476.598387][ C1] Call Trace: [ 4476.598566][ C1] [ 4476.598722][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4476.599005][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4476.599260][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4476.599554][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4476.599840][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4476.600144][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4476.600425][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4476.600748][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4476.601028][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4476.601356][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4476.601667][ C1] [ 4476.601827][ C1] [ 4476.601987][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4476.602325][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4476.602629][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4476.602939][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4476.603245][ C1] ? run_ksoftirqd+0xb/0x60 [ 4476.603492][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4476.603825][ C1] ? __orc_find+0x9c/0xf0 [ 4476.604057][ C1] ? lock_acquire+0x1c1/0x220 [ 4476.604313][ C1] ? irqentry_enter+0x2b/0x60 [ 4476.604570][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4476.604837][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4476.605129][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4476.605432][ C1] ? lock_acquire+0x1c1/0x220 [ 4476.605681][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4476.605934][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4476.606209][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4476.606460][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4476.606727][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4476.607001][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4476.607295][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4476.607589][ C1] ip_local_deliver+0x19d/0x480 [ 4476.607848][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4476.608135][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4476.608403][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4476.608686][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4476.608954][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4476.609293][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4476.609574][ C1] ip_rcv+0x564/0x740 [ 4476.609791][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4476.610040][ C1] ? set_track_prepare+0x8a/0xd0 [ 4476.610311][ C1] ? irqentry_enter+0x2b/0x60 [ 4476.610563][ C1] ? irqentry_enter+0x2b/0x60 [ 4476.610814][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4476.611058][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4476.611372][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4476.611712][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4476.612022][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4476.612367][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4476.612669][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4476.613004][ C1] netif_receive_skb+0x55/0x280 [ 4476.613266][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4476.613596][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4476.613946][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4476.614265][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4476.614559][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4476.614867][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4476.615201][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4476.615485][ C1] ? arch_stack_walk+0x68/0x100 [ 4476.615745][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4476.616021][ C1] ? irqentry_enter+0x2b/0x60 [ 4476.616272][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4476.616596][ C1] ? irqentry_enter+0x2b/0x60 [ 4476.616853][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4476.617179][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4476.617459][ C1] ? arch_stack_walk+0x68/0x100 [ 4476.617722][ C1] __tcf_classify+0x32c/0x7d0 [ 4476.617980][ C1] tcf_classify+0x283/0x930 [ 4476.618228][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4476.618503][ C1] tc_run+0x2e4/0x5d0 [ 4476.618721][ C1] ? __pfx_tc_run+0x10/0x10 [ 4476.618971][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4476.619242][ C1] ? irqentry_enter+0x2b/0x60 [ 4476.619493][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4476.619778][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4476.620107][ C1] ip_finish_output2+0x786/0x18e0 [ 4476.620381][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4476.620674][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4476.620940][ C1] ? __ip_finish_output+0x10f/0x770 [ 4476.621223][ C1] ip_output+0x16b/0x4f0 [ 4476.621456][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4476.621778][ C1] ? __pfx_ip_output+0x10/0x10 [ 4476.622040][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4476.622393][ C1] ? __pfx_ip_output+0x10/0x10 [ 4476.622650][ C1] __ip_queue_xmit+0x672/0x1910 [ 4476.622919][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4476.623206][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4476.623508][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4476.623799][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4476.624099][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4476.624389][ C1] tcp_delack_timer+0x84/0x240 [ 4476.624652][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4476.624941][ C1] call_timer_fn+0x176/0x430 [ 4476.625196][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4476.625473][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4476.625756][ C1] __run_timers.part.0+0x52d/0x890 [ 4476.626033][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4476.626324][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4476.626626][ C1] ? __pfx___schedule+0x10/0x10 [ 4476.626893][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4476.627220][ C1] run_timer_softirq+0x72/0x100 [ 4476.627482][ C1] __do_softirq+0x1bc/0x7ff [ 4476.627724][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4476.628002][ C1] run_ksoftirqd+0x2e/0x60 [ 4476.628244][ C1] smpboot_thread_fn+0x30e/0x840 [ 4476.628512][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4476.628809][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4476.629102][ C1] kthread+0x292/0x360 [ 4476.629321][ C1] ? __pfx_kthread+0x10/0x10 [ 4476.629566][ C1] ret_from_fork+0x34/0x70 [ 4476.629807][ C1] ? __pfx_kthread+0x10/0x10 [ 4476.630057][ C1] ret_from_fork_asm+0x1b/0x30 [ 4476.630322][ C1] [ 4499.904025][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4499.904422][ C0] rcu: 0-....: (3301671 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=788834 [ 4499.904939][ C0] rcu: (t=3305595 jiffies g=1007429 q=31 ncpus=4) [ 4499.905292][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4499.905770][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4499.906420][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4499.906768][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4499.907796][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4499.908126][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4499.908548][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4499.908971][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4499.909397][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4499.909818][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4499.910241][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4499.910714][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4499.911062][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4499.911485][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4499.911903][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4499.912321][ C0] Call Trace: [ 4499.912502][ C0] [ 4499.912658][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4499.912949][ C0] ? print_cpu_stall+0x263/0x6a0 [ 4499.913213][ C0] ? check_cpu_stall+0x284/0x500 [ 4499.913478][ C0] ? rcu_pending+0x92/0x360 [ 4499.913718][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4499.913999][ C0] ? update_process_times+0xb9/0x110 [ 4499.914286][ C0] ? tick_sched_handle+0x67/0x130 [ 4499.914563][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4499.914866][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4499.915121][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4499.915451][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4499.915737][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4499.916039][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4499.916318][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4499.916638][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4499.916916][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4499.917192][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4499.917519][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4499.917834][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4499.918166][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4499.918472][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4499.918788][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4499.919090][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4499.919416][ C0] ? get_stack_info+0x36/0xc0 [ 4499.919671][ C0] ? lock_acquire+0x1c1/0x220 [ 4499.919925][ C0] ? lock_release+0x1d5/0x250 [ 4499.920179][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4499.920441][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4499.920728][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4499.921030][ C0] ? lock_acquire+0x1c1/0x220 [ 4499.921281][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4499.921535][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4499.921807][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4499.922057][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4499.922317][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4499.922591][ C0] ? __inet_lookup_established+0x341/0x610 [ 4499.922907][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4499.923197][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4499.923485][ C0] ip_local_deliver+0x19d/0x480 [ 4499.923746][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4499.924035][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4499.924316][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4499.924596][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4499.924864][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4499.925201][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4499.925480][ C0] ip_rcv+0x564/0x740 [ 4499.925700][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4499.925946][ C0] ? set_track_prepare+0x8a/0xd0 [ 4499.926221][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4499.926511][ C0] ? rest_init+0x153/0x260 [ 4499.926751][ C0] ? skb_clone+0x10b/0x330 [ 4499.926993][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4499.927333][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4499.927661][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4499.927957][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4499.928265][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4499.928524][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4499.928766][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4499.929079][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4499.929378][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4499.929725][ C0] ? lock_acquire+0x1c1/0x220 [ 4499.929978][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4499.930290][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4499.930586][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4499.930924][ C0] ? __copy_skb_header+0xaf/0x490 [ 4499.931197][ C0] ? __skb_clone+0x57a/0x760 [ 4499.931445][ C0] netif_receive_skb+0x55/0x280 [ 4499.931704][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4499.932033][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4499.932383][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4499.932701][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4499.932990][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4499.933291][ C0] ? hlock_class+0x4e/0x130 [ 4499.933537][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4499.933864][ C0] ? place_entity+0x21/0x2f0 [ 4499.934109][ C0] ? resched_curr+0x219/0x280 [ 4499.934370][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4499.934637][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4499.934919][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4499.935201][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4499.935462][ C0] ? activate_task+0xf5/0x260 [ 4499.935717][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4499.935997][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4499.936270][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4499.936533][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4499.936826][ C0] ? get_stack_info+0x36/0xc0 [ 4499.937076][ C0] ? stack_access_ok+0xda/0x1f0 [ 4499.937332][ C0] ? get_reg+0x119/0x190 [ 4499.937558][ C0] __tcf_classify+0x32c/0x7d0 [ 4499.937812][ C0] tcf_classify+0x283/0x930 [ 4499.938059][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4499.938391][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4499.938657][ C0] ? arch_stack_walk+0x8c/0x100 [ 4499.938915][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4499.939204][ C0] tc_run+0x2e4/0x5d0 [ 4499.939430][ C0] ? __pfx_tc_run+0x10/0x10 [ 4499.939675][ C0] ? lock_acquire+0x1c1/0x220 [ 4499.939928][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4499.940206][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4499.940471][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4499.940760][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4499.941045][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4499.941370][ C0] ? neigh_hh_output+0x348/0x590 [ 4499.941634][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4499.941915][ C0] ip_finish_output2+0x786/0x18e0 [ 4499.942190][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4499.942487][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4499.942844][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4499.943132][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4499.943399][ C0] ? __ip_finish_output+0x10f/0x770 [ 4499.943676][ C0] ip_output+0x16b/0x4f0 [ 4499.943906][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4499.944192][ C0] ? __pfx_ip_output+0x10/0x10 [ 4499.944456][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4499.944755][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4499.945022][ C0] ? ip_local_out+0x114/0x3b0 [ 4499.945274][ C0] __ip_queue_xmit+0x672/0x1910 [ 4499.945535][ C0] ? __skb_clone+0x57a/0x760 [ 4499.945783][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4499.946068][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4499.946369][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4499.946688][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4499.946943][ C0] ? tcp_current_mss+0x40a/0x510 [ 4499.947212][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4499.947495][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4499.947775][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4499.948033][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4499.948301][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4499.948621][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4499.948901][ C0] ? ktime_get+0xb6/0x190 [ 4499.949137][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4499.949415][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4499.949697][ C0] tcp_write_timer+0x82/0x1d0 [ 4499.949954][ C0] call_timer_fn+0x176/0x430 [ 4499.950206][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4499.950481][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4499.950758][ C0] __run_timers.part.0+0x52d/0x890 [ 4499.951031][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4499.951317][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4499.951615][ C0] ? lock_acquire+0x1c1/0x220 [ 4499.951870][ C0] ? clockevents_program_event+0xf6/0x300 [ 4499.952177][ C0] ? lock_release+0x1d5/0x250 [ 4499.952429][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4499.952709][ C0] ? ktime_get+0xb6/0x190 [ 4499.952942][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4499.953245][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4499.953556][ C0] run_timer_softirq+0x72/0x100 [ 4499.953821][ C0] __do_softirq+0x1bc/0x7ff [ 4499.954070][ C0] irq_exit_rcu+0x98/0xc0 [ 4499.954311][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4499.954610][ C0] [ 4499.954771][ C0] [ 4499.954932][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4499.955255][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4499.955522][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4499.956539][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4499.956859][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4499.957278][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4499.957697][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4499.958116][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4499.958538][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4499.958958][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4499.959261][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4499.959533][ C0] default_idle_call+0x69/0xa0 [ 4499.959790][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4499.960053][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4499.960353][ C0] ? lock_release+0x1d5/0x250 [ 4499.960602][ C0] do_idle+0xfb/0x160 [ 4499.960815][ C0] cpu_startup_entry+0x55/0x60 [ 4499.961071][ C0] rest_init+0x153/0x260 [ 4499.961297][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4499.961583][ C0] arch_call_rest_init+0x13/0x40 [ 4499.961848][ C0] start_kernel+0x314/0x3d0 [ 4499.962096][ C0] x86_64_start_reservations+0x18/0x30 [ 4499.962392][ C0] x86_64_start_kernel+0xba/0x110 [ 4499.962660][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4499.962986][ C0] [ 4499.963152][ C0] Sending NMI from CPU 0 to CPUs 1: [ 4499.963444][ C1] NMI backtrace for cpu 1 [ 4499.963453][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4499.963459][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4499.963462][ C1] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 4499.963474][ C1] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 4499.963477][ C1] RSP: 0018:ffffc9000019e9d8 EFLAGS: 00000202 [ 4499.963481][ C1] RAX: ffff88800a098e18 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4499.963483][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4499.963485][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4499.963487][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4499.963489][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4499.963491][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4499.963493][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4499.963496][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4499.963498][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4499.963499][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4499.963501][ C1] Call Trace: [ 4499.963504][ C1] [ 4499.963508][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 4499.963514][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4499.963519][ C1] ? nmi_handle+0x156/0x420 [ 4499.963525][ C1] ? default_do_nmi+0x41/0x100 [ 4499.963529][ C1] ? exc_nmi+0xf3/0x120 [ 4499.963532][ C1] ? end_repeat_nmi+0xf/0x60 [ 4499.963536][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4499.963543][ C1] ? kasan_check_range+0x12/0x1c0 [ 4499.963546][ C1] ? kasan_check_range+0x12/0x1c0 [ 4499.963550][ C1] ? kasan_check_range+0x12/0x1c0 [ 4499.963553][ C1] [ 4499.963555][ C1] [ 4499.963556][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 4499.963559][ C1] ? run_ksoftirqd+0xb/0x60 [ 4499.963565][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4499.963568][ C1] ? __orc_find+0x9c/0xf0 [ 4499.963572][ C1] ? lock_acquire+0x1c1/0x220 [ 4499.963576][ C1] ? irqentry_enter+0x2b/0x60 [ 4499.963581][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4499.963586][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4499.963588][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4499.963592][ C1] ? lock_acquire+0x1c1/0x220 [ 4499.963595][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4499.963600][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4499.963604][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4499.963612][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4499.963615][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4499.963621][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4499.963628][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4499.963632][ C1] ip_local_deliver+0x19d/0x480 [ 4499.963635][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4499.963637][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4499.963643][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4499.963647][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4499.963650][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4499.963653][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4499.963664][ C1] ip_rcv+0x564/0x740 [ 4499.963667][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4499.963670][ C1] ? set_track_prepare+0x8a/0xd0 [ 4499.963675][ C1] ? irqentry_enter+0x2b/0x60 [ 4499.963678][ C1] ? irqentry_enter+0x2b/0x60 [ 4499.963682][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4499.963685][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4499.963689][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4499.963693][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4499.963696][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4499.963699][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4499.963703][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4499.963707][ C1] netif_receive_skb+0x55/0x280 [ 4499.963711][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4499.963720][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4499.963727][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4499.963735][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4499.963741][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4499.963754][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4499.963764][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4499.963767][ C1] ? arch_stack_walk+0x68/0x100 [ 4499.963772][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4499.963775][ C1] ? irqentry_enter+0x2b/0x60 [ 4499.963779][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4499.963784][ C1] ? irqentry_enter+0x2b/0x60 [ 4499.963788][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4499.963795][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4499.963798][ C1] ? arch_stack_walk+0x68/0x100 [ 4499.963803][ C1] __tcf_classify+0x32c/0x7d0 [ 4499.963808][ C1] tcf_classify+0x283/0x930 [ 4499.963812][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4499.963817][ C1] tc_run+0x2e4/0x5d0 [ 4499.963822][ C1] ? __pfx_tc_run+0x10/0x10 [ 4499.963827][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4499.963832][ C1] ? irqentry_enter+0x2b/0x60 [ 4499.963836][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4499.963839][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4499.963846][ C1] ip_finish_output2+0x786/0x18e0 [ 4499.963851][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4499.963854][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4499.963858][ C1] ? __ip_finish_output+0x10f/0x770 [ 4499.963862][ C1] ip_output+0x16b/0x4f0 [ 4499.963865][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4499.963868][ C1] ? __pfx_ip_output+0x10/0x10 [ 4499.963873][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4499.963880][ C1] ? __pfx_ip_output+0x10/0x10 [ 4499.963885][ C1] __ip_queue_xmit+0x672/0x1910 [ 4499.963890][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4499.963898][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4499.963902][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4499.963906][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4499.963910][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4499.963914][ C1] tcp_delack_timer+0x84/0x240 [ 4499.963918][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4499.963920][ C1] call_timer_fn+0x176/0x430 [ 4499.963926][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4499.963931][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4499.963935][ C1] __run_timers.part.0+0x52d/0x890 [ 4499.963938][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4499.963943][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4499.963948][ C1] ? __pfx___schedule+0x10/0x10 [ 4499.963952][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4499.963957][ C1] run_timer_softirq+0x72/0x100 [ 4499.963960][ C1] __do_softirq+0x1bc/0x7ff [ 4499.963964][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4499.963968][ C1] run_ksoftirqd+0x2e/0x60 [ 4499.963972][ C1] smpboot_thread_fn+0x30e/0x840 [ 4499.963976][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4499.963980][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4499.963983][ C1] kthread+0x292/0x360 [ 4499.963986][ C1] ? __pfx_kthread+0x10/0x10 [ 4499.963989][ C1] ret_from_fork+0x34/0x70 [ 4499.963992][ C1] ? __pfx_kthread+0x10/0x10 [ 4499.963994][ C1] ret_from_fork_asm+0x1b/0x30 [ 4499.964002][ C1] [ 4524.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3107s! [swapper/0:0] [ 4524.527914][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4524.529113][ C0] irq event stamp: 27567077 [ 4524.529351][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4524.529881][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4524.530365][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4524.530869][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4524.531367][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4524.531852][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4524.532495][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4524.532835][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4524.533860][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4524.534189][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4524.534619][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4524.535040][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4524.535460][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4524.535883][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4524.536308][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4524.536779][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4524.537128][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4524.537557][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4524.537976][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4524.538396][ C0] Call Trace: [ 4524.538572][ C0] [ 4524.538726][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4524.539004][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4524.539259][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4524.539551][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4524.539834][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4524.540135][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4524.540412][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4524.540729][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4524.541005][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4524.541281][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4524.541610][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4524.541923][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4524.542252][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4524.542559][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4524.542869][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4524.543171][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4524.543495][ C0] ? get_stack_info+0x36/0xc0 [ 4524.543754][ C0] ? lock_acquire+0x1c1/0x220 [ 4524.544009][ C0] ? lock_release+0x1d5/0x250 [ 4524.544270][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4524.544529][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4524.544813][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4524.545111][ C0] ? lock_acquire+0x1c1/0x220 [ 4524.545363][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4524.545618][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4524.545893][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4524.546137][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4524.546394][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4524.546662][ C0] ? __inet_lookup_established+0x341/0x610 [ 4524.546976][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4524.547269][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4524.547563][ C0] ip_local_deliver+0x19d/0x480 [ 4524.547822][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4524.548106][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4524.548370][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4524.548655][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4524.548918][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4524.549252][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4524.549531][ C0] ip_rcv+0x564/0x740 [ 4524.549744][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4524.549987][ C0] ? set_track_prepare+0x8a/0xd0 [ 4524.550253][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4524.550538][ C0] ? rest_init+0x153/0x260 [ 4524.550778][ C0] ? skb_clone+0x10b/0x330 [ 4524.551017][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4524.551355][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4524.551675][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4524.551970][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4524.552278][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4524.552535][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4524.552773][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4524.553089][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4524.553386][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4524.553729][ C0] ? lock_acquire+0x1c1/0x220 [ 4524.553980][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4524.554299][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4524.554601][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4524.554933][ C0] ? __copy_skb_header+0xaf/0x490 [ 4524.555200][ C0] ? __skb_clone+0x57a/0x760 [ 4524.555442][ C0] netif_receive_skb+0x55/0x280 [ 4524.555701][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4524.556031][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4524.556382][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4524.556692][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4524.556981][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4524.557284][ C0] ? hlock_class+0x4e/0x130 [ 4524.557531][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4524.557866][ C0] ? place_entity+0x21/0x2f0 [ 4524.558117][ C0] ? resched_curr+0x219/0x280 [ 4524.558368][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4524.558635][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4524.558915][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4524.559197][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4524.559458][ C0] ? activate_task+0xf5/0x260 [ 4524.559711][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4524.559989][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4524.560261][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4524.560523][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4524.560817][ C0] ? get_stack_info+0x36/0xc0 [ 4524.561069][ C0] ? stack_access_ok+0xda/0x1f0 [ 4524.561326][ C0] ? get_reg+0x119/0x190 [ 4524.561551][ C0] __tcf_classify+0x32c/0x7d0 [ 4524.561807][ C0] tcf_classify+0x283/0x930 [ 4524.562052][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4524.562385][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4524.562650][ C0] ? arch_stack_walk+0x8c/0x100 [ 4524.562912][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4524.563202][ C0] tc_run+0x2e4/0x5d0 [ 4524.563417][ C0] ? __pfx_tc_run+0x10/0x10 [ 4524.563662][ C0] ? lock_acquire+0x1c1/0x220 [ 4524.563913][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4524.564195][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4524.564465][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4524.564749][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4524.565025][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4524.565343][ C0] ? neigh_hh_output+0x348/0x590 [ 4524.565609][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4524.565884][ C0] ip_finish_output2+0x786/0x18e0 [ 4524.566152][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4524.566443][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4524.566798][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4524.567091][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4524.567358][ C0] ? __ip_finish_output+0x10f/0x770 [ 4524.567638][ C0] ip_output+0x16b/0x4f0 [ 4524.567864][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4524.568144][ C0] ? __pfx_ip_output+0x10/0x10 [ 4524.568400][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4524.568698][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4524.568967][ C0] ? ip_local_out+0x114/0x3b0 [ 4524.569216][ C0] __ip_queue_xmit+0x672/0x1910 [ 4524.569473][ C0] ? __skb_clone+0x57a/0x760 [ 4524.569717][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4524.570004][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4524.570301][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4524.570622][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4524.570878][ C0] ? tcp_current_mss+0x40a/0x510 [ 4524.571143][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4524.571421][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4524.571699][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4524.571954][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4524.572220][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4524.572536][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4524.572815][ C0] ? ktime_get+0xb6/0x190 [ 4524.573050][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4524.573324][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4524.573602][ C0] tcp_write_timer+0x82/0x1d0 [ 4524.573855][ C0] call_timer_fn+0x176/0x430 [ 4524.574104][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4524.574384][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4524.574656][ C0] __run_timers.part.0+0x52d/0x890 [ 4524.574931][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4524.575216][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4524.575518][ C0] ? lock_acquire+0x1c1/0x220 [ 4524.575764][ C0] ? clockevents_program_event+0xf6/0x300 [ 4524.576069][ C0] ? lock_release+0x1d5/0x250 [ 4524.576319][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4524.576593][ C0] ? ktime_get+0xb6/0x190 [ 4524.576822][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4524.577118][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4524.577431][ C0] run_timer_softirq+0x72/0x100 [ 4524.577689][ C0] __do_softirq+0x1bc/0x7ff [ 4524.577931][ C0] irq_exit_rcu+0x98/0xc0 [ 4524.578160][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4524.578458][ C0] [ 4524.578616][ C0] [ 4524.578774][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4524.579097][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4524.579364][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4524.580380][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4524.580703][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4524.581123][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4524.581541][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4524.581961][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4524.582380][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4524.582801][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4524.583104][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4524.583375][ C0] default_idle_call+0x69/0xa0 [ 4524.583630][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4524.583893][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4524.584200][ C0] ? lock_release+0x1d5/0x250 [ 4524.584456][ C0] do_idle+0xfb/0x160 [ 4524.584671][ C0] cpu_startup_entry+0x55/0x60 [ 4524.584927][ C0] rest_init+0x153/0x260 [ 4524.585153][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4524.585445][ C0] arch_call_rest_init+0x13/0x40 [ 4524.585713][ C0] start_kernel+0x314/0x3d0 [ 4524.585953][ C0] x86_64_start_reservations+0x18/0x30 [ 4524.586250][ C0] x86_64_start_kernel+0xba/0x110 [ 4524.586520][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4524.586849][ C0] [ 4524.587016][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3107s! [ksoftirqd/1:22] [ 4524.587495][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4524.588688][ C1] irq event stamp: 3886976 [ 4524.588924][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4524.589430][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4524.589929][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4524.590433][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4524.590925][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4524.591426][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4524.592080][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 4524.592421][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 4524.593443][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4524.593767][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4524.594196][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4524.594618][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4524.595043][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4524.595469][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4524.595897][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4524.596372][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4524.596722][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4524.597152][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4524.597574][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4524.597993][ C1] Call Trace: [ 4524.598172][ C1] [ 4524.598328][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4524.598608][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4524.598865][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4524.599160][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4524.599444][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4524.599747][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4524.600025][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4524.600346][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4524.600625][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4524.600948][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4524.601260][ C1] [ 4524.601420][ C1] [ 4524.601579][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4524.601912][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4524.602217][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 4524.602521][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4524.602823][ C1] ? run_ksoftirqd+0xb/0x60 [ 4524.603070][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4524.603397][ C1] ? __orc_find+0x9c/0xf0 [ 4524.603633][ C1] ? lock_acquire+0x1c1/0x220 [ 4524.603890][ C1] ? irqentry_enter+0x2b/0x60 [ 4524.604147][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4524.604416][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4524.604704][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4524.605005][ C1] ? lock_acquire+0x1c1/0x220 [ 4524.605259][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4524.605515][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4524.605792][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4524.606038][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4524.606296][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4524.606568][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4524.606856][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4524.607149][ C1] ip_local_deliver+0x19d/0x480 [ 4524.607413][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4524.607702][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4524.607973][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4524.608253][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4524.608520][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4524.608861][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4524.609139][ C1] ip_rcv+0x564/0x740 [ 4524.609355][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4524.609599][ C1] ? set_track_prepare+0x8a/0xd0 [ 4524.609865][ C1] ? irqentry_enter+0x2b/0x60 [ 4524.610120][ C1] ? irqentry_enter+0x2b/0x60 [ 4524.610375][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4524.610621][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4524.610938][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4524.611286][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4524.611599][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4524.611939][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4524.612238][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4524.612575][ C1] netif_receive_skb+0x55/0x280 [ 4524.612841][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4524.613173][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4524.613526][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4524.613838][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4524.614132][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4524.614442][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4524.614770][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4524.615054][ C1] ? arch_stack_walk+0x68/0x100 [ 4524.615318][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4524.615599][ C1] ? irqentry_enter+0x2b/0x60 [ 4524.615853][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4524.616180][ C1] ? irqentry_enter+0x2b/0x60 [ 4524.616432][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4524.616753][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4524.617039][ C1] ? arch_stack_walk+0x68/0x100 [ 4524.617300][ C1] __tcf_classify+0x32c/0x7d0 [ 4524.617551][ C1] tcf_classify+0x283/0x930 [ 4524.617793][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4524.618063][ C1] tc_run+0x2e4/0x5d0 [ 4524.618280][ C1] ? __pfx_tc_run+0x10/0x10 [ 4524.618526][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4524.618793][ C1] ? irqentry_enter+0x2b/0x60 [ 4524.619049][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4524.619337][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4524.619665][ C1] ip_finish_output2+0x786/0x18e0 [ 4524.619935][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4524.620225][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4524.620494][ C1] ? __ip_finish_output+0x10f/0x770 [ 4524.620779][ C1] ip_output+0x16b/0x4f0 [ 4524.621005][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4524.621331][ C1] ? __pfx_ip_output+0x10/0x10 [ 4524.621588][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4524.621943][ C1] ? __pfx_ip_output+0x10/0x10 [ 4524.622202][ C1] __ip_queue_xmit+0x672/0x1910 [ 4524.622463][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4524.622743][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4524.623039][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4524.623326][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4524.623623][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4524.623909][ C1] tcp_delack_timer+0x84/0x240 [ 4524.624170][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4524.624458][ C1] call_timer_fn+0x176/0x430 [ 4524.624709][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4524.624986][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4524.625264][ C1] __run_timers.part.0+0x52d/0x890 [ 4524.625538][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4524.625831][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4524.626137][ C1] ? __pfx___schedule+0x10/0x10 [ 4524.626395][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4524.626713][ C1] run_timer_softirq+0x72/0x100 [ 4524.626976][ C1] __do_softirq+0x1bc/0x7ff [ 4524.627224][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4524.627502][ C1] run_ksoftirqd+0x2e/0x60 [ 4524.627740][ C1] smpboot_thread_fn+0x30e/0x840 [ 4524.628009][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4524.628303][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4524.628597][ C1] kthread+0x292/0x360 [ 4524.628814][ C1] ? __pfx_kthread+0x10/0x10 [ 4524.629064][ C1] ret_from_fork+0x34/0x70 [ 4524.629303][ C1] ? __pfx_kthread+0x10/0x10 [ 4524.629554][ C1] ret_from_fork_asm+0x1b/0x30 [ 4524.629817][ C1] [ 4552.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3133s! [swapper/0:0] [ 4552.527924][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4552.529128][ C0] irq event stamp: 27567077 [ 4552.529367][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4552.529901][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4552.530383][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4552.530894][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4552.531394][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4552.531879][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4552.532521][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4552.532860][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4552.533873][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4552.534200][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4552.534626][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4552.535052][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4552.535476][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4552.535901][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4552.536328][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4552.536800][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4552.537150][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4552.537579][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4552.538000][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4552.538420][ C0] Call Trace: [ 4552.538597][ C0] [ 4552.538752][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4552.539030][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4552.539284][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4552.539576][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4552.539859][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4552.540159][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4552.540436][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4552.540754][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4552.541032][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4552.541309][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4552.541638][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4552.541953][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4552.542284][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4552.542591][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4552.542902][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4552.543204][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4552.543530][ C0] ? get_stack_info+0x36/0xc0 [ 4552.543787][ C0] ? lock_acquire+0x1c1/0x220 [ 4552.544046][ C0] ? lock_release+0x1d5/0x250 [ 4552.544294][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4552.544553][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4552.544838][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4552.545135][ C0] ? lock_acquire+0x1c1/0x220 [ 4552.545386][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4552.545642][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4552.545916][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4552.546160][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4552.546417][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4552.546686][ C0] ? __inet_lookup_established+0x341/0x610 [ 4552.547002][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4552.547296][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4552.547590][ C0] ip_local_deliver+0x19d/0x480 [ 4552.547848][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4552.548134][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4552.548397][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4552.548677][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4552.548941][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4552.549273][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4552.549552][ C0] ip_rcv+0x564/0x740 [ 4552.549764][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4552.550009][ C0] ? set_track_prepare+0x8a/0xd0 [ 4552.550275][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4552.550561][ C0] ? rest_init+0x153/0x260 [ 4552.550801][ C0] ? skb_clone+0x10b/0x330 [ 4552.551040][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4552.551378][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4552.551703][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4552.551998][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4552.552306][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4552.552561][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4552.552799][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4552.553119][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4552.553417][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4552.553760][ C0] ? lock_acquire+0x1c1/0x220 [ 4552.554010][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4552.554327][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4552.554629][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4552.554959][ C0] ? __copy_skb_header+0xaf/0x490 [ 4552.555228][ C0] ? __skb_clone+0x57a/0x760 [ 4552.555471][ C0] netif_receive_skb+0x55/0x280 [ 4552.555731][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4552.556060][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4552.556413][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4552.556724][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4552.557014][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4552.557315][ C0] ? hlock_class+0x4e/0x130 [ 4552.557562][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4552.557897][ C0] ? place_entity+0x21/0x2f0 [ 4552.558148][ C0] ? resched_curr+0x219/0x280 [ 4552.558399][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4552.558666][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4552.558946][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4552.559229][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4552.559495][ C0] ? activate_task+0xf5/0x260 [ 4552.559749][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4552.560028][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4552.560300][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4552.560562][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4552.560855][ C0] ? get_stack_info+0x36/0xc0 [ 4552.561107][ C0] ? stack_access_ok+0xda/0x1f0 [ 4552.561365][ C0] ? get_reg+0x119/0x190 [ 4552.561591][ C0] __tcf_classify+0x32c/0x7d0 [ 4552.561847][ C0] tcf_classify+0x283/0x930 [ 4552.562093][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4552.562425][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4552.562690][ C0] ? arch_stack_walk+0x8c/0x100 [ 4552.562951][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4552.563240][ C0] tc_run+0x2e4/0x5d0 [ 4552.563455][ C0] ? __pfx_tc_run+0x10/0x10 [ 4552.563700][ C0] ? lock_acquire+0x1c1/0x220 [ 4552.563952][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4552.564235][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4552.564505][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4552.564790][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4552.565069][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4552.565387][ C0] ? neigh_hh_output+0x348/0x590 [ 4552.565655][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4552.565931][ C0] ip_finish_output2+0x786/0x18e0 [ 4552.566199][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4552.566492][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4552.566848][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4552.567143][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4552.567407][ C0] ? __ip_finish_output+0x10f/0x770 [ 4552.567688][ C0] ip_output+0x16b/0x4f0 [ 4552.567915][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4552.568194][ C0] ? __pfx_ip_output+0x10/0x10 [ 4552.568450][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4552.568750][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4552.569016][ C0] ? ip_local_out+0x114/0x3b0 [ 4552.569266][ C0] __ip_queue_xmit+0x672/0x1910 [ 4552.569524][ C0] ? __skb_clone+0x57a/0x760 [ 4552.569768][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4552.570054][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4552.570351][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4552.570674][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4552.570932][ C0] ? tcp_current_mss+0x40a/0x510 [ 4552.571197][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4552.571476][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4552.571755][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4552.572012][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4552.572280][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4552.572596][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4552.572882][ C0] ? ktime_get+0xb6/0x190 [ 4552.573117][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4552.573393][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4552.573671][ C0] tcp_write_timer+0x82/0x1d0 [ 4552.573924][ C0] call_timer_fn+0x176/0x430 [ 4552.574179][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4552.574456][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4552.574729][ C0] __run_timers.part.0+0x52d/0x890 [ 4552.575003][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4552.575287][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4552.575589][ C0] ? lock_acquire+0x1c1/0x220 [ 4552.575836][ C0] ? clockevents_program_event+0xf6/0x300 [ 4552.576142][ C0] ? lock_release+0x1d5/0x250 [ 4552.576392][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4552.576671][ C0] ? ktime_get+0xb6/0x190 [ 4552.576900][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4552.577198][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4552.577511][ C0] run_timer_softirq+0x72/0x100 [ 4552.577770][ C0] __do_softirq+0x1bc/0x7ff [ 4552.578012][ C0] irq_exit_rcu+0x98/0xc0 [ 4552.578241][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4552.578543][ C0] [ 4552.578702][ C0] [ 4552.578860][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4552.579184][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4552.579450][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4552.580463][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4552.580790][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4552.581209][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4552.581627][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4552.582047][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4552.582465][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4552.582883][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4552.583190][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4552.583461][ C0] default_idle_call+0x69/0xa0 [ 4552.583715][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4552.583977][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4552.584277][ C0] ? lock_release+0x1d5/0x250 [ 4552.584532][ C0] do_idle+0xfb/0x160 [ 4552.584746][ C0] cpu_startup_entry+0x55/0x60 [ 4552.585001][ C0] rest_init+0x153/0x260 [ 4552.585227][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4552.585519][ C0] arch_call_rest_init+0x13/0x40 [ 4552.585787][ C0] start_kernel+0x314/0x3d0 [ 4552.586032][ C0] x86_64_start_reservations+0x18/0x30 [ 4552.586323][ C0] x86_64_start_kernel+0xba/0x110 [ 4552.586593][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4552.586921][ C0] [ 4552.587090][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3133s! [ksoftirqd/1:22] [ 4552.587565][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4552.588772][ C1] irq event stamp: 3886976 [ 4552.589012][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4552.589511][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4552.590005][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4552.590505][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4552.591002][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4552.591493][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4552.592139][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 4552.592477][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 4552.593512][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4552.593838][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4552.594273][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4552.594692][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4552.595112][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4552.595530][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4552.595951][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4552.596422][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4552.596775][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4552.597201][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4552.597628][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4552.598052][ C1] Call Trace: [ 4552.598234][ C1] [ 4552.598396][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4552.598673][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4552.598933][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4552.599226][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4552.599516][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4552.599822][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4552.600107][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4552.600434][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4552.600710][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4552.601039][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4552.601355][ C1] [ 4552.601517][ C1] [ 4552.601674][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4552.602006][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4552.602316][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 4552.602623][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4552.602933][ C1] ? run_ksoftirqd+0xb/0x60 [ 4552.603183][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4552.603512][ C1] ? __orc_find+0x9c/0xf0 [ 4552.603743][ C1] ? lock_acquire+0x1c1/0x220 [ 4552.603997][ C1] ? irqentry_enter+0x2b/0x60 [ 4552.604253][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4552.604517][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4552.604809][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4552.605114][ C1] ? lock_acquire+0x1c1/0x220 [ 4552.605365][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4552.605619][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4552.605891][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4552.606143][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4552.606405][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4552.606681][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4552.606978][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4552.607272][ C1] ip_local_deliver+0x19d/0x480 [ 4552.607529][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4552.607812][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4552.608079][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4552.608360][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4552.608628][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4552.608965][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4552.609245][ C1] ip_rcv+0x564/0x740 [ 4552.609465][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4552.609712][ C1] ? set_track_prepare+0x8a/0xd0 [ 4552.609981][ C1] ? irqentry_enter+0x2b/0x60 [ 4552.610235][ C1] ? irqentry_enter+0x2b/0x60 [ 4552.610492][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4552.610735][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4552.611051][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4552.611391][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4552.611700][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4552.612047][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4552.612350][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4552.612682][ C1] netif_receive_skb+0x55/0x280 [ 4552.612942][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4552.613269][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4552.613618][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4552.613936][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4552.614235][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4552.614542][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4552.614876][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4552.615161][ C1] ? arch_stack_walk+0x68/0x100 [ 4552.615423][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4552.615699][ C1] ? irqentry_enter+0x2b/0x60 [ 4552.615952][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4552.616273][ C1] ? irqentry_enter+0x2b/0x60 [ 4552.616528][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4552.616855][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4552.617135][ C1] ? arch_stack_walk+0x68/0x100 [ 4552.617399][ C1] __tcf_classify+0x32c/0x7d0 [ 4552.617656][ C1] tcf_classify+0x283/0x930 [ 4552.617902][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4552.618175][ C1] tc_run+0x2e4/0x5d0 [ 4552.618398][ C1] ? __pfx_tc_run+0x10/0x10 [ 4552.618647][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4552.618918][ C1] ? irqentry_enter+0x2b/0x60 [ 4552.619175][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4552.619462][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4552.619788][ C1] ip_finish_output2+0x786/0x18e0 [ 4552.620064][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4552.620358][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4552.620629][ C1] ? __ip_finish_output+0x10f/0x770 [ 4552.620911][ C1] ip_output+0x16b/0x4f0 [ 4552.621143][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4552.621462][ C1] ? __pfx_ip_output+0x10/0x10 [ 4552.621724][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4552.622079][ C1] ? __pfx_ip_output+0x10/0x10 [ 4552.622334][ C1] __ip_queue_xmit+0x672/0x1910 [ 4552.622599][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4552.622884][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4552.623184][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4552.623476][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4552.623778][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4552.624077][ C1] tcp_delack_timer+0x84/0x240 [ 4552.624336][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4552.624628][ C1] call_timer_fn+0x176/0x430 [ 4552.624881][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4552.625157][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4552.625439][ C1] __run_timers.part.0+0x52d/0x890 [ 4552.625716][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4552.626005][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4552.626308][ C1] ? __pfx___schedule+0x10/0x10 [ 4552.626574][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4552.626899][ C1] run_timer_softirq+0x72/0x100 [ 4552.627161][ C1] __do_softirq+0x1bc/0x7ff [ 4552.627404][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4552.627681][ C1] run_ksoftirqd+0x2e/0x60 [ 4552.627924][ C1] smpboot_thread_fn+0x30e/0x840 [ 4552.628190][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4552.628488][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4552.628781][ C1] kthread+0x292/0x360 [ 4552.629002][ C1] ? __pfx_kthread+0x10/0x10 [ 4552.629248][ C1] ret_from_fork+0x34/0x70 [ 4552.629491][ C1] ? __pfx_kthread+0x10/0x10 [ 4552.629738][ C1] ret_from_fork_asm+0x1b/0x30 [ 4552.630003][ C1] [ 4577.967024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4577.967414][ C0] rcu: 0-....: (3379558 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=807620 [ 4577.967935][ C0] rcu: (t=3383658 jiffies g=1007429 q=31 ncpus=4) [ 4577.968281][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4577.968766][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4577.969409][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4577.969755][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4577.970771][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4577.971097][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4577.971516][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4577.971934][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4577.972355][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4577.972773][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4577.973194][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4577.973662][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4577.974019][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4577.974441][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4577.974857][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4577.975274][ C0] Call Trace: [ 4577.975454][ C0] [ 4577.975608][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4577.975897][ C0] ? print_cpu_stall+0x263/0x6a0 [ 4577.976161][ C0] ? check_cpu_stall+0x284/0x500 [ 4577.976427][ C0] ? rcu_pending+0x92/0x360 [ 4577.976667][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4577.976951][ C0] ? update_process_times+0xb9/0x110 [ 4577.977237][ C0] ? tick_sched_handle+0x67/0x130 [ 4577.977507][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4577.977804][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4577.978061][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4577.978387][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4577.978681][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4577.978991][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4577.979274][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4577.979598][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4577.979872][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4577.980151][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4577.980472][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4577.980781][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4577.981113][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4577.981415][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4577.981723][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4577.982029][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4577.982359][ C0] ? get_stack_info+0x36/0xc0 [ 4577.982612][ C0] ? lock_acquire+0x1c1/0x220 [ 4577.982864][ C0] ? lock_release+0x1d5/0x250 [ 4577.983114][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4577.983373][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4577.983655][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4577.983955][ C0] ? lock_acquire+0x1c1/0x220 [ 4577.984202][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4577.984452][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4577.984723][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4577.984972][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4577.985235][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4577.985506][ C0] ? __inet_lookup_established+0x341/0x610 [ 4577.985821][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4577.986111][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4577.986400][ C0] ip_local_deliver+0x19d/0x480 [ 4577.986664][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4577.986951][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4577.987220][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4577.987496][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4577.987759][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4577.988098][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4577.988371][ C0] ip_rcv+0x564/0x740 [ 4577.988584][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4577.988824][ C0] ? set_track_prepare+0x8a/0xd0 [ 4577.989089][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4577.989380][ C0] ? rest_init+0x153/0x260 [ 4577.989617][ C0] ? skb_clone+0x10b/0x330 [ 4577.989860][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4577.990193][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4577.990514][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4577.990812][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4577.991122][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4577.991386][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4577.991631][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4577.991948][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4577.992246][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4577.992582][ C0] ? lock_acquire+0x1c1/0x220 [ 4577.992831][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4577.993139][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4577.993436][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4577.993762][ C0] ? __copy_skb_header+0xaf/0x490 [ 4577.994035][ C0] ? __skb_clone+0x57a/0x760 [ 4577.994284][ C0] netif_receive_skb+0x55/0x280 [ 4577.994541][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4577.994874][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4577.995220][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4577.995534][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4577.995819][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4577.996117][ C0] ? hlock_class+0x4e/0x130 [ 4577.996360][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4577.996686][ C0] ? place_entity+0x21/0x2f0 [ 4577.996930][ C0] ? resched_curr+0x219/0x280 [ 4577.997184][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4577.997453][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4577.997737][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4577.998012][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4577.998267][ C0] ? activate_task+0xf5/0x260 [ 4577.998513][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4577.998791][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4577.999065][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4577.999324][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4577.999618][ C0] ? get_stack_info+0x36/0xc0 [ 4577.999870][ C0] ? stack_access_ok+0xda/0x1f0 [ 4578.000133][ C0] ? get_reg+0x119/0x190 [ 4578.000366][ C0] __tcf_classify+0x32c/0x7d0 [ 4578.000617][ C0] tcf_classify+0x283/0x930 [ 4578.000859][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4578.001186][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4578.001456][ C0] ? arch_stack_walk+0x8c/0x100 [ 4578.001717][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4578.002007][ C0] tc_run+0x2e4/0x5d0 [ 4578.002222][ C0] ? __pfx_tc_run+0x10/0x10 [ 4578.002461][ C0] ? lock_acquire+0x1c1/0x220 [ 4578.002711][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4578.002983][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4578.003251][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4578.003531][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4578.003806][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4578.004134][ C0] ? neigh_hh_output+0x348/0x590 [ 4578.004397][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4578.004677][ C0] ip_finish_output2+0x786/0x18e0 [ 4578.004947][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4578.005241][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4578.005590][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4578.005878][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4578.006146][ C0] ? __ip_finish_output+0x10f/0x770 [ 4578.006419][ C0] ip_output+0x16b/0x4f0 [ 4578.006646][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4578.006930][ C0] ? __pfx_ip_output+0x10/0x10 [ 4578.007185][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4578.007486][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4578.007748][ C0] ? ip_local_out+0x114/0x3b0 [ 4578.008007][ C0] __ip_queue_xmit+0x672/0x1910 [ 4578.008274][ C0] ? __skb_clone+0x57a/0x760 [ 4578.008525][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4578.008808][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4578.009102][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4578.009419][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4578.009678][ C0] ? tcp_current_mss+0x40a/0x510 [ 4578.009940][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4578.010228][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4578.010502][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4578.010754][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4578.011026][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4578.011349][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4578.011624][ C0] ? ktime_get+0xb6/0x190 [ 4578.011854][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4578.012127][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4578.012411][ C0] tcp_write_timer+0x82/0x1d0 [ 4578.012663][ C0] call_timer_fn+0x176/0x430 [ 4578.012909][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4578.013188][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4578.013461][ C0] __run_timers.part.0+0x52d/0x890 [ 4578.013736][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4578.014021][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4578.014318][ C0] ? lock_acquire+0x1c1/0x220 [ 4578.014571][ C0] ? clockevents_program_event+0xf6/0x300 [ 4578.014879][ C0] ? lock_release+0x1d5/0x250 [ 4578.015132][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4578.015412][ C0] ? ktime_get+0xb6/0x190 [ 4578.015644][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4578.015946][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4578.016255][ C0] run_timer_softirq+0x72/0x100 [ 4578.016517][ C0] __do_softirq+0x1bc/0x7ff [ 4578.016765][ C0] irq_exit_rcu+0x98/0xc0 [ 4578.017000][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4578.017301][ C0] [ 4578.017456][ C0] [ 4578.017612][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4578.017929][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4578.018200][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4578.019225][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4578.019549][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4578.019971][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4578.020396][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4578.020815][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4578.021235][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4578.021662][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4578.021968][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4578.022243][ C0] default_idle_call+0x69/0xa0 [ 4578.022497][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4578.022761][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4578.023049][ C0] ? lock_release+0x1d5/0x250 [ 4578.023301][ C0] do_idle+0xfb/0x160 [ 4578.023516][ C0] cpu_startup_entry+0x55/0x60 [ 4578.023775][ C0] rest_init+0x153/0x260 [ 4578.024007][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4578.024299][ C0] arch_call_rest_init+0x13/0x40 [ 4578.024563][ C0] start_kernel+0x314/0x3d0 [ 4578.024809][ C0] x86_64_start_reservations+0x18/0x30 [ 4578.025107][ C0] x86_64_start_kernel+0xba/0x110 [ 4578.025375][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4578.025702][ C0] [ 4578.025868][ C0] Sending NMI from CPU 0 to CPUs 1: [ 4578.026158][ C1] NMI backtrace for cpu 1 [ 4578.026166][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4578.026171][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4578.026175][ C1] RIP: 0010:kasan_check_range+0x161/0x1c0 [ 4578.026184][ C1] Code: 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 48 83 c0 01 48 39 d0 74 a5 <80> 38 00 74 f2 e9 74 ff ff ff b8 01 00 00 00 c3 cc cc cc cc 48 29 [ 4578.026187][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000282 [ 4578.026191][ C1] RAX: ffffed10014131c3 RBX: ffffed10014131c4 RCX: ffffffff90c7aaa0 [ 4578.026194][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4578.026196][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: ffffed10014131c3 [ 4578.026197][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4578.026200][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4578.026201][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4578.026203][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4578.026207][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4578.026209][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4578.026210][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4578.026212][ C1] Call Trace: [ 4578.026215][ C1] [ 4578.026219][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 4578.026226][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4578.026231][ C1] ? nmi_handle+0x156/0x420 [ 4578.026237][ C1] ? default_do_nmi+0x41/0x100 [ 4578.026242][ C1] ? exc_nmi+0xf3/0x120 [ 4578.026244][ C1] ? end_repeat_nmi+0xf/0x60 [ 4578.026249][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4578.026254][ C1] ? kasan_check_range+0x161/0x1c0 [ 4578.026258][ C1] ? kasan_check_range+0x161/0x1c0 [ 4578.026261][ C1] ? kasan_check_range+0x161/0x1c0 [ 4578.026264][ C1] [ 4578.026265][ C1] [ 4578.026267][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 4578.026271][ C1] ? run_ksoftirqd+0xb/0x60 [ 4578.026276][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4578.026279][ C1] ? __orc_find+0x9c/0xf0 [ 4578.026282][ C1] ? lock_acquire+0x1c1/0x220 [ 4578.026287][ C1] ? irqentry_enter+0x2b/0x60 [ 4578.026292][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4578.026296][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4578.026299][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4578.026303][ C1] ? lock_acquire+0x1c1/0x220 [ 4578.026305][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4578.026310][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4578.026314][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4578.026322][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4578.026325][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4578.026331][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4578.026340][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4578.026344][ C1] ip_local_deliver+0x19d/0x480 [ 4578.026347][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4578.026349][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4578.026354][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4578.026358][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4578.026361][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4578.026365][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4578.026375][ C1] ip_rcv+0x564/0x740 [ 4578.026379][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4578.026382][ C1] ? set_track_prepare+0x8a/0xd0 [ 4578.026386][ C1] ? irqentry_enter+0x2b/0x60 [ 4578.026390][ C1] ? irqentry_enter+0x2b/0x60 [ 4578.026394][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4578.026396][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4578.026400][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4578.026404][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4578.026407][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4578.026410][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4578.026413][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4578.026418][ C1] netif_receive_skb+0x55/0x280 [ 4578.026422][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4578.026431][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4578.026438][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4578.026446][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4578.026453][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4578.026466][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4578.026475][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4578.026478][ C1] ? arch_stack_walk+0x68/0x100 [ 4578.026485][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4578.026488][ C1] ? irqentry_enter+0x2b/0x60 [ 4578.026492][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4578.026496][ C1] ? irqentry_enter+0x2b/0x60 [ 4578.026500][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4578.026508][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4578.026510][ C1] ? arch_stack_walk+0x68/0x100 [ 4578.026514][ C1] __tcf_classify+0x32c/0x7d0 [ 4578.026520][ C1] tcf_classify+0x283/0x930 [ 4578.026524][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4578.026529][ C1] tc_run+0x2e4/0x5d0 [ 4578.026534][ C1] ? __pfx_tc_run+0x10/0x10 [ 4578.026539][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4578.026545][ C1] ? irqentry_enter+0x2b/0x60 [ 4578.026548][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4578.026551][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4578.026558][ C1] ip_finish_output2+0x786/0x18e0 [ 4578.026564][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4578.026567][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4578.026570][ C1] ? __ip_finish_output+0x10f/0x770 [ 4578.026574][ C1] ip_output+0x16b/0x4f0 [ 4578.026577][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4578.026581][ C1] ? __pfx_ip_output+0x10/0x10 [ 4578.026585][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4578.026593][ C1] ? __pfx_ip_output+0x10/0x10 [ 4578.026597][ C1] __ip_queue_xmit+0x672/0x1910 [ 4578.026603][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4578.026610][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4578.026615][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4578.026619][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4578.026623][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4578.026626][ C1] tcp_delack_timer+0x84/0x240 [ 4578.026630][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4578.026633][ C1] call_timer_fn+0x176/0x430 [ 4578.026638][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4578.026643][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4578.026648][ C1] __run_timers.part.0+0x52d/0x890 [ 4578.026651][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4578.026656][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4578.026661][ C1] ? __pfx___schedule+0x10/0x10 [ 4578.026665][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4578.026670][ C1] run_timer_softirq+0x72/0x100 [ 4578.026674][ C1] __do_softirq+0x1bc/0x7ff [ 4578.026678][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4578.026682][ C1] run_ksoftirqd+0x2e/0x60 [ 4578.026686][ C1] smpboot_thread_fn+0x30e/0x840 [ 4578.026690][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4578.026694][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4578.026697][ C1] kthread+0x292/0x360 [ 4578.026700][ C1] ? __pfx_kthread+0x10/0x10 [ 4578.026702][ C1] ret_from_fork+0x34/0x70 [ 4578.026705][ C1] ? __pfx_kthread+0x10/0x10 [ 4578.026707][ C1] ret_from_fork_asm+0x1b/0x30 [ 4578.026715][ C1] [ 4604.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3182s! [swapper/0:0] [ 4604.527919][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4604.529122][ C0] irq event stamp: 27567077 [ 4604.529360][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4604.529885][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4604.530361][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4604.530875][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4604.531375][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4604.531856][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4604.532496][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4604.532835][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4604.533853][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4604.534180][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4604.534600][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4604.535024][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4604.535454][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4604.535874][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4604.536294][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4604.536772][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4604.537119][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4604.537543][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4604.537961][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4604.538380][ C0] Call Trace: [ 4604.538559][ C0] [ 4604.538715][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4604.538994][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4604.539248][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4604.539544][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4604.539829][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4604.540131][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4604.540409][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4604.540728][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4604.541005][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4604.541283][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4604.541609][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4604.541923][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4604.542256][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4604.542566][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4604.542884][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4604.543186][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4604.543511][ C0] ? get_stack_info+0x36/0xc0 [ 4604.543766][ C0] ? lock_acquire+0x1c1/0x220 [ 4604.544029][ C0] ? lock_release+0x1d5/0x250 [ 4604.544280][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4604.544540][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4604.544822][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4604.545120][ C0] ? lock_acquire+0x1c1/0x220 [ 4604.545375][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4604.545632][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4604.545908][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4604.546153][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4604.546411][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4604.546683][ C0] ? __inet_lookup_established+0x341/0x610 [ 4604.546998][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4604.547289][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4604.547581][ C0] ip_local_deliver+0x19d/0x480 [ 4604.547836][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4604.548118][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4604.548383][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4604.548663][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4604.548929][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4604.549265][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4604.549541][ C0] ip_rcv+0x564/0x740 [ 4604.549761][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4604.550007][ C0] ? set_track_prepare+0x8a/0xd0 [ 4604.550279][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4604.550568][ C0] ? rest_init+0x153/0x260 [ 4604.550809][ C0] ? skb_clone+0x10b/0x330 [ 4604.551048][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4604.551389][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4604.551713][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4604.552008][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4604.552315][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4604.552574][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4604.552816][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4604.553128][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4604.553424][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4604.553769][ C0] ? lock_acquire+0x1c1/0x220 [ 4604.554025][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4604.554334][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4604.554633][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4604.554959][ C0] ? __copy_skb_header+0xaf/0x490 [ 4604.555225][ C0] ? __skb_clone+0x57a/0x760 [ 4604.555473][ C0] netif_receive_skb+0x55/0x280 [ 4604.555734][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4604.556067][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4604.556417][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4604.556729][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4604.557022][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4604.557326][ C0] ? hlock_class+0x4e/0x130 [ 4604.557575][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4604.557906][ C0] ? place_entity+0x21/0x2f0 [ 4604.558156][ C0] ? resched_curr+0x219/0x280 [ 4604.558406][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4604.558673][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4604.558954][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4604.559235][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4604.559495][ C0] ? activate_task+0xf5/0x260 [ 4604.559751][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4604.560029][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4604.560302][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4604.560564][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4604.560855][ C0] ? get_stack_info+0x36/0xc0 [ 4604.561104][ C0] ? stack_access_ok+0xda/0x1f0 [ 4604.561359][ C0] ? get_reg+0x119/0x190 [ 4604.561585][ C0] __tcf_classify+0x32c/0x7d0 [ 4604.561839][ C0] tcf_classify+0x283/0x930 [ 4604.562085][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4604.562415][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4604.562679][ C0] ? arch_stack_walk+0x8c/0x100 [ 4604.562937][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4604.563231][ C0] tc_run+0x2e4/0x5d0 [ 4604.563453][ C0] ? __pfx_tc_run+0x10/0x10 [ 4604.563698][ C0] ? lock_acquire+0x1c1/0x220 [ 4604.563953][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4604.564227][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4604.564495][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4604.564777][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4604.565053][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4604.565374][ C0] ? neigh_hh_output+0x348/0x590 [ 4604.565641][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4604.565917][ C0] ip_finish_output2+0x786/0x18e0 [ 4604.566189][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4604.566480][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4604.566839][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4604.567130][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4604.567393][ C0] ? __ip_finish_output+0x10f/0x770 [ 4604.567676][ C0] ip_output+0x16b/0x4f0 [ 4604.567906][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4604.568191][ C0] ? __pfx_ip_output+0x10/0x10 [ 4604.568450][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4604.568749][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4604.569016][ C0] ? ip_local_out+0x114/0x3b0 [ 4604.569267][ C0] __ip_queue_xmit+0x672/0x1910 [ 4604.569529][ C0] ? __skb_clone+0x57a/0x760 [ 4604.569777][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4604.570061][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4604.570363][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4604.570687][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4604.570942][ C0] ? tcp_current_mss+0x40a/0x510 [ 4604.571210][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4604.571493][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4604.571772][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4604.572031][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4604.572298][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4604.572618][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4604.572903][ C0] ? ktime_get+0xb6/0x190 [ 4604.573140][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4604.573417][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4604.573699][ C0] tcp_write_timer+0x82/0x1d0 [ 4604.573956][ C0] call_timer_fn+0x176/0x430 [ 4604.574203][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4604.574480][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4604.574753][ C0] __run_timers.part.0+0x52d/0x890 [ 4604.575027][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4604.575308][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4604.575609][ C0] ? lock_acquire+0x1c1/0x220 [ 4604.575859][ C0] ? clockevents_program_event+0xf6/0x300 [ 4604.576164][ C0] ? lock_release+0x1d5/0x250 [ 4604.576412][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4604.576687][ C0] ? ktime_get+0xb6/0x190 [ 4604.576917][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4604.577216][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4604.577529][ C0] run_timer_softirq+0x72/0x100 [ 4604.577788][ C0] __do_softirq+0x1bc/0x7ff [ 4604.578030][ C0] irq_exit_rcu+0x98/0xc0 [ 4604.578260][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4604.578558][ C0] [ 4604.578719][ C0] [ 4604.578880][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4604.579203][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4604.579470][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4604.580486][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4604.580807][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4604.581226][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4604.581644][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4604.582062][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4604.582480][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4604.582900][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4604.583204][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4604.583477][ C0] default_idle_call+0x69/0xa0 [ 4604.583734][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4604.584009][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4604.584301][ C0] ? lock_release+0x1d5/0x250 [ 4604.584554][ C0] do_idle+0xfb/0x160 [ 4604.584770][ C0] cpu_startup_entry+0x55/0x60 [ 4604.585030][ C0] rest_init+0x153/0x260 [ 4604.585255][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4604.585545][ C0] arch_call_rest_init+0x13/0x40 [ 4604.585813][ C0] start_kernel+0x314/0x3d0 [ 4604.586055][ C0] x86_64_start_reservations+0x18/0x30 [ 4604.586346][ C0] x86_64_start_kernel+0xba/0x110 [ 4604.586619][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4604.586952][ C0] [ 4604.587120][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3182s! [ksoftirqd/1:22] [ 4604.587596][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4604.588811][ C1] irq event stamp: 3886976 [ 4604.589054][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4604.589553][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4604.590049][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4604.590548][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4604.591049][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4604.591542][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4604.592191][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4604.592534][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4604.593558][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4604.593889][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4604.594318][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4604.594747][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4604.595178][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4604.595605][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4604.596032][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4604.596512][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4604.596862][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4604.597291][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4604.597713][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4604.598136][ C1] Call Trace: [ 4604.598317][ C1] [ 4604.598476][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4604.598755][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4604.599009][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4604.599307][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4604.599594][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4604.599897][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4604.600178][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4604.600499][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4604.600779][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4604.601106][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4604.601415][ C1] [ 4604.601576][ C1] [ 4604.601737][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4604.602073][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4604.602376][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4604.602686][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4604.602991][ C1] ? run_ksoftirqd+0xb/0x60 [ 4604.603240][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4604.603574][ C1] ? __orc_find+0x9c/0xf0 [ 4604.603812][ C1] ? lock_acquire+0x1c1/0x220 [ 4604.604071][ C1] ? irqentry_enter+0x2b/0x60 [ 4604.604331][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4604.604597][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4604.604887][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4604.605192][ C1] ? lock_acquire+0x1c1/0x220 [ 4604.605441][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4604.605693][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4604.605967][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4604.606221][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4604.606486][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4604.606763][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4604.607059][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4604.607358][ C1] ip_local_deliver+0x19d/0x480 [ 4604.607619][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4604.607907][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4604.608175][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4604.608457][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4604.608724][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4604.609061][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4604.609343][ C1] ip_rcv+0x564/0x740 [ 4604.609559][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4604.609805][ C1] ? set_track_prepare+0x8a/0xd0 [ 4604.610077][ C1] ? irqentry_enter+0x2b/0x60 [ 4604.610327][ C1] ? irqentry_enter+0x2b/0x60 [ 4604.610578][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4604.610819][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4604.611141][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4604.611484][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4604.611795][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4604.612142][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4604.612446][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4604.612782][ C1] netif_receive_skb+0x55/0x280 [ 4604.613045][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4604.613377][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4604.613727][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4604.614050][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4604.614346][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4604.614657][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4604.614989][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4604.615276][ C1] ? arch_stack_walk+0x68/0x100 [ 4604.615538][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4604.615815][ C1] ? irqentry_enter+0x2b/0x60 [ 4604.616066][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4604.616385][ C1] ? irqentry_enter+0x2b/0x60 [ 4604.616641][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4604.616971][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4604.617254][ C1] ? arch_stack_walk+0x68/0x100 [ 4604.617522][ C1] __tcf_classify+0x32c/0x7d0 [ 4604.617781][ C1] tcf_classify+0x283/0x930 [ 4604.618029][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4604.618307][ C1] tc_run+0x2e4/0x5d0 [ 4604.618524][ C1] ? __pfx_tc_run+0x10/0x10 [ 4604.618772][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4604.619042][ C1] ? irqentry_enter+0x2b/0x60 [ 4604.619291][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4604.619575][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4604.619897][ C1] ip_finish_output2+0x786/0x18e0 [ 4604.620171][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4604.620467][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4604.620733][ C1] ? __ip_finish_output+0x10f/0x770 [ 4604.621016][ C1] ip_output+0x16b/0x4f0 [ 4604.621244][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4604.621562][ C1] ? __pfx_ip_output+0x10/0x10 [ 4604.621822][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4604.622177][ C1] ? __pfx_ip_output+0x10/0x10 [ 4604.622436][ C1] __ip_queue_xmit+0x672/0x1910 [ 4604.622702][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4604.622988][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4604.623289][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4604.623579][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4604.623883][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4604.624171][ C1] tcp_delack_timer+0x84/0x240 [ 4604.624426][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4604.624715][ C1] call_timer_fn+0x176/0x430 [ 4604.624968][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4604.625244][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4604.625525][ C1] __run_timers.part.0+0x52d/0x890 [ 4604.625803][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4604.626091][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4604.626392][ C1] ? __pfx___schedule+0x10/0x10 [ 4604.626658][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4604.626981][ C1] run_timer_softirq+0x72/0x100 [ 4604.627241][ C1] __do_softirq+0x1bc/0x7ff [ 4604.627484][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4604.627757][ C1] run_ksoftirqd+0x2e/0x60 [ 4604.628000][ C1] smpboot_thread_fn+0x30e/0x840 [ 4604.628267][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4604.628561][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4604.628850][ C1] kthread+0x292/0x360 [ 4604.629073][ C1] ? __pfx_kthread+0x10/0x10 [ 4604.629319][ C1] ret_from_fork+0x34/0x70 [ 4604.629562][ C1] ? __pfx_kthread+0x10/0x10 [ 4604.629807][ C1] ret_from_fork_asm+0x1b/0x30 [ 4604.630071][ C1] [ 4632.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3208s! [swapper/0:0] [ 4632.527928][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4632.529134][ C0] irq event stamp: 27567077 [ 4632.529378][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4632.529910][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4632.530386][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4632.530889][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4632.531383][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4632.531863][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4632.532510][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4632.532855][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4632.533890][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4632.534211][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4632.534630][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4632.535049][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4632.535469][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4632.535885][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4632.536303][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4632.536771][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4632.537124][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4632.537549][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4632.537973][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4632.538394][ C0] Call Trace: [ 4632.538572][ C0] [ 4632.538731][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4632.539010][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4632.539268][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4632.539558][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4632.539845][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4632.540151][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4632.540433][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4632.540756][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4632.541030][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4632.541312][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4632.541637][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4632.541946][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4632.542282][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4632.542585][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4632.542893][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4632.543201][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4632.543529][ C0] ? get_stack_info+0x36/0xc0 [ 4632.543786][ C0] ? lock_acquire+0x1c1/0x220 [ 4632.544041][ C0] ? lock_release+0x1d5/0x250 [ 4632.544294][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4632.544556][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4632.544844][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4632.545147][ C0] ? lock_acquire+0x1c1/0x220 [ 4632.545398][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4632.545651][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4632.545924][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4632.546173][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4632.546434][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4632.546707][ C0] ? __inet_lookup_established+0x341/0x610 [ 4632.547021][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4632.547308][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4632.547595][ C0] ip_local_deliver+0x19d/0x480 [ 4632.547860][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4632.548150][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4632.548416][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4632.548692][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4632.548954][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4632.549293][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4632.549566][ C0] ip_rcv+0x564/0x740 [ 4632.549778][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4632.550018][ C0] ? set_track_prepare+0x8a/0xd0 [ 4632.550283][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4632.550572][ C0] ? rest_init+0x153/0x260 [ 4632.550807][ C0] ? skb_clone+0x10b/0x330 [ 4632.551049][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4632.551382][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4632.551698][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4632.551999][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4632.552312][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4632.552572][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4632.552815][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4632.553132][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4632.553434][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4632.553778][ C0] ? lock_acquire+0x1c1/0x220 [ 4632.554029][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4632.554340][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4632.554638][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4632.554971][ C0] ? __copy_skb_header+0xaf/0x490 [ 4632.555242][ C0] ? __skb_clone+0x57a/0x760 [ 4632.555489][ C0] netif_receive_skb+0x55/0x280 [ 4632.555744][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4632.556069][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4632.556415][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4632.556732][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4632.557020][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4632.557318][ C0] ? hlock_class+0x4e/0x130 [ 4632.557562][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4632.557890][ C0] ? place_entity+0x21/0x2f0 [ 4632.558136][ C0] ? resched_curr+0x219/0x280 [ 4632.558391][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4632.558662][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4632.558945][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4632.559222][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4632.559479][ C0] ? activate_task+0xf5/0x260 [ 4632.559729][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4632.560003][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4632.560279][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4632.560535][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4632.560823][ C0] ? get_stack_info+0x36/0xc0 [ 4632.561079][ C0] ? stack_access_ok+0xda/0x1f0 [ 4632.561343][ C0] ? get_reg+0x119/0x190 [ 4632.561571][ C0] __tcf_classify+0x32c/0x7d0 [ 4632.561820][ C0] tcf_classify+0x283/0x930 [ 4632.562060][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4632.562387][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4632.562657][ C0] ? arch_stack_walk+0x8c/0x100 [ 4632.562924][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4632.563218][ C0] tc_run+0x2e4/0x5d0 [ 4632.563431][ C0] ? __pfx_tc_run+0x10/0x10 [ 4632.563678][ C0] ? lock_acquire+0x1c1/0x220 [ 4632.563932][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4632.564208][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4632.564475][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4632.564764][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4632.565045][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4632.565368][ C0] ? neigh_hh_output+0x348/0x590 [ 4632.565632][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4632.565913][ C0] ip_finish_output2+0x786/0x18e0 [ 4632.566186][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4632.566482][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4632.566833][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4632.567122][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4632.567390][ C0] ? __ip_finish_output+0x10f/0x770 [ 4632.567668][ C0] ip_output+0x16b/0x4f0 [ 4632.567894][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4632.568183][ C0] ? __pfx_ip_output+0x10/0x10 [ 4632.568436][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4632.568739][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4632.569003][ C0] ? ip_local_out+0x114/0x3b0 [ 4632.569257][ C0] __ip_queue_xmit+0x672/0x1910 [ 4632.569519][ C0] ? __skb_clone+0x57a/0x760 [ 4632.569768][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4632.570048][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4632.570352][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4632.570671][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4632.570931][ C0] ? tcp_current_mss+0x40a/0x510 [ 4632.571193][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4632.571476][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4632.571750][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4632.572003][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4632.572272][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4632.572593][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4632.572868][ C0] ? ktime_get+0xb6/0x190 [ 4632.573099][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4632.573370][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4632.573652][ C0] tcp_write_timer+0x82/0x1d0 [ 4632.573910][ C0] call_timer_fn+0x176/0x430 [ 4632.574160][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4632.574432][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4632.574711][ C0] __run_timers.part.0+0x52d/0x890 [ 4632.574982][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4632.575268][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4632.575565][ C0] ? lock_acquire+0x1c1/0x220 [ 4632.575816][ C0] ? clockevents_program_event+0xf6/0x300 [ 4632.576124][ C0] ? lock_release+0x1d5/0x250 [ 4632.576377][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4632.576656][ C0] ? ktime_get+0xb6/0x190 [ 4632.576889][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4632.577188][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4632.577497][ C0] run_timer_softirq+0x72/0x100 [ 4632.577760][ C0] __do_softirq+0x1bc/0x7ff [ 4632.578011][ C0] irq_exit_rcu+0x98/0xc0 [ 4632.578244][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4632.578547][ C0] [ 4632.578704][ C0] [ 4632.578859][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4632.579182][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4632.579454][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4632.580481][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4632.580810][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4632.581233][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4632.581654][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4632.582078][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4632.582504][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4632.582929][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4632.583235][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4632.583511][ C0] default_idle_call+0x69/0xa0 [ 4632.583775][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4632.584037][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4632.584332][ C0] ? lock_release+0x1d5/0x250 [ 4632.584582][ C0] do_idle+0xfb/0x160 [ 4632.584795][ C0] cpu_startup_entry+0x55/0x60 [ 4632.585050][ C0] rest_init+0x153/0x260 [ 4632.585277][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4632.585564][ C0] arch_call_rest_init+0x13/0x40 [ 4632.585829][ C0] start_kernel+0x314/0x3d0 [ 4632.586075][ C0] x86_64_start_reservations+0x18/0x30 [ 4632.586369][ C0] x86_64_start_kernel+0xba/0x110 [ 4632.586637][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4632.586960][ C0] [ 4632.587124][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3208s! [ksoftirqd/1:22] [ 4632.587599][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4632.588814][ C1] irq event stamp: 3886976 [ 4632.589059][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4632.589563][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4632.590059][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4632.590557][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4632.591062][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4632.591557][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4632.592203][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4632.592548][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4632.593590][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4632.593923][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4632.594346][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4632.594767][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4632.595189][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4632.595610][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4632.596033][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4632.596504][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4632.596861][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4632.597285][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4632.597707][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4632.598132][ C1] Call Trace: [ 4632.598316][ C1] [ 4632.598475][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4632.598752][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4632.599010][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4632.599300][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4632.599591][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4632.599901][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4632.600187][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4632.600513][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4632.600790][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4632.601119][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4632.601434][ C1] [ 4632.601592][ C1] [ 4632.601751][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4632.602084][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4632.602392][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4632.602710][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4632.603013][ C1] ? run_ksoftirqd+0xb/0x60 [ 4632.603258][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4632.603588][ C1] ? __orc_find+0x9c/0xf0 [ 4632.603825][ C1] ? lock_acquire+0x1c1/0x220 [ 4632.604077][ C1] ? irqentry_enter+0x2b/0x60 [ 4632.604327][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4632.604589][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4632.604877][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4632.605178][ C1] ? lock_acquire+0x1c1/0x220 [ 4632.605436][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4632.605693][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4632.605971][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4632.606219][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4632.606478][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4632.606749][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4632.607039][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4632.607329][ C1] ip_local_deliver+0x19d/0x480 [ 4632.607592][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4632.607883][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4632.608155][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4632.608434][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4632.608699][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4632.609041][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4632.609315][ C1] ip_rcv+0x564/0x740 [ 4632.609530][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4632.609774][ C1] ? set_track_prepare+0x8a/0xd0 [ 4632.610040][ C1] ? irqentry_enter+0x2b/0x60 [ 4632.610294][ C1] ? irqentry_enter+0x2b/0x60 [ 4632.610549][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4632.610796][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4632.611115][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4632.611461][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4632.611775][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4632.612116][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4632.612414][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4632.612752][ C1] netif_receive_skb+0x55/0x280 [ 4632.613018][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4632.613352][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4632.613712][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4632.614029][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4632.614319][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4632.614621][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4632.614948][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4632.615231][ C1] ? arch_stack_walk+0x68/0x100 [ 4632.615495][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4632.615776][ C1] ? irqentry_enter+0x2b/0x60 [ 4632.616031][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4632.616357][ C1] ? irqentry_enter+0x2b/0x60 [ 4632.616610][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4632.616931][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4632.617217][ C1] ? arch_stack_walk+0x68/0x100 [ 4632.617476][ C1] __tcf_classify+0x32c/0x7d0 [ 4632.617728][ C1] tcf_classify+0x283/0x930 [ 4632.617970][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4632.618241][ C1] tc_run+0x2e4/0x5d0 [ 4632.618458][ C1] ? __pfx_tc_run+0x10/0x10 [ 4632.618705][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4632.618973][ C1] ? irqentry_enter+0x2b/0x60 [ 4632.619228][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4632.619518][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4632.619847][ C1] ip_finish_output2+0x786/0x18e0 [ 4632.620119][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4632.620408][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4632.620678][ C1] ? __ip_finish_output+0x10f/0x770 [ 4632.620955][ C1] ip_output+0x16b/0x4f0 [ 4632.621184][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4632.621513][ C1] ? __pfx_ip_output+0x10/0x10 [ 4632.621771][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4632.622131][ C1] ? __pfx_ip_output+0x10/0x10 [ 4632.622389][ C1] __ip_queue_xmit+0x672/0x1910 [ 4632.622650][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4632.622929][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4632.623226][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4632.623513][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4632.623816][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4632.624108][ C1] tcp_delack_timer+0x84/0x240 [ 4632.624369][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4632.624656][ C1] call_timer_fn+0x176/0x430 [ 4632.624908][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4632.625191][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4632.625469][ C1] __run_timers.part.0+0x52d/0x890 [ 4632.625744][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4632.626043][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4632.626349][ C1] ? __pfx___schedule+0x10/0x10 [ 4632.626607][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4632.626927][ C1] run_timer_softirq+0x72/0x100 [ 4632.627191][ C1] __do_softirq+0x1bc/0x7ff [ 4632.627439][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4632.627717][ C1] run_ksoftirqd+0x2e/0x60 [ 4632.627956][ C1] smpboot_thread_fn+0x30e/0x840 [ 4632.628228][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4632.628523][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4632.628818][ C1] kthread+0x292/0x360 [ 4632.629037][ C1] ? __pfx_kthread+0x10/0x10 [ 4632.629287][ C1] ret_from_fork+0x34/0x70 [ 4632.629527][ C1] ? __pfx_kthread+0x10/0x10 [ 4632.629778][ C1] ret_from_fork_asm+0x1b/0x30 [ 4632.630042][ C1] [ 4656.030024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4656.030412][ C1] rcu: 1-....: (3452277 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=825999 [ 4656.030999][ C1] rcu: (t=3461721 jiffies g=1007429 q=31 ncpus=4) [ 4656.031346][ C1] Sending NMI from CPU 1 to CPUs 0: [ 4656.031639][ C0] NMI backtrace for cpu 0 [ 4656.031648][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4656.031653][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4656.031656][ C0] RIP: 0010:kasan_check_range+0x1b/0x1c0 [ 4656.031666][ C0] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 53 <72> 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 23 [ 4656.031670][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000286 [ 4656.031674][ C0] RAX: ffff88800a099b5c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4656.031675][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4656.031677][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4656.031679][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4656.031681][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4656.031683][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4656.031685][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4656.031688][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4656.031690][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4656.031692][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4656.031693][ C0] Call Trace: [ 4656.031697][ C0] [ 4656.031702][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 4656.031708][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4656.031714][ C0] ? nmi_handle+0x156/0x420 [ 4656.031719][ C0] ? default_do_nmi+0x41/0x100 [ 4656.031724][ C0] ? exc_nmi+0xf3/0x120 [ 4656.031727][ C0] ? end_repeat_nmi+0xf/0x60 [ 4656.031732][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4656.031739][ C0] ? kasan_check_range+0x1b/0x1c0 [ 4656.031742][ C0] ? kasan_check_range+0x1b/0x1c0 [ 4656.031746][ C0] ? kasan_check_range+0x1b/0x1c0 [ 4656.031749][ C0] [ 4656.031750][ C0] [ 4656.031752][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 4656.031756][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4656.031759][ C0] ? get_stack_info+0x36/0xc0 [ 4656.031765][ C0] ? lock_acquire+0x1c1/0x220 [ 4656.031770][ C0] ? lock_release+0x1d5/0x250 [ 4656.031774][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4656.031777][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4656.031781][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4656.031784][ C0] ? lock_acquire+0x1c1/0x220 [ 4656.031786][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4656.031793][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4656.031797][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4656.031804][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4656.031807][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4656.031811][ C0] ? __inet_lookup_established+0x341/0x610 [ 4656.031817][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4656.031826][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4656.031830][ C0] ip_local_deliver+0x19d/0x480 [ 4656.031834][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4656.031836][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4656.031842][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4656.031846][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4656.031849][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4656.031853][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4656.031863][ C0] ip_rcv+0x564/0x740 [ 4656.031867][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4656.031870][ C0] ? set_track_prepare+0x8a/0xd0 [ 4656.031875][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4656.031877][ C0] ? rest_init+0x153/0x260 [ 4656.031880][ C0] ? skb_clone+0x10b/0x330 [ 4656.031886][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4656.031892][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4656.031898][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4656.031902][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4656.031912][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4656.031915][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4656.031918][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4656.031923][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4656.031926][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4656.031930][ C0] ? lock_acquire+0x1c1/0x220 [ 4656.031932][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4656.031936][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4656.031939][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4656.031942][ C0] ? __copy_skb_header+0xaf/0x490 [ 4656.031945][ C0] ? __skb_clone+0x57a/0x760 [ 4656.031948][ C0] netif_receive_skb+0x55/0x280 [ 4656.031950][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4656.031958][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4656.031966][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4656.031972][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4656.031978][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4656.031986][ C0] ? hlock_class+0x4e/0x130 [ 4656.031992][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4656.032003][ C0] ? place_entity+0x21/0x2f0 [ 4656.032006][ C0] ? resched_curr+0x219/0x280 [ 4656.032010][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4656.032013][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4656.032017][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4656.032023][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4656.032026][ C0] ? activate_task+0xf5/0x260 [ 4656.032029][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4656.032034][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4656.032037][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4656.032041][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4656.032044][ C0] ? get_stack_info+0x36/0xc0 [ 4656.032047][ C0] ? stack_access_ok+0xda/0x1f0 [ 4656.032049][ C0] ? get_reg+0x119/0x190 [ 4656.032053][ C0] __tcf_classify+0x32c/0x7d0 [ 4656.032058][ C0] tcf_classify+0x283/0x930 [ 4656.032060][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4656.032066][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4656.032068][ C0] ? arch_stack_walk+0x8c/0x100 [ 4656.032072][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4656.032075][ C0] tc_run+0x2e4/0x5d0 [ 4656.032080][ C0] ? __pfx_tc_run+0x10/0x10 [ 4656.032083][ C0] ? lock_acquire+0x1c1/0x220 [ 4656.032086][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4656.032090][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4656.032096][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4656.032099][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4656.032102][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4656.032107][ C0] ? neigh_hh_output+0x348/0x590 [ 4656.032111][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4656.032115][ C0] ip_finish_output2+0x786/0x18e0 [ 4656.032119][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4656.032125][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4656.032133][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4656.032136][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4656.032140][ C0] ? __ip_finish_output+0x10f/0x770 [ 4656.032144][ C0] ip_output+0x16b/0x4f0 [ 4656.032147][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4656.032152][ C0] ? __pfx_ip_output+0x10/0x10 [ 4656.032155][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4656.032160][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4656.032163][ C0] ? ip_local_out+0x114/0x3b0 [ 4656.032166][ C0] __ip_queue_xmit+0x672/0x1910 [ 4656.032171][ C0] ? __skb_clone+0x57a/0x760 [ 4656.032174][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4656.032181][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4656.032186][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4656.032189][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4656.032194][ C0] ? tcp_current_mss+0x40a/0x510 [ 4656.032197][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4656.032200][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4656.032203][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4656.032205][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4656.032208][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4656.032212][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4656.032216][ C0] ? ktime_get+0xb6/0x190 [ 4656.032220][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4656.032224][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4656.032228][ C0] tcp_write_timer+0x82/0x1d0 [ 4656.032231][ C0] call_timer_fn+0x176/0x430 [ 4656.032235][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4656.032240][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4656.032244][ C0] __run_timers.part.0+0x52d/0x890 [ 4656.032247][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4656.032252][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4656.032255][ C0] ? lock_acquire+0x1c1/0x220 [ 4656.032257][ C0] ? clockevents_program_event+0xf6/0x300 [ 4656.032261][ C0] ? lock_release+0x1d5/0x250 [ 4656.032264][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4656.032267][ C0] ? ktime_get+0xb6/0x190 [ 4656.032269][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4656.032273][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4656.032278][ C0] run_timer_softirq+0x72/0x100 [ 4656.032281][ C0] __do_softirq+0x1bc/0x7ff [ 4656.032286][ C0] irq_exit_rcu+0x98/0xc0 [ 4656.032289][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4656.032293][ C0] [ 4656.032294][ C0] [ 4656.032295][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4656.032300][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4656.032304][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4656.032306][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4656.032308][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4656.032310][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4656.032311][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4656.032312][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4656.032314][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4656.032317][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4656.032321][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4656.032324][ C0] default_idle_call+0x69/0xa0 [ 4656.032326][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4656.032329][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4656.032334][ C0] ? lock_release+0x1d5/0x250 [ 4656.032338][ C0] do_idle+0xfb/0x160 [ 4656.032341][ C0] cpu_startup_entry+0x55/0x60 [ 4656.032343][ C0] rest_init+0x153/0x260 [ 4656.032345][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4656.032352][ C0] arch_call_rest_init+0x13/0x40 [ 4656.032358][ C0] start_kernel+0x314/0x3d0 [ 4656.032362][ C0] x86_64_start_reservations+0x18/0x30 [ 4656.032367][ C0] x86_64_start_kernel+0xba/0x110 [ 4656.032371][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4656.032379][ C0] [ 4656.032634][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4656.087219][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4656.087865][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4656.088213][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4656.089237][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4656.089561][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4656.089981][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4656.090402][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4656.090820][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4656.091240][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4656.091660][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4656.092133][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4656.092488][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4656.092911][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4656.093339][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4656.093768][ C1] Call Trace: [ 4656.093944][ C1] [ 4656.094103][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4656.094396][ C1] ? print_cpu_stall+0x263/0x6a0 [ 4656.094660][ C1] ? check_cpu_stall+0x284/0x500 [ 4656.094928][ C1] ? rcu_pending+0x92/0x360 [ 4656.095170][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4656.095451][ C1] ? update_process_times+0xb9/0x110 [ 4656.095742][ C1] ? tick_sched_handle+0x67/0x130 [ 4656.096013][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4656.096314][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4656.096571][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4656.096899][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4656.097189][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4656.097495][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4656.097777][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4656.098105][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4656.098380][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4656.098707][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4656.099025][ C1] [ 4656.099182][ C1] [ 4656.099339][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4656.099669][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4656.099978][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4656.100291][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4656.100594][ C1] ? run_ksoftirqd+0xb/0x60 [ 4656.100839][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4656.101166][ C1] ? __orc_find+0x9c/0xf0 [ 4656.101401][ C1] ? lock_acquire+0x1c1/0x220 [ 4656.101656][ C1] ? irqentry_enter+0x2b/0x60 [ 4656.101911][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4656.102176][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4656.102471][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4656.102775][ C1] ? lock_acquire+0x1c1/0x220 [ 4656.103027][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4656.103281][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4656.103555][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4656.103810][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4656.104069][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4656.104339][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4656.104630][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4656.104923][ C1] ip_local_deliver+0x19d/0x480 [ 4656.105191][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4656.105479][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4656.105747][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4656.106024][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4656.106289][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4656.106629][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4656.106903][ C1] ip_rcv+0x564/0x740 [ 4656.107124][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4656.107365][ C1] ? set_track_prepare+0x8a/0xd0 [ 4656.107632][ C1] ? irqentry_enter+0x2b/0x60 [ 4656.107889][ C1] ? irqentry_enter+0x2b/0x60 [ 4656.108148][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4656.108393][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4656.108712][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4656.109058][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4656.109373][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4656.109716][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4656.110019][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4656.110358][ C1] netif_receive_skb+0x55/0x280 [ 4656.110622][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4656.110954][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4656.111309][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4656.111622][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4656.111914][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4656.112223][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4656.112561][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4656.112846][ C1] ? arch_stack_walk+0x68/0x100 [ 4656.113108][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4656.113386][ C1] ? irqentry_enter+0x2b/0x60 [ 4656.113645][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4656.113968][ C1] ? irqentry_enter+0x2b/0x60 [ 4656.114219][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4656.114542][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4656.114827][ C1] ? arch_stack_walk+0x68/0x100 [ 4656.115090][ C1] __tcf_classify+0x32c/0x7d0 [ 4656.115342][ C1] tcf_classify+0x283/0x930 [ 4656.115585][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4656.115855][ C1] tc_run+0x2e4/0x5d0 [ 4656.116073][ C1] ? __pfx_tc_run+0x10/0x10 [ 4656.116316][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4656.116585][ C1] ? irqentry_enter+0x2b/0x60 [ 4656.116842][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4656.117134][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4656.117459][ C1] ip_finish_output2+0x786/0x18e0 [ 4656.117730][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4656.118023][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4656.118290][ C1] ? __ip_finish_output+0x10f/0x770 [ 4656.118567][ C1] ip_output+0x16b/0x4f0 [ 4656.118796][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4656.119118][ C1] ? __pfx_ip_output+0x10/0x10 [ 4656.119375][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4656.119734][ C1] ? __pfx_ip_output+0x10/0x10 [ 4656.119994][ C1] __ip_queue_xmit+0x672/0x1910 [ 4656.120255][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4656.120536][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4656.120831][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4656.121117][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4656.121413][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4656.121700][ C1] tcp_delack_timer+0x84/0x240 [ 4656.121959][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4656.122255][ C1] call_timer_fn+0x176/0x430 [ 4656.122508][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4656.122782][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4656.123065][ C1] __run_timers.part.0+0x52d/0x890 [ 4656.123342][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4656.123633][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4656.123941][ C1] ? __pfx___schedule+0x10/0x10 [ 4656.124202][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4656.124525][ C1] run_timer_softirq+0x72/0x100 [ 4656.124789][ C1] __do_softirq+0x1bc/0x7ff [ 4656.125039][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4656.125315][ C1] run_ksoftirqd+0x2e/0x60 [ 4656.125553][ C1] smpboot_thread_fn+0x30e/0x840 [ 4656.125820][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4656.126111][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4656.126407][ C1] kthread+0x292/0x360 [ 4656.126627][ C1] ? __pfx_kthread+0x10/0x10 [ 4656.126877][ C1] ret_from_fork+0x34/0x70 [ 4656.127117][ C1] ? __pfx_kthread+0x10/0x10 [ 4656.127368][ C1] ret_from_fork_asm+0x1b/0x30 [ 4656.127628][ C1] [ 4680.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3253s! [swapper/0:0] [ 4680.527931][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4680.529138][ C0] irq event stamp: 27567077 [ 4680.529382][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4680.529916][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4680.530397][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4680.530903][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4680.531398][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4680.531879][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4680.532527][ C0] RIP: 0010:__kasan_check_read+0x0/0x20 [ 4680.532826][ C0] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 4680.533858][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000202 [ 4680.534180][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4680.534599][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4680.535020][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4680.535439][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4680.535857][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4680.536277][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4680.536749][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4680.537102][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4680.537525][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4680.537951][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4680.538377][ C0] Call Trace: [ 4680.538559][ C0] [ 4680.538717][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4680.538992][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4680.539252][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4680.539544][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4680.539834][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4680.540139][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4680.540421][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4680.540748][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4680.541021][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4680.541300][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4680.541624][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4680.541934][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4680.542270][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4680.542571][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 4680.542864][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 4680.543158][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4680.543487][ C0] ? get_stack_info+0x36/0xc0 [ 4680.543742][ C0] ? lock_acquire+0x1c1/0x220 [ 4680.543995][ C0] ? lock_release+0x1d5/0x250 [ 4680.544247][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4680.544507][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4680.544792][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4680.545090][ C0] ? lock_acquire+0x1c1/0x220 [ 4680.545341][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4680.545596][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4680.545878][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4680.546125][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4680.546385][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4680.546653][ C0] ? __inet_lookup_established+0x341/0x610 [ 4680.546965][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4680.547259][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4680.547554][ C0] ip_local_deliver+0x19d/0x480 [ 4680.547813][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4680.548097][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4680.548362][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4680.548643][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4680.548911][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4680.549248][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4680.549526][ C0] ip_rcv+0x564/0x740 [ 4680.549744][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4680.549990][ C0] ? set_track_prepare+0x8a/0xd0 [ 4680.550260][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4680.550550][ C0] ? rest_init+0x153/0x260 [ 4680.550789][ C0] ? skb_clone+0x10b/0x330 [ 4680.551028][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4680.551367][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4680.551693][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4680.551988][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4680.552296][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4680.552554][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4680.552794][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4680.553108][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4680.553405][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4680.553751][ C0] ? lock_acquire+0x1c1/0x220 [ 4680.553999][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4680.554311][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4680.554612][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4680.554943][ C0] ? __copy_skb_header+0xaf/0x490 [ 4680.555211][ C0] ? __skb_clone+0x57a/0x760 [ 4680.555456][ C0] netif_receive_skb+0x55/0x280 [ 4680.555720][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4680.556050][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4680.556401][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4680.556712][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4680.557005][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4680.557308][ C0] ? hlock_class+0x4e/0x130 [ 4680.557557][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4680.557892][ C0] ? place_entity+0x21/0x2f0 [ 4680.558142][ C0] ? resched_curr+0x219/0x280 [ 4680.558395][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4680.558662][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4680.558941][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4680.559222][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4680.559482][ C0] ? activate_task+0xf5/0x260 [ 4680.559741][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4680.560021][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4680.560294][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4680.560560][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4680.560853][ C0] ? get_stack_info+0x36/0xc0 [ 4680.561106][ C0] ? stack_access_ok+0xda/0x1f0 [ 4680.561364][ C0] ? get_reg+0x119/0x190 [ 4680.561593][ C0] __tcf_classify+0x32c/0x7d0 [ 4680.561851][ C0] tcf_classify+0x283/0x930 [ 4680.562098][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4680.562429][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4680.562696][ C0] ? arch_stack_walk+0x8c/0x100 [ 4680.562962][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4680.563251][ C0] tc_run+0x2e4/0x5d0 [ 4680.563473][ C0] ? __pfx_tc_run+0x10/0x10 [ 4680.563714][ C0] ? lock_acquire+0x1c1/0x220 [ 4680.563963][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4680.564240][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4680.564509][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4680.564793][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4680.565070][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4680.565391][ C0] ? neigh_hh_output+0x348/0x590 [ 4680.565661][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4680.565939][ C0] ip_finish_output2+0x786/0x18e0 [ 4680.566208][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4680.566499][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4680.566858][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4680.567152][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4680.567416][ C0] ? __ip_finish_output+0x10f/0x770 [ 4680.567696][ C0] ip_output+0x16b/0x4f0 [ 4680.567929][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4680.568212][ C0] ? __pfx_ip_output+0x10/0x10 [ 4680.568476][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4680.568776][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4680.569043][ C0] ? ip_local_out+0x114/0x3b0 [ 4680.569291][ C0] __ip_queue_xmit+0x672/0x1910 [ 4680.569554][ C0] ? __skb_clone+0x57a/0x760 [ 4680.569800][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4680.570084][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4680.570380][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4680.570700][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4680.570953][ C0] ? tcp_current_mss+0x40a/0x510 [ 4680.571219][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4680.571498][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4680.571778][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4680.572033][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4680.572300][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4680.572617][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4680.572896][ C0] ? ktime_get+0xb6/0x190 [ 4680.573131][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4680.573407][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4680.573696][ C0] tcp_write_timer+0x82/0x1d0 [ 4680.573944][ C0] call_timer_fn+0x176/0x430 [ 4680.574188][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4680.574464][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4680.574737][ C0] __run_timers.part.0+0x52d/0x890 [ 4680.575013][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4680.575294][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4680.575596][ C0] ? lock_acquire+0x1c1/0x220 [ 4680.575843][ C0] ? clockevents_program_event+0xf6/0x300 [ 4680.576148][ C0] ? lock_release+0x1d5/0x250 [ 4680.576398][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4680.576674][ C0] ? ktime_get+0xb6/0x190 [ 4680.576903][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4680.577202][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4680.577514][ C0] run_timer_softirq+0x72/0x100 [ 4680.577770][ C0] __do_softirq+0x1bc/0x7ff [ 4680.578011][ C0] irq_exit_rcu+0x98/0xc0 [ 4680.578241][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4680.578539][ C0] [ 4680.578699][ C0] [ 4680.578859][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4680.579183][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4680.579450][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4680.580468][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4680.580789][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4680.581208][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4680.581626][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4680.582043][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4680.582459][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4680.582877][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4680.583179][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4680.583455][ C0] default_idle_call+0x69/0xa0 [ 4680.583710][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4680.583978][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4680.584270][ C0] ? lock_release+0x1d5/0x250 [ 4680.584523][ C0] do_idle+0xfb/0x160 [ 4680.584736][ C0] cpu_startup_entry+0x55/0x60 [ 4680.584997][ C0] rest_init+0x153/0x260 [ 4680.585224][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4680.585514][ C0] arch_call_rest_init+0x13/0x40 [ 4680.585781][ C0] start_kernel+0x314/0x3d0 [ 4680.586022][ C0] x86_64_start_reservations+0x18/0x30 [ 4680.586312][ C0] x86_64_start_kernel+0xba/0x110 [ 4680.586585][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4680.586914][ C0] [ 4680.587084][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3253s! [ksoftirqd/1:22] [ 4680.587565][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4680.588763][ C1] irq event stamp: 3886976 [ 4680.589000][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4680.589506][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4680.590007][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4680.590514][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4680.591005][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4680.591505][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4680.592156][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4680.592503][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4680.593542][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4680.593863][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4680.594284][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4680.594701][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4680.595119][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4680.595538][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4680.595958][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4680.596429][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4680.596782][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4680.597208][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4680.597639][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4680.598066][ C1] Call Trace: [ 4680.598245][ C1] [ 4680.598406][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4680.598684][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4680.598944][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4680.599237][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4680.599527][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4680.599833][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4680.600119][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4680.600448][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4680.600724][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4680.601053][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4680.601372][ C1] [ 4680.601529][ C1] [ 4680.601686][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4680.602019][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4680.602328][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4680.602641][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4680.602943][ C1] ? run_ksoftirqd+0xb/0x60 [ 4680.603189][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4680.603520][ C1] ? __orc_find+0x9c/0xf0 [ 4680.603750][ C1] ? lock_acquire+0x1c1/0x220 [ 4680.604004][ C1] ? irqentry_enter+0x2b/0x60 [ 4680.604255][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4680.604513][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4680.604797][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4680.605098][ C1] ? lock_acquire+0x1c1/0x220 [ 4680.605353][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4680.605612][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4680.605887][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4680.606133][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4680.606390][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4680.606661][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4680.606951][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4680.607244][ C1] ip_local_deliver+0x19d/0x480 [ 4680.607506][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4680.607796][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4680.608066][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4680.608342][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4680.608607][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4680.608946][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4680.609221][ C1] ip_rcv+0x564/0x740 [ 4680.609436][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4680.609677][ C1] ? set_track_prepare+0x8a/0xd0 [ 4680.609943][ C1] ? irqentry_enter+0x2b/0x60 [ 4680.610201][ C1] ? irqentry_enter+0x2b/0x60 [ 4680.610457][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4680.610702][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4680.611022][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4680.611365][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4680.611679][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4680.612022][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4680.612321][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4680.612658][ C1] netif_receive_skb+0x55/0x280 [ 4680.612920][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4680.613255][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4680.613615][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4680.613935][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4680.614227][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4680.614531][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4680.614865][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4680.615148][ C1] ? arch_stack_walk+0x68/0x100 [ 4680.615415][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4680.615697][ C1] ? irqentry_enter+0x2b/0x60 [ 4680.615953][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4680.616275][ C1] ? irqentry_enter+0x2b/0x60 [ 4680.616524][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4680.616844][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4680.617128][ C1] ? arch_stack_walk+0x68/0x100 [ 4680.617390][ C1] __tcf_classify+0x32c/0x7d0 [ 4680.617643][ C1] tcf_classify+0x283/0x930 [ 4680.617886][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4680.618156][ C1] tc_run+0x2e4/0x5d0 [ 4680.618372][ C1] ? __pfx_tc_run+0x10/0x10 [ 4680.618615][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4680.618885][ C1] ? irqentry_enter+0x2b/0x60 [ 4680.619143][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4680.619434][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4680.619757][ C1] ip_finish_output2+0x786/0x18e0 [ 4680.620028][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4680.620318][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4680.620584][ C1] ? __ip_finish_output+0x10f/0x770 [ 4680.620861][ C1] ip_output+0x16b/0x4f0 [ 4680.621090][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4680.621410][ C1] ? __pfx_ip_output+0x10/0x10 [ 4680.621666][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4680.622022][ C1] ? __pfx_ip_output+0x10/0x10 [ 4680.622282][ C1] __ip_queue_xmit+0x672/0x1910 [ 4680.622541][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4680.622821][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4680.623117][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4680.623401][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4680.623706][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4680.623997][ C1] tcp_delack_timer+0x84/0x240 [ 4680.624260][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4680.624548][ C1] call_timer_fn+0x176/0x430 [ 4680.624797][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4680.625078][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4680.625356][ C1] __run_timers.part.0+0x52d/0x890 [ 4680.625629][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4680.625922][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4680.626231][ C1] ? __pfx___schedule+0x10/0x10 [ 4680.626491][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4680.626814][ C1] run_timer_softirq+0x72/0x100 [ 4680.627079][ C1] __do_softirq+0x1bc/0x7ff [ 4680.627330][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4680.627606][ C1] run_ksoftirqd+0x2e/0x60 [ 4680.627844][ C1] smpboot_thread_fn+0x30e/0x840 [ 4680.628112][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4680.628402][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4680.628698][ C1] kthread+0x292/0x360 [ 4680.628917][ C1] ? __pfx_kthread+0x10/0x10 [ 4680.629172][ C1] ret_from_fork+0x34/0x70 [ 4680.629411][ C1] ? __pfx_kthread+0x10/0x10 [ 4680.629663][ C1] ret_from_fork_asm+0x1b/0x30 [ 4680.629923][ C1] [ 4708.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3279s! [swapper/0:0] [ 4708.527919][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4708.529112][ C0] irq event stamp: 27567077 [ 4708.529351][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4708.529883][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4708.530361][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4708.530871][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4708.531375][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4708.531864][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4708.532509][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 4708.532845][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 4708.533876][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4708.534200][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4708.534620][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4708.535041][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4708.535467][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4708.535884][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4708.536301][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4708.536767][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4708.537120][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4708.537541][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4708.537960][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4708.538381][ C0] Call Trace: [ 4708.538562][ C0] [ 4708.538719][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4708.538994][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4708.539252][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4708.539540][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4708.539830][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4708.540137][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4708.540418][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4708.540741][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4708.541014][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4708.541294][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4708.541616][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4708.541928][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4708.542262][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4708.542564][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 4708.542867][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4708.543169][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4708.543503][ C0] ? get_stack_info+0x36/0xc0 [ 4708.543759][ C0] ? lock_acquire+0x1c1/0x220 [ 4708.544011][ C0] ? lock_release+0x1d5/0x250 [ 4708.544264][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4708.544533][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4708.544831][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4708.545130][ C0] ? lock_acquire+0x1c1/0x220 [ 4708.545382][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4708.545637][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4708.545913][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4708.546161][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4708.546420][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4708.546687][ C0] ? __inet_lookup_established+0x341/0x610 [ 4708.547001][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4708.547297][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4708.547590][ C0] ip_local_deliver+0x19d/0x480 [ 4708.547849][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4708.548133][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4708.548396][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4708.548677][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4708.548943][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4708.549279][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4708.549556][ C0] ip_rcv+0x564/0x740 [ 4708.549774][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4708.550019][ C0] ? set_track_prepare+0x8a/0xd0 [ 4708.550288][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4708.550578][ C0] ? rest_init+0x153/0x260 [ 4708.550817][ C0] ? skb_clone+0x10b/0x330 [ 4708.551058][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4708.551397][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4708.551722][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4708.552019][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4708.552328][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4708.552586][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4708.552825][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4708.553138][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4708.553441][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4708.553781][ C0] ? lock_acquire+0x1c1/0x220 [ 4708.554029][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4708.554339][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4708.554641][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4708.554977][ C0] ? __copy_skb_header+0xaf/0x490 [ 4708.555247][ C0] ? __skb_clone+0x57a/0x760 [ 4708.555494][ C0] netif_receive_skb+0x55/0x280 [ 4708.555759][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4708.556090][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4708.556443][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4708.556754][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4708.557050][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4708.557352][ C0] ? hlock_class+0x4e/0x130 [ 4708.557601][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4708.557935][ C0] ? place_entity+0x21/0x2f0 [ 4708.558187][ C0] ? resched_curr+0x219/0x280 [ 4708.558439][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4708.558706][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4708.558985][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4708.559267][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4708.559527][ C0] ? activate_task+0xf5/0x260 [ 4708.559780][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4708.560061][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4708.560334][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4708.560599][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4708.560893][ C0] ? get_stack_info+0x36/0xc0 [ 4708.561146][ C0] ? stack_access_ok+0xda/0x1f0 [ 4708.561404][ C0] ? get_reg+0x119/0x190 [ 4708.561636][ C0] __tcf_classify+0x32c/0x7d0 [ 4708.561893][ C0] tcf_classify+0x283/0x930 [ 4708.562140][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4708.562473][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4708.562739][ C0] ? arch_stack_walk+0x8c/0x100 [ 4708.563000][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4708.563289][ C0] tc_run+0x2e4/0x5d0 [ 4708.563510][ C0] ? __pfx_tc_run+0x10/0x10 [ 4708.563751][ C0] ? lock_acquire+0x1c1/0x220 [ 4708.563999][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4708.564275][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4708.564544][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4708.564829][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4708.565106][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4708.565425][ C0] ? neigh_hh_output+0x348/0x590 [ 4708.565694][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4708.565974][ C0] ip_finish_output2+0x786/0x18e0 [ 4708.566244][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4708.566534][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4708.566893][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4708.567187][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4708.567451][ C0] ? __ip_finish_output+0x10f/0x770 [ 4708.567732][ C0] ip_output+0x16b/0x4f0 [ 4708.567961][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4708.568245][ C0] ? __pfx_ip_output+0x10/0x10 [ 4708.568505][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4708.568804][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4708.569070][ C0] ? ip_local_out+0x114/0x3b0 [ 4708.569319][ C0] __ip_queue_xmit+0x672/0x1910 [ 4708.569580][ C0] ? __skb_clone+0x57a/0x760 [ 4708.569826][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4708.570111][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4708.570410][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4708.570732][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4708.570987][ C0] ? tcp_current_mss+0x40a/0x510 [ 4708.571255][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4708.571535][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4708.571815][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4708.572072][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4708.572338][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4708.572656][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4708.572936][ C0] ? ktime_get+0xb6/0x190 [ 4708.573173][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4708.573455][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4708.573740][ C0] tcp_write_timer+0x82/0x1d0 [ 4708.573991][ C0] call_timer_fn+0x176/0x430 [ 4708.574237][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4708.574514][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4708.574788][ C0] __run_timers.part.0+0x52d/0x890 [ 4708.575066][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4708.575348][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4708.575649][ C0] ? lock_acquire+0x1c1/0x220 [ 4708.575896][ C0] ? clockevents_program_event+0xf6/0x300 [ 4708.576202][ C0] ? lock_release+0x1d5/0x250 [ 4708.576453][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4708.576730][ C0] ? ktime_get+0xb6/0x190 [ 4708.576961][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4708.577260][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4708.577574][ C0] run_timer_softirq+0x72/0x100 [ 4708.577832][ C0] __do_softirq+0x1bc/0x7ff [ 4708.578075][ C0] irq_exit_rcu+0x98/0xc0 [ 4708.578307][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4708.578606][ C0] [ 4708.578767][ C0] [ 4708.578929][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4708.579254][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4708.579522][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4708.580543][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4708.580865][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4708.581283][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4708.581703][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4708.582122][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4708.582541][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4708.582963][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4708.583266][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4708.583548][ C0] default_idle_call+0x69/0xa0 [ 4708.583802][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4708.584070][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4708.584362][ C0] ? lock_release+0x1d5/0x250 [ 4708.584616][ C0] do_idle+0xfb/0x160 [ 4708.584830][ C0] cpu_startup_entry+0x55/0x60 [ 4708.585090][ C0] rest_init+0x153/0x260 [ 4708.585324][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4708.585615][ C0] arch_call_rest_init+0x13/0x40 [ 4708.585882][ C0] start_kernel+0x314/0x3d0 [ 4708.586123][ C0] x86_64_start_reservations+0x18/0x30 [ 4708.586412][ C0] x86_64_start_kernel+0xba/0x110 [ 4708.586689][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4708.587019][ C0] [ 4708.587188][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3279s! [ksoftirqd/1:22] [ 4708.587655][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4708.588855][ C1] irq event stamp: 3886976 [ 4708.589096][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4708.589593][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4708.590087][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4708.590588][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4708.591084][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4708.591576][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4708.592220][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 4708.592558][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 4708.593593][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4708.593914][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4708.594335][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4708.594755][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4708.595173][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4708.595590][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4708.596014][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4708.596485][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4708.596838][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4708.597264][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4708.597689][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4708.598110][ C1] Call Trace: [ 4708.598290][ C1] [ 4708.598450][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4708.598728][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4708.598990][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4708.599281][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4708.599570][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4708.599875][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4708.600158][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4708.600482][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4708.600756][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4708.601084][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4708.601397][ C1] [ 4708.601553][ C1] [ 4708.601710][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4708.602040][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4708.602348][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 4708.602652][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4708.602959][ C1] ? run_ksoftirqd+0xb/0x60 [ 4708.603207][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4708.603540][ C1] ? __orc_find+0x9c/0xf0 [ 4708.603774][ C1] ? lock_acquire+0x1c1/0x220 [ 4708.604027][ C1] ? irqentry_enter+0x2b/0x60 [ 4708.604281][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4708.604545][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4708.604833][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4708.605137][ C1] ? lock_acquire+0x1c1/0x220 [ 4708.605388][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4708.605640][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4708.605913][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4708.606164][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4708.606426][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4708.606701][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4708.606992][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4708.607286][ C1] ip_local_deliver+0x19d/0x480 [ 4708.607542][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4708.607824][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4708.608089][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4708.608370][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4708.608637][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4708.608971][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4708.609252][ C1] ip_rcv+0x564/0x740 [ 4708.609472][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4708.609716][ C1] ? set_track_prepare+0x8a/0xd0 [ 4708.609986][ C1] ? irqentry_enter+0x2b/0x60 [ 4708.610237][ C1] ? irqentry_enter+0x2b/0x60 [ 4708.610488][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4708.610729][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4708.611043][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4708.611380][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4708.611688][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4708.612031][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4708.612330][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4708.612659][ C1] netif_receive_skb+0x55/0x280 [ 4708.612916][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4708.613242][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4708.613595][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4708.613909][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4708.614200][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4708.614504][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4708.614836][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4708.615120][ C1] ? arch_stack_walk+0x68/0x100 [ 4708.615380][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4708.615655][ C1] ? irqentry_enter+0x2b/0x60 [ 4708.615906][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4708.616226][ C1] ? irqentry_enter+0x2b/0x60 [ 4708.616481][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4708.616805][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4708.617085][ C1] ? arch_stack_walk+0x68/0x100 [ 4708.617346][ C1] __tcf_classify+0x32c/0x7d0 [ 4708.617600][ C1] tcf_classify+0x283/0x930 [ 4708.617844][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4708.618117][ C1] tc_run+0x2e4/0x5d0 [ 4708.618338][ C1] ? __pfx_tc_run+0x10/0x10 [ 4708.618584][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4708.618855][ C1] ? irqentry_enter+0x2b/0x60 [ 4708.619108][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4708.619394][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4708.619715][ C1] ip_finish_output2+0x786/0x18e0 [ 4708.619988][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4708.620281][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4708.620543][ C1] ? __ip_finish_output+0x10f/0x770 [ 4708.620824][ C1] ip_output+0x16b/0x4f0 [ 4708.621056][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4708.621374][ C1] ? __pfx_ip_output+0x10/0x10 [ 4708.621634][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4708.621984][ C1] ? __pfx_ip_output+0x10/0x10 [ 4708.622238][ C1] __ip_queue_xmit+0x672/0x1910 [ 4708.622502][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4708.622785][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4708.623083][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4708.623377][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4708.623673][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4708.623959][ C1] tcp_delack_timer+0x84/0x240 [ 4708.624216][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4708.624505][ C1] call_timer_fn+0x176/0x430 [ 4708.624760][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4708.625034][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4708.625314][ C1] __run_timers.part.0+0x52d/0x890 [ 4708.625589][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4708.625877][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4708.626178][ C1] ? __pfx___schedule+0x10/0x10 [ 4708.626440][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4708.626765][ C1] run_timer_softirq+0x72/0x100 [ 4708.627026][ C1] __do_softirq+0x1bc/0x7ff [ 4708.627268][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4708.627542][ C1] run_ksoftirqd+0x2e/0x60 [ 4708.627783][ C1] smpboot_thread_fn+0x30e/0x840 [ 4708.628049][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4708.628345][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4708.628636][ C1] kthread+0x292/0x360 [ 4708.628854][ C1] ? __pfx_kthread+0x10/0x10 [ 4708.629100][ C1] ret_from_fork+0x34/0x70 [ 4708.629342][ C1] ? __pfx_kthread+0x10/0x10 [ 4708.629588][ C1] ret_from_fork_asm+0x1b/0x30 [ 4708.629855][ C1] [ 4734.129024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4734.129418][ C0] rcu: 0-....: (3535425 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=844453 [ 4734.129940][ C0] rcu: (t=3539820 jiffies g=1007429 q=31 ncpus=4) [ 4734.130287][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4734.130773][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4734.131416][ C0] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 4734.131720][ C0] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 4734.132743][ C0] RSP: 0018:ffffc900000069c8 EFLAGS: 00000202 [ 4734.133071][ C0] RAX: ffff88800a099b58 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4734.133498][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4734.133917][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4734.134337][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4734.134756][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4734.135176][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4734.135647][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4734.136001][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4734.136423][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4734.136846][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4734.137272][ C0] Call Trace: [ 4734.137459][ C0] [ 4734.137616][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4734.137902][ C0] ? print_cpu_stall+0x263/0x6a0 [ 4734.138171][ C0] ? check_cpu_stall+0x284/0x500 [ 4734.138432][ C0] ? rcu_pending+0x92/0x360 [ 4734.138676][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4734.138961][ C0] ? update_process_times+0xb9/0x110 [ 4734.139244][ C0] ? tick_sched_handle+0x67/0x130 [ 4734.139516][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4734.139817][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4734.140073][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4734.140402][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4734.140689][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4734.140990][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4734.141266][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4734.141586][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4734.141863][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4734.142140][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4734.142465][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4734.142778][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4734.143111][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4734.143422][ C0] ? kasan_check_range+0x12/0x1c0 [ 4734.143689][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 4734.143986][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4734.144312][ C0] ? get_stack_info+0x36/0xc0 [ 4734.144571][ C0] ? lock_acquire+0x1c1/0x220 [ 4734.144828][ C0] ? lock_release+0x1d5/0x250 [ 4734.145083][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4734.145348][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4734.145635][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4734.145934][ C0] ? lock_acquire+0x1c1/0x220 [ 4734.146181][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4734.146432][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4734.146703][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4734.146953][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4734.147216][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4734.147487][ C0] ? __inet_lookup_established+0x341/0x610 [ 4734.147804][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4734.148094][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4734.148384][ C0] ip_local_deliver+0x19d/0x480 [ 4734.148645][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4734.148931][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4734.149199][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4734.149475][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4734.149739][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4734.150077][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4734.150351][ C0] ip_rcv+0x564/0x740 [ 4734.150569][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4734.150809][ C0] ? set_track_prepare+0x8a/0xd0 [ 4734.151074][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4734.151365][ C0] ? rest_init+0x153/0x260 [ 4734.151602][ C0] ? skb_clone+0x10b/0x330 [ 4734.151846][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4734.152179][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4734.152500][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4734.152800][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4734.153111][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4734.153379][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4734.153619][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4734.153935][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4734.154232][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4734.154575][ C0] ? lock_acquire+0x1c1/0x220 [ 4734.154827][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4734.155142][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4734.155454][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4734.155779][ C0] ? __copy_skb_header+0xaf/0x490 [ 4734.156045][ C0] ? __skb_clone+0x57a/0x760 [ 4734.156287][ C0] netif_receive_skb+0x55/0x280 [ 4734.156539][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4734.156857][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4734.157215][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4734.157531][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4734.157817][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4734.158123][ C0] ? hlock_class+0x4e/0x130 [ 4734.158388][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4734.158705][ C0] ? place_entity+0x21/0x2f0 [ 4734.158944][ C0] ? resched_curr+0x219/0x280 [ 4734.159192][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4734.159453][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4734.159734][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4734.160002][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4734.160252][ C0] ? activate_task+0xf5/0x260 [ 4734.160492][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4734.160757][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4734.161024][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4734.161280][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4734.161579][ C0] ? get_stack_info+0x36/0xc0 [ 4734.161833][ C0] ? stack_access_ok+0xda/0x1f0 [ 4734.162093][ C0] ? get_reg+0x119/0x190 [ 4734.162324][ C0] __tcf_classify+0x32c/0x7d0 [ 4734.162576][ C0] tcf_classify+0x283/0x930 [ 4734.162819][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4734.163146][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4734.163421][ C0] ? arch_stack_walk+0x8c/0x100 [ 4734.163682][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4734.163968][ C0] tc_run+0x2e4/0x5d0 [ 4734.164188][ C0] ? __pfx_tc_run+0x10/0x10 [ 4734.164433][ C0] ? lock_acquire+0x1c1/0x220 [ 4734.164684][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4734.164961][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4734.165228][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4734.165515][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4734.165794][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4734.166118][ C0] ? neigh_hh_output+0x348/0x590 [ 4734.166396][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4734.166669][ C0] ip_finish_output2+0x786/0x18e0 [ 4734.166932][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4734.167218][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4734.167559][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4734.167840][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4734.168116][ C0] ? __ip_finish_output+0x10f/0x770 [ 4734.168391][ C0] ip_output+0x16b/0x4f0 [ 4734.168619][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4734.168904][ C0] ? __pfx_ip_output+0x10/0x10 [ 4734.169160][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4734.169462][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4734.169723][ C0] ? ip_local_out+0x114/0x3b0 [ 4734.169979][ C0] __ip_queue_xmit+0x672/0x1910 [ 4734.170245][ C0] ? __skb_clone+0x57a/0x760 [ 4734.170494][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4734.170774][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4734.171068][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4734.171384][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4734.171642][ C0] ? tcp_current_mss+0x40a/0x510 [ 4734.171906][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4734.172190][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4734.172465][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4734.172717][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4734.172989][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4734.173319][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4734.173600][ C0] ? ktime_get+0xb6/0x190 [ 4734.173835][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4734.174112][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4734.174392][ C0] tcp_write_timer+0x82/0x1d0 [ 4734.174647][ C0] call_timer_fn+0x176/0x430 [ 4734.174897][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4734.175169][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4734.175445][ C0] __run_timers.part.0+0x52d/0x890 [ 4734.175716][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4734.176011][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4734.176323][ C0] ? lock_acquire+0x1c1/0x220 [ 4734.176575][ C0] ? clockevents_program_event+0xf6/0x300 [ 4734.176883][ C0] ? lock_release+0x1d5/0x250 [ 4734.177135][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4734.177415][ C0] ? ktime_get+0xb6/0x190 [ 4734.177648][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4734.177950][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4734.178258][ C0] run_timer_softirq+0x72/0x100 [ 4734.178519][ C0] __do_softirq+0x1bc/0x7ff [ 4734.178766][ C0] irq_exit_rcu+0x98/0xc0 [ 4734.179001][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4734.179300][ C0] [ 4734.179456][ C0] [ 4734.179612][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4734.179927][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4734.180198][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4734.181222][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4734.181550][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4734.181973][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4734.182401][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4734.182821][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4734.183248][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4734.183667][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4734.183970][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4734.184244][ C0] default_idle_call+0x69/0xa0 [ 4734.184503][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4734.184766][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4734.185060][ C0] ? lock_release+0x1d5/0x250 [ 4734.185310][ C0] do_idle+0xfb/0x160 [ 4734.185522][ C0] cpu_startup_entry+0x55/0x60 [ 4734.185774][ C0] rest_init+0x153/0x260 [ 4734.186004][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4734.186292][ C0] arch_call_rest_init+0x13/0x40 [ 4734.186556][ C0] start_kernel+0x314/0x3d0 [ 4734.186802][ C0] x86_64_start_reservations+0x18/0x30 [ 4734.187096][ C0] x86_64_start_kernel+0xba/0x110 [ 4734.187368][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4734.187694][ C0] [ 4734.187859][ C0] Sending NMI from CPU 0 to CPUs 1: [ 4734.188149][ C1] NMI backtrace for cpu 1 [ 4734.188157][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4734.188161][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4734.188164][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4734.188172][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4734.188175][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4734.188179][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4734.188181][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4734.188183][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4734.188185][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4734.188187][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4734.188189][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4734.188191][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4734.188195][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4734.188196][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4734.188198][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4734.188199][ C1] Call Trace: [ 4734.188203][ C1] [ 4734.188206][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 4734.188213][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4734.188218][ C1] ? nmi_handle+0x156/0x420 [ 4734.188224][ C1] ? default_do_nmi+0x41/0x100 [ 4734.188228][ C1] ? exc_nmi+0xf3/0x120 [ 4734.188230][ C1] ? end_repeat_nmi+0xf/0x60 [ 4734.188235][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4734.188239][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4734.188242][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4734.188246][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4734.188249][ C1] [ 4734.188251][ C1] [ 4734.188251][ C1] ? run_ksoftirqd+0xb/0x60 [ 4734.188256][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4734.188259][ C1] ? __orc_find+0x9c/0xf0 [ 4734.188263][ C1] ? lock_acquire+0x1c1/0x220 [ 4734.188267][ C1] ? irqentry_enter+0x2b/0x60 [ 4734.188272][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4734.188276][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4734.188279][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4734.188282][ C1] ? lock_acquire+0x1c1/0x220 [ 4734.188285][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4734.188290][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4734.188294][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4734.188301][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4734.188304][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4734.188310][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4734.188317][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4734.188321][ C1] ip_local_deliver+0x19d/0x480 [ 4734.188325][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4734.188327][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4734.188333][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4734.188337][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4734.188340][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4734.188343][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4734.188352][ C1] ip_rcv+0x564/0x740 [ 4734.188356][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4734.188358][ C1] ? set_track_prepare+0x8a/0xd0 [ 4734.188364][ C1] ? irqentry_enter+0x2b/0x60 [ 4734.188367][ C1] ? irqentry_enter+0x2b/0x60 [ 4734.188371][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4734.188374][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4734.188378][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4734.188382][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4734.188385][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4734.188388][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4734.188391][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4734.188396][ C1] netif_receive_skb+0x55/0x280 [ 4734.188399][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4734.188408][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4734.188415][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4734.188422][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4734.188429][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4734.188441][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4734.188451][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4734.188454][ C1] ? arch_stack_walk+0x68/0x100 [ 4734.188459][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4734.188462][ C1] ? irqentry_enter+0x2b/0x60 [ 4734.188466][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4734.188470][ C1] ? irqentry_enter+0x2b/0x60 [ 4734.188474][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4734.188481][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4734.188484][ C1] ? arch_stack_walk+0x68/0x100 [ 4734.188488][ C1] __tcf_classify+0x32c/0x7d0 [ 4734.188493][ C1] tcf_classify+0x283/0x930 [ 4734.188497][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4734.188502][ C1] tc_run+0x2e4/0x5d0 [ 4734.188507][ C1] ? __pfx_tc_run+0x10/0x10 [ 4734.188512][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4734.188517][ C1] ? irqentry_enter+0x2b/0x60 [ 4734.188520][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4734.188524][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4734.188531][ C1] ip_finish_output2+0x786/0x18e0 [ 4734.188536][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4734.188539][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4734.188543][ C1] ? __ip_finish_output+0x10f/0x770 [ 4734.188547][ C1] ip_output+0x16b/0x4f0 [ 4734.188550][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4734.188553][ C1] ? __pfx_ip_output+0x10/0x10 [ 4734.188558][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4734.188565][ C1] ? __pfx_ip_output+0x10/0x10 [ 4734.188569][ C1] __ip_queue_xmit+0x672/0x1910 [ 4734.188575][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4734.188581][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4734.188585][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4734.188589][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4734.188594][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4734.188596][ C1] tcp_delack_timer+0x84/0x240 [ 4734.188600][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4734.188603][ C1] call_timer_fn+0x176/0x430 [ 4734.188608][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4734.188612][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4734.188616][ C1] __run_timers.part.0+0x52d/0x890 [ 4734.188619][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4734.188624][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4734.188629][ C1] ? __pfx___schedule+0x10/0x10 [ 4734.188633][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4734.188638][ C1] run_timer_softirq+0x72/0x100 [ 4734.188641][ C1] __do_softirq+0x1bc/0x7ff [ 4734.188645][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4734.188649][ C1] run_ksoftirqd+0x2e/0x60 [ 4734.188653][ C1] smpboot_thread_fn+0x30e/0x840 [ 4734.188657][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4734.188661][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4734.188664][ C1] kthread+0x292/0x360 [ 4734.188667][ C1] ? __pfx_kthread+0x10/0x10 [ 4734.188669][ C1] ret_from_fork+0x34/0x70 [ 4734.188672][ C1] ? __pfx_kthread+0x10/0x10 [ 4734.188674][ C1] ret_from_fork_asm+0x1b/0x30 [ 4734.188681][ C1] [ 4760.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3327s! [swapper/0:0] [ 4760.527918][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4760.529116][ C0] irq event stamp: 27567077 [ 4760.529355][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4760.529884][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4760.530364][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4760.530874][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4760.531373][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4760.531858][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4760.532497][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4760.532835][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4760.533863][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4760.534187][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4760.534610][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4760.535028][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4760.535446][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4760.535868][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4760.536290][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4760.536760][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4760.537109][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4760.537539][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4760.537960][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4760.538375][ C0] Call Trace: [ 4760.538550][ C0] [ 4760.538705][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4760.538983][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4760.539240][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4760.539532][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4760.539815][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4760.540116][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4760.540392][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4760.540710][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4760.540986][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4760.541262][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4760.541588][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4760.541900][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4760.542229][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4760.542535][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4760.542845][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4760.543155][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4760.543483][ C0] ? get_stack_info+0x36/0xc0 [ 4760.543732][ C0] ? lock_acquire+0x1c1/0x220 [ 4760.543980][ C0] ? lock_release+0x1d5/0x250 [ 4760.544228][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4760.544486][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4760.544774][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4760.545071][ C0] ? lock_acquire+0x1c1/0x220 [ 4760.545322][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4760.545577][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4760.545851][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4760.546098][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4760.546354][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4760.546621][ C0] ? __inet_lookup_established+0x341/0x610 [ 4760.546936][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4760.547228][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4760.547521][ C0] ip_local_deliver+0x19d/0x480 [ 4760.547779][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4760.548062][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4760.548334][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4760.548613][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4760.548877][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4760.549209][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4760.549486][ C0] ip_rcv+0x564/0x740 [ 4760.549698][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4760.549941][ C0] ? set_track_prepare+0x8a/0xd0 [ 4760.550207][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4760.550492][ C0] ? rest_init+0x153/0x260 [ 4760.550731][ C0] ? skb_clone+0x10b/0x330 [ 4760.550969][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4760.551306][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4760.551624][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4760.551916][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4760.552223][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4760.552476][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4760.552715][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4760.553032][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4760.553336][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4760.553674][ C0] ? lock_acquire+0x1c1/0x220 [ 4760.553920][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4760.554229][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4760.554529][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4760.554857][ C0] ? __copy_skb_header+0xaf/0x490 [ 4760.555123][ C0] ? __skb_clone+0x57a/0x760 [ 4760.555364][ C0] netif_receive_skb+0x55/0x280 [ 4760.555624][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4760.555952][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4760.556303][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4760.556612][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4760.556901][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4760.557201][ C0] ? hlock_class+0x4e/0x130 [ 4760.557447][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4760.557780][ C0] ? place_entity+0x21/0x2f0 [ 4760.558029][ C0] ? resched_curr+0x219/0x280 [ 4760.558280][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4760.558547][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4760.558826][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4760.559106][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4760.559367][ C0] ? activate_task+0xf5/0x260 [ 4760.559619][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4760.559896][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4760.560167][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4760.560428][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4760.560721][ C0] ? get_stack_info+0x36/0xc0 [ 4760.560972][ C0] ? stack_access_ok+0xda/0x1f0 [ 4760.561229][ C0] ? get_reg+0x119/0x190 [ 4760.561454][ C0] __tcf_classify+0x32c/0x7d0 [ 4760.561708][ C0] tcf_classify+0x283/0x930 [ 4760.561953][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4760.562284][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4760.562549][ C0] ? arch_stack_walk+0x8c/0x100 [ 4760.562809][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4760.563110][ C0] tc_run+0x2e4/0x5d0 [ 4760.563324][ C0] ? __pfx_tc_run+0x10/0x10 [ 4760.563565][ C0] ? lock_acquire+0x1c1/0x220 [ 4760.563814][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4760.564087][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4760.564357][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4760.564641][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4760.564918][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4760.565236][ C0] ? neigh_hh_output+0x348/0x590 [ 4760.565502][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4760.565779][ C0] ip_finish_output2+0x786/0x18e0 [ 4760.566046][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4760.566338][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4760.566694][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4760.566987][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4760.567251][ C0] ? __ip_finish_output+0x10f/0x770 [ 4760.567531][ C0] ip_output+0x16b/0x4f0 [ 4760.567758][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4760.568037][ C0] ? __pfx_ip_output+0x10/0x10 [ 4760.568292][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4760.568590][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4760.568855][ C0] ? ip_local_out+0x114/0x3b0 [ 4760.569108][ C0] __ip_queue_xmit+0x672/0x1910 [ 4760.569365][ C0] ? __skb_clone+0x57a/0x760 [ 4760.569607][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4760.569889][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4760.570190][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4760.570517][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4760.570773][ C0] ? tcp_current_mss+0x40a/0x510 [ 4760.571036][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4760.571313][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4760.571590][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4760.571845][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4760.572110][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4760.572425][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4760.572703][ C0] ? ktime_get+0xb6/0x190 [ 4760.572936][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4760.573213][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4760.573495][ C0] tcp_write_timer+0x82/0x1d0 [ 4760.573743][ C0] call_timer_fn+0x176/0x430 [ 4760.573988][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4760.574263][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4760.574534][ C0] __run_timers.part.0+0x52d/0x890 [ 4760.574809][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4760.575093][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4760.575393][ C0] ? lock_acquire+0x1c1/0x220 [ 4760.575640][ C0] ? clockevents_program_event+0xf6/0x300 [ 4760.575944][ C0] ? lock_release+0x1d5/0x250 [ 4760.576194][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4760.576468][ C0] ? ktime_get+0xb6/0x190 [ 4760.576697][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4760.576992][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4760.577305][ C0] run_timer_softirq+0x72/0x100 [ 4760.577563][ C0] __do_softirq+0x1bc/0x7ff [ 4760.577805][ C0] irq_exit_rcu+0x98/0xc0 [ 4760.578035][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4760.578333][ C0] [ 4760.578492][ C0] [ 4760.578651][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4760.578974][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4760.579242][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4760.580253][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4760.580575][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4760.580991][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4760.581408][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4760.581831][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4760.582246][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4760.582666][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4760.582966][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4760.583245][ C0] default_idle_call+0x69/0xa0 [ 4760.583495][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4760.583760][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4760.584053][ C0] ? lock_release+0x1d5/0x250 [ 4760.584308][ C0] do_idle+0xfb/0x160 [ 4760.584523][ C0] cpu_startup_entry+0x55/0x60 [ 4760.584778][ C0] rest_init+0x153/0x260 [ 4760.585007][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4760.585305][ C0] arch_call_rest_init+0x13/0x40 [ 4760.585573][ C0] start_kernel+0x314/0x3d0 [ 4760.585812][ C0] x86_64_start_reservations+0x18/0x30 [ 4760.586103][ C0] x86_64_start_kernel+0xba/0x110 [ 4760.586372][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4760.586700][ C0] [ 4760.586868][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3327s! [ksoftirqd/1:22] [ 4760.587333][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4760.588531][ C1] irq event stamp: 3886976 [ 4760.588770][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4760.589265][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4760.589757][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4760.590257][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4760.590749][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4760.591242][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4760.591886][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4760.592225][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4760.593249][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4760.593573][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4760.593995][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4760.594420][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4760.594839][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4760.595267][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4760.595690][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4760.596165][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4760.596511][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4760.596935][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4760.597355][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4760.597771][ C1] Call Trace: [ 4760.597947][ C1] [ 4760.598102][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4760.598385][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4760.598642][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4760.598936][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4760.599224][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4760.599526][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4760.599803][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4760.600127][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4760.600404][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4760.600727][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4760.601040][ C1] [ 4760.601200][ C1] [ 4760.601369][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4760.601702][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4760.602004][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4760.602314][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4760.602621][ C1] ? run_ksoftirqd+0xb/0x60 [ 4760.602867][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4760.603199][ C1] ? __orc_find+0x9c/0xf0 [ 4760.603433][ C1] ? lock_acquire+0x1c1/0x220 [ 4760.603688][ C1] ? irqentry_enter+0x2b/0x60 [ 4760.603941][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4760.604206][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4760.604495][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4760.604796][ C1] ? lock_acquire+0x1c1/0x220 [ 4760.605047][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4760.605301][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4760.605573][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4760.605822][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4760.606084][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4760.606361][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4760.606655][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4760.606948][ C1] ip_local_deliver+0x19d/0x480 [ 4760.607208][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4760.607495][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4760.607757][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4760.608039][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4760.608305][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4760.608643][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4760.608919][ C1] ip_rcv+0x564/0x740 [ 4760.609136][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4760.609381][ C1] ? set_track_prepare+0x8a/0xd0 [ 4760.609648][ C1] ? irqentry_enter+0x2b/0x60 [ 4760.609901][ C1] ? irqentry_enter+0x2b/0x60 [ 4760.610152][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4760.610392][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4760.610704][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4760.611044][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4760.611353][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4760.611696][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4760.612000][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4760.612333][ C1] netif_receive_skb+0x55/0x280 [ 4760.612589][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4760.612914][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4760.613268][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4760.613582][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4760.613874][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4760.614180][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4760.614514][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4760.614797][ C1] ? arch_stack_walk+0x68/0x100 [ 4760.615059][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4760.615336][ C1] ? irqentry_enter+0x2b/0x60 [ 4760.615587][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4760.615905][ C1] ? irqentry_enter+0x2b/0x60 [ 4760.616158][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4760.616484][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4760.616765][ C1] ? arch_stack_walk+0x68/0x100 [ 4760.617030][ C1] __tcf_classify+0x32c/0x7d0 [ 4760.617285][ C1] tcf_classify+0x283/0x930 [ 4760.617532][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4760.617803][ C1] tc_run+0x2e4/0x5d0 [ 4760.618021][ C1] ? __pfx_tc_run+0x10/0x10 [ 4760.618268][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4760.618537][ C1] ? irqentry_enter+0x2b/0x60 [ 4760.618788][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4760.619075][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4760.619395][ C1] ip_finish_output2+0x786/0x18e0 [ 4760.619670][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4760.619963][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4760.620228][ C1] ? __ip_finish_output+0x10f/0x770 [ 4760.620508][ C1] ip_output+0x16b/0x4f0 [ 4760.620736][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4760.621053][ C1] ? __pfx_ip_output+0x10/0x10 [ 4760.621310][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4760.621661][ C1] ? __pfx_ip_output+0x10/0x10 [ 4760.621918][ C1] __ip_queue_xmit+0x672/0x1910 [ 4760.622182][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4760.622464][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4760.622761][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4760.623048][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4760.623348][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4760.623631][ C1] tcp_delack_timer+0x84/0x240 [ 4760.623886][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4760.624176][ C1] call_timer_fn+0x176/0x430 [ 4760.624425][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4760.624704][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4760.624985][ C1] __run_timers.part.0+0x52d/0x890 [ 4760.625260][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4760.625549][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4760.625849][ C1] ? __pfx___schedule+0x10/0x10 [ 4760.626114][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4760.626437][ C1] run_timer_softirq+0x72/0x100 [ 4760.626697][ C1] __do_softirq+0x1bc/0x7ff [ 4760.626942][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4760.627214][ C1] run_ksoftirqd+0x2e/0x60 [ 4760.627454][ C1] smpboot_thread_fn+0x30e/0x840 [ 4760.627718][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4760.628009][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4760.628298][ C1] kthread+0x292/0x360 [ 4760.628521][ C1] ? __pfx_kthread+0x10/0x10 [ 4760.628768][ C1] ret_from_fork+0x34/0x70 [ 4760.629008][ C1] ? __pfx_kthread+0x10/0x10 [ 4760.629254][ C1] ret_from_fork_asm+0x1b/0x30 [ 4760.629516][ C1] [ 4788.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3353s! [swapper/0:0] [ 4788.527923][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4788.529131][ C0] irq event stamp: 27567077 [ 4788.529374][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4788.529906][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4788.530381][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4788.530885][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4788.531378][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4788.531858][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4788.532512][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4788.532855][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4788.533884][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4788.534209][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4788.534628][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4788.535048][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4788.535466][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4788.535886][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4788.536306][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4788.536772][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4788.537128][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4788.537549][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4788.537968][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4788.538390][ C0] Call Trace: [ 4788.538573][ C0] [ 4788.538731][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4788.539006][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4788.539263][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4788.539551][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4788.539839][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4788.540147][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4788.540430][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4788.540754][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4788.541028][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4788.541307][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4788.541629][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4788.541942][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4788.542285][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4788.542588][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4788.542896][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4788.543205][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4788.543530][ C0] ? get_stack_info+0x36/0xc0 [ 4788.543788][ C0] ? lock_acquire+0x1c1/0x220 [ 4788.544044][ C0] ? lock_release+0x1d5/0x250 [ 4788.544299][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4788.544564][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4788.544857][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4788.545159][ C0] ? lock_acquire+0x1c1/0x220 [ 4788.545407][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4788.545658][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4788.545931][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4788.546181][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4788.546445][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4788.546716][ C0] ? __inet_lookup_established+0x341/0x610 [ 4788.547037][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4788.547326][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4788.547617][ C0] ip_local_deliver+0x19d/0x480 [ 4788.547878][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4788.548165][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4788.548432][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4788.548708][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4788.548970][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4788.549310][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4788.549584][ C0] ip_rcv+0x564/0x740 [ 4788.549796][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4788.550037][ C0] ? set_track_prepare+0x8a/0xd0 [ 4788.550300][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4788.550594][ C0] ? rest_init+0x153/0x260 [ 4788.550829][ C0] ? skb_clone+0x10b/0x330 [ 4788.551073][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4788.551406][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4788.551725][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4788.552026][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4788.552337][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4788.552599][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4788.552844][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4788.553170][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4788.553467][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4788.553810][ C0] ? lock_acquire+0x1c1/0x220 [ 4788.554061][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4788.554375][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4788.554672][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4788.555006][ C0] ? __copy_skb_header+0xaf/0x490 [ 4788.555276][ C0] ? __skb_clone+0x57a/0x760 [ 4788.555528][ C0] netif_receive_skb+0x55/0x280 [ 4788.555784][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4788.556109][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4788.556454][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4788.556767][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4788.557053][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4788.557348][ C0] ? hlock_class+0x4e/0x130 [ 4788.557600][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4788.557930][ C0] ? place_entity+0x21/0x2f0 [ 4788.558178][ C0] ? resched_curr+0x219/0x280 [ 4788.558432][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4788.558701][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4788.558983][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4788.559258][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4788.559515][ C0] ? activate_task+0xf5/0x260 [ 4788.559762][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4788.560036][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4788.560309][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4788.560566][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4788.560855][ C0] ? get_stack_info+0x36/0xc0 [ 4788.561111][ C0] ? stack_access_ok+0xda/0x1f0 [ 4788.561372][ C0] ? get_reg+0x119/0x190 [ 4788.561599][ C0] __tcf_classify+0x32c/0x7d0 [ 4788.561850][ C0] tcf_classify+0x283/0x930 [ 4788.562089][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4788.562412][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4788.562682][ C0] ? arch_stack_walk+0x8c/0x100 [ 4788.562950][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4788.563238][ C0] tc_run+0x2e4/0x5d0 [ 4788.563453][ C0] ? __pfx_tc_run+0x10/0x10 [ 4788.563696][ C0] ? lock_acquire+0x1c1/0x220 [ 4788.563948][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4788.564224][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4788.564489][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4788.564775][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4788.565056][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4788.565375][ C0] ? neigh_hh_output+0x348/0x590 [ 4788.565638][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4788.565917][ C0] ip_finish_output2+0x786/0x18e0 [ 4788.566190][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4788.566483][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4788.566834][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4788.567125][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4788.567392][ C0] ? __ip_finish_output+0x10f/0x770 [ 4788.567667][ C0] ip_output+0x16b/0x4f0 [ 4788.567891][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4788.568177][ C0] ? __pfx_ip_output+0x10/0x10 [ 4788.568433][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4788.568736][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4788.568998][ C0] ? ip_local_out+0x114/0x3b0 [ 4788.569251][ C0] __ip_queue_xmit+0x672/0x1910 [ 4788.569513][ C0] ? __skb_clone+0x57a/0x760 [ 4788.569765][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4788.570043][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4788.570335][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4788.570650][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4788.570910][ C0] ? tcp_current_mss+0x40a/0x510 [ 4788.571172][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4788.571454][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4788.571729][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4788.571979][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4788.572251][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4788.572571][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4788.572845][ C0] ? ktime_get+0xb6/0x190 [ 4788.573084][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4788.573358][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4788.573636][ C0] tcp_write_timer+0x82/0x1d0 [ 4788.573888][ C0] call_timer_fn+0x176/0x430 [ 4788.574138][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4788.574410][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4788.574684][ C0] __run_timers.part.0+0x52d/0x890 [ 4788.574955][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4788.575240][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4788.575536][ C0] ? lock_acquire+0x1c1/0x220 [ 4788.575786][ C0] ? clockevents_program_event+0xf6/0x300 [ 4788.576095][ C0] ? lock_release+0x1d5/0x250 [ 4788.576349][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4788.576628][ C0] ? ktime_get+0xb6/0x190 [ 4788.576862][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4788.577163][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4788.577471][ C0] run_timer_softirq+0x72/0x100 [ 4788.577731][ C0] __do_softirq+0x1bc/0x7ff [ 4788.577976][ C0] irq_exit_rcu+0x98/0xc0 [ 4788.578209][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4788.578509][ C0] [ 4788.578665][ C0] [ 4788.578821][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4788.579142][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4788.579412][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4788.580435][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4788.580761][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4788.581182][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4788.581605][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4788.582029][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4788.582453][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4788.582876][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4788.583190][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4788.583462][ C0] default_idle_call+0x69/0xa0 [ 4788.583718][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4788.583981][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4788.584277][ C0] ? lock_release+0x1d5/0x250 [ 4788.584528][ C0] do_idle+0xfb/0x160 [ 4788.584739][ C0] cpu_startup_entry+0x55/0x60 [ 4788.584991][ C0] rest_init+0x153/0x260 [ 4788.585222][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4788.585508][ C0] arch_call_rest_init+0x13/0x40 [ 4788.585773][ C0] start_kernel+0x314/0x3d0 [ 4788.586019][ C0] x86_64_start_reservations+0x18/0x30 [ 4788.586313][ C0] x86_64_start_kernel+0xba/0x110 [ 4788.586579][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4788.586903][ C0] [ 4788.587067][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3353s! [ksoftirqd/1:22] [ 4788.587533][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4788.588717][ C1] irq event stamp: 3886976 [ 4788.588952][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4788.589455][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4788.589954][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4788.590457][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4788.590946][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4788.591445][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4788.592088][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4788.592430][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4788.593456][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4788.593776][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4788.594194][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4788.594616][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4788.595035][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4788.595452][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4788.595867][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4788.596336][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4788.596685][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4788.597106][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4788.597529][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4788.597953][ C1] Call Trace: [ 4788.598135][ C1] [ 4788.598296][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4788.598571][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4788.598830][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4788.599120][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4788.599409][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4788.599712][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4788.599992][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4788.600317][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4788.600589][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4788.600915][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4788.601226][ C1] [ 4788.601383][ C1] [ 4788.601539][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4788.601865][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4788.602173][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4788.602482][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4788.602782][ C1] ? run_ksoftirqd+0xb/0x60 [ 4788.603029][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4788.603359][ C1] ? __orc_find+0x9c/0xf0 [ 4788.603589][ C1] ? lock_acquire+0x1c1/0x220 [ 4788.603839][ C1] ? irqentry_enter+0x2b/0x60 [ 4788.604091][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4788.604350][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4788.604632][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4788.604927][ C1] ? lock_acquire+0x1c1/0x220 [ 4788.605180][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4788.605436][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4788.605710][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4788.605954][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4788.606212][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4788.606482][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4788.606769][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4788.607061][ C1] ip_local_deliver+0x19d/0x480 [ 4788.607322][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4788.607608][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4788.607875][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4788.608152][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4788.608414][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4788.608752][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4788.609026][ C1] ip_rcv+0x564/0x740 [ 4788.609237][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4788.609476][ C1] ? set_track_prepare+0x8a/0xd0 [ 4788.609740][ C1] ? irqentry_enter+0x2b/0x60 [ 4788.609994][ C1] ? irqentry_enter+0x2b/0x60 [ 4788.610251][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4788.610495][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4788.610814][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4788.611156][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4788.611466][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4788.611804][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4788.612102][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4788.612436][ C1] netif_receive_skb+0x55/0x280 [ 4788.612696][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4788.613031][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4788.613376][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4788.613692][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4788.613979][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4788.614282][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4788.614608][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4788.614886][ C1] ? arch_stack_walk+0x68/0x100 [ 4788.615152][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4788.615430][ C1] ? irqentry_enter+0x2b/0x60 [ 4788.615683][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4788.616003][ C1] ? irqentry_enter+0x2b/0x60 [ 4788.616253][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4788.616576][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4788.616858][ C1] ? arch_stack_walk+0x68/0x100 [ 4788.617118][ C1] __tcf_classify+0x32c/0x7d0 [ 4788.617369][ C1] tcf_classify+0x283/0x930 [ 4788.617611][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4788.617879][ C1] tc_run+0x2e4/0x5d0 [ 4788.618092][ C1] ? __pfx_tc_run+0x10/0x10 [ 4788.618333][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4788.618596][ C1] ? irqentry_enter+0x2b/0x60 [ 4788.618850][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4788.619138][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4788.619464][ C1] ip_finish_output2+0x786/0x18e0 [ 4788.619733][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4788.620023][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4788.620289][ C1] ? __ip_finish_output+0x10f/0x770 [ 4788.620564][ C1] ip_output+0x16b/0x4f0 [ 4788.620789][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4788.621110][ C1] ? __pfx_ip_output+0x10/0x10 [ 4788.621363][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4788.621719][ C1] ? __pfx_ip_output+0x10/0x10 [ 4788.621977][ C1] __ip_queue_xmit+0x672/0x1910 [ 4788.622239][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4788.622517][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4788.622811][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4788.623101][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4788.623397][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4788.623684][ C1] tcp_delack_timer+0x84/0x240 [ 4788.623939][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4788.624221][ C1] call_timer_fn+0x176/0x430 [ 4788.624465][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4788.624740][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4788.625018][ C1] __run_timers.part.0+0x52d/0x890 [ 4788.625290][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4788.625576][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4788.625877][ C1] ? __pfx___schedule+0x10/0x10 [ 4788.626137][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4788.626454][ C1] run_timer_softirq+0x72/0x100 [ 4788.626720][ C1] __do_softirq+0x1bc/0x7ff [ 4788.626965][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4788.627242][ C1] run_ksoftirqd+0x2e/0x60 [ 4788.627481][ C1] smpboot_thread_fn+0x30e/0x840 [ 4788.627746][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4788.628034][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4788.628323][ C1] kthread+0x292/0x360 [ 4788.628541][ C1] ? __pfx_kthread+0x10/0x10 [ 4788.628789][ C1] ret_from_fork+0x34/0x70 [ 4788.629025][ C1] ? __pfx_kthread+0x10/0x10 [ 4788.629272][ C1] ret_from_fork_asm+0x1b/0x30 [ 4788.629527][ C1] [ 4812.192024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4812.192416][ C0] rcu: 0-....: (3613312 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=862996 [ 4812.192937][ C0] rcu: (t=3617883 jiffies g=1007429 q=31 ncpus=4) [ 4812.193281][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4812.193766][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4812.194407][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 4812.194749][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 4812.195787][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4812.196118][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4812.196544][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4812.196965][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4812.197386][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4812.197811][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4812.198236][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4812.198708][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4812.199058][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4812.199485][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4812.199905][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4812.200325][ C0] Call Trace: [ 4812.200503][ C0] [ 4812.200659][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4812.200952][ C0] ? print_cpu_stall+0x263/0x6a0 [ 4812.201214][ C0] ? check_cpu_stall+0x284/0x500 [ 4812.201481][ C0] ? rcu_pending+0x92/0x360 [ 4812.201722][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4812.202004][ C0] ? update_process_times+0xb9/0x110 [ 4812.202289][ C0] ? tick_sched_handle+0x67/0x130 [ 4812.202557][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4812.202861][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4812.203113][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4812.203442][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4812.203725][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4812.204024][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4812.204300][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4812.204617][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4812.204892][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4812.205168][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4812.205495][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4812.205808][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4812.206136][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4812.206444][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 4812.206749][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4812.207055][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4812.207383][ C0] ? get_stack_info+0x36/0xc0 [ 4812.207635][ C0] ? lock_acquire+0x1c1/0x220 [ 4812.207886][ C0] ? lock_release+0x1d5/0x250 [ 4812.208139][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4812.208398][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4812.208681][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4812.208982][ C0] ? lock_acquire+0x1c1/0x220 [ 4812.209234][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4812.209488][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4812.209764][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4812.210011][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4812.210270][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4812.210538][ C0] ? __inet_lookup_established+0x341/0x610 [ 4812.210851][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4812.211146][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4812.211440][ C0] ip_local_deliver+0x19d/0x480 [ 4812.211699][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4812.211981][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4812.212246][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4812.212526][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4812.212793][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4812.213136][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4812.213411][ C0] ip_rcv+0x564/0x740 [ 4812.213622][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4812.213863][ C0] ? set_track_prepare+0x8a/0xd0 [ 4812.214128][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4812.214420][ C0] ? rest_init+0x153/0x260 [ 4812.214657][ C0] ? skb_clone+0x10b/0x330 [ 4812.214900][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4812.215233][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4812.215552][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4812.215854][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4812.216164][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4812.216427][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4812.216672][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4812.216993][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4812.217296][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4812.217634][ C0] ? lock_acquire+0x1c1/0x220 [ 4812.217881][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4812.218190][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4812.218491][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4812.218821][ C0] ? __copy_skb_header+0xaf/0x490 [ 4812.219087][ C0] ? __skb_clone+0x57a/0x760 [ 4812.219333][ C0] netif_receive_skb+0x55/0x280 [ 4812.219599][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4812.219936][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4812.220286][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4812.220605][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4812.220890][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4812.221187][ C0] ? hlock_class+0x4e/0x130 [ 4812.221434][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4812.221763][ C0] ? place_entity+0x21/0x2f0 [ 4812.222010][ C0] ? resched_curr+0x219/0x280 [ 4812.222266][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4812.222535][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4812.222820][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4812.223111][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4812.223371][ C0] ? activate_task+0xf5/0x260 [ 4812.223624][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4812.223902][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4812.224173][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4812.224434][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4812.224728][ C0] ? get_stack_info+0x36/0xc0 [ 4812.224978][ C0] ? stack_access_ok+0xda/0x1f0 [ 4812.225236][ C0] ? get_reg+0x119/0x190 [ 4812.225462][ C0] __tcf_classify+0x32c/0x7d0 [ 4812.225715][ C0] tcf_classify+0x283/0x930 [ 4812.225960][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4812.226290][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4812.226554][ C0] ? arch_stack_walk+0x8c/0x100 [ 4812.226815][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4812.227104][ C0] tc_run+0x2e4/0x5d0 [ 4812.227319][ C0] ? __pfx_tc_run+0x10/0x10 [ 4812.227562][ C0] ? lock_acquire+0x1c1/0x220 [ 4812.227819][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4812.228095][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4812.228361][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4812.228648][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4812.228928][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4812.229248][ C0] ? neigh_hh_output+0x348/0x590 [ 4812.229511][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4812.229790][ C0] ip_finish_output2+0x786/0x18e0 [ 4812.230062][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4812.230358][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4812.230712][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4812.231003][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4812.231271][ C0] ? __ip_finish_output+0x10f/0x770 [ 4812.231546][ C0] ip_output+0x16b/0x4f0 [ 4812.231770][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4812.232054][ C0] ? __pfx_ip_output+0x10/0x10 [ 4812.232308][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4812.232612][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4812.232879][ C0] ? ip_local_out+0x114/0x3b0 [ 4812.233129][ C0] __ip_queue_xmit+0x672/0x1910 [ 4812.233388][ C0] ? __skb_clone+0x57a/0x760 [ 4812.233631][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4812.233915][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4812.234212][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4812.234535][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4812.234792][ C0] ? tcp_current_mss+0x40a/0x510 [ 4812.235056][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4812.235335][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4812.235613][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4812.235868][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4812.236134][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4812.236451][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4812.236730][ C0] ? ktime_get+0xb6/0x190 [ 4812.236964][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4812.237239][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4812.237518][ C0] tcp_write_timer+0x82/0x1d0 [ 4812.237771][ C0] call_timer_fn+0x176/0x430 [ 4812.238020][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4812.238294][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4812.238568][ C0] __run_timers.part.0+0x52d/0x890 [ 4812.238838][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4812.239124][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4812.239421][ C0] ? lock_acquire+0x1c1/0x220 [ 4812.239672][ C0] ? clockevents_program_event+0xf6/0x300 [ 4812.239981][ C0] ? lock_release+0x1d5/0x250 [ 4812.240236][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4812.240516][ C0] ? ktime_get+0xb6/0x190 [ 4812.240750][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4812.241056][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4812.241365][ C0] run_timer_softirq+0x72/0x100 [ 4812.241625][ C0] __do_softirq+0x1bc/0x7ff [ 4812.241872][ C0] irq_exit_rcu+0x98/0xc0 [ 4812.242106][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4812.242409][ C0] [ 4812.242566][ C0] [ 4812.242723][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4812.243052][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4812.243320][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4812.244337][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4812.244660][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4812.245078][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4812.245495][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4812.245913][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4812.246332][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4812.246751][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4812.247052][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4812.247324][ C0] default_idle_call+0x69/0xa0 [ 4812.247579][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4812.247842][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4812.248137][ C0] ? lock_release+0x1d5/0x250 [ 4812.248388][ C0] do_idle+0xfb/0x160 [ 4812.248601][ C0] cpu_startup_entry+0x55/0x60 [ 4812.248852][ C0] rest_init+0x153/0x260 [ 4812.249082][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4812.249370][ C0] arch_call_rest_init+0x13/0x40 [ 4812.249636][ C0] start_kernel+0x314/0x3d0 [ 4812.249880][ C0] x86_64_start_reservations+0x18/0x30 [ 4812.250176][ C0] x86_64_start_kernel+0xba/0x110 [ 4812.250442][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4812.250776][ C0] [ 4812.250940][ C0] Sending NMI from CPU 0 to CPUs 1: [ 4812.251230][ C1] NMI backtrace for cpu 1 [ 4812.251238][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4812.251243][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4812.251245][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 4812.251252][ C1] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 4812.251256][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [ 4812.251260][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4812.251262][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4812.251264][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4812.251266][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4812.251268][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4812.251270][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4812.251272][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4812.251276][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4812.251278][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4812.251280][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4812.251281][ C1] Call Trace: [ 4812.251285][ C1] [ 4812.251289][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 4812.251294][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4812.251298][ C1] ? nmi_handle+0x156/0x420 [ 4812.251304][ C1] ? default_do_nmi+0x41/0x100 [ 4812.251309][ C1] ? exc_nmi+0xf3/0x120 [ 4812.251312][ C1] ? end_repeat_nmi+0xf/0x60 [ 4812.251317][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4812.251323][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 4812.251325][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 4812.251328][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 4812.251331][ C1] [ 4812.251332][ C1] [ 4812.251334][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 4812.251337][ C1] ? run_ksoftirqd+0xb/0x60 [ 4812.251342][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4812.251345][ C1] ? __orc_find+0x9c/0xf0 [ 4812.251348][ C1] ? lock_acquire+0x1c1/0x220 [ 4812.251352][ C1] ? irqentry_enter+0x2b/0x60 [ 4812.251357][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4812.251361][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4812.251364][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4812.251367][ C1] ? lock_acquire+0x1c1/0x220 [ 4812.251369][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4812.251375][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4812.251378][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4812.251386][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4812.251389][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4812.251395][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4812.251402][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4812.251406][ C1] ip_local_deliver+0x19d/0x480 [ 4812.251409][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4812.251412][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4812.251417][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4812.251421][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4812.251424][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4812.251427][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4812.251437][ C1] ip_rcv+0x564/0x740 [ 4812.251441][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4812.251443][ C1] ? set_track_prepare+0x8a/0xd0 [ 4812.251449][ C1] ? irqentry_enter+0x2b/0x60 [ 4812.251452][ C1] ? irqentry_enter+0x2b/0x60 [ 4812.251456][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4812.251458][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4812.251463][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4812.251467][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4812.251469][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4812.251472][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4812.251475][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4812.251480][ C1] netif_receive_skb+0x55/0x280 [ 4812.251484][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4812.251493][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4812.251500][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4812.251507][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4812.251515][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4812.251527][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4812.251537][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4812.251539][ C1] ? arch_stack_walk+0x68/0x100 [ 4812.251545][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4812.251548][ C1] ? irqentry_enter+0x2b/0x60 [ 4812.251552][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4812.251557][ C1] ? irqentry_enter+0x2b/0x60 [ 4812.251560][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4812.251568][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4812.251570][ C1] ? arch_stack_walk+0x68/0x100 [ 4812.251574][ C1] __tcf_classify+0x32c/0x7d0 [ 4812.251579][ C1] tcf_classify+0x283/0x930 [ 4812.251584][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4812.251588][ C1] tc_run+0x2e4/0x5d0 [ 4812.251593][ C1] ? __pfx_tc_run+0x10/0x10 [ 4812.251598][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4812.251604][ C1] ? irqentry_enter+0x2b/0x60 [ 4812.251607][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4812.251610][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4812.251617][ C1] ip_finish_output2+0x786/0x18e0 [ 4812.251623][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4812.251625][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4812.251629][ C1] ? __ip_finish_output+0x10f/0x770 [ 4812.251633][ C1] ip_output+0x16b/0x4f0 [ 4812.251636][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4812.251640][ C1] ? __pfx_ip_output+0x10/0x10 [ 4812.251644][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4812.251651][ C1] ? __pfx_ip_output+0x10/0x10 [ 4812.251655][ C1] __ip_queue_xmit+0x672/0x1910 [ 4812.251661][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4812.251667][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4812.251672][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4812.251676][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4812.251680][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4812.251683][ C1] tcp_delack_timer+0x84/0x240 [ 4812.251686][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4812.251689][ C1] call_timer_fn+0x176/0x430 [ 4812.251694][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4812.251699][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4812.251703][ C1] __run_timers.part.0+0x52d/0x890 [ 4812.251706][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4812.251711][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4812.251716][ C1] ? __pfx___schedule+0x10/0x10 [ 4812.251720][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4812.251724][ C1] run_timer_softirq+0x72/0x100 [ 4812.251728][ C1] __do_softirq+0x1bc/0x7ff [ 4812.251732][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4812.251736][ C1] run_ksoftirqd+0x2e/0x60 [ 4812.251739][ C1] smpboot_thread_fn+0x30e/0x840 [ 4812.251744][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4812.251747][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4812.251750][ C1] kthread+0x292/0x360 [ 4812.251753][ C1] ? __pfx_kthread+0x10/0x10 [ 4812.251756][ C1] ret_from_fork+0x34/0x70 [ 4812.251758][ C1] ? __pfx_kthread+0x10/0x10 [ 4812.251760][ C1] ret_from_fork_asm+0x1b/0x30 [ 4812.251767][ C1] [ 4836.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3398s! [swapper/0:0] [ 4836.527916][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4836.529132][ C0] irq event stamp: 27567077 [ 4836.529381][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4836.529913][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4836.530385][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4836.530887][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4836.531379][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4836.531865][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4836.532516][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4836.532865][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4836.533882][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4836.534201][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4836.534619][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4836.535035][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4836.535450][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4836.535865][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4836.536284][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4836.536751][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4836.537105][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4836.537528][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4836.537952][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4836.538374][ C0] Call Trace: [ 4836.538552][ C0] [ 4836.538712][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4836.538987][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4836.539246][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4836.539536][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4836.539824][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4836.540130][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4836.540413][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4836.540738][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4836.541011][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4836.541293][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4836.541617][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4836.541930][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4836.542266][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4836.542568][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4836.542882][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4836.543183][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4836.543506][ C0] ? get_stack_info+0x36/0xc0 [ 4836.543760][ C0] ? lock_acquire+0x1c1/0x220 [ 4836.544013][ C0] ? lock_release+0x1d5/0x250 [ 4836.544267][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4836.544530][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4836.544823][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4836.545127][ C0] ? lock_acquire+0x1c1/0x220 [ 4836.545376][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4836.545630][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4836.545903][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4836.546153][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4836.546414][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4836.546687][ C0] ? __inet_lookup_established+0x341/0x610 [ 4836.547005][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4836.547294][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4836.547582][ C0] ip_local_deliver+0x19d/0x480 [ 4836.547848][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4836.548138][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4836.548408][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4836.548684][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4836.548946][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4836.549286][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4836.549560][ C0] ip_rcv+0x564/0x740 [ 4836.549771][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4836.550012][ C0] ? set_track_prepare+0x8a/0xd0 [ 4836.550275][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4836.550565][ C0] ? rest_init+0x153/0x260 [ 4836.550799][ C0] ? skb_clone+0x10b/0x330 [ 4836.551048][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4836.551382][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4836.551700][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4836.551998][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4836.552317][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4836.552583][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4836.552832][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4836.553144][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4836.553443][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4836.553785][ C0] ? lock_acquire+0x1c1/0x220 [ 4836.554037][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4836.554349][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4836.554649][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4836.554984][ C0] ? __copy_skb_header+0xaf/0x490 [ 4836.555255][ C0] ? __skb_clone+0x57a/0x760 [ 4836.555502][ C0] netif_receive_skb+0x55/0x280 [ 4836.555758][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4836.556084][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4836.556431][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4836.556748][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4836.557037][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4836.557335][ C0] ? hlock_class+0x4e/0x130 [ 4836.557579][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4836.557909][ C0] ? place_entity+0x21/0x2f0 [ 4836.558155][ C0] ? resched_curr+0x219/0x280 [ 4836.558411][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4836.558684][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4836.558968][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4836.559246][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4836.559504][ C0] ? activate_task+0xf5/0x260 [ 4836.559756][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4836.560031][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4836.560308][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4836.560564][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4836.560853][ C0] ? get_stack_info+0x36/0xc0 [ 4836.561109][ C0] ? stack_access_ok+0xda/0x1f0 [ 4836.561372][ C0] ? get_reg+0x119/0x190 [ 4836.561599][ C0] __tcf_classify+0x32c/0x7d0 [ 4836.561848][ C0] tcf_classify+0x283/0x930 [ 4836.562088][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4836.562421][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4836.562690][ C0] ? arch_stack_walk+0x8c/0x100 [ 4836.562959][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4836.563250][ C0] tc_run+0x2e4/0x5d0 [ 4836.563468][ C0] ? __pfx_tc_run+0x10/0x10 [ 4836.563714][ C0] ? lock_acquire+0x1c1/0x220 [ 4836.563968][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4836.564243][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4836.564510][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4836.564799][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4836.565079][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4836.565400][ C0] ? neigh_hh_output+0x348/0x590 [ 4836.565668][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4836.565949][ C0] ip_finish_output2+0x786/0x18e0 [ 4836.566222][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4836.566522][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4836.566874][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4836.567165][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4836.567439][ C0] ? __ip_finish_output+0x10f/0x770 [ 4836.567716][ C0] ip_output+0x16b/0x4f0 [ 4836.567942][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4836.568232][ C0] ? __pfx_ip_output+0x10/0x10 [ 4836.568484][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4836.568790][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4836.569058][ C0] ? ip_local_out+0x114/0x3b0 [ 4836.569313][ C0] __ip_queue_xmit+0x672/0x1910 [ 4836.569580][ C0] ? __skb_clone+0x57a/0x760 [ 4836.569829][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4836.570110][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4836.570405][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4836.570726][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4836.570987][ C0] ? tcp_current_mss+0x40a/0x510 [ 4836.571250][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4836.571537][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4836.571811][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4836.572065][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4836.572336][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4836.572657][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4836.572942][ C0] ? ktime_get+0xb6/0x190 [ 4836.573177][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4836.573453][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4836.573732][ C0] tcp_write_timer+0x82/0x1d0 [ 4836.573986][ C0] call_timer_fn+0x176/0x430 [ 4836.574237][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4836.574510][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4836.574789][ C0] __run_timers.part.0+0x52d/0x890 [ 4836.575064][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4836.575350][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4836.575648][ C0] ? lock_acquire+0x1c1/0x220 [ 4836.575899][ C0] ? clockevents_program_event+0xf6/0x300 [ 4836.576207][ C0] ? lock_release+0x1d5/0x250 [ 4836.576461][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4836.576740][ C0] ? ktime_get+0xb6/0x190 [ 4836.576975][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4836.577275][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4836.577585][ C0] run_timer_softirq+0x72/0x100 [ 4836.577848][ C0] __do_softirq+0x1bc/0x7ff [ 4836.578096][ C0] irq_exit_rcu+0x98/0xc0 [ 4836.578328][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4836.578631][ C0] [ 4836.578788][ C0] [ 4836.578945][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4836.579265][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4836.579538][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4836.580563][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4836.580894][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4836.581322][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4836.581745][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4836.582172][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4836.582599][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4836.583029][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4836.583332][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4836.583604][ C0] default_idle_call+0x69/0xa0 [ 4836.583861][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4836.584124][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4836.584421][ C0] ? lock_release+0x1d5/0x250 [ 4836.584675][ C0] do_idle+0xfb/0x160 [ 4836.584889][ C0] cpu_startup_entry+0x55/0x60 [ 4836.585145][ C0] rest_init+0x153/0x260 [ 4836.585373][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4836.585662][ C0] arch_call_rest_init+0x13/0x40 [ 4836.585929][ C0] start_kernel+0x314/0x3d0 [ 4836.586181][ C0] x86_64_start_reservations+0x18/0x30 [ 4836.586477][ C0] x86_64_start_kernel+0xba/0x110 [ 4836.586745][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4836.587069][ C0] [ 4836.587233][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3398s! [ksoftirqd/1:22] [ 4836.587703][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4836.588903][ C1] irq event stamp: 3886976 [ 4836.589139][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4836.589642][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4836.590142][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4836.590646][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4836.591136][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4836.591639][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4836.592294][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4836.592639][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4836.593668][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4836.593995][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4836.594414][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4836.594834][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4836.595252][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4836.595669][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4836.596089][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4836.596560][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4836.596913][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4836.597333][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4836.597753][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4836.598179][ C1] Call Trace: [ 4836.598364][ C1] [ 4836.598521][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4836.598798][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4836.599056][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4836.599349][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4836.599640][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4836.599950][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4836.600239][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4836.600562][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4836.600839][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4836.601172][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4836.601485][ C1] [ 4836.601641][ C1] [ 4836.601798][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4836.602131][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4836.602438][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4836.602759][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4836.603070][ C1] ? run_ksoftirqd+0xb/0x60 [ 4836.603317][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4836.603649][ C1] ? __orc_find+0x9c/0xf0 [ 4836.603879][ C1] ? lock_acquire+0x1c1/0x220 [ 4836.604136][ C1] ? irqentry_enter+0x2b/0x60 [ 4836.604389][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4836.604651][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4836.604940][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4836.605239][ C1] ? lock_acquire+0x1c1/0x220 [ 4836.605491][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4836.605746][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4836.606025][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4836.606273][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4836.606533][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4836.606803][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4836.607091][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4836.607381][ C1] ip_local_deliver+0x19d/0x480 [ 4836.607647][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4836.607937][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4836.608207][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4836.608486][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4836.608750][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4836.609090][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4836.609365][ C1] ip_rcv+0x564/0x740 [ 4836.609577][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4836.609819][ C1] ? set_track_prepare+0x8a/0xd0 [ 4836.610084][ C1] ? irqentry_enter+0x2b/0x60 [ 4836.610338][ C1] ? irqentry_enter+0x2b/0x60 [ 4836.610592][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4836.610840][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4836.611162][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4836.611507][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4836.611819][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4836.612159][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4836.612459][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4836.612801][ C1] netif_receive_skb+0x55/0x280 [ 4836.613063][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4836.613391][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4836.613740][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4836.614058][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4836.614346][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4836.614648][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4836.614976][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4836.615256][ C1] ? arch_stack_walk+0x68/0x100 [ 4836.615521][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4836.615802][ C1] ? irqentry_enter+0x2b/0x60 [ 4836.616057][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4836.616383][ C1] ? irqentry_enter+0x2b/0x60 [ 4836.616636][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4836.616960][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4836.617245][ C1] ? arch_stack_walk+0x68/0x100 [ 4836.617505][ C1] __tcf_classify+0x32c/0x7d0 [ 4836.617759][ C1] tcf_classify+0x283/0x930 [ 4836.618004][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4836.618274][ C1] tc_run+0x2e4/0x5d0 [ 4836.618489][ C1] ? __pfx_tc_run+0x10/0x10 [ 4836.618737][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4836.619004][ C1] ? irqentry_enter+0x2b/0x60 [ 4836.619256][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4836.619544][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4836.619871][ C1] ip_finish_output2+0x786/0x18e0 [ 4836.620142][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4836.620434][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4836.620703][ C1] ? __ip_finish_output+0x10f/0x770 [ 4836.620982][ C1] ip_output+0x16b/0x4f0 [ 4836.621210][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4836.621534][ C1] ? __pfx_ip_output+0x10/0x10 [ 4836.621791][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4836.622150][ C1] ? __pfx_ip_output+0x10/0x10 [ 4836.622412][ C1] __ip_queue_xmit+0x672/0x1910 [ 4836.622675][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4836.622963][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4836.623268][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4836.623560][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4836.623860][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4836.624151][ C1] tcp_delack_timer+0x84/0x240 [ 4836.624412][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4836.624697][ C1] call_timer_fn+0x176/0x430 [ 4836.624944][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4836.625224][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4836.625502][ C1] __run_timers.part.0+0x52d/0x890 [ 4836.625775][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4836.626066][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4836.626369][ C1] ? __pfx___schedule+0x10/0x10 [ 4836.626629][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4836.626948][ C1] run_timer_softirq+0x72/0x100 [ 4836.627213][ C1] __do_softirq+0x1bc/0x7ff [ 4836.627459][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4836.627736][ C1] run_ksoftirqd+0x2e/0x60 [ 4836.627975][ C1] smpboot_thread_fn+0x30e/0x840 [ 4836.628250][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4836.628542][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4836.628835][ C1] kthread+0x292/0x360 [ 4836.629055][ C1] ? __pfx_kthread+0x10/0x10 [ 4836.629306][ C1] ret_from_fork+0x34/0x70 [ 4836.629543][ C1] ? __pfx_kthread+0x10/0x10 [ 4836.629792][ C1] ret_from_fork_asm+0x1b/0x30 [ 4836.630055][ C1] [ 4864.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3424s! [swapper/0:0] [ 4864.527932][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4864.529137][ C0] irq event stamp: 27567077 [ 4864.529380][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4864.529910][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4864.530382][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4864.530880][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4864.531371][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4864.531851][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4864.532497][ C0] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 4864.532814][ C0] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 4864.533839][ C0] RSP: 0018:ffffc900000069c8 EFLAGS: 00000202 [ 4864.534165][ C0] RAX: ffff88800a099b58 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4864.534590][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4864.535011][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4864.535433][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4864.535857][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4864.536282][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4864.536754][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4864.537105][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4864.537534][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4864.537953][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4864.538371][ C0] Call Trace: [ 4864.538548][ C0] [ 4864.538705][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4864.538984][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4864.539240][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4864.539531][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4864.539814][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4864.540115][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4864.540391][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4864.540710][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4864.540986][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4864.541260][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4864.541588][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4864.541905][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4864.542233][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4864.542541][ C0] ? kasan_check_range+0x12/0x1c0 [ 4864.542821][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 4864.543113][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4864.543437][ C0] ? get_stack_info+0x36/0xc0 [ 4864.543692][ C0] ? lock_acquire+0x1c1/0x220 [ 4864.543946][ C0] ? lock_release+0x1d5/0x250 [ 4864.544200][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4864.544464][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4864.544752][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4864.545059][ C0] ? lock_acquire+0x1c1/0x220 [ 4864.545309][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4864.545563][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4864.545835][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4864.546088][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4864.546350][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4864.546624][ C0] ? __inet_lookup_established+0x341/0x610 [ 4864.546939][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4864.547229][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4864.547518][ C0] ip_local_deliver+0x19d/0x480 [ 4864.547789][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4864.548078][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4864.548346][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4864.548622][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4864.548885][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4864.549230][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4864.549504][ C0] ip_rcv+0x564/0x740 [ 4864.549716][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4864.549958][ C0] ? set_track_prepare+0x8a/0xd0 [ 4864.550222][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4864.550513][ C0] ? rest_init+0x153/0x260 [ 4864.550749][ C0] ? skb_clone+0x10b/0x330 [ 4864.550992][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4864.551328][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4864.551646][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4864.551945][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4864.552261][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4864.552526][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4864.552776][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4864.553090][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4864.553388][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4864.553736][ C0] ? lock_acquire+0x1c1/0x220 [ 4864.553989][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4864.554302][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4864.554601][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4864.554935][ C0] ? __copy_skb_header+0xaf/0x490 [ 4864.555207][ C0] ? __skb_clone+0x57a/0x760 [ 4864.555455][ C0] netif_receive_skb+0x55/0x280 [ 4864.555712][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4864.556037][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4864.556388][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4864.556704][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4864.556992][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4864.557292][ C0] ? hlock_class+0x4e/0x130 [ 4864.557537][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4864.557865][ C0] ? place_entity+0x21/0x2f0 [ 4864.558112][ C0] ? resched_curr+0x219/0x280 [ 4864.558368][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4864.558639][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4864.558924][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4864.559203][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4864.559461][ C0] ? activate_task+0xf5/0x260 [ 4864.559713][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4864.559988][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4864.560265][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4864.560526][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4864.560814][ C0] ? get_stack_info+0x36/0xc0 [ 4864.561076][ C0] ? stack_access_ok+0xda/0x1f0 [ 4864.561340][ C0] ? get_reg+0x119/0x190 [ 4864.561567][ C0] __tcf_classify+0x32c/0x7d0 [ 4864.561820][ C0] tcf_classify+0x283/0x930 [ 4864.562061][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4864.562389][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4864.562666][ C0] ? arch_stack_walk+0x8c/0x100 [ 4864.562926][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4864.563222][ C0] tc_run+0x2e4/0x5d0 [ 4864.563440][ C0] ? __pfx_tc_run+0x10/0x10 [ 4864.563687][ C0] ? lock_acquire+0x1c1/0x220 [ 4864.563942][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4864.564218][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4864.564483][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4864.564773][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4864.565055][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4864.565377][ C0] ? neigh_hh_output+0x348/0x590 [ 4864.565639][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4864.565919][ C0] ip_finish_output2+0x786/0x18e0 [ 4864.566193][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4864.566493][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4864.566843][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4864.567136][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4864.567405][ C0] ? __ip_finish_output+0x10f/0x770 [ 4864.567682][ C0] ip_output+0x16b/0x4f0 [ 4864.567908][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4864.568192][ C0] ? __pfx_ip_output+0x10/0x10 [ 4864.568445][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4864.568747][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4864.569012][ C0] ? ip_local_out+0x114/0x3b0 [ 4864.569265][ C0] __ip_queue_xmit+0x672/0x1910 [ 4864.569527][ C0] ? __skb_clone+0x57a/0x760 [ 4864.569776][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4864.570056][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4864.570352][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4864.570671][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4864.570931][ C0] ? tcp_current_mss+0x40a/0x510 [ 4864.571194][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4864.571477][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4864.571752][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4864.572006][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4864.572276][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4864.572603][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4864.572883][ C0] ? ktime_get+0xb6/0x190 [ 4864.573120][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4864.573397][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4864.573676][ C0] tcp_write_timer+0x82/0x1d0 [ 4864.573933][ C0] call_timer_fn+0x176/0x430 [ 4864.574182][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4864.574462][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4864.574740][ C0] __run_timers.part.0+0x52d/0x890 [ 4864.575012][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4864.575297][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4864.575595][ C0] ? lock_acquire+0x1c1/0x220 [ 4864.575846][ C0] ? clockevents_program_event+0xf6/0x300 [ 4864.576155][ C0] ? lock_release+0x1d5/0x250 [ 4864.576408][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4864.576687][ C0] ? ktime_get+0xb6/0x190 [ 4864.576920][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4864.577223][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4864.577533][ C0] run_timer_softirq+0x72/0x100 [ 4864.577799][ C0] __do_softirq+0x1bc/0x7ff [ 4864.578046][ C0] irq_exit_rcu+0x98/0xc0 [ 4864.578279][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4864.578582][ C0] [ 4864.578738][ C0] [ 4864.578898][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4864.579218][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4864.579491][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4864.580518][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4864.580846][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4864.581269][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4864.581691][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4864.582115][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4864.582538][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4864.582963][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4864.583264][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4864.583534][ C0] default_idle_call+0x69/0xa0 [ 4864.583789][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4864.584050][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4864.584345][ C0] ? lock_release+0x1d5/0x250 [ 4864.584596][ C0] do_idle+0xfb/0x160 [ 4864.584810][ C0] cpu_startup_entry+0x55/0x60 [ 4864.585068][ C0] rest_init+0x153/0x260 [ 4864.585296][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4864.585583][ C0] arch_call_rest_init+0x13/0x40 [ 4864.585849][ C0] start_kernel+0x314/0x3d0 [ 4864.586097][ C0] x86_64_start_reservations+0x18/0x30 [ 4864.586392][ C0] x86_64_start_kernel+0xba/0x110 [ 4864.586660][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4864.586984][ C0] [ 4864.587149][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3424s! [ksoftirqd/1:22] [ 4864.587617][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4864.588822][ C1] irq event stamp: 3886976 [ 4864.589062][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4864.589558][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4864.590050][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4864.590548][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4864.591044][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4864.591538][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4864.592184][ C1] RIP: 0010:kasan_check_range+0x156/0x1c0 [ 4864.592495][ C1] Code: d0 74 11 80 38 00 74 ef 4d 8d 1c 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea 09 48 83 c0 01 48 39 d0 74 a5 80 38 00 74 f2 e9 74 ff ff ff b8 [ 4864.593529][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000282 [ 4864.593856][ C1] RAX: ffffed10014131c3 RBX: ffffed10014131c4 RCX: ffffffff90c7aaa0 [ 4864.594283][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4864.594709][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: ffffed10014131c3 [ 4864.595135][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4864.595557][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4864.595981][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4864.596460][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4864.596809][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4864.597241][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4864.597664][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4864.598086][ C1] Call Trace: [ 4864.598264][ C1] [ 4864.598421][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4864.598701][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4864.598957][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4864.599251][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4864.599536][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4864.599836][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4864.600114][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4864.600437][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4864.600714][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4864.601036][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4864.601346][ C1] [ 4864.601507][ C1] [ 4864.601669][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4864.602003][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4864.602306][ C1] ? kasan_check_range+0x156/0x1c0 [ 4864.602583][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 4864.602883][ C1] ? run_ksoftirqd+0xb/0x60 [ 4864.603128][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4864.603452][ C1] ? __orc_find+0x9c/0xf0 [ 4864.603688][ C1] ? lock_acquire+0x1c1/0x220 [ 4864.603943][ C1] ? irqentry_enter+0x2b/0x60 [ 4864.604200][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4864.604462][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4864.604750][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4864.605054][ C1] ? lock_acquire+0x1c1/0x220 [ 4864.605305][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4864.605558][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4864.605830][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4864.606081][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4864.606343][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4864.606622][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4864.606915][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4864.607210][ C1] ip_local_deliver+0x19d/0x480 [ 4864.607470][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4864.607754][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4864.608019][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4864.608300][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4864.608566][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4864.608903][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4864.609181][ C1] ip_rcv+0x564/0x740 [ 4864.609399][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4864.609644][ C1] ? set_track_prepare+0x8a/0xd0 [ 4864.609911][ C1] ? irqentry_enter+0x2b/0x60 [ 4864.610163][ C1] ? irqentry_enter+0x2b/0x60 [ 4864.610414][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4864.610654][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4864.610967][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4864.611308][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4864.611617][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4864.611961][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4864.612263][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4864.612600][ C1] netif_receive_skb+0x55/0x280 [ 4864.612862][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4864.613196][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4864.613548][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4864.613864][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4864.614159][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4864.614466][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4864.614803][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4864.615091][ C1] ? arch_stack_walk+0x68/0x100 [ 4864.615353][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4864.615631][ C1] ? irqentry_enter+0x2b/0x60 [ 4864.615883][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4864.616203][ C1] ? irqentry_enter+0x2b/0x60 [ 4864.616457][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4864.616785][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4864.617069][ C1] ? arch_stack_walk+0x68/0x100 [ 4864.617333][ C1] __tcf_classify+0x32c/0x7d0 [ 4864.617589][ C1] tcf_classify+0x283/0x930 [ 4864.617837][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4864.618112][ C1] tc_run+0x2e4/0x5d0 [ 4864.618332][ C1] ? __pfx_tc_run+0x10/0x10 [ 4864.618580][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4864.618852][ C1] ? irqentry_enter+0x2b/0x60 [ 4864.619106][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4864.619393][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4864.619715][ C1] ip_finish_output2+0x786/0x18e0 [ 4864.619991][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4864.620285][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4864.620551][ C1] ? __ip_finish_output+0x10f/0x770 [ 4864.620833][ C1] ip_output+0x16b/0x4f0 [ 4864.621064][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4864.621382][ C1] ? __pfx_ip_output+0x10/0x10 [ 4864.621641][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4864.621993][ C1] ? __pfx_ip_output+0x10/0x10 [ 4864.622252][ C1] __ip_queue_xmit+0x672/0x1910 [ 4864.622517][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4864.622806][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4864.623103][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4864.623387][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4864.623681][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4864.623965][ C1] tcp_delack_timer+0x84/0x240 [ 4864.624221][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4864.624511][ C1] call_timer_fn+0x176/0x430 [ 4864.624761][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4864.625037][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4864.625320][ C1] __run_timers.part.0+0x52d/0x890 [ 4864.625595][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4864.625881][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4864.626183][ C1] ? __pfx___schedule+0x10/0x10 [ 4864.626446][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4864.626771][ C1] run_timer_softirq+0x72/0x100 [ 4864.627033][ C1] __do_softirq+0x1bc/0x7ff [ 4864.627278][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4864.627551][ C1] run_ksoftirqd+0x2e/0x60 [ 4864.627792][ C1] smpboot_thread_fn+0x30e/0x840 [ 4864.628057][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4864.628351][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4864.628640][ C1] kthread+0x292/0x360 [ 4864.628863][ C1] ? __pfx_kthread+0x10/0x10 [ 4864.629112][ C1] ret_from_fork+0x34/0x70 [ 4864.629353][ C1] ? __pfx_kthread+0x10/0x10 [ 4864.629598][ C1] ret_from_fork_asm+0x1b/0x30 [ 4864.629859][ C1] [ 4890.255024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4890.255414][ C0] rcu: 0-....: (3691198 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=881076 [ 4890.255934][ C0] rcu: (t=3695946 jiffies g=1007429 q=31 ncpus=4) [ 4890.256279][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4890.256764][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4890.257407][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4890.257752][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4890.258774][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4890.259097][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4890.259518][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4890.259938][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4890.260356][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4890.260774][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4890.261192][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4890.261660][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4890.262012][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4890.262437][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4890.262882][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4890.263302][ C0] Call Trace: [ 4890.263480][ C0] [ 4890.263636][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4890.263925][ C0] ? print_cpu_stall+0x263/0x6a0 [ 4890.264188][ C0] ? check_cpu_stall+0x284/0x500 [ 4890.264454][ C0] ? rcu_pending+0x92/0x360 [ 4890.264693][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4890.264978][ C0] ? update_process_times+0xb9/0x110 [ 4890.265264][ C0] ? tick_sched_handle+0x67/0x130 [ 4890.265531][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4890.265830][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4890.266085][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4890.266411][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4890.266698][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4890.267001][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4890.267284][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4890.267609][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4890.267882][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4890.268162][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4890.268486][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4890.268794][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4890.269130][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4890.269433][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4890.269740][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4890.270045][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4890.270372][ C0] ? get_stack_info+0x36/0xc0 [ 4890.270623][ C0] ? lock_acquire+0x1c1/0x220 [ 4890.270872][ C0] ? lock_release+0x1d5/0x250 [ 4890.271119][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4890.271379][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4890.271663][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4890.271960][ C0] ? lock_acquire+0x1c1/0x220 [ 4890.272212][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4890.272473][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4890.272745][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4890.272994][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4890.273256][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4890.273528][ C0] ? __inet_lookup_established+0x341/0x610 [ 4890.273842][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4890.274129][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4890.274417][ C0] ip_local_deliver+0x19d/0x480 [ 4890.274685][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4890.274973][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4890.275245][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4890.275520][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4890.275782][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4890.276119][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4890.276393][ C0] ip_rcv+0x564/0x740 [ 4890.276604][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4890.276843][ C0] ? set_track_prepare+0x8a/0xd0 [ 4890.277105][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4890.277394][ C0] ? rest_init+0x153/0x260 [ 4890.277628][ C0] ? skb_clone+0x10b/0x330 [ 4890.277871][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4890.278204][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4890.278521][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4890.278819][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4890.279132][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4890.279392][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4890.279634][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4890.279952][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4890.280253][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4890.280591][ C0] ? lock_acquire+0x1c1/0x220 [ 4890.280838][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4890.281147][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4890.281450][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4890.281779][ C0] ? __copy_skb_header+0xaf/0x490 [ 4890.282045][ C0] ? __skb_clone+0x57a/0x760 [ 4890.282287][ C0] netif_receive_skb+0x55/0x280 [ 4890.282554][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4890.282878][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4890.283226][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4890.283541][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4890.283828][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4890.284127][ C0] ? hlock_class+0x4e/0x130 [ 4890.284369][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4890.284697][ C0] ? place_entity+0x21/0x2f0 [ 4890.284946][ C0] ? resched_curr+0x219/0x280 [ 4890.285201][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4890.285472][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4890.285756][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4890.286032][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4890.286290][ C0] ? activate_task+0xf5/0x260 [ 4890.286539][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4890.286814][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4890.287090][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4890.287346][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4890.287633][ C0] ? get_stack_info+0x36/0xc0 [ 4890.287887][ C0] ? stack_access_ok+0xda/0x1f0 [ 4890.288151][ C0] ? get_reg+0x119/0x190 [ 4890.288378][ C0] __tcf_classify+0x32c/0x7d0 [ 4890.288626][ C0] tcf_classify+0x283/0x930 [ 4890.288865][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4890.289191][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4890.289459][ C0] ? arch_stack_walk+0x8c/0x100 [ 4890.289725][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4890.290018][ C0] tc_run+0x2e4/0x5d0 [ 4890.290231][ C0] ? __pfx_tc_run+0x10/0x10 [ 4890.290470][ C0] ? lock_acquire+0x1c1/0x220 [ 4890.290719][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4890.290994][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4890.291268][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4890.291553][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4890.291831][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4890.292149][ C0] ? neigh_hh_output+0x348/0x590 [ 4890.292416][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4890.292701][ C0] ip_finish_output2+0x786/0x18e0 [ 4890.292973][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4890.293271][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4890.293622][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4890.293910][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4890.294180][ C0] ? __ip_finish_output+0x10f/0x770 [ 4890.294459][ C0] ip_output+0x16b/0x4f0 [ 4890.294685][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4890.294969][ C0] ? __pfx_ip_output+0x10/0x10 [ 4890.295221][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4890.295524][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4890.295787][ C0] ? ip_local_out+0x114/0x3b0 [ 4890.296041][ C0] __ip_queue_xmit+0x672/0x1910 [ 4890.296304][ C0] ? __skb_clone+0x57a/0x760 [ 4890.296558][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4890.296838][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4890.297134][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4890.297459][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4890.297721][ C0] ? tcp_current_mss+0x40a/0x510 [ 4890.297983][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4890.298267][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4890.298542][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4890.298795][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4890.299065][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4890.299388][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4890.299662][ C0] ? ktime_get+0xb6/0x190 [ 4890.299892][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4890.300165][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4890.300448][ C0] tcp_write_timer+0x82/0x1d0 [ 4890.300697][ C0] call_timer_fn+0x176/0x430 [ 4890.300941][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4890.301219][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4890.301490][ C0] __run_timers.part.0+0x52d/0x890 [ 4890.301765][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4890.302050][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4890.302351][ C0] ? lock_acquire+0x1c1/0x220 [ 4890.302607][ C0] ? clockevents_program_event+0xf6/0x300 [ 4890.302916][ C0] ? lock_release+0x1d5/0x250 [ 4890.303171][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4890.303451][ C0] ? ktime_get+0xb6/0x190 [ 4890.303685][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4890.303983][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4890.304294][ C0] run_timer_softirq+0x72/0x100 [ 4890.304557][ C0] __do_softirq+0x1bc/0x7ff [ 4890.304804][ C0] irq_exit_rcu+0x98/0xc0 [ 4890.305037][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4890.305341][ C0] [ 4890.305497][ C0] [ 4890.305653][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4890.305972][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4890.306245][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4890.307270][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4890.307598][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4890.308018][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4890.308441][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4890.308866][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4890.309296][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4890.309718][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4890.310023][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4890.310302][ C0] default_idle_call+0x69/0xa0 [ 4890.310554][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4890.310820][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4890.311115][ C0] ? lock_release+0x1d5/0x250 [ 4890.311376][ C0] do_idle+0xfb/0x160 [ 4890.311591][ C0] cpu_startup_entry+0x55/0x60 [ 4890.311847][ C0] rest_init+0x153/0x260 [ 4890.312074][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4890.312368][ C0] arch_call_rest_init+0x13/0x40 [ 4890.312642][ C0] start_kernel+0x314/0x3d0 [ 4890.312890][ C0] x86_64_start_reservations+0x18/0x30 [ 4890.313187][ C0] x86_64_start_kernel+0xba/0x110 [ 4890.313455][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4890.313779][ C0] [ 4890.313943][ C0] Sending NMI from CPU 0 to CPUs 1: [ 4890.314235][ C1] NMI backtrace for cpu 1 [ 4890.314244][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4890.314248][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4890.314251][ C1] RIP: 0010:__kasan_check_read+0x8/0x20 [ 4890.314259][ C1] Code: 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 48 8b 0c 24 <89> f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f [ 4890.314262][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [ 4890.314265][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4890.314267][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4890.314269][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4890.314271][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4890.314273][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4890.314275][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4890.314277][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4890.314280][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4890.314282][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4890.314284][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4890.314285][ C1] Call Trace: [ 4890.314289][ C1] [ 4890.314292][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 4890.314298][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4890.314302][ C1] ? nmi_handle+0x156/0x420 [ 4890.314308][ C1] ? default_do_nmi+0x41/0x100 [ 4890.314312][ C1] ? exc_nmi+0xf3/0x120 [ 4890.314315][ C1] ? end_repeat_nmi+0xf/0x60 [ 4890.314320][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4890.314325][ C1] ? __kasan_check_read+0x8/0x20 [ 4890.314328][ C1] ? __kasan_check_read+0x8/0x20 [ 4890.314330][ C1] ? __kasan_check_read+0x8/0x20 [ 4890.314333][ C1] [ 4890.314334][ C1] [ 4890.314335][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 4890.314338][ C1] ? run_ksoftirqd+0xb/0x60 [ 4890.314343][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4890.314346][ C1] ? __orc_find+0x9c/0xf0 [ 4890.314349][ C1] ? lock_acquire+0x1c1/0x220 [ 4890.314353][ C1] ? irqentry_enter+0x2b/0x60 [ 4890.314358][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4890.314362][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4890.314364][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4890.314368][ C1] ? lock_acquire+0x1c1/0x220 [ 4890.314370][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4890.314375][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4890.314378][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4890.314386][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4890.314389][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4890.314395][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4890.314401][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4890.314405][ C1] ip_local_deliver+0x19d/0x480 [ 4890.314408][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4890.314411][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4890.314416][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4890.314420][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4890.314423][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4890.314426][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4890.314436][ C1] ip_rcv+0x564/0x740 [ 4890.314439][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4890.314442][ C1] ? set_track_prepare+0x8a/0xd0 [ 4890.314447][ C1] ? irqentry_enter+0x2b/0x60 [ 4890.314450][ C1] ? irqentry_enter+0x2b/0x60 [ 4890.314454][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4890.314457][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4890.314461][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4890.314465][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4890.314468][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4890.314470][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4890.314473][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4890.314478][ C1] netif_receive_skb+0x55/0x280 [ 4890.314482][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4890.314491][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4890.314498][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4890.314504][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4890.314512][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4890.314524][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4890.314534][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4890.314537][ C1] ? arch_stack_walk+0x68/0x100 [ 4890.314542][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4890.314545][ C1] ? irqentry_enter+0x2b/0x60 [ 4890.314549][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4890.314553][ C1] ? irqentry_enter+0x2b/0x60 [ 4890.314557][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4890.314564][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4890.314566][ C1] ? arch_stack_walk+0x68/0x100 [ 4890.314571][ C1] __tcf_classify+0x32c/0x7d0 [ 4890.314576][ C1] tcf_classify+0x283/0x930 [ 4890.314579][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4890.314584][ C1] tc_run+0x2e4/0x5d0 [ 4890.314588][ C1] ? __pfx_tc_run+0x10/0x10 [ 4890.314593][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4890.314599][ C1] ? irqentry_enter+0x2b/0x60 [ 4890.314602][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4890.314605][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4890.314612][ C1] ip_finish_output2+0x786/0x18e0 [ 4890.314618][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4890.314620][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4890.314624][ C1] ? __ip_finish_output+0x10f/0x770 [ 4890.314628][ C1] ip_output+0x16b/0x4f0 [ 4890.314631][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4890.314635][ C1] ? __pfx_ip_output+0x10/0x10 [ 4890.314639][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4890.314646][ C1] ? __pfx_ip_output+0x10/0x10 [ 4890.314651][ C1] __ip_queue_xmit+0x672/0x1910 [ 4890.314657][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4890.314663][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4890.314668][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4890.314672][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4890.314677][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4890.314680][ C1] tcp_delack_timer+0x84/0x240 [ 4890.314683][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4890.314686][ C1] call_timer_fn+0x176/0x430 [ 4890.314691][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4890.314696][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4890.314700][ C1] __run_timers.part.0+0x52d/0x890 [ 4890.314703][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4890.314708][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4890.314713][ C1] ? __pfx___schedule+0x10/0x10 [ 4890.314717][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4890.314721][ C1] run_timer_softirq+0x72/0x100 [ 4890.314725][ C1] __do_softirq+0x1bc/0x7ff [ 4890.314728][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4890.314732][ C1] run_ksoftirqd+0x2e/0x60 [ 4890.314735][ C1] smpboot_thread_fn+0x30e/0x840 [ 4890.314740][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4890.314743][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4890.314746][ C1] kthread+0x292/0x360 [ 4890.314749][ C1] ? __pfx_kthread+0x10/0x10 [ 4890.314751][ C1] ret_from_fork+0x34/0x70 [ 4890.314754][ C1] ? __pfx_kthread+0x10/0x10 [ 4890.314756][ C1] ret_from_fork_asm+0x1b/0x30 [ 4890.314764][ C1] [ 4916.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3472s! [swapper/0:0] [ 4916.527923][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4916.529122][ C0] irq event stamp: 27567077 [ 4916.529362][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4916.529893][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4916.530374][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4916.530886][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4916.531396][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4916.531886][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4916.532540][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4916.532887][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4916.533923][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4916.534254][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4916.534678][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4916.535104][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4916.535532][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4916.535965][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4916.536391][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4916.536867][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4916.537217][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4916.537643][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4916.538066][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4916.538488][ C0] Call Trace: [ 4916.538668][ C0] [ 4916.538824][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4916.539106][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4916.539360][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4916.539653][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4916.539935][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4916.540237][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4916.540517][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4916.540836][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4916.541113][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4916.541390][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4916.541717][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4916.542035][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4916.542369][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4916.542673][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4916.542982][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4916.543291][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4916.543621][ C0] ? get_stack_info+0x36/0xc0 [ 4916.543873][ C0] ? lock_acquire+0x1c1/0x220 [ 4916.544126][ C0] ? lock_release+0x1d5/0x250 [ 4916.544377][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4916.544638][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4916.544924][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4916.545222][ C0] ? lock_acquire+0x1c1/0x220 [ 4916.545473][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4916.545728][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4916.546004][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4916.546252][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4916.546510][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4916.546777][ C0] ? __inet_lookup_established+0x341/0x610 [ 4916.547099][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4916.547394][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4916.547688][ C0] ip_local_deliver+0x19d/0x480 [ 4916.547947][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4916.548231][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4916.548495][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4916.548776][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4916.549042][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4916.549377][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4916.549656][ C0] ip_rcv+0x564/0x740 [ 4916.549885][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4916.550130][ C0] ? set_track_prepare+0x8a/0xd0 [ 4916.550397][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4916.550687][ C0] ? rest_init+0x153/0x260 [ 4916.550926][ C0] ? skb_clone+0x10b/0x330 [ 4916.551165][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4916.551503][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4916.551828][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4916.552123][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4916.552435][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4916.552698][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4916.552942][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4916.553263][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4916.553564][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4916.553901][ C0] ? lock_acquire+0x1c1/0x220 [ 4916.554148][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4916.554456][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4916.554757][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4916.555087][ C0] ? __copy_skb_header+0xaf/0x490 [ 4916.555353][ C0] ? __skb_clone+0x57a/0x760 [ 4916.555598][ C0] netif_receive_skb+0x55/0x280 [ 4916.555862][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4916.556191][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4916.556543][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4916.556853][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4916.557143][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4916.557446][ C0] ? hlock_class+0x4e/0x130 [ 4916.557694][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4916.558028][ C0] ? place_entity+0x21/0x2f0 [ 4916.558278][ C0] ? resched_curr+0x219/0x280 [ 4916.558531][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4916.558801][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4916.559082][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4916.559365][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4916.559626][ C0] ? activate_task+0xf5/0x260 [ 4916.559879][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4916.560158][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4916.560430][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4916.560695][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4916.560989][ C0] ? get_stack_info+0x36/0xc0 [ 4916.561241][ C0] ? stack_access_ok+0xda/0x1f0 [ 4916.561498][ C0] ? get_reg+0x119/0x190 [ 4916.561727][ C0] __tcf_classify+0x32c/0x7d0 [ 4916.561983][ C0] tcf_classify+0x283/0x930 [ 4916.562229][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4916.562566][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4916.562837][ C0] ? arch_stack_walk+0x8c/0x100 [ 4916.563105][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4916.563396][ C0] tc_run+0x2e4/0x5d0 [ 4916.563610][ C0] ? __pfx_tc_run+0x10/0x10 [ 4916.563851][ C0] ? lock_acquire+0x1c1/0x220 [ 4916.564098][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4916.564375][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4916.564646][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4916.564929][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4916.565207][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4916.565525][ C0] ? neigh_hh_output+0x348/0x590 [ 4916.565795][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4916.566074][ C0] ip_finish_output2+0x786/0x18e0 [ 4916.566342][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4916.566634][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4916.566992][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4916.567286][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4916.567549][ C0] ? __ip_finish_output+0x10f/0x770 [ 4916.567829][ C0] ip_output+0x16b/0x4f0 [ 4916.568059][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4916.568341][ C0] ? __pfx_ip_output+0x10/0x10 [ 4916.568602][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4916.568903][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4916.569169][ C0] ? ip_local_out+0x114/0x3b0 [ 4916.569417][ C0] __ip_queue_xmit+0x672/0x1910 [ 4916.569676][ C0] ? __skb_clone+0x57a/0x760 [ 4916.569922][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4916.570208][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4916.570507][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4916.570829][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4916.571085][ C0] ? tcp_current_mss+0x40a/0x510 [ 4916.571351][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4916.571631][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4916.571910][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4916.572168][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4916.572440][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4916.572760][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4916.573035][ C0] ? ktime_get+0xb6/0x190 [ 4916.573266][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4916.573542][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4916.573825][ C0] tcp_write_timer+0x82/0x1d0 [ 4916.574074][ C0] call_timer_fn+0x176/0x430 [ 4916.574319][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4916.574596][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4916.574869][ C0] __run_timers.part.0+0x52d/0x890 [ 4916.575146][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4916.575427][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4916.575727][ C0] ? lock_acquire+0x1c1/0x220 [ 4916.575973][ C0] ? clockevents_program_event+0xf6/0x300 [ 4916.576278][ C0] ? lock_release+0x1d5/0x250 [ 4916.576528][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4916.576805][ C0] ? ktime_get+0xb6/0x190 [ 4916.577036][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4916.577335][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4916.577651][ C0] run_timer_softirq+0x72/0x100 [ 4916.577908][ C0] __do_softirq+0x1bc/0x7ff [ 4916.578150][ C0] irq_exit_rcu+0x98/0xc0 [ 4916.578382][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4916.578681][ C0] [ 4916.578842][ C0] [ 4916.579003][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4916.579328][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4916.579595][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4916.580612][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4916.580932][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4916.581353][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4916.581773][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4916.582193][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4916.582619][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4916.583047][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4916.583354][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4916.583629][ C0] default_idle_call+0x69/0xa0 [ 4916.583886][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4916.584155][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4916.584447][ C0] ? lock_release+0x1d5/0x250 [ 4916.584700][ C0] do_idle+0xfb/0x160 [ 4916.584914][ C0] cpu_startup_entry+0x55/0x60 [ 4916.585170][ C0] rest_init+0x153/0x260 [ 4916.585395][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4916.585686][ C0] arch_call_rest_init+0x13/0x40 [ 4916.585954][ C0] start_kernel+0x314/0x3d0 [ 4916.586203][ C0] x86_64_start_reservations+0x18/0x30 [ 4916.586492][ C0] x86_64_start_kernel+0xba/0x110 [ 4916.586765][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4916.587096][ C0] [ 4916.587264][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3472s! [ksoftirqd/1:22] [ 4916.587738][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4916.588929][ C1] irq event stamp: 3886976 [ 4916.589163][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4916.589662][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4916.590160][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4916.590657][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4916.591148][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4916.591643][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4916.592296][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4916.592643][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4916.593662][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4916.593986][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4916.594407][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4916.594828][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4916.595247][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4916.595667][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4916.596087][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4916.596553][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4916.596909][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4916.597333][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4916.597754][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4916.598178][ C1] Call Trace: [ 4916.598363][ C1] [ 4916.598521][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4916.598798][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4916.599057][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4916.599346][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4916.599634][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4916.599940][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4916.600223][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4916.600550][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4916.600825][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4916.601154][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4916.601469][ C1] [ 4916.601627][ C1] [ 4916.601785][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4916.602122][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4916.602433][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4916.602745][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4916.603057][ C1] ? run_ksoftirqd+0xb/0x60 [ 4916.603305][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4916.603635][ C1] ? __orc_find+0x9c/0xf0 [ 4916.603866][ C1] ? lock_acquire+0x1c1/0x220 [ 4916.604117][ C1] ? irqentry_enter+0x2b/0x60 [ 4916.604367][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4916.604628][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4916.604914][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4916.605214][ C1] ? lock_acquire+0x1c1/0x220 [ 4916.605468][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4916.605725][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4916.606001][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4916.606250][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4916.606509][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4916.606781][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4916.607071][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4916.607360][ C1] ip_local_deliver+0x19d/0x480 [ 4916.607622][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4916.607912][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4916.608184][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4916.608463][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4916.608728][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4916.609069][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4916.609345][ C1] ip_rcv+0x564/0x740 [ 4916.609565][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4916.609808][ C1] ? set_track_prepare+0x8a/0xd0 [ 4916.610075][ C1] ? irqentry_enter+0x2b/0x60 [ 4916.610329][ C1] ? irqentry_enter+0x2b/0x60 [ 4916.610583][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4916.610830][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4916.611149][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4916.611495][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4916.611810][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4916.612151][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4916.612454][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4916.612784][ C1] netif_receive_skb+0x55/0x280 [ 4916.613044][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4916.613371][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4916.613721][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4916.614038][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4916.614326][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4916.614627][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4916.614955][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4916.615236][ C1] ? arch_stack_walk+0x68/0x100 [ 4916.615501][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4916.615782][ C1] ? irqentry_enter+0x2b/0x60 [ 4916.616037][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4916.616361][ C1] ? irqentry_enter+0x2b/0x60 [ 4916.616613][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4916.616937][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4916.617223][ C1] ? arch_stack_walk+0x68/0x100 [ 4916.617482][ C1] __tcf_classify+0x32c/0x7d0 [ 4916.617732][ C1] tcf_classify+0x283/0x930 [ 4916.617974][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4916.618244][ C1] tc_run+0x2e4/0x5d0 [ 4916.618462][ C1] ? __pfx_tc_run+0x10/0x10 [ 4916.618707][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4916.618975][ C1] ? irqentry_enter+0x2b/0x60 [ 4916.619230][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4916.619519][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4916.619847][ C1] ip_finish_output2+0x786/0x18e0 [ 4916.620119][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4916.620407][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4916.620676][ C1] ? __ip_finish_output+0x10f/0x770 [ 4916.620952][ C1] ip_output+0x16b/0x4f0 [ 4916.621180][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4916.621503][ C1] ? __pfx_ip_output+0x10/0x10 [ 4916.621761][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4916.622117][ C1] ? __pfx_ip_output+0x10/0x10 [ 4916.622383][ C1] __ip_queue_xmit+0x672/0x1910 [ 4916.622649][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4916.622934][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4916.623233][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4916.623524][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4916.623825][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4916.624116][ C1] tcp_delack_timer+0x84/0x240 [ 4916.624376][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4916.624662][ C1] call_timer_fn+0x176/0x430 [ 4916.624912][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4916.625191][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4916.625467][ C1] __run_timers.part.0+0x52d/0x890 [ 4916.625744][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4916.626036][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4916.626340][ C1] ? __pfx___schedule+0x10/0x10 [ 4916.626596][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4916.626917][ C1] run_timer_softirq+0x72/0x100 [ 4916.627184][ C1] __do_softirq+0x1bc/0x7ff [ 4916.627431][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4916.627708][ C1] run_ksoftirqd+0x2e/0x60 [ 4916.627946][ C1] smpboot_thread_fn+0x30e/0x840 [ 4916.628217][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4916.628510][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4916.628804][ C1] kthread+0x292/0x360 [ 4916.629022][ C1] ? __pfx_kthread+0x10/0x10 [ 4916.629271][ C1] ret_from_fork+0x34/0x70 [ 4916.629512][ C1] ? __pfx_kthread+0x10/0x10 [ 4916.629763][ C1] ret_from_fork_asm+0x1b/0x30 [ 4916.630025][ C1] [ 4944.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3498s! [swapper/0:0] [ 4944.527934][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4944.529133][ C0] irq event stamp: 27567077 [ 4944.529377][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4944.529907][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4944.530379][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4944.530880][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4944.531379][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4944.531857][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4944.532510][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4944.532848][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4944.533866][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4944.534190][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4944.534608][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4944.535025][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4944.535440][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4944.535855][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4944.536275][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4944.536742][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4944.537095][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4944.537518][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4944.537942][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4944.538369][ C0] Call Trace: [ 4944.538547][ C0] [ 4944.538708][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4944.538984][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4944.539244][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4944.539533][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4944.539822][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4944.540126][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4944.540408][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4944.540738][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4944.541011][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4944.541292][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4944.541616][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4944.541925][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4944.542267][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4944.542574][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4944.542887][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4944.543188][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4944.543511][ C0] ? get_stack_info+0x36/0xc0 [ 4944.543766][ C0] ? lock_acquire+0x1c1/0x220 [ 4944.544020][ C0] ? lock_release+0x1d5/0x250 [ 4944.544272][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4944.544540][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4944.544829][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4944.545131][ C0] ? lock_acquire+0x1c1/0x220 [ 4944.545381][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4944.545632][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4944.545904][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4944.546153][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4944.546414][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4944.546687][ C0] ? __inet_lookup_established+0x341/0x610 [ 4944.547006][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4944.547294][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4944.547582][ C0] ip_local_deliver+0x19d/0x480 [ 4944.547846][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4944.548138][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4944.548404][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4944.548678][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4944.548939][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4944.549276][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4944.549549][ C0] ip_rcv+0x564/0x740 [ 4944.549760][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4944.549999][ C0] ? set_track_prepare+0x8a/0xd0 [ 4944.550261][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4944.550550][ C0] ? rest_init+0x153/0x260 [ 4944.550784][ C0] ? skb_clone+0x10b/0x330 [ 4944.551026][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4944.551360][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4944.551676][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4944.551974][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4944.552290][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4944.552550][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4944.552789][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4944.553099][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4944.553397][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4944.553737][ C0] ? lock_acquire+0x1c1/0x220 [ 4944.553989][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4944.554299][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4944.554597][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4944.554930][ C0] ? __copy_skb_header+0xaf/0x490 [ 4944.555203][ C0] ? __skb_clone+0x57a/0x760 [ 4944.555455][ C0] netif_receive_skb+0x55/0x280 [ 4944.555709][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4944.556034][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4944.556380][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4944.556697][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4944.556984][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4944.557284][ C0] ? hlock_class+0x4e/0x130 [ 4944.557527][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4944.557854][ C0] ? place_entity+0x21/0x2f0 [ 4944.558100][ C0] ? resched_curr+0x219/0x280 [ 4944.558354][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4944.558624][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4944.558907][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4944.559182][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4944.559439][ C0] ? activate_task+0xf5/0x260 [ 4944.559690][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4944.559964][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4944.560242][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4944.560497][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4944.560784][ C0] ? get_stack_info+0x36/0xc0 [ 4944.561039][ C0] ? stack_access_ok+0xda/0x1f0 [ 4944.561301][ C0] ? get_reg+0x119/0x190 [ 4944.561527][ C0] __tcf_classify+0x32c/0x7d0 [ 4944.561775][ C0] tcf_classify+0x283/0x930 [ 4944.562013][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4944.562348][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4944.562614][ C0] ? arch_stack_walk+0x8c/0x100 [ 4944.562872][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4944.563162][ C0] tc_run+0x2e4/0x5d0 [ 4944.563380][ C0] ? __pfx_tc_run+0x10/0x10 [ 4944.563627][ C0] ? lock_acquire+0x1c1/0x220 [ 4944.563880][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4944.564158][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4944.564423][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4944.564711][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4944.564990][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4944.565315][ C0] ? neigh_hh_output+0x348/0x590 [ 4944.565578][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4944.565858][ C0] ip_finish_output2+0x786/0x18e0 [ 4944.566129][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4944.566425][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4944.566774][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4944.567062][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4944.567329][ C0] ? __ip_finish_output+0x10f/0x770 [ 4944.567606][ C0] ip_output+0x16b/0x4f0 [ 4944.567832][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4944.568119][ C0] ? __pfx_ip_output+0x10/0x10 [ 4944.568371][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4944.568673][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4944.568935][ C0] ? ip_local_out+0x114/0x3b0 [ 4944.569189][ C0] __ip_queue_xmit+0x672/0x1910 [ 4944.569451][ C0] ? __skb_clone+0x57a/0x760 [ 4944.569700][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4944.569978][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4944.570273][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4944.570591][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4944.570850][ C0] ? tcp_current_mss+0x40a/0x510 [ 4944.571113][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4944.571395][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4944.571670][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4944.571923][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4944.572199][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4944.572515][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4944.572795][ C0] ? ktime_get+0xb6/0x190 [ 4944.573029][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4944.573306][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4944.573586][ C0] tcp_write_timer+0x82/0x1d0 [ 4944.573839][ C0] call_timer_fn+0x176/0x430 [ 4944.574090][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4944.574364][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4944.574640][ C0] __run_timers.part.0+0x52d/0x890 [ 4944.574912][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4944.575197][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4944.575494][ C0] ? lock_acquire+0x1c1/0x220 [ 4944.575746][ C0] ? clockevents_program_event+0xf6/0x300 [ 4944.576054][ C0] ? lock_release+0x1d5/0x250 [ 4944.576309][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4944.576589][ C0] ? ktime_get+0xb6/0x190 [ 4944.576822][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4944.577123][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4944.577433][ C0] run_timer_softirq+0x72/0x100 [ 4944.577696][ C0] __do_softirq+0x1bc/0x7ff [ 4944.577944][ C0] irq_exit_rcu+0x98/0xc0 [ 4944.578176][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4944.578481][ C0] [ 4944.578637][ C0] [ 4944.578793][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4944.579115][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4944.579389][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4944.580410][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4944.580738][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4944.581163][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4944.581581][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4944.582002][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4944.582430][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4944.582847][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4944.583149][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4944.583420][ C0] default_idle_call+0x69/0xa0 [ 4944.583676][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4944.583937][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4944.584233][ C0] ? lock_release+0x1d5/0x250 [ 4944.584483][ C0] do_idle+0xfb/0x160 [ 4944.584696][ C0] cpu_startup_entry+0x55/0x60 [ 4944.584949][ C0] rest_init+0x153/0x260 [ 4944.585177][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4944.585464][ C0] arch_call_rest_init+0x13/0x40 [ 4944.585730][ C0] start_kernel+0x314/0x3d0 [ 4944.585981][ C0] x86_64_start_reservations+0x18/0x30 [ 4944.586276][ C0] x86_64_start_kernel+0xba/0x110 [ 4944.586542][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4944.586867][ C0] [ 4944.587031][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3498s! [ksoftirqd/1:22] [ 4944.587503][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4944.588706][ C1] irq event stamp: 3886976 [ 4944.588946][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4944.589444][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4944.589937][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4944.590436][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4944.590933][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4944.591426][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4944.592071][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4944.592418][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4944.593453][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4944.593779][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4944.594208][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4944.594631][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4944.595054][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4944.595480][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4944.595906][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4944.596379][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4944.596729][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4944.597159][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4944.597582][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4944.598002][ C1] Call Trace: [ 4944.598181][ C1] [ 4944.598338][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4944.598620][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4944.598877][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4944.599177][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4944.599463][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4944.599766][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4944.600046][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4944.600366][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4944.600646][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4944.600970][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4944.601283][ C1] [ 4944.601444][ C1] [ 4944.601604][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4944.601938][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4944.602250][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4944.602564][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4944.602868][ C1] ? run_ksoftirqd+0xb/0x60 [ 4944.603118][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4944.603446][ C1] ? __orc_find+0x9c/0xf0 [ 4944.603681][ C1] ? lock_acquire+0x1c1/0x220 [ 4944.603935][ C1] ? irqentry_enter+0x2b/0x60 [ 4944.604191][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4944.604455][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4944.604746][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4944.605051][ C1] ? lock_acquire+0x1c1/0x220 [ 4944.605303][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4944.605558][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4944.605833][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4944.606086][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4944.606350][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4944.606629][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4944.606923][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4944.607220][ C1] ip_local_deliver+0x19d/0x480 [ 4944.607478][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4944.607762][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4944.608030][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4944.608313][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4944.608583][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4944.608920][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4944.609199][ C1] ip_rcv+0x564/0x740 [ 4944.609421][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4944.609668][ C1] ? set_track_prepare+0x8a/0xd0 [ 4944.609941][ C1] ? irqentry_enter+0x2b/0x60 [ 4944.610197][ C1] ? irqentry_enter+0x2b/0x60 [ 4944.610451][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4944.610695][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4944.611013][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4944.611356][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4944.611666][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4944.612010][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4944.612320][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4944.612659][ C1] netif_receive_skb+0x55/0x280 [ 4944.612923][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4944.613257][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4944.613613][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4944.613928][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4944.614227][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4944.614534][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4944.614870][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4944.615156][ C1] ? arch_stack_walk+0x68/0x100 [ 4944.615418][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4944.615696][ C1] ? irqentry_enter+0x2b/0x60 [ 4944.615949][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4944.616271][ C1] ? irqentry_enter+0x2b/0x60 [ 4944.616528][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4944.616855][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4944.617137][ C1] ? arch_stack_walk+0x68/0x100 [ 4944.617402][ C1] __tcf_classify+0x32c/0x7d0 [ 4944.617658][ C1] tcf_classify+0x283/0x930 [ 4944.617905][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4944.618183][ C1] tc_run+0x2e4/0x5d0 [ 4944.618407][ C1] ? __pfx_tc_run+0x10/0x10 [ 4944.618656][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4944.618929][ C1] ? irqentry_enter+0x2b/0x60 [ 4944.619184][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4944.619471][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4944.619795][ C1] ip_finish_output2+0x786/0x18e0 [ 4944.620072][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4944.620366][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4944.620631][ C1] ? __ip_finish_output+0x10f/0x770 [ 4944.620914][ C1] ip_output+0x16b/0x4f0 [ 4944.621148][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4944.621469][ C1] ? __pfx_ip_output+0x10/0x10 [ 4944.621732][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4944.622087][ C1] ? __pfx_ip_output+0x10/0x10 [ 4944.622349][ C1] __ip_queue_xmit+0x672/0x1910 [ 4944.622610][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4944.622892][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4944.623188][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4944.623475][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4944.623772][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4944.624061][ C1] tcp_delack_timer+0x84/0x240 [ 4944.624319][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4944.624612][ C1] call_timer_fn+0x176/0x430 [ 4944.624866][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4944.625142][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4944.625425][ C1] __run_timers.part.0+0x52d/0x890 [ 4944.625704][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4944.625994][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4944.626297][ C1] ? __pfx___schedule+0x10/0x10 [ 4944.626561][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4944.626887][ C1] run_timer_softirq+0x72/0x100 [ 4944.627150][ C1] __do_softirq+0x1bc/0x7ff [ 4944.627393][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4944.627669][ C1] run_ksoftirqd+0x2e/0x60 [ 4944.627912][ C1] smpboot_thread_fn+0x30e/0x840 [ 4944.628182][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4944.628479][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4944.628775][ C1] kthread+0x292/0x360 [ 4944.628998][ C1] ? __pfx_kthread+0x10/0x10 [ 4944.629245][ C1] ret_from_fork+0x34/0x70 [ 4944.629487][ C1] ? __pfx_kthread+0x10/0x10 [ 4944.629734][ C1] ret_from_fork_asm+0x1b/0x30 [ 4944.629999][ C1] [ 4968.318024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4968.318411][ C1] rcu: 1-....: (3763620 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=899076 [ 4968.319002][ C1] rcu: (t=3774009 jiffies g=1007429 q=31 ncpus=4) [ 4968.319353][ C1] Sending NMI from CPU 1 to CPUs 0: [ 4968.319640][ C0] NMI backtrace for cpu 0 [ 4968.319647][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4968.319651][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4968.319654][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4968.319663][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4968.319667][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4968.319670][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4968.319672][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4968.319674][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4968.319676][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4968.319678][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4968.319679][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4968.319681][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4968.319686][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4968.319687][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4968.319689][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4968.319690][ C0] Call Trace: [ 4968.319693][ C0] [ 4968.319697][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 4968.319703][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4968.319708][ C0] ? nmi_handle+0x156/0x420 [ 4968.319714][ C0] ? default_do_nmi+0x41/0x100 [ 4968.319718][ C0] ? exc_nmi+0xf3/0x120 [ 4968.319721][ C0] ? end_repeat_nmi+0xf/0x60 [ 4968.319726][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4968.319730][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4968.319733][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4968.319738][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4968.319741][ C0] [ 4968.319742][ C0] [ 4968.319743][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4968.319746][ C0] ? get_stack_info+0x36/0xc0 [ 4968.319752][ C0] ? lock_acquire+0x1c1/0x220 [ 4968.319756][ C0] ? lock_release+0x1d5/0x250 [ 4968.319760][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4968.319763][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4968.319766][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4968.319769][ C0] ? lock_acquire+0x1c1/0x220 [ 4968.319772][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4968.319776][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4968.319780][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4968.319787][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4968.319790][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4968.319794][ C0] ? __inet_lookup_established+0x341/0x610 [ 4968.319800][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4968.319807][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4968.319811][ C0] ip_local_deliver+0x19d/0x480 [ 4968.319814][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4968.319816][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4968.319822][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4968.319825][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4968.319828][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4968.319832][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4968.319842][ C0] ip_rcv+0x564/0x740 [ 4968.319846][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4968.319849][ C0] ? set_track_prepare+0x8a/0xd0 [ 4968.319854][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4968.319857][ C0] ? rest_init+0x153/0x260 [ 4968.319859][ C0] ? skb_clone+0x10b/0x330 [ 4968.319864][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4968.319871][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4968.319876][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4968.319881][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4968.319891][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4968.319894][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4968.319896][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4968.319902][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4968.319905][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4968.319908][ C0] ? lock_acquire+0x1c1/0x220 [ 4968.319910][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4968.319914][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4968.319917][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4968.319920][ C0] ? __copy_skb_header+0xaf/0x490 [ 4968.319923][ C0] ? __skb_clone+0x57a/0x760 [ 4968.319925][ C0] netif_receive_skb+0x55/0x280 [ 4968.319928][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4968.319935][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4968.319942][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4968.319949][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4968.319955][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4968.319963][ C0] ? hlock_class+0x4e/0x130 [ 4968.319969][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4968.319979][ C0] ? place_entity+0x21/0x2f0 [ 4968.319982][ C0] ? resched_curr+0x219/0x280 [ 4968.319986][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4968.319988][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4968.319992][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4968.319997][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4968.320000][ C0] ? activate_task+0xf5/0x260 [ 4968.320003][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4968.320009][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4968.320012][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4968.320015][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4968.320018][ C0] ? get_stack_info+0x36/0xc0 [ 4968.320023][ C0] ? stack_access_ok+0xda/0x1f0 [ 4968.320026][ C0] ? get_reg+0x119/0x190 [ 4968.320029][ C0] __tcf_classify+0x32c/0x7d0 [ 4968.320033][ C0] tcf_classify+0x283/0x930 [ 4968.320037][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4968.320042][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4968.320044][ C0] ? arch_stack_walk+0x8c/0x100 [ 4968.320049][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4968.320052][ C0] tc_run+0x2e4/0x5d0 [ 4968.320057][ C0] ? __pfx_tc_run+0x10/0x10 [ 4968.320060][ C0] ? lock_acquire+0x1c1/0x220 [ 4968.320062][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4968.320067][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4968.320073][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4968.320076][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4968.320080][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4968.320085][ C0] ? neigh_hh_output+0x348/0x590 [ 4968.320090][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4968.320094][ C0] ip_finish_output2+0x786/0x18e0 [ 4968.320097][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4968.320103][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4968.320111][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4968.320114][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4968.320118][ C0] ? __ip_finish_output+0x10f/0x770 [ 4968.320122][ C0] ip_output+0x16b/0x4f0 [ 4968.320125][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4968.320130][ C0] ? __pfx_ip_output+0x10/0x10 [ 4968.320133][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4968.320138][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4968.320141][ C0] ? ip_local_out+0x114/0x3b0 [ 4968.320145][ C0] __ip_queue_xmit+0x672/0x1910 [ 4968.320150][ C0] ? __skb_clone+0x57a/0x760 [ 4968.320153][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4968.320161][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4968.320165][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4968.320169][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4968.320174][ C0] ? tcp_current_mss+0x40a/0x510 [ 4968.320177][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4968.320180][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4968.320183][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4968.320185][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4968.320188][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4968.320191][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4968.320196][ C0] ? ktime_get+0xb6/0x190 [ 4968.320200][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4968.320205][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4968.320208][ C0] tcp_write_timer+0x82/0x1d0 [ 4968.320212][ C0] call_timer_fn+0x176/0x430 [ 4968.320215][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4968.320220][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4968.320224][ C0] __run_timers.part.0+0x52d/0x890 [ 4968.320227][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4968.320232][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4968.320235][ C0] ? lock_acquire+0x1c1/0x220 [ 4968.320238][ C0] ? clockevents_program_event+0xf6/0x300 [ 4968.320242][ C0] ? lock_release+0x1d5/0x250 [ 4968.320245][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4968.320248][ C0] ? ktime_get+0xb6/0x190 [ 4968.320250][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4968.320254][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4968.320258][ C0] run_timer_softirq+0x72/0x100 [ 4968.320262][ C0] __do_softirq+0x1bc/0x7ff [ 4968.320266][ C0] irq_exit_rcu+0x98/0xc0 [ 4968.320270][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4968.320273][ C0] [ 4968.320274][ C0] [ 4968.320275][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4968.320281][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4968.320284][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4968.320287][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4968.320289][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4968.320291][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4968.320292][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4968.320293][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4968.320295][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4968.320298][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4968.320302][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4968.320305][ C0] default_idle_call+0x69/0xa0 [ 4968.320308][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4968.320310][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4968.320316][ C0] ? lock_release+0x1d5/0x250 [ 4968.320320][ C0] do_idle+0xfb/0x160 [ 4968.320323][ C0] cpu_startup_entry+0x55/0x60 [ 4968.320325][ C0] rest_init+0x153/0x260 [ 4968.320328][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4968.320333][ C0] arch_call_rest_init+0x13/0x40 [ 4968.320339][ C0] start_kernel+0x314/0x3d0 [ 4968.320343][ C0] x86_64_start_reservations+0x18/0x30 [ 4968.320348][ C0] x86_64_start_kernel+0xba/0x110 [ 4968.320351][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4968.320359][ C0] [ 4968.320636][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4968.375022][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4968.375664][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4968.376008][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4968.377024][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4968.377347][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4968.377765][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4968.378186][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4968.378604][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4968.379024][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4968.379443][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4968.379916][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4968.380271][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4968.380693][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4968.381121][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4968.381548][ C1] Call Trace: [ 4968.381729][ C1] [ 4968.381888][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4968.382183][ C1] ? print_cpu_stall+0x263/0x6a0 [ 4968.382449][ C1] ? check_cpu_stall+0x284/0x500 [ 4968.382715][ C1] ? rcu_pending+0x92/0x360 [ 4968.382956][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4968.383240][ C1] ? update_process_times+0xb9/0x110 [ 4968.383527][ C1] ? tick_sched_handle+0x67/0x130 [ 4968.383797][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4968.384098][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4968.384358][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4968.384688][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4968.384980][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4968.385287][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4968.385569][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4968.385895][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4968.386171][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4968.386500][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4968.386815][ C1] [ 4968.386971][ C1] [ 4968.387129][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4968.387457][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4968.387766][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4968.388079][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4968.388382][ C1] ? run_ksoftirqd+0xb/0x60 [ 4968.388624][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4968.388947][ C1] ? __orc_find+0x9c/0xf0 [ 4968.389185][ C1] ? lock_acquire+0x1c1/0x220 [ 4968.389440][ C1] ? irqentry_enter+0x2b/0x60 [ 4968.389695][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4968.389958][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4968.390246][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4968.390547][ C1] ? lock_acquire+0x1c1/0x220 [ 4968.390797][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4968.391051][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4968.391324][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4968.391573][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4968.391834][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4968.392113][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4968.392403][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4968.392695][ C1] ip_local_deliver+0x19d/0x480 [ 4968.392958][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4968.393247][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4968.393513][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4968.393789][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4968.394054][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4968.394394][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4968.394669][ C1] ip_rcv+0x564/0x740 [ 4968.394881][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4968.395123][ C1] ? set_track_prepare+0x8a/0xd0 [ 4968.395386][ C1] ? irqentry_enter+0x2b/0x60 [ 4968.395642][ C1] ? irqentry_enter+0x2b/0x60 [ 4968.395898][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4968.396144][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4968.396469][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4968.396811][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4968.397124][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4968.397462][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4968.397761][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4968.398099][ C1] netif_receive_skb+0x55/0x280 [ 4968.398361][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4968.398693][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4968.399045][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4968.399359][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4968.399653][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4968.399959][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4968.400294][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4968.400578][ C1] ? arch_stack_walk+0x68/0x100 [ 4968.400838][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4968.401116][ C1] ? irqentry_enter+0x2b/0x60 [ 4968.401366][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4968.401683][ C1] ? irqentry_enter+0x2b/0x60 [ 4968.401936][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4968.402279][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4968.402563][ C1] ? arch_stack_walk+0x68/0x100 [ 4968.402828][ C1] __tcf_classify+0x32c/0x7d0 [ 4968.403082][ C1] tcf_classify+0x283/0x930 [ 4968.403326][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4968.403594][ C1] tc_run+0x2e4/0x5d0 [ 4968.403806][ C1] ? __pfx_tc_run+0x10/0x10 [ 4968.404049][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4968.404315][ C1] ? irqentry_enter+0x2b/0x60 [ 4968.404570][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4968.404859][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4968.405187][ C1] ip_finish_output2+0x786/0x18e0 [ 4968.405457][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4968.405748][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4968.406015][ C1] ? __ip_finish_output+0x10f/0x770 [ 4968.406293][ C1] ip_output+0x16b/0x4f0 [ 4968.406518][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4968.406839][ C1] ? __pfx_ip_output+0x10/0x10 [ 4968.407094][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4968.407453][ C1] ? __pfx_ip_output+0x10/0x10 [ 4968.407713][ C1] __ip_queue_xmit+0x672/0x1910 [ 4968.407975][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4968.408256][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4968.408552][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4968.408836][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4968.409129][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4968.409413][ C1] tcp_delack_timer+0x84/0x240 [ 4968.409667][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4968.409957][ C1] call_timer_fn+0x176/0x430 [ 4968.410207][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4968.410481][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4968.410763][ C1] __run_timers.part.0+0x52d/0x890 [ 4968.411039][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4968.411324][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4968.411624][ C1] ? __pfx___schedule+0x10/0x10 [ 4968.411888][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4968.412214][ C1] run_timer_softirq+0x72/0x100 [ 4968.412481][ C1] __do_softirq+0x1bc/0x7ff [ 4968.412728][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4968.413005][ C1] run_ksoftirqd+0x2e/0x60 [ 4968.413245][ C1] smpboot_thread_fn+0x30e/0x840 [ 4968.413512][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4968.413801][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4968.414094][ C1] kthread+0x292/0x360 [ 4968.414313][ C1] ? __pfx_kthread+0x10/0x10 [ 4968.414564][ C1] ret_from_fork+0x34/0x70 [ 4968.414801][ C1] ? __pfx_kthread+0x10/0x10 [ 4968.415050][ C1] ret_from_fork_asm+0x1b/0x30 [ 4968.415306][ C1] [ 4992.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3543s! [swapper/0:0] [ 4992.527928][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4992.529132][ C0] irq event stamp: 27567077 [ 4992.529376][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 4992.529908][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 4992.530380][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 4992.530883][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 4992.531378][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 4992.531859][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4992.532512][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4992.532851][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4992.533872][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 4992.534201][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4992.534618][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 4992.535037][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 4992.535458][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 4992.535875][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 4992.536293][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 4992.536761][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4992.537113][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 4992.537532][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4992.537953][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4992.538382][ C0] Call Trace: [ 4992.538567][ C0] [ 4992.538724][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4992.539000][ C0] ? __run_hrtimer+0x1c3/0x710 [ 4992.539255][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4992.539543][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 4992.539833][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4992.540143][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4992.540424][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4992.540746][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 4992.541018][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 4992.541298][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4992.541618][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4992.541928][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4992.542264][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4992.542571][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4992.542883][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4992.543185][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4992.543511][ C0] ? get_stack_info+0x36/0xc0 [ 4992.543769][ C0] ? lock_acquire+0x1c1/0x220 [ 4992.544026][ C0] ? lock_release+0x1d5/0x250 [ 4992.544282][ C0] do_raw_spin_lock+0x1ec/0x270 [ 4992.544544][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4992.544831][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4992.545131][ C0] ? lock_acquire+0x1c1/0x220 [ 4992.545378][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 4992.545631][ C0] _raw_spin_lock_nested+0x65/0x80 [ 4992.545903][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 4992.546154][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4992.546416][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 4992.546691][ C0] ? __inet_lookup_established+0x341/0x610 [ 4992.547011][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 4992.547301][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 4992.547603][ C0] ip_local_deliver+0x19d/0x480 [ 4992.547864][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 4992.548152][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4992.548419][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 4992.548694][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4992.548958][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4992.549296][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4992.549574][ C0] ip_rcv+0x564/0x740 [ 4992.549787][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4992.550027][ C0] ? set_track_prepare+0x8a/0xd0 [ 4992.550296][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 4992.550588][ C0] ? rest_init+0x153/0x260 [ 4992.550826][ C0] ? skb_clone+0x10b/0x330 [ 4992.551069][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4992.551403][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4992.551726][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 4992.552028][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4992.552337][ C0] ? __tcf_classify+0x32c/0x7d0 [ 4992.552596][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 4992.552835][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 4992.553147][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4992.553444][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4992.553788][ C0] ? lock_acquire+0x1c1/0x220 [ 4992.554043][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 4992.554355][ C0] netif_receive_skb_internal+0xb0/0x300 [ 4992.554653][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4992.554985][ C0] ? __copy_skb_header+0xaf/0x490 [ 4992.555257][ C0] ? __skb_clone+0x57a/0x760 [ 4992.555507][ C0] netif_receive_skb+0x55/0x280 [ 4992.555764][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4992.556092][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4992.556439][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4992.556754][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 4992.557039][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 4992.557337][ C0] ? hlock_class+0x4e/0x130 [ 4992.557582][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4992.557908][ C0] ? place_entity+0x21/0x2f0 [ 4992.558154][ C0] ? resched_curr+0x219/0x280 [ 4992.558406][ C0] ? __pfx_resched_curr+0x10/0x10 [ 4992.558676][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 4992.558962][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 4992.559237][ C0] ? wakeup_preempt+0x161/0x2c0 [ 4992.559492][ C0] ? activate_task+0xf5/0x260 [ 4992.559738][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 4992.560011][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 4992.560287][ C0] ? _raw_spin_unlock+0x23/0x40 [ 4992.560546][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4992.560836][ C0] ? get_stack_info+0x36/0xc0 [ 4992.561091][ C0] ? stack_access_ok+0xda/0x1f0 [ 4992.561351][ C0] ? get_reg+0x119/0x190 [ 4992.561582][ C0] __tcf_classify+0x32c/0x7d0 [ 4992.561835][ C0] tcf_classify+0x283/0x930 [ 4992.562085][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4992.562416][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 4992.562680][ C0] ? arch_stack_walk+0x8c/0x100 [ 4992.562940][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 4992.563228][ C0] tc_run+0x2e4/0x5d0 [ 4992.563446][ C0] ? __pfx_tc_run+0x10/0x10 [ 4992.563692][ C0] ? lock_acquire+0x1c1/0x220 [ 4992.563944][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 4992.564223][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 4992.564488][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4992.564775][ C0] ? ip_finish_output2+0x786/0x18e0 [ 4992.565056][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4992.565380][ C0] ? neigh_hh_output+0x348/0x590 [ 4992.565644][ C0] ? ip_finish_output2+0x262/0x18e0 [ 4992.565926][ C0] ip_finish_output2+0x786/0x18e0 [ 4992.566197][ C0] ? stack_depot_save_flags+0x45/0x550 [ 4992.566492][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4992.566842][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 4992.567132][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4992.567397][ C0] ? __ip_finish_output+0x10f/0x770 [ 4992.567673][ C0] ip_output+0x16b/0x4f0 [ 4992.567900][ C0] ? __run_timers.part.0+0x52d/0x890 [ 4992.568186][ C0] ? __pfx_ip_output+0x10/0x10 [ 4992.568443][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4992.568745][ C0] ? rcu_read_lock_held+0xe/0x50 [ 4992.569006][ C0] ? ip_local_out+0x114/0x3b0 [ 4992.569261][ C0] __ip_queue_xmit+0x672/0x1910 [ 4992.569526][ C0] ? __skb_clone+0x57a/0x760 [ 4992.569775][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 4992.570054][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4992.570348][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 4992.570664][ C0] tcp_write_xmit+0xe42/0x24c0 [ 4992.570922][ C0] ? tcp_current_mss+0x40a/0x510 [ 4992.571186][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 4992.571471][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 4992.571746][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 4992.572003][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 4992.572271][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4992.572588][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4992.572868][ C0] ? ktime_get+0xb6/0x190 [ 4992.573104][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 4992.573379][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4992.573665][ C0] tcp_write_timer+0x82/0x1d0 [ 4992.573920][ C0] call_timer_fn+0x176/0x430 [ 4992.574170][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 4992.574442][ C0] ? next_expiry_recalc+0xcd/0x220 [ 4992.574718][ C0] __run_timers.part.0+0x52d/0x890 [ 4992.574989][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 4992.575275][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 4992.575572][ C0] ? lock_acquire+0x1c1/0x220 [ 4992.575826][ C0] ? clockevents_program_event+0xf6/0x300 [ 4992.576136][ C0] ? lock_release+0x1d5/0x250 [ 4992.576388][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 4992.576669][ C0] ? ktime_get+0xb6/0x190 [ 4992.576901][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 4992.577205][ C0] ? clockevents_program_event+0x1ed/0x300 [ 4992.577513][ C0] run_timer_softirq+0x72/0x100 [ 4992.577775][ C0] __do_softirq+0x1bc/0x7ff [ 4992.578022][ C0] irq_exit_rcu+0x98/0xc0 [ 4992.578256][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 4992.578557][ C0] [ 4992.578713][ C0] [ 4992.578869][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4992.579186][ C0] RIP: 0010:default_idle+0xf/0x20 [ 4992.579457][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4992.580486][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 4992.580811][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 4992.581240][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 4992.581665][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 4992.582093][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 4992.582511][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 4992.582930][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4992.583232][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 4992.583504][ C0] default_idle_call+0x69/0xa0 [ 4992.583761][ C0] cpuidle_idle_call+0x1f6/0x280 [ 4992.584024][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4992.584316][ C0] ? lock_release+0x1d5/0x250 [ 4992.584566][ C0] do_idle+0xfb/0x160 [ 4992.584776][ C0] cpu_startup_entry+0x55/0x60 [ 4992.585030][ C0] rest_init+0x153/0x260 [ 4992.585259][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 4992.585545][ C0] arch_call_rest_init+0x13/0x40 [ 4992.585809][ C0] start_kernel+0x314/0x3d0 [ 4992.586055][ C0] x86_64_start_reservations+0x18/0x30 [ 4992.586347][ C0] x86_64_start_kernel+0xba/0x110 [ 4992.586614][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 4992.586939][ C0] [ 4992.587105][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3543s! [ksoftirqd/1:22] [ 4992.587575][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 4992.588771][ C1] irq event stamp: 3886976 [ 4992.589007][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 4992.589510][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 4992.590010][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 4992.590512][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 4992.591000][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 4992.591500][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4992.592156][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4992.592499][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4992.593525][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 4992.593850][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 4992.594270][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 4992.594689][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 4992.595111][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 4992.595534][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 4992.595952][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4992.596422][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4992.596776][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 4992.597196][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4992.597619][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4992.598052][ C1] Call Trace: [ 4992.598237][ C1] [ 4992.598394][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4992.598671][ C1] ? __run_hrtimer+0x1c3/0x710 [ 4992.598930][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4992.599222][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4992.599513][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4992.599820][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4992.600104][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 4992.600427][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4992.600701][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 4992.601033][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 4992.601346][ C1] [ 4992.601503][ C1] [ 4992.601660][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4992.601996][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4992.602302][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4992.602612][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4992.602916][ C1] ? run_ksoftirqd+0xb/0x60 [ 4992.603163][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4992.603495][ C1] ? __orc_find+0x9c/0xf0 [ 4992.603725][ C1] ? lock_acquire+0x1c1/0x220 [ 4992.603977][ C1] ? irqentry_enter+0x2b/0x60 [ 4992.604231][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4992.604492][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4992.604778][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4992.605078][ C1] ? lock_acquire+0x1c1/0x220 [ 4992.605329][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 4992.605585][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4992.605861][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 4992.606109][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4992.606368][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4992.606639][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4992.606926][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 4992.607217][ C1] ip_local_deliver+0x19d/0x480 [ 4992.607483][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4992.607773][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4992.608043][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 4992.608320][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4992.608584][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4992.608923][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4992.609197][ C1] ip_rcv+0x564/0x740 [ 4992.609410][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4992.609650][ C1] ? set_track_prepare+0x8a/0xd0 [ 4992.609916][ C1] ? irqentry_enter+0x2b/0x60 [ 4992.610169][ C1] ? irqentry_enter+0x2b/0x60 [ 4992.610423][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4992.610667][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4992.610986][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4992.611333][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4992.611644][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4992.611990][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4992.612294][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4992.612627][ C1] netif_receive_skb+0x55/0x280 [ 4992.612893][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4992.613221][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4992.613568][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4992.613887][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 4992.614175][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4992.614477][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4992.614803][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4992.615083][ C1] ? arch_stack_walk+0x68/0x100 [ 4992.615347][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 4992.615630][ C1] ? irqentry_enter+0x2b/0x60 [ 4992.615882][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4992.616208][ C1] ? irqentry_enter+0x2b/0x60 [ 4992.616459][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4992.616781][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 4992.617065][ C1] ? arch_stack_walk+0x68/0x100 [ 4992.617325][ C1] __tcf_classify+0x32c/0x7d0 [ 4992.617578][ C1] tcf_classify+0x283/0x930 [ 4992.617820][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4992.618090][ C1] tc_run+0x2e4/0x5d0 [ 4992.618303][ C1] ? __pfx_tc_run+0x10/0x10 [ 4992.618546][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 4992.618811][ C1] ? irqentry_enter+0x2b/0x60 [ 4992.619065][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4992.619353][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4992.619679][ C1] ip_finish_output2+0x786/0x18e0 [ 4992.619948][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4992.620238][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4992.620508][ C1] ? __ip_finish_output+0x10f/0x770 [ 4992.620786][ C1] ip_output+0x16b/0x4f0 [ 4992.621013][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4992.621337][ C1] ? __pfx_ip_output+0x10/0x10 [ 4992.621593][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 4992.621954][ C1] ? __pfx_ip_output+0x10/0x10 [ 4992.622214][ C1] __ip_queue_xmit+0x672/0x1910 [ 4992.622482][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4992.622767][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4992.623069][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4992.623364][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4992.623663][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4992.623951][ C1] tcp_delack_timer+0x84/0x240 [ 4992.624210][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4992.624494][ C1] call_timer_fn+0x176/0x430 [ 4992.624741][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4992.625019][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 4992.625296][ C1] __run_timers.part.0+0x52d/0x890 [ 4992.625567][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4992.625860][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4992.626164][ C1] ? __pfx___schedule+0x10/0x10 [ 4992.626423][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4992.626741][ C1] run_timer_softirq+0x72/0x100 [ 4992.627004][ C1] __do_softirq+0x1bc/0x7ff [ 4992.627252][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 4992.627529][ C1] run_ksoftirqd+0x2e/0x60 [ 4992.627768][ C1] smpboot_thread_fn+0x30e/0x840 [ 4992.628039][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4992.628331][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 4992.628623][ C1] kthread+0x292/0x360 [ 4992.628842][ C1] ? __pfx_kthread+0x10/0x10 [ 4992.629093][ C1] ret_from_fork+0x34/0x70 [ 4992.629328][ C1] ? __pfx_kthread+0x10/0x10 [ 4992.629578][ C1] ret_from_fork_asm+0x1b/0x30 [ 4992.629838][ C1] [ 5020.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3569s! [swapper/0:0] [ 5020.527920][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5020.529124][ C0] irq event stamp: 27567077 [ 5020.529368][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5020.529901][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5020.530377][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5020.530881][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5020.531378][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5020.531865][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5020.532510][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5020.532850][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5020.533868][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5020.534191][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5020.534609][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5020.535026][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5020.535447][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5020.535865][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5020.536289][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5020.536757][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5020.537114][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5020.537537][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5020.537958][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5020.538381][ C0] Call Trace: [ 5020.538564][ C0] [ 5020.538725][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5020.539001][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5020.539260][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5020.539550][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5020.539838][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5020.540146][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5020.540428][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5020.540755][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5020.541031][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5020.541310][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5020.541631][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5020.541950][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5020.542281][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5020.542589][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5020.542900][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5020.543203][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5020.543528][ C0] ? get_stack_info+0x36/0xc0 [ 5020.543786][ C0] ? lock_acquire+0x1c1/0x220 [ 5020.544043][ C0] ? lock_release+0x1d5/0x250 [ 5020.544298][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5020.544566][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5020.544856][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5020.545159][ C0] ? lock_acquire+0x1c1/0x220 [ 5020.545406][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5020.545658][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5020.545931][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5020.546181][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5020.546446][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5020.546722][ C0] ? __inet_lookup_established+0x341/0x610 [ 5020.547040][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5020.547329][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5020.547621][ C0] ip_local_deliver+0x19d/0x480 [ 5020.547884][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5020.548171][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5020.548442][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5020.548718][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5020.548984][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5020.549326][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5020.549601][ C0] ip_rcv+0x564/0x740 [ 5020.549813][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5020.550059][ C0] ? set_track_prepare+0x8a/0xd0 [ 5020.550324][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5020.550619][ C0] ? rest_init+0x153/0x260 [ 5020.550854][ C0] ? skb_clone+0x10b/0x330 [ 5020.551098][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5020.551433][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5020.551752][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5020.552057][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5020.552365][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5020.552623][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5020.552862][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5020.553179][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5020.553479][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5020.553821][ C0] ? lock_acquire+0x1c1/0x220 [ 5020.554074][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5020.554390][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5020.554687][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5020.555023][ C0] ? __copy_skb_header+0xaf/0x490 [ 5020.555293][ C0] ? __skb_clone+0x57a/0x760 [ 5020.555542][ C0] netif_receive_skb+0x55/0x280 [ 5020.555800][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5020.556129][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5020.556476][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5020.556790][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5020.557077][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5020.557373][ C0] ? hlock_class+0x4e/0x130 [ 5020.557616][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5020.557946][ C0] ? place_entity+0x21/0x2f0 [ 5020.558195][ C0] ? resched_curr+0x219/0x280 [ 5020.558450][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5020.558720][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5020.559003][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5020.559279][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5020.559536][ C0] ? activate_task+0xf5/0x260 [ 5020.559785][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5020.560060][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5020.560334][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5020.560591][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5020.560881][ C0] ? get_stack_info+0x36/0xc0 [ 5020.561138][ C0] ? stack_access_ok+0xda/0x1f0 [ 5020.561399][ C0] ? get_reg+0x119/0x190 [ 5020.561628][ C0] __tcf_classify+0x32c/0x7d0 [ 5020.561885][ C0] tcf_classify+0x283/0x930 [ 5020.562131][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5020.562462][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5020.562727][ C0] ? arch_stack_walk+0x8c/0x100 [ 5020.562987][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5020.563277][ C0] tc_run+0x2e4/0x5d0 [ 5020.563493][ C0] ? __pfx_tc_run+0x10/0x10 [ 5020.563738][ C0] ? lock_acquire+0x1c1/0x220 [ 5020.563989][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5020.564270][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5020.564535][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5020.564822][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5020.565104][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5020.565425][ C0] ? neigh_hh_output+0x348/0x590 [ 5020.565690][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5020.565971][ C0] ip_finish_output2+0x786/0x18e0 [ 5020.566244][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5020.566538][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5020.566890][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5020.567181][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5020.567450][ C0] ? __ip_finish_output+0x10f/0x770 [ 5020.567725][ C0] ip_output+0x16b/0x4f0 [ 5020.567954][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5020.568242][ C0] ? __pfx_ip_output+0x10/0x10 [ 5020.568495][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5020.568799][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5020.569062][ C0] ? ip_local_out+0x114/0x3b0 [ 5020.569316][ C0] __ip_queue_xmit+0x672/0x1910 [ 5020.569581][ C0] ? __skb_clone+0x57a/0x760 [ 5020.569831][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5020.570110][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5020.570403][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5020.570720][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5020.570980][ C0] ? tcp_current_mss+0x40a/0x510 [ 5020.571243][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5020.571529][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5020.571803][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5020.572062][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5020.572329][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5020.572646][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5020.572926][ C0] ? ktime_get+0xb6/0x190 [ 5020.573160][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5020.573437][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5020.573715][ C0] tcp_write_timer+0x82/0x1d0 [ 5020.573969][ C0] call_timer_fn+0x176/0x430 [ 5020.574220][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5020.574498][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5020.574772][ C0] __run_timers.part.0+0x52d/0x890 [ 5020.575044][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5020.575329][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5020.575626][ C0] ? lock_acquire+0x1c1/0x220 [ 5020.575877][ C0] ? clockevents_program_event+0xf6/0x300 [ 5020.576189][ C0] ? lock_release+0x1d5/0x250 [ 5020.576443][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5020.576722][ C0] ? ktime_get+0xb6/0x190 [ 5020.576957][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5020.577258][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5020.577567][ C0] run_timer_softirq+0x72/0x100 [ 5020.577828][ C0] __do_softirq+0x1bc/0x7ff [ 5020.578074][ C0] irq_exit_rcu+0x98/0xc0 [ 5020.578307][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5020.578608][ C0] [ 5020.578765][ C0] [ 5020.578921][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5020.579242][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5020.579513][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5020.580535][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5020.580861][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5020.581281][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5020.581703][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5020.582130][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5020.582544][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5020.582962][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5020.583264][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5020.583535][ C0] default_idle_call+0x69/0xa0 [ 5020.583788][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5020.584052][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5020.584345][ C0] ? lock_release+0x1d5/0x250 [ 5020.584596][ C0] do_idle+0xfb/0x160 [ 5020.584807][ C0] cpu_startup_entry+0x55/0x60 [ 5020.585059][ C0] rest_init+0x153/0x260 [ 5020.585294][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5020.585581][ C0] arch_call_rest_init+0x13/0x40 [ 5020.585847][ C0] start_kernel+0x314/0x3d0 [ 5020.586093][ C0] x86_64_start_reservations+0x18/0x30 [ 5020.586386][ C0] x86_64_start_kernel+0xba/0x110 [ 5020.586652][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5020.586976][ C0] [ 5020.587141][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3569s! [ksoftirqd/1:22] [ 5020.587606][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5020.588808][ C1] irq event stamp: 3886976 [ 5020.589050][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5020.589547][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5020.590042][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5020.590539][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5020.591036][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5020.591528][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5020.592184][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5020.592530][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5020.593564][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5020.593891][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5020.594321][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5020.594744][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5020.595168][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5020.595598][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5020.596025][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5020.596501][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5020.596852][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5020.597284][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5020.597705][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5020.598125][ C1] Call Trace: [ 5020.598301][ C1] [ 5020.598457][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5020.598737][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5020.598993][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5020.599289][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5020.599575][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5020.599878][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5020.600157][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5020.600477][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5020.600757][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5020.601081][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5020.601393][ C1] [ 5020.601553][ C1] [ 5020.601713][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5020.602051][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5020.602361][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5020.602675][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5020.602979][ C1] ? run_ksoftirqd+0xb/0x60 [ 5020.603227][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5020.603552][ C1] ? __orc_find+0x9c/0xf0 [ 5020.603787][ C1] ? lock_acquire+0x1c1/0x220 [ 5020.604043][ C1] ? irqentry_enter+0x2b/0x60 [ 5020.604301][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5020.604565][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5020.604856][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5020.605161][ C1] ? lock_acquire+0x1c1/0x220 [ 5020.605411][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5020.605665][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5020.605938][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5020.606189][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5020.606451][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5020.606728][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5020.607021][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5020.607315][ C1] ip_local_deliver+0x19d/0x480 [ 5020.607572][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5020.607855][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5020.608122][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5020.608404][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5020.608673][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5020.609009][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5020.609287][ C1] ip_rcv+0x564/0x740 [ 5020.609508][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5020.609754][ C1] ? set_track_prepare+0x8a/0xd0 [ 5020.610025][ C1] ? irqentry_enter+0x2b/0x60 [ 5020.610278][ C1] ? irqentry_enter+0x2b/0x60 [ 5020.610531][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5020.610774][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5020.611089][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5020.611428][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5020.611739][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5020.612086][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5020.612386][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5020.612728][ C1] netif_receive_skb+0x55/0x280 [ 5020.612994][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5020.613326][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5020.613680][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5020.613993][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5020.614286][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5020.614592][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5020.614925][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5020.615211][ C1] ? arch_stack_walk+0x68/0x100 [ 5020.615472][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5020.615749][ C1] ? irqentry_enter+0x2b/0x60 [ 5020.616001][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5020.616321][ C1] ? irqentry_enter+0x2b/0x60 [ 5020.616577][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5020.616903][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5020.617187][ C1] ? arch_stack_walk+0x68/0x100 [ 5020.617450][ C1] __tcf_classify+0x32c/0x7d0 [ 5020.617704][ C1] tcf_classify+0x283/0x930 [ 5020.617950][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5020.618223][ C1] tc_run+0x2e4/0x5d0 [ 5020.618445][ C1] ? __pfx_tc_run+0x10/0x10 [ 5020.618693][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5020.618965][ C1] ? irqentry_enter+0x2b/0x60 [ 5020.619219][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5020.619508][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5020.619830][ C1] ip_finish_output2+0x786/0x18e0 [ 5020.620108][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5020.620401][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5020.620665][ C1] ? __ip_finish_output+0x10f/0x770 [ 5020.620947][ C1] ip_output+0x16b/0x4f0 [ 5020.621180][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5020.621498][ C1] ? __pfx_ip_output+0x10/0x10 [ 5020.621760][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5020.622121][ C1] ? __pfx_ip_output+0x10/0x10 [ 5020.622380][ C1] __ip_queue_xmit+0x672/0x1910 [ 5020.622640][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5020.622920][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5020.623214][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5020.623499][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5020.623794][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5020.624083][ C1] tcp_delack_timer+0x84/0x240 [ 5020.624341][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5020.624632][ C1] call_timer_fn+0x176/0x430 [ 5020.624884][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5020.625159][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5020.625441][ C1] __run_timers.part.0+0x52d/0x890 [ 5020.625717][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5020.626005][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5020.626308][ C1] ? __pfx___schedule+0x10/0x10 [ 5020.626571][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5020.626896][ C1] run_timer_softirq+0x72/0x100 [ 5020.627158][ C1] __do_softirq+0x1bc/0x7ff [ 5020.627401][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5020.627675][ C1] run_ksoftirqd+0x2e/0x60 [ 5020.627918][ C1] smpboot_thread_fn+0x30e/0x840 [ 5020.628183][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5020.628479][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5020.628771][ C1] kthread+0x292/0x360 [ 5020.628990][ C1] ? __pfx_kthread+0x10/0x10 [ 5020.629236][ C1] ret_from_fork+0x34/0x70 [ 5020.629478][ C1] ? __pfx_kthread+0x10/0x10 [ 5020.629723][ C1] ret_from_fork_asm+0x1b/0x30 [ 5020.629988][ C1] [ 5046.417024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5046.417404][ C1] rcu: 1-....: (3841438 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=916997 [ 5046.417989][ C1] rcu: (t=3852108 jiffies g=1007429 q=31 ncpus=4) [ 5046.418336][ C1] Sending NMI from CPU 1 to CPUs 0: [ 5046.418627][ C0] NMI backtrace for cpu 0 [ 5046.418636][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5046.418640][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5046.418642][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5046.418652][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5046.418656][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5046.418659][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5046.418661][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5046.418663][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5046.418665][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5046.418666][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5046.418668][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5046.418670][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5046.418674][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5046.418676][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5046.418677][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5046.418679][ C0] Call Trace: [ 5046.418682][ C0] [ 5046.418686][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 5046.418692][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5046.418698][ C0] ? nmi_handle+0x156/0x420 [ 5046.418703][ C0] ? default_do_nmi+0x41/0x100 [ 5046.418707][ C0] ? exc_nmi+0xf3/0x120 [ 5046.418710][ C0] ? end_repeat_nmi+0xf/0x60 [ 5046.418715][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5046.418718][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5046.418722][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5046.418726][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5046.418729][ C0] [ 5046.418730][ C0] [ 5046.418731][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5046.418734][ C0] ? get_stack_info+0x36/0xc0 [ 5046.418739][ C0] ? lock_acquire+0x1c1/0x220 [ 5046.418744][ C0] ? lock_release+0x1d5/0x250 [ 5046.418747][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5046.418752][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5046.418755][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5046.418758][ C0] ? lock_acquire+0x1c1/0x220 [ 5046.418760][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5046.418766][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5046.418770][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5046.418777][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5046.418780][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5046.418785][ C0] ? __inet_lookup_established+0x341/0x610 [ 5046.418791][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5046.418799][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5046.418803][ C0] ip_local_deliver+0x19d/0x480 [ 5046.418806][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5046.418808][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5046.418813][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5046.418817][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5046.418821][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5046.418824][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5046.418836][ C0] ip_rcv+0x564/0x740 [ 5046.418839][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5046.418842][ C0] ? set_track_prepare+0x8a/0xd0 [ 5046.418847][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5046.418849][ C0] ? rest_init+0x153/0x260 [ 5046.418852][ C0] ? skb_clone+0x10b/0x330 [ 5046.418858][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5046.418863][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5046.418869][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5046.418873][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5046.418883][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5046.418886][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5046.418889][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5046.418893][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5046.418897][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5046.418900][ C0] ? lock_acquire+0x1c1/0x220 [ 5046.418902][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5046.418906][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5046.418909][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5046.418912][ C0] ? __copy_skb_header+0xaf/0x490 [ 5046.418915][ C0] ? __skb_clone+0x57a/0x760 [ 5046.418917][ C0] netif_receive_skb+0x55/0x280 [ 5046.418920][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5046.418928][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5046.418935][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5046.418942][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5046.418947][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5046.418956][ C0] ? hlock_class+0x4e/0x130 [ 5046.418961][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5046.418971][ C0] ? place_entity+0x21/0x2f0 [ 5046.418974][ C0] ? resched_curr+0x219/0x280 [ 5046.418978][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5046.418981][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5046.418986][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5046.418990][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5046.418993][ C0] ? activate_task+0xf5/0x260 [ 5046.418996][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5046.419001][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5046.419004][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5046.419008][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5046.419011][ C0] ? get_stack_info+0x36/0xc0 [ 5046.419014][ C0] ? stack_access_ok+0xda/0x1f0 [ 5046.419017][ C0] ? get_reg+0x119/0x190 [ 5046.419022][ C0] __tcf_classify+0x32c/0x7d0 [ 5046.419027][ C0] tcf_classify+0x283/0x930 [ 5046.419029][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5046.419035][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5046.419038][ C0] ? arch_stack_walk+0x8c/0x100 [ 5046.419042][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5046.419045][ C0] tc_run+0x2e4/0x5d0 [ 5046.419050][ C0] ? __pfx_tc_run+0x10/0x10 [ 5046.419053][ C0] ? lock_acquire+0x1c1/0x220 [ 5046.419055][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5046.419060][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5046.419066][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5046.419069][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5046.419073][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5046.419078][ C0] ? neigh_hh_output+0x348/0x590 [ 5046.419082][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5046.419086][ C0] ip_finish_output2+0x786/0x18e0 [ 5046.419089][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5046.419095][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5046.419103][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5046.419106][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5046.419110][ C0] ? __ip_finish_output+0x10f/0x770 [ 5046.419114][ C0] ip_output+0x16b/0x4f0 [ 5046.419117][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5046.419123][ C0] ? __pfx_ip_output+0x10/0x10 [ 5046.419126][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5046.419131][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5046.419134][ C0] ? ip_local_out+0x114/0x3b0 [ 5046.419138][ C0] __ip_queue_xmit+0x672/0x1910 [ 5046.419142][ C0] ? __skb_clone+0x57a/0x760 [ 5046.419145][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5046.419152][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5046.419157][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5046.419161][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5046.419166][ C0] ? tcp_current_mss+0x40a/0x510 [ 5046.419169][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5046.419172][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5046.419175][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5046.419177][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5046.419180][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5046.419184][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5046.419189][ C0] ? ktime_get+0xb6/0x190 [ 5046.419193][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5046.419197][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5046.419200][ C0] tcp_write_timer+0x82/0x1d0 [ 5046.419204][ C0] call_timer_fn+0x176/0x430 [ 5046.419208][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5046.419213][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5046.419217][ C0] __run_timers.part.0+0x52d/0x890 [ 5046.419220][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5046.419225][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5046.419228][ C0] ? lock_acquire+0x1c1/0x220 [ 5046.419230][ C0] ? clockevents_program_event+0xf6/0x300 [ 5046.419236][ C0] ? lock_release+0x1d5/0x250 [ 5046.419239][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5046.419241][ C0] ? ktime_get+0xb6/0x190 [ 5046.419244][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5046.419248][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5046.419252][ C0] run_timer_softirq+0x72/0x100 [ 5046.419256][ C0] __do_softirq+0x1bc/0x7ff [ 5046.419260][ C0] irq_exit_rcu+0x98/0xc0 [ 5046.419264][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5046.419267][ C0] [ 5046.419268][ C0] [ 5046.419269][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5046.419276][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5046.419279][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5046.419281][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5046.419283][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5046.419284][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5046.419286][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5046.419288][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5046.419289][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5046.419293][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5046.419296][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5046.419300][ C0] default_idle_call+0x69/0xa0 [ 5046.419302][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5046.419305][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5046.419310][ C0] ? lock_release+0x1d5/0x250 [ 5046.419314][ C0] do_idle+0xfb/0x160 [ 5046.419317][ C0] cpu_startup_entry+0x55/0x60 [ 5046.419320][ C0] rest_init+0x153/0x260 [ 5046.419322][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5046.419328][ C0] arch_call_rest_init+0x13/0x40 [ 5046.419334][ C0] start_kernel+0x314/0x3d0 [ 5046.419338][ C0] x86_64_start_reservations+0x18/0x30 [ 5046.419342][ C0] x86_64_start_kernel+0xba/0x110 [ 5046.419346][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5046.419355][ C0] [ 5046.419624][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5046.473918][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5046.474570][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5046.474921][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5046.475952][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5046.476280][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5046.476708][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5046.477136][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5046.477557][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5046.477980][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5046.478406][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5046.478882][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5046.479230][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5046.479658][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5046.480081][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5046.480499][ C1] Call Trace: [ 5046.480675][ C1] [ 5046.480832][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5046.481123][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5046.481386][ C1] ? check_cpu_stall+0x284/0x500 [ 5046.481652][ C1] ? rcu_pending+0x92/0x360 [ 5046.481900][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5046.482186][ C1] ? update_process_times+0xb9/0x110 [ 5046.482468][ C1] ? tick_sched_handle+0x67/0x130 [ 5046.482741][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5046.483046][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5046.483304][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5046.483636][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5046.483923][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5046.484227][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5046.484503][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5046.484825][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5046.485103][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5046.485425][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5046.485736][ C1] [ 5046.485896][ C1] [ 5046.486058][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5046.486390][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5046.486691][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5046.487000][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5046.487308][ C1] ? run_ksoftirqd+0xb/0x60 [ 5046.487556][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5046.487884][ C1] ? __orc_find+0x9c/0xf0 [ 5046.488114][ C1] ? lock_acquire+0x1c1/0x220 [ 5046.488365][ C1] ? irqentry_enter+0x2b/0x60 [ 5046.488615][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5046.488873][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5046.489158][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5046.489458][ C1] ? lock_acquire+0x1c1/0x220 [ 5046.489713][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5046.489980][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5046.490254][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5046.490498][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5046.490753][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5046.491028][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5046.491318][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5046.491608][ C1] ip_local_deliver+0x19d/0x480 [ 5046.491877][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5046.492163][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5046.492427][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5046.492709][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5046.492977][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5046.493314][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5046.493590][ C1] ip_rcv+0x564/0x740 [ 5046.493808][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5046.494054][ C1] ? set_track_prepare+0x8a/0xd0 [ 5046.494322][ C1] ? irqentry_enter+0x2b/0x60 [ 5046.494572][ C1] ? irqentry_enter+0x2b/0x60 [ 5046.494824][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5046.495065][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5046.495378][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5046.495718][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5046.496028][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5046.496372][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5046.496674][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5046.497006][ C1] netif_receive_skb+0x55/0x280 [ 5046.497265][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5046.497590][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5046.497938][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5046.498256][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5046.498545][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5046.498847][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5046.499176][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5046.499458][ C1] ? arch_stack_walk+0x68/0x100 [ 5046.499722][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5046.500003][ C1] ? irqentry_enter+0x2b/0x60 [ 5046.500260][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5046.500581][ C1] ? irqentry_enter+0x2b/0x60 [ 5046.500829][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5046.501150][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5046.501432][ C1] ? arch_stack_walk+0x68/0x100 [ 5046.501692][ C1] __tcf_classify+0x32c/0x7d0 [ 5046.501949][ C1] tcf_classify+0x283/0x930 [ 5046.502198][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5046.502470][ C1] tc_run+0x2e4/0x5d0 [ 5046.502689][ C1] ? __pfx_tc_run+0x10/0x10 [ 5046.502936][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5046.503208][ C1] ? irqentry_enter+0x2b/0x60 [ 5046.503459][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5046.503745][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5046.504067][ C1] ip_finish_output2+0x786/0x18e0 [ 5046.504341][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5046.504634][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5046.504897][ C1] ? __ip_finish_output+0x10f/0x770 [ 5046.505179][ C1] ip_output+0x16b/0x4f0 [ 5046.505408][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5046.505724][ C1] ? __pfx_ip_output+0x10/0x10 [ 5046.505982][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5046.506334][ C1] ? __pfx_ip_output+0x10/0x10 [ 5046.506591][ C1] __ip_queue_xmit+0x672/0x1910 [ 5046.506854][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5046.507139][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5046.507436][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5046.507724][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5046.508022][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5046.508312][ C1] tcp_delack_timer+0x84/0x240 [ 5046.508573][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5046.508858][ C1] call_timer_fn+0x176/0x430 [ 5046.509106][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5046.509384][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5046.509660][ C1] __run_timers.part.0+0x52d/0x890 [ 5046.509931][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5046.510224][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5046.510527][ C1] ? __pfx___schedule+0x10/0x10 [ 5046.510787][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5046.511109][ C1] run_timer_softirq+0x72/0x100 [ 5046.511372][ C1] __do_softirq+0x1bc/0x7ff [ 5046.511619][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5046.511900][ C1] run_ksoftirqd+0x2e/0x60 [ 5046.512142][ C1] smpboot_thread_fn+0x30e/0x840 [ 5046.512406][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5046.512698][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5046.512986][ C1] kthread+0x292/0x360 [ 5046.513209][ C1] ? __pfx_kthread+0x10/0x10 [ 5046.513457][ C1] ret_from_fork+0x34/0x70 [ 5046.513697][ C1] ? __pfx_kthread+0x10/0x10 [ 5046.513940][ C1] ret_from_fork_asm+0x1b/0x30 [ 5046.514203][ C1] [ 5072.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3618s! [swapper/0:0] [ 5072.527918][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5072.529121][ C0] irq event stamp: 27567077 [ 5072.529364][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5072.529897][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5072.530367][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5072.530868][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5072.531363][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5072.531851][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5072.532495][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5072.532834][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5072.533852][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5072.534176][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5072.534594][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5072.535011][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5072.535432][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5072.535853][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5072.536271][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5072.536738][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5072.537091][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5072.537515][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5072.537936][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5072.538361][ C0] Call Trace: [ 5072.538547][ C0] [ 5072.538702][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5072.538977][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5072.539234][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5072.539522][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5072.539811][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5072.540117][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5072.540399][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5072.540720][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5072.540992][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5072.541272][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5072.541596][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5072.541911][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5072.542239][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5072.542546][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5072.542856][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5072.543159][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5072.543485][ C0] ? get_stack_info+0x36/0xc0 [ 5072.543743][ C0] ? lock_acquire+0x1c1/0x220 [ 5072.543999][ C0] ? lock_release+0x1d5/0x250 [ 5072.544255][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5072.544518][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5072.544804][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5072.545103][ C0] ? lock_acquire+0x1c1/0x220 [ 5072.545348][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5072.545599][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5072.545870][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5072.546122][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5072.546384][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5072.546655][ C0] ? __inet_lookup_established+0x341/0x610 [ 5072.546973][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5072.547262][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5072.547552][ C0] ip_local_deliver+0x19d/0x480 [ 5072.547812][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5072.548098][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5072.548365][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5072.548639][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5072.548903][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5072.549241][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5072.549514][ C0] ip_rcv+0x564/0x740 [ 5072.549727][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5072.549966][ C0] ? set_track_prepare+0x8a/0xd0 [ 5072.550232][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5072.550522][ C0] ? rest_init+0x153/0x260 [ 5072.550764][ C0] ? skb_clone+0x10b/0x330 [ 5072.551005][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5072.551338][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5072.551665][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5072.551964][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5072.552272][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5072.552534][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5072.552773][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5072.553085][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5072.553382][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5072.553725][ C0] ? lock_acquire+0x1c1/0x220 [ 5072.553978][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5072.554291][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5072.554587][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5072.554921][ C0] ? __copy_skb_header+0xaf/0x490 [ 5072.555193][ C0] ? __skb_clone+0x57a/0x760 [ 5072.555442][ C0] netif_receive_skb+0x55/0x280 [ 5072.555701][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5072.556026][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5072.556373][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5072.556687][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5072.556972][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5072.557271][ C0] ? hlock_class+0x4e/0x130 [ 5072.557514][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5072.557844][ C0] ? place_entity+0x21/0x2f0 [ 5072.558090][ C0] ? resched_curr+0x219/0x280 [ 5072.558343][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5072.558617][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5072.558900][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5072.559176][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5072.559430][ C0] ? activate_task+0xf5/0x260 [ 5072.559677][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5072.559951][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5072.560228][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5072.560487][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5072.560776][ C0] ? get_stack_info+0x36/0xc0 [ 5072.561029][ C0] ? stack_access_ok+0xda/0x1f0 [ 5072.561288][ C0] ? get_reg+0x119/0x190 [ 5072.561523][ C0] __tcf_classify+0x32c/0x7d0 [ 5072.561784][ C0] tcf_classify+0x283/0x930 [ 5072.562030][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5072.562360][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5072.562625][ C0] ? arch_stack_walk+0x8c/0x100 [ 5072.562886][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5072.563174][ C0] tc_run+0x2e4/0x5d0 [ 5072.563394][ C0] ? __pfx_tc_run+0x10/0x10 [ 5072.563639][ C0] ? lock_acquire+0x1c1/0x220 [ 5072.563895][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5072.564174][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5072.564439][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5072.564727][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5072.565007][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5072.565332][ C0] ? neigh_hh_output+0x348/0x590 [ 5072.565597][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5072.565884][ C0] ip_finish_output2+0x786/0x18e0 [ 5072.566155][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5072.566449][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5072.566800][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5072.567090][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5072.567356][ C0] ? __ip_finish_output+0x10f/0x770 [ 5072.567631][ C0] ip_output+0x16b/0x4f0 [ 5072.567859][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5072.568146][ C0] ? __pfx_ip_output+0x10/0x10 [ 5072.568403][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5072.568706][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5072.568967][ C0] ? ip_local_out+0x114/0x3b0 [ 5072.569223][ C0] __ip_queue_xmit+0x672/0x1910 [ 5072.569489][ C0] ? __skb_clone+0x57a/0x760 [ 5072.569739][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5072.570018][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5072.570313][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5072.570629][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5072.570887][ C0] ? tcp_current_mss+0x40a/0x510 [ 5072.571155][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5072.571439][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5072.571720][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5072.571976][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5072.572244][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5072.572563][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5072.572843][ C0] ? ktime_get+0xb6/0x190 [ 5072.573082][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5072.573362][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5072.573643][ C0] tcp_write_timer+0x82/0x1d0 [ 5072.573899][ C0] call_timer_fn+0x176/0x430 [ 5072.574148][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5072.574421][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5072.574698][ C0] __run_timers.part.0+0x52d/0x890 [ 5072.574972][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5072.575256][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5072.575551][ C0] ? lock_acquire+0x1c1/0x220 [ 5072.575804][ C0] ? clockevents_program_event+0xf6/0x300 [ 5072.576114][ C0] ? lock_release+0x1d5/0x250 [ 5072.576366][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5072.576650][ C0] ? ktime_get+0xb6/0x190 [ 5072.576882][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5072.577184][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5072.577492][ C0] run_timer_softirq+0x72/0x100 [ 5072.577753][ C0] __do_softirq+0x1bc/0x7ff [ 5072.578000][ C0] irq_exit_rcu+0x98/0xc0 [ 5072.578234][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5072.578534][ C0] [ 5072.578689][ C0] [ 5072.578845][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5072.579160][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5072.579429][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5072.580453][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5072.580776][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5072.581199][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5072.581626][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5072.582051][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5072.582465][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5072.582880][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5072.583180][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5072.583452][ C0] default_idle_call+0x69/0xa0 [ 5072.583712][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5072.583974][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5072.584268][ C0] ? lock_release+0x1d5/0x250 [ 5072.584516][ C0] do_idle+0xfb/0x160 [ 5072.584727][ C0] cpu_startup_entry+0x55/0x60 [ 5072.584978][ C0] rest_init+0x153/0x260 [ 5072.585209][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5072.585496][ C0] arch_call_rest_init+0x13/0x40 [ 5072.585762][ C0] start_kernel+0x314/0x3d0 [ 5072.586006][ C0] x86_64_start_reservations+0x18/0x30 [ 5072.586298][ C0] x86_64_start_kernel+0xba/0x110 [ 5072.586565][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5072.586891][ C0] [ 5072.587057][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3618s! [ksoftirqd/1:22] [ 5072.587523][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5072.588730][ C1] irq event stamp: 3886976 [ 5072.588969][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5072.589465][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5072.589955][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5072.590452][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5072.590947][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5072.591439][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5072.592093][ C1] RIP: 0010:__kasan_check_read+0x8/0x20 [ 5072.592391][ C1] Code: 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 48 8b 0c 24 <89> f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f [ 5072.593420][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [ 5072.593748][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5072.594173][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5072.594599][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5072.595027][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5072.595451][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5072.595874][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5072.596352][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5072.596702][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5072.597128][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5072.597548][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5072.597969][ C1] Call Trace: [ 5072.598150][ C1] [ 5072.598308][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5072.598591][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5072.598844][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5072.599141][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5072.599426][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5072.599728][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5072.600005][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5072.600327][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5072.600607][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5072.600932][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5072.601243][ C1] [ 5072.601404][ C1] [ 5072.601564][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5072.601903][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5072.602214][ C1] ? __kasan_check_read+0x8/0x20 [ 5072.602485][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 5072.602780][ C1] ? run_ksoftirqd+0xb/0x60 [ 5072.603023][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5072.603352][ C1] ? __orc_find+0x9c/0xf0 [ 5072.603585][ C1] ? lock_acquire+0x1c1/0x220 [ 5072.603841][ C1] ? irqentry_enter+0x2b/0x60 [ 5072.604099][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5072.604366][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5072.604657][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5072.604960][ C1] ? lock_acquire+0x1c1/0x220 [ 5072.605211][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5072.605463][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5072.605738][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5072.605988][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5072.606254][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5072.606528][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5072.606820][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5072.607114][ C1] ip_local_deliver+0x19d/0x480 [ 5072.607373][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5072.607659][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5072.607924][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5072.608208][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5072.608474][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5072.608811][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5072.609091][ C1] ip_rcv+0x564/0x740 [ 5072.609307][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5072.609554][ C1] ? set_track_prepare+0x8a/0xd0 [ 5072.609823][ C1] ? irqentry_enter+0x2b/0x60 [ 5072.610073][ C1] ? irqentry_enter+0x2b/0x60 [ 5072.610324][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5072.610566][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5072.610879][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5072.611221][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5072.611530][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5072.611877][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5072.612176][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5072.612516][ C1] netif_receive_skb+0x55/0x280 [ 5072.612781][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5072.613115][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5072.613469][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5072.613783][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5072.614076][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5072.614384][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5072.614716][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5072.615000][ C1] ? arch_stack_walk+0x68/0x100 [ 5072.615261][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5072.615536][ C1] ? irqentry_enter+0x2b/0x60 [ 5072.615787][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5072.616111][ C1] ? irqentry_enter+0x2b/0x60 [ 5072.616367][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5072.616691][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5072.616971][ C1] ? arch_stack_walk+0x68/0x100 [ 5072.617235][ C1] __tcf_classify+0x32c/0x7d0 [ 5072.617492][ C1] tcf_classify+0x283/0x930 [ 5072.617738][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5072.618013][ C1] tc_run+0x2e4/0x5d0 [ 5072.618231][ C1] ? __pfx_tc_run+0x10/0x10 [ 5072.618481][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5072.618751][ C1] ? irqentry_enter+0x2b/0x60 [ 5072.619001][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5072.619286][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5072.619610][ C1] ip_finish_output2+0x786/0x18e0 [ 5072.619883][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5072.620177][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5072.620442][ C1] ? __ip_finish_output+0x10f/0x770 [ 5072.620724][ C1] ip_output+0x16b/0x4f0 [ 5072.620959][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5072.621285][ C1] ? __pfx_ip_output+0x10/0x10 [ 5072.621545][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5072.621905][ C1] ? __pfx_ip_output+0x10/0x10 [ 5072.622165][ C1] __ip_queue_xmit+0x672/0x1910 [ 5072.622427][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5072.622707][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5072.623003][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5072.623291][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5072.623588][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5072.623875][ C1] tcp_delack_timer+0x84/0x240 [ 5072.624132][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5072.624420][ C1] call_timer_fn+0x176/0x430 [ 5072.624671][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5072.624945][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5072.625231][ C1] __run_timers.part.0+0x52d/0x890 [ 5072.625509][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5072.625799][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5072.626103][ C1] ? __pfx___schedule+0x10/0x10 [ 5072.626366][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5072.626690][ C1] run_timer_softirq+0x72/0x100 [ 5072.626949][ C1] __do_softirq+0x1bc/0x7ff [ 5072.627192][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5072.627467][ C1] run_ksoftirqd+0x2e/0x60 [ 5072.627707][ C1] smpboot_thread_fn+0x30e/0x840 [ 5072.627974][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5072.628271][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5072.628562][ C1] kthread+0x292/0x360 [ 5072.628781][ C1] ? __pfx_kthread+0x10/0x10 [ 5072.629026][ C1] ret_from_fork+0x34/0x70 [ 5072.629268][ C1] ? __pfx_kthread+0x10/0x10 [ 5072.629516][ C1] ret_from_fork_asm+0x1b/0x30 [ 5072.629780][ C1] [ 5100.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3644s! [swapper/0:0] [ 5100.527924][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5100.529124][ C0] irq event stamp: 27567077 [ 5100.529365][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5100.529898][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5100.530369][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5100.530879][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5100.531375][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5100.531866][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5100.532509][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5100.532847][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5100.533860][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5100.534184][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5100.534599][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5100.535015][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5100.535433][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5100.535849][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5100.536266][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5100.536738][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5100.537088][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5100.537503][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5100.537920][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5100.538342][ C0] Call Trace: [ 5100.538527][ C0] [ 5100.538683][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5100.538958][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5100.539214][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5100.539501][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5100.539790][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5100.540096][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5100.540379][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5100.540700][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5100.540973][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5100.541253][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5100.541582][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5100.541897][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5100.542225][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5100.542532][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5100.542843][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5100.543146][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5100.543471][ C0] ? get_stack_info+0x36/0xc0 [ 5100.543733][ C0] ? lock_acquire+0x1c1/0x220 [ 5100.543988][ C0] ? lock_release+0x1d5/0x250 [ 5100.544243][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5100.544505][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5100.544791][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5100.545089][ C0] ? lock_acquire+0x1c1/0x220 [ 5100.545335][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5100.545589][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5100.545860][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5100.546111][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5100.546371][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5100.546642][ C0] ? __inet_lookup_established+0x341/0x610 [ 5100.546957][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5100.547245][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5100.547534][ C0] ip_local_deliver+0x19d/0x480 [ 5100.547793][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5100.548078][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5100.548344][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5100.548618][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5100.548879][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5100.549215][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5100.549488][ C0] ip_rcv+0x564/0x740 [ 5100.549700][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5100.549938][ C0] ? set_track_prepare+0x8a/0xd0 [ 5100.550203][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5100.550492][ C0] ? rest_init+0x153/0x260 [ 5100.550728][ C0] ? skb_clone+0x10b/0x330 [ 5100.550970][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5100.551304][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5100.551632][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5100.551926][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5100.552232][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5100.552488][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5100.552728][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5100.553040][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5100.553337][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5100.553679][ C0] ? lock_acquire+0x1c1/0x220 [ 5100.553931][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5100.554242][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5100.554538][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5100.554872][ C0] ? __copy_skb_header+0xaf/0x490 [ 5100.555144][ C0] ? __skb_clone+0x57a/0x760 [ 5100.555396][ C0] netif_receive_skb+0x55/0x280 [ 5100.555653][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5100.555978][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5100.556332][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5100.556647][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5100.556932][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5100.557230][ C0] ? hlock_class+0x4e/0x130 [ 5100.557475][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5100.557799][ C0] ? place_entity+0x21/0x2f0 [ 5100.558046][ C0] ? resched_curr+0x219/0x280 [ 5100.558298][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5100.558571][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5100.558855][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5100.559130][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5100.559385][ C0] ? activate_task+0xf5/0x260 [ 5100.559632][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5100.559907][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5100.560182][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5100.560441][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5100.560729][ C0] ? get_stack_info+0x36/0xc0 [ 5100.560982][ C0] ? stack_access_ok+0xda/0x1f0 [ 5100.561241][ C0] ? get_reg+0x119/0x190 [ 5100.561478][ C0] __tcf_classify+0x32c/0x7d0 [ 5100.561734][ C0] tcf_classify+0x283/0x930 [ 5100.561979][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5100.562308][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5100.562572][ C0] ? arch_stack_walk+0x8c/0x100 [ 5100.562832][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5100.563119][ C0] tc_run+0x2e4/0x5d0 [ 5100.563335][ C0] ? __pfx_tc_run+0x10/0x10 [ 5100.563580][ C0] ? lock_acquire+0x1c1/0x220 [ 5100.563830][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5100.564107][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5100.564372][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5100.564663][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5100.564942][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5100.565267][ C0] ? neigh_hh_output+0x348/0x590 [ 5100.565530][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5100.565811][ C0] ip_finish_output2+0x786/0x18e0 [ 5100.566081][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5100.566375][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5100.566725][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5100.567013][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5100.567279][ C0] ? __ip_finish_output+0x10f/0x770 [ 5100.567555][ C0] ip_output+0x16b/0x4f0 [ 5100.567782][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5100.568068][ C0] ? __pfx_ip_output+0x10/0x10 [ 5100.568324][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5100.568624][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5100.568885][ C0] ? ip_local_out+0x114/0x3b0 [ 5100.569141][ C0] __ip_queue_xmit+0x672/0x1910 [ 5100.569405][ C0] ? __skb_clone+0x57a/0x760 [ 5100.569655][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5100.569933][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5100.570227][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5100.570542][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5100.570800][ C0] ? tcp_current_mss+0x40a/0x510 [ 5100.571062][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5100.571346][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5100.571629][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5100.571884][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5100.572152][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5100.572469][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5100.572748][ C0] ? ktime_get+0xb6/0x190 [ 5100.572982][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5100.573258][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5100.573537][ C0] tcp_write_timer+0x82/0x1d0 [ 5100.573793][ C0] call_timer_fn+0x176/0x430 [ 5100.574043][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5100.574314][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5100.574595][ C0] __run_timers.part.0+0x52d/0x890 [ 5100.574864][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5100.575148][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5100.575442][ C0] ? lock_acquire+0x1c1/0x220 [ 5100.575693][ C0] ? clockevents_program_event+0xf6/0x300 [ 5100.576001][ C0] ? lock_release+0x1d5/0x250 [ 5100.576253][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5100.576531][ C0] ? ktime_get+0xb6/0x190 [ 5100.576762][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5100.577063][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5100.577370][ C0] run_timer_softirq+0x72/0x100 [ 5100.577630][ C0] __do_softirq+0x1bc/0x7ff [ 5100.577875][ C0] irq_exit_rcu+0x98/0xc0 [ 5100.578109][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5100.578407][ C0] [ 5100.578562][ C0] [ 5100.578717][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5100.579033][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5100.579304][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5100.580325][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5100.580648][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5100.581074][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5100.581508][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5100.581921][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5100.582337][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5100.582753][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5100.583054][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5100.583325][ C0] default_idle_call+0x69/0xa0 [ 5100.583582][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5100.583842][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5100.584135][ C0] ? lock_release+0x1d5/0x250 [ 5100.584382][ C0] do_idle+0xfb/0x160 [ 5100.584592][ C0] cpu_startup_entry+0x55/0x60 [ 5100.584843][ C0] rest_init+0x153/0x260 [ 5100.585072][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5100.585358][ C0] arch_call_rest_init+0x13/0x40 [ 5100.585622][ C0] start_kernel+0x314/0x3d0 [ 5100.585866][ C0] x86_64_start_reservations+0x18/0x30 [ 5100.586159][ C0] x86_64_start_kernel+0xba/0x110 [ 5100.586427][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5100.586753][ C0] [ 5100.586918][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3644s! [ksoftirqd/1:22] [ 5100.587393][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5100.588590][ C1] irq event stamp: 3886976 [ 5100.588827][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5100.589333][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5100.589835][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5100.590343][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5100.590834][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5100.591338][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5100.591988][ C1] RIP: 0010:kasan_check_range+0x54/0x1c0 [ 5100.592292][ C1] Code: ff fe 48 39 c7 77 23 44 89 c2 e8 57 e8 ff ff 83 f0 01 5b 5d 41 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd <4c> 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 [ 5100.593326][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000212 [ 5100.593656][ C1] RAX: ffff7fffffffffff RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5100.594084][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5100.594512][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5100.594937][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5100.595363][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5100.595789][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5100.596270][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5100.596621][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5100.597052][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5100.597476][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5100.597896][ C1] Call Trace: [ 5100.598075][ C1] [ 5100.598232][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5100.598513][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5100.598771][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5100.599067][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5100.599355][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5100.599657][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5100.599935][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5100.600259][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5100.600537][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5100.600860][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5100.601174][ C1] [ 5100.601335][ C1] [ 5100.601500][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5100.601832][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5100.602144][ C1] ? kasan_check_range+0x54/0x1c0 [ 5100.602417][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 5100.602716][ C1] ? run_ksoftirqd+0xb/0x60 [ 5100.602964][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5100.603297][ C1] ? __orc_find+0x9c/0xf0 [ 5100.603529][ C1] ? lock_acquire+0x1c1/0x220 [ 5100.603782][ C1] ? irqentry_enter+0x2b/0x60 [ 5100.604036][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5100.604297][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5100.604582][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5100.604881][ C1] ? lock_acquire+0x1c1/0x220 [ 5100.605137][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5100.605395][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5100.605673][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5100.605920][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5100.606182][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5100.606454][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5100.606744][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5100.607039][ C1] ip_local_deliver+0x19d/0x480 [ 5100.607302][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5100.607590][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5100.607857][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5100.608134][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5100.608397][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5100.608738][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5100.609013][ C1] ip_rcv+0x564/0x740 [ 5100.609226][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5100.609467][ C1] ? set_track_prepare+0x8a/0xd0 [ 5100.609731][ C1] ? irqentry_enter+0x2b/0x60 [ 5100.609988][ C1] ? irqentry_enter+0x2b/0x60 [ 5100.610245][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5100.610491][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5100.610817][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5100.611162][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5100.611478][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5100.611821][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5100.612126][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5100.612460][ C1] netif_receive_skb+0x55/0x280 [ 5100.612719][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5100.613050][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5100.613398][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5100.613717][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5100.614010][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5100.614315][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5100.614645][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5100.614926][ C1] ? arch_stack_walk+0x68/0x100 [ 5100.615195][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5100.615475][ C1] ? irqentry_enter+0x2b/0x60 [ 5100.615732][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5100.616055][ C1] ? irqentry_enter+0x2b/0x60 [ 5100.616305][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5100.616630][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5100.616915][ C1] ? arch_stack_walk+0x68/0x100 [ 5100.617176][ C1] __tcf_classify+0x32c/0x7d0 [ 5100.617430][ C1] tcf_classify+0x283/0x930 [ 5100.617675][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5100.617944][ C1] tc_run+0x2e4/0x5d0 [ 5100.618160][ C1] ? __pfx_tc_run+0x10/0x10 [ 5100.618402][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5100.618670][ C1] ? irqentry_enter+0x2b/0x60 [ 5100.618925][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5100.619216][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5100.619542][ C1] ip_finish_output2+0x786/0x18e0 [ 5100.619812][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5100.620105][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5100.620373][ C1] ? __ip_finish_output+0x10f/0x770 [ 5100.620650][ C1] ip_output+0x16b/0x4f0 [ 5100.620876][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5100.621201][ C1] ? __pfx_ip_output+0x10/0x10 [ 5100.621460][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5100.621815][ C1] ? __pfx_ip_output+0x10/0x10 [ 5100.622075][ C1] __ip_queue_xmit+0x672/0x1910 [ 5100.622341][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5100.622627][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5100.622928][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5100.623218][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5100.623516][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5100.623804][ C1] tcp_delack_timer+0x84/0x240 [ 5100.624063][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5100.624346][ C1] call_timer_fn+0x176/0x430 [ 5100.624593][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5100.624872][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5100.625153][ C1] __run_timers.part.0+0x52d/0x890 [ 5100.625426][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5100.625716][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5100.626020][ C1] ? __pfx___schedule+0x10/0x10 [ 5100.626281][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5100.626601][ C1] run_timer_softirq+0x72/0x100 [ 5100.626869][ C1] __do_softirq+0x1bc/0x7ff [ 5100.627118][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5100.627396][ C1] run_ksoftirqd+0x2e/0x60 [ 5100.627635][ C1] smpboot_thread_fn+0x30e/0x840 [ 5100.627904][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5100.628195][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5100.628487][ C1] kthread+0x292/0x360 [ 5100.628707][ C1] ? __pfx_kthread+0x10/0x10 [ 5100.628958][ C1] ret_from_fork+0x34/0x70 [ 5100.629196][ C1] ? __pfx_kthread+0x10/0x10 [ 5100.629444][ C1] ret_from_fork_asm+0x1b/0x30 [ 5100.629702][ C1] [ 5124.515024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5124.515406][ C1] rcu: 1-....: (3919256 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=935485 [ 5124.515994][ C1] rcu: (t=3930206 jiffies g=1007429 q=31 ncpus=4) [ 5124.516346][ C1] Sending NMI from CPU 1 to CPUs 0: [ 5124.516631][ C0] NMI backtrace for cpu 0 [ 5124.516640][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5124.516645][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5124.516648][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5124.516658][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5124.516662][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5124.516665][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5124.516667][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5124.516669][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5124.516671][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5124.516673][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5124.516674][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5124.516677][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5124.516680][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5124.516682][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5124.516684][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5124.516685][ C0] Call Trace: [ 5124.516688][ C0] [ 5124.516692][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 5124.516699][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5124.516705][ C0] ? nmi_handle+0x156/0x420 [ 5124.516710][ C0] ? default_do_nmi+0x41/0x100 [ 5124.516714][ C0] ? exc_nmi+0xf3/0x120 [ 5124.516717][ C0] ? end_repeat_nmi+0xf/0x60 [ 5124.516722][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5124.516726][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5124.516729][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5124.516733][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5124.516736][ C0] [ 5124.516737][ C0] [ 5124.516739][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5124.516742][ C0] ? get_stack_info+0x36/0xc0 [ 5124.516747][ C0] ? lock_acquire+0x1c1/0x220 [ 5124.516752][ C0] ? lock_release+0x1d5/0x250 [ 5124.516755][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5124.516759][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5124.516762][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5124.516765][ C0] ? lock_acquire+0x1c1/0x220 [ 5124.516768][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5124.516774][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5124.516777][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5124.516785][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5124.516788][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5124.516791][ C0] ? __inet_lookup_established+0x341/0x610 [ 5124.516798][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5124.516805][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5124.516809][ C0] ip_local_deliver+0x19d/0x480 [ 5124.516812][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5124.516815][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5124.516820][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5124.516824][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5124.516826][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5124.516831][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5124.516841][ C0] ip_rcv+0x564/0x740 [ 5124.516844][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5124.516847][ C0] ? set_track_prepare+0x8a/0xd0 [ 5124.516852][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5124.516855][ C0] ? rest_init+0x153/0x260 [ 5124.516857][ C0] ? skb_clone+0x10b/0x330 [ 5124.516863][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5124.516870][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5124.516876][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5124.516881][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5124.516890][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5124.516893][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5124.516896][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5124.516900][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5124.516903][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5124.516907][ C0] ? lock_acquire+0x1c1/0x220 [ 5124.516909][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5124.516912][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5124.516915][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5124.516919][ C0] ? __copy_skb_header+0xaf/0x490 [ 5124.516922][ C0] ? __skb_clone+0x57a/0x760 [ 5124.516925][ C0] netif_receive_skb+0x55/0x280 [ 5124.516927][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5124.516936][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5124.516943][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5124.516950][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5124.516955][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5124.516964][ C0] ? hlock_class+0x4e/0x130 [ 5124.516969][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5124.516979][ C0] ? place_entity+0x21/0x2f0 [ 5124.516982][ C0] ? resched_curr+0x219/0x280 [ 5124.516986][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5124.516989][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5124.516993][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5124.516997][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5124.517000][ C0] ? activate_task+0xf5/0x260 [ 5124.517003][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5124.517008][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5124.517012][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5124.517015][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5124.517018][ C0] ? get_stack_info+0x36/0xc0 [ 5124.517023][ C0] ? stack_access_ok+0xda/0x1f0 [ 5124.517025][ C0] ? get_reg+0x119/0x190 [ 5124.517029][ C0] __tcf_classify+0x32c/0x7d0 [ 5124.517033][ C0] tcf_classify+0x283/0x930 [ 5124.517036][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5124.517042][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5124.517044][ C0] ? arch_stack_walk+0x8c/0x100 [ 5124.517048][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5124.517051][ C0] tc_run+0x2e4/0x5d0 [ 5124.517056][ C0] ? __pfx_tc_run+0x10/0x10 [ 5124.517059][ C0] ? lock_acquire+0x1c1/0x220 [ 5124.517061][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5124.517066][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5124.517072][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5124.517075][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5124.517078][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5124.517083][ C0] ? neigh_hh_output+0x348/0x590 [ 5124.517087][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5124.517092][ C0] ip_finish_output2+0x786/0x18e0 [ 5124.517095][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5124.517100][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5124.517108][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5124.517111][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5124.517115][ C0] ? __ip_finish_output+0x10f/0x770 [ 5124.517119][ C0] ip_output+0x16b/0x4f0 [ 5124.517123][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5124.517128][ C0] ? __pfx_ip_output+0x10/0x10 [ 5124.517131][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5124.517136][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5124.517139][ C0] ? ip_local_out+0x114/0x3b0 [ 5124.517143][ C0] __ip_queue_xmit+0x672/0x1910 [ 5124.517147][ C0] ? __skb_clone+0x57a/0x760 [ 5124.517150][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5124.517157][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5124.517161][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5124.517165][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5124.517170][ C0] ? tcp_current_mss+0x40a/0x510 [ 5124.517173][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5124.517176][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5124.517179][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5124.517181][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5124.517184][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5124.517188][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5124.517193][ C0] ? ktime_get+0xb6/0x190 [ 5124.517197][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5124.517201][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5124.517204][ C0] tcp_write_timer+0x82/0x1d0 [ 5124.517208][ C0] call_timer_fn+0x176/0x430 [ 5124.517212][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5124.517216][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5124.517220][ C0] __run_timers.part.0+0x52d/0x890 [ 5124.517223][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5124.517228][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5124.517231][ C0] ? lock_acquire+0x1c1/0x220 [ 5124.517233][ C0] ? clockevents_program_event+0xf6/0x300 [ 5124.517238][ C0] ? lock_release+0x1d5/0x250 [ 5124.517240][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5124.517243][ C0] ? ktime_get+0xb6/0x190 [ 5124.517246][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5124.517249][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5124.517254][ C0] run_timer_softirq+0x72/0x100 [ 5124.517257][ C0] __do_softirq+0x1bc/0x7ff [ 5124.517262][ C0] irq_exit_rcu+0x98/0xc0 [ 5124.517265][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5124.517269][ C0] [ 5124.517270][ C0] [ 5124.517271][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5124.517278][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5124.517281][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5124.517283][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5124.517285][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5124.517287][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5124.517289][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5124.517291][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5124.517292][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5124.517296][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5124.517300][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5124.517304][ C0] default_idle_call+0x69/0xa0 [ 5124.517306][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5124.517309][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5124.517314][ C0] ? lock_release+0x1d5/0x250 [ 5124.517317][ C0] do_idle+0xfb/0x160 [ 5124.517320][ C0] cpu_startup_entry+0x55/0x60 [ 5124.517323][ C0] rest_init+0x153/0x260 [ 5124.517325][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5124.517330][ C0] arch_call_rest_init+0x13/0x40 [ 5124.517336][ C0] start_kernel+0x314/0x3d0 [ 5124.517340][ C0] x86_64_start_reservations+0x18/0x30 [ 5124.517345][ C0] x86_64_start_kernel+0xba/0x110 [ 5124.517348][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5124.517356][ C0] [ 5124.517627][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5124.571861][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5124.572507][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5124.572853][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5124.573874][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5124.574202][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5124.574621][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5124.575040][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5124.575459][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5124.575876][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5124.576294][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5124.576762][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5124.577116][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5124.577535][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5124.577956][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5124.578383][ C1] Call Trace: [ 5124.578569][ C1] [ 5124.578727][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5124.579013][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5124.579283][ C1] ? check_cpu_stall+0x284/0x500 [ 5124.579546][ C1] ? rcu_pending+0x92/0x360 [ 5124.579790][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5124.580075][ C1] ? update_process_times+0xb9/0x110 [ 5124.580358][ C1] ? tick_sched_handle+0x67/0x130 [ 5124.580630][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5124.580931][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5124.581188][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5124.581521][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5124.581812][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5124.582119][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5124.582400][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5124.582720][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5124.582993][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5124.583323][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5124.583638][ C1] [ 5124.583795][ C1] [ 5124.583952][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5124.584284][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5124.584590][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5124.584903][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5124.585205][ C1] ? run_ksoftirqd+0xb/0x60 [ 5124.585448][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5124.585773][ C1] ? __orc_find+0x9c/0xf0 [ 5124.586006][ C1] ? lock_acquire+0x1c1/0x220 [ 5124.586264][ C1] ? irqentry_enter+0x2b/0x60 [ 5124.586521][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5124.586784][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5124.587073][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5124.587373][ C1] ? lock_acquire+0x1c1/0x220 [ 5124.587619][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5124.587869][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5124.588140][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5124.588391][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5124.588655][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5124.588931][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5124.589225][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5124.589521][ C1] ip_local_deliver+0x19d/0x480 [ 5124.589780][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5124.590067][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5124.590332][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5124.590613][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5124.590878][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5124.591214][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5124.591495][ C1] ip_rcv+0x564/0x740 [ 5124.591707][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5124.591948][ C1] ? set_track_prepare+0x8a/0xd0 [ 5124.592215][ C1] ? irqentry_enter+0x2b/0x60 [ 5124.592467][ C1] ? irqentry_enter+0x2b/0x60 [ 5124.592724][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5124.592968][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5124.593288][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5124.593635][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5124.593945][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5124.594284][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5124.594583][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5124.594919][ C1] netif_receive_skb+0x55/0x280 [ 5124.595183][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5124.595516][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5124.595866][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5124.596179][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5124.596472][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5124.596780][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5124.597112][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5124.597397][ C1] ? arch_stack_walk+0x68/0x100 [ 5124.597657][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5124.597933][ C1] ? irqentry_enter+0x2b/0x60 [ 5124.598182][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5124.598502][ C1] ? irqentry_enter+0x2b/0x60 [ 5124.598755][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5124.599083][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5124.599363][ C1] ? arch_stack_walk+0x68/0x100 [ 5124.599631][ C1] __tcf_classify+0x32c/0x7d0 [ 5124.599888][ C1] tcf_classify+0x283/0x930 [ 5124.600135][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5124.600408][ C1] tc_run+0x2e4/0x5d0 [ 5124.600624][ C1] ? __pfx_tc_run+0x10/0x10 [ 5124.600870][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5124.601139][ C1] ? irqentry_enter+0x2b/0x60 [ 5124.601390][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5124.601677][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5124.602003][ C1] ip_finish_output2+0x786/0x18e0 [ 5124.602274][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5124.602561][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5124.602833][ C1] ? __ip_finish_output+0x10f/0x770 [ 5124.603112][ C1] ip_output+0x16b/0x4f0 [ 5124.603338][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5124.603660][ C1] ? __pfx_ip_output+0x10/0x10 [ 5124.603917][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5124.604274][ C1] ? __pfx_ip_output+0x10/0x10 [ 5124.604535][ C1] __ip_queue_xmit+0x672/0x1910 [ 5124.604797][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5124.605079][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5124.605374][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5124.605659][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5124.605955][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5124.606239][ C1] tcp_delack_timer+0x84/0x240 [ 5124.606492][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5124.606778][ C1] call_timer_fn+0x176/0x430 [ 5124.607029][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5124.607304][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5124.607584][ C1] __run_timers.part.0+0x52d/0x890 [ 5124.607861][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5124.608147][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5124.608446][ C1] ? __pfx___schedule+0x10/0x10 [ 5124.608711][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5124.609032][ C1] run_timer_softirq+0x72/0x100 [ 5124.609291][ C1] __do_softirq+0x1bc/0x7ff [ 5124.609531][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5124.609802][ C1] run_ksoftirqd+0x2e/0x60 [ 5124.610044][ C1] smpboot_thread_fn+0x30e/0x840 [ 5124.610308][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5124.610600][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5124.610885][ C1] kthread+0x292/0x360 [ 5124.611108][ C1] ? __pfx_kthread+0x10/0x10 [ 5124.611357][ C1] ret_from_fork+0x34/0x70 [ 5124.611594][ C1] ? __pfx_kthread+0x10/0x10 [ 5124.611841][ C1] ret_from_fork_asm+0x1b/0x30 [ 5124.612101][ C1] [ 5148.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3688s! [swapper/0:0] [ 5148.527920][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5148.529121][ C0] irq event stamp: 27567077 [ 5148.529364][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5148.529902][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5148.530377][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5148.530878][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5148.531375][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5148.531860][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5148.532500][ C0] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 5148.532802][ C0] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 5148.533827][ C0] RSP: 0018:ffffc900000069c0 EFLAGS: 00000286 [ 5148.534158][ C0] RAX: ffff88800a099b5c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5148.534580][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5148.535002][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5148.535428][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5148.535853][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5148.536275][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5148.536747][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5148.537095][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5148.537522][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5148.537939][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5148.538358][ C0] Call Trace: [ 5148.538538][ C0] [ 5148.538692][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5148.538971][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5148.539223][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5148.539514][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5148.539796][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5148.540097][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5148.540375][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5148.540692][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5148.540967][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5148.541247][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5148.541567][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5148.541878][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5148.542212][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5148.542513][ C0] ? kasan_check_range+0x1a/0x1c0 [ 5148.542781][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 5148.543076][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5148.543400][ C0] ? get_stack_info+0x36/0xc0 [ 5148.543657][ C0] ? lock_acquire+0x1c1/0x220 [ 5148.543913][ C0] ? lock_release+0x1d5/0x250 [ 5148.544167][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5148.544433][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5148.544727][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5148.545027][ C0] ? lock_acquire+0x1c1/0x220 [ 5148.545273][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5148.545525][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5148.545797][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5148.546047][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5148.546311][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5148.546582][ C0] ? __inet_lookup_established+0x341/0x610 [ 5148.546899][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5148.547191][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5148.547485][ C0] ip_local_deliver+0x19d/0x480 [ 5148.547748][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5148.548036][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5148.548302][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5148.548579][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5148.548840][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5148.549180][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5148.549453][ C0] ip_rcv+0x564/0x740 [ 5148.549664][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5148.549904][ C0] ? set_track_prepare+0x8a/0xd0 [ 5148.550168][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5148.550460][ C0] ? rest_init+0x153/0x260 [ 5148.550696][ C0] ? skb_clone+0x10b/0x330 [ 5148.550939][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5148.551280][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5148.551601][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5148.551894][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5148.552202][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5148.552457][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5148.552696][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5148.553011][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5148.553309][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5148.553651][ C0] ? lock_acquire+0x1c1/0x220 [ 5148.553901][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5148.554216][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5148.554514][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5148.554848][ C0] ? __copy_skb_header+0xaf/0x490 [ 5148.555119][ C0] ? __skb_clone+0x57a/0x760 [ 5148.555367][ C0] netif_receive_skb+0x55/0x280 [ 5148.555625][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5148.555949][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5148.556297][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5148.556611][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5148.556897][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5148.557193][ C0] ? hlock_class+0x4e/0x130 [ 5148.557435][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5148.557764][ C0] ? place_entity+0x21/0x2f0 [ 5148.558011][ C0] ? resched_curr+0x219/0x280 [ 5148.558267][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5148.558537][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5148.558820][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5148.559095][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5148.559352][ C0] ? activate_task+0xf5/0x260 [ 5148.559600][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5148.559876][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5148.560151][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5148.560408][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5148.560699][ C0] ? get_stack_info+0x36/0xc0 [ 5148.560954][ C0] ? stack_access_ok+0xda/0x1f0 [ 5148.561215][ C0] ? get_reg+0x119/0x190 [ 5148.561454][ C0] __tcf_classify+0x32c/0x7d0 [ 5148.561709][ C0] tcf_classify+0x283/0x930 [ 5148.561954][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5148.562287][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5148.562552][ C0] ? arch_stack_walk+0x8c/0x100 [ 5148.562812][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5148.563102][ C0] tc_run+0x2e4/0x5d0 [ 5148.563316][ C0] ? __pfx_tc_run+0x10/0x10 [ 5148.563560][ C0] ? lock_acquire+0x1c1/0x220 [ 5148.563811][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5148.564093][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5148.564360][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5148.564653][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5148.564933][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5148.565259][ C0] ? neigh_hh_output+0x348/0x590 [ 5148.565523][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5148.565815][ C0] ip_finish_output2+0x786/0x18e0 [ 5148.566088][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5148.566382][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5148.566734][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5148.567025][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5148.567292][ C0] ? __ip_finish_output+0x10f/0x770 [ 5148.567568][ C0] ip_output+0x16b/0x4f0 [ 5148.567793][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5148.568079][ C0] ? __pfx_ip_output+0x10/0x10 [ 5148.568332][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5148.568635][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5148.568897][ C0] ? ip_local_out+0x114/0x3b0 [ 5148.569149][ C0] __ip_queue_xmit+0x672/0x1910 [ 5148.569412][ C0] ? __skb_clone+0x57a/0x760 [ 5148.569660][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5148.569939][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5148.570233][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5148.570549][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5148.570808][ C0] ? tcp_current_mss+0x40a/0x510 [ 5148.571071][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5148.571360][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5148.571639][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5148.571894][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5148.572161][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5148.572477][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5148.572757][ C0] ? ktime_get+0xb6/0x190 [ 5148.572995][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5148.573271][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5148.573553][ C0] tcp_write_timer+0x82/0x1d0 [ 5148.573807][ C0] call_timer_fn+0x176/0x430 [ 5148.574060][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5148.574333][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5148.574611][ C0] __run_timers.part.0+0x52d/0x890 [ 5148.574881][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5148.575165][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5148.575461][ C0] ? lock_acquire+0x1c1/0x220 [ 5148.575711][ C0] ? clockevents_program_event+0xf6/0x300 [ 5148.576019][ C0] ? lock_release+0x1d5/0x250 [ 5148.576274][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5148.576552][ C0] ? ktime_get+0xb6/0x190 [ 5148.576786][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5148.577086][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5148.577394][ C0] run_timer_softirq+0x72/0x100 [ 5148.577654][ C0] __do_softirq+0x1bc/0x7ff [ 5148.577899][ C0] irq_exit_rcu+0x98/0xc0 [ 5148.578132][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5148.578433][ C0] [ 5148.578588][ C0] [ 5148.578744][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5148.579065][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5148.579335][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5148.580359][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5148.580683][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5148.581104][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5148.581529][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5148.581946][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5148.582361][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5148.582778][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5148.583080][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5148.583352][ C0] default_idle_call+0x69/0xa0 [ 5148.583605][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5148.583868][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5148.584163][ C0] ? lock_release+0x1d5/0x250 [ 5148.584413][ C0] do_idle+0xfb/0x160 [ 5148.584625][ C0] cpu_startup_entry+0x55/0x60 [ 5148.584877][ C0] rest_init+0x153/0x260 [ 5148.585106][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5148.585395][ C0] arch_call_rest_init+0x13/0x40 [ 5148.585659][ C0] start_kernel+0x314/0x3d0 [ 5148.585904][ C0] x86_64_start_reservations+0x18/0x30 [ 5148.586198][ C0] x86_64_start_kernel+0xba/0x110 [ 5148.586465][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5148.586790][ C0] [ 5148.586953][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3688s! [ksoftirqd/1:22] [ 5148.587425][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5148.588625][ C1] irq event stamp: 3886976 [ 5148.588865][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5148.589364][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5148.589859][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5148.590359][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5148.590854][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5148.591353][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5148.592000][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5148.592347][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5148.593378][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5148.593703][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5148.594130][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5148.594558][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5148.594980][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5148.595403][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5148.595829][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5148.596309][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5148.596656][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5148.597085][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5148.597505][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5148.597923][ C1] Call Trace: [ 5148.598100][ C1] [ 5148.598260][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5148.598540][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5148.598796][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5148.599090][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5148.599375][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5148.599676][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5148.599953][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5148.600276][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5148.600554][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5148.600874][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5148.601190][ C1] [ 5148.601355][ C1] [ 5148.601512][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5148.601840][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5148.602148][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5148.602461][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5148.602762][ C1] ? run_ksoftirqd+0xb/0x60 [ 5148.603003][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5148.603327][ C1] ? __orc_find+0x9c/0xf0 [ 5148.603561][ C1] ? lock_acquire+0x1c1/0x220 [ 5148.603815][ C1] ? irqentry_enter+0x2b/0x60 [ 5148.604070][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5148.604332][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5148.604621][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5148.604924][ C1] ? lock_acquire+0x1c1/0x220 [ 5148.605176][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5148.605430][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5148.605707][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5148.605957][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5148.606221][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5148.606497][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5148.606790][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5148.607086][ C1] ip_local_deliver+0x19d/0x480 [ 5148.607346][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5148.607630][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5148.607894][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5148.608177][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5148.608445][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5148.608783][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5148.609061][ C1] ip_rcv+0x564/0x740 [ 5148.609278][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5148.609524][ C1] ? set_track_prepare+0x8a/0xd0 [ 5148.609791][ C1] ? irqentry_enter+0x2b/0x60 [ 5148.610044][ C1] ? irqentry_enter+0x2b/0x60 [ 5148.610297][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5148.610535][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5148.610849][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5148.611189][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5148.611503][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5148.611841][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5148.612141][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5148.612477][ C1] netif_receive_skb+0x55/0x280 [ 5148.612738][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5148.613072][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5148.613423][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5148.613737][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5148.614036][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5148.614344][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5148.614679][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5148.614964][ C1] ? arch_stack_walk+0x68/0x100 [ 5148.615226][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5148.615504][ C1] ? irqentry_enter+0x2b/0x60 [ 5148.615756][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5148.616074][ C1] ? irqentry_enter+0x2b/0x60 [ 5148.616327][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5148.616655][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5148.616937][ C1] ? arch_stack_walk+0x68/0x100 [ 5148.617202][ C1] __tcf_classify+0x32c/0x7d0 [ 5148.617458][ C1] tcf_classify+0x283/0x930 [ 5148.617706][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5148.617978][ C1] tc_run+0x2e4/0x5d0 [ 5148.618198][ C1] ? __pfx_tc_run+0x10/0x10 [ 5148.618445][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5148.618716][ C1] ? irqentry_enter+0x2b/0x60 [ 5148.618966][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5148.619256][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5148.619576][ C1] ip_finish_output2+0x786/0x18e0 [ 5148.619854][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5148.620152][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5148.620416][ C1] ? __ip_finish_output+0x10f/0x770 [ 5148.620697][ C1] ip_output+0x16b/0x4f0 [ 5148.620925][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5148.621246][ C1] ? __pfx_ip_output+0x10/0x10 [ 5148.621501][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5148.621859][ C1] ? __pfx_ip_output+0x10/0x10 [ 5148.622119][ C1] __ip_queue_xmit+0x672/0x1910 [ 5148.622381][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5148.622661][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5148.622956][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5148.623241][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5148.623533][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5148.623816][ C1] tcp_delack_timer+0x84/0x240 [ 5148.624072][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5148.624364][ C1] call_timer_fn+0x176/0x430 [ 5148.624614][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5148.624888][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5148.625171][ C1] __run_timers.part.0+0x52d/0x890 [ 5148.625448][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5148.625733][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5148.626034][ C1] ? __pfx___schedule+0x10/0x10 [ 5148.626297][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5148.626621][ C1] run_timer_softirq+0x72/0x100 [ 5148.626881][ C1] __do_softirq+0x1bc/0x7ff [ 5148.627126][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5148.627398][ C1] run_ksoftirqd+0x2e/0x60 [ 5148.627639][ C1] smpboot_thread_fn+0x30e/0x840 [ 5148.627902][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5148.628195][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5148.628484][ C1] kthread+0x292/0x360 [ 5148.628707][ C1] ? __pfx_kthread+0x10/0x10 [ 5148.628954][ C1] ret_from_fork+0x34/0x70 [ 5148.629196][ C1] ? __pfx_kthread+0x10/0x10 [ 5148.629439][ C1] ret_from_fork_asm+0x1b/0x30 [ 5148.629701][ C1] [ 5176.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3715s! [swapper/0:0] [ 5176.527921][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5176.529119][ C0] irq event stamp: 27567077 [ 5176.529360][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5176.529899][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5176.530371][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5176.530870][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5176.531370][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5176.531851][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5176.532490][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5176.532828][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5176.533843][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5176.534165][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5176.534582][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5176.535000][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5176.535417][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5176.535835][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5176.536252][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5176.536717][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5176.537071][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5176.537490][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5176.537907][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5176.538327][ C0] Call Trace: [ 5176.538509][ C0] [ 5176.538670][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5176.538943][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5176.539205][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5176.539492][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5176.539779][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5176.540084][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5176.540365][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5176.540690][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5176.540963][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5176.541244][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5176.541571][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5176.541882][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5176.542209][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5176.542541][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5176.542851][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5176.543151][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5176.543474][ C0] ? get_stack_info+0x36/0xc0 [ 5176.543732][ C0] ? lock_acquire+0x1c1/0x220 [ 5176.543985][ C0] ? lock_release+0x1d5/0x250 [ 5176.544245][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5176.544509][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5176.544797][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5176.545097][ C0] ? lock_acquire+0x1c1/0x220 [ 5176.545342][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5176.545591][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5176.545862][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5176.546111][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5176.546373][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5176.546642][ C0] ? __inet_lookup_established+0x341/0x610 [ 5176.546963][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5176.547251][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5176.547541][ C0] ip_local_deliver+0x19d/0x480 [ 5176.547802][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5176.548088][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5176.548355][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5176.548630][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5176.548891][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5176.549230][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5176.549503][ C0] ip_rcv+0x564/0x740 [ 5176.549714][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5176.549958][ C0] ? set_track_prepare+0x8a/0xd0 [ 5176.550222][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5176.550513][ C0] ? rest_init+0x153/0x260 [ 5176.550756][ C0] ? skb_clone+0x10b/0x330 [ 5176.550999][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5176.551339][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5176.551660][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5176.551955][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5176.552265][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5176.552521][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5176.552758][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5176.553073][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5176.553369][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5176.553710][ C0] ? lock_acquire+0x1c1/0x220 [ 5176.553960][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5176.554273][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5176.554569][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5176.554901][ C0] ? __copy_skb_header+0xaf/0x490 [ 5176.555170][ C0] ? __skb_clone+0x57a/0x760 [ 5176.555418][ C0] netif_receive_skb+0x55/0x280 [ 5176.555674][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5176.555996][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5176.556341][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5176.556654][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5176.556938][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5176.557233][ C0] ? hlock_class+0x4e/0x130 [ 5176.557475][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5176.557807][ C0] ? place_entity+0x21/0x2f0 [ 5176.558054][ C0] ? resched_curr+0x219/0x280 [ 5176.558310][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5176.558578][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5176.558860][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5176.559136][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5176.559392][ C0] ? activate_task+0xf5/0x260 [ 5176.559638][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5176.559911][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5176.560183][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5176.560441][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5176.560730][ C0] ? get_stack_info+0x36/0xc0 [ 5176.560984][ C0] ? stack_access_ok+0xda/0x1f0 [ 5176.561251][ C0] ? get_reg+0x119/0x190 [ 5176.561475][ C0] __tcf_classify+0x32c/0x7d0 [ 5176.561730][ C0] tcf_classify+0x283/0x930 [ 5176.561972][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5176.562303][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5176.562566][ C0] ? arch_stack_walk+0x8c/0x100 [ 5176.562825][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5176.563114][ C0] tc_run+0x2e4/0x5d0 [ 5176.563328][ C0] ? __pfx_tc_run+0x10/0x10 [ 5176.563572][ C0] ? lock_acquire+0x1c1/0x220 [ 5176.563826][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5176.564101][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5176.564365][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5176.564651][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5176.564931][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5176.565249][ C0] ? neigh_hh_output+0x348/0x590 [ 5176.565513][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5176.565792][ C0] ip_finish_output2+0x786/0x18e0 [ 5176.566063][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5176.566355][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5176.566705][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5176.566994][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5176.567259][ C0] ? __ip_finish_output+0x10f/0x770 [ 5176.567534][ C0] ip_output+0x16b/0x4f0 [ 5176.567758][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5176.568042][ C0] ? __pfx_ip_output+0x10/0x10 [ 5176.568295][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5176.568597][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5176.568859][ C0] ? ip_local_out+0x114/0x3b0 [ 5176.569111][ C0] __ip_queue_xmit+0x672/0x1910 [ 5176.569378][ C0] ? __skb_clone+0x57a/0x760 [ 5176.569628][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5176.569905][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5176.570198][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5176.570513][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5176.570771][ C0] ? tcp_current_mss+0x40a/0x510 [ 5176.571033][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5176.571322][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5176.571604][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5176.571859][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5176.572125][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5176.572453][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5176.572723][ C0] ? ktime_get+0xb6/0x190 [ 5176.572971][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5176.573245][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5176.573521][ C0] tcp_write_timer+0x82/0x1d0 [ 5176.573772][ C0] call_timer_fn+0x176/0x430 [ 5176.574019][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5176.574291][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5176.574563][ C0] __run_timers.part.0+0x52d/0x890 [ 5176.574832][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5176.575120][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5176.575415][ C0] ? lock_acquire+0x1c1/0x220 [ 5176.575664][ C0] ? clockevents_program_event+0xf6/0x300 [ 5176.575969][ C0] ? lock_release+0x1d5/0x250 [ 5176.576222][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5176.576500][ C0] ? ktime_get+0xb6/0x190 [ 5176.576732][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5176.577031][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5176.577336][ C0] run_timer_softirq+0x72/0x100 [ 5176.577594][ C0] __do_softirq+0x1bc/0x7ff [ 5176.577838][ C0] irq_exit_rcu+0x98/0xc0 [ 5176.578069][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5176.578372][ C0] [ 5176.578528][ C0] [ 5176.578683][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5176.579001][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5176.579270][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5176.580288][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5176.580613][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5176.581031][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5176.581452][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5176.581868][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5176.582284][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5176.582701][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5176.583001][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5176.583271][ C0] default_idle_call+0x69/0xa0 [ 5176.583526][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5176.583787][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5176.584081][ C0] ? lock_release+0x1d5/0x250 [ 5176.584331][ C0] do_idle+0xfb/0x160 [ 5176.584540][ C0] cpu_startup_entry+0x55/0x60 [ 5176.584790][ C0] rest_init+0x153/0x260 [ 5176.585019][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5176.585306][ C0] arch_call_rest_init+0x13/0x40 [ 5176.585569][ C0] start_kernel+0x314/0x3d0 [ 5176.585813][ C0] x86_64_start_reservations+0x18/0x30 [ 5176.586106][ C0] x86_64_start_kernel+0xba/0x110 [ 5176.586371][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5176.586693][ C0] [ 5176.586856][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3715s! [ksoftirqd/1:22] [ 5176.587322][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5176.588525][ C1] irq event stamp: 3886976 [ 5176.588766][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5176.589263][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5176.589756][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5176.590256][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5176.590752][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5176.591250][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5176.591903][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5176.592247][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5176.593274][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5176.593601][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5176.594026][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5176.594448][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5176.594871][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5176.595299][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5176.595721][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5176.596192][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5176.596540][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5176.596966][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5176.597387][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5176.597804][ C1] Call Trace: [ 5176.597982][ C1] [ 5176.598138][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5176.598418][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5176.598671][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5176.598965][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5176.599252][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5176.599554][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5176.599834][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5176.600154][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5176.600432][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5176.600756][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5176.601067][ C1] [ 5176.601232][ C1] [ 5176.601389][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5176.601721][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5176.602027][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5176.602341][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5176.602642][ C1] ? run_ksoftirqd+0xb/0x60 [ 5176.602886][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5176.603214][ C1] ? __orc_find+0x9c/0xf0 [ 5176.603446][ C1] ? lock_acquire+0x1c1/0x220 [ 5176.603703][ C1] ? irqentry_enter+0x2b/0x60 [ 5176.603959][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5176.604227][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5176.604517][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5176.604819][ C1] ? lock_acquire+0x1c1/0x220 [ 5176.605068][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5176.605320][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5176.605594][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5176.605844][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5176.606109][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5176.606383][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5176.606673][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5176.606965][ C1] ip_local_deliver+0x19d/0x480 [ 5176.607224][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5176.607509][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5176.607775][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5176.608058][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5176.608324][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5176.608660][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5176.608940][ C1] ip_rcv+0x564/0x740 [ 5176.609156][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5176.609404][ C1] ? set_track_prepare+0x8a/0xd0 [ 5176.609673][ C1] ? irqentry_enter+0x2b/0x60 [ 5176.609925][ C1] ? irqentry_enter+0x2b/0x60 [ 5176.610175][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5176.610416][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5176.610729][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5176.611069][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5176.611384][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5176.611724][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5176.612023][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5176.612361][ C1] netif_receive_skb+0x55/0x280 [ 5176.612627][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5176.612957][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5176.613311][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5176.613623][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5176.613916][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5176.614223][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5176.614556][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5176.614839][ C1] ? arch_stack_walk+0x68/0x100 [ 5176.615099][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5176.615376][ C1] ? irqentry_enter+0x2b/0x60 [ 5176.615625][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5176.615947][ C1] ? irqentry_enter+0x2b/0x60 [ 5176.616206][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5176.616531][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5176.616809][ C1] ? arch_stack_walk+0x68/0x100 [ 5176.617073][ C1] __tcf_classify+0x32c/0x7d0 [ 5176.617330][ C1] tcf_classify+0x283/0x930 [ 5176.617577][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5176.617851][ C1] tc_run+0x2e4/0x5d0 [ 5176.618069][ C1] ? __pfx_tc_run+0x10/0x10 [ 5176.618318][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5176.618592][ C1] ? irqentry_enter+0x2b/0x60 [ 5176.618841][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5176.619125][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5176.619451][ C1] ip_finish_output2+0x786/0x18e0 [ 5176.619724][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5176.620017][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5176.620283][ C1] ? __ip_finish_output+0x10f/0x770 [ 5176.620565][ C1] ip_output+0x16b/0x4f0 [ 5176.620797][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5176.621125][ C1] ? __pfx_ip_output+0x10/0x10 [ 5176.621385][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5176.621739][ C1] ? __pfx_ip_output+0x10/0x10 [ 5176.621997][ C1] __ip_queue_xmit+0x672/0x1910 [ 5176.622260][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5176.622540][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5176.622837][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5176.623126][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5176.623423][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5176.623710][ C1] tcp_delack_timer+0x84/0x240 [ 5176.623966][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5176.624259][ C1] call_timer_fn+0x176/0x430 [ 5176.624512][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5176.624787][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5176.625070][ C1] __run_timers.part.0+0x52d/0x890 [ 5176.625347][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5176.625635][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5176.625935][ C1] ? __pfx___schedule+0x10/0x10 [ 5176.626199][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5176.626523][ C1] run_timer_softirq+0x72/0x100 [ 5176.626781][ C1] __do_softirq+0x1bc/0x7ff [ 5176.627023][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5176.627298][ C1] run_ksoftirqd+0x2e/0x60 [ 5176.627546][ C1] smpboot_thread_fn+0x30e/0x840 [ 5176.627812][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5176.628109][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5176.628400][ C1] kthread+0x292/0x360 [ 5176.628618][ C1] ? __pfx_kthread+0x10/0x10 [ 5176.628862][ C1] ret_from_fork+0x34/0x70 [ 5176.629104][ C1] ? __pfx_kthread+0x10/0x10 [ 5176.629351][ C1] ret_from_fork_asm+0x1b/0x30 [ 5176.629615][ C1] [ 5202.614023][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5202.614404][ C1] rcu: 1-....: (3997075 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=953816 [ 5202.614993][ C1] rcu: (t=4008305 jiffies g=1007429 q=31 ncpus=4) [ 5202.615344][ C1] Sending NMI from CPU 1 to CPUs 0: [ 5202.615633][ C0] NMI backtrace for cpu 0 [ 5202.615641][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5202.615646][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5202.615649][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5202.615658][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5202.615661][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5202.615665][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5202.615667][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5202.615669][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5202.615671][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5202.615672][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5202.615674][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5202.615676][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5202.615680][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5202.615682][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5202.615683][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5202.615685][ C0] Call Trace: [ 5202.615688][ C0] [ 5202.615692][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 5202.615698][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5202.615705][ C0] ? nmi_handle+0x156/0x420 [ 5202.615710][ C0] ? default_do_nmi+0x41/0x100 [ 5202.615715][ C0] ? exc_nmi+0xf3/0x120 [ 5202.615717][ C0] ? end_repeat_nmi+0xf/0x60 [ 5202.615722][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5202.615726][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5202.615730][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5202.615734][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5202.615737][ C0] [ 5202.615738][ C0] [ 5202.615740][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5202.615742][ C0] ? get_stack_info+0x36/0xc0 [ 5202.615748][ C0] ? lock_acquire+0x1c1/0x220 [ 5202.615753][ C0] ? lock_release+0x1d5/0x250 [ 5202.615756][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5202.615761][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5202.615764][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5202.615767][ C0] ? lock_acquire+0x1c1/0x220 [ 5202.615769][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5202.615775][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5202.615779][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5202.615786][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5202.615789][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5202.615793][ C0] ? __inet_lookup_established+0x341/0x610 [ 5202.615799][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5202.615807][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5202.615811][ C0] ip_local_deliver+0x19d/0x480 [ 5202.615815][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5202.615817][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5202.615822][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5202.615827][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5202.615830][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5202.615833][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5202.615844][ C0] ip_rcv+0x564/0x740 [ 5202.615847][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5202.615850][ C0] ? set_track_prepare+0x8a/0xd0 [ 5202.615855][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5202.615857][ C0] ? rest_init+0x153/0x260 [ 5202.615860][ C0] ? skb_clone+0x10b/0x330 [ 5202.615866][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5202.615873][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5202.615879][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5202.615883][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5202.615893][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5202.615896][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5202.615899][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5202.615903][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5202.615906][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5202.615910][ C0] ? lock_acquire+0x1c1/0x220 [ 5202.615912][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5202.615915][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5202.615919][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5202.615922][ C0] ? __copy_skb_header+0xaf/0x490 [ 5202.615925][ C0] ? __skb_clone+0x57a/0x760 [ 5202.615927][ C0] netif_receive_skb+0x55/0x280 [ 5202.615930][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5202.615938][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5202.615945][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5202.615952][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5202.615957][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5202.615966][ C0] ? hlock_class+0x4e/0x130 [ 5202.615972][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5202.615982][ C0] ? place_entity+0x21/0x2f0 [ 5202.615986][ C0] ? resched_curr+0x219/0x280 [ 5202.615990][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5202.615993][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5202.615996][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5202.616001][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5202.616004][ C0] ? activate_task+0xf5/0x260 [ 5202.616007][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5202.616012][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5202.616016][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5202.616019][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5202.616024][ C0] ? get_stack_info+0x36/0xc0 [ 5202.616028][ C0] ? stack_access_ok+0xda/0x1f0 [ 5202.616030][ C0] ? get_reg+0x119/0x190 [ 5202.616033][ C0] __tcf_classify+0x32c/0x7d0 [ 5202.616038][ C0] tcf_classify+0x283/0x930 [ 5202.616041][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5202.616045][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5202.616047][ C0] ? arch_stack_walk+0x8c/0x100 [ 5202.616052][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5202.616056][ C0] tc_run+0x2e4/0x5d0 [ 5202.616060][ C0] ? __pfx_tc_run+0x10/0x10 [ 5202.616063][ C0] ? lock_acquire+0x1c1/0x220 [ 5202.616066][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5202.616070][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5202.616077][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5202.616079][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5202.616083][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5202.616089][ C0] ? neigh_hh_output+0x348/0x590 [ 5202.616093][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5202.616097][ C0] ip_finish_output2+0x786/0x18e0 [ 5202.616100][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5202.616107][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5202.616114][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5202.616117][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5202.616121][ C0] ? __ip_finish_output+0x10f/0x770 [ 5202.616125][ C0] ip_output+0x16b/0x4f0 [ 5202.616129][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5202.616134][ C0] ? __pfx_ip_output+0x10/0x10 [ 5202.616137][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5202.616141][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5202.616144][ C0] ? ip_local_out+0x114/0x3b0 [ 5202.616148][ C0] __ip_queue_xmit+0x672/0x1910 [ 5202.616152][ C0] ? __skb_clone+0x57a/0x760 [ 5202.616156][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5202.616163][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5202.616168][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5202.616171][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5202.616177][ C0] ? tcp_current_mss+0x40a/0x510 [ 5202.616180][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5202.616183][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5202.616185][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5202.616187][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5202.616190][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5202.616194][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5202.616199][ C0] ? ktime_get+0xb6/0x190 [ 5202.616203][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5202.616208][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5202.616211][ C0] tcp_write_timer+0x82/0x1d0 [ 5202.616215][ C0] call_timer_fn+0x176/0x430 [ 5202.616218][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5202.616223][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5202.616227][ C0] __run_timers.part.0+0x52d/0x890 [ 5202.616230][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5202.616235][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5202.616238][ C0] ? lock_acquire+0x1c1/0x220 [ 5202.616240][ C0] ? clockevents_program_event+0xf6/0x300 [ 5202.616245][ C0] ? lock_release+0x1d5/0x250 [ 5202.616248][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5202.616250][ C0] ? ktime_get+0xb6/0x190 [ 5202.616253][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5202.616257][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5202.616261][ C0] run_timer_softirq+0x72/0x100 [ 5202.616265][ C0] __do_softirq+0x1bc/0x7ff [ 5202.616270][ C0] irq_exit_rcu+0x98/0xc0 [ 5202.616273][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5202.616277][ C0] [ 5202.616278][ C0] [ 5202.616279][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5202.616285][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5202.616288][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5202.616291][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5202.616293][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5202.616294][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5202.616296][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5202.616297][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5202.616299][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5202.616302][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5202.616306][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5202.616309][ C0] default_idle_call+0x69/0xa0 [ 5202.616312][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5202.616314][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5202.616319][ C0] ? lock_release+0x1d5/0x250 [ 5202.616323][ C0] do_idle+0xfb/0x160 [ 5202.616326][ C0] cpu_startup_entry+0x55/0x60 [ 5202.616328][ C0] rest_init+0x153/0x260 [ 5202.616331][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5202.616337][ C0] arch_call_rest_init+0x13/0x40 [ 5202.616342][ C0] start_kernel+0x314/0x3d0 [ 5202.616346][ C0] x86_64_start_reservations+0x18/0x30 [ 5202.616351][ C0] x86_64_start_kernel+0xba/0x110 [ 5202.616355][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5202.616363][ C0] [ 5202.616628][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5202.670900][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5202.671551][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5202.671898][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5202.672920][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5202.673245][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5202.673665][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5202.674088][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5202.674508][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5202.674928][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5202.675350][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5202.675823][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5202.676178][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5202.676603][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5202.677033][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5202.677464][ C1] Call Trace: [ 5202.677646][ C1] [ 5202.677805][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5202.678098][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5202.678366][ C1] ? check_cpu_stall+0x284/0x500 [ 5202.678629][ C1] ? rcu_pending+0x92/0x360 [ 5202.678874][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5202.679161][ C1] ? update_process_times+0xb9/0x110 [ 5202.679443][ C1] ? tick_sched_handle+0x67/0x130 [ 5202.679716][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5202.680020][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5202.680276][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5202.680608][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5202.680895][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5202.681205][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5202.681487][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5202.681815][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5202.682091][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5202.682419][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5202.682734][ C1] [ 5202.682891][ C1] [ 5202.683049][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5202.683375][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5202.683683][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5202.683995][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5202.684297][ C1] ? run_ksoftirqd+0xb/0x60 [ 5202.684539][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5202.684863][ C1] ? __orc_find+0x9c/0xf0 [ 5202.685099][ C1] ? lock_acquire+0x1c1/0x220 [ 5202.685353][ C1] ? irqentry_enter+0x2b/0x60 [ 5202.685608][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5202.685870][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5202.686159][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5202.686460][ C1] ? lock_acquire+0x1c1/0x220 [ 5202.686710][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5202.686964][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5202.687238][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5202.687487][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5202.687747][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5202.688023][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5202.688317][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5202.688611][ C1] ip_local_deliver+0x19d/0x480 [ 5202.688872][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5202.689155][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5202.689419][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5202.689700][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5202.689966][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5202.690304][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5202.690582][ C1] ip_rcv+0x564/0x740 [ 5202.690800][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5202.691055][ C1] ? set_track_prepare+0x8a/0xd0 [ 5202.691321][ C1] ? irqentry_enter+0x2b/0x60 [ 5202.691576][ C1] ? irqentry_enter+0x2b/0x60 [ 5202.691831][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5202.692078][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5202.692399][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5202.692741][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5202.693053][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5202.693392][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5202.693690][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5202.694030][ C1] netif_receive_skb+0x55/0x280 [ 5202.694292][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5202.694623][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5202.694973][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5202.695288][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5202.695584][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5202.695891][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5202.696231][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5202.696514][ C1] ? arch_stack_walk+0x68/0x100 [ 5202.696776][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5202.697054][ C1] ? irqentry_enter+0x2b/0x60 [ 5202.697305][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5202.697622][ C1] ? irqentry_enter+0x2b/0x60 [ 5202.697874][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5202.698201][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5202.698483][ C1] ? arch_stack_walk+0x68/0x100 [ 5202.698746][ C1] __tcf_classify+0x32c/0x7d0 [ 5202.699000][ C1] tcf_classify+0x283/0x930 [ 5202.699248][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5202.699519][ C1] tc_run+0x2e4/0x5d0 [ 5202.699738][ C1] ? __pfx_tc_run+0x10/0x10 [ 5202.699986][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5202.700257][ C1] ? irqentry_enter+0x2b/0x60 [ 5202.700510][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5202.700795][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5202.701120][ C1] ip_finish_output2+0x786/0x18e0 [ 5202.701390][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5202.701681][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5202.701949][ C1] ? __ip_finish_output+0x10f/0x770 [ 5202.702226][ C1] ip_output+0x16b/0x4f0 [ 5202.702451][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5202.702775][ C1] ? __pfx_ip_output+0x10/0x10 [ 5202.703029][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5202.703391][ C1] ? __pfx_ip_output+0x10/0x10 [ 5202.703651][ C1] __ip_queue_xmit+0x672/0x1910 [ 5202.703913][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5202.704194][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5202.704489][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5202.704773][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5202.705068][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5202.705350][ C1] tcp_delack_timer+0x84/0x240 [ 5202.705603][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5202.705893][ C1] call_timer_fn+0x176/0x430 [ 5202.706143][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5202.706416][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5202.706698][ C1] __run_timers.part.0+0x52d/0x890 [ 5202.706974][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5202.707260][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5202.707560][ C1] ? __pfx___schedule+0x10/0x10 [ 5202.707823][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5202.708148][ C1] run_timer_softirq+0x72/0x100 [ 5202.708409][ C1] __do_softirq+0x1bc/0x7ff [ 5202.708653][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5202.708926][ C1] run_ksoftirqd+0x2e/0x60 [ 5202.709168][ C1] smpboot_thread_fn+0x30e/0x840 [ 5202.709435][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5202.709729][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5202.710017][ C1] kthread+0x292/0x360 [ 5202.710241][ C1] ? __pfx_kthread+0x10/0x10 [ 5202.710490][ C1] ret_from_fork+0x34/0x70 [ 5202.710730][ C1] ? __pfx_kthread+0x10/0x10 [ 5202.710979][ C1] ret_from_fork_asm+0x1b/0x30 [ 5202.711242][ C1] [ 5228.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3763s! [swapper/0:0] [ 5228.527924][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5228.529113][ C0] irq event stamp: 27567077 [ 5228.529350][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5228.529874][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5228.530354][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5228.530861][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5228.531352][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5228.531825][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5228.532470][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5228.532813][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5228.533834][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5228.534158][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5228.534582][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5228.535000][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5228.535419][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5228.535844][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5228.536268][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5228.536740][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5228.537089][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5228.537517][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5228.537936][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5228.538352][ C0] Call Trace: [ 5228.538530][ C0] [ 5228.538684][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5228.538962][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5228.539216][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5228.539507][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5228.539788][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5228.540088][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5228.540364][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5228.540681][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5228.540962][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5228.541241][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5228.541564][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5228.541872][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5228.542206][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5228.542508][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5228.542818][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5228.543123][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5228.543451][ C0] ? get_stack_info+0x36/0xc0 [ 5228.543700][ C0] ? lock_acquire+0x1c1/0x220 [ 5228.543950][ C0] ? lock_release+0x1d5/0x250 [ 5228.544198][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5228.544456][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5228.544740][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5228.545037][ C0] ? lock_acquire+0x1c1/0x220 [ 5228.545290][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5228.545554][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5228.545830][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5228.546075][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5228.546332][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5228.546600][ C0] ? __inet_lookup_established+0x341/0x610 [ 5228.546916][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5228.547210][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5228.547504][ C0] ip_local_deliver+0x19d/0x480 [ 5228.547763][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5228.548048][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5228.548312][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5228.548591][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5228.548856][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5228.549189][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5228.549468][ C0] ip_rcv+0x564/0x740 [ 5228.549681][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5228.549926][ C0] ? set_track_prepare+0x8a/0xd0 [ 5228.550193][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5228.550479][ C0] ? rest_init+0x153/0x260 [ 5228.550718][ C0] ? skb_clone+0x10b/0x330 [ 5228.550968][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5228.551301][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5228.551618][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5228.551919][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5228.552233][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5228.552493][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5228.552737][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5228.553055][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5228.553357][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5228.553700][ C0] ? lock_acquire+0x1c1/0x220 [ 5228.553951][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5228.554259][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5228.554560][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5228.554888][ C0] ? __copy_skb_header+0xaf/0x490 [ 5228.555154][ C0] ? __skb_clone+0x57a/0x760 [ 5228.555398][ C0] netif_receive_skb+0x55/0x280 [ 5228.555657][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5228.555985][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5228.556336][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5228.556646][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5228.556935][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5228.557235][ C0] ? hlock_class+0x4e/0x130 [ 5228.557482][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5228.557815][ C0] ? place_entity+0x21/0x2f0 [ 5228.558065][ C0] ? resched_curr+0x219/0x280 [ 5228.558315][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5228.558581][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5228.558860][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5228.559141][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5228.559402][ C0] ? activate_task+0xf5/0x260 [ 5228.559655][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5228.559930][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5228.560201][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5228.560462][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5228.560755][ C0] ? get_stack_info+0x36/0xc0 [ 5228.561015][ C0] ? stack_access_ok+0xda/0x1f0 [ 5228.561279][ C0] ? get_reg+0x119/0x190 [ 5228.561507][ C0] __tcf_classify+0x32c/0x7d0 [ 5228.561754][ C0] tcf_classify+0x283/0x930 [ 5228.561994][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5228.562320][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5228.562592][ C0] ? arch_stack_walk+0x8c/0x100 [ 5228.562859][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5228.563152][ C0] tc_run+0x2e4/0x5d0 [ 5228.563365][ C0] ? __pfx_tc_run+0x10/0x10 [ 5228.563605][ C0] ? lock_acquire+0x1c1/0x220 [ 5228.563853][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5228.564133][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5228.564404][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5228.564689][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5228.564967][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5228.565283][ C0] ? neigh_hh_output+0x348/0x590 [ 5228.565551][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5228.565825][ C0] ip_finish_output2+0x786/0x18e0 [ 5228.566094][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5228.566385][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5228.566739][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5228.567033][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5228.567296][ C0] ? __ip_finish_output+0x10f/0x770 [ 5228.567576][ C0] ip_output+0x16b/0x4f0 [ 5228.567804][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5228.568083][ C0] ? __pfx_ip_output+0x10/0x10 [ 5228.568340][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5228.568639][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5228.568904][ C0] ? ip_local_out+0x114/0x3b0 [ 5228.569154][ C0] __ip_queue_xmit+0x672/0x1910 [ 5228.569410][ C0] ? __skb_clone+0x57a/0x760 [ 5228.569653][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5228.569936][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5228.570238][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5228.570561][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5228.570822][ C0] ? tcp_current_mss+0x40a/0x510 [ 5228.571095][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5228.571377][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5228.571650][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5228.571903][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5228.572172][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5228.572491][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5228.572765][ C0] ? ktime_get+0xb6/0x190 [ 5228.572994][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5228.573265][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5228.573547][ C0] tcp_write_timer+0x82/0x1d0 [ 5228.573794][ C0] call_timer_fn+0x176/0x430 [ 5228.574039][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5228.574313][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5228.574584][ C0] __run_timers.part.0+0x52d/0x890 [ 5228.574857][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5228.575140][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5228.575439][ C0] ? lock_acquire+0x1c1/0x220 [ 5228.575686][ C0] ? clockevents_program_event+0xf6/0x300 [ 5228.575989][ C0] ? lock_release+0x1d5/0x250 [ 5228.576240][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5228.576513][ C0] ? ktime_get+0xb6/0x190 [ 5228.576746][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5228.577043][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5228.577355][ C0] run_timer_softirq+0x72/0x100 [ 5228.577613][ C0] __do_softirq+0x1bc/0x7ff [ 5228.577855][ C0] irq_exit_rcu+0x98/0xc0 [ 5228.578084][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5228.578382][ C0] [ 5228.578540][ C0] [ 5228.578698][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5228.579020][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5228.579288][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5228.580303][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5228.580624][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5228.581048][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5228.581469][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5228.581893][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5228.582320][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5228.582746][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5228.583053][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5228.583329][ C0] default_idle_call+0x69/0xa0 [ 5228.583580][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5228.583846][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5228.584139][ C0] ? lock_release+0x1d5/0x250 [ 5228.584394][ C0] do_idle+0xfb/0x160 [ 5228.584608][ C0] cpu_startup_entry+0x55/0x60 [ 5228.584865][ C0] rest_init+0x153/0x260 [ 5228.585092][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5228.585384][ C0] arch_call_rest_init+0x13/0x40 [ 5228.585652][ C0] start_kernel+0x314/0x3d0 [ 5228.585893][ C0] x86_64_start_reservations+0x18/0x30 [ 5228.586189][ C0] x86_64_start_kernel+0xba/0x110 [ 5228.586459][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5228.586788][ C0] [ 5228.586957][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3763s! [ksoftirqd/1:22] [ 5228.587431][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5228.588620][ C1] irq event stamp: 3886976 [ 5228.588856][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5228.589362][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5228.589866][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5228.590373][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5228.590866][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5228.591359][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5228.592000][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5228.592341][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5228.593363][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5228.593685][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5228.594103][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5228.594523][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5228.594941][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5228.595361][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5228.595779][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5228.596251][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5228.596608][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5228.597031][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5228.597457][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5228.597888][ C1] Call Trace: [ 5228.598070][ C1] [ 5228.598229][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5228.598506][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5228.598767][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5228.599061][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5228.599353][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5228.599659][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5228.599941][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5228.600270][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5228.600544][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5228.600880][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5228.601191][ C1] [ 5228.601353][ C1] [ 5228.601514][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5228.601850][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5228.602155][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5228.602464][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5228.602770][ C1] ? run_ksoftirqd+0xb/0x60 [ 5228.603017][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5228.603354][ C1] ? __orc_find+0x9c/0xf0 [ 5228.603584][ C1] ? lock_acquire+0x1c1/0x220 [ 5228.603837][ C1] ? irqentry_enter+0x2b/0x60 [ 5228.604090][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5228.604351][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5228.604635][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5228.604932][ C1] ? lock_acquire+0x1c1/0x220 [ 5228.605188][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5228.605446][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5228.605724][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5228.605970][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5228.606231][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5228.606503][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5228.606792][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5228.607086][ C1] ip_local_deliver+0x19d/0x480 [ 5228.607349][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5228.607637][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5228.607904][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5228.608182][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5228.608444][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5228.608784][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5228.609060][ C1] ip_rcv+0x564/0x740 [ 5228.609272][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5228.609513][ C1] ? set_track_prepare+0x8a/0xd0 [ 5228.609775][ C1] ? irqentry_enter+0x2b/0x60 [ 5228.610031][ C1] ? irqentry_enter+0x2b/0x60 [ 5228.610287][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5228.610532][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5228.610856][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5228.611200][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5228.611508][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5228.611852][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5228.612156][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5228.612489][ C1] netif_receive_skb+0x55/0x280 [ 5228.612748][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5228.613078][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5228.613432][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5228.613750][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5228.614041][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5228.614345][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5228.614674][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5228.614956][ C1] ? arch_stack_walk+0x68/0x100 [ 5228.615224][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5228.615505][ C1] ? irqentry_enter+0x2b/0x60 [ 5228.615761][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5228.616086][ C1] ? irqentry_enter+0x2b/0x60 [ 5228.616336][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5228.616660][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5228.616946][ C1] ? arch_stack_walk+0x68/0x100 [ 5228.617208][ C1] __tcf_classify+0x32c/0x7d0 [ 5228.617461][ C1] tcf_classify+0x283/0x930 [ 5228.617705][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5228.617979][ C1] tc_run+0x2e4/0x5d0 [ 5228.618194][ C1] ? __pfx_tc_run+0x10/0x10 [ 5228.618436][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5228.618702][ C1] ? irqentry_enter+0x2b/0x60 [ 5228.618957][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5228.619248][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5228.619577][ C1] ip_finish_output2+0x786/0x18e0 [ 5228.619848][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5228.620140][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5228.620407][ C1] ? __ip_finish_output+0x10f/0x770 [ 5228.620685][ C1] ip_output+0x16b/0x4f0 [ 5228.620912][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5228.621231][ C1] ? __pfx_ip_output+0x10/0x10 [ 5228.621490][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5228.621843][ C1] ? __pfx_ip_output+0x10/0x10 [ 5228.622105][ C1] __ip_queue_xmit+0x672/0x1910 [ 5228.622371][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5228.622657][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5228.622958][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5228.623248][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5228.623547][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5228.623835][ C1] tcp_delack_timer+0x84/0x240 [ 5228.624093][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5228.624377][ C1] call_timer_fn+0x176/0x430 [ 5228.624623][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5228.624902][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5228.625182][ C1] __run_timers.part.0+0x52d/0x890 [ 5228.625455][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5228.625745][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5228.626052][ C1] ? __pfx___schedule+0x10/0x10 [ 5228.626312][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5228.626632][ C1] run_timer_softirq+0x72/0x100 [ 5228.626899][ C1] __do_softirq+0x1bc/0x7ff [ 5228.627148][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5228.627427][ C1] run_ksoftirqd+0x2e/0x60 [ 5228.627667][ C1] smpboot_thread_fn+0x30e/0x840 [ 5228.627936][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5228.628226][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5228.628519][ C1] kthread+0x292/0x360 [ 5228.628738][ C1] ? __pfx_kthread+0x10/0x10 [ 5228.628988][ C1] ret_from_fork+0x34/0x70 [ 5228.629226][ C1] ? __pfx_kthread+0x10/0x10 [ 5228.629475][ C1] ret_from_fork_asm+0x1b/0x30 [ 5228.629733][ C1] [ 5256.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3789s! [swapper/0:0] [ 5256.527915][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5256.529112][ C0] irq event stamp: 27567077 [ 5256.529354][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5256.529885][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5256.530354][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5256.530862][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5256.531360][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5256.531845][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5256.532483][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5256.532821][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5256.533836][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5256.534159][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5256.534576][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5256.534992][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5256.535410][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5256.535830][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5256.536245][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5256.536714][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5256.537064][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5256.537481][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5256.537904][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5256.538327][ C0] Call Trace: [ 5256.538512][ C0] [ 5256.538667][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5256.538941][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5256.539202][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5256.539490][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5256.539779][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5256.540085][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5256.540368][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5256.540688][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5256.540965][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5256.541243][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5256.541568][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5256.541882][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5256.542216][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5256.542526][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5256.542837][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5256.543138][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5256.543473][ C0] ? get_stack_info+0x36/0xc0 [ 5256.543731][ C0] ? lock_acquire+0x1c1/0x220 [ 5256.543987][ C0] ? lock_release+0x1d5/0x250 [ 5256.544242][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5256.544506][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5256.544792][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5256.545092][ C0] ? lock_acquire+0x1c1/0x220 [ 5256.545338][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5256.545587][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5256.545857][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5256.546112][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5256.546373][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5256.546649][ C0] ? __inet_lookup_established+0x341/0x610 [ 5256.546965][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5256.547254][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5256.547545][ C0] ip_local_deliver+0x19d/0x480 [ 5256.547809][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5256.548094][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5256.548360][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5256.548633][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5256.548895][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5256.549233][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5256.549506][ C0] ip_rcv+0x564/0x740 [ 5256.549718][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5256.549957][ C0] ? set_track_prepare+0x8a/0xd0 [ 5256.550221][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5256.550511][ C0] ? rest_init+0x153/0x260 [ 5256.550750][ C0] ? skb_clone+0x10b/0x330 [ 5256.550990][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5256.551328][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5256.551653][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5256.551953][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5256.552260][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5256.552517][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5256.552756][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5256.553071][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5256.553367][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5256.553709][ C0] ? lock_acquire+0x1c1/0x220 [ 5256.553962][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5256.554274][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5256.554571][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5256.554904][ C0] ? __copy_skb_header+0xaf/0x490 [ 5256.555176][ C0] ? __skb_clone+0x57a/0x760 [ 5256.555425][ C0] netif_receive_skb+0x55/0x280 [ 5256.555681][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5256.556006][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5256.556353][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5256.556667][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5256.556951][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5256.557252][ C0] ? hlock_class+0x4e/0x130 [ 5256.557488][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5256.557825][ C0] ? place_entity+0x21/0x2f0 [ 5256.558070][ C0] ? resched_curr+0x219/0x280 [ 5256.558322][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5256.558591][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5256.558873][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5256.559147][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5256.559401][ C0] ? activate_task+0xf5/0x260 [ 5256.559651][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5256.559924][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5256.560198][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5256.560456][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5256.560750][ C0] ? get_stack_info+0x36/0xc0 [ 5256.561001][ C0] ? stack_access_ok+0xda/0x1f0 [ 5256.561259][ C0] ? get_reg+0x119/0x190 [ 5256.561485][ C0] __tcf_classify+0x32c/0x7d0 [ 5256.561740][ C0] tcf_classify+0x283/0x930 [ 5256.561985][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5256.562314][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5256.562578][ C0] ? arch_stack_walk+0x8c/0x100 [ 5256.562838][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5256.563124][ C0] tc_run+0x2e4/0x5d0 [ 5256.563343][ C0] ? __pfx_tc_run+0x10/0x10 [ 5256.563591][ C0] ? lock_acquire+0x1c1/0x220 [ 5256.563842][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5256.564123][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5256.564388][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5256.564674][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5256.564954][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5256.565279][ C0] ? neigh_hh_output+0x348/0x590 [ 5256.565543][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5256.565822][ C0] ip_finish_output2+0x786/0x18e0 [ 5256.566092][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5256.566385][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5256.566735][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5256.567024][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5256.567288][ C0] ? __ip_finish_output+0x10f/0x770 [ 5256.567563][ C0] ip_output+0x16b/0x4f0 [ 5256.567789][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5256.568074][ C0] ? __pfx_ip_output+0x10/0x10 [ 5256.568329][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5256.568629][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5256.568889][ C0] ? ip_local_out+0x114/0x3b0 [ 5256.569144][ C0] __ip_queue_xmit+0x672/0x1910 [ 5256.569409][ C0] ? __skb_clone+0x57a/0x760 [ 5256.569662][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5256.569939][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5256.570233][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5256.570555][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5256.570820][ C0] ? tcp_current_mss+0x40a/0x510 [ 5256.571088][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5256.571367][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5256.571646][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5256.571901][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5256.572167][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5256.572484][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5256.572763][ C0] ? ktime_get+0xb6/0x190 [ 5256.572997][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5256.573273][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5256.573554][ C0] tcp_write_timer+0x82/0x1d0 [ 5256.573810][ C0] call_timer_fn+0x176/0x430 [ 5256.574059][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5256.574330][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5256.574605][ C0] __run_timers.part.0+0x52d/0x890 [ 5256.574875][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5256.575160][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5256.575456][ C0] ? lock_acquire+0x1c1/0x220 [ 5256.575709][ C0] ? clockevents_program_event+0xf6/0x300 [ 5256.576018][ C0] ? lock_release+0x1d5/0x250 [ 5256.576270][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5256.576549][ C0] ? ktime_get+0xb6/0x190 [ 5256.576781][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5256.577084][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5256.577392][ C0] run_timer_softirq+0x72/0x100 [ 5256.577653][ C0] __do_softirq+0x1bc/0x7ff [ 5256.577899][ C0] irq_exit_rcu+0x98/0xc0 [ 5256.578133][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5256.578433][ C0] [ 5256.578588][ C0] [ 5256.578743][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5256.579060][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5256.579330][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5256.580355][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5256.580679][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5256.581105][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5256.581523][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5256.581942][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5256.582360][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5256.582782][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5256.583084][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5256.583356][ C0] default_idle_call+0x69/0xa0 [ 5256.583614][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5256.583877][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5256.584171][ C0] ? lock_release+0x1d5/0x250 [ 5256.584420][ C0] do_idle+0xfb/0x160 [ 5256.584631][ C0] cpu_startup_entry+0x55/0x60 [ 5256.584884][ C0] rest_init+0x153/0x260 [ 5256.585120][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5256.585405][ C0] arch_call_rest_init+0x13/0x40 [ 5256.585669][ C0] start_kernel+0x314/0x3d0 [ 5256.585914][ C0] x86_64_start_reservations+0x18/0x30 [ 5256.586208][ C0] x86_64_start_kernel+0xba/0x110 [ 5256.586476][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5256.586802][ C0] [ 5256.586967][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3789s! [ksoftirqd/1:22] [ 5256.587432][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5256.588624][ C1] irq event stamp: 3886976 [ 5256.588859][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5256.589362][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5256.589863][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5256.590365][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5256.590862][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5256.591357][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5256.592001][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5256.592342][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5256.593363][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5256.593689][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5256.594109][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5256.594531][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5256.594952][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5256.595376][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5256.595794][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5256.596264][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5256.596618][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5256.597043][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5256.597466][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5256.597892][ C1] Call Trace: [ 5256.598080][ C1] [ 5256.598237][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5256.598513][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5256.598770][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5256.599061][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5256.599353][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5256.599661][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5256.599945][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5256.600268][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5256.600545][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5256.600878][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5256.601188][ C1] [ 5256.601347][ C1] [ 5256.601507][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5256.601843][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5256.602146][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5256.602457][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5256.602763][ C1] ? run_ksoftirqd+0xb/0x60 [ 5256.603009][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5256.603345][ C1] ? __orc_find+0x9c/0xf0 [ 5256.603575][ C1] ? lock_acquire+0x1c1/0x220 [ 5256.603826][ C1] ? irqentry_enter+0x2b/0x60 [ 5256.604079][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5256.604340][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5256.604629][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5256.604928][ C1] ? lock_acquire+0x1c1/0x220 [ 5256.605181][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5256.605436][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5256.605713][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5256.605960][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5256.606221][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5256.606492][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5256.606778][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5256.607068][ C1] ip_local_deliver+0x19d/0x480 [ 5256.607334][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5256.607624][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5256.607892][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5256.608169][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5256.608431][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5256.608770][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5256.609045][ C1] ip_rcv+0x564/0x740 [ 5256.609256][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5256.609497][ C1] ? set_track_prepare+0x8a/0xd0 [ 5256.609763][ C1] ? irqentry_enter+0x2b/0x60 [ 5256.610015][ C1] ? irqentry_enter+0x2b/0x60 [ 5256.610271][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5256.610516][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5256.610835][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5256.611177][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5256.611484][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5256.611826][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5256.612128][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5256.612462][ C1] netif_receive_skb+0x55/0x280 [ 5256.612724][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5256.613054][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5256.613403][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5256.613720][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5256.614009][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5256.614315][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5256.614643][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5256.614923][ C1] ? arch_stack_walk+0x68/0x100 [ 5256.615188][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5256.615470][ C1] ? irqentry_enter+0x2b/0x60 [ 5256.615724][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5256.616050][ C1] ? irqentry_enter+0x2b/0x60 [ 5256.616301][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5256.616627][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5256.616911][ C1] ? arch_stack_walk+0x68/0x100 [ 5256.617172][ C1] __tcf_classify+0x32c/0x7d0 [ 5256.617425][ C1] tcf_classify+0x283/0x930 [ 5256.617667][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5256.617937][ C1] tc_run+0x2e4/0x5d0 [ 5256.618153][ C1] ? __pfx_tc_run+0x10/0x10 [ 5256.618397][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5256.618665][ C1] ? irqentry_enter+0x2b/0x60 [ 5256.618919][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5256.619210][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5256.619540][ C1] ip_finish_output2+0x786/0x18e0 [ 5256.619814][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5256.620105][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5256.620375][ C1] ? __ip_finish_output+0x10f/0x770 [ 5256.620656][ C1] ip_output+0x16b/0x4f0 [ 5256.620891][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5256.621215][ C1] ? __pfx_ip_output+0x10/0x10 [ 5256.621476][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5256.621828][ C1] ? __pfx_ip_output+0x10/0x10 [ 5256.622085][ C1] __ip_queue_xmit+0x672/0x1910 [ 5256.622354][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5256.622639][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5256.622943][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5256.623237][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5256.623537][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5256.623827][ C1] tcp_delack_timer+0x84/0x240 [ 5256.624087][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5256.624372][ C1] call_timer_fn+0x176/0x430 [ 5256.624620][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5256.624898][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5256.625176][ C1] __run_timers.part.0+0x52d/0x890 [ 5256.625450][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5256.625742][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5256.626048][ C1] ? __pfx___schedule+0x10/0x10 [ 5256.626308][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5256.626632][ C1] run_timer_softirq+0x72/0x100 [ 5256.626896][ C1] __do_softirq+0x1bc/0x7ff [ 5256.627145][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5256.627422][ C1] run_ksoftirqd+0x2e/0x60 [ 5256.627661][ C1] smpboot_thread_fn+0x30e/0x840 [ 5256.627932][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5256.628226][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5256.628520][ C1] kthread+0x292/0x360 [ 5256.628740][ C1] ? __pfx_kthread+0x10/0x10 [ 5256.628992][ C1] ret_from_fork+0x34/0x70 [ 5256.629230][ C1] ? __pfx_kthread+0x10/0x10 [ 5256.629480][ C1] ret_from_fork_asm+0x1b/0x30 [ 5256.629741][ C1] [ 5280.713023][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5280.713403][ C1] rcu: 1-....: (4074894 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=971962 [ 5280.713988][ C1] rcu: (t=4086404 jiffies g=1007429 q=31 ncpus=4) [ 5280.714334][ C1] Sending NMI from CPU 1 to CPUs 0: [ 5280.714627][ C0] NMI backtrace for cpu 0 [ 5280.714634][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5280.714639][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5280.714642][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5280.714651][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5280.714655][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5280.714659][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5280.714661][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5280.714663][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5280.714665][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5280.714667][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5280.714668][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5280.714671][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5280.714674][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5280.714676][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5280.714677][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5280.714679][ C0] Call Trace: [ 5280.714682][ C0] [ 5280.714686][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 5280.714692][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5280.714697][ C0] ? nmi_handle+0x156/0x420 [ 5280.714703][ C0] ? default_do_nmi+0x41/0x100 [ 5280.714707][ C0] ? exc_nmi+0xf3/0x120 [ 5280.714709][ C0] ? end_repeat_nmi+0xf/0x60 [ 5280.714714][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5280.714718][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5280.714721][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5280.714725][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5280.714728][ C0] [ 5280.714729][ C0] [ 5280.714731][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5280.714734][ C0] ? get_stack_info+0x36/0xc0 [ 5280.714739][ C0] ? lock_acquire+0x1c1/0x220 [ 5280.714744][ C0] ? lock_release+0x1d5/0x250 [ 5280.714747][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5280.714752][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5280.714754][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5280.714758][ C0] ? lock_acquire+0x1c1/0x220 [ 5280.714760][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5280.714766][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5280.714770][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5280.714778][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5280.714780][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5280.714784][ C0] ? __inet_lookup_established+0x341/0x610 [ 5280.714791][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5280.714799][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5280.714803][ C0] ip_local_deliver+0x19d/0x480 [ 5280.714807][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5280.714809][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5280.714814][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5280.714818][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5280.714821][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5280.714825][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5280.714835][ C0] ip_rcv+0x564/0x740 [ 5280.714839][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5280.714842][ C0] ? set_track_prepare+0x8a/0xd0 [ 5280.714847][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5280.714849][ C0] ? rest_init+0x153/0x260 [ 5280.714852][ C0] ? skb_clone+0x10b/0x330 [ 5280.714857][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5280.714863][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5280.714868][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5280.714873][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5280.714883][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5280.714886][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5280.714889][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5280.714893][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5280.714896][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5280.714899][ C0] ? lock_acquire+0x1c1/0x220 [ 5280.714902][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5280.714905][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5280.714908][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5280.714911][ C0] ? __copy_skb_header+0xaf/0x490 [ 5280.714914][ C0] ? __skb_clone+0x57a/0x760 [ 5280.714917][ C0] netif_receive_skb+0x55/0x280 [ 5280.714919][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5280.714927][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5280.714934][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5280.714941][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5280.714946][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5280.714954][ C0] ? hlock_class+0x4e/0x130 [ 5280.714960][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5280.714970][ C0] ? place_entity+0x21/0x2f0 [ 5280.714974][ C0] ? resched_curr+0x219/0x280 [ 5280.714977][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5280.714980][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5280.714984][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5280.714988][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5280.714990][ C0] ? activate_task+0xf5/0x260 [ 5280.714993][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5280.714998][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5280.715002][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5280.715005][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5280.715008][ C0] ? get_stack_info+0x36/0xc0 [ 5280.715012][ C0] ? stack_access_ok+0xda/0x1f0 [ 5280.715014][ C0] ? get_reg+0x119/0x190 [ 5280.715018][ C0] __tcf_classify+0x32c/0x7d0 [ 5280.715024][ C0] tcf_classify+0x283/0x930 [ 5280.715027][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5280.715033][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5280.715035][ C0] ? arch_stack_walk+0x8c/0x100 [ 5280.715039][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5280.715043][ C0] tc_run+0x2e4/0x5d0 [ 5280.715047][ C0] ? __pfx_tc_run+0x10/0x10 [ 5280.715050][ C0] ? lock_acquire+0x1c1/0x220 [ 5280.715052][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5280.715057][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5280.715063][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5280.715066][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5280.715070][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5280.715075][ C0] ? neigh_hh_output+0x348/0x590 [ 5280.715079][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5280.715083][ C0] ip_finish_output2+0x786/0x18e0 [ 5280.715086][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5280.715093][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5280.715101][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5280.715104][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5280.715108][ C0] ? __ip_finish_output+0x10f/0x770 [ 5280.715112][ C0] ip_output+0x16b/0x4f0 [ 5280.715115][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5280.715121][ C0] ? __pfx_ip_output+0x10/0x10 [ 5280.715124][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5280.715129][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5280.715132][ C0] ? ip_local_out+0x114/0x3b0 [ 5280.715136][ C0] __ip_queue_xmit+0x672/0x1910 [ 5280.715140][ C0] ? __skb_clone+0x57a/0x760 [ 5280.715144][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5280.715151][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5280.715155][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5280.715159][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5280.715164][ C0] ? tcp_current_mss+0x40a/0x510 [ 5280.715167][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5280.715170][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5280.715173][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5280.715175][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5280.715178][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5280.715181][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5280.715187][ C0] ? ktime_get+0xb6/0x190 [ 5280.715191][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5280.715196][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5280.715199][ C0] tcp_write_timer+0x82/0x1d0 [ 5280.715203][ C0] call_timer_fn+0x176/0x430 [ 5280.715206][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5280.715211][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5280.715215][ C0] __run_timers.part.0+0x52d/0x890 [ 5280.715218][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5280.715223][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5280.715226][ C0] ? lock_acquire+0x1c1/0x220 [ 5280.715228][ C0] ? clockevents_program_event+0xf6/0x300 [ 5280.715233][ C0] ? lock_release+0x1d5/0x250 [ 5280.715235][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5280.715238][ C0] ? ktime_get+0xb6/0x190 [ 5280.715241][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5280.715245][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5280.715249][ C0] run_timer_softirq+0x72/0x100 [ 5280.715252][ C0] __do_softirq+0x1bc/0x7ff [ 5280.715257][ C0] irq_exit_rcu+0x98/0xc0 [ 5280.715260][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5280.715264][ C0] [ 5280.715265][ C0] [ 5280.715266][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5280.715272][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5280.715275][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5280.715278][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5280.715279][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5280.715281][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5280.715282][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5280.715284][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5280.715285][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5280.715289][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5280.715292][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5280.715296][ C0] default_idle_call+0x69/0xa0 [ 5280.715298][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5280.715301][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5280.715306][ C0] ? lock_release+0x1d5/0x250 [ 5280.715310][ C0] do_idle+0xfb/0x160 [ 5280.715313][ C0] cpu_startup_entry+0x55/0x60 [ 5280.715315][ C0] rest_init+0x153/0x260 [ 5280.715318][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5280.715323][ C0] arch_call_rest_init+0x13/0x40 [ 5280.715329][ C0] start_kernel+0x314/0x3d0 [ 5280.715333][ C0] x86_64_start_reservations+0x18/0x30 [ 5280.715338][ C0] x86_64_start_kernel+0xba/0x110 [ 5280.715342][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5280.715350][ C0] [ 5280.715623][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5280.769720][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5280.770364][ C1] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 5280.770676][ C1] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 5280.771698][ C1] RSP: 0018:ffffc9000019e9d8 EFLAGS: 00000202 [ 5280.772022][ C1] RAX: ffff88800a098e18 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5280.772444][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5280.772864][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5280.773285][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5280.773703][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5280.774127][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5280.774600][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5280.774955][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5280.775381][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5280.775810][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5280.776236][ C1] Call Trace: [ 5280.776414][ C1] [ 5280.776576][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5280.776862][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5280.777128][ C1] ? check_cpu_stall+0x284/0x500 [ 5280.777393][ C1] ? rcu_pending+0x92/0x360 [ 5280.777639][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5280.777925][ C1] ? update_process_times+0xb9/0x110 [ 5280.778207][ C1] ? tick_sched_handle+0x67/0x130 [ 5280.778480][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5280.778782][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5280.779038][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5280.779369][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5280.779653][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5280.779954][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5280.780235][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5280.780552][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5280.780831][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5280.781160][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5280.781477][ C1] [ 5280.781633][ C1] [ 5280.781789][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5280.782120][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5280.782430][ C1] ? kasan_check_range+0x12/0x1c0 [ 5280.782701][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 5280.783002][ C1] ? run_ksoftirqd+0xb/0x60 [ 5280.783256][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5280.783587][ C1] ? __orc_find+0x9c/0xf0 [ 5280.783816][ C1] ? lock_acquire+0x1c1/0x220 [ 5280.784067][ C1] ? irqentry_enter+0x2b/0x60 [ 5280.784317][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5280.784574][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5280.784856][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5280.785156][ C1] ? lock_acquire+0x1c1/0x220 [ 5280.785411][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5280.785669][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5280.785945][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5280.786189][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5280.786446][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5280.786716][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5280.787006][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5280.787298][ C1] ip_local_deliver+0x19d/0x480 [ 5280.787559][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5280.787847][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5280.788117][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5280.788394][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5280.788658][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5280.788997][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5280.789272][ C1] ip_rcv+0x564/0x740 [ 5280.789486][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5280.789727][ C1] ? set_track_prepare+0x8a/0xd0 [ 5280.789993][ C1] ? irqentry_enter+0x2b/0x60 [ 5280.790251][ C1] ? irqentry_enter+0x2b/0x60 [ 5280.790508][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5280.790753][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5280.791070][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5280.791409][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5280.791719][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5280.792066][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5280.792370][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5280.792703][ C1] netif_receive_skb+0x55/0x280 [ 5280.792961][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5280.793289][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5280.793637][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5280.793958][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5280.794248][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5280.794551][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5280.794881][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5280.795165][ C1] ? arch_stack_walk+0x68/0x100 [ 5280.795429][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5280.795709][ C1] ? irqentry_enter+0x2b/0x60 [ 5280.795965][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5280.796287][ C1] ? irqentry_enter+0x2b/0x60 [ 5280.796535][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5280.796855][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5280.797147][ C1] ? arch_stack_walk+0x68/0x100 [ 5280.797408][ C1] __tcf_classify+0x32c/0x7d0 [ 5280.797659][ C1] tcf_classify+0x283/0x930 [ 5280.797901][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5280.798171][ C1] tc_run+0x2e4/0x5d0 [ 5280.798386][ C1] ? __pfx_tc_run+0x10/0x10 [ 5280.798632][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5280.798898][ C1] ? irqentry_enter+0x2b/0x60 [ 5280.799154][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5280.799444][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5280.799768][ C1] ip_finish_output2+0x786/0x18e0 [ 5280.800039][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5280.800328][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5280.800593][ C1] ? __ip_finish_output+0x10f/0x770 [ 5280.800877][ C1] ip_output+0x16b/0x4f0 [ 5280.801106][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5280.801422][ C1] ? __pfx_ip_output+0x10/0x10 [ 5280.801680][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5280.802031][ C1] ? __pfx_ip_output+0x10/0x10 [ 5280.802287][ C1] __ip_queue_xmit+0x672/0x1910 [ 5280.802551][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5280.802835][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5280.803134][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5280.803422][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5280.803719][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5280.804008][ C1] tcp_delack_timer+0x84/0x240 [ 5280.804270][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5280.804555][ C1] call_timer_fn+0x176/0x430 [ 5280.804805][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5280.805085][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5280.805362][ C1] __run_timers.part.0+0x52d/0x890 [ 5280.805639][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5280.805930][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5280.806236][ C1] ? __pfx___schedule+0x10/0x10 [ 5280.806495][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5280.806817][ C1] run_timer_softirq+0x72/0x100 [ 5280.807081][ C1] __do_softirq+0x1bc/0x7ff [ 5280.807328][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5280.807604][ C1] run_ksoftirqd+0x2e/0x60 [ 5280.807841][ C1] smpboot_thread_fn+0x30e/0x840 [ 5280.808110][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5280.808399][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5280.808693][ C1] kthread+0x292/0x360 [ 5280.808912][ C1] ? __pfx_kthread+0x10/0x10 [ 5280.809162][ C1] ret_from_fork+0x34/0x70 [ 5280.809401][ C1] ? __pfx_kthread+0x10/0x10 [ 5280.809650][ C1] ret_from_fork_asm+0x1b/0x30 [ 5280.809907][ C1] [ 5308.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3837s! [swapper/0:0] [ 5308.527925][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5308.529124][ C0] irq event stamp: 27567077 [ 5308.529366][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5308.529898][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5308.530370][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5308.530880][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5308.531380][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5308.531865][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5308.532507][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5308.532844][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5308.533859][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5308.534183][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5308.534602][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5308.535018][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5308.535437][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5308.535854][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5308.536271][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5308.536738][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5308.537092][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5308.537511][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5308.537931][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5308.538355][ C0] Call Trace: [ 5308.538545][ C0] [ 5308.538701][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5308.538976][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5308.539232][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5308.539519][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5308.539808][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5308.540114][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5308.540396][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5308.540720][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5308.540995][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5308.541270][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5308.541596][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5308.541916][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5308.542246][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5308.542554][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5308.542866][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5308.543168][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5308.543494][ C0] ? get_stack_info+0x36/0xc0 [ 5308.543753][ C0] ? lock_acquire+0x1c1/0x220 [ 5308.544010][ C0] ? lock_release+0x1d5/0x250 [ 5308.544266][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5308.544529][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5308.544817][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5308.545117][ C0] ? lock_acquire+0x1c1/0x220 [ 5308.545363][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5308.545612][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5308.545883][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5308.546135][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5308.546397][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5308.546667][ C0] ? __inet_lookup_established+0x341/0x610 [ 5308.546982][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5308.547271][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5308.547559][ C0] ip_local_deliver+0x19d/0x480 [ 5308.547819][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5308.548104][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5308.548372][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5308.548647][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5308.548909][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5308.549248][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5308.549521][ C0] ip_rcv+0x564/0x740 [ 5308.549734][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5308.549979][ C0] ? set_track_prepare+0x8a/0xd0 [ 5308.550244][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5308.550542][ C0] ? rest_init+0x153/0x260 [ 5308.550781][ C0] ? skb_clone+0x10b/0x330 [ 5308.551019][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5308.551357][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5308.551681][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5308.551976][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5308.552285][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5308.552543][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5308.552782][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5308.553094][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5308.553391][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5308.553733][ C0] ? lock_acquire+0x1c1/0x220 [ 5308.553986][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5308.554300][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5308.554596][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5308.554929][ C0] ? __copy_skb_header+0xaf/0x490 [ 5308.555201][ C0] ? __skb_clone+0x57a/0x760 [ 5308.555450][ C0] netif_receive_skb+0x55/0x280 [ 5308.555707][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5308.556034][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5308.556380][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5308.556694][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5308.556979][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5308.557277][ C0] ? hlock_class+0x4e/0x130 [ 5308.557521][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5308.557847][ C0] ? place_entity+0x21/0x2f0 [ 5308.558094][ C0] ? resched_curr+0x219/0x280 [ 5308.558348][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5308.558618][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5308.558902][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5308.559178][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5308.559433][ C0] ? activate_task+0xf5/0x260 [ 5308.559679][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5308.559953][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5308.560228][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5308.560495][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5308.560787][ C0] ? get_stack_info+0x36/0xc0 [ 5308.561038][ C0] ? stack_access_ok+0xda/0x1f0 [ 5308.561293][ C0] ? get_reg+0x119/0x190 [ 5308.561522][ C0] __tcf_classify+0x32c/0x7d0 [ 5308.561777][ C0] tcf_classify+0x283/0x930 [ 5308.562021][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5308.562351][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5308.562615][ C0] ? arch_stack_walk+0x8c/0x100 [ 5308.562875][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5308.563162][ C0] tc_run+0x2e4/0x5d0 [ 5308.563381][ C0] ? __pfx_tc_run+0x10/0x10 [ 5308.563626][ C0] ? lock_acquire+0x1c1/0x220 [ 5308.563876][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5308.564153][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5308.564418][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5308.564703][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5308.564982][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5308.565305][ C0] ? neigh_hh_output+0x348/0x590 [ 5308.565568][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5308.565849][ C0] ip_finish_output2+0x786/0x18e0 [ 5308.566118][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5308.566411][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5308.566762][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5308.567050][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5308.567314][ C0] ? __ip_finish_output+0x10f/0x770 [ 5308.567589][ C0] ip_output+0x16b/0x4f0 [ 5308.567815][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5308.568101][ C0] ? __pfx_ip_output+0x10/0x10 [ 5308.568356][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5308.568657][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5308.568918][ C0] ? ip_local_out+0x114/0x3b0 [ 5308.569179][ C0] __ip_queue_xmit+0x672/0x1910 [ 5308.569444][ C0] ? __skb_clone+0x57a/0x760 [ 5308.569693][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5308.569972][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5308.570265][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5308.570585][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5308.570839][ C0] ? tcp_current_mss+0x40a/0x510 [ 5308.571106][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5308.571385][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5308.571664][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5308.571918][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5308.572185][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5308.572502][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5308.572781][ C0] ? ktime_get+0xb6/0x190 [ 5308.573015][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5308.573291][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5308.573570][ C0] tcp_write_timer+0x82/0x1d0 [ 5308.573825][ C0] call_timer_fn+0x176/0x430 [ 5308.574074][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5308.574346][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5308.574622][ C0] __run_timers.part.0+0x52d/0x890 [ 5308.574893][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5308.575178][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5308.575475][ C0] ? lock_acquire+0x1c1/0x220 [ 5308.575728][ C0] ? clockevents_program_event+0xf6/0x300 [ 5308.576039][ C0] ? lock_release+0x1d5/0x250 [ 5308.576290][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5308.576569][ C0] ? ktime_get+0xb6/0x190 [ 5308.576804][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5308.577109][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5308.577416][ C0] run_timer_softirq+0x72/0x100 [ 5308.577678][ C0] __do_softirq+0x1bc/0x7ff [ 5308.577924][ C0] irq_exit_rcu+0x98/0xc0 [ 5308.578159][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5308.578459][ C0] [ 5308.578615][ C0] [ 5308.578770][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5308.579091][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5308.579362][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5308.580389][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5308.580718][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5308.581133][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5308.581551][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5308.581966][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5308.582381][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5308.582797][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5308.583102][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5308.583377][ C0] default_idle_call+0x69/0xa0 [ 5308.583636][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5308.583899][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5308.584192][ C0] ? lock_release+0x1d5/0x250 [ 5308.584440][ C0] do_idle+0xfb/0x160 [ 5308.584651][ C0] cpu_startup_entry+0x55/0x60 [ 5308.584904][ C0] rest_init+0x153/0x260 [ 5308.585135][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5308.585422][ C0] arch_call_rest_init+0x13/0x40 [ 5308.585688][ C0] start_kernel+0x314/0x3d0 [ 5308.585933][ C0] x86_64_start_reservations+0x18/0x30 [ 5308.586228][ C0] x86_64_start_kernel+0xba/0x110 [ 5308.586494][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5308.586822][ C0] [ 5308.586989][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3837s! [ksoftirqd/1:22] [ 5308.587459][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5308.588663][ C1] irq event stamp: 3886976 [ 5308.588904][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5308.589401][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5308.589893][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5308.590391][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5308.590889][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5308.591388][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5308.592044][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa8/0xb90 [ 5308.592384][ C1] Code: 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 be 04 00 00 00 <48> 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c 08 84 c0 0f 85 [ 5308.593405][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5308.593729][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5308.594150][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5308.594573][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5308.594993][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5308.595415][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5308.595835][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5308.596305][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5308.596661][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5308.597085][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5308.597505][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5308.597927][ C1] Call Trace: [ 5308.598110][ C1] [ 5308.598268][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5308.598544][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5308.598802][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5308.599094][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5308.599382][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5308.599689][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5308.599972][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5308.600297][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5308.600580][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5308.600904][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5308.601217][ C1] [ 5308.601377][ C1] [ 5308.601537][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5308.601877][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5308.602182][ C1] ? queued_spin_lock_slowpath+0xa8/0xb90 [ 5308.602484][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5308.602787][ C1] ? run_ksoftirqd+0xb/0x60 [ 5308.603029][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5308.603356][ C1] ? __orc_find+0x9c/0xf0 [ 5308.603589][ C1] ? lock_acquire+0x1c1/0x220 [ 5308.603845][ C1] ? irqentry_enter+0x2b/0x60 [ 5308.604105][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5308.604373][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5308.604662][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5308.604964][ C1] ? lock_acquire+0x1c1/0x220 [ 5308.605213][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5308.605465][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5308.605738][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5308.605988][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5308.606259][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5308.606533][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5308.606824][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5308.607121][ C1] ip_local_deliver+0x19d/0x480 [ 5308.607379][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5308.607665][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5308.607930][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5308.608213][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5308.608479][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5308.608814][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5308.609095][ C1] ip_rcv+0x564/0x740 [ 5308.609312][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5308.609559][ C1] ? set_track_prepare+0x8a/0xd0 [ 5308.609827][ C1] ? irqentry_enter+0x2b/0x60 [ 5308.610084][ C1] ? irqentry_enter+0x2b/0x60 [ 5308.610334][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5308.610580][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5308.610898][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5308.611247][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5308.611560][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5308.611898][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5308.612196][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5308.612532][ C1] netif_receive_skb+0x55/0x280 [ 5308.612797][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5308.613127][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5308.613478][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5308.613789][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5308.614081][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5308.614387][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5308.614719][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5308.615002][ C1] ? arch_stack_walk+0x68/0x100 [ 5308.615262][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5308.615537][ C1] ? irqentry_enter+0x2b/0x60 [ 5308.615786][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5308.616109][ C1] ? irqentry_enter+0x2b/0x60 [ 5308.616365][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5308.616689][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5308.616967][ C1] ? arch_stack_walk+0x68/0x100 [ 5308.617232][ C1] __tcf_classify+0x32c/0x7d0 [ 5308.617489][ C1] tcf_classify+0x283/0x930 [ 5308.617735][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5308.618010][ C1] tc_run+0x2e4/0x5d0 [ 5308.618228][ C1] ? __pfx_tc_run+0x10/0x10 [ 5308.618476][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5308.618745][ C1] ? irqentry_enter+0x2b/0x60 [ 5308.618994][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5308.619280][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5308.619604][ C1] ip_finish_output2+0x786/0x18e0 [ 5308.619878][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5308.620171][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5308.620435][ C1] ? __ip_finish_output+0x10f/0x770 [ 5308.620717][ C1] ip_output+0x16b/0x4f0 [ 5308.620945][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5308.621270][ C1] ? __pfx_ip_output+0x10/0x10 [ 5308.621528][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5308.621882][ C1] ? __pfx_ip_output+0x10/0x10 [ 5308.622141][ C1] __ip_queue_xmit+0x672/0x1910 [ 5308.622403][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5308.622682][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5308.622977][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5308.623265][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5308.623563][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5308.623849][ C1] tcp_delack_timer+0x84/0x240 [ 5308.624106][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5308.624394][ C1] call_timer_fn+0x176/0x430 [ 5308.624644][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5308.624920][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5308.625203][ C1] __run_timers.part.0+0x52d/0x890 [ 5308.625481][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5308.625771][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5308.626072][ C1] ? __pfx___schedule+0x10/0x10 [ 5308.626337][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5308.626661][ C1] run_timer_softirq+0x72/0x100 [ 5308.626919][ C1] __do_softirq+0x1bc/0x7ff [ 5308.627162][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5308.627437][ C1] run_ksoftirqd+0x2e/0x60 [ 5308.627679][ C1] smpboot_thread_fn+0x30e/0x840 [ 5308.627945][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5308.628240][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5308.628531][ C1] kthread+0x292/0x360 [ 5308.628749][ C1] ? __pfx_kthread+0x10/0x10 [ 5308.628994][ C1] ret_from_fork+0x34/0x70 [ 5308.629237][ C1] ? __pfx_kthread+0x10/0x10 [ 5308.629485][ C1] ret_from_fork_asm+0x1b/0x30 [ 5308.629750][ C1] [ 5336.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3864s! [swapper/0:0] [ 5336.527920][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5336.529110][ C0] irq event stamp: 27567077 [ 5336.529350][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5336.529877][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5336.530365][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5336.530866][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5336.531355][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5336.531830][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5336.532475][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5336.532820][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5336.533840][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5336.534169][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5336.534594][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5336.535018][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5336.535437][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5336.535858][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5336.536281][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5336.536756][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5336.537103][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5336.537532][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5336.537951][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5336.538367][ C0] Call Trace: [ 5336.538543][ C0] [ 5336.538698][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5336.538974][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5336.539229][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5336.539520][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5336.539809][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5336.540109][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5336.540392][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5336.540716][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5336.540987][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5336.541267][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5336.541590][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5336.541899][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5336.542233][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5336.542534][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5336.542841][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5336.543150][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5336.543478][ C0] ? get_stack_info+0x36/0xc0 [ 5336.543729][ C0] ? lock_acquire+0x1c1/0x220 [ 5336.543977][ C0] ? lock_release+0x1d5/0x250 [ 5336.544226][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5336.544482][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5336.544764][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5336.545061][ C0] ? lock_acquire+0x1c1/0x220 [ 5336.545314][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5336.545572][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5336.545845][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5336.546089][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5336.546344][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5336.546611][ C0] ? __inet_lookup_established+0x341/0x610 [ 5336.546924][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5336.547214][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5336.547505][ C0] ip_local_deliver+0x19d/0x480 [ 5336.547763][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5336.548047][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5336.548311][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5336.548591][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5336.548856][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5336.549190][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5336.549469][ C0] ip_rcv+0x564/0x740 [ 5336.549684][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5336.549929][ C0] ? set_track_prepare+0x8a/0xd0 [ 5336.550196][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5336.550492][ C0] ? rest_init+0x153/0x260 [ 5336.550729][ C0] ? skb_clone+0x10b/0x330 [ 5336.550969][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5336.551298][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5336.551615][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5336.551912][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5336.552225][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5336.552486][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5336.552735][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5336.553049][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5336.553349][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5336.553687][ C0] ? lock_acquire+0x1c1/0x220 [ 5336.553940][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5336.554247][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5336.554547][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5336.554875][ C0] ? __copy_skb_header+0xaf/0x490 [ 5336.555142][ C0] ? __skb_clone+0x57a/0x760 [ 5336.555384][ C0] netif_receive_skb+0x55/0x280 [ 5336.555643][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5336.555973][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5336.556323][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5336.556633][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5336.556924][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5336.557226][ C0] ? hlock_class+0x4e/0x130 [ 5336.557474][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5336.557803][ C0] ? place_entity+0x21/0x2f0 [ 5336.558052][ C0] ? resched_curr+0x219/0x280 [ 5336.558299][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5336.558564][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5336.558847][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5336.559127][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5336.559390][ C0] ? activate_task+0xf5/0x260 [ 5336.559646][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5336.559922][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5336.560193][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5336.560458][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5336.560745][ C0] ? get_stack_info+0x36/0xc0 [ 5336.561001][ C0] ? stack_access_ok+0xda/0x1f0 [ 5336.561263][ C0] ? get_reg+0x119/0x190 [ 5336.561494][ C0] __tcf_classify+0x32c/0x7d0 [ 5336.561744][ C0] tcf_classify+0x283/0x930 [ 5336.561983][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5336.562312][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5336.562580][ C0] ? arch_stack_walk+0x8c/0x100 [ 5336.562843][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5336.563137][ C0] tc_run+0x2e4/0x5d0 [ 5336.563352][ C0] ? __pfx_tc_run+0x10/0x10 [ 5336.563595][ C0] ? lock_acquire+0x1c1/0x220 [ 5336.563844][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5336.564117][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5336.564386][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5336.564671][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5336.564945][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5336.565262][ C0] ? neigh_hh_output+0x348/0x590 [ 5336.565527][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5336.565802][ C0] ip_finish_output2+0x786/0x18e0 [ 5336.566069][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5336.566366][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5336.566722][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5336.567012][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5336.567276][ C0] ? __ip_finish_output+0x10f/0x770 [ 5336.567557][ C0] ip_output+0x16b/0x4f0 [ 5336.567787][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5336.568067][ C0] ? __pfx_ip_output+0x10/0x10 [ 5336.568323][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5336.568620][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5336.568886][ C0] ? ip_local_out+0x114/0x3b0 [ 5336.569138][ C0] __ip_queue_xmit+0x672/0x1910 [ 5336.569396][ C0] ? __skb_clone+0x57a/0x760 [ 5336.569640][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5336.569924][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5336.570221][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5336.570546][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5336.570813][ C0] ? tcp_current_mss+0x40a/0x510 [ 5336.571076][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5336.571358][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5336.571635][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5336.571889][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5336.572161][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5336.572486][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5336.572763][ C0] ? ktime_get+0xb6/0x190 [ 5336.572993][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5336.573265][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5336.573549][ C0] tcp_write_timer+0x82/0x1d0 [ 5336.573800][ C0] call_timer_fn+0x176/0x430 [ 5336.574048][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5336.574324][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5336.574595][ C0] __run_timers.part.0+0x52d/0x890 [ 5336.574870][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5336.575152][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5336.575456][ C0] ? lock_acquire+0x1c1/0x220 [ 5336.575706][ C0] ? clockevents_program_event+0xf6/0x300 [ 5336.576009][ C0] ? lock_release+0x1d5/0x250 [ 5336.576257][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5336.576531][ C0] ? ktime_get+0xb6/0x190 [ 5336.576760][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5336.577058][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5336.577374][ C0] run_timer_softirq+0x72/0x100 [ 5336.577633][ C0] __do_softirq+0x1bc/0x7ff [ 5336.577877][ C0] irq_exit_rcu+0x98/0xc0 [ 5336.578107][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5336.578406][ C0] [ 5336.578564][ C0] [ 5336.578723][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5336.579044][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5336.579310][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5336.580325][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5336.580656][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5336.581083][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5336.581504][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5336.581926][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5336.582351][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5336.582778][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5336.583083][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5336.583359][ C0] default_idle_call+0x69/0xa0 [ 5336.583612][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5336.583876][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5336.584167][ C0] ? lock_release+0x1d5/0x250 [ 5336.584421][ C0] do_idle+0xfb/0x160 [ 5336.584641][ C0] cpu_startup_entry+0x55/0x60 [ 5336.584898][ C0] rest_init+0x153/0x260 [ 5336.585123][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5336.585416][ C0] arch_call_rest_init+0x13/0x40 [ 5336.585685][ C0] start_kernel+0x314/0x3d0 [ 5336.585928][ C0] x86_64_start_reservations+0x18/0x30 [ 5336.586226][ C0] x86_64_start_kernel+0xba/0x110 [ 5336.586495][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5336.586826][ C0] [ 5336.586992][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3864s! [ksoftirqd/1:22] [ 5336.587456][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5336.588659][ C1] irq event stamp: 3886976 [ 5336.588899][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5336.589394][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5336.589885][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5336.590388][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5336.590875][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5336.591373][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5336.592022][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5336.592366][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5336.593394][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5336.593724][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5336.594149][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5336.594574][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5336.595001][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5336.595424][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5336.595845][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5336.596320][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5336.596668][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5336.597093][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5336.597512][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5336.597930][ C1] Call Trace: [ 5336.598110][ C1] [ 5336.598266][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5336.598545][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5336.598799][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5336.599095][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5336.599381][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5336.599683][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5336.599966][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5336.600285][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5336.600567][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5336.600898][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5336.601210][ C1] [ 5336.601367][ C1] [ 5336.601524][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5336.601853][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5336.602160][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5336.602474][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5336.602775][ C1] ? run_ksoftirqd+0xb/0x60 [ 5336.603018][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5336.603347][ C1] ? __orc_find+0x9c/0xf0 [ 5336.603580][ C1] ? lock_acquire+0x1c1/0x220 [ 5336.603838][ C1] ? irqentry_enter+0x2b/0x60 [ 5336.604096][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5336.604359][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5336.604647][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5336.604950][ C1] ? lock_acquire+0x1c1/0x220 [ 5336.605198][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5336.605451][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5336.605723][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5336.605974][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5336.606241][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5336.606515][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5336.606809][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5336.607105][ C1] ip_local_deliver+0x19d/0x480 [ 5336.607365][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5336.607650][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5336.607916][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5336.608197][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5336.608462][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5336.608796][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5336.609076][ C1] ip_rcv+0x564/0x740 [ 5336.609291][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5336.609535][ C1] ? set_track_prepare+0x8a/0xd0 [ 5336.609801][ C1] ? irqentry_enter+0x2b/0x60 [ 5336.610050][ C1] ? irqentry_enter+0x2b/0x60 [ 5336.610299][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5336.610545][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5336.610867][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5336.611213][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5336.611524][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5336.611863][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5336.612164][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5336.612502][ C1] netif_receive_skb+0x55/0x280 [ 5336.612764][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5336.613099][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5336.613449][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5336.613764][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5336.614059][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5336.614368][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5336.614698][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5336.614983][ C1] ? arch_stack_walk+0x68/0x100 [ 5336.615245][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5336.615521][ C1] ? irqentry_enter+0x2b/0x60 [ 5336.615770][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5336.616089][ C1] ? irqentry_enter+0x2b/0x60 [ 5336.616343][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5336.616671][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5336.616950][ C1] ? arch_stack_walk+0x68/0x100 [ 5336.617218][ C1] __tcf_classify+0x32c/0x7d0 [ 5336.617476][ C1] tcf_classify+0x283/0x930 [ 5336.617722][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5336.617996][ C1] tc_run+0x2e4/0x5d0 [ 5336.618212][ C1] ? __pfx_tc_run+0x10/0x10 [ 5336.618459][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5336.618727][ C1] ? irqentry_enter+0x2b/0x60 [ 5336.618976][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5336.619262][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5336.619582][ C1] ip_finish_output2+0x786/0x18e0 [ 5336.619856][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5336.620152][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5336.620420][ C1] ? __ip_finish_output+0x10f/0x770 [ 5336.620700][ C1] ip_output+0x16b/0x4f0 [ 5336.620928][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5336.621252][ C1] ? __pfx_ip_output+0x10/0x10 [ 5336.621509][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5336.621866][ C1] ? __pfx_ip_output+0x10/0x10 [ 5336.622128][ C1] __ip_queue_xmit+0x672/0x1910 [ 5336.622390][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5336.622671][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5336.622968][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5336.623256][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5336.623552][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5336.623835][ C1] tcp_delack_timer+0x84/0x240 [ 5336.624091][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5336.624378][ C1] call_timer_fn+0x176/0x430 [ 5336.624628][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5336.624903][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5336.625185][ C1] __run_timers.part.0+0x52d/0x890 [ 5336.625461][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5336.625747][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5336.626049][ C1] ? __pfx___schedule+0x10/0x10 [ 5336.626314][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5336.626635][ C1] run_timer_softirq+0x72/0x100 [ 5336.626894][ C1] __do_softirq+0x1bc/0x7ff [ 5336.627138][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5336.627413][ C1] run_ksoftirqd+0x2e/0x60 [ 5336.627654][ C1] smpboot_thread_fn+0x30e/0x840 [ 5336.627919][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5336.628213][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5336.628501][ C1] kthread+0x292/0x360 [ 5336.628722][ C1] ? __pfx_kthread+0x10/0x10 [ 5336.628969][ C1] ret_from_fork+0x34/0x70 [ 5336.629212][ C1] ? __pfx_kthread+0x10/0x10 [ 5336.629456][ C1] ret_from_fork_asm+0x1b/0x30 [ 5336.629718][ C1] [ 5358.811024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5358.811413][ C0] rcu: 0-....: (4158994 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=990325 [ 5358.811924][ C0] rcu: (t=4164502 jiffies g=1007429 q=31 ncpus=4) [ 5358.812273][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5358.812750][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5358.813395][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5358.813741][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5358.814762][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5358.815090][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5358.815510][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5358.815934][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5358.816358][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5358.816777][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5358.817198][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5358.817672][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5358.818018][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5358.818439][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5358.818855][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5358.819272][ C0] Call Trace: [ 5358.819451][ C0] [ 5358.819608][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5358.819896][ C0] ? print_cpu_stall+0x263/0x6a0 [ 5358.820160][ C0] ? check_cpu_stall+0x284/0x500 [ 5358.820429][ C0] ? rcu_pending+0x92/0x360 [ 5358.820672][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5358.820958][ C0] ? update_process_times+0xb9/0x110 [ 5358.821243][ C0] ? tick_sched_handle+0x67/0x130 [ 5358.821515][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5358.821816][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5358.822070][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5358.822398][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5358.822682][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5358.822982][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5358.823260][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5358.823579][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5358.823860][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5358.824136][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5358.824461][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5358.824774][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5358.825105][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5358.825409][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5358.825722][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5358.826023][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5358.826348][ C0] ? get_stack_info+0x36/0xc0 [ 5358.826603][ C0] ? lock_acquire+0x1c1/0x220 [ 5358.826857][ C0] ? lock_release+0x1d5/0x250 [ 5358.827110][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5358.827371][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5358.827660][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5358.827961][ C0] ? lock_acquire+0x1c1/0x220 [ 5358.828210][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5358.828464][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5358.828735][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5358.828984][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5358.829244][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5358.829518][ C0] ? __inet_lookup_established+0x341/0x610 [ 5358.829831][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5358.830118][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5358.830416][ C0] ip_local_deliver+0x19d/0x480 [ 5358.830675][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5358.830957][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5358.831223][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5358.831503][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5358.831769][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5358.832103][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5358.832380][ C0] ip_rcv+0x564/0x740 [ 5358.832601][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5358.832848][ C0] ? set_track_prepare+0x8a/0xd0 [ 5358.833116][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5358.833403][ C0] ? rest_init+0x153/0x260 [ 5358.833643][ C0] ? skb_clone+0x10b/0x330 [ 5358.833881][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5358.834217][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5358.834540][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5358.834834][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5358.835141][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5358.835399][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5358.835640][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5358.835952][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5358.836248][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5358.836597][ C0] ? lock_acquire+0x1c1/0x220 [ 5358.836851][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5358.837162][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5358.837458][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5358.837791][ C0] ? __copy_skb_header+0xaf/0x490 [ 5358.838063][ C0] ? __skb_clone+0x57a/0x760 [ 5358.838312][ C0] netif_receive_skb+0x55/0x280 [ 5358.838570][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5358.838897][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5358.839244][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5358.839561][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5358.839847][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5358.840147][ C0] ? hlock_class+0x4e/0x130 [ 5358.840400][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5358.840735][ C0] ? place_entity+0x21/0x2f0 [ 5358.840983][ C0] ? resched_curr+0x219/0x280 [ 5358.841232][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5358.841498][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5358.841779][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5358.842059][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5358.842319][ C0] ? activate_task+0xf5/0x260 [ 5358.842573][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5358.842851][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5358.843123][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5358.843385][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5358.843678][ C0] ? get_stack_info+0x36/0xc0 [ 5358.843927][ C0] ? stack_access_ok+0xda/0x1f0 [ 5358.844182][ C0] ? get_reg+0x119/0x190 [ 5358.844410][ C0] __tcf_classify+0x32c/0x7d0 [ 5358.844664][ C0] tcf_classify+0x283/0x930 [ 5358.844911][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5358.845241][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5358.845507][ C0] ? arch_stack_walk+0x8c/0x100 [ 5358.845767][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5358.846055][ C0] tc_run+0x2e4/0x5d0 [ 5358.846276][ C0] ? __pfx_tc_run+0x10/0x10 [ 5358.846520][ C0] ? lock_acquire+0x1c1/0x220 [ 5358.846775][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5358.847052][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5358.847317][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5358.847610][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5358.847890][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5358.848213][ C0] ? neigh_hh_output+0x348/0x590 [ 5358.848477][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5358.848755][ C0] ip_finish_output2+0x786/0x18e0 [ 5358.849024][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5358.849325][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5358.849675][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5358.849961][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5358.850230][ C0] ? __ip_finish_output+0x10f/0x770 [ 5358.850513][ C0] ip_output+0x16b/0x4f0 [ 5358.850742][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5358.851025][ C0] ? __pfx_ip_output+0x10/0x10 [ 5358.851282][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5358.851579][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5358.851844][ C0] ? ip_local_out+0x114/0x3b0 [ 5358.852104][ C0] __ip_queue_xmit+0x672/0x1910 [ 5358.852363][ C0] ? __skb_clone+0x57a/0x760 [ 5358.852612][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5358.852894][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5358.853195][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5358.853513][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5358.853767][ C0] ? tcp_current_mss+0x40a/0x510 [ 5358.854033][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5358.854315][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5358.854592][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5358.854849][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5358.855116][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5358.855434][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5358.855713][ C0] ? ktime_get+0xb6/0x190 [ 5358.855948][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5358.856224][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5358.856507][ C0] tcp_write_timer+0x82/0x1d0 [ 5358.856762][ C0] call_timer_fn+0x176/0x430 [ 5358.857012][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5358.857285][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5358.857560][ C0] __run_timers.part.0+0x52d/0x890 [ 5358.857831][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5358.858116][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5358.858414][ C0] ? lock_acquire+0x1c1/0x220 [ 5358.858667][ C0] ? clockevents_program_event+0xf6/0x300 [ 5358.858974][ C0] ? lock_release+0x1d5/0x250 [ 5358.859225][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5358.859507][ C0] ? ktime_get+0xb6/0x190 [ 5358.859739][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5358.860039][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5358.860355][ C0] run_timer_softirq+0x72/0x100 [ 5358.860614][ C0] __do_softirq+0x1bc/0x7ff [ 5358.860855][ C0] irq_exit_rcu+0x98/0xc0 [ 5358.861085][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5358.861383][ C0] [ 5358.861543][ C0] [ 5358.861703][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5358.862022][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5358.862290][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5358.863300][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5358.863618][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5358.864035][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5358.864450][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5358.864865][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5358.865280][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5358.865698][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5358.865999][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5358.866272][ C0] default_idle_call+0x69/0xa0 [ 5358.866528][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5358.866790][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5358.867082][ C0] ? lock_release+0x1d5/0x250 [ 5358.867330][ C0] do_idle+0xfb/0x160 [ 5358.867542][ C0] cpu_startup_entry+0x55/0x60 [ 5358.867797][ C0] rest_init+0x153/0x260 [ 5358.868022][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5358.868308][ C0] arch_call_rest_init+0x13/0x40 [ 5358.868573][ C0] start_kernel+0x314/0x3d0 [ 5358.868817][ C0] x86_64_start_reservations+0x18/0x30 [ 5358.869113][ C0] x86_64_start_kernel+0xba/0x110 [ 5358.869379][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5358.869705][ C0] [ 5358.869870][ C0] Sending NMI from CPU 0 to CPUs 1: [ 5358.870160][ C1] NMI backtrace for cpu 1 [ 5358.870168][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5358.870173][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5358.870176][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5358.870184][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5358.870188][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5358.870191][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5358.870193][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5358.870196][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5358.870197][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5358.870199][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5358.870201][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5358.870203][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5358.870206][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5358.870208][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5358.870209][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5358.870211][ C1] Call Trace: [ 5358.870214][ C1] [ 5358.870218][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 5358.870224][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5358.870230][ C1] ? nmi_handle+0x156/0x420 [ 5358.870236][ C1] ? default_do_nmi+0x41/0x100 [ 5358.870245][ C1] ? exc_nmi+0xf3/0x120 [ 5358.870248][ C1] ? end_repeat_nmi+0xf/0x60 [ 5358.870253][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5358.870257][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5358.870260][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5358.870264][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5358.870267][ C1] [ 5358.870268][ C1] [ 5358.870269][ C1] ? run_ksoftirqd+0xb/0x60 [ 5358.870274][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5358.870277][ C1] ? __orc_find+0x9c/0xf0 [ 5358.870280][ C1] ? lock_acquire+0x1c1/0x220 [ 5358.870285][ C1] ? irqentry_enter+0x2b/0x60 [ 5358.870290][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5358.870294][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5358.870298][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5358.870301][ C1] ? lock_acquire+0x1c1/0x220 [ 5358.870303][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5358.870309][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5358.870313][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5358.870320][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5358.870323][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5358.870329][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5358.870336][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5358.870340][ C1] ip_local_deliver+0x19d/0x480 [ 5358.870343][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5358.870346][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5358.870350][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5358.870355][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5358.870358][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5358.870362][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5358.870372][ C1] ip_rcv+0x564/0x740 [ 5358.870375][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5358.870378][ C1] ? set_track_prepare+0x8a/0xd0 [ 5358.870383][ C1] ? irqentry_enter+0x2b/0x60 [ 5358.870386][ C1] ? irqentry_enter+0x2b/0x60 [ 5358.870390][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5358.870392][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5358.870397][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5358.870400][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5358.870403][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5358.870406][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5358.870409][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5358.870414][ C1] netif_receive_skb+0x55/0x280 [ 5358.870417][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5358.870426][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5358.870433][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5358.870440][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5358.870447][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5358.870459][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5358.870469][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5358.870472][ C1] ? arch_stack_walk+0x68/0x100 [ 5358.870477][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5358.870480][ C1] ? irqentry_enter+0x2b/0x60 [ 5358.870483][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5358.870488][ C1] ? irqentry_enter+0x2b/0x60 [ 5358.870491][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5358.870498][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5358.870501][ C1] ? arch_stack_walk+0x68/0x100 [ 5358.870505][ C1] __tcf_classify+0x32c/0x7d0 [ 5358.870510][ C1] tcf_classify+0x283/0x930 [ 5358.870514][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5358.870518][ C1] tc_run+0x2e4/0x5d0 [ 5358.870523][ C1] ? __pfx_tc_run+0x10/0x10 [ 5358.870528][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5358.870533][ C1] ? irqentry_enter+0x2b/0x60 [ 5358.870537][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5358.870540][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5358.870547][ C1] ip_finish_output2+0x786/0x18e0 [ 5358.870553][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5358.870556][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5358.870560][ C1] ? __ip_finish_output+0x10f/0x770 [ 5358.870564][ C1] ip_output+0x16b/0x4f0 [ 5358.870567][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5358.870571][ C1] ? __pfx_ip_output+0x10/0x10 [ 5358.870575][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5358.870582][ C1] ? __pfx_ip_output+0x10/0x10 [ 5358.870587][ C1] __ip_queue_xmit+0x672/0x1910 [ 5358.870593][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5358.870599][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5358.870604][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5358.870608][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5358.870612][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5358.870614][ C1] tcp_delack_timer+0x84/0x240 [ 5358.870618][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5358.870621][ C1] call_timer_fn+0x176/0x430 [ 5358.870626][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5358.870631][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5358.870635][ C1] __run_timers.part.0+0x52d/0x890 [ 5358.870638][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5358.870642][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5358.870647][ C1] ? __pfx___schedule+0x10/0x10 [ 5358.870651][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5358.870656][ C1] run_timer_softirq+0x72/0x100 [ 5358.870659][ C1] __do_softirq+0x1bc/0x7ff [ 5358.870663][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5358.870667][ C1] run_ksoftirqd+0x2e/0x60 [ 5358.870670][ C1] smpboot_thread_fn+0x30e/0x840 [ 5358.870675][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5358.870678][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5358.870681][ C1] kthread+0x292/0x360 [ 5358.870684][ C1] ? __pfx_kthread+0x10/0x10 [ 5358.870686][ C1] ret_from_fork+0x34/0x70 [ 5358.870689][ C1] ? __pfx_kthread+0x10/0x10 [ 5358.870691][ C1] ret_from_fork_asm+0x1b/0x30 [ 5358.870698][ C1] [ 5384.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3908s! [swapper/0:0] [ 5384.527913][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5384.529104][ C0] irq event stamp: 27567077 [ 5384.529342][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5384.529871][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5384.530354][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5384.530855][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5384.531347][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5384.531824][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5384.532472][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5384.532814][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5384.533837][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5384.534166][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5384.534585][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5384.535004][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5384.535427][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5384.535850][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5384.536271][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5384.536741][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5384.537088][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5384.537508][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5384.537924][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5384.538343][ C0] Call Trace: [ 5384.538523][ C0] [ 5384.538677][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5384.538955][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5384.539208][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5384.539499][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5384.539781][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5384.540081][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5384.540365][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5384.540687][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5384.540959][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5384.541238][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5384.541558][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5384.541869][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5384.542202][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5384.542502][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5384.542810][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5384.543116][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5384.543445][ C0] ? get_stack_info+0x36/0xc0 [ 5384.543696][ C0] ? lock_acquire+0x1c1/0x220 [ 5384.543948][ C0] ? lock_release+0x1d5/0x250 [ 5384.544198][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5384.544457][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5384.544742][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5384.545038][ C0] ? lock_acquire+0x1c1/0x220 [ 5384.545290][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5384.545550][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5384.545825][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5384.546072][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5384.546329][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5384.546596][ C0] ? __inet_lookup_established+0x341/0x610 [ 5384.546906][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5384.547199][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5384.547495][ C0] ip_local_deliver+0x19d/0x480 [ 5384.547752][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5384.548035][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5384.548297][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5384.548577][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5384.548843][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5384.549179][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5384.549455][ C0] ip_rcv+0x564/0x740 [ 5384.549672][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5384.549916][ C0] ? set_track_prepare+0x8a/0xd0 [ 5384.550190][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5384.550482][ C0] ? rest_init+0x153/0x260 [ 5384.550716][ C0] ? skb_clone+0x10b/0x330 [ 5384.550958][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5384.551292][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5384.551610][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5384.551911][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5384.552226][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5384.552488][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5384.552731][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5384.553052][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5384.553357][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5384.553697][ C0] ? lock_acquire+0x1c1/0x220 [ 5384.553942][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5384.554249][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5384.554549][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5384.554876][ C0] ? __copy_skb_header+0xaf/0x490 [ 5384.555142][ C0] ? __skb_clone+0x57a/0x760 [ 5384.555386][ C0] netif_receive_skb+0x55/0x280 [ 5384.555648][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5384.555977][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5384.556328][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5384.556638][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5384.556925][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5384.557226][ C0] ? hlock_class+0x4e/0x130 [ 5384.557475][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5384.557807][ C0] ? place_entity+0x21/0x2f0 [ 5384.558058][ C0] ? resched_curr+0x219/0x280 [ 5384.558310][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5384.558575][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5384.558854][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5384.559134][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5384.559393][ C0] ? activate_task+0xf5/0x260 [ 5384.559645][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5384.559922][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5384.560198][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5384.560457][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5384.560748][ C0] ? get_stack_info+0x36/0xc0 [ 5384.561003][ C0] ? stack_access_ok+0xda/0x1f0 [ 5384.561264][ C0] ? get_reg+0x119/0x190 [ 5384.561492][ C0] __tcf_classify+0x32c/0x7d0 [ 5384.561743][ C0] tcf_classify+0x283/0x930 [ 5384.561982][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5384.562308][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5384.562585][ C0] ? arch_stack_walk+0x8c/0x100 [ 5384.562848][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5384.563142][ C0] tc_run+0x2e4/0x5d0 [ 5384.563356][ C0] ? __pfx_tc_run+0x10/0x10 [ 5384.563595][ C0] ? lock_acquire+0x1c1/0x220 [ 5384.563841][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5384.564116][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5384.564384][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5384.564668][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5384.564945][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5384.565265][ C0] ? neigh_hh_output+0x348/0x590 [ 5384.565534][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5384.565815][ C0] ip_finish_output2+0x786/0x18e0 [ 5384.566083][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5384.566373][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5384.566731][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5384.567023][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5384.567286][ C0] ? __ip_finish_output+0x10f/0x770 [ 5384.567567][ C0] ip_output+0x16b/0x4f0 [ 5384.567794][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5384.568085][ C0] ? __pfx_ip_output+0x10/0x10 [ 5384.568343][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5384.568642][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5384.568906][ C0] ? ip_local_out+0x114/0x3b0 [ 5384.569155][ C0] __ip_queue_xmit+0x672/0x1910 [ 5384.569414][ C0] ? __skb_clone+0x57a/0x760 [ 5384.569659][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5384.569943][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5384.570246][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5384.570561][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5384.570819][ C0] ? tcp_current_mss+0x40a/0x510 [ 5384.571079][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5384.571362][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5384.571634][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5384.571884][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5384.572155][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5384.572474][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5384.572753][ C0] ? ktime_get+0xb6/0x190 [ 5384.572982][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5384.573255][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5384.573538][ C0] tcp_write_timer+0x82/0x1d0 [ 5384.573785][ C0] call_timer_fn+0x176/0x430 [ 5384.574028][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5384.574304][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5384.574580][ C0] __run_timers.part.0+0x52d/0x890 [ 5384.574855][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5384.575135][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5384.575433][ C0] ? lock_acquire+0x1c1/0x220 [ 5384.575678][ C0] ? clockevents_program_event+0xf6/0x300 [ 5384.575981][ C0] ? lock_release+0x1d5/0x250 [ 5384.576231][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5384.576506][ C0] ? ktime_get+0xb6/0x190 [ 5384.576735][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5384.577032][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5384.577343][ C0] run_timer_softirq+0x72/0x100 [ 5384.577598][ C0] __do_softirq+0x1bc/0x7ff [ 5384.577839][ C0] irq_exit_rcu+0x98/0xc0 [ 5384.578069][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5384.578366][ C0] [ 5384.578525][ C0] [ 5384.578685][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5384.579007][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5384.579274][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5384.580297][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5384.580623][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5384.581044][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5384.581466][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5384.581890][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5384.582311][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5384.582732][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5384.583037][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5384.583310][ C0] default_idle_call+0x69/0xa0 [ 5384.583562][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5384.583827][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5384.584118][ C0] ? lock_release+0x1d5/0x250 [ 5384.584370][ C0] do_idle+0xfb/0x160 [ 5384.584587][ C0] cpu_startup_entry+0x55/0x60 [ 5384.584845][ C0] rest_init+0x153/0x260 [ 5384.585070][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5384.585359][ C0] arch_call_rest_init+0x13/0x40 [ 5384.585626][ C0] start_kernel+0x314/0x3d0 [ 5384.585866][ C0] x86_64_start_reservations+0x18/0x30 [ 5384.586156][ C0] x86_64_start_kernel+0xba/0x110 [ 5384.586428][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5384.586757][ C0] [ 5384.586926][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3908s! [ksoftirqd/1:22] [ 5384.587391][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5384.588590][ C1] irq event stamp: 3886976 [ 5384.588830][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5384.589328][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5384.589822][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5384.590329][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5384.590819][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5384.591317][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5384.591970][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5384.592316][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5384.593349][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5384.593680][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5384.594104][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5384.594528][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5384.594954][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5384.595382][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5384.595805][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5384.596279][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5384.596628][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5384.597053][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5384.597474][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5384.597893][ C1] Call Trace: [ 5384.598073][ C1] [ 5384.598229][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5384.598509][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5384.598762][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5384.599055][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5384.599339][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5384.599640][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5384.599920][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5384.600247][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5384.600523][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5384.600850][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5384.601165][ C1] [ 5384.601322][ C1] [ 5384.601479][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5384.601811][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5384.602119][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5384.602434][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5384.602737][ C1] ? run_ksoftirqd+0xb/0x60 [ 5384.602983][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5384.603311][ C1] ? __orc_find+0x9c/0xf0 [ 5384.603544][ C1] ? lock_acquire+0x1c1/0x220 [ 5384.603801][ C1] ? irqentry_enter+0x2b/0x60 [ 5384.604058][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5384.604325][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5384.604616][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5384.604920][ C1] ? lock_acquire+0x1c1/0x220 [ 5384.605169][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5384.605419][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5384.605692][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5384.605942][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5384.606209][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5384.606482][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5384.606777][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5384.607070][ C1] ip_local_deliver+0x19d/0x480 [ 5384.607329][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5384.607614][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5384.607880][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5384.608163][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5384.608429][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5384.608765][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5384.609045][ C1] ip_rcv+0x564/0x740 [ 5384.609262][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5384.609508][ C1] ? set_track_prepare+0x8a/0xd0 [ 5384.609777][ C1] ? irqentry_enter+0x2b/0x60 [ 5384.610026][ C1] ? irqentry_enter+0x2b/0x60 [ 5384.610284][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5384.610530][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5384.610847][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5384.611192][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5384.611506][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5384.611846][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5384.612144][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5384.612480][ C1] netif_receive_skb+0x55/0x280 [ 5384.612747][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5384.613078][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5384.613432][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5384.613743][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5384.614036][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5384.614342][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5384.614674][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5384.614957][ C1] ? arch_stack_walk+0x68/0x100 [ 5384.615216][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5384.615493][ C1] ? irqentry_enter+0x2b/0x60 [ 5384.615742][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5384.616065][ C1] ? irqentry_enter+0x2b/0x60 [ 5384.616323][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5384.616646][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5384.616925][ C1] ? arch_stack_walk+0x68/0x100 [ 5384.617189][ C1] __tcf_classify+0x32c/0x7d0 [ 5384.617447][ C1] tcf_classify+0x283/0x930 [ 5384.617693][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5384.617968][ C1] tc_run+0x2e4/0x5d0 [ 5384.618186][ C1] ? __pfx_tc_run+0x10/0x10 [ 5384.618436][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5384.618705][ C1] ? irqentry_enter+0x2b/0x60 [ 5384.618954][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5384.619240][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5384.619565][ C1] ip_finish_output2+0x786/0x18e0 [ 5384.619838][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5384.620134][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5384.620403][ C1] ? __ip_finish_output+0x10f/0x770 [ 5384.620680][ C1] ip_output+0x16b/0x4f0 [ 5384.620908][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5384.621232][ C1] ? __pfx_ip_output+0x10/0x10 [ 5384.621491][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5384.621846][ C1] ? __pfx_ip_output+0x10/0x10 [ 5384.622106][ C1] __ip_queue_xmit+0x672/0x1910 [ 5384.622367][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5384.622647][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5384.622942][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5384.623230][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5384.623527][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5384.623814][ C1] tcp_delack_timer+0x84/0x240 [ 5384.624072][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5384.624361][ C1] call_timer_fn+0x176/0x430 [ 5384.624613][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5384.624888][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5384.625172][ C1] __run_timers.part.0+0x52d/0x890 [ 5384.625448][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5384.625736][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5384.626038][ C1] ? __pfx___schedule+0x10/0x10 [ 5384.626300][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5384.626625][ C1] run_timer_softirq+0x72/0x100 [ 5384.626882][ C1] __do_softirq+0x1bc/0x7ff [ 5384.627125][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5384.627399][ C1] run_ksoftirqd+0x2e/0x60 [ 5384.627640][ C1] smpboot_thread_fn+0x30e/0x840 [ 5384.627906][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5384.628204][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5384.628495][ C1] kthread+0x292/0x360 [ 5384.628713][ C1] ? __pfx_kthread+0x10/0x10 [ 5384.628957][ C1] ret_from_fork+0x34/0x70 [ 5384.629199][ C1] ? __pfx_kthread+0x10/0x10 [ 5384.629446][ C1] ret_from_fork_asm+0x1b/0x30 [ 5384.629709][ C1] [ 5412.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3934s! [swapper/0:0] [ 5412.527919][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5412.529126][ C0] irq event stamp: 27567077 [ 5412.529368][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5412.529897][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5412.530381][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5412.530886][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5412.531385][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5412.531870][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5412.532513][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5412.532851][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5412.533863][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5412.534185][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5412.534601][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5412.535015][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5412.535432][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5412.535846][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5412.536265][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5412.536731][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5412.537082][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5412.537498][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5412.537915][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5412.538336][ C0] Call Trace: [ 5412.538519][ C0] [ 5412.538674][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5412.538947][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5412.539202][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5412.539488][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5412.539775][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5412.540087][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5412.540364][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5412.540680][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5412.540954][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5412.541235][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5412.541559][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5412.541872][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5412.542204][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5412.542510][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5412.542820][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5412.543121][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5412.543445][ C0] ? get_stack_info+0x36/0xc0 [ 5412.543706][ C0] ? lock_acquire+0x1c1/0x220 [ 5412.543962][ C0] ? lock_release+0x1d5/0x250 [ 5412.544217][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5412.544478][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5412.544764][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5412.545062][ C0] ? lock_acquire+0x1c1/0x220 [ 5412.545308][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5412.545556][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5412.545827][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5412.546076][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5412.546337][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5412.546607][ C0] ? __inet_lookup_established+0x341/0x610 [ 5412.546925][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5412.547215][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5412.547504][ C0] ip_local_deliver+0x19d/0x480 [ 5412.547764][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5412.548049][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5412.548315][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5412.548589][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5412.548855][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5412.549193][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5412.549466][ C0] ip_rcv+0x564/0x740 [ 5412.549679][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5412.549918][ C0] ? set_track_prepare+0x8a/0xd0 [ 5412.550188][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5412.550476][ C0] ? rest_init+0x153/0x260 [ 5412.550718][ C0] ? skb_clone+0x10b/0x330 [ 5412.550956][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5412.551294][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5412.551617][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5412.551911][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5412.552218][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5412.552476][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5412.552714][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5412.553026][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5412.553322][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5412.553664][ C0] ? lock_acquire+0x1c1/0x220 [ 5412.553915][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5412.554227][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5412.554524][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5412.554856][ C0] ? __copy_skb_header+0xaf/0x490 [ 5412.555129][ C0] ? __skb_clone+0x57a/0x760 [ 5412.555378][ C0] netif_receive_skb+0x55/0x280 [ 5412.555635][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5412.555960][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5412.556306][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5412.556620][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5412.556905][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5412.557203][ C0] ? hlock_class+0x4e/0x130 [ 5412.557446][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5412.557770][ C0] ? place_entity+0x21/0x2f0 [ 5412.558014][ C0] ? resched_curr+0x219/0x280 [ 5412.558267][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5412.558536][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5412.558824][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5412.559099][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5412.559353][ C0] ? activate_task+0xf5/0x260 [ 5412.559600][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5412.559872][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5412.560153][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5412.560415][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5412.560706][ C0] ? get_stack_info+0x36/0xc0 [ 5412.560955][ C0] ? stack_access_ok+0xda/0x1f0 [ 5412.561212][ C0] ? get_reg+0x119/0x190 [ 5412.561439][ C0] __tcf_classify+0x32c/0x7d0 [ 5412.561695][ C0] tcf_classify+0x283/0x930 [ 5412.561939][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5412.562269][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5412.562538][ C0] ? arch_stack_walk+0x8c/0x100 [ 5412.562797][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5412.563084][ C0] tc_run+0x2e4/0x5d0 [ 5412.563301][ C0] ? __pfx_tc_run+0x10/0x10 [ 5412.563546][ C0] ? lock_acquire+0x1c1/0x220 [ 5412.563795][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5412.564070][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5412.564334][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5412.564618][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5412.564896][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5412.565218][ C0] ? neigh_hh_output+0x348/0x590 [ 5412.565481][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5412.565761][ C0] ip_finish_output2+0x786/0x18e0 [ 5412.566031][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5412.566324][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5412.566673][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5412.566960][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5412.567226][ C0] ? __ip_finish_output+0x10f/0x770 [ 5412.567503][ C0] ip_output+0x16b/0x4f0 [ 5412.567729][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5412.568012][ C0] ? __pfx_ip_output+0x10/0x10 [ 5412.568268][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5412.568569][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5412.568829][ C0] ? ip_local_out+0x114/0x3b0 [ 5412.569083][ C0] __ip_queue_xmit+0x672/0x1910 [ 5412.569348][ C0] ? __skb_clone+0x57a/0x760 [ 5412.569596][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5412.569875][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5412.570180][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5412.570500][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5412.570753][ C0] ? tcp_current_mss+0x40a/0x510 [ 5412.571019][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5412.571298][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5412.571577][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5412.571830][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5412.572097][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5412.572413][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5412.572692][ C0] ? ktime_get+0xb6/0x190 [ 5412.572926][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5412.573201][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5412.573480][ C0] tcp_write_timer+0x82/0x1d0 [ 5412.573734][ C0] call_timer_fn+0x176/0x430 [ 5412.573982][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5412.574254][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5412.574530][ C0] __run_timers.part.0+0x52d/0x890 [ 5412.574800][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5412.575085][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5412.575380][ C0] ? lock_acquire+0x1c1/0x220 [ 5412.575632][ C0] ? clockevents_program_event+0xf6/0x300 [ 5412.575941][ C0] ? lock_release+0x1d5/0x250 [ 5412.576193][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5412.576472][ C0] ? ktime_get+0xb6/0x190 [ 5412.576703][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5412.577005][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5412.577314][ C0] run_timer_softirq+0x72/0x100 [ 5412.577574][ C0] __do_softirq+0x1bc/0x7ff [ 5412.577819][ C0] irq_exit_rcu+0x98/0xc0 [ 5412.578053][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5412.578353][ C0] [ 5412.578508][ C0] [ 5412.578663][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5412.578979][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5412.579249][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5412.580275][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5412.580593][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5412.581008][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5412.581425][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5412.581838][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5412.582252][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5412.582670][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5412.582969][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5412.583246][ C0] default_idle_call+0x69/0xa0 [ 5412.583502][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5412.583765][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5412.584057][ C0] ? lock_release+0x1d5/0x250 [ 5412.584305][ C0] do_idle+0xfb/0x160 [ 5412.584515][ C0] cpu_startup_entry+0x55/0x60 [ 5412.584766][ C0] rest_init+0x153/0x260 [ 5412.584996][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5412.585283][ C0] arch_call_rest_init+0x13/0x40 [ 5412.585547][ C0] start_kernel+0x314/0x3d0 [ 5412.585791][ C0] x86_64_start_reservations+0x18/0x30 [ 5412.586083][ C0] x86_64_start_kernel+0xba/0x110 [ 5412.586349][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5412.586675][ C0] [ 5412.586840][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3934s! [ksoftirqd/1:22] [ 5412.587316][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5412.588508][ C1] irq event stamp: 3886976 [ 5412.588744][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5412.589246][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5412.589748][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5412.590255][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5412.590752][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5412.591245][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5412.591887][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 5412.592225][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 5412.593258][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5412.593583][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5412.594009][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5412.594431][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5412.594851][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5412.595277][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5412.595702][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5412.596178][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5412.596528][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5412.596957][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5412.597376][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5412.597797][ C1] Call Trace: [ 5412.597974][ C1] [ 5412.598129][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5412.598409][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5412.598665][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5412.598959][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5412.599245][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5412.599549][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5412.599828][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5412.600153][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5412.600430][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5412.600757][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5412.601073][ C1] [ 5412.601230][ C1] [ 5412.601386][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5412.601716][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5412.602028][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 5412.602335][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5412.602643][ C1] ? run_ksoftirqd+0xb/0x60 [ 5412.602893][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5412.603224][ C1] ? __orc_find+0x9c/0xf0 [ 5412.603454][ C1] ? lock_acquire+0x1c1/0x220 [ 5412.603703][ C1] ? irqentry_enter+0x2b/0x60 [ 5412.603953][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5412.604213][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5412.604499][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5412.604799][ C1] ? lock_acquire+0x1c1/0x220 [ 5412.605056][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5412.605312][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5412.605588][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5412.605834][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5412.606094][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5412.606365][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5412.606653][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5412.606942][ C1] ip_local_deliver+0x19d/0x480 [ 5412.607205][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5412.607495][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5412.607764][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5412.608043][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5412.608308][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5412.608648][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5412.608923][ C1] ip_rcv+0x564/0x740 [ 5412.609139][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5412.609382][ C1] ? set_track_prepare+0x8a/0xd0 [ 5412.609648][ C1] ? irqentry_enter+0x2b/0x60 [ 5412.609903][ C1] ? irqentry_enter+0x2b/0x60 [ 5412.610163][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5412.610407][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5412.610722][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5412.611063][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5412.611375][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5412.611717][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5412.612018][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5412.612348][ C1] netif_receive_skb+0x55/0x280 [ 5412.612608][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5412.612933][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5412.613283][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5412.613598][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5412.613886][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5412.614189][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5412.614516][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5412.614797][ C1] ? arch_stack_walk+0x68/0x100 [ 5412.615060][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5412.615339][ C1] ? irqentry_enter+0x2b/0x60 [ 5412.615594][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5412.615918][ C1] ? irqentry_enter+0x2b/0x60 [ 5412.616171][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5412.616491][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5412.616773][ C1] ? arch_stack_walk+0x68/0x100 [ 5412.617032][ C1] __tcf_classify+0x32c/0x7d0 [ 5412.617282][ C1] tcf_classify+0x283/0x930 [ 5412.617524][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5412.617793][ C1] tc_run+0x2e4/0x5d0 [ 5412.618009][ C1] ? __pfx_tc_run+0x10/0x10 [ 5412.618255][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5412.618523][ C1] ? irqentry_enter+0x2b/0x60 [ 5412.618777][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5412.619067][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5412.619394][ C1] ip_finish_output2+0x786/0x18e0 [ 5412.619665][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5412.619953][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5412.620224][ C1] ? __ip_finish_output+0x10f/0x770 [ 5412.620508][ C1] ip_output+0x16b/0x4f0 [ 5412.620739][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5412.621059][ C1] ? __pfx_ip_output+0x10/0x10 [ 5412.621323][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5412.621675][ C1] ? __pfx_ip_output+0x10/0x10 [ 5412.621929][ C1] __ip_queue_xmit+0x672/0x1910 [ 5412.622196][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5412.622480][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5412.622779][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5412.623076][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5412.623378][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5412.623668][ C1] tcp_delack_timer+0x84/0x240 [ 5412.623927][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5412.624215][ C1] call_timer_fn+0x176/0x430 [ 5412.624465][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5412.624741][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5412.625019][ C1] __run_timers.part.0+0x52d/0x890 [ 5412.625292][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5412.625584][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5412.625888][ C1] ? __pfx___schedule+0x10/0x10 [ 5412.626147][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5412.626466][ C1] run_timer_softirq+0x72/0x100 [ 5412.626728][ C1] __do_softirq+0x1bc/0x7ff [ 5412.626974][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5412.627252][ C1] run_ksoftirqd+0x2e/0x60 [ 5412.627489][ C1] smpboot_thread_fn+0x30e/0x840 [ 5412.627759][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5412.628052][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5412.628346][ C1] kthread+0x292/0x360 [ 5412.628562][ C1] ? __pfx_kthread+0x10/0x10 [ 5412.628810][ C1] ret_from_fork+0x34/0x70 [ 5412.629051][ C1] ? __pfx_kthread+0x10/0x10 [ 5412.629301][ C1] ret_from_fork_asm+0x1b/0x30 [ 5412.629562][ C1] [ 5436.874024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5436.874402][ C1] rcu: 1-....: (4230555 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1008617 [ 5436.874995][ C1] rcu: (t=4242565 jiffies g=1007429 q=31 ncpus=4) [ 5436.875340][ C1] Sending NMI from CPU 1 to CPUs 0: [ 5436.875631][ C0] NMI backtrace for cpu 0 [ 5436.875640][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5436.875644][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5436.875646][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5436.875656][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5436.875660][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5436.875664][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5436.875665][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5436.875667][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5436.875669][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5436.875671][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5436.875673][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5436.875675][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5436.875678][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5436.875680][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5436.875682][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5436.875683][ C0] Call Trace: [ 5436.875687][ C0] [ 5436.875691][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 5436.875697][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5436.875702][ C0] ? nmi_handle+0x156/0x420 [ 5436.875708][ C0] ? default_do_nmi+0x41/0x100 [ 5436.875712][ C0] ? exc_nmi+0xf3/0x120 [ 5436.875715][ C0] ? end_repeat_nmi+0xf/0x60 [ 5436.875720][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5436.875724][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5436.875727][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5436.875731][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5436.875735][ C0] [ 5436.875735][ C0] [ 5436.875737][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5436.875740][ C0] ? get_stack_info+0x36/0xc0 [ 5436.875745][ C0] ? lock_acquire+0x1c1/0x220 [ 5436.875750][ C0] ? lock_release+0x1d5/0x250 [ 5436.875753][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5436.875758][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5436.875760][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5436.875764][ C0] ? lock_acquire+0x1c1/0x220 [ 5436.875766][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5436.875772][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5436.875776][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5436.875784][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5436.875786][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5436.875790][ C0] ? __inet_lookup_established+0x341/0x610 [ 5436.875797][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5436.875805][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5436.875809][ C0] ip_local_deliver+0x19d/0x480 [ 5436.875812][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5436.875815][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5436.875820][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5436.875824][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5436.875827][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5436.875831][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5436.875841][ C0] ip_rcv+0x564/0x740 [ 5436.875844][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5436.875847][ C0] ? set_track_prepare+0x8a/0xd0 [ 5436.875852][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5436.875854][ C0] ? rest_init+0x153/0x260 [ 5436.875857][ C0] ? skb_clone+0x10b/0x330 [ 5436.875862][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5436.875869][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5436.875874][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5436.875879][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5436.875888][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5436.875892][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5436.875894][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5436.875899][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5436.875902][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5436.875905][ C0] ? lock_acquire+0x1c1/0x220 [ 5436.875908][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5436.875911][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5436.875915][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5436.875918][ C0] ? __copy_skb_header+0xaf/0x490 [ 5436.875921][ C0] ? __skb_clone+0x57a/0x760 [ 5436.875923][ C0] netif_receive_skb+0x55/0x280 [ 5436.875925][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5436.875933][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5436.875940][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5436.875947][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5436.875953][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5436.875962][ C0] ? hlock_class+0x4e/0x130 [ 5436.875967][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5436.875977][ C0] ? place_entity+0x21/0x2f0 [ 5436.875981][ C0] ? resched_curr+0x219/0x280 [ 5436.875985][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5436.875987][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5436.875991][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5436.875995][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5436.875997][ C0] ? activate_task+0xf5/0x260 [ 5436.876000][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5436.876006][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5436.876009][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5436.876013][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5436.876016][ C0] ? get_stack_info+0x36/0xc0 [ 5436.876021][ C0] ? stack_access_ok+0xda/0x1f0 [ 5436.876023][ C0] ? get_reg+0x119/0x190 [ 5436.876027][ C0] __tcf_classify+0x32c/0x7d0 [ 5436.876032][ C0] tcf_classify+0x283/0x930 [ 5436.876035][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5436.876040][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5436.876043][ C0] ? arch_stack_walk+0x8c/0x100 [ 5436.876047][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5436.876051][ C0] tc_run+0x2e4/0x5d0 [ 5436.876055][ C0] ? __pfx_tc_run+0x10/0x10 [ 5436.876058][ C0] ? lock_acquire+0x1c1/0x220 [ 5436.876060][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5436.876066][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5436.876071][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5436.876074][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5436.876078][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5436.876083][ C0] ? neigh_hh_output+0x348/0x590 [ 5436.876088][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5436.876092][ C0] ip_finish_output2+0x786/0x18e0 [ 5436.876095][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5436.876102][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5436.876109][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5436.876112][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5436.876117][ C0] ? __ip_finish_output+0x10f/0x770 [ 5436.876121][ C0] ip_output+0x16b/0x4f0 [ 5436.876124][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5436.876129][ C0] ? __pfx_ip_output+0x10/0x10 [ 5436.876132][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5436.876137][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5436.876140][ C0] ? ip_local_out+0x114/0x3b0 [ 5436.876144][ C0] __ip_queue_xmit+0x672/0x1910 [ 5436.876148][ C0] ? __skb_clone+0x57a/0x760 [ 5436.876152][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5436.876159][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5436.876164][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5436.876168][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5436.876173][ C0] ? tcp_current_mss+0x40a/0x510 [ 5436.876176][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5436.876180][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5436.876182][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5436.876184][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5436.876187][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5436.876191][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5436.876196][ C0] ? ktime_get+0xb6/0x190 [ 5436.876200][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5436.876204][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5436.876207][ C0] tcp_write_timer+0x82/0x1d0 [ 5436.876211][ C0] call_timer_fn+0x176/0x430 [ 5436.876214][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5436.876219][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5436.876223][ C0] __run_timers.part.0+0x52d/0x890 [ 5436.876226][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5436.876231][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5436.876234][ C0] ? lock_acquire+0x1c1/0x220 [ 5436.876236][ C0] ? clockevents_program_event+0xf6/0x300 [ 5436.876240][ C0] ? lock_release+0x1d5/0x250 [ 5436.876243][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5436.876246][ C0] ? ktime_get+0xb6/0x190 [ 5436.876249][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5436.876252][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5436.876256][ C0] run_timer_softirq+0x72/0x100 [ 5436.876260][ C0] __do_softirq+0x1bc/0x7ff [ 5436.876265][ C0] irq_exit_rcu+0x98/0xc0 [ 5436.876268][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5436.876272][ C0] [ 5436.876273][ C0] [ 5436.876274][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5436.876281][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5436.876284][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5436.876287][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5436.876289][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5436.876291][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5436.876292][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5436.876294][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5436.876296][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5436.876300][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5436.876303][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5436.876307][ C0] default_idle_call+0x69/0xa0 [ 5436.876309][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5436.876312][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5436.876317][ C0] ? lock_release+0x1d5/0x250 [ 5436.876321][ C0] do_idle+0xfb/0x160 [ 5436.876324][ C0] cpu_startup_entry+0x55/0x60 [ 5436.876326][ C0] rest_init+0x153/0x260 [ 5436.876328][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5436.876335][ C0] arch_call_rest_init+0x13/0x40 [ 5436.876340][ C0] start_kernel+0x314/0x3d0 [ 5436.876344][ C0] x86_64_start_reservations+0x18/0x30 [ 5436.876349][ C0] x86_64_start_kernel+0xba/0x110 [ 5436.876352][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5436.876360][ C0] [ 5436.876627][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5436.930702][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5436.931354][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5436.931703][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5436.932731][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5436.933058][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5436.933483][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5436.933912][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5436.934335][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5436.934756][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5436.935182][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5436.935658][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5436.936005][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5436.936435][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5436.936856][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5436.937275][ C1] Call Trace: [ 5436.937452][ C1] [ 5436.937608][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5436.937898][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5436.938162][ C1] ? check_cpu_stall+0x284/0x500 [ 5436.938429][ C1] ? rcu_pending+0x92/0x360 [ 5436.938669][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5436.938949][ C1] ? update_process_times+0xb9/0x110 [ 5436.939236][ C1] ? tick_sched_handle+0x67/0x130 [ 5436.939504][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5436.939802][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5436.940064][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5436.940397][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5436.940682][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5436.940983][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5436.941260][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5436.941582][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5436.941859][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5436.942181][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5436.942491][ C1] [ 5436.942652][ C1] [ 5436.942812][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5436.943147][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5436.943448][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5436.943759][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5436.944067][ C1] ? run_ksoftirqd+0xb/0x60 [ 5436.944313][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5436.944641][ C1] ? __orc_find+0x9c/0xf0 [ 5436.944871][ C1] ? lock_acquire+0x1c1/0x220 [ 5436.945122][ C1] ? irqentry_enter+0x2b/0x60 [ 5436.945372][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5436.945631][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5436.945913][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5436.946213][ C1] ? lock_acquire+0x1c1/0x220 [ 5436.946467][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5436.946724][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5436.946998][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5436.947243][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5436.947499][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5436.947769][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5436.948059][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5436.948348][ C1] ip_local_deliver+0x19d/0x480 [ 5436.948609][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5436.948896][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5436.949165][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5436.949441][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5436.949708][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5436.950052][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5436.950329][ C1] ip_rcv+0x564/0x740 [ 5436.950550][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5436.950795][ C1] ? set_track_prepare+0x8a/0xd0 [ 5436.951064][ C1] ? irqentry_enter+0x2b/0x60 [ 5436.951314][ C1] ? irqentry_enter+0x2b/0x60 [ 5436.951565][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5436.951804][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5436.952117][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5436.952456][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5436.952765][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5436.953110][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5436.953412][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5436.953743][ C1] netif_receive_skb+0x55/0x280 [ 5436.954000][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5436.954326][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5436.954674][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5436.954993][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5436.955283][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5436.955584][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5436.955913][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5436.956197][ C1] ? arch_stack_walk+0x68/0x100 [ 5436.956461][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5436.956742][ C1] ? irqentry_enter+0x2b/0x60 [ 5436.956998][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5436.957323][ C1] ? irqentry_enter+0x2b/0x60 [ 5436.957571][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5436.957891][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5436.958175][ C1] ? arch_stack_walk+0x68/0x100 [ 5436.958435][ C1] __tcf_classify+0x32c/0x7d0 [ 5436.958686][ C1] tcf_classify+0x283/0x930 [ 5436.958928][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5436.959197][ C1] tc_run+0x2e4/0x5d0 [ 5436.959412][ C1] ? __pfx_tc_run+0x10/0x10 [ 5436.959655][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5436.959924][ C1] ? irqentry_enter+0x2b/0x60 [ 5436.960176][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5436.960463][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5436.960784][ C1] ip_finish_output2+0x786/0x18e0 [ 5436.961061][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5436.961354][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5436.961618][ C1] ? __ip_finish_output+0x10f/0x770 [ 5436.961899][ C1] ip_output+0x16b/0x4f0 [ 5436.962129][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5436.962448][ C1] ? __pfx_ip_output+0x10/0x10 [ 5436.962706][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5436.963056][ C1] ? __pfx_ip_output+0x10/0x10 [ 5436.963312][ C1] __ip_queue_xmit+0x672/0x1910 [ 5436.963575][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5436.963859][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5436.964157][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5436.964448][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5436.964746][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5436.965037][ C1] tcp_delack_timer+0x84/0x240 [ 5436.965297][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5436.965583][ C1] call_timer_fn+0x176/0x430 [ 5436.965829][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5436.966109][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5436.966386][ C1] __run_timers.part.0+0x52d/0x890 [ 5436.966658][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5436.966950][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5436.967256][ C1] ? __pfx___schedule+0x10/0x10 [ 5436.967517][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5436.967838][ C1] run_timer_softirq+0x72/0x100 [ 5436.968102][ C1] __do_softirq+0x1bc/0x7ff [ 5436.968349][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5436.968624][ C1] run_ksoftirqd+0x2e/0x60 [ 5436.968861][ C1] smpboot_thread_fn+0x30e/0x840 [ 5436.969129][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5436.969416][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5436.969711][ C1] kthread+0x292/0x360 [ 5436.969938][ C1] ? __pfx_kthread+0x10/0x10 [ 5436.970188][ C1] ret_from_fork+0x34/0x70 [ 5436.970428][ C1] ? __pfx_kthread+0x10/0x10 [ 5436.970672][ C1] ret_from_fork_asm+0x1b/0x30 [ 5436.970938][ C1] [ 5464.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 3983s! [swapper/0:0] [ 5464.527926][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5464.529129][ C0] irq event stamp: 27567077 [ 5464.529373][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5464.529915][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5464.530393][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5464.530909][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5464.531411][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5464.531893][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5464.532534][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5464.532874][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5464.533890][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5464.534212][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5464.534631][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5464.535053][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5464.535471][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5464.535889][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5464.536308][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5464.536778][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5464.537131][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5464.537556][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5464.537983][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5464.538412][ C0] Call Trace: [ 5464.538594][ C0] [ 5464.538753][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5464.539030][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5464.539289][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5464.539582][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5464.539874][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5464.540176][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5464.540453][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5464.540774][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5464.541052][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5464.541329][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5464.541656][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5464.541970][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5464.542304][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5464.542611][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5464.542926][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5464.543229][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5464.543556][ C0] ? get_stack_info+0x36/0xc0 [ 5464.543812][ C0] ? lock_acquire+0x1c1/0x220 [ 5464.544068][ C0] ? lock_release+0x1d5/0x250 [ 5464.544323][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5464.544586][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5464.544872][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5464.545175][ C0] ? lock_acquire+0x1c1/0x220 [ 5464.545426][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5464.545679][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5464.545951][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5464.546201][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5464.546462][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5464.546736][ C0] ? __inet_lookup_established+0x341/0x610 [ 5464.547055][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5464.547344][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5464.547632][ C0] ip_local_deliver+0x19d/0x480 [ 5464.547894][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5464.548187][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5464.548458][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5464.548735][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5464.548998][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5464.549338][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5464.549614][ C0] ip_rcv+0x564/0x740 [ 5464.549838][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5464.550086][ C0] ? set_track_prepare+0x8a/0xd0 [ 5464.550355][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5464.550644][ C0] ? rest_init+0x153/0x260 [ 5464.550884][ C0] ? skb_clone+0x10b/0x330 [ 5464.551123][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5464.551460][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5464.551785][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5464.552083][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5464.552399][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5464.552658][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5464.552900][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5464.553214][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5464.553516][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5464.553860][ C0] ? lock_acquire+0x1c1/0x220 [ 5464.554117][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5464.554430][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5464.554726][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5464.555061][ C0] ? __copy_skb_header+0xaf/0x490 [ 5464.555333][ C0] ? __skb_clone+0x57a/0x760 [ 5464.555586][ C0] netif_receive_skb+0x55/0x280 [ 5464.555844][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5464.556172][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5464.556522][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5464.556839][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5464.557127][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5464.557428][ C0] ? hlock_class+0x4e/0x130 [ 5464.557675][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5464.558002][ C0] ? place_entity+0x21/0x2f0 [ 5464.558248][ C0] ? resched_curr+0x219/0x280 [ 5464.558502][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5464.558774][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5464.559065][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5464.559341][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5464.559601][ C0] ? activate_task+0xf5/0x260 [ 5464.559858][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5464.560140][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5464.560413][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5464.560677][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5464.560969][ C0] ? get_stack_info+0x36/0xc0 [ 5464.561220][ C0] ? stack_access_ok+0xda/0x1f0 [ 5464.561476][ C0] ? get_reg+0x119/0x190 [ 5464.561702][ C0] __tcf_classify+0x32c/0x7d0 [ 5464.561957][ C0] tcf_classify+0x283/0x930 [ 5464.562205][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5464.562538][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5464.562805][ C0] ? arch_stack_walk+0x8c/0x100 [ 5464.563064][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5464.563352][ C0] tc_run+0x2e4/0x5d0 [ 5464.563574][ C0] ? __pfx_tc_run+0x10/0x10 [ 5464.563821][ C0] ? lock_acquire+0x1c1/0x220 [ 5464.564076][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5464.564356][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5464.564622][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5464.564916][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5464.565200][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5464.565525][ C0] ? neigh_hh_output+0x348/0x590 [ 5464.565789][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5464.566071][ C0] ip_finish_output2+0x786/0x18e0 [ 5464.566343][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5464.566640][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5464.566991][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5464.567280][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5464.567549][ C0] ? __ip_finish_output+0x10f/0x770 [ 5464.567825][ C0] ip_output+0x16b/0x4f0 [ 5464.568052][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5464.568337][ C0] ? __pfx_ip_output+0x10/0x10 [ 5464.568592][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5464.568894][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5464.569159][ C0] ? ip_local_out+0x114/0x3b0 [ 5464.569417][ C0] __ip_queue_xmit+0x672/0x1910 [ 5464.569681][ C0] ? __skb_clone+0x57a/0x760 [ 5464.569936][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5464.570227][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5464.570530][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5464.570849][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5464.571105][ C0] ? tcp_current_mss+0x40a/0x510 [ 5464.571374][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5464.571657][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5464.571937][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5464.572198][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5464.572470][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5464.572791][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5464.573071][ C0] ? ktime_get+0xb6/0x190 [ 5464.573308][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5464.573585][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5464.573871][ C0] tcp_write_timer+0x82/0x1d0 [ 5464.574128][ C0] call_timer_fn+0x176/0x430 [ 5464.574379][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5464.574652][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5464.574928][ C0] __run_timers.part.0+0x52d/0x890 [ 5464.575201][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5464.575487][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5464.575786][ C0] ? lock_acquire+0x1c1/0x220 [ 5464.576045][ C0] ? clockevents_program_event+0xf6/0x300 [ 5464.576354][ C0] ? lock_release+0x1d5/0x250 [ 5464.576605][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5464.576885][ C0] ? ktime_get+0xb6/0x190 [ 5464.577120][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5464.577421][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5464.577737][ C0] run_timer_softirq+0x72/0x100 [ 5464.578002][ C0] __do_softirq+0x1bc/0x7ff [ 5464.578252][ C0] irq_exit_rcu+0x98/0xc0 [ 5464.578491][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5464.578794][ C0] [ 5464.578950][ C0] [ 5464.579109][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5464.579428][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5464.579701][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5464.580724][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5464.581045][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5464.581463][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5464.581878][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5464.582296][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5464.582712][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5464.583132][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5464.583435][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5464.583708][ C0] default_idle_call+0x69/0xa0 [ 5464.583966][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5464.584229][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5464.584522][ C0] ? lock_release+0x1d5/0x250 [ 5464.584770][ C0] do_idle+0xfb/0x160 [ 5464.584983][ C0] cpu_startup_entry+0x55/0x60 [ 5464.585239][ C0] rest_init+0x153/0x260 [ 5464.585464][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5464.585750][ C0] arch_call_rest_init+0x13/0x40 [ 5464.586016][ C0] start_kernel+0x314/0x3d0 [ 5464.586263][ C0] x86_64_start_reservations+0x18/0x30 [ 5464.586560][ C0] x86_64_start_kernel+0xba/0x110 [ 5464.586828][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5464.587157][ C0] [ 5464.587322][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3983s! [ksoftirqd/1:22] [ 5464.587794][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5464.588994][ C1] irq event stamp: 3886976 [ 5464.589232][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5464.589733][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5464.590233][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5464.590734][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5464.591234][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5464.591726][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5464.592373][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5464.592714][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5464.593737][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5464.594062][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5464.594481][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5464.594899][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5464.595319][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5464.595739][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5464.596159][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5464.596629][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5464.596990][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5464.597411][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5464.597830][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5464.598252][ C1] Call Trace: [ 5464.598438][ C1] [ 5464.598595][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5464.598871][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5464.599131][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5464.599421][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5464.599710][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5464.600019][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5464.600299][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5464.600619][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5464.600898][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5464.601222][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5464.601533][ C1] [ 5464.601693][ C1] [ 5464.601853][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5464.602188][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5464.602492][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5464.602803][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5464.603111][ C1] ? run_ksoftirqd+0xb/0x60 [ 5464.603359][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5464.603690][ C1] ? __orc_find+0x9c/0xf0 [ 5464.603920][ C1] ? lock_acquire+0x1c1/0x220 [ 5464.604170][ C1] ? irqentry_enter+0x2b/0x60 [ 5464.604424][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5464.604683][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5464.604969][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5464.605269][ C1] ? lock_acquire+0x1c1/0x220 [ 5464.605522][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5464.605777][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5464.606055][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5464.606300][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5464.606559][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5464.606831][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5464.607121][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5464.607412][ C1] ip_local_deliver+0x19d/0x480 [ 5464.607675][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5464.607965][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5464.608238][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5464.608517][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5464.608781][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5464.609122][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5464.609397][ C1] ip_rcv+0x564/0x740 [ 5464.609612][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5464.609861][ C1] ? set_track_prepare+0x8a/0xd0 [ 5464.610133][ C1] ? irqentry_enter+0x2b/0x60 [ 5464.610384][ C1] ? irqentry_enter+0x2b/0x60 [ 5464.610636][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5464.610878][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5464.611196][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5464.611536][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5464.611845][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5464.612190][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5464.612491][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5464.612820][ C1] netif_receive_skb+0x55/0x280 [ 5464.613081][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5464.613407][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5464.613755][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5464.614072][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5464.614360][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5464.614661][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5464.614991][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5464.615273][ C1] ? arch_stack_walk+0x68/0x100 [ 5464.615536][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5464.615816][ C1] ? irqentry_enter+0x2b/0x60 [ 5464.616076][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5464.616402][ C1] ? irqentry_enter+0x2b/0x60 [ 5464.616653][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5464.616974][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5464.617259][ C1] ? arch_stack_walk+0x68/0x100 [ 5464.617516][ C1] __tcf_classify+0x32c/0x7d0 [ 5464.617766][ C1] tcf_classify+0x283/0x930 [ 5464.618006][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5464.618276][ C1] tc_run+0x2e4/0x5d0 [ 5464.618493][ C1] ? __pfx_tc_run+0x10/0x10 [ 5464.618739][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5464.619005][ C1] ? irqentry_enter+0x2b/0x60 [ 5464.619260][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5464.619548][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5464.619878][ C1] ip_finish_output2+0x786/0x18e0 [ 5464.620156][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5464.620449][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5464.620713][ C1] ? __ip_finish_output+0x10f/0x770 [ 5464.620996][ C1] ip_output+0x16b/0x4f0 [ 5464.621229][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5464.621547][ C1] ? __pfx_ip_output+0x10/0x10 [ 5464.621808][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5464.622163][ C1] ? __pfx_ip_output+0x10/0x10 [ 5464.622417][ C1] __ip_queue_xmit+0x672/0x1910 [ 5464.622683][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5464.622969][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5464.623269][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5464.623561][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5464.623866][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5464.624158][ C1] tcp_delack_timer+0x84/0x240 [ 5464.624418][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5464.624704][ C1] call_timer_fn+0x176/0x430 [ 5464.624955][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5464.625233][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5464.625510][ C1] __run_timers.part.0+0x52d/0x890 [ 5464.625783][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5464.626077][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5464.626382][ C1] ? __pfx___schedule+0x10/0x10 [ 5464.626640][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5464.626958][ C1] run_timer_softirq+0x72/0x100 [ 5464.627221][ C1] __do_softirq+0x1bc/0x7ff [ 5464.627468][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5464.627745][ C1] run_ksoftirqd+0x2e/0x60 [ 5464.627983][ C1] smpboot_thread_fn+0x30e/0x840 [ 5464.628254][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5464.628547][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5464.628845][ C1] kthread+0x292/0x360 [ 5464.629063][ C1] ? __pfx_kthread+0x10/0x10 [ 5464.629312][ C1] ret_from_fork+0x34/0x70 [ 5464.629551][ C1] ? __pfx_kthread+0x10/0x10 [ 5464.629805][ C1] ret_from_fork_asm+0x1b/0x30 [ 5464.630071][ C1] [ 5492.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4009s! [swapper/0:0] [ 5492.527927][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5492.529136][ C0] irq event stamp: 27567077 [ 5492.529379][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5492.529915][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5492.530392][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5492.530903][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5492.531403][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5492.531887][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5492.532529][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5492.532869][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5492.533894][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5492.534216][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5492.534635][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5492.535055][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5492.535472][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5492.535889][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5492.536310][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5492.536778][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5492.537128][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5492.537550][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5492.537975][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5492.538400][ C0] Call Trace: [ 5492.538582][ C0] [ 5492.538739][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5492.539014][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5492.539275][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5492.539566][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5492.539859][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5492.540161][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5492.540438][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5492.540759][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5492.541037][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5492.541314][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5492.541640][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5492.541955][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5492.542286][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5492.542591][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5492.542905][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5492.543207][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5492.543532][ C0] ? get_stack_info+0x36/0xc0 [ 5492.543789][ C0] ? lock_acquire+0x1c1/0x220 [ 5492.544045][ C0] ? lock_release+0x1d5/0x250 [ 5492.544298][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5492.544560][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5492.544846][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5492.545148][ C0] ? lock_acquire+0x1c1/0x220 [ 5492.545398][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5492.545651][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5492.545923][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5492.546173][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5492.546433][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5492.546706][ C0] ? __inet_lookup_established+0x341/0x610 [ 5492.547024][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5492.547313][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5492.547600][ C0] ip_local_deliver+0x19d/0x480 [ 5492.547862][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5492.548151][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5492.548421][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5492.548698][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5492.548961][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5492.549302][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5492.549577][ C0] ip_rcv+0x564/0x740 [ 5492.549800][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5492.550046][ C0] ? set_track_prepare+0x8a/0xd0 [ 5492.550316][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5492.550604][ C0] ? rest_init+0x153/0x260 [ 5492.550844][ C0] ? skb_clone+0x10b/0x330 [ 5492.551108][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5492.551445][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5492.551771][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5492.552069][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5492.552379][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5492.552639][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5492.552881][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5492.553194][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5492.553491][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5492.553834][ C0] ? lock_acquire+0x1c1/0x220 [ 5492.554089][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5492.554400][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5492.554696][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5492.555035][ C0] ? __copy_skb_header+0xaf/0x490 [ 5492.555306][ C0] ? __skb_clone+0x57a/0x760 [ 5492.555555][ C0] netif_receive_skb+0x55/0x280 [ 5492.555813][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5492.556140][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5492.556491][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5492.556807][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5492.557098][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5492.557396][ C0] ? hlock_class+0x4e/0x130 [ 5492.557643][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5492.557969][ C0] ? place_entity+0x21/0x2f0 [ 5492.558213][ C0] ? resched_curr+0x219/0x280 [ 5492.558466][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5492.558737][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5492.559023][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5492.559298][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5492.559555][ C0] ? activate_task+0xf5/0x260 [ 5492.559811][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5492.560091][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5492.560362][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5492.560623][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5492.560914][ C0] ? get_stack_info+0x36/0xc0 [ 5492.561164][ C0] ? stack_access_ok+0xda/0x1f0 [ 5492.561418][ C0] ? get_reg+0x119/0x190 [ 5492.561643][ C0] __tcf_classify+0x32c/0x7d0 [ 5492.561897][ C0] tcf_classify+0x283/0x930 [ 5492.562143][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5492.562473][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5492.562738][ C0] ? arch_stack_walk+0x8c/0x100 [ 5492.562995][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5492.563283][ C0] tc_run+0x2e4/0x5d0 [ 5492.563505][ C0] ? __pfx_tc_run+0x10/0x10 [ 5492.563750][ C0] ? lock_acquire+0x1c1/0x220 [ 5492.564003][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5492.564282][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5492.564547][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5492.564836][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5492.565116][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5492.565439][ C0] ? neigh_hh_output+0x348/0x590 [ 5492.565702][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5492.565982][ C0] ip_finish_output2+0x786/0x18e0 [ 5492.566252][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5492.566548][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5492.566900][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5492.567187][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5492.567454][ C0] ? __ip_finish_output+0x10f/0x770 [ 5492.567730][ C0] ip_output+0x16b/0x4f0 [ 5492.567956][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5492.568241][ C0] ? __pfx_ip_output+0x10/0x10 [ 5492.568496][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5492.568796][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5492.569059][ C0] ? ip_local_out+0x114/0x3b0 [ 5492.569317][ C0] __ip_queue_xmit+0x672/0x1910 [ 5492.569580][ C0] ? __skb_clone+0x57a/0x760 [ 5492.569834][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5492.570119][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5492.570419][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5492.570742][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5492.570996][ C0] ? tcp_current_mss+0x40a/0x510 [ 5492.571268][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5492.571549][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5492.571828][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5492.572091][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5492.572357][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5492.572677][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5492.572956][ C0] ? ktime_get+0xb6/0x190 [ 5492.573192][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5492.573468][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5492.573750][ C0] tcp_write_timer+0x82/0x1d0 [ 5492.574009][ C0] call_timer_fn+0x176/0x430 [ 5492.574263][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5492.574536][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5492.574813][ C0] __run_timers.part.0+0x52d/0x890 [ 5492.575086][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5492.575372][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5492.575670][ C0] ? lock_acquire+0x1c1/0x220 [ 5492.575924][ C0] ? clockevents_program_event+0xf6/0x300 [ 5492.576235][ C0] ? lock_release+0x1d5/0x250 [ 5492.576486][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5492.576766][ C0] ? ktime_get+0xb6/0x190 [ 5492.576999][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5492.577301][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5492.577611][ C0] run_timer_softirq+0x72/0x100 [ 5492.577876][ C0] __do_softirq+0x1bc/0x7ff [ 5492.578123][ C0] irq_exit_rcu+0x98/0xc0 [ 5492.578357][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5492.578659][ C0] [ 5492.578815][ C0] [ 5492.578971][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5492.579288][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5492.579559][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5492.580580][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5492.580901][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5492.581323][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5492.581741][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5492.582157][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5492.582573][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5492.582991][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5492.583293][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5492.583569][ C0] default_idle_call+0x69/0xa0 [ 5492.583829][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5492.584091][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5492.584385][ C0] ? lock_release+0x1d5/0x250 [ 5492.584632][ C0] do_idle+0xfb/0x160 [ 5492.584845][ C0] cpu_startup_entry+0x55/0x60 [ 5492.585101][ C0] rest_init+0x153/0x260 [ 5492.585326][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5492.585610][ C0] arch_call_rest_init+0x13/0x40 [ 5492.585876][ C0] start_kernel+0x314/0x3d0 [ 5492.586126][ C0] x86_64_start_reservations+0x18/0x30 [ 5492.586421][ C0] x86_64_start_kernel+0xba/0x110 [ 5492.586688][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5492.587015][ C0] [ 5492.587182][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4009s! [ksoftirqd/1:22] [ 5492.587658][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5492.588858][ C1] irq event stamp: 3886976 [ 5492.589097][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5492.589604][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5492.590110][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5492.590610][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5492.591110][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5492.591601][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5492.592245][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5492.592585][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5492.593606][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5492.593928][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5492.594349][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5492.594769][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5492.595189][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5492.595607][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5492.596025][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5492.596496][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5492.596847][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5492.597270][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5492.597694][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5492.598120][ C1] Call Trace: [ 5492.598302][ C1] [ 5492.598459][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5492.598736][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5492.598996][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5492.599291][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5492.599583][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5492.599895][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5492.600175][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5492.600494][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5492.600773][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5492.601098][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5492.601406][ C1] [ 5492.601566][ C1] [ 5492.601728][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5492.602064][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5492.602367][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5492.602676][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5492.602982][ C1] ? run_ksoftirqd+0xb/0x60 [ 5492.603230][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5492.603562][ C1] ? __orc_find+0x9c/0xf0 [ 5492.603793][ C1] ? lock_acquire+0x1c1/0x220 [ 5492.604047][ C1] ? irqentry_enter+0x2b/0x60 [ 5492.604299][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5492.604559][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5492.604843][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5492.605142][ C1] ? lock_acquire+0x1c1/0x220 [ 5492.605396][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5492.605653][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5492.605930][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5492.606177][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5492.606440][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5492.606712][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5492.607001][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5492.607295][ C1] ip_local_deliver+0x19d/0x480 [ 5492.607557][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5492.607844][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5492.608112][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5492.608392][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5492.608655][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5492.608995][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5492.609272][ C1] ip_rcv+0x564/0x740 [ 5492.609487][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5492.609742][ C1] ? set_track_prepare+0x8a/0xd0 [ 5492.610010][ C1] ? irqentry_enter+0x2b/0x60 [ 5492.610261][ C1] ? irqentry_enter+0x2b/0x60 [ 5492.610511][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5492.610751][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5492.611069][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5492.611410][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5492.611722][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5492.612072][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5492.612377][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5492.612710][ C1] netif_receive_skb+0x55/0x280 [ 5492.612971][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5492.613301][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5492.613649][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5492.613968][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5492.614261][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5492.614568][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5492.614897][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5492.615179][ C1] ? arch_stack_walk+0x68/0x100 [ 5492.615446][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5492.615725][ C1] ? irqentry_enter+0x2b/0x60 [ 5492.615981][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5492.616306][ C1] ? irqentry_enter+0x2b/0x60 [ 5492.616554][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5492.616880][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5492.617165][ C1] ? arch_stack_walk+0x68/0x100 [ 5492.617427][ C1] __tcf_classify+0x32c/0x7d0 [ 5492.617680][ C1] tcf_classify+0x283/0x930 [ 5492.617924][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5492.618195][ C1] tc_run+0x2e4/0x5d0 [ 5492.618408][ C1] ? __pfx_tc_run+0x10/0x10 [ 5492.618650][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5492.618916][ C1] ? irqentry_enter+0x2b/0x60 [ 5492.619173][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5492.619462][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5492.619791][ C1] ip_finish_output2+0x786/0x18e0 [ 5492.620070][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5492.620364][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5492.620629][ C1] ? __ip_finish_output+0x10f/0x770 [ 5492.620913][ C1] ip_output+0x16b/0x4f0 [ 5492.621142][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5492.621460][ C1] ? __pfx_ip_output+0x10/0x10 [ 5492.621720][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5492.622075][ C1] ? __pfx_ip_output+0x10/0x10 [ 5492.622334][ C1] __ip_queue_xmit+0x672/0x1910 [ 5492.622601][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5492.622887][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5492.623190][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5492.623480][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5492.623778][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5492.624071][ C1] tcp_delack_timer+0x84/0x240 [ 5492.624329][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5492.624612][ C1] call_timer_fn+0x176/0x430 [ 5492.624858][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5492.625139][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5492.625418][ C1] __run_timers.part.0+0x52d/0x890 [ 5492.625690][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5492.625981][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5492.626287][ C1] ? __pfx___schedule+0x10/0x10 [ 5492.626548][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5492.626868][ C1] run_timer_softirq+0x72/0x100 [ 5492.627136][ C1] __do_softirq+0x1bc/0x7ff [ 5492.627384][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5492.627662][ C1] run_ksoftirqd+0x2e/0x60 [ 5492.627901][ C1] smpboot_thread_fn+0x30e/0x840 [ 5492.628171][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5492.628460][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5492.628753][ C1] kthread+0x292/0x360 [ 5492.628972][ C1] ? __pfx_kthread+0x10/0x10 [ 5492.629224][ C1] ret_from_fork+0x34/0x70 [ 5492.629462][ C1] ? __pfx_kthread+0x10/0x10 [ 5492.629715][ C1] ret_from_fork_asm+0x1b/0x30 [ 5492.629980][ C1] [ 5514.973024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5514.973401][ C1] rcu: 1-....: (4308372 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1027120 [ 5514.973995][ C1] rcu: (t=4320664 jiffies g=1007429 q=31 ncpus=4) [ 5514.974345][ C1] Sending NMI from CPU 1 to CPUs 0: [ 5514.974635][ C0] NMI backtrace for cpu 0 [ 5514.974643][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5514.974648][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5514.974651][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5514.974662][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5514.974665][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5514.974669][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5514.974671][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5514.974672][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5514.974674][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5514.974676][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5514.974678][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5514.974680][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5514.974683][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5514.974685][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5514.974686][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5514.974688][ C0] Call Trace: [ 5514.974691][ C0] [ 5514.974694][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 5514.974700][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5514.974705][ C0] ? nmi_handle+0x156/0x420 [ 5514.974711][ C0] ? default_do_nmi+0x41/0x100 [ 5514.974715][ C0] ? exc_nmi+0xf3/0x120 [ 5514.974717][ C0] ? end_repeat_nmi+0xf/0x60 [ 5514.974722][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5514.974726][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5514.974730][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5514.974734][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5514.974737][ C0] [ 5514.974738][ C0] [ 5514.974740][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5514.974743][ C0] ? get_stack_info+0x36/0xc0 [ 5514.974748][ C0] ? lock_acquire+0x1c1/0x220 [ 5514.974754][ C0] ? lock_release+0x1d5/0x250 [ 5514.974757][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5514.974762][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5514.974764][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5514.974768][ C0] ? lock_acquire+0x1c1/0x220 [ 5514.974770][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5514.974776][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5514.974780][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5514.974787][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5514.974789][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5514.974794][ C0] ? __inet_lookup_established+0x341/0x610 [ 5514.974800][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5514.974807][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5514.974811][ C0] ip_local_deliver+0x19d/0x480 [ 5514.974815][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5514.974817][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5514.974823][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5514.974827][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5514.974830][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5514.974834][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5514.974844][ C0] ip_rcv+0x564/0x740 [ 5514.974847][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5514.974850][ C0] ? set_track_prepare+0x8a/0xd0 [ 5514.974856][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5514.974858][ C0] ? rest_init+0x153/0x260 [ 5514.974861][ C0] ? skb_clone+0x10b/0x330 [ 5514.974866][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5514.974873][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5514.974879][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5514.974884][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5514.974893][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5514.974896][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5514.974899][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5514.974903][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5514.974906][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5514.974910][ C0] ? lock_acquire+0x1c1/0x220 [ 5514.974912][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5514.974916][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5514.974919][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5514.974922][ C0] ? __copy_skb_header+0xaf/0x490 [ 5514.974925][ C0] ? __skb_clone+0x57a/0x760 [ 5514.974928][ C0] netif_receive_skb+0x55/0x280 [ 5514.974930][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5514.974938][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5514.974945][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5514.974952][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5514.974957][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5514.974965][ C0] ? hlock_class+0x4e/0x130 [ 5514.974971][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5514.974981][ C0] ? place_entity+0x21/0x2f0 [ 5514.974985][ C0] ? resched_curr+0x219/0x280 [ 5514.974988][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5514.974991][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5514.974994][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5514.974999][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5514.975001][ C0] ? activate_task+0xf5/0x260 [ 5514.975004][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5514.975010][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5514.975013][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5514.975017][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5514.975021][ C0] ? get_stack_info+0x36/0xc0 [ 5514.975025][ C0] ? stack_access_ok+0xda/0x1f0 [ 5514.975027][ C0] ? get_reg+0x119/0x190 [ 5514.975031][ C0] __tcf_classify+0x32c/0x7d0 [ 5514.975035][ C0] tcf_classify+0x283/0x930 [ 5514.975039][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5514.975044][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5514.975046][ C0] ? arch_stack_walk+0x8c/0x100 [ 5514.975052][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5514.975055][ C0] tc_run+0x2e4/0x5d0 [ 5514.975060][ C0] ? __pfx_tc_run+0x10/0x10 [ 5514.975063][ C0] ? lock_acquire+0x1c1/0x220 [ 5514.975065][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5514.975070][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5514.975076][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5514.975079][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5514.975082][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5514.975087][ C0] ? neigh_hh_output+0x348/0x590 [ 5514.975092][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5514.975096][ C0] ip_finish_output2+0x786/0x18e0 [ 5514.975099][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5514.975106][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5514.975113][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5514.975116][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5514.975120][ C0] ? __ip_finish_output+0x10f/0x770 [ 5514.975124][ C0] ip_output+0x16b/0x4f0 [ 5514.975128][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5514.975133][ C0] ? __pfx_ip_output+0x10/0x10 [ 5514.975136][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5514.975140][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5514.975143][ C0] ? ip_local_out+0x114/0x3b0 [ 5514.975147][ C0] __ip_queue_xmit+0x672/0x1910 [ 5514.975151][ C0] ? __skb_clone+0x57a/0x760 [ 5514.975154][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5514.975162][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5514.975166][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5514.975170][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5514.975175][ C0] ? tcp_current_mss+0x40a/0x510 [ 5514.975178][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5514.975181][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5514.975184][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5514.975186][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5514.975189][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5514.975193][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5514.975198][ C0] ? ktime_get+0xb6/0x190 [ 5514.975203][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5514.975207][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5514.975210][ C0] tcp_write_timer+0x82/0x1d0 [ 5514.975214][ C0] call_timer_fn+0x176/0x430 [ 5514.975218][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5514.975223][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5514.975228][ C0] __run_timers.part.0+0x52d/0x890 [ 5514.975231][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5514.975236][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5514.975239][ C0] ? lock_acquire+0x1c1/0x220 [ 5514.975241][ C0] ? clockevents_program_event+0xf6/0x300 [ 5514.975247][ C0] ? lock_release+0x1d5/0x250 [ 5514.975250][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5514.975253][ C0] ? ktime_get+0xb6/0x190 [ 5514.975256][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5514.975260][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5514.975264][ C0] run_timer_softirq+0x72/0x100 [ 5514.975267][ C0] __do_softirq+0x1bc/0x7ff [ 5514.975272][ C0] irq_exit_rcu+0x98/0xc0 [ 5514.975276][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5514.975280][ C0] [ 5514.975281][ C0] [ 5514.975282][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5514.975288][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5514.975292][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5514.975294][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5514.975296][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5514.975298][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5514.975299][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5514.975301][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5514.975303][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5514.975306][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5514.975310][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5514.975314][ C0] default_idle_call+0x69/0xa0 [ 5514.975316][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5514.975319][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5514.975324][ C0] ? lock_release+0x1d5/0x250 [ 5514.975328][ C0] do_idle+0xfb/0x160 [ 5514.975330][ C0] cpu_startup_entry+0x55/0x60 [ 5514.975333][ C0] rest_init+0x153/0x260 [ 5514.975335][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5514.975341][ C0] arch_call_rest_init+0x13/0x40 [ 5514.975347][ C0] start_kernel+0x314/0x3d0 [ 5514.975350][ C0] x86_64_start_reservations+0x18/0x30 [ 5514.975355][ C0] x86_64_start_kernel+0xba/0x110 [ 5514.975359][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5514.975367][ C0] [ 5514.975631][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5515.029831][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5515.030483][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5515.030831][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5515.031864][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5515.032192][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5515.032618][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5515.033046][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5515.033470][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5515.033892][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5515.034318][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5515.034795][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5515.035144][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5515.035572][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5515.035998][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5515.036420][ C1] Call Trace: [ 5515.036598][ C1] [ 5515.036755][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5515.037045][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5515.037309][ C1] ? check_cpu_stall+0x284/0x500 [ 5515.037576][ C1] ? rcu_pending+0x92/0x360 [ 5515.037816][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5515.038098][ C1] ? update_process_times+0xb9/0x110 [ 5515.038383][ C1] ? tick_sched_handle+0x67/0x130 [ 5515.038651][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5515.038950][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5515.039206][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5515.039541][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5515.039828][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5515.040130][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5515.040409][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5515.040731][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5515.041008][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5515.041330][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5515.041643][ C1] [ 5515.041803][ C1] [ 5515.041964][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5515.042298][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5515.042600][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5515.042907][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5515.043215][ C1] ? run_ksoftirqd+0xb/0x60 [ 5515.043462][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5515.043791][ C1] ? __orc_find+0x9c/0xf0 [ 5515.044021][ C1] ? lock_acquire+0x1c1/0x220 [ 5515.044271][ C1] ? irqentry_enter+0x2b/0x60 [ 5515.044521][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5515.044779][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5515.045062][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5515.045360][ C1] ? lock_acquire+0x1c1/0x220 [ 5515.045615][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5515.045873][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5515.046150][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5515.046394][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5515.046649][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5515.046920][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5515.047210][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5515.047500][ C1] ip_local_deliver+0x19d/0x480 [ 5515.047761][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5515.048051][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5515.048318][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5515.048594][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5515.048857][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5515.049200][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5515.049474][ C1] ip_rcv+0x564/0x740 [ 5515.049693][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5515.049938][ C1] ? set_track_prepare+0x8a/0xd0 [ 5515.050208][ C1] ? irqentry_enter+0x2b/0x60 [ 5515.050458][ C1] ? irqentry_enter+0x2b/0x60 [ 5515.050710][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5515.050949][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5515.051263][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5515.051602][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5515.051913][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5515.052258][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5515.052561][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5515.052893][ C1] netif_receive_skb+0x55/0x280 [ 5515.053151][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5515.053476][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5515.053825][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5515.054143][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5515.054433][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5515.054735][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5515.055066][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5515.055348][ C1] ? arch_stack_walk+0x68/0x100 [ 5515.055613][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5515.055893][ C1] ? irqentry_enter+0x2b/0x60 [ 5515.056151][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5515.056472][ C1] ? irqentry_enter+0x2b/0x60 [ 5515.056720][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5515.057040][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5515.057325][ C1] ? arch_stack_walk+0x68/0x100 [ 5515.057584][ C1] __tcf_classify+0x32c/0x7d0 [ 5515.057835][ C1] tcf_classify+0x283/0x930 [ 5515.058078][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5515.058346][ C1] tc_run+0x2e4/0x5d0 [ 5515.058561][ C1] ? __pfx_tc_run+0x10/0x10 [ 5515.058803][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5515.059071][ C1] ? irqentry_enter+0x2b/0x60 [ 5515.059327][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5515.059619][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5515.059938][ C1] ip_finish_output2+0x786/0x18e0 [ 5515.060214][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5515.060506][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5515.060770][ C1] ? __ip_finish_output+0x10f/0x770 [ 5515.061051][ C1] ip_output+0x16b/0x4f0 [ 5515.061279][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5515.061596][ C1] ? __pfx_ip_output+0x10/0x10 [ 5515.061859][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5515.062212][ C1] ? __pfx_ip_output+0x10/0x10 [ 5515.062468][ C1] __ip_queue_xmit+0x672/0x1910 [ 5515.062732][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5515.063015][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5515.063314][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5515.063602][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5515.063900][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5515.064190][ C1] tcp_delack_timer+0x84/0x240 [ 5515.064450][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5515.064735][ C1] call_timer_fn+0x176/0x430 [ 5515.064982][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5515.065261][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5515.065537][ C1] __run_timers.part.0+0x52d/0x890 [ 5515.065810][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5515.066103][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5515.066407][ C1] ? __pfx___schedule+0x10/0x10 [ 5515.066667][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5515.066988][ C1] run_timer_softirq+0x72/0x100 [ 5515.067253][ C1] __do_softirq+0x1bc/0x7ff [ 5515.067501][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5515.067776][ C1] run_ksoftirqd+0x2e/0x60 [ 5515.068013][ C1] smpboot_thread_fn+0x30e/0x840 [ 5515.068283][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5515.068572][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5515.068868][ C1] kthread+0x292/0x360 [ 5515.069088][ C1] ? __pfx_kthread+0x10/0x10 [ 5515.069338][ C1] ret_from_fork+0x34/0x70 [ 5515.069592][ C1] ? __pfx_kthread+0x10/0x10 [ 5515.069836][ C1] ret_from_fork_asm+0x1b/0x30 [ 5515.070099][ C1] [ 5540.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4054s! [swapper/0:0] [ 5540.527925][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5540.529126][ C0] irq event stamp: 27567077 [ 5540.529370][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5540.529903][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5540.530379][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5540.530891][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5540.531392][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5540.531878][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5540.532519][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5540.532859][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5540.533875][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5540.534198][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5540.534617][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5540.535036][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5540.535455][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5540.535874][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5540.536294][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5540.536766][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5540.537118][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5540.537539][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5540.537965][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5540.538392][ C0] Call Trace: [ 5540.538573][ C0] [ 5540.538731][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5540.539006][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5540.539267][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5540.539561][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5540.539847][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5540.540149][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5540.540426][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5540.540747][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5540.541025][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5540.541302][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5540.541633][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5540.541947][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5540.542281][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5540.542586][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5540.542899][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5540.543202][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5540.543528][ C0] ? get_stack_info+0x36/0xc0 [ 5540.543785][ C0] ? lock_acquire+0x1c1/0x220 [ 5540.544040][ C0] ? lock_release+0x1d5/0x250 [ 5540.544293][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5540.544555][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5540.544841][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5540.545143][ C0] ? lock_acquire+0x1c1/0x220 [ 5540.545392][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5540.545644][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5540.545916][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5540.546165][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5540.546427][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5540.546699][ C0] ? __inet_lookup_established+0x341/0x610 [ 5540.547019][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5540.547308][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5540.547595][ C0] ip_local_deliver+0x19d/0x480 [ 5540.547855][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5540.548144][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5540.548413][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5540.548690][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5540.548951][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5540.549290][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5540.549569][ C0] ip_rcv+0x564/0x740 [ 5540.549790][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5540.550034][ C0] ? set_track_prepare+0x8a/0xd0 [ 5540.550303][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5540.550594][ C0] ? rest_init+0x153/0x260 [ 5540.550834][ C0] ? skb_clone+0x10b/0x330 [ 5540.551072][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5540.551408][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5540.551732][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5540.552028][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5540.552335][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5540.552593][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5540.552834][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5540.553145][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5540.553440][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5540.553784][ C0] ? lock_acquire+0x1c1/0x220 [ 5540.554038][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5540.554348][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5540.554643][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5540.554976][ C0] ? __copy_skb_header+0xaf/0x490 [ 5540.555248][ C0] ? __skb_clone+0x57a/0x760 [ 5540.555498][ C0] netif_receive_skb+0x55/0x280 [ 5540.555755][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5540.556083][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5540.556428][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5540.556745][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5540.557031][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5540.557331][ C0] ? hlock_class+0x4e/0x130 [ 5540.557576][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5540.557903][ C0] ? place_entity+0x21/0x2f0 [ 5540.558151][ C0] ? resched_curr+0x219/0x280 [ 5540.558403][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5540.558675][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5540.558964][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5540.559240][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5540.559502][ C0] ? activate_task+0xf5/0x260 [ 5540.559758][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5540.560038][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5540.560310][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5540.560572][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5540.560865][ C0] ? get_stack_info+0x36/0xc0 [ 5540.561116][ C0] ? stack_access_ok+0xda/0x1f0 [ 5540.561370][ C0] ? get_reg+0x119/0x190 [ 5540.561597][ C0] __tcf_classify+0x32c/0x7d0 [ 5540.561851][ C0] tcf_classify+0x283/0x930 [ 5540.562098][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5540.562430][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5540.562696][ C0] ? arch_stack_walk+0x8c/0x100 [ 5540.562954][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5540.563247][ C0] tc_run+0x2e4/0x5d0 [ 5540.563470][ C0] ? __pfx_tc_run+0x10/0x10 [ 5540.563716][ C0] ? lock_acquire+0x1c1/0x220 [ 5540.563969][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5540.564248][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5540.564513][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5540.564801][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5540.565083][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5540.565408][ C0] ? neigh_hh_output+0x348/0x590 [ 5540.565671][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5540.565951][ C0] ip_finish_output2+0x786/0x18e0 [ 5540.566223][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5540.566521][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5540.566874][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5540.567162][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5540.567429][ C0] ? __ip_finish_output+0x10f/0x770 [ 5540.567704][ C0] ip_output+0x16b/0x4f0 [ 5540.567929][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5540.568214][ C0] ? __pfx_ip_output+0x10/0x10 [ 5540.568468][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5540.568768][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5540.569030][ C0] ? ip_local_out+0x114/0x3b0 [ 5540.569286][ C0] __ip_queue_xmit+0x672/0x1910 [ 5540.569551][ C0] ? __skb_clone+0x57a/0x760 [ 5540.569799][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5540.570083][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5540.570383][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5540.570701][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5540.570955][ C0] ? tcp_current_mss+0x40a/0x510 [ 5540.571223][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5540.571503][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5540.571781][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5540.572040][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5540.572306][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5540.572626][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5540.572905][ C0] ? ktime_get+0xb6/0x190 [ 5540.573141][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5540.573417][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5540.573699][ C0] tcp_write_timer+0x82/0x1d0 [ 5540.573954][ C0] call_timer_fn+0x176/0x430 [ 5540.574205][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5540.574477][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5540.574752][ C0] __run_timers.part.0+0x52d/0x890 [ 5540.575025][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5540.575314][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5540.575612][ C0] ? lock_acquire+0x1c1/0x220 [ 5540.575866][ C0] ? clockevents_program_event+0xf6/0x300 [ 5540.576173][ C0] ? lock_release+0x1d5/0x250 [ 5540.576425][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5540.576703][ C0] ? ktime_get+0xb6/0x190 [ 5540.576936][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5540.577238][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5540.577548][ C0] run_timer_softirq+0x72/0x100 [ 5540.577814][ C0] __do_softirq+0x1bc/0x7ff [ 5540.578062][ C0] irq_exit_rcu+0x98/0xc0 [ 5540.578296][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5540.578598][ C0] [ 5540.578754][ C0] [ 5540.578913][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5540.579231][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5540.579506][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5540.580522][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5540.580844][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5540.581264][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5540.581683][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5540.582100][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5540.582519][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5540.582939][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5540.583242][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5540.583516][ C0] default_idle_call+0x69/0xa0 [ 5540.583773][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5540.584035][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5540.584329][ C0] ? lock_release+0x1d5/0x250 [ 5540.584576][ C0] do_idle+0xfb/0x160 [ 5540.584789][ C0] cpu_startup_entry+0x55/0x60 [ 5540.585048][ C0] rest_init+0x153/0x260 [ 5540.585274][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5540.585559][ C0] arch_call_rest_init+0x13/0x40 [ 5540.585825][ C0] start_kernel+0x314/0x3d0 [ 5540.586070][ C0] x86_64_start_reservations+0x18/0x30 [ 5540.586366][ C0] x86_64_start_kernel+0xba/0x110 [ 5540.586634][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5540.586960][ C0] [ 5540.587127][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4054s! [ksoftirqd/1:22] [ 5540.587594][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5540.588804][ C1] irq event stamp: 3886976 [ 5540.589046][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5540.589555][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5540.590056][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5540.590564][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5540.591057][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5540.591557][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5540.592209][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5540.592557][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5540.593589][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5540.593917][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5540.594346][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5540.594768][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5540.595192][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5540.595617][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5540.596044][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5540.596517][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5540.596867][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5540.597296][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5540.597716][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5540.598135][ C1] Call Trace: [ 5540.598312][ C1] [ 5540.598468][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5540.598747][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5540.599004][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5540.599299][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5540.599593][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5540.599900][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5540.600184][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5540.600511][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5540.600786][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5540.601116][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5540.601432][ C1] [ 5540.601588][ C1] [ 5540.601745][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5540.602080][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5540.602387][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5540.602700][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5540.603001][ C1] ? run_ksoftirqd+0xb/0x60 [ 5540.603246][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5540.603573][ C1] ? __orc_find+0x9c/0xf0 [ 5540.603811][ C1] ? lock_acquire+0x1c1/0x220 [ 5540.604065][ C1] ? irqentry_enter+0x2b/0x60 [ 5540.604319][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5540.604582][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5540.604871][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5540.605175][ C1] ? lock_acquire+0x1c1/0x220 [ 5540.605425][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5540.605678][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5540.605952][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5540.606203][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5540.606465][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5540.606741][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5540.607033][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5540.607326][ C1] ip_local_deliver+0x19d/0x480 [ 5540.607583][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5540.607868][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5540.608135][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5540.608416][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5540.608684][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5540.609020][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5540.609298][ C1] ip_rcv+0x564/0x740 [ 5540.609521][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5540.609763][ C1] ? set_track_prepare+0x8a/0xd0 [ 5540.610029][ C1] ? irqentry_enter+0x2b/0x60 [ 5540.610285][ C1] ? irqentry_enter+0x2b/0x60 [ 5540.610542][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5540.610787][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5540.611107][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5540.611450][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5540.611764][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5540.612105][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5540.612403][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5540.612740][ C1] netif_receive_skb+0x55/0x280 [ 5540.613003][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5540.613335][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5540.613688][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5540.614001][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5540.614294][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5540.614599][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5540.614932][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5540.615217][ C1] ? arch_stack_walk+0x68/0x100 [ 5540.615478][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5540.615753][ C1] ? irqentry_enter+0x2b/0x60 [ 5540.616006][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5540.616325][ C1] ? irqentry_enter+0x2b/0x60 [ 5540.616581][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5540.616906][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5540.617187][ C1] ? arch_stack_walk+0x68/0x100 [ 5540.617453][ C1] __tcf_classify+0x32c/0x7d0 [ 5540.617707][ C1] tcf_classify+0x283/0x930 [ 5540.617953][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5540.618226][ C1] tc_run+0x2e4/0x5d0 [ 5540.618448][ C1] ? __pfx_tc_run+0x10/0x10 [ 5540.618696][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5540.618968][ C1] ? irqentry_enter+0x2b/0x60 [ 5540.619221][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5540.619514][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5540.619838][ C1] ip_finish_output2+0x786/0x18e0 [ 5540.620109][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5540.620401][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5540.620667][ C1] ? __ip_finish_output+0x10f/0x770 [ 5540.620944][ C1] ip_output+0x16b/0x4f0 [ 5540.621174][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5540.621494][ C1] ? __pfx_ip_output+0x10/0x10 [ 5540.621752][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5540.622111][ C1] ? __pfx_ip_output+0x10/0x10 [ 5540.622369][ C1] __ip_queue_xmit+0x672/0x1910 [ 5540.622630][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5540.622909][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5540.623204][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5540.623488][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5540.623783][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5540.624070][ C1] tcp_delack_timer+0x84/0x240 [ 5540.624327][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5540.624617][ C1] call_timer_fn+0x176/0x430 [ 5540.624869][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5540.625144][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5540.625424][ C1] __run_timers.part.0+0x52d/0x890 [ 5540.625700][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5540.625988][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5540.626290][ C1] ? __pfx___schedule+0x10/0x10 [ 5540.626552][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5540.626877][ C1] run_timer_softirq+0x72/0x100 [ 5540.627139][ C1] __do_softirq+0x1bc/0x7ff [ 5540.627381][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5540.627655][ C1] run_ksoftirqd+0x2e/0x60 [ 5540.627898][ C1] smpboot_thread_fn+0x30e/0x840 [ 5540.628163][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5540.628462][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5540.628758][ C1] kthread+0x292/0x360 [ 5540.628977][ C1] ? __pfx_kthread+0x10/0x10 [ 5540.629224][ C1] ret_from_fork+0x34/0x70 [ 5540.629480][ C1] ? __pfx_kthread+0x10/0x10 [ 5540.629730][ C1] ret_from_fork_asm+0x1b/0x30 [ 5540.629989][ C1] [ 5568.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4080s! [swapper/0:0] [ 5568.527914][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5568.529108][ C0] irq event stamp: 27567077 [ 5568.529355][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5568.529888][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5568.530365][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5568.530868][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5568.531361][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5568.531841][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5568.532491][ C0] RIP: 0010:__kasan_check_read+0x0/0x20 [ 5568.532796][ C0] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 5568.533823][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000202 [ 5568.534150][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5568.534575][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5568.534997][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5568.535419][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5568.535842][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5568.536269][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5568.536741][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5568.537090][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5568.537519][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5568.537937][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5568.538356][ C0] Call Trace: [ 5568.538533][ C0] [ 5568.538688][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5568.538967][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5568.539222][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5568.539520][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5568.539809][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5568.540114][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5568.540395][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5568.540721][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5568.540994][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5568.541275][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5568.541602][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5568.541911][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5568.542246][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5568.542549][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 5568.542843][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 5568.543137][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5568.543462][ C0] ? get_stack_info+0x36/0xc0 [ 5568.543718][ C0] ? lock_acquire+0x1c1/0x220 [ 5568.543973][ C0] ? lock_release+0x1d5/0x250 [ 5568.544225][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5568.544487][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5568.544774][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5568.545076][ C0] ? lock_acquire+0x1c1/0x220 [ 5568.545326][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5568.545580][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5568.545853][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5568.546102][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5568.546364][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5568.546637][ C0] ? __inet_lookup_established+0x341/0x610 [ 5568.546951][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5568.547241][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5568.547529][ C0] ip_local_deliver+0x19d/0x480 [ 5568.547792][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5568.548081][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5568.548350][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5568.548628][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5568.548891][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5568.549231][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5568.549513][ C0] ip_rcv+0x564/0x740 [ 5568.549734][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5568.549979][ C0] ? set_track_prepare+0x8a/0xd0 [ 5568.550248][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5568.550536][ C0] ? rest_init+0x153/0x260 [ 5568.550776][ C0] ? skb_clone+0x10b/0x330 [ 5568.551013][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5568.551353][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5568.551677][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5568.551973][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5568.552284][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5568.552542][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5568.552783][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5568.553094][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5568.553390][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5568.553735][ C0] ? lock_acquire+0x1c1/0x220 [ 5568.553989][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5568.554300][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5568.554596][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5568.554928][ C0] ? __copy_skb_header+0xaf/0x490 [ 5568.555200][ C0] ? __skb_clone+0x57a/0x760 [ 5568.555448][ C0] netif_receive_skb+0x55/0x280 [ 5568.555705][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5568.556031][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5568.556378][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5568.556696][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5568.556987][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5568.557288][ C0] ? hlock_class+0x4e/0x130 [ 5568.557533][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5568.557858][ C0] ? place_entity+0x21/0x2f0 [ 5568.558103][ C0] ? resched_curr+0x219/0x280 [ 5568.558355][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5568.558626][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5568.558911][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5568.559187][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5568.559449][ C0] ? activate_task+0xf5/0x260 [ 5568.559704][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5568.559983][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5568.560257][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5568.560520][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5568.560816][ C0] ? get_stack_info+0x36/0xc0 [ 5568.561066][ C0] ? stack_access_ok+0xda/0x1f0 [ 5568.561321][ C0] ? get_reg+0x119/0x190 [ 5568.561547][ C0] __tcf_classify+0x32c/0x7d0 [ 5568.561801][ C0] tcf_classify+0x283/0x930 [ 5568.562047][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5568.562377][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5568.562642][ C0] ? arch_stack_walk+0x8c/0x100 [ 5568.562902][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5568.563191][ C0] tc_run+0x2e4/0x5d0 [ 5568.563413][ C0] ? __pfx_tc_run+0x10/0x10 [ 5568.563659][ C0] ? lock_acquire+0x1c1/0x220 [ 5568.563912][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5568.564191][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5568.564456][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5568.564745][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5568.565026][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5568.565350][ C0] ? neigh_hh_output+0x348/0x590 [ 5568.565615][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5568.565895][ C0] ip_finish_output2+0x786/0x18e0 [ 5568.566166][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5568.566468][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5568.566820][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5568.567107][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5568.567375][ C0] ? __ip_finish_output+0x10f/0x770 [ 5568.567651][ C0] ip_output+0x16b/0x4f0 [ 5568.567877][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5568.568163][ C0] ? __pfx_ip_output+0x10/0x10 [ 5568.568418][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5568.568719][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5568.568981][ C0] ? ip_local_out+0x114/0x3b0 [ 5568.569237][ C0] __ip_queue_xmit+0x672/0x1910 [ 5568.569503][ C0] ? __skb_clone+0x57a/0x760 [ 5568.569752][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5568.570036][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5568.570336][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5568.570656][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5568.570912][ C0] ? tcp_current_mss+0x40a/0x510 [ 5568.571180][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5568.571471][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5568.571751][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5568.572009][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5568.572276][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5568.572597][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5568.572876][ C0] ? ktime_get+0xb6/0x190 [ 5568.573113][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5568.573393][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5568.573675][ C0] tcp_write_timer+0x82/0x1d0 [ 5568.573931][ C0] call_timer_fn+0x176/0x430 [ 5568.574183][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5568.574456][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5568.574732][ C0] __run_timers.part.0+0x52d/0x890 [ 5568.575004][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5568.575290][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5568.575591][ C0] ? lock_acquire+0x1c1/0x220 [ 5568.575846][ C0] ? clockevents_program_event+0xf6/0x300 [ 5568.576154][ C0] ? lock_release+0x1d5/0x250 [ 5568.576406][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5568.576685][ C0] ? ktime_get+0xb6/0x190 [ 5568.576919][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5568.577220][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5568.577531][ C0] run_timer_softirq+0x72/0x100 [ 5568.577797][ C0] __do_softirq+0x1bc/0x7ff [ 5568.578044][ C0] irq_exit_rcu+0x98/0xc0 [ 5568.578280][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5568.578581][ C0] [ 5568.578738][ C0] [ 5568.578900][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5568.579222][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5568.579497][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5568.580516][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5568.580835][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5568.581253][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5568.581669][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5568.582086][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5568.582503][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5568.582925][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5568.583229][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5568.583502][ C0] default_idle_call+0x69/0xa0 [ 5568.583760][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5568.584023][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5568.584318][ C0] ? lock_release+0x1d5/0x250 [ 5568.584566][ C0] do_idle+0xfb/0x160 [ 5568.584779][ C0] cpu_startup_entry+0x55/0x60 [ 5568.585035][ C0] rest_init+0x153/0x260 [ 5568.585265][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5568.585551][ C0] arch_call_rest_init+0x13/0x40 [ 5568.585817][ C0] start_kernel+0x314/0x3d0 [ 5568.586065][ C0] x86_64_start_reservations+0x18/0x30 [ 5568.586360][ C0] x86_64_start_kernel+0xba/0x110 [ 5568.586628][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5568.586955][ C0] [ 5568.587121][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4080s! [ksoftirqd/1:22] [ 5568.587587][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5568.588791][ C1] irq event stamp: 3886976 [ 5568.589029][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5568.589539][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5568.590032][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5568.590531][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5568.591029][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5568.591522][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5568.592167][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5568.592511][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5568.593532][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5568.593854][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5568.594277][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5568.594698][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5568.595118][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5568.595537][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5568.595955][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5568.596427][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5568.596779][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5568.597201][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5568.597627][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5568.598059][ C1] Call Trace: [ 5568.598240][ C1] [ 5568.598398][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5568.598674][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5568.598934][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5568.599228][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5568.599524][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5568.599825][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5568.600103][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5568.600422][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5568.600702][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5568.601028][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5568.601337][ C1] [ 5568.601498][ C1] [ 5568.601659][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5568.601994][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5568.602299][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5568.602609][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5568.602915][ C1] ? run_ksoftirqd+0xb/0x60 [ 5568.603162][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5568.603493][ C1] ? __orc_find+0x9c/0xf0 [ 5568.603723][ C1] ? lock_acquire+0x1c1/0x220 [ 5568.603976][ C1] ? irqentry_enter+0x2b/0x60 [ 5568.604235][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5568.604496][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5568.604781][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5568.605080][ C1] ? lock_acquire+0x1c1/0x220 [ 5568.605335][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5568.605593][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5568.605871][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5568.606118][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5568.606378][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5568.606648][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5568.606939][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5568.607234][ C1] ip_local_deliver+0x19d/0x480 [ 5568.607496][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5568.607785][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5568.608052][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5568.608328][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5568.608590][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5568.608931][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5568.609206][ C1] ip_rcv+0x564/0x740 [ 5568.609426][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5568.609671][ C1] ? set_track_prepare+0x8a/0xd0 [ 5568.609938][ C1] ? irqentry_enter+0x2b/0x60 [ 5568.610187][ C1] ? irqentry_enter+0x2b/0x60 [ 5568.610436][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5568.610676][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5568.610992][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5568.611333][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5568.611641][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5568.611984][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5568.612290][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5568.612623][ C1] netif_receive_skb+0x55/0x280 [ 5568.612883][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5568.613214][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5568.613560][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5568.613878][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5568.614169][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5568.614472][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5568.614801][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5568.615083][ C1] ? arch_stack_walk+0x68/0x100 [ 5568.615350][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5568.615630][ C1] ? irqentry_enter+0x2b/0x60 [ 5568.615885][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5568.616209][ C1] ? irqentry_enter+0x2b/0x60 [ 5568.616458][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5568.616782][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5568.617067][ C1] ? arch_stack_walk+0x68/0x100 [ 5568.617327][ C1] __tcf_classify+0x32c/0x7d0 [ 5568.617581][ C1] tcf_classify+0x283/0x930 [ 5568.617824][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5568.618094][ C1] tc_run+0x2e4/0x5d0 [ 5568.618307][ C1] ? __pfx_tc_run+0x10/0x10 [ 5568.618549][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5568.618815][ C1] ? irqentry_enter+0x2b/0x60 [ 5568.619071][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5568.619368][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5568.619688][ C1] ip_finish_output2+0x786/0x18e0 [ 5568.619962][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5568.620259][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5568.620524][ C1] ? __ip_finish_output+0x10f/0x770 [ 5568.620807][ C1] ip_output+0x16b/0x4f0 [ 5568.621036][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5568.621353][ C1] ? __pfx_ip_output+0x10/0x10 [ 5568.621612][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5568.621966][ C1] ? __pfx_ip_output+0x10/0x10 [ 5568.622225][ C1] __ip_queue_xmit+0x672/0x1910 [ 5568.622490][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5568.622775][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5568.623076][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5568.623367][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5568.623666][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5568.623955][ C1] tcp_delack_timer+0x84/0x240 [ 5568.624214][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5568.624498][ C1] call_timer_fn+0x176/0x430 [ 5568.624744][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5568.625022][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5568.625302][ C1] __run_timers.part.0+0x52d/0x890 [ 5568.625574][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5568.625866][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5568.626172][ C1] ? __pfx___schedule+0x10/0x10 [ 5568.626432][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5568.626752][ C1] run_timer_softirq+0x72/0x100 [ 5568.627019][ C1] __do_softirq+0x1bc/0x7ff [ 5568.627267][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5568.627545][ C1] run_ksoftirqd+0x2e/0x60 [ 5568.627784][ C1] smpboot_thread_fn+0x30e/0x840 [ 5568.628054][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5568.628344][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5568.628636][ C1] kthread+0x292/0x360 [ 5568.628855][ C1] ? __pfx_kthread+0x10/0x10 [ 5568.629106][ C1] ret_from_fork+0x34/0x70 [ 5568.629351][ C1] ? __pfx_kthread+0x10/0x10 [ 5568.629596][ C1] ret_from_fork_asm+0x1b/0x30 [ 5568.629859][ C1] [ 5593.071024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5593.071414][ C0] rcu: 0-....: (4392843 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1045493 [ 5593.071935][ C0] rcu: (t=4398762 jiffies g=1007429 q=31 ncpus=4) [ 5593.072284][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5593.072760][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5593.073406][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5593.073756][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5593.074783][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5593.075109][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5593.075532][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5593.075956][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5593.076381][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5593.076801][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5593.077230][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5593.077705][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5593.078053][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5593.078483][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5593.078903][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5593.079332][ C0] Call Trace: [ 5593.079512][ C0] [ 5593.079670][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5593.079959][ C0] ? print_cpu_stall+0x263/0x6a0 [ 5593.080226][ C0] ? check_cpu_stall+0x284/0x500 [ 5593.080488][ C0] ? rcu_pending+0x92/0x360 [ 5593.080732][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5593.081015][ C0] ? update_process_times+0xb9/0x110 [ 5593.081297][ C0] ? tick_sched_handle+0x67/0x130 [ 5593.081568][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5593.081870][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5593.082125][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5593.082455][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5593.082740][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5593.083040][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5593.083316][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5593.083638][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5593.083914][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5593.084189][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5593.084517][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5593.084829][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5593.085161][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5593.085466][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5593.085779][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5593.086080][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5593.086402][ C0] ? get_stack_info+0x36/0xc0 [ 5593.086657][ C0] ? lock_acquire+0x1c1/0x220 [ 5593.086910][ C0] ? lock_release+0x1d5/0x250 [ 5593.087163][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5593.087425][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5593.087712][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5593.088015][ C0] ? lock_acquire+0x1c1/0x220 [ 5593.088265][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5593.088519][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5593.088791][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5593.089039][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5593.089303][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5593.089572][ C0] ? __inet_lookup_established+0x341/0x610 [ 5593.089882][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5593.090173][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5593.090464][ C0] ip_local_deliver+0x19d/0x480 [ 5593.090721][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5593.091005][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5593.091269][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5593.091548][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5593.091813][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5593.092147][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5593.092427][ C0] ip_rcv+0x564/0x740 [ 5593.092642][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5593.092887][ C0] ? set_track_prepare+0x8a/0xd0 [ 5593.093154][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5593.093439][ C0] ? rest_init+0x153/0x260 [ 5593.093678][ C0] ? skb_clone+0x10b/0x330 [ 5593.093917][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5593.094255][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5593.094577][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5593.094869][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5593.095175][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5593.095433][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5593.095676][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5593.095988][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5593.096285][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5593.096630][ C0] ? lock_acquire+0x1c1/0x220 [ 5593.096881][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5593.097192][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5593.097493][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5593.097831][ C0] ? __copy_skb_header+0xaf/0x490 [ 5593.098100][ C0] ? __skb_clone+0x57a/0x760 [ 5593.098347][ C0] netif_receive_skb+0x55/0x280 [ 5593.098602][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5593.098926][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5593.099279][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5593.099590][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5593.099882][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5593.100185][ C0] ? hlock_class+0x4e/0x130 [ 5593.100434][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5593.100765][ C0] ? place_entity+0x21/0x2f0 [ 5593.101013][ C0] ? resched_curr+0x219/0x280 [ 5593.101262][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5593.101527][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5593.101810][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5593.102089][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5593.102357][ C0] ? activate_task+0xf5/0x260 [ 5593.102612][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5593.102886][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5593.103156][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5593.103415][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5593.103705][ C0] ? get_stack_info+0x36/0xc0 [ 5593.103951][ C0] ? stack_access_ok+0xda/0x1f0 [ 5593.104208][ C0] ? get_reg+0x119/0x190 [ 5593.104433][ C0] __tcf_classify+0x32c/0x7d0 [ 5593.104686][ C0] tcf_classify+0x283/0x930 [ 5593.104929][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5593.105261][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5593.105525][ C0] ? arch_stack_walk+0x8c/0x100 [ 5593.105784][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5593.106076][ C0] tc_run+0x2e4/0x5d0 [ 5593.106293][ C0] ? __pfx_tc_run+0x10/0x10 [ 5593.106538][ C0] ? lock_acquire+0x1c1/0x220 [ 5593.106791][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5593.107070][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5593.107335][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5593.107622][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5593.107900][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5593.108221][ C0] ? neigh_hh_output+0x348/0x590 [ 5593.108483][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5593.108762][ C0] ip_finish_output2+0x786/0x18e0 [ 5593.109034][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5593.109334][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5593.109687][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5593.109976][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5593.110240][ C0] ? __ip_finish_output+0x10f/0x770 [ 5593.110518][ C0] ip_output+0x16b/0x4f0 [ 5593.110748][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5593.111026][ C0] ? __pfx_ip_output+0x10/0x10 [ 5593.111282][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5593.111579][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5593.111845][ C0] ? ip_local_out+0x114/0x3b0 [ 5593.112096][ C0] __ip_queue_xmit+0x672/0x1910 [ 5593.112355][ C0] ? __skb_clone+0x57a/0x760 [ 5593.112598][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5593.112880][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5593.113177][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5593.113498][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5593.113755][ C0] ? tcp_current_mss+0x40a/0x510 [ 5593.114028][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5593.114307][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5593.114585][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5593.114846][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5593.115115][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5593.115429][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5593.115712][ C0] ? ktime_get+0xb6/0x190 [ 5593.115944][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5593.116223][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5593.116501][ C0] tcp_write_timer+0x82/0x1d0 [ 5593.116754][ C0] call_timer_fn+0x176/0x430 [ 5593.117002][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5593.117276][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5593.117552][ C0] __run_timers.part.0+0x52d/0x890 [ 5593.117823][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5593.118108][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5593.118404][ C0] ? lock_acquire+0x1c1/0x220 [ 5593.118655][ C0] ? clockevents_program_event+0xf6/0x300 [ 5593.118970][ C0] ? lock_release+0x1d5/0x250 [ 5593.119226][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5593.119500][ C0] ? ktime_get+0xb6/0x190 [ 5593.119730][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5593.120027][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5593.120342][ C0] run_timer_softirq+0x72/0x100 [ 5593.120600][ C0] __do_softirq+0x1bc/0x7ff [ 5593.120844][ C0] irq_exit_rcu+0x98/0xc0 [ 5593.121074][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5593.121373][ C0] [ 5593.121531][ C0] [ 5593.121690][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5593.122010][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5593.122277][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5593.123291][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5593.123613][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5593.124030][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5593.124446][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5593.124861][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5593.125278][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5593.125695][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5593.126001][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5593.126274][ C0] default_idle_call+0x69/0xa0 [ 5593.126528][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5593.126788][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5593.127082][ C0] ? lock_release+0x1d5/0x250 [ 5593.127332][ C0] do_idle+0xfb/0x160 [ 5593.127544][ C0] cpu_startup_entry+0x55/0x60 [ 5593.127796][ C0] rest_init+0x153/0x260 [ 5593.128022][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5593.128310][ C0] arch_call_rest_init+0x13/0x40 [ 5593.128577][ C0] start_kernel+0x314/0x3d0 [ 5593.128827][ C0] x86_64_start_reservations+0x18/0x30 [ 5593.129121][ C0] x86_64_start_kernel+0xba/0x110 [ 5593.129394][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5593.129725][ C0] [ 5593.129891][ C0] Sending NMI from CPU 0 to CPUs 1: [ 5593.130179][ C1] NMI backtrace for cpu 1 [ 5593.130187][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5593.130191][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5593.130194][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5593.130202][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5593.130205][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5593.130209][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5593.130211][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5593.130213][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5593.130215][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5593.130217][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5593.130219][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5593.130221][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5593.130225][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5593.130226][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5593.130227][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5593.130229][ C1] Call Trace: [ 5593.130232][ C1] [ 5593.130234][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 5593.130241][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5593.130247][ C1] ? nmi_handle+0x156/0x420 [ 5593.130252][ C1] ? default_do_nmi+0x41/0x100 [ 5593.130256][ C1] ? exc_nmi+0xf3/0x120 [ 5593.130259][ C1] ? end_repeat_nmi+0xf/0x60 [ 5593.130264][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5593.130268][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5593.130271][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5593.130275][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5593.130278][ C1] [ 5593.130279][ C1] [ 5593.130280][ C1] ? run_ksoftirqd+0xb/0x60 [ 5593.130285][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5593.130288][ C1] ? __orc_find+0x9c/0xf0 [ 5593.130291][ C1] ? lock_acquire+0x1c1/0x220 [ 5593.130296][ C1] ? irqentry_enter+0x2b/0x60 [ 5593.130301][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5593.130305][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5593.130308][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5593.130311][ C1] ? lock_acquire+0x1c1/0x220 [ 5593.130314][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5593.130319][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5593.130323][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5593.130330][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5593.130333][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5593.130339][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5593.130346][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5593.130350][ C1] ip_local_deliver+0x19d/0x480 [ 5593.130353][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5593.130356][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5593.130361][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5593.130364][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5593.130367][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5593.130371][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5593.130380][ C1] ip_rcv+0x564/0x740 [ 5593.130383][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5593.130386][ C1] ? set_track_prepare+0x8a/0xd0 [ 5593.130391][ C1] ? irqentry_enter+0x2b/0x60 [ 5593.130394][ C1] ? irqentry_enter+0x2b/0x60 [ 5593.130398][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5593.130400][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5593.130404][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5593.130408][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5593.130410][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5593.130413][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5593.130416][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5593.130422][ C1] netif_receive_skb+0x55/0x280 [ 5593.130425][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5593.130434][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5593.130441][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5593.130448][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5593.130454][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5593.130466][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5593.130475][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5593.130478][ C1] ? arch_stack_walk+0x68/0x100 [ 5593.130483][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5593.130486][ C1] ? irqentry_enter+0x2b/0x60 [ 5593.130490][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5593.130494][ C1] ? irqentry_enter+0x2b/0x60 [ 5593.130498][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5593.130505][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5593.130508][ C1] ? arch_stack_walk+0x68/0x100 [ 5593.130512][ C1] __tcf_classify+0x32c/0x7d0 [ 5593.130517][ C1] tcf_classify+0x283/0x930 [ 5593.130521][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5593.130526][ C1] tc_run+0x2e4/0x5d0 [ 5593.130530][ C1] ? __pfx_tc_run+0x10/0x10 [ 5593.130536][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5593.130541][ C1] ? irqentry_enter+0x2b/0x60 [ 5593.130544][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5593.130547][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5593.130554][ C1] ip_finish_output2+0x786/0x18e0 [ 5593.130560][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5593.130563][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5593.130567][ C1] ? __ip_finish_output+0x10f/0x770 [ 5593.130571][ C1] ip_output+0x16b/0x4f0 [ 5593.130574][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5593.130578][ C1] ? __pfx_ip_output+0x10/0x10 [ 5593.130582][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5593.130589][ C1] ? __pfx_ip_output+0x10/0x10 [ 5593.130594][ C1] __ip_queue_xmit+0x672/0x1910 [ 5593.130599][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5593.130606][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5593.130610][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5593.130614][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5593.130618][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5593.130621][ C1] tcp_delack_timer+0x84/0x240 [ 5593.130625][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5593.130628][ C1] call_timer_fn+0x176/0x430 [ 5593.130632][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5593.130637][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5593.130641][ C1] __run_timers.part.0+0x52d/0x890 [ 5593.130644][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5593.130649][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5593.130654][ C1] ? __pfx___schedule+0x10/0x10 [ 5593.130657][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5593.130662][ C1] run_timer_softirq+0x72/0x100 [ 5593.130665][ C1] __do_softirq+0x1bc/0x7ff [ 5593.130669][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5593.130673][ C1] run_ksoftirqd+0x2e/0x60 [ 5593.130676][ C1] smpboot_thread_fn+0x30e/0x840 [ 5593.130680][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5593.130684][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5593.130687][ C1] kthread+0x292/0x360 [ 5593.130689][ C1] ? __pfx_kthread+0x10/0x10 [ 5593.130692][ C1] ret_from_fork+0x34/0x70 [ 5593.130695][ C1] ? __pfx_kthread+0x10/0x10 [ 5593.130697][ C1] ret_from_fork_asm+0x1b/0x30 [ 5593.130705][ C1] [ 5620.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4128s! [swapper/0:0] [ 5620.527921][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5620.529121][ C0] irq event stamp: 27567077 [ 5620.529360][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5620.529888][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5620.530364][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5620.530877][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5620.531378][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5620.531862][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5620.532503][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5620.532840][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5620.533856][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5620.534179][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5620.534595][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5620.535012][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5620.535431][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5620.535847][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5620.536265][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5620.536734][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5620.537087][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5620.537507][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5620.537928][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5620.538351][ C0] Call Trace: [ 5620.538537][ C0] [ 5620.538702][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5620.538981][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5620.539239][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5620.539526][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5620.539812][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5620.540123][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5620.540404][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5620.540727][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5620.540999][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5620.541278][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5620.541599][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5620.541910][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5620.542246][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5620.542548][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5620.542855][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5620.543162][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5620.543491][ C0] ? get_stack_info+0x36/0xc0 [ 5620.543745][ C0] ? lock_acquire+0x1c1/0x220 [ 5620.544000][ C0] ? lock_release+0x1d5/0x250 [ 5620.544252][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5620.544512][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5620.544801][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5620.545098][ C0] ? lock_acquire+0x1c1/0x220 [ 5620.545348][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5620.545601][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5620.545876][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5620.546123][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5620.546379][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5620.546646][ C0] ? __inet_lookup_established+0x341/0x610 [ 5620.546958][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5620.547251][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5620.547544][ C0] ip_local_deliver+0x19d/0x480 [ 5620.547802][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5620.548085][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5620.548348][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5620.548627][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5620.548892][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5620.549231][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5620.549504][ C0] ip_rcv+0x564/0x740 [ 5620.549714][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5620.549952][ C0] ? set_track_prepare+0x8a/0xd0 [ 5620.550214][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5620.550505][ C0] ? rest_init+0x153/0x260 [ 5620.550740][ C0] ? skb_clone+0x10b/0x330 [ 5620.550982][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5620.551315][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5620.551632][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5620.551934][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5620.552244][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5620.552505][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5620.552747][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5620.553067][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5620.553366][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5620.553702][ C0] ? lock_acquire+0x1c1/0x220 [ 5620.553947][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5620.554255][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5620.554554][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5620.554882][ C0] ? __copy_skb_header+0xaf/0x490 [ 5620.555148][ C0] ? __skb_clone+0x57a/0x760 [ 5620.555391][ C0] netif_receive_skb+0x55/0x280 [ 5620.555654][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5620.555982][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5620.556333][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5620.556642][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5620.556929][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5620.557230][ C0] ? hlock_class+0x4e/0x130 [ 5620.557479][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5620.557810][ C0] ? place_entity+0x21/0x2f0 [ 5620.558059][ C0] ? resched_curr+0x219/0x280 [ 5620.558308][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5620.558573][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5620.558852][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5620.559135][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5620.559394][ C0] ? activate_task+0xf5/0x260 [ 5620.559642][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5620.559917][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5620.560191][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5620.560449][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5620.560739][ C0] ? get_stack_info+0x36/0xc0 [ 5620.560994][ C0] ? stack_access_ok+0xda/0x1f0 [ 5620.561254][ C0] ? get_reg+0x119/0x190 [ 5620.561482][ C0] __tcf_classify+0x32c/0x7d0 [ 5620.561734][ C0] tcf_classify+0x283/0x930 [ 5620.561973][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5620.562296][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5620.562569][ C0] ? arch_stack_walk+0x8c/0x100 [ 5620.562837][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5620.563128][ C0] tc_run+0x2e4/0x5d0 [ 5620.563342][ C0] ? __pfx_tc_run+0x10/0x10 [ 5620.563581][ C0] ? lock_acquire+0x1c1/0x220 [ 5620.563828][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5620.564103][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5620.564371][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5620.564654][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5620.564929][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5620.565248][ C0] ? neigh_hh_output+0x348/0x590 [ 5620.565517][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5620.565794][ C0] ip_finish_output2+0x786/0x18e0 [ 5620.566063][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5620.566355][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5620.566713][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5620.567009][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5620.567272][ C0] ? __ip_finish_output+0x10f/0x770 [ 5620.567552][ C0] ip_output+0x16b/0x4f0 [ 5620.567779][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5620.568061][ C0] ? __pfx_ip_output+0x10/0x10 [ 5620.568321][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5620.568620][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5620.568885][ C0] ? ip_local_out+0x114/0x3b0 [ 5620.569137][ C0] __ip_queue_xmit+0x672/0x1910 [ 5620.569401][ C0] ? __skb_clone+0x57a/0x760 [ 5620.569649][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5620.569928][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5620.570222][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5620.570537][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5620.570796][ C0] ? tcp_current_mss+0x40a/0x510 [ 5620.571066][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5620.571349][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5620.571622][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5620.571872][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5620.572144][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5620.572461][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5620.572739][ C0] ? ktime_get+0xb6/0x190 [ 5620.572968][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5620.573240][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5620.573522][ C0] tcp_write_timer+0x82/0x1d0 [ 5620.573768][ C0] call_timer_fn+0x176/0x430 [ 5620.574011][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5620.574287][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5620.574558][ C0] __run_timers.part.0+0x52d/0x890 [ 5620.574833][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5620.575113][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5620.575411][ C0] ? lock_acquire+0x1c1/0x220 [ 5620.575657][ C0] ? clockevents_program_event+0xf6/0x300 [ 5620.575962][ C0] ? lock_release+0x1d5/0x250 [ 5620.576212][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5620.576488][ C0] ? ktime_get+0xb6/0x190 [ 5620.576716][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5620.577014][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5620.577325][ C0] run_timer_softirq+0x72/0x100 [ 5620.577581][ C0] __do_softirq+0x1bc/0x7ff [ 5620.577822][ C0] irq_exit_rcu+0x98/0xc0 [ 5620.578052][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5620.578349][ C0] [ 5620.578509][ C0] [ 5620.578669][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5620.578990][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5620.579264][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5620.580287][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5620.580612][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5620.581032][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5620.581455][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5620.581877][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5620.582296][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5620.582716][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5620.583021][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5620.583294][ C0] default_idle_call+0x69/0xa0 [ 5620.583546][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5620.583811][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5620.584102][ C0] ? lock_release+0x1d5/0x250 [ 5620.584355][ C0] do_idle+0xfb/0x160 [ 5620.584566][ C0] cpu_startup_entry+0x55/0x60 [ 5620.584821][ C0] rest_init+0x153/0x260 [ 5620.585045][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5620.585334][ C0] arch_call_rest_init+0x13/0x40 [ 5620.585600][ C0] start_kernel+0x314/0x3d0 [ 5620.585839][ C0] x86_64_start_reservations+0x18/0x30 [ 5620.586129][ C0] x86_64_start_kernel+0xba/0x110 [ 5620.586399][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5620.586727][ C0] [ 5620.586895][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4128s! [ksoftirqd/1:22] [ 5620.587364][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5620.588577][ C1] irq event stamp: 3886976 [ 5620.588816][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5620.589321][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5620.589820][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5620.590325][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5620.590814][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5620.591309][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5620.591957][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5620.592302][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5620.593331][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5620.593658][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5620.594080][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5620.594504][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5620.594931][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5620.595353][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5620.595775][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5620.596254][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5620.596601][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5620.597025][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5620.597444][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5620.597861][ C1] Call Trace: [ 5620.598042][ C1] [ 5620.598199][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5620.598478][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5620.598731][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5620.599034][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5620.599325][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5620.599632][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5620.599915][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5620.600237][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5620.600510][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5620.600839][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5620.601152][ C1] [ 5620.601308][ C1] [ 5620.601465][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5620.601794][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5620.602103][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5620.602417][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5620.602718][ C1] ? run_ksoftirqd+0xb/0x60 [ 5620.602958][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5620.603287][ C1] ? __orc_find+0x9c/0xf0 [ 5620.603520][ C1] ? lock_acquire+0x1c1/0x220 [ 5620.603775][ C1] ? irqentry_enter+0x2b/0x60 [ 5620.604032][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5620.604296][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5620.604589][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5620.604890][ C1] ? lock_acquire+0x1c1/0x220 [ 5620.605137][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5620.605387][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5620.605659][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5620.605909][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5620.606172][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5620.606446][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5620.606740][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5620.607036][ C1] ip_local_deliver+0x19d/0x480 [ 5620.607295][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5620.607580][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5620.607844][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5620.608125][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5620.608389][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5620.608722][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5620.609001][ C1] ip_rcv+0x564/0x740 [ 5620.609228][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5620.609468][ C1] ? set_track_prepare+0x8a/0xd0 [ 5620.609732][ C1] ? irqentry_enter+0x2b/0x60 [ 5620.609984][ C1] ? irqentry_enter+0x2b/0x60 [ 5620.610238][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5620.610482][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5620.610801][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5620.611147][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5620.611458][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5620.611797][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5620.612096][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5620.612432][ C1] netif_receive_skb+0x55/0x280 [ 5620.612696][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5620.613030][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5620.613380][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5620.613693][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5620.613988][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5620.614297][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5620.614628][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5620.614912][ C1] ? arch_stack_walk+0x68/0x100 [ 5620.615174][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5620.615449][ C1] ? irqentry_enter+0x2b/0x60 [ 5620.615696][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5620.616013][ C1] ? irqentry_enter+0x2b/0x60 [ 5620.616268][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5620.616594][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5620.616874][ C1] ? arch_stack_walk+0x68/0x100 [ 5620.617142][ C1] __tcf_classify+0x32c/0x7d0 [ 5620.617400][ C1] tcf_classify+0x283/0x930 [ 5620.617647][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5620.617920][ C1] tc_run+0x2e4/0x5d0 [ 5620.618137][ C1] ? __pfx_tc_run+0x10/0x10 [ 5620.618383][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5620.618652][ C1] ? irqentry_enter+0x2b/0x60 [ 5620.618900][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5620.619188][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5620.619514][ C1] ip_finish_output2+0x786/0x18e0 [ 5620.619784][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5620.620073][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5620.620341][ C1] ? __ip_finish_output+0x10f/0x770 [ 5620.620618][ C1] ip_output+0x16b/0x4f0 [ 5620.620845][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5620.621169][ C1] ? __pfx_ip_output+0x10/0x10 [ 5620.621425][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5620.621782][ C1] ? __pfx_ip_output+0x10/0x10 [ 5620.622044][ C1] __ip_queue_xmit+0x672/0x1910 [ 5620.622306][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5620.622588][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5620.622883][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5620.623169][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5620.623464][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5620.623747][ C1] tcp_delack_timer+0x84/0x240 [ 5620.624000][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5620.624287][ C1] call_timer_fn+0x176/0x430 [ 5620.624537][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5620.624811][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5620.625093][ C1] __run_timers.part.0+0x52d/0x890 [ 5620.625369][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5620.625655][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5620.625954][ C1] ? __pfx___schedule+0x10/0x10 [ 5620.626220][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5620.626541][ C1] run_timer_softirq+0x72/0x100 [ 5620.626799][ C1] __do_softirq+0x1bc/0x7ff [ 5620.627042][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5620.627315][ C1] run_ksoftirqd+0x2e/0x60 [ 5620.627556][ C1] smpboot_thread_fn+0x30e/0x840 [ 5620.627822][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5620.628115][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5620.628402][ C1] kthread+0x292/0x360 [ 5620.628623][ C1] ? __pfx_kthread+0x10/0x10 [ 5620.628869][ C1] ret_from_fork+0x34/0x70 [ 5620.629114][ C1] ? __pfx_kthread+0x10/0x10 [ 5620.629362][ C1] ret_from_fork_asm+0x1b/0x30 [ 5620.629621][ C1] [ 5648.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4154s! [swapper/0:0] [ 5648.527919][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5648.529125][ C0] irq event stamp: 27567077 [ 5648.529363][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5648.529892][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5648.530370][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5648.530873][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5648.531370][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5648.531854][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5648.532496][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5648.532834][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5648.533848][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5648.534171][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5648.534588][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5648.535005][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5648.535423][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5648.535841][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5648.536259][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5648.536725][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5648.537080][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5648.537501][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5648.537919][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5648.538340][ C0] Call Trace: [ 5648.538523][ C0] [ 5648.538680][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5648.538957][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5648.539212][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5648.539502][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5648.539785][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5648.540087][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5648.540363][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5648.540680][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5648.540956][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5648.541230][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5648.541556][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5648.541868][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5648.542196][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5648.542502][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5648.542811][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5648.543116][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5648.543440][ C0] ? get_stack_info+0x36/0xc0 [ 5648.543698][ C0] ? lock_acquire+0x1c1/0x220 [ 5648.543952][ C0] ? lock_release+0x1d5/0x250 [ 5648.544207][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5648.544472][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5648.544760][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5648.545060][ C0] ? lock_acquire+0x1c1/0x220 [ 5648.545307][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5648.545557][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5648.545833][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5648.546082][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5648.546345][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5648.546615][ C0] ? __inet_lookup_established+0x341/0x610 [ 5648.546934][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5648.547223][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5648.547513][ C0] ip_local_deliver+0x19d/0x480 [ 5648.547773][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5648.548060][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5648.548325][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5648.548600][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5648.548861][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5648.549202][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5648.549480][ C0] ip_rcv+0x564/0x740 [ 5648.549693][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5648.549935][ C0] ? set_track_prepare+0x8a/0xd0 [ 5648.550200][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5648.550486][ C0] ? rest_init+0x153/0x260 [ 5648.550725][ C0] ? skb_clone+0x10b/0x330 [ 5648.550965][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5648.551307][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5648.551627][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5648.551920][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5648.552228][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5648.552483][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5648.552721][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5648.553036][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5648.553332][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5648.553673][ C0] ? lock_acquire+0x1c1/0x220 [ 5648.553922][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5648.554235][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5648.554534][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5648.554867][ C0] ? __copy_skb_header+0xaf/0x490 [ 5648.555136][ C0] ? __skb_clone+0x57a/0x760 [ 5648.555385][ C0] netif_receive_skb+0x55/0x280 [ 5648.555640][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5648.555963][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5648.556310][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5648.556627][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5648.556911][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5648.557208][ C0] ? hlock_class+0x4e/0x130 [ 5648.557450][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5648.557779][ C0] ? place_entity+0x21/0x2f0 [ 5648.558026][ C0] ? resched_curr+0x219/0x280 [ 5648.558281][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5648.558554][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5648.558837][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5648.559119][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5648.559379][ C0] ? activate_task+0xf5/0x260 [ 5648.559632][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5648.559907][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5648.560179][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5648.560440][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5648.560733][ C0] ? get_stack_info+0x36/0xc0 [ 5648.560983][ C0] ? stack_access_ok+0xda/0x1f0 [ 5648.561240][ C0] ? get_reg+0x119/0x190 [ 5648.561465][ C0] __tcf_classify+0x32c/0x7d0 [ 5648.561719][ C0] tcf_classify+0x283/0x930 [ 5648.561963][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5648.562293][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5648.562558][ C0] ? arch_stack_walk+0x8c/0x100 [ 5648.562816][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5648.563104][ C0] tc_run+0x2e4/0x5d0 [ 5648.563319][ C0] ? __pfx_tc_run+0x10/0x10 [ 5648.563563][ C0] ? lock_acquire+0x1c1/0x220 [ 5648.563814][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5648.564091][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5648.564356][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5648.564643][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5648.564921][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5648.565241][ C0] ? neigh_hh_output+0x348/0x590 [ 5648.565505][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5648.565783][ C0] ip_finish_output2+0x786/0x18e0 [ 5648.566055][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5648.566348][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5648.566703][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5648.566995][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5648.567269][ C0] ? __ip_finish_output+0x10f/0x770 [ 5648.567545][ C0] ip_output+0x16b/0x4f0 [ 5648.567770][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5648.568057][ C0] ? __pfx_ip_output+0x10/0x10 [ 5648.568310][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5648.568617][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5648.568879][ C0] ? ip_local_out+0x114/0x3b0 [ 5648.569136][ C0] __ip_queue_xmit+0x672/0x1910 [ 5648.569394][ C0] ? __skb_clone+0x57a/0x760 [ 5648.569637][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5648.569925][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5648.570225][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5648.570546][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5648.570802][ C0] ? tcp_current_mss+0x40a/0x510 [ 5648.571067][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5648.571344][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5648.571622][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5648.571876][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5648.572142][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5648.572457][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5648.572735][ C0] ? ktime_get+0xb6/0x190 [ 5648.572969][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5648.573244][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5648.573523][ C0] tcp_write_timer+0x82/0x1d0 [ 5648.573774][ C0] call_timer_fn+0x176/0x430 [ 5648.574023][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5648.574295][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5648.574570][ C0] __run_timers.part.0+0x52d/0x890 [ 5648.574840][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5648.575124][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5648.575420][ C0] ? lock_acquire+0x1c1/0x220 [ 5648.575670][ C0] ? clockevents_program_event+0xf6/0x300 [ 5648.575978][ C0] ? lock_release+0x1d5/0x250 [ 5648.576232][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5648.576511][ C0] ? ktime_get+0xb6/0x190 [ 5648.576745][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5648.577044][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5648.577352][ C0] run_timer_softirq+0x72/0x100 [ 5648.577612][ C0] __do_softirq+0x1bc/0x7ff [ 5648.577857][ C0] irq_exit_rcu+0x98/0xc0 [ 5648.578091][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5648.578392][ C0] [ 5648.578547][ C0] [ 5648.578703][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5648.579036][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5648.579302][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5648.580314][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5648.580636][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5648.581054][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5648.581470][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5648.581888][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5648.582305][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5648.582725][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5648.583025][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5648.583296][ C0] default_idle_call+0x69/0xa0 [ 5648.583550][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5648.583812][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5648.584106][ C0] ? lock_release+0x1d5/0x250 [ 5648.584356][ C0] do_idle+0xfb/0x160 [ 5648.584567][ C0] cpu_startup_entry+0x55/0x60 [ 5648.584818][ C0] rest_init+0x153/0x260 [ 5648.585047][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5648.585336][ C0] arch_call_rest_init+0x13/0x40 [ 5648.585601][ C0] start_kernel+0x314/0x3d0 [ 5648.585845][ C0] x86_64_start_reservations+0x18/0x30 [ 5648.586136][ C0] x86_64_start_kernel+0xba/0x110 [ 5648.586402][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5648.586726][ C0] [ 5648.586888][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4154s! [ksoftirqd/1:22] [ 5648.587361][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5648.588554][ C1] irq event stamp: 3886976 [ 5648.588792][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5648.589299][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5648.589796][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5648.590298][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5648.590795][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5648.591291][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5648.591932][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5648.592271][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5648.593290][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5648.593611][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5648.594033][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5648.594453][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5648.594872][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5648.595292][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5648.595713][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5648.596186][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5648.596540][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5648.596965][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5648.597393][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5648.597816][ C1] Call Trace: [ 5648.597995][ C1] [ 5648.598157][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5648.598434][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5648.598693][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5648.598993][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5648.599281][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5648.599583][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5648.599861][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5648.600186][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5648.600462][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5648.600785][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5648.601096][ C1] [ 5648.601257][ C1] [ 5648.601419][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5648.601751][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5648.602056][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5648.602366][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5648.602674][ C1] ? run_ksoftirqd+0xb/0x60 [ 5648.602921][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5648.603252][ C1] ? __orc_find+0x9c/0xf0 [ 5648.603482][ C1] ? lock_acquire+0x1c1/0x220 [ 5648.603733][ C1] ? irqentry_enter+0x2b/0x60 [ 5648.603984][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5648.604246][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5648.604530][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5648.604828][ C1] ? lock_acquire+0x1c1/0x220 [ 5648.605085][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5648.605342][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5648.605620][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5648.605864][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5648.606122][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5648.606392][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5648.606683][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5648.606974][ C1] ip_local_deliver+0x19d/0x480 [ 5648.607238][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5648.607525][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5648.607792][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5648.608070][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5648.608334][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5648.608672][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5648.608952][ C1] ip_rcv+0x564/0x740 [ 5648.609172][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5648.609415][ C1] ? set_track_prepare+0x8a/0xd0 [ 5648.609684][ C1] ? irqentry_enter+0x2b/0x60 [ 5648.609935][ C1] ? irqentry_enter+0x2b/0x60 [ 5648.610188][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5648.610428][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5648.610741][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5648.611082][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5648.611392][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5648.611736][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5648.612038][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5648.612370][ C1] netif_receive_skb+0x55/0x280 [ 5648.612627][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5648.612951][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5648.613300][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5648.613617][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5648.613906][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5648.614209][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5648.614538][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5648.614821][ C1] ? arch_stack_walk+0x68/0x100 [ 5648.615087][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5648.615368][ C1] ? irqentry_enter+0x2b/0x60 [ 5648.615624][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5648.615945][ C1] ? irqentry_enter+0x2b/0x60 [ 5648.616195][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5648.616514][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5648.616798][ C1] ? arch_stack_walk+0x68/0x100 [ 5648.617060][ C1] __tcf_classify+0x32c/0x7d0 [ 5648.617311][ C1] tcf_classify+0x283/0x930 [ 5648.617553][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5648.617821][ C1] tc_run+0x2e4/0x5d0 [ 5648.618037][ C1] ? __pfx_tc_run+0x10/0x10 [ 5648.618279][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5648.618546][ C1] ? irqentry_enter+0x2b/0x60 [ 5648.618802][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5648.619096][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5648.619416][ C1] ip_finish_output2+0x786/0x18e0 [ 5648.619693][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5648.619986][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5648.620252][ C1] ? __ip_finish_output+0x10f/0x770 [ 5648.620534][ C1] ip_output+0x16b/0x4f0 [ 5648.620762][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5648.621080][ C1] ? __pfx_ip_output+0x10/0x10 [ 5648.621339][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5648.621690][ C1] ? __pfx_ip_output+0x10/0x10 [ 5648.621947][ C1] __ip_queue_xmit+0x672/0x1910 [ 5648.622213][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5648.622498][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5648.622798][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5648.623089][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5648.623387][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5648.623677][ C1] tcp_delack_timer+0x84/0x240 [ 5648.623938][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5648.624225][ C1] call_timer_fn+0x176/0x430 [ 5648.624473][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5648.624753][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5648.625032][ C1] __run_timers.part.0+0x52d/0x890 [ 5648.625305][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5648.625597][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5648.625903][ C1] ? __pfx___schedule+0x10/0x10 [ 5648.626163][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5648.626486][ C1] run_timer_softirq+0x72/0x100 [ 5648.626750][ C1] __do_softirq+0x1bc/0x7ff [ 5648.626997][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5648.627275][ C1] run_ksoftirqd+0x2e/0x60 [ 5648.627512][ C1] smpboot_thread_fn+0x30e/0x840 [ 5648.627780][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5648.628071][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5648.628366][ C1] kthread+0x292/0x360 [ 5648.628584][ C1] ? __pfx_kthread+0x10/0x10 [ 5648.628834][ C1] ret_from_fork+0x34/0x70 [ 5648.629080][ C1] ? __pfx_kthread+0x10/0x10 [ 5648.629322][ C1] ret_from_fork_asm+0x1b/0x30 [ 5648.629584][ C1] [ 5671.134024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5671.134413][ C0] rcu: 0-....: (4470731 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1063674 [ 5671.134929][ C0] rcu: (t=4476825 jiffies g=1007429 q=31 ncpus=4) [ 5671.135275][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5671.135758][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5671.136398][ C0] RIP: 0010:kasan_check_range+0x4/0x1c0 [ 5671.136697][ C0] Code: 6a 00 5b 5d 41 5c 41 5d c3 cc cc cc cc 66 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 <48> 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 [ 5671.137713][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000246 [ 5671.138034][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5671.138452][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5671.138877][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5671.139297][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5671.139718][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5671.140142][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5671.140617][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5671.140963][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5671.141390][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5671.141811][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5671.142229][ C0] Call Trace: [ 5671.142405][ C0] [ 5671.142562][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5671.142850][ C0] ? print_cpu_stall+0x263/0x6a0 [ 5671.143114][ C0] ? check_cpu_stall+0x284/0x500 [ 5671.143379][ C0] ? rcu_pending+0x92/0x360 [ 5671.143618][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5671.143898][ C0] ? update_process_times+0xb9/0x110 [ 5671.144183][ C0] ? tick_sched_handle+0x67/0x130 [ 5671.144452][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5671.144750][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5671.145006][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5671.145335][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5671.145624][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5671.145929][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5671.146212][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5671.146538][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5671.146811][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5671.147093][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5671.147418][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5671.147727][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5671.148064][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5671.148368][ C0] ? kasan_check_range+0x4/0x1c0 [ 5671.148632][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 5671.148934][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5671.149264][ C0] ? get_stack_info+0x36/0xc0 [ 5671.149519][ C0] ? lock_acquire+0x1c1/0x220 [ 5671.149774][ C0] ? lock_release+0x1d5/0x250 [ 5671.150027][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5671.150289][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5671.150576][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5671.150877][ C0] ? lock_acquire+0x1c1/0x220 [ 5671.151127][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5671.151380][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5671.151651][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5671.151900][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5671.152161][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5671.152435][ C0] ? __inet_lookup_established+0x341/0x610 [ 5671.152747][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5671.153036][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5671.153323][ C0] ip_local_deliver+0x19d/0x480 [ 5671.153588][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5671.153877][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5671.154150][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5671.154427][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5671.154690][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5671.155031][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5671.155305][ C0] ip_rcv+0x564/0x740 [ 5671.155519][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5671.155760][ C0] ? set_track_prepare+0x8a/0xd0 [ 5671.156026][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5671.156316][ C0] ? rest_init+0x153/0x260 [ 5671.156552][ C0] ? skb_clone+0x10b/0x330 [ 5671.156793][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5671.157124][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5671.157441][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5671.157738][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5671.158050][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5671.158312][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5671.158558][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5671.158874][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5671.159171][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5671.159520][ C0] ? lock_acquire+0x1c1/0x220 [ 5671.159774][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5671.160086][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5671.160383][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5671.160717][ C0] ? __copy_skb_header+0xaf/0x490 [ 5671.160989][ C0] ? __skb_clone+0x57a/0x760 [ 5671.161238][ C0] netif_receive_skb+0x55/0x280 [ 5671.161498][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5671.161824][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5671.162171][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5671.162488][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5671.162775][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5671.163075][ C0] ? hlock_class+0x4e/0x130 [ 5671.163320][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5671.163645][ C0] ? place_entity+0x21/0x2f0 [ 5671.163888][ C0] ? resched_curr+0x219/0x280 [ 5671.164140][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5671.164412][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5671.164697][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5671.164974][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5671.165232][ C0] ? activate_task+0xf5/0x260 [ 5671.165484][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5671.165758][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5671.166034][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5671.166297][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5671.166585][ C0] ? get_stack_info+0x36/0xc0 [ 5671.166837][ C0] ? stack_access_ok+0xda/0x1f0 [ 5671.167105][ C0] ? get_reg+0x119/0x190 [ 5671.167335][ C0] __tcf_classify+0x32c/0x7d0 [ 5671.167584][ C0] tcf_classify+0x283/0x930 [ 5671.167824][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5671.168151][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5671.168419][ C0] ? arch_stack_walk+0x8c/0x100 [ 5671.168683][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5671.168979][ C0] tc_run+0x2e4/0x5d0 [ 5671.169205][ C0] ? __pfx_tc_run+0x10/0x10 [ 5671.169450][ C0] ? lock_acquire+0x1c1/0x220 [ 5671.169703][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5671.169980][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5671.170244][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5671.170533][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5671.170812][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5671.171136][ C0] ? neigh_hh_output+0x348/0x590 [ 5671.171403][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5671.171681][ C0] ip_finish_output2+0x786/0x18e0 [ 5671.171951][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5671.172248][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5671.172597][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5671.172883][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5671.173149][ C0] ? __ip_finish_output+0x10f/0x770 [ 5671.173423][ C0] ip_output+0x16b/0x4f0 [ 5671.173648][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5671.173930][ C0] ? __pfx_ip_output+0x10/0x10 [ 5671.174184][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5671.174484][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5671.174746][ C0] ? ip_local_out+0x114/0x3b0 [ 5671.175001][ C0] __ip_queue_xmit+0x672/0x1910 [ 5671.175264][ C0] ? __skb_clone+0x57a/0x760 [ 5671.175512][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5671.175791][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5671.176086][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5671.176401][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5671.176662][ C0] ? tcp_current_mss+0x40a/0x510 [ 5671.176923][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5671.177205][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5671.177480][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5671.177734][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5671.178002][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5671.178324][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5671.178598][ C0] ? ktime_get+0xb6/0x190 [ 5671.178833][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5671.179109][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5671.179389][ C0] tcp_write_timer+0x82/0x1d0 [ 5671.179645][ C0] call_timer_fn+0x176/0x430 [ 5671.179893][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5671.180165][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5671.180440][ C0] __run_timers.part.0+0x52d/0x890 [ 5671.180710][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5671.180995][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5671.181291][ C0] ? lock_acquire+0x1c1/0x220 [ 5671.181544][ C0] ? clockevents_program_event+0xf6/0x300 [ 5671.181849][ C0] ? lock_release+0x1d5/0x250 [ 5671.182100][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5671.182378][ C0] ? ktime_get+0xb6/0x190 [ 5671.182614][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5671.182913][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5671.183222][ C0] run_timer_softirq+0x72/0x100 [ 5671.183486][ C0] __do_softirq+0x1bc/0x7ff [ 5671.183732][ C0] irq_exit_rcu+0x98/0xc0 [ 5671.183966][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5671.184267][ C0] [ 5671.184422][ C0] [ 5671.184578][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5671.184893][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5671.185164][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5671.186184][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5671.186507][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5671.186933][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5671.187353][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5671.187773][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5671.188196][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5671.188622][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5671.188929][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5671.189203][ C0] default_idle_call+0x69/0xa0 [ 5671.189459][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5671.189720][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5671.190011][ C0] ? lock_release+0x1d5/0x250 [ 5671.190258][ C0] do_idle+0xfb/0x160 [ 5671.190469][ C0] cpu_startup_entry+0x55/0x60 [ 5671.190728][ C0] rest_init+0x153/0x260 [ 5671.190954][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5671.191238][ C0] arch_call_rest_init+0x13/0x40 [ 5671.191503][ C0] start_kernel+0x314/0x3d0 [ 5671.191747][ C0] x86_64_start_reservations+0x18/0x30 [ 5671.192046][ C0] x86_64_start_kernel+0xba/0x110 [ 5671.192313][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5671.192639][ C0] [ 5671.192803][ C0] Sending NMI from CPU 0 to CPUs 1: [ 5671.193095][ C1] NMI backtrace for cpu 1 [ 5671.193103][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5671.193107][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5671.193110][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5671.193120][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5671.193123][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5671.193126][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5671.193128][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5671.193130][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5671.193132][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5671.193134][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5671.193136][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5671.193138][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5671.193142][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5671.193144][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5671.193145][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5671.193147][ C1] Call Trace: [ 5671.193150][ C1] [ 5671.193155][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 5671.193160][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5671.193165][ C1] ? nmi_handle+0x156/0x420 [ 5671.193171][ C1] ? default_do_nmi+0x41/0x100 [ 5671.193174][ C1] ? exc_nmi+0xf3/0x120 [ 5671.193177][ C1] ? end_repeat_nmi+0xf/0x60 [ 5671.193182][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5671.193186][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5671.193189][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5671.193193][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5671.193196][ C1] [ 5671.193197][ C1] [ 5671.193198][ C1] ? run_ksoftirqd+0xb/0x60 [ 5671.193203][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5671.193206][ C1] ? __orc_find+0x9c/0xf0 [ 5671.193209][ C1] ? lock_acquire+0x1c1/0x220 [ 5671.193213][ C1] ? irqentry_enter+0x2b/0x60 [ 5671.193218][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5671.193221][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5671.193224][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5671.193228][ C1] ? lock_acquire+0x1c1/0x220 [ 5671.193230][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5671.193236][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5671.193239][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5671.193247][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5671.193250][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5671.193256][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5671.193263][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5671.193267][ C1] ip_local_deliver+0x19d/0x480 [ 5671.193271][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5671.193273][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5671.193277][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5671.193282][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5671.193285][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5671.193288][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5671.193297][ C1] ip_rcv+0x564/0x740 [ 5671.193301][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5671.193304][ C1] ? set_track_prepare+0x8a/0xd0 [ 5671.193308][ C1] ? irqentry_enter+0x2b/0x60 [ 5671.193312][ C1] ? irqentry_enter+0x2b/0x60 [ 5671.193315][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5671.193318][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5671.193323][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5671.193326][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5671.193329][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5671.193332][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5671.193335][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5671.193340][ C1] netif_receive_skb+0x55/0x280 [ 5671.193344][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5671.193353][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5671.193360][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5671.193367][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5671.193373][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5671.193385][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5671.193395][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5671.193398][ C1] ? arch_stack_walk+0x68/0x100 [ 5671.193403][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5671.193406][ C1] ? irqentry_enter+0x2b/0x60 [ 5671.193410][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5671.193415][ C1] ? irqentry_enter+0x2b/0x60 [ 5671.193418][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5671.193425][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5671.193428][ C1] ? arch_stack_walk+0x68/0x100 [ 5671.193432][ C1] __tcf_classify+0x32c/0x7d0 [ 5671.193437][ C1] tcf_classify+0x283/0x930 [ 5671.193441][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5671.193445][ C1] tc_run+0x2e4/0x5d0 [ 5671.193449][ C1] ? __pfx_tc_run+0x10/0x10 [ 5671.193454][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5671.193460][ C1] ? irqentry_enter+0x2b/0x60 [ 5671.193463][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5671.193466][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5671.193473][ C1] ip_finish_output2+0x786/0x18e0 [ 5671.193479][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5671.193482][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5671.193485][ C1] ? __ip_finish_output+0x10f/0x770 [ 5671.193489][ C1] ip_output+0x16b/0x4f0 [ 5671.193492][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5671.193496][ C1] ? __pfx_ip_output+0x10/0x10 [ 5671.193500][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5671.193507][ C1] ? __pfx_ip_output+0x10/0x10 [ 5671.193512][ C1] __ip_queue_xmit+0x672/0x1910 [ 5671.193517][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5671.193524][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5671.193528][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5671.193532][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5671.193536][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5671.193539][ C1] tcp_delack_timer+0x84/0x240 [ 5671.193542][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5671.193545][ C1] call_timer_fn+0x176/0x430 [ 5671.193550][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5671.193555][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5671.193559][ C1] __run_timers.part.0+0x52d/0x890 [ 5671.193562][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5671.193567][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5671.193572][ C1] ? __pfx___schedule+0x10/0x10 [ 5671.193575][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5671.193580][ C1] run_timer_softirq+0x72/0x100 [ 5671.193584][ C1] __do_softirq+0x1bc/0x7ff [ 5671.193588][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5671.193591][ C1] run_ksoftirqd+0x2e/0x60 [ 5671.193595][ C1] smpboot_thread_fn+0x30e/0x840 [ 5671.193598][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5671.193602][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5671.193605][ C1] kthread+0x292/0x360 [ 5671.193607][ C1] ? __pfx_kthread+0x10/0x10 [ 5671.193610][ C1] ret_from_fork+0x34/0x70 [ 5671.193612][ C1] ? __pfx_kthread+0x10/0x10 [ 5671.193614][ C1] ret_from_fork_asm+0x1b/0x30 [ 5671.193622][ C1] [ 5696.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4199s! [swapper/0:0] [ 5696.527915][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5696.529109][ C0] irq event stamp: 27567077 [ 5696.529354][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5696.529886][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5696.530360][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5696.530865][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5696.531365][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5696.531842][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5696.532489][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5696.532839][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5696.533863][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5696.534188][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5696.534618][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5696.535037][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5696.535455][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5696.535877][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5696.536300][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5696.536769][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5696.537121][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5696.537547][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5696.537963][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5696.538378][ C0] Call Trace: [ 5696.538553][ C0] [ 5696.538711][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5696.538988][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5696.539247][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5696.539536][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5696.539823][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5696.540127][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5696.540409][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5696.540735][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5696.541007][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5696.541289][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5696.541612][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5696.541919][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5696.542255][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5696.542557][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5696.542865][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5696.543171][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5696.543499][ C0] ? get_stack_info+0x36/0xc0 [ 5696.543750][ C0] ? lock_acquire+0x1c1/0x220 [ 5696.543998][ C0] ? lock_release+0x1d5/0x250 [ 5696.544245][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5696.544505][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5696.544789][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5696.545087][ C0] ? lock_acquire+0x1c1/0x220 [ 5696.545338][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5696.545594][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5696.545869][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5696.546113][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5696.546370][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5696.546638][ C0] ? __inet_lookup_established+0x341/0x610 [ 5696.546953][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5696.547247][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5696.547540][ C0] ip_local_deliver+0x19d/0x480 [ 5696.547803][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5696.548089][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5696.548353][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5696.548633][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5696.548903][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5696.549243][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5696.549517][ C0] ip_rcv+0x564/0x740 [ 5696.549729][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5696.549969][ C0] ? set_track_prepare+0x8a/0xd0 [ 5696.550233][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5696.550522][ C0] ? rest_init+0x153/0x260 [ 5696.550756][ C0] ? skb_clone+0x10b/0x330 [ 5696.550999][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5696.551331][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5696.551649][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5696.551947][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5696.552261][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5696.552521][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5696.552766][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5696.553086][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5696.553388][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5696.553726][ C0] ? lock_acquire+0x1c1/0x220 [ 5696.553973][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5696.554283][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5696.554585][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5696.554915][ C0] ? __copy_skb_header+0xaf/0x490 [ 5696.555182][ C0] ? __skb_clone+0x57a/0x760 [ 5696.555425][ C0] netif_receive_skb+0x55/0x280 [ 5696.555685][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5696.556014][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5696.556367][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5696.556677][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5696.556968][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5696.557272][ C0] ? hlock_class+0x4e/0x130 [ 5696.557520][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5696.557855][ C0] ? place_entity+0x21/0x2f0 [ 5696.558106][ C0] ? resched_curr+0x219/0x280 [ 5696.558357][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5696.558624][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5696.558911][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5696.559189][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5696.559447][ C0] ? activate_task+0xf5/0x260 [ 5696.559698][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5696.559973][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5696.560248][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5696.560504][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5696.560791][ C0] ? get_stack_info+0x36/0xc0 [ 5696.561047][ C0] ? stack_access_ok+0xda/0x1f0 [ 5696.561310][ C0] ? get_reg+0x119/0x190 [ 5696.561538][ C0] __tcf_classify+0x32c/0x7d0 [ 5696.561786][ C0] tcf_classify+0x283/0x930 [ 5696.562026][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5696.562353][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5696.562622][ C0] ? arch_stack_walk+0x8c/0x100 [ 5696.562894][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5696.563188][ C0] tc_run+0x2e4/0x5d0 [ 5696.563401][ C0] ? __pfx_tc_run+0x10/0x10 [ 5696.563641][ C0] ? lock_acquire+0x1c1/0x220 [ 5696.563890][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5696.564164][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5696.564434][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5696.564718][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5696.564999][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5696.565318][ C0] ? neigh_hh_output+0x348/0x590 [ 5696.565586][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5696.565862][ C0] ip_finish_output2+0x786/0x18e0 [ 5696.566129][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5696.566421][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5696.566777][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5696.567075][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5696.567339][ C0] ? __ip_finish_output+0x10f/0x770 [ 5696.567620][ C0] ip_output+0x16b/0x4f0 [ 5696.567847][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5696.568127][ C0] ? __pfx_ip_output+0x10/0x10 [ 5696.568383][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5696.568686][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5696.568948][ C0] ? ip_local_out+0x114/0x3b0 [ 5696.569203][ C0] __ip_queue_xmit+0x672/0x1910 [ 5696.569464][ C0] ? __skb_clone+0x57a/0x760 [ 5696.569712][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5696.569992][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5696.570287][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5696.570605][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5696.570865][ C0] ? tcp_current_mss+0x40a/0x510 [ 5696.571128][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5696.571411][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5696.571685][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5696.571938][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5696.572207][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5696.572528][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5696.572804][ C0] ? ktime_get+0xb6/0x190 [ 5696.573035][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5696.573307][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5696.573588][ C0] tcp_write_timer+0x82/0x1d0 [ 5696.573841][ C0] call_timer_fn+0x176/0x430 [ 5696.574085][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5696.574361][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5696.574633][ C0] __run_timers.part.0+0x52d/0x890 [ 5696.574908][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5696.575193][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5696.575493][ C0] ? lock_acquire+0x1c1/0x220 [ 5696.575740][ C0] ? clockevents_program_event+0xf6/0x300 [ 5696.576043][ C0] ? lock_release+0x1d5/0x250 [ 5696.576292][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5696.576567][ C0] ? ktime_get+0xb6/0x190 [ 5696.576797][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5696.577093][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5696.577408][ C0] run_timer_softirq+0x72/0x100 [ 5696.577667][ C0] __do_softirq+0x1bc/0x7ff [ 5696.577908][ C0] irq_exit_rcu+0x98/0xc0 [ 5696.578138][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5696.578440][ C0] [ 5696.578598][ C0] [ 5696.578762][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5696.579084][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5696.579357][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5696.580381][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5696.580708][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5696.581130][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5696.581550][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5696.581973][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5696.582398][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5696.582820][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5696.583126][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5696.583401][ C0] default_idle_call+0x69/0xa0 [ 5696.583651][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5696.583917][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5696.584210][ C0] ? lock_release+0x1d5/0x250 [ 5696.584465][ C0] do_idle+0xfb/0x160 [ 5696.584679][ C0] cpu_startup_entry+0x55/0x60 [ 5696.584933][ C0] rest_init+0x153/0x260 [ 5696.585160][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5696.585450][ C0] arch_call_rest_init+0x13/0x40 [ 5696.585717][ C0] start_kernel+0x314/0x3d0 [ 5696.585957][ C0] x86_64_start_reservations+0x18/0x30 [ 5696.586247][ C0] x86_64_start_kernel+0xba/0x110 [ 5696.586517][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5696.586845][ C0] [ 5696.587012][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4199s! [ksoftirqd/1:22] [ 5696.587482][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5696.588687][ C1] irq event stamp: 3886976 [ 5696.588924][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5696.589429][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5696.589928][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5696.590435][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5696.590927][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5696.591429][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5696.592080][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5696.592423][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5696.593451][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5696.593777][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5696.594207][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5696.594631][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5696.595054][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5696.595473][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5696.595896][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5696.596373][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5696.596720][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5696.597146][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5696.597565][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5696.597981][ C1] Call Trace: [ 5696.598158][ C1] [ 5696.598314][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5696.598593][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5696.598856][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5696.599150][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5696.599441][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5696.599746][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5696.600029][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5696.600355][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5696.600628][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5696.600956][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5696.601269][ C1] [ 5696.601426][ C1] [ 5696.601582][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5696.601909][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5696.602220][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5696.602532][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5696.602834][ C1] ? run_ksoftirqd+0xb/0x60 [ 5696.603076][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5696.603400][ C1] ? __orc_find+0x9c/0xf0 [ 5696.603634][ C1] ? lock_acquire+0x1c1/0x220 [ 5696.603889][ C1] ? irqentry_enter+0x2b/0x60 [ 5696.604145][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5696.604407][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5696.604695][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5696.604995][ C1] ? lock_acquire+0x1c1/0x220 [ 5696.605248][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5696.605500][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5696.605772][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5696.606021][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5696.606284][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5696.606559][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5696.606853][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5696.607148][ C1] ip_local_deliver+0x19d/0x480 [ 5696.607407][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5696.607691][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5696.607955][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5696.608237][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5696.608504][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5696.608847][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5696.609122][ C1] ip_rcv+0x564/0x740 [ 5696.609334][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5696.609574][ C1] ? set_track_prepare+0x8a/0xd0 [ 5696.609839][ C1] ? irqentry_enter+0x2b/0x60 [ 5696.610094][ C1] ? irqentry_enter+0x2b/0x60 [ 5696.610350][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5696.610594][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5696.610916][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5696.611260][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5696.611573][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5696.611912][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5696.612212][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5696.612550][ C1] netif_receive_skb+0x55/0x280 [ 5696.612812][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5696.613146][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5696.613497][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5696.613809][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5696.614108][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5696.614414][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5696.614749][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5696.615034][ C1] ? arch_stack_walk+0x68/0x100 [ 5696.615295][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5696.615573][ C1] ? irqentry_enter+0x2b/0x60 [ 5696.615824][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5696.616144][ C1] ? irqentry_enter+0x2b/0x60 [ 5696.616397][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5696.616724][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5696.617006][ C1] ? arch_stack_walk+0x68/0x100 [ 5696.617273][ C1] __tcf_classify+0x32c/0x7d0 [ 5696.617528][ C1] tcf_classify+0x283/0x930 [ 5696.617776][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5696.618050][ C1] tc_run+0x2e4/0x5d0 [ 5696.618269][ C1] ? __pfx_tc_run+0x10/0x10 [ 5696.618517][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5696.618792][ C1] ? irqentry_enter+0x2b/0x60 [ 5696.619048][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5696.619338][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5696.619663][ C1] ip_finish_output2+0x786/0x18e0 [ 5696.619933][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5696.620226][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5696.620493][ C1] ? __ip_finish_output+0x10f/0x770 [ 5696.620770][ C1] ip_output+0x16b/0x4f0 [ 5696.620996][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5696.621319][ C1] ? __pfx_ip_output+0x10/0x10 [ 5696.621576][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5696.621936][ C1] ? __pfx_ip_output+0x10/0x10 [ 5696.622196][ C1] __ip_queue_xmit+0x672/0x1910 [ 5696.622458][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5696.622739][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5696.623036][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5696.623321][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5696.623615][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5696.623898][ C1] tcp_delack_timer+0x84/0x240 [ 5696.624157][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5696.624447][ C1] call_timer_fn+0x176/0x430 [ 5696.624699][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5696.624973][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5696.625255][ C1] __run_timers.part.0+0x52d/0x890 [ 5696.625531][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5696.625816][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5696.626119][ C1] ? __pfx___schedule+0x10/0x10 [ 5696.626384][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5696.626710][ C1] run_timer_softirq+0x72/0x100 [ 5696.626971][ C1] __do_softirq+0x1bc/0x7ff [ 5696.627216][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5696.627489][ C1] run_ksoftirqd+0x2e/0x60 [ 5696.627731][ C1] smpboot_thread_fn+0x30e/0x840 [ 5696.627996][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5696.628290][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5696.628579][ C1] kthread+0x292/0x360 [ 5696.628810][ C1] ? __pfx_kthread+0x10/0x10 [ 5696.629061][ C1] ret_from_fork+0x34/0x70 [ 5696.629305][ C1] ? __pfx_kthread+0x10/0x10 [ 5696.629553][ C1] ret_from_fork_asm+0x1b/0x30 [ 5696.629811][ C1] [ 5724.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4225s! [swapper/0:0] [ 5724.527921][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5724.529123][ C0] irq event stamp: 27567077 [ 5724.529370][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5724.529903][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5724.530374][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5724.530876][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5724.531376][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5724.531865][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5724.532514][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5724.532857][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5724.533874][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5724.534195][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5724.534615][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5724.535032][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5724.535448][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5724.535864][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5724.536283][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5724.536751][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5724.537104][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5724.537529][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5724.537953][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5724.538372][ C0] Call Trace: [ 5724.538554][ C0] [ 5724.538711][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5724.538990][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5724.539246][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5724.539542][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5724.539832][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5724.540133][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5724.540411][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5724.540733][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5724.541007][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5724.541282][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5724.541612][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5724.541924][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5724.542258][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5724.542563][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5724.542877][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5724.543178][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5724.543503][ C0] ? get_stack_info+0x36/0xc0 [ 5724.543760][ C0] ? lock_acquire+0x1c1/0x220 [ 5724.544014][ C0] ? lock_release+0x1d5/0x250 [ 5724.544267][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5724.544530][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5724.544819][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5724.545122][ C0] ? lock_acquire+0x1c1/0x220 [ 5724.545375][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5724.545629][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5724.545902][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5724.546152][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5724.546414][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5724.546688][ C0] ? __inet_lookup_established+0x341/0x610 [ 5724.547009][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5724.547298][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5724.547588][ C0] ip_local_deliver+0x19d/0x480 [ 5724.547858][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5724.548149][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5724.548417][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5724.548699][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5724.548969][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5724.549306][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5724.549590][ C0] ip_rcv+0x564/0x740 [ 5724.549804][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5724.550050][ C0] ? set_track_prepare+0x8a/0xd0 [ 5724.550320][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5724.550606][ C0] ? rest_init+0x153/0x260 [ 5724.550845][ C0] ? skb_clone+0x10b/0x330 [ 5724.551086][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5724.551422][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5724.551744][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5724.552036][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5724.552348][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5724.552610][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5724.552850][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5724.553161][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5724.553459][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5724.553801][ C0] ? lock_acquire+0x1c1/0x220 [ 5724.554053][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5724.554365][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5724.554663][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5724.554997][ C0] ? __copy_skb_header+0xaf/0x490 [ 5724.555267][ C0] ? __skb_clone+0x57a/0x760 [ 5724.555518][ C0] netif_receive_skb+0x55/0x280 [ 5724.555775][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5724.556101][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5724.556449][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5724.556765][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5724.557054][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5724.557353][ C0] ? hlock_class+0x4e/0x130 [ 5724.557597][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5724.557926][ C0] ? place_entity+0x21/0x2f0 [ 5724.558178][ C0] ? resched_curr+0x219/0x280 [ 5724.558433][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5724.558706][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5724.558989][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5724.559271][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5724.559535][ C0] ? activate_task+0xf5/0x260 [ 5724.559791][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5724.560070][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5724.560341][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5724.560602][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5724.560894][ C0] ? get_stack_info+0x36/0xc0 [ 5724.561143][ C0] ? stack_access_ok+0xda/0x1f0 [ 5724.561401][ C0] ? get_reg+0x119/0x190 [ 5724.561627][ C0] __tcf_classify+0x32c/0x7d0 [ 5724.561880][ C0] tcf_classify+0x283/0x930 [ 5724.562126][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5724.562459][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5724.562725][ C0] ? arch_stack_walk+0x8c/0x100 [ 5724.562984][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5724.563276][ C0] tc_run+0x2e4/0x5d0 [ 5724.563494][ C0] ? __pfx_tc_run+0x10/0x10 [ 5724.563740][ C0] ? lock_acquire+0x1c1/0x220 [ 5724.563996][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5724.564273][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5724.564542][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5724.564832][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5724.565114][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5724.565437][ C0] ? neigh_hh_output+0x348/0x590 [ 5724.565700][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5724.565980][ C0] ip_finish_output2+0x786/0x18e0 [ 5724.566254][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5724.566549][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5724.566901][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5724.567189][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5724.567458][ C0] ? __ip_finish_output+0x10f/0x770 [ 5724.567736][ C0] ip_output+0x16b/0x4f0 [ 5724.567968][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5724.568252][ C0] ? __pfx_ip_output+0x10/0x10 [ 5724.568504][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5724.568808][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5724.569076][ C0] ? ip_local_out+0x114/0x3b0 [ 5724.569326][ C0] __ip_queue_xmit+0x672/0x1910 [ 5724.569585][ C0] ? __skb_clone+0x57a/0x760 [ 5724.569829][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5724.570115][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5724.570412][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5724.570737][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5724.570993][ C0] ? tcp_current_mss+0x40a/0x510 [ 5724.571258][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5724.571536][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5724.571814][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5724.572071][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5724.572337][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5724.572650][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5724.572929][ C0] ? ktime_get+0xb6/0x190 [ 5724.573162][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5724.573438][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5724.573716][ C0] tcp_write_timer+0x82/0x1d0 [ 5724.573973][ C0] call_timer_fn+0x176/0x430 [ 5724.574221][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5724.574493][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5724.574770][ C0] __run_timers.part.0+0x52d/0x890 [ 5724.575041][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5724.575325][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5724.575620][ C0] ? lock_acquire+0x1c1/0x220 [ 5724.575870][ C0] ? clockevents_program_event+0xf6/0x300 [ 5724.576175][ C0] ? lock_release+0x1d5/0x250 [ 5724.576429][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5724.576707][ C0] ? ktime_get+0xb6/0x190 [ 5724.576939][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5724.577238][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5724.577546][ C0] run_timer_softirq+0x72/0x100 [ 5724.577808][ C0] __do_softirq+0x1bc/0x7ff [ 5724.578055][ C0] irq_exit_rcu+0x98/0xc0 [ 5724.578286][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5724.578595][ C0] [ 5724.578759][ C0] [ 5724.578917][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5724.579237][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5724.579503][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5724.580512][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5724.580833][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5724.581251][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5724.581668][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5724.582084][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5724.582506][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5724.582924][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5724.583225][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5724.583495][ C0] default_idle_call+0x69/0xa0 [ 5724.583749][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5724.584012][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5724.584308][ C0] ? lock_release+0x1d5/0x250 [ 5724.584558][ C0] do_idle+0xfb/0x160 [ 5724.584771][ C0] cpu_startup_entry+0x55/0x60 [ 5724.585025][ C0] rest_init+0x153/0x260 [ 5724.585250][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5724.585537][ C0] arch_call_rest_init+0x13/0x40 [ 5724.585802][ C0] start_kernel+0x314/0x3d0 [ 5724.586049][ C0] x86_64_start_reservations+0x18/0x30 [ 5724.586342][ C0] x86_64_start_kernel+0xba/0x110 [ 5724.586609][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5724.586930][ C0] [ 5724.587095][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4225s! [ksoftirqd/1:22] [ 5724.587567][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5724.588772][ C1] irq event stamp: 3886976 [ 5724.589007][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5724.589509][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5724.590006][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5724.590512][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5724.591001][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5724.591500][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5724.592150][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5724.592495][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5724.593524][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5724.593851][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5724.594277][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5724.594703][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5724.595129][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5724.595550][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5724.595971][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5724.596446][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5724.596794][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5724.597218][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5724.597636][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5724.598055][ C1] Call Trace: [ 5724.598234][ C1] [ 5724.598390][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5724.598670][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5724.598926][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5724.599216][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5724.599504][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5724.599810][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5724.600095][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5724.600415][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5724.600689][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5724.601018][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5724.601329][ C1] [ 5724.601486][ C1] [ 5724.601643][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5724.601974][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5724.602281][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5724.602595][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5724.602896][ C1] ? run_ksoftirqd+0xb/0x60 [ 5724.603138][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5724.603464][ C1] ? __orc_find+0x9c/0xf0 [ 5724.603696][ C1] ? lock_acquire+0x1c1/0x220 [ 5724.603953][ C1] ? irqentry_enter+0x2b/0x60 [ 5724.604210][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5724.604473][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5724.604760][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5724.605060][ C1] ? lock_acquire+0x1c1/0x220 [ 5724.605307][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5724.605556][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5724.605827][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5724.606078][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5724.606340][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5724.606616][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5724.606909][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5724.607206][ C1] ip_local_deliver+0x19d/0x480 [ 5724.607464][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5724.607749][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5724.608011][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5724.608292][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5724.608562][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5724.608900][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5724.609173][ C1] ip_rcv+0x564/0x740 [ 5724.609384][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5724.609629][ C1] ? set_track_prepare+0x8a/0xd0 [ 5724.609892][ C1] ? irqentry_enter+0x2b/0x60 [ 5724.610149][ C1] ? irqentry_enter+0x2b/0x60 [ 5724.610402][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5724.610651][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5724.610969][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5724.611316][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5724.611627][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5724.611965][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5724.612265][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5724.612601][ C1] netif_receive_skb+0x55/0x280 [ 5724.612864][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5724.613201][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5724.613552][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5724.613866][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5724.614159][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5724.614469][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5724.614800][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5724.615086][ C1] ? arch_stack_walk+0x68/0x100 [ 5724.615346][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5724.615622][ C1] ? irqentry_enter+0x2b/0x60 [ 5724.615869][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5724.616190][ C1] ? irqentry_enter+0x2b/0x60 [ 5724.616443][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5724.616771][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5724.617053][ C1] ? arch_stack_walk+0x68/0x100 [ 5724.617327][ C1] __tcf_classify+0x32c/0x7d0 [ 5724.617583][ C1] tcf_classify+0x283/0x930 [ 5724.617828][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5724.618103][ C1] tc_run+0x2e4/0x5d0 [ 5724.618318][ C1] ? __pfx_tc_run+0x10/0x10 [ 5724.618570][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5724.618837][ C1] ? irqentry_enter+0x2b/0x60 [ 5724.619090][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5724.619376][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5724.619704][ C1] ip_finish_output2+0x786/0x18e0 [ 5724.619973][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5724.620262][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5724.620532][ C1] ? __ip_finish_output+0x10f/0x770 [ 5724.620810][ C1] ip_output+0x16b/0x4f0 [ 5724.621041][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5724.621363][ C1] ? __pfx_ip_output+0x10/0x10 [ 5724.621625][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5724.621982][ C1] ? __pfx_ip_output+0x10/0x10 [ 5724.622244][ C1] __ip_queue_xmit+0x672/0x1910 [ 5724.622506][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5724.622787][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5724.623083][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5724.623369][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5724.623664][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5724.623947][ C1] tcp_delack_timer+0x84/0x240 [ 5724.624206][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5724.624493][ C1] call_timer_fn+0x176/0x430 [ 5724.624744][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5724.625018][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5724.625300][ C1] __run_timers.part.0+0x52d/0x890 [ 5724.625576][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5724.625862][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5724.626162][ C1] ? __pfx___schedule+0x10/0x10 [ 5724.626427][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5724.626746][ C1] run_timer_softirq+0x72/0x100 [ 5724.627006][ C1] __do_softirq+0x1bc/0x7ff [ 5724.627247][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5724.627518][ C1] run_ksoftirqd+0x2e/0x60 [ 5724.627759][ C1] smpboot_thread_fn+0x30e/0x840 [ 5724.628024][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5724.628317][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5724.628612][ C1] kthread+0x292/0x360 [ 5724.628829][ C1] ? __pfx_kthread+0x10/0x10 [ 5724.629078][ C1] ret_from_fork+0x34/0x70 [ 5724.629314][ C1] ? __pfx_kthread+0x10/0x10 [ 5724.629562][ C1] ret_from_fork_asm+0x1b/0x30 [ 5724.629821][ C1] [ 5749.197024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5749.197402][ C1] rcu: 1-....: (4541874 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1081764 [ 5749.197996][ C1] rcu: (t=4554888 jiffies g=1007429 q=31 ncpus=4) [ 5749.198351][ C1] Sending NMI from CPU 1 to CPUs 0: [ 5749.198653][ C0] NMI backtrace for cpu 0 [ 5749.198662][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5749.198667][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5749.198670][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5749.198680][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5749.198683][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5749.198687][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5749.198689][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5749.198691][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5749.198693][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5749.198695][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5749.198696][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5749.198698][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5749.198702][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5749.198704][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5749.198706][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5749.198707][ C0] Call Trace: [ 5749.198711][ C0] [ 5749.198714][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 5749.198720][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5749.198725][ C0] ? nmi_handle+0x156/0x420 [ 5749.198731][ C0] ? default_do_nmi+0x41/0x100 [ 5749.198735][ C0] ? exc_nmi+0xf3/0x120 [ 5749.198738][ C0] ? end_repeat_nmi+0xf/0x60 [ 5749.198743][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5749.198746][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5749.198750][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5749.198753][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5749.198757][ C0] [ 5749.198758][ C0] [ 5749.198759][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5749.198762][ C0] ? get_stack_info+0x36/0xc0 [ 5749.198767][ C0] ? lock_acquire+0x1c1/0x220 [ 5749.198771][ C0] ? lock_release+0x1d5/0x250 [ 5749.198775][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5749.198779][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5749.198781][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5749.198785][ C0] ? lock_acquire+0x1c1/0x220 [ 5749.198787][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5749.198793][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5749.198796][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5749.198803][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5749.198806][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5749.198810][ C0] ? __inet_lookup_established+0x341/0x610 [ 5749.198817][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5749.198825][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5749.198829][ C0] ip_local_deliver+0x19d/0x480 [ 5749.198832][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5749.198834][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5749.198840][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5749.198844][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5749.198847][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5749.198851][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5749.198861][ C0] ip_rcv+0x564/0x740 [ 5749.198865][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5749.198868][ C0] ? set_track_prepare+0x8a/0xd0 [ 5749.198872][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5749.198875][ C0] ? rest_init+0x153/0x260 [ 5749.198878][ C0] ? skb_clone+0x10b/0x330 [ 5749.198883][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5749.198890][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5749.198895][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5749.198901][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5749.198910][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5749.198914][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5749.198917][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5749.198921][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5749.198925][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5749.198928][ C0] ? lock_acquire+0x1c1/0x220 [ 5749.198930][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5749.198934][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5749.198937][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5749.198940][ C0] ? __copy_skb_header+0xaf/0x490 [ 5749.198943][ C0] ? __skb_clone+0x57a/0x760 [ 5749.198945][ C0] netif_receive_skb+0x55/0x280 [ 5749.198948][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5749.198956][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5749.198963][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5749.198969][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5749.198974][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5749.198983][ C0] ? hlock_class+0x4e/0x130 [ 5749.198991][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5749.199001][ C0] ? place_entity+0x21/0x2f0 [ 5749.199004][ C0] ? resched_curr+0x219/0x280 [ 5749.199008][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5749.199011][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5749.199014][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5749.199019][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5749.199023][ C0] ? activate_task+0xf5/0x260 [ 5749.199026][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5749.199031][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5749.199035][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5749.199038][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5749.199042][ C0] ? get_stack_info+0x36/0xc0 [ 5749.199045][ C0] ? stack_access_ok+0xda/0x1f0 [ 5749.199047][ C0] ? get_reg+0x119/0x190 [ 5749.199051][ C0] __tcf_classify+0x32c/0x7d0 [ 5749.199056][ C0] tcf_classify+0x283/0x930 [ 5749.199059][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5749.199063][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5749.199066][ C0] ? arch_stack_walk+0x8c/0x100 [ 5749.199070][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5749.199073][ C0] tc_run+0x2e4/0x5d0 [ 5749.199077][ C0] ? __pfx_tc_run+0x10/0x10 [ 5749.199081][ C0] ? lock_acquire+0x1c1/0x220 [ 5749.199083][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5749.199088][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5749.199094][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5749.199097][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5749.199100][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5749.199105][ C0] ? neigh_hh_output+0x348/0x590 [ 5749.199110][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5749.199114][ C0] ip_finish_output2+0x786/0x18e0 [ 5749.199117][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5749.199123][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5749.199131][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5749.199134][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5749.199138][ C0] ? __ip_finish_output+0x10f/0x770 [ 5749.199142][ C0] ip_output+0x16b/0x4f0 [ 5749.199145][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5749.199150][ C0] ? __pfx_ip_output+0x10/0x10 [ 5749.199154][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5749.199158][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5749.199161][ C0] ? ip_local_out+0x114/0x3b0 [ 5749.199165][ C0] __ip_queue_xmit+0x672/0x1910 [ 5749.199169][ C0] ? __skb_clone+0x57a/0x760 [ 5749.199172][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5749.199179][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5749.199183][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5749.199187][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5749.199192][ C0] ? tcp_current_mss+0x40a/0x510 [ 5749.199195][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5749.199198][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5749.199201][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5749.199203][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5749.199206][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5749.199210][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5749.199214][ C0] ? ktime_get+0xb6/0x190 [ 5749.199219][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5749.199223][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5749.199226][ C0] tcp_write_timer+0x82/0x1d0 [ 5749.199230][ C0] call_timer_fn+0x176/0x430 [ 5749.199234][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5749.199238][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5749.199243][ C0] __run_timers.part.0+0x52d/0x890 [ 5749.199246][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5749.199250][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5749.199253][ C0] ? lock_acquire+0x1c1/0x220 [ 5749.199256][ C0] ? clockevents_program_event+0xf6/0x300 [ 5749.199262][ C0] ? lock_release+0x1d5/0x250 [ 5749.199264][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5749.199267][ C0] ? ktime_get+0xb6/0x190 [ 5749.199270][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5749.199274][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5749.199278][ C0] run_timer_softirq+0x72/0x100 [ 5749.199282][ C0] __do_softirq+0x1bc/0x7ff [ 5749.199287][ C0] irq_exit_rcu+0x98/0xc0 [ 5749.199290][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5749.199294][ C0] [ 5749.199295][ C0] [ 5749.199296][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5749.199302][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5749.199305][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5749.199307][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5749.199309][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5749.199311][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5749.199312][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5749.199314][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5749.199315][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5749.199319][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5749.199322][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5749.199326][ C0] default_idle_call+0x69/0xa0 [ 5749.199328][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5749.199331][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5749.199336][ C0] ? lock_release+0x1d5/0x250 [ 5749.199340][ C0] do_idle+0xfb/0x160 [ 5749.199343][ C0] cpu_startup_entry+0x55/0x60 [ 5749.199345][ C0] rest_init+0x153/0x260 [ 5749.199348][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5749.199354][ C0] arch_call_rest_init+0x13/0x40 [ 5749.199359][ C0] start_kernel+0x314/0x3d0 [ 5749.199363][ C0] x86_64_start_reservations+0x18/0x30 [ 5749.199368][ C0] x86_64_start_kernel+0xba/0x110 [ 5749.199371][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5749.199379][ C0] [ 5749.199642][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5749.253764][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5749.254418][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5749.254766][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5749.255794][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5749.256122][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5749.256543][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5749.256968][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5749.257397][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5749.257819][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5749.258241][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5749.258719][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5749.259072][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5749.259490][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5749.259911][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5749.260338][ C1] Call Trace: [ 5749.260523][ C1] [ 5749.260679][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5749.260966][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5749.261237][ C1] ? check_cpu_stall+0x284/0x500 [ 5749.261499][ C1] ? rcu_pending+0x92/0x360 [ 5749.261743][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5749.262029][ C1] ? update_process_times+0xb9/0x110 [ 5749.262313][ C1] ? tick_sched_handle+0x67/0x130 [ 5749.262585][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5749.262886][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5749.263143][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5749.263474][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5749.263760][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5749.264063][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5749.264340][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5749.264662][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5749.264940][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5749.265265][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5749.265574][ C1] [ 5749.265735][ C1] [ 5749.265895][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5749.266231][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5749.266532][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5749.266840][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5749.267145][ C1] ? run_ksoftirqd+0xb/0x60 [ 5749.267394][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5749.267725][ C1] ? __orc_find+0x9c/0xf0 [ 5749.267955][ C1] ? lock_acquire+0x1c1/0x220 [ 5749.268208][ C1] ? irqentry_enter+0x2b/0x60 [ 5749.268466][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5749.268729][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5749.269015][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5749.269315][ C1] ? lock_acquire+0x1c1/0x220 [ 5749.269562][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5749.269811][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5749.270083][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5749.270333][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5749.270595][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5749.270869][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5749.271163][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5749.271459][ C1] ip_local_deliver+0x19d/0x480 [ 5749.271718][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5749.272003][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5749.272268][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5749.272548][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5749.272813][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5749.273148][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5749.273427][ C1] ip_rcv+0x564/0x740 [ 5749.273641][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5749.273886][ C1] ? set_track_prepare+0x8a/0xd0 [ 5749.274152][ C1] ? irqentry_enter+0x2b/0x60 [ 5749.274400][ C1] ? irqentry_enter+0x2b/0x60 [ 5749.274648][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5749.274887][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5749.275204][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5749.275543][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5749.275850][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5749.276194][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5749.276497][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5749.276829][ C1] netif_receive_skb+0x55/0x280 [ 5749.277090][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5749.277417][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5749.277763][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5749.278082][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5749.278371][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5749.278688][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5749.279018][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5749.279302][ C1] ? arch_stack_walk+0x68/0x100 [ 5749.279562][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5749.279837][ C1] ? irqentry_enter+0x2b/0x60 [ 5749.280086][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5749.280403][ C1] ? irqentry_enter+0x2b/0x60 [ 5749.280657][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5749.280984][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5749.281265][ C1] ? arch_stack_walk+0x68/0x100 [ 5749.281532][ C1] __tcf_classify+0x32c/0x7d0 [ 5749.281790][ C1] tcf_classify+0x283/0x930 [ 5749.282037][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5749.282312][ C1] tc_run+0x2e4/0x5d0 [ 5749.282527][ C1] ? __pfx_tc_run+0x10/0x10 [ 5749.282774][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5749.283042][ C1] ? irqentry_enter+0x2b/0x60 [ 5749.283290][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5749.283572][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5749.283891][ C1] ip_finish_output2+0x786/0x18e0 [ 5749.284165][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5749.284460][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5749.284724][ C1] ? __ip_finish_output+0x10f/0x770 [ 5749.285006][ C1] ip_output+0x16b/0x4f0 [ 5749.285236][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5749.285551][ C1] ? __pfx_ip_output+0x10/0x10 [ 5749.285809][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5749.286163][ C1] ? __pfx_ip_output+0x10/0x10 [ 5749.286420][ C1] __ip_queue_xmit+0x672/0x1910 [ 5749.286685][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5749.286969][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5749.287269][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5749.287557][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5749.287854][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5749.288142][ C1] tcp_delack_timer+0x84/0x240 [ 5749.288399][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5749.288690][ C1] call_timer_fn+0x176/0x430 [ 5749.288938][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5749.289216][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5749.289495][ C1] __run_timers.part.0+0x52d/0x890 [ 5749.289771][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5749.290056][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5749.290354][ C1] ? __pfx___schedule+0x10/0x10 [ 5749.290620][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5749.290943][ C1] run_timer_softirq+0x72/0x100 [ 5749.291203][ C1] __do_softirq+0x1bc/0x7ff [ 5749.291444][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5749.291717][ C1] run_ksoftirqd+0x2e/0x60 [ 5749.291958][ C1] smpboot_thread_fn+0x30e/0x840 [ 5749.292223][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5749.292516][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5749.292803][ C1] kthread+0x292/0x360 [ 5749.293024][ C1] ? __pfx_kthread+0x10/0x10 [ 5749.293270][ C1] ret_from_fork+0x34/0x70 [ 5749.293511][ C1] ? __pfx_kthread+0x10/0x10 [ 5749.293755][ C1] ret_from_fork_asm+0x1b/0x30 [ 5749.294017][ C1] [ 5776.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4273s! [swapper/0:0] [ 5776.527922][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5776.529127][ C0] irq event stamp: 27567077 [ 5776.529371][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5776.529912][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5776.530383][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5776.530885][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5776.531380][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5776.531860][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5776.532510][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5776.532855][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5776.533880][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5776.534212][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5776.534634][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5776.535059][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5776.535484][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5776.535904][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5776.536326][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5776.536801][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5776.537149][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5776.537573][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5776.537992][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5776.538415][ C0] Call Trace: [ 5776.538601][ C0] [ 5776.538759][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5776.539033][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5776.539289][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5776.539578][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5776.539867][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5776.540175][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5776.540457][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5776.540779][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5776.541052][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5776.541331][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5776.541652][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5776.541962][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5776.542296][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5776.542598][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5776.542907][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5776.543213][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5776.543542][ C0] ? get_stack_info+0x36/0xc0 [ 5776.543797][ C0] ? lock_acquire+0x1c1/0x220 [ 5776.544050][ C0] ? lock_release+0x1d5/0x250 [ 5776.544301][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5776.544560][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5776.544843][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5776.545140][ C0] ? lock_acquire+0x1c1/0x220 [ 5776.545393][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5776.545651][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5776.545927][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5776.546172][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5776.546430][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5776.546698][ C0] ? __inet_lookup_established+0x341/0x610 [ 5776.547012][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5776.547305][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5776.547597][ C0] ip_local_deliver+0x19d/0x480 [ 5776.547853][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5776.548136][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5776.548405][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5776.548682][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5776.548944][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5776.549283][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5776.549557][ C0] ip_rcv+0x564/0x740 [ 5776.549770][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5776.550010][ C0] ? set_track_prepare+0x8a/0xd0 [ 5776.550277][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5776.550568][ C0] ? rest_init+0x153/0x260 [ 5776.550804][ C0] ? skb_clone+0x10b/0x330 [ 5776.551048][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5776.551381][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5776.551702][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5776.552002][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5776.552313][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5776.552581][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5776.552827][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5776.553145][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5776.553445][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5776.553785][ C0] ? lock_acquire+0x1c1/0x220 [ 5776.554035][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5776.554344][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5776.554644][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5776.554972][ C0] ? __copy_skb_header+0xaf/0x490 [ 5776.555240][ C0] ? __skb_clone+0x57a/0x760 [ 5776.555488][ C0] netif_receive_skb+0x55/0x280 [ 5776.555751][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5776.556086][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5776.556436][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5776.556749][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5776.557041][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5776.557348][ C0] ? hlock_class+0x4e/0x130 [ 5776.557597][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5776.557934][ C0] ? place_entity+0x21/0x2f0 [ 5776.558185][ C0] ? resched_curr+0x219/0x280 [ 5776.558442][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5776.558713][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5776.558998][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5776.559275][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5776.559531][ C0] ? activate_task+0xf5/0x260 [ 5776.559780][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5776.560054][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5776.560330][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5776.560589][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5776.560880][ C0] ? get_stack_info+0x36/0xc0 [ 5776.561135][ C0] ? stack_access_ok+0xda/0x1f0 [ 5776.561394][ C0] ? get_reg+0x119/0x190 [ 5776.561626][ C0] __tcf_classify+0x32c/0x7d0 [ 5776.561878][ C0] tcf_classify+0x283/0x930 [ 5776.562125][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5776.562453][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5776.562725][ C0] ? arch_stack_walk+0x8c/0x100 [ 5776.562988][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5776.563281][ C0] tc_run+0x2e4/0x5d0 [ 5776.563497][ C0] ? __pfx_tc_run+0x10/0x10 [ 5776.563738][ C0] ? lock_acquire+0x1c1/0x220 [ 5776.563986][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5776.564258][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5776.564525][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5776.564812][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5776.565090][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5776.565412][ C0] ? neigh_hh_output+0x348/0x590 [ 5776.565680][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5776.565957][ C0] ip_finish_output2+0x786/0x18e0 [ 5776.566225][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5776.566517][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5776.566874][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5776.567166][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5776.567430][ C0] ? __ip_finish_output+0x10f/0x770 [ 5776.567710][ C0] ip_output+0x16b/0x4f0 [ 5776.567941][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5776.568225][ C0] ? __pfx_ip_output+0x10/0x10 [ 5776.568488][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5776.568796][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5776.569058][ C0] ? ip_local_out+0x114/0x3b0 [ 5776.569314][ C0] __ip_queue_xmit+0x672/0x1910 [ 5776.569580][ C0] ? __skb_clone+0x57a/0x760 [ 5776.569831][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5776.570110][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5776.570404][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5776.570720][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5776.570977][ C0] ? tcp_current_mss+0x40a/0x510 [ 5776.571241][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5776.571524][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5776.571798][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5776.572051][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5776.572323][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5776.572648][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5776.572923][ C0] ? ktime_get+0xb6/0x190 [ 5776.573155][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5776.573427][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5776.573712][ C0] tcp_write_timer+0x82/0x1d0 [ 5776.573963][ C0] call_timer_fn+0x176/0x430 [ 5776.574210][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5776.574489][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5776.574764][ C0] __run_timers.part.0+0x52d/0x890 [ 5776.575042][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5776.575322][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5776.575623][ C0] ? lock_acquire+0x1c1/0x220 [ 5776.575872][ C0] ? clockevents_program_event+0xf6/0x300 [ 5776.576178][ C0] ? lock_release+0x1d5/0x250 [ 5776.576430][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5776.576709][ C0] ? ktime_get+0xb6/0x190 [ 5776.576939][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5776.577238][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5776.577551][ C0] run_timer_softirq+0x72/0x100 [ 5776.577810][ C0] __do_softirq+0x1bc/0x7ff [ 5776.578052][ C0] irq_exit_rcu+0x98/0xc0 [ 5776.578285][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5776.578586][ C0] [ 5776.578742][ C0] [ 5776.578897][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5776.579215][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5776.579488][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5776.580518][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5776.580844][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5776.581268][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5776.581694][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5776.582114][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5776.582536][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5776.582962][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5776.583270][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5776.583545][ C0] default_idle_call+0x69/0xa0 [ 5776.583800][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5776.584065][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5776.584355][ C0] ? lock_release+0x1d5/0x250 [ 5776.584607][ C0] do_idle+0xfb/0x160 [ 5776.584824][ C0] cpu_startup_entry+0x55/0x60 [ 5776.585083][ C0] rest_init+0x153/0x260 [ 5776.585308][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5776.585597][ C0] arch_call_rest_init+0x13/0x40 [ 5776.585866][ C0] start_kernel+0x314/0x3d0 [ 5776.586107][ C0] x86_64_start_reservations+0x18/0x30 [ 5776.586395][ C0] x86_64_start_kernel+0xba/0x110 [ 5776.586667][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5776.587001][ C0] [ 5776.587169][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4273s! [ksoftirqd/1:22] [ 5776.587636][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5776.588839][ C1] irq event stamp: 3886976 [ 5776.589079][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5776.589575][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5776.590070][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5776.590575][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5776.591068][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5776.591564][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5776.592207][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5776.592546][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5776.593562][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5776.593882][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5776.594302][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5776.594721][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5776.595141][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5776.595558][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5776.595978][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5776.596449][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5776.596803][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5776.597228][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5776.597656][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5776.598078][ C1] Call Trace: [ 5776.598257][ C1] [ 5776.598422][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5776.598701][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5776.598957][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5776.599252][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5776.599537][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5776.599839][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5776.600119][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5776.600441][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5776.600718][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5776.601041][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5776.601351][ C1] [ 5776.601510][ C1] [ 5776.601671][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5776.602003][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5776.602306][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5776.602613][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5776.602919][ C1] ? run_ksoftirqd+0xb/0x60 [ 5776.603166][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5776.603494][ C1] ? __orc_find+0x9c/0xf0 [ 5776.603723][ C1] ? lock_acquire+0x1c1/0x220 [ 5776.603972][ C1] ? irqentry_enter+0x2b/0x60 [ 5776.604223][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5776.604480][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5776.604762][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5776.605061][ C1] ? lock_acquire+0x1c1/0x220 [ 5776.605321][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5776.605579][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5776.605853][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5776.606097][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5776.606354][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5776.606623][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5776.606912][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5776.607204][ C1] ip_local_deliver+0x19d/0x480 [ 5776.607464][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5776.607750][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5776.608018][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5776.608300][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5776.608574][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5776.608913][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5776.609191][ C1] ip_rcv+0x564/0x740 [ 5776.609412][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5776.609657][ C1] ? set_track_prepare+0x8a/0xd0 [ 5776.609926][ C1] ? irqentry_enter+0x2b/0x60 [ 5776.610178][ C1] ? irqentry_enter+0x2b/0x60 [ 5776.610430][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5776.610670][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5776.610982][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5776.611323][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5776.611632][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5776.611977][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5776.612280][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5776.612612][ C1] netif_receive_skb+0x55/0x280 [ 5776.612869][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5776.613196][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5776.613548][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5776.613865][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5776.614155][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5776.614458][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5776.614787][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5776.615070][ C1] ? arch_stack_walk+0x68/0x100 [ 5776.615334][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5776.615614][ C1] ? irqentry_enter+0x2b/0x60 [ 5776.615870][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5776.616191][ C1] ? irqentry_enter+0x2b/0x60 [ 5776.616439][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5776.616758][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5776.617042][ C1] ? arch_stack_walk+0x68/0x100 [ 5776.617302][ C1] __tcf_classify+0x32c/0x7d0 [ 5776.617553][ C1] tcf_classify+0x283/0x930 [ 5776.617794][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5776.618063][ C1] tc_run+0x2e4/0x5d0 [ 5776.618277][ C1] ? __pfx_tc_run+0x10/0x10 [ 5776.618532][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5776.618801][ C1] ? irqentry_enter+0x2b/0x60 [ 5776.619052][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5776.619338][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5776.619657][ C1] ip_finish_output2+0x786/0x18e0 [ 5776.619932][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5776.620226][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5776.620490][ C1] ? __ip_finish_output+0x10f/0x770 [ 5776.620771][ C1] ip_output+0x16b/0x4f0 [ 5776.621000][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5776.621317][ C1] ? __pfx_ip_output+0x10/0x10 [ 5776.621575][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5776.621926][ C1] ? __pfx_ip_output+0x10/0x10 [ 5776.622184][ C1] __ip_queue_xmit+0x672/0x1910 [ 5776.622447][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5776.622730][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5776.623028][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5776.623316][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5776.623614][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5776.623904][ C1] tcp_delack_timer+0x84/0x240 [ 5776.624165][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5776.624455][ C1] call_timer_fn+0x176/0x430 [ 5776.624703][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5776.624982][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5776.625261][ C1] __run_timers.part.0+0x52d/0x890 [ 5776.625534][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5776.625826][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5776.626132][ C1] ? __pfx___schedule+0x10/0x10 [ 5776.626391][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5776.626713][ C1] run_timer_softirq+0x72/0x100 [ 5776.626977][ C1] __do_softirq+0x1bc/0x7ff [ 5776.627227][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5776.627502][ C1] run_ksoftirqd+0x2e/0x60 [ 5776.627738][ C1] smpboot_thread_fn+0x30e/0x840 [ 5776.628004][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5776.628298][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5776.628587][ C1] kthread+0x292/0x360 [ 5776.628809][ C1] ? __pfx_kthread+0x10/0x10 [ 5776.629058][ C1] ret_from_fork+0x34/0x70 [ 5776.629297][ C1] ? __pfx_kthread+0x10/0x10 [ 5776.629540][ C1] ret_from_fork_asm+0x1b/0x30 [ 5776.629801][ C1] [ 5804.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4299s! [swapper/0:0] [ 5804.527940][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5804.529136][ C0] irq event stamp: 27567077 [ 5804.529374][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5804.529914][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5804.530395][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5804.530907][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5804.531407][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5804.531886][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5804.532540][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa8/0xb90 [ 5804.532881][ C0] Code: 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 be 04 00 00 00 <48> 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c 08 84 c0 0f 85 [ 5804.533919][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5804.534249][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5804.534670][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5804.535097][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5804.535520][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5804.535944][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5804.536365][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5804.536834][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5804.537181][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5804.537602][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5804.538016][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5804.538440][ C0] Call Trace: [ 5804.538623][ C0] [ 5804.538782][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5804.539057][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5804.539312][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5804.539599][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5804.539885][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5804.540192][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5804.540474][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5804.540797][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5804.541071][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5804.541350][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5804.541671][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5804.541981][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5804.542313][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5804.542614][ C0] ? queued_spin_lock_slowpath+0xa8/0xb90 [ 5804.542914][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5804.543216][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5804.543542][ C0] ? get_stack_info+0x36/0xc0 [ 5804.543799][ C0] ? lock_acquire+0x1c1/0x220 [ 5804.544060][ C0] ? lock_release+0x1d5/0x250 [ 5804.544317][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5804.544581][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5804.544871][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5804.545171][ C0] ? lock_acquire+0x1c1/0x220 [ 5804.545417][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5804.545667][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5804.545937][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5804.546188][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5804.546453][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5804.546729][ C0] ? __inet_lookup_established+0x341/0x610 [ 5804.547047][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5804.547337][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5804.547627][ C0] ip_local_deliver+0x19d/0x480 [ 5804.547888][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5804.548180][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5804.548445][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5804.548730][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5804.548997][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5804.549334][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5804.549612][ C0] ip_rcv+0x564/0x740 [ 5804.549824][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5804.550064][ C0] ? set_track_prepare+0x8a/0xd0 [ 5804.550328][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5804.550621][ C0] ? rest_init+0x153/0x260 [ 5804.550857][ C0] ? skb_clone+0x10b/0x330 [ 5804.551101][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5804.551434][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5804.551753][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5804.552055][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5804.552366][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5804.552629][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5804.552873][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5804.553196][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5804.553499][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5804.553837][ C0] ? lock_acquire+0x1c1/0x220 [ 5804.554083][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5804.554393][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5804.554693][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5804.555028][ C0] ? __copy_skb_header+0xaf/0x490 [ 5804.555299][ C0] ? __skb_clone+0x57a/0x760 [ 5804.555544][ C0] netif_receive_skb+0x55/0x280 [ 5804.555808][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5804.556139][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5804.556490][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5804.556804][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5804.557094][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5804.557395][ C0] ? hlock_class+0x4e/0x130 [ 5804.557645][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5804.557979][ C0] ? place_entity+0x21/0x2f0 [ 5804.558241][ C0] ? resched_curr+0x219/0x280 [ 5804.558499][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5804.558769][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5804.559058][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5804.559333][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5804.559592][ C0] ? activate_task+0xf5/0x260 [ 5804.559841][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5804.560118][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5804.560391][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5804.560649][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5804.560942][ C0] ? get_stack_info+0x36/0xc0 [ 5804.561201][ C0] ? stack_access_ok+0xda/0x1f0 [ 5804.561462][ C0] ? get_reg+0x119/0x190 [ 5804.561690][ C0] __tcf_classify+0x32c/0x7d0 [ 5804.561943][ C0] tcf_classify+0x283/0x930 [ 5804.562184][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5804.562512][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5804.562783][ C0] ? arch_stack_walk+0x8c/0x100 [ 5804.563050][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5804.563343][ C0] tc_run+0x2e4/0x5d0 [ 5804.563556][ C0] ? __pfx_tc_run+0x10/0x10 [ 5804.563797][ C0] ? lock_acquire+0x1c1/0x220 [ 5804.564046][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5804.564322][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5804.564592][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5804.564877][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5804.565153][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5804.565473][ C0] ? neigh_hh_output+0x348/0x590 [ 5804.565742][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5804.566021][ C0] ip_finish_output2+0x786/0x18e0 [ 5804.566294][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5804.566585][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5804.566944][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5804.567239][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5804.567503][ C0] ? __ip_finish_output+0x10f/0x770 [ 5804.567784][ C0] ip_output+0x16b/0x4f0 [ 5804.568012][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5804.568298][ C0] ? __pfx_ip_output+0x10/0x10 [ 5804.568552][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5804.568858][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5804.569121][ C0] ? ip_local_out+0x114/0x3b0 [ 5804.569376][ C0] __ip_queue_xmit+0x672/0x1910 [ 5804.569640][ C0] ? __skb_clone+0x57a/0x760 [ 5804.569890][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5804.570172][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5804.570466][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5804.570783][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5804.571044][ C0] ? tcp_current_mss+0x40a/0x510 [ 5804.571308][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5804.571591][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5804.571865][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5804.572118][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5804.572390][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5804.572711][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5804.572986][ C0] ? ktime_get+0xb6/0x190 [ 5804.573220][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5804.573494][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5804.573780][ C0] tcp_write_timer+0x82/0x1d0 [ 5804.574030][ C0] call_timer_fn+0x176/0x430 [ 5804.574275][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5804.574553][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5804.574826][ C0] __run_timers.part.0+0x52d/0x890 [ 5804.575104][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5804.575385][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5804.575686][ C0] ? lock_acquire+0x1c1/0x220 [ 5804.575934][ C0] ? clockevents_program_event+0xf6/0x300 [ 5804.576240][ C0] ? lock_release+0x1d5/0x250 [ 5804.576492][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5804.576769][ C0] ? ktime_get+0xb6/0x190 [ 5804.576999][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5804.577298][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5804.577612][ C0] run_timer_softirq+0x72/0x100 [ 5804.577868][ C0] __do_softirq+0x1bc/0x7ff [ 5804.578113][ C0] irq_exit_rcu+0x98/0xc0 [ 5804.578348][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5804.578652][ C0] [ 5804.578808][ C0] [ 5804.578966][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5804.579289][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5804.579562][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5804.580591][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5804.580918][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5804.581340][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5804.581764][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5804.582191][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5804.582612][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5804.583034][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5804.583342][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5804.583616][ C0] default_idle_call+0x69/0xa0 [ 5804.583869][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5804.584137][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5804.584428][ C0] ? lock_release+0x1d5/0x250 [ 5804.584683][ C0] do_idle+0xfb/0x160 [ 5804.584896][ C0] cpu_startup_entry+0x55/0x60 [ 5804.585152][ C0] rest_init+0x153/0x260 [ 5804.585381][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5804.585671][ C0] arch_call_rest_init+0x13/0x40 [ 5804.585939][ C0] start_kernel+0x314/0x3d0 [ 5804.586180][ C0] x86_64_start_reservations+0x18/0x30 [ 5804.586469][ C0] x86_64_start_kernel+0xba/0x110 [ 5804.586742][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5804.587073][ C0] [ 5804.587242][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4299s! [ksoftirqd/1:22] [ 5804.587710][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5804.588918][ C1] irq event stamp: 3886976 [ 5804.589154][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5804.589654][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5804.590153][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5804.590655][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5804.591144][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5804.591641][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5804.592286][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5804.592629][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5804.593654][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5804.593978][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5804.594405][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5804.594827][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5804.595248][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5804.595672][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5804.596100][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5804.596571][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5804.596920][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5804.597349][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5804.597769][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5804.598193][ C1] Call Trace: [ 5804.598372][ C1] [ 5804.598532][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5804.598809][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5804.599069][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5804.599361][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5804.599649][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5804.599954][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5804.600237][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5804.600561][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5804.600836][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5804.601163][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5804.601477][ C1] [ 5804.601633][ C1] [ 5804.601792][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5804.602122][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5804.602431][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5804.602744][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5804.603048][ C1] ? run_ksoftirqd+0xb/0x60 [ 5804.603292][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5804.603617][ C1] ? __orc_find+0x9c/0xf0 [ 5804.603852][ C1] ? lock_acquire+0x1c1/0x220 [ 5804.604108][ C1] ? irqentry_enter+0x2b/0x60 [ 5804.604364][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5804.604626][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5804.604918][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5804.605223][ C1] ? lock_acquire+0x1c1/0x220 [ 5804.605473][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5804.605730][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5804.606002][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5804.606253][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5804.606514][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5804.606789][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5804.607082][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5804.607375][ C1] ip_local_deliver+0x19d/0x480 [ 5804.607632][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5804.607915][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5804.608184][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5804.608461][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5804.608728][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5804.609067][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5804.609341][ C1] ip_rcv+0x564/0x740 [ 5804.609555][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5804.609795][ C1] ? set_track_prepare+0x8a/0xd0 [ 5804.610061][ C1] ? irqentry_enter+0x2b/0x60 [ 5804.610317][ C1] ? irqentry_enter+0x2b/0x60 [ 5804.610572][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5804.610817][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5804.611136][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5804.611478][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5804.611795][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5804.612134][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5804.612431][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5804.612765][ C1] netif_receive_skb+0x55/0x280 [ 5804.613027][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5804.613358][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5804.613710][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5804.614021][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5804.614313][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5804.614617][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5804.614950][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5804.615233][ C1] ? arch_stack_walk+0x68/0x100 [ 5804.615497][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5804.615773][ C1] ? irqentry_enter+0x2b/0x60 [ 5804.616024][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5804.616348][ C1] ? irqentry_enter+0x2b/0x60 [ 5804.616602][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5804.616926][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5804.617206][ C1] ? arch_stack_walk+0x68/0x100 [ 5804.617467][ C1] __tcf_classify+0x32c/0x7d0 [ 5804.617721][ C1] tcf_classify+0x283/0x930 [ 5804.617966][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5804.618245][ C1] tc_run+0x2e4/0x5d0 [ 5804.618460][ C1] ? __pfx_tc_run+0x10/0x10 [ 5804.618702][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5804.618968][ C1] ? irqentry_enter+0x2b/0x60 [ 5804.619224][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5804.619515][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5804.619838][ C1] ip_finish_output2+0x786/0x18e0 [ 5804.620108][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5804.620397][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5804.620663][ C1] ? __ip_finish_output+0x10f/0x770 [ 5804.620939][ C1] ip_output+0x16b/0x4f0 [ 5804.621168][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5804.621487][ C1] ? __pfx_ip_output+0x10/0x10 [ 5804.621743][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5804.622102][ C1] ? __pfx_ip_output+0x10/0x10 [ 5804.622360][ C1] __ip_queue_xmit+0x672/0x1910 [ 5804.622620][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5804.622900][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5804.623194][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5804.623478][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5804.623773][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5804.624059][ C1] tcp_delack_timer+0x84/0x240 [ 5804.624315][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5804.624606][ C1] call_timer_fn+0x176/0x430 [ 5804.624858][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5804.625133][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5804.625417][ C1] __run_timers.part.0+0x52d/0x890 [ 5804.625693][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5804.625980][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5804.626282][ C1] ? __pfx___schedule+0x10/0x10 [ 5804.626543][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5804.626870][ C1] run_timer_softirq+0x72/0x100 [ 5804.627130][ C1] __do_softirq+0x1bc/0x7ff [ 5804.627373][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5804.627647][ C1] run_ksoftirqd+0x2e/0x60 [ 5804.627889][ C1] smpboot_thread_fn+0x30e/0x840 [ 5804.628161][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5804.628452][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5804.628746][ C1] kthread+0x292/0x360 [ 5804.628964][ C1] ? __pfx_kthread+0x10/0x10 [ 5804.629215][ C1] ret_from_fork+0x34/0x70 [ 5804.629453][ C1] ? __pfx_kthread+0x10/0x10 [ 5804.629701][ C1] ret_from_fork_asm+0x1b/0x30 [ 5804.629959][ C1] [ 5827.296024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5827.296400][ C1] rcu: 1-....: (4619692 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1099977 [ 5827.296993][ C1] rcu: (t=4632987 jiffies g=1007429 q=31 ncpus=4) [ 5827.297345][ C1] Sending NMI from CPU 1 to CPUs 0: [ 5827.297640][ C0] NMI backtrace for cpu 0 [ 5827.297649][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5827.297654][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5827.297657][ C0] RIP: 0010:kasan_check_range+0x10f/0x1c0 [ 5827.297667][ C0] Code: 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff 5b b8 01 00 00 00 5d 41 5c cc cc cc cc 41 bc 08 00 00 00 45 29 dc 49 8d 14 2c eb 0c 48 83 [ 5827.297670][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000246 [ 5827.297675][ C0] RAX: 0000000000000001 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5827.297676][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5827.297678][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5827.297680][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5827.297682][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5827.297684][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5827.297686][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5827.297690][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5827.297692][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5827.297693][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5827.297695][ C0] Call Trace: [ 5827.297698][ C0] [ 5827.297702][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 5827.297709][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5827.297715][ C0] ? nmi_handle+0x156/0x420 [ 5827.297720][ C0] ? default_do_nmi+0x41/0x100 [ 5827.297725][ C0] ? exc_nmi+0xf3/0x120 [ 5827.297728][ C0] ? end_repeat_nmi+0xf/0x60 [ 5827.297733][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5827.297739][ C0] ? kasan_check_range+0x10f/0x1c0 [ 5827.297743][ C0] ? kasan_check_range+0x10f/0x1c0 [ 5827.297747][ C0] ? kasan_check_range+0x10f/0x1c0 [ 5827.297751][ C0] [ 5827.297752][ C0] [ 5827.297753][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 5827.297757][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5827.297760][ C0] ? get_stack_info+0x36/0xc0 [ 5827.297766][ C0] ? lock_acquire+0x1c1/0x220 [ 5827.297771][ C0] ? lock_release+0x1d5/0x250 [ 5827.297775][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5827.297779][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5827.297782][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5827.297785][ C0] ? lock_acquire+0x1c1/0x220 [ 5827.297787][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5827.297793][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5827.297797][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5827.297804][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5827.297807][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5827.297811][ C0] ? __inet_lookup_established+0x341/0x610 [ 5827.297818][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5827.297826][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5827.297830][ C0] ip_local_deliver+0x19d/0x480 [ 5827.297833][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5827.297836][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5827.297841][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5827.297845][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5827.297848][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5827.297852][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5827.297863][ C0] ip_rcv+0x564/0x740 [ 5827.297866][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5827.297869][ C0] ? set_track_prepare+0x8a/0xd0 [ 5827.297874][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5827.297876][ C0] ? rest_init+0x153/0x260 [ 5827.297879][ C0] ? skb_clone+0x10b/0x330 [ 5827.297884][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5827.297890][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5827.297895][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5827.297900][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5827.297909][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5827.297912][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5827.297915][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5827.297919][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5827.297922][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5827.297926][ C0] ? lock_acquire+0x1c1/0x220 [ 5827.297928][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5827.297932][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5827.297935][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5827.297938][ C0] ? __copy_skb_header+0xaf/0x490 [ 5827.297941][ C0] ? __skb_clone+0x57a/0x760 [ 5827.297944][ C0] netif_receive_skb+0x55/0x280 [ 5827.297946][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5827.297954][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5827.297961][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5827.297968][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5827.297973][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5827.297982][ C0] ? hlock_class+0x4e/0x130 [ 5827.297988][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5827.297998][ C0] ? place_entity+0x21/0x2f0 [ 5827.298002][ C0] ? resched_curr+0x219/0x280 [ 5827.298005][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5827.298008][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5827.298011][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5827.298016][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5827.298018][ C0] ? activate_task+0xf5/0x260 [ 5827.298022][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5827.298028][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5827.298031][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5827.298035][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5827.298038][ C0] ? get_stack_info+0x36/0xc0 [ 5827.298042][ C0] ? stack_access_ok+0xda/0x1f0 [ 5827.298050][ C0] ? get_reg+0x119/0x190 [ 5827.298053][ C0] __tcf_classify+0x32c/0x7d0 [ 5827.298058][ C0] tcf_classify+0x283/0x930 [ 5827.298061][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5827.298067][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5827.298069][ C0] ? arch_stack_walk+0x8c/0x100 [ 5827.298075][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5827.298078][ C0] tc_run+0x2e4/0x5d0 [ 5827.298084][ C0] ? __pfx_tc_run+0x10/0x10 [ 5827.298087][ C0] ? lock_acquire+0x1c1/0x220 [ 5827.298089][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5827.298095][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5827.298101][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5827.298104][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5827.298107][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5827.298113][ C0] ? neigh_hh_output+0x348/0x590 [ 5827.298118][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5827.298122][ C0] ip_finish_output2+0x786/0x18e0 [ 5827.298125][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5827.298132][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5827.298140][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5827.298143][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5827.298147][ C0] ? __ip_finish_output+0x10f/0x770 [ 5827.298151][ C0] ip_output+0x16b/0x4f0 [ 5827.298154][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5827.298160][ C0] ? __pfx_ip_output+0x10/0x10 [ 5827.298163][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5827.298168][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5827.298171][ C0] ? ip_local_out+0x114/0x3b0 [ 5827.298175][ C0] __ip_queue_xmit+0x672/0x1910 [ 5827.298179][ C0] ? __skb_clone+0x57a/0x760 [ 5827.298182][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5827.298190][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5827.298194][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5827.298198][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5827.298203][ C0] ? tcp_current_mss+0x40a/0x510 [ 5827.298206][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5827.298209][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5827.298212][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5827.298214][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5827.298217][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5827.298220][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5827.298225][ C0] ? ktime_get+0xb6/0x190 [ 5827.298229][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5827.298234][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5827.298237][ C0] tcp_write_timer+0x82/0x1d0 [ 5827.298241][ C0] call_timer_fn+0x176/0x430 [ 5827.298244][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5827.298249][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5827.298253][ C0] __run_timers.part.0+0x52d/0x890 [ 5827.298256][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5827.298261][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5827.298264][ C0] ? lock_acquire+0x1c1/0x220 [ 5827.298266][ C0] ? clockevents_program_event+0xf6/0x300 [ 5827.298271][ C0] ? lock_release+0x1d5/0x250 [ 5827.298274][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5827.298276][ C0] ? ktime_get+0xb6/0x190 [ 5827.298279][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5827.298283][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5827.298287][ C0] run_timer_softirq+0x72/0x100 [ 5827.298291][ C0] __do_softirq+0x1bc/0x7ff [ 5827.298296][ C0] irq_exit_rcu+0x98/0xc0 [ 5827.298299][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5827.298303][ C0] [ 5827.298304][ C0] [ 5827.298305][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5827.298312][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5827.298315][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5827.298317][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5827.298319][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5827.298321][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5827.298323][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5827.298324][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5827.298326][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5827.298329][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5827.298333][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5827.298337][ C0] default_idle_call+0x69/0xa0 [ 5827.298339][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5827.298341][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5827.298347][ C0] ? lock_release+0x1d5/0x250 [ 5827.298351][ C0] do_idle+0xfb/0x160 [ 5827.298353][ C0] cpu_startup_entry+0x55/0x60 [ 5827.298356][ C0] rest_init+0x153/0x260 [ 5827.298358][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5827.298365][ C0] arch_call_rest_init+0x13/0x40 [ 5827.298371][ C0] start_kernel+0x314/0x3d0 [ 5827.298375][ C0] x86_64_start_reservations+0x18/0x30 [ 5827.298380][ C0] x86_64_start_kernel+0xba/0x110 [ 5827.298383][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5827.298392][ C0] [ 5827.298630][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5827.352844][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5827.353488][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5827.353834][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5827.354855][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5827.355180][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5827.355598][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5827.356018][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5827.356439][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5827.356861][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5827.357281][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5827.357754][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5827.358113][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5827.358540][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5827.358960][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5827.359380][ C1] Call Trace: [ 5827.359559][ C1] [ 5827.359715][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5827.360005][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5827.360270][ C1] ? check_cpu_stall+0x284/0x500 [ 5827.360536][ C1] ? rcu_pending+0x92/0x360 [ 5827.360776][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5827.361059][ C1] ? update_process_times+0xb9/0x110 [ 5827.361344][ C1] ? tick_sched_handle+0x67/0x130 [ 5827.361612][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5827.361911][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5827.362170][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5827.362497][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5827.362788][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5827.363094][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5827.363376][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5827.363703][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5827.363977][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5827.364306][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5827.364620][ C1] [ 5827.364777][ C1] [ 5827.364933][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5827.365259][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5827.365566][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5827.365877][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5827.366179][ C1] ? run_ksoftirqd+0xb/0x60 [ 5827.366421][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5827.366747][ C1] ? __orc_find+0x9c/0xf0 [ 5827.366981][ C1] ? lock_acquire+0x1c1/0x220 [ 5827.367235][ C1] ? irqentry_enter+0x2b/0x60 [ 5827.367489][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5827.367751][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5827.368039][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5827.368343][ C1] ? lock_acquire+0x1c1/0x220 [ 5827.368597][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5827.368854][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5827.369132][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5827.369377][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5827.369637][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5827.369907][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5827.370198][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5827.370490][ C1] ip_local_deliver+0x19d/0x480 [ 5827.370753][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5827.371041][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5827.371308][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5827.371583][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5827.371845][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5827.372189][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5827.372463][ C1] ip_rcv+0x564/0x740 [ 5827.372675][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5827.372915][ C1] ? set_track_prepare+0x8a/0xd0 [ 5827.373180][ C1] ? irqentry_enter+0x2b/0x60 [ 5827.373435][ C1] ? irqentry_enter+0x2b/0x60 [ 5827.373690][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5827.373934][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5827.374256][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5827.374598][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5827.374910][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5827.375250][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5827.375548][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5827.375888][ C1] netif_receive_skb+0x55/0x280 [ 5827.376150][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5827.376482][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5827.376833][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5827.377146][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5827.377443][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5827.377749][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5827.378086][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5827.378367][ C1] ? arch_stack_walk+0x68/0x100 [ 5827.378634][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5827.378914][ C1] ? irqentry_enter+0x2b/0x60 [ 5827.379171][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5827.379493][ C1] ? irqentry_enter+0x2b/0x60 [ 5827.379741][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5827.380068][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5827.380352][ C1] ? arch_stack_walk+0x68/0x100 [ 5827.380612][ C1] __tcf_classify+0x32c/0x7d0 [ 5827.380865][ C1] tcf_classify+0x283/0x930 [ 5827.381110][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5827.381378][ C1] tc_run+0x2e4/0x5d0 [ 5827.381592][ C1] ? __pfx_tc_run+0x10/0x10 [ 5827.381834][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5827.382101][ C1] ? irqentry_enter+0x2b/0x60 [ 5827.382355][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5827.382645][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5827.382969][ C1] ip_finish_output2+0x786/0x18e0 [ 5827.383241][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5827.383531][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5827.383799][ C1] ? __ip_finish_output+0x10f/0x770 [ 5827.384079][ C1] ip_output+0x16b/0x4f0 [ 5827.384304][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5827.384626][ C1] ? __pfx_ip_output+0x10/0x10 [ 5827.384880][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5827.385240][ C1] ? __pfx_ip_output+0x10/0x10 [ 5827.385499][ C1] __ip_queue_xmit+0x672/0x1910 [ 5827.385760][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5827.386041][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5827.386336][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5827.386624][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5827.386916][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5827.387200][ C1] tcp_delack_timer+0x84/0x240 [ 5827.387453][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5827.387743][ C1] call_timer_fn+0x176/0x430 [ 5827.387992][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5827.388272][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5827.388551][ C1] __run_timers.part.0+0x52d/0x890 [ 5827.388822][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5827.389112][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5827.389415][ C1] ? __pfx___schedule+0x10/0x10 [ 5827.389675][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5827.389993][ C1] run_timer_softirq+0x72/0x100 [ 5827.390260][ C1] __do_softirq+0x1bc/0x7ff [ 5827.390507][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5827.390784][ C1] run_ksoftirqd+0x2e/0x60 [ 5827.391022][ C1] smpboot_thread_fn+0x30e/0x840 [ 5827.391291][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5827.391578][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5827.391869][ C1] kthread+0x292/0x360 [ 5827.392088][ C1] ? __pfx_kthread+0x10/0x10 [ 5827.392342][ C1] ret_from_fork+0x34/0x70 [ 5827.392579][ C1] ? __pfx_kthread+0x10/0x10 [ 5827.392826][ C1] ret_from_fork_asm+0x1b/0x30 [ 5827.393085][ C1] [ 5852.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4344s! [swapper/0:0] [ 5852.527923][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5852.529132][ C0] irq event stamp: 27567077 [ 5852.529376][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5852.529911][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5852.530388][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5852.530887][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5852.531381][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5852.531863][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5852.532511][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5852.532859][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5852.533889][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5852.534214][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5852.534637][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5852.535058][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5852.535477][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5852.535900][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5852.536324][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5852.536795][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5852.537144][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5852.537572][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5852.537999][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5852.538419][ C0] Call Trace: [ 5852.538598][ C0] [ 5852.538758][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5852.539037][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5852.539294][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5852.539584][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5852.539876][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5852.540180][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5852.540462][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5852.540792][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5852.541065][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5852.541347][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5852.541670][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5852.541979][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5852.542315][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5852.542617][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5852.542924][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5852.543229][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5852.543557][ C0] ? get_stack_info+0x36/0xc0 [ 5852.543808][ C0] ? lock_acquire+0x1c1/0x220 [ 5852.544057][ C0] ? lock_release+0x1d5/0x250 [ 5852.544306][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5852.544564][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5852.544848][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5852.545146][ C0] ? lock_acquire+0x1c1/0x220 [ 5852.545399][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5852.545655][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5852.545930][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5852.546174][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5852.546432][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5852.546700][ C0] ? __inet_lookup_established+0x341/0x610 [ 5852.547011][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5852.547304][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5852.547599][ C0] ip_local_deliver+0x19d/0x480 [ 5852.547858][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5852.548151][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5852.548419][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5852.548696][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5852.548958][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5852.549297][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5852.549572][ C0] ip_rcv+0x564/0x740 [ 5852.549784][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5852.550025][ C0] ? set_track_prepare+0x8a/0xd0 [ 5852.550291][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5852.550581][ C0] ? rest_init+0x153/0x260 [ 5852.550815][ C0] ? skb_clone+0x10b/0x330 [ 5852.551058][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5852.551392][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5852.551711][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5852.552013][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5852.552328][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5852.552588][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5852.552832][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5852.553150][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5852.553454][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5852.553792][ C0] ? lock_acquire+0x1c1/0x220 [ 5852.554040][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5852.554350][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5852.554652][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5852.554981][ C0] ? __copy_skb_header+0xaf/0x490 [ 5852.555247][ C0] ? __skb_clone+0x57a/0x760 [ 5852.555490][ C0] netif_receive_skb+0x55/0x280 [ 5852.555751][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5852.556080][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5852.556432][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5852.556745][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5852.557036][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5852.557335][ C0] ? hlock_class+0x4e/0x130 [ 5852.557582][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5852.557917][ C0] ? place_entity+0x21/0x2f0 [ 5852.558168][ C0] ? resched_curr+0x219/0x280 [ 5852.558425][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5852.558697][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5852.558983][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5852.559260][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5852.559518][ C0] ? activate_task+0xf5/0x260 [ 5852.559768][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5852.560042][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5852.560318][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5852.560573][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5852.560861][ C0] ? get_stack_info+0x36/0xc0 [ 5852.561115][ C0] ? stack_access_ok+0xda/0x1f0 [ 5852.561379][ C0] ? get_reg+0x119/0x190 [ 5852.561607][ C0] __tcf_classify+0x32c/0x7d0 [ 5852.561856][ C0] tcf_classify+0x283/0x930 [ 5852.562095][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5852.562424][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5852.562692][ C0] ? arch_stack_walk+0x8c/0x100 [ 5852.562959][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5852.563253][ C0] tc_run+0x2e4/0x5d0 [ 5852.563467][ C0] ? __pfx_tc_run+0x10/0x10 [ 5852.563707][ C0] ? lock_acquire+0x1c1/0x220 [ 5852.563957][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5852.564232][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5852.564504][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5852.564789][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5852.565066][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5852.565383][ C0] ? neigh_hh_output+0x348/0x590 [ 5852.565650][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5852.565926][ C0] ip_finish_output2+0x786/0x18e0 [ 5852.566194][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5852.566487][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5852.566843][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5852.567137][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5852.567402][ C0] ? __ip_finish_output+0x10f/0x770 [ 5852.567683][ C0] ip_output+0x16b/0x4f0 [ 5852.567910][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5852.568196][ C0] ? __pfx_ip_output+0x10/0x10 [ 5852.568451][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5852.568753][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5852.569017][ C0] ? ip_local_out+0x114/0x3b0 [ 5852.569272][ C0] __ip_queue_xmit+0x672/0x1910 [ 5852.569534][ C0] ? __skb_clone+0x57a/0x760 [ 5852.569782][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5852.570062][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5852.570358][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5852.570677][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5852.570938][ C0] ? tcp_current_mss+0x40a/0x510 [ 5852.571201][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5852.571484][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5852.571758][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5852.572012][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5852.572283][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5852.572605][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5852.572881][ C0] ? ktime_get+0xb6/0x190 [ 5852.573113][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5852.573385][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5852.573668][ C0] tcp_write_timer+0x82/0x1d0 [ 5852.573917][ C0] call_timer_fn+0x176/0x430 [ 5852.574163][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5852.574439][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5852.574712][ C0] __run_timers.part.0+0x52d/0x890 [ 5852.574986][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5852.575271][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5852.575574][ C0] ? lock_acquire+0x1c1/0x220 [ 5852.575821][ C0] ? clockevents_program_event+0xf6/0x300 [ 5852.576125][ C0] ? lock_release+0x1d5/0x250 [ 5852.576376][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5852.576650][ C0] ? ktime_get+0xb6/0x190 [ 5852.576879][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5852.577178][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5852.577492][ C0] run_timer_softirq+0x72/0x100 [ 5852.577751][ C0] __do_softirq+0x1bc/0x7ff [ 5852.578003][ C0] irq_exit_rcu+0x98/0xc0 [ 5852.578236][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5852.578540][ C0] [ 5852.578696][ C0] [ 5852.578852][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5852.579172][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5852.579445][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5852.580471][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5852.580801][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5852.581222][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5852.581643][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5852.582067][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5852.582492][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5852.582915][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5852.583220][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5852.583497][ C0] default_idle_call+0x69/0xa0 [ 5852.583749][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5852.584014][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5852.584306][ C0] ? lock_release+0x1d5/0x250 [ 5852.584567][ C0] do_idle+0xfb/0x160 [ 5852.584782][ C0] cpu_startup_entry+0x55/0x60 [ 5852.585042][ C0] rest_init+0x153/0x260 [ 5852.585270][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5852.585562][ C0] arch_call_rest_init+0x13/0x40 [ 5852.585831][ C0] start_kernel+0x314/0x3d0 [ 5852.586074][ C0] x86_64_start_reservations+0x18/0x30 [ 5852.586366][ C0] x86_64_start_kernel+0xba/0x110 [ 5852.586637][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5852.586967][ C0] [ 5852.587137][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4344s! [ksoftirqd/1:22] [ 5852.587601][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5852.588803][ C1] irq event stamp: 3886976 [ 5852.589039][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5852.589539][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5852.590038][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5852.590540][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5852.591028][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5852.591527][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5852.592177][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5852.592521][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5852.593548][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5852.593876][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5852.594301][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5852.594726][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5852.595156][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5852.595579][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5852.596003][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5852.596479][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5852.596828][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5852.597252][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5852.597670][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5852.598098][ C1] Call Trace: [ 5852.598284][ C1] [ 5852.598440][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5852.598716][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5852.598973][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5852.599263][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5852.599554][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5852.599861][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5852.600145][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5852.600469][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5852.600743][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5852.601074][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5852.601387][ C1] [ 5852.601543][ C1] [ 5852.601700][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5852.602032][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5852.602339][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5852.602656][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5852.602957][ C1] ? run_ksoftirqd+0xb/0x60 [ 5852.603199][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5852.603526][ C1] ? __orc_find+0x9c/0xf0 [ 5852.603759][ C1] ? lock_acquire+0x1c1/0x220 [ 5852.604016][ C1] ? irqentry_enter+0x2b/0x60 [ 5852.604274][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5852.604537][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5852.604825][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5852.605126][ C1] ? lock_acquire+0x1c1/0x220 [ 5852.605373][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5852.605623][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5852.605894][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5852.606146][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5852.606407][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5852.606681][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5852.606975][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5852.607272][ C1] ip_local_deliver+0x19d/0x480 [ 5852.607532][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5852.607818][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5852.608094][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5852.608372][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5852.608634][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5852.608974][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5852.609250][ C1] ip_rcv+0x564/0x740 [ 5852.609463][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5852.609704][ C1] ? set_track_prepare+0x8a/0xd0 [ 5852.609969][ C1] ? irqentry_enter+0x2b/0x60 [ 5852.610222][ C1] ? irqentry_enter+0x2b/0x60 [ 5852.610475][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5852.610720][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5852.611040][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5852.611385][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5852.611696][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5852.612035][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5852.612334][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5852.612670][ C1] netif_receive_skb+0x55/0x280 [ 5852.612933][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5852.613268][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5852.613618][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5852.613933][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5852.614227][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5852.614535][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5852.614866][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5852.615150][ C1] ? arch_stack_walk+0x68/0x100 [ 5852.615409][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5852.615688][ C1] ? irqentry_enter+0x2b/0x60 [ 5852.615936][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5852.616255][ C1] ? irqentry_enter+0x2b/0x60 [ 5852.616508][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5852.616835][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5852.617116][ C1] ? arch_stack_walk+0x68/0x100 [ 5852.617385][ C1] __tcf_classify+0x32c/0x7d0 [ 5852.617647][ C1] tcf_classify+0x283/0x930 [ 5852.617894][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5852.618173][ C1] tc_run+0x2e4/0x5d0 [ 5852.618387][ C1] ? __pfx_tc_run+0x10/0x10 [ 5852.618631][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5852.618897][ C1] ? irqentry_enter+0x2b/0x60 [ 5852.619151][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5852.619441][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5852.619767][ C1] ip_finish_output2+0x786/0x18e0 [ 5852.620038][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5852.620326][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5852.620595][ C1] ? __ip_finish_output+0x10f/0x770 [ 5852.620873][ C1] ip_output+0x16b/0x4f0 [ 5852.621102][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5852.621425][ C1] ? __pfx_ip_output+0x10/0x10 [ 5852.621681][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5852.622039][ C1] ? __pfx_ip_output+0x10/0x10 [ 5852.622299][ C1] __ip_queue_xmit+0x672/0x1910 [ 5852.622565][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5852.622849][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5852.623146][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5852.623432][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5852.623728][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5852.624012][ C1] tcp_delack_timer+0x84/0x240 [ 5852.624266][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5852.624554][ C1] call_timer_fn+0x176/0x430 [ 5852.624804][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5852.625079][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5852.625360][ C1] __run_timers.part.0+0x52d/0x890 [ 5852.625636][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5852.625922][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5852.626222][ C1] ? __pfx___schedule+0x10/0x10 [ 5852.626487][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5852.626809][ C1] run_timer_softirq+0x72/0x100 [ 5852.627070][ C1] __do_softirq+0x1bc/0x7ff [ 5852.627311][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5852.627584][ C1] run_ksoftirqd+0x2e/0x60 [ 5852.627825][ C1] smpboot_thread_fn+0x30e/0x840 [ 5852.628096][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5852.628387][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5852.628679][ C1] kthread+0x292/0x360 [ 5852.628896][ C1] ? __pfx_kthread+0x10/0x10 [ 5852.629145][ C1] ret_from_fork+0x34/0x70 [ 5852.629381][ C1] ? __pfx_kthread+0x10/0x10 [ 5852.629629][ C1] ret_from_fork_asm+0x1b/0x30 [ 5852.629889][ C1] [ 5880.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4370s! [swapper/0:0] [ 5880.527923][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5880.529119][ C0] irq event stamp: 27567077 [ 5880.529363][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5880.529899][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5880.530371][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5880.530873][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5880.531368][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5880.531847][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5880.532496][ C0] RIP: 0010:__kasan_check_read+0x0/0x20 [ 5880.532797][ C0] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 5880.533824][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000202 [ 5880.534151][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5880.534575][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5880.534998][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5880.535424][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5880.535844][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5880.536266][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5880.536740][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5880.537091][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5880.537514][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5880.537937][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5880.538360][ C0] Call Trace: [ 5880.538546][ C0] [ 5880.538701][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5880.538976][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5880.539232][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5880.539520][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5880.539810][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5880.540116][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5880.540403][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5880.540724][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5880.540995][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5880.541275][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5880.541595][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5880.541905][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5880.542238][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5880.542540][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 5880.542831][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 5880.543124][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5880.543448][ C0] ? get_stack_info+0x36/0xc0 [ 5880.543704][ C0] ? lock_acquire+0x1c1/0x220 [ 5880.543960][ C0] ? lock_release+0x1d5/0x250 [ 5880.544216][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5880.544482][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5880.544771][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5880.545077][ C0] ? lock_acquire+0x1c1/0x220 [ 5880.545325][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5880.545576][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5880.545848][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5880.546097][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5880.546361][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5880.546632][ C0] ? __inet_lookup_established+0x341/0x610 [ 5880.546948][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5880.547241][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5880.547533][ C0] ip_local_deliver+0x19d/0x480 [ 5880.547801][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5880.548088][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5880.548352][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5880.548632][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5880.548896][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5880.549229][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5880.549510][ C0] ip_rcv+0x564/0x740 [ 5880.549723][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5880.549966][ C0] ? set_track_prepare+0x8a/0xd0 [ 5880.550234][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5880.550520][ C0] ? rest_init+0x153/0x260 [ 5880.550760][ C0] ? skb_clone+0x10b/0x330 [ 5880.550999][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5880.551337][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5880.551656][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5880.551949][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5880.552258][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5880.552513][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5880.552751][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5880.553067][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5880.553364][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5880.553707][ C0] ? lock_acquire+0x1c1/0x220 [ 5880.553958][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5880.554277][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5880.554575][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5880.554908][ C0] ? __copy_skb_header+0xaf/0x490 [ 5880.555178][ C0] ? __skb_clone+0x57a/0x760 [ 5880.555425][ C0] netif_receive_skb+0x55/0x280 [ 5880.555682][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5880.556005][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5880.556353][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5880.556667][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5880.556951][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5880.557248][ C0] ? hlock_class+0x4e/0x130 [ 5880.557491][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5880.557827][ C0] ? place_entity+0x21/0x2f0 [ 5880.558077][ C0] ? resched_curr+0x219/0x280 [ 5880.558328][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5880.558594][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5880.558873][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5880.559155][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5880.559421][ C0] ? activate_task+0xf5/0x260 [ 5880.559674][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5880.559952][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5880.560223][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5880.560483][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5880.560777][ C0] ? get_stack_info+0x36/0xc0 [ 5880.561029][ C0] ? stack_access_ok+0xda/0x1f0 [ 5880.561287][ C0] ? get_reg+0x119/0x190 [ 5880.561515][ C0] __tcf_classify+0x32c/0x7d0 [ 5880.561770][ C0] tcf_classify+0x283/0x930 [ 5880.562016][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5880.562348][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5880.562613][ C0] ? arch_stack_walk+0x8c/0x100 [ 5880.562873][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5880.563162][ C0] tc_run+0x2e4/0x5d0 [ 5880.563377][ C0] ? __pfx_tc_run+0x10/0x10 [ 5880.563621][ C0] ? lock_acquire+0x1c1/0x220 [ 5880.563872][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5880.564150][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5880.564416][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5880.564703][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5880.564984][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5880.565305][ C0] ? neigh_hh_output+0x348/0x590 [ 5880.565569][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5880.565849][ C0] ip_finish_output2+0x786/0x18e0 [ 5880.566122][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5880.566416][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5880.566770][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5880.567061][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5880.567329][ C0] ? __ip_finish_output+0x10f/0x770 [ 5880.567606][ C0] ip_output+0x16b/0x4f0 [ 5880.567836][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5880.568117][ C0] ? __pfx_ip_output+0x10/0x10 [ 5880.568373][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5880.568673][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5880.568940][ C0] ? ip_local_out+0x114/0x3b0 [ 5880.569189][ C0] __ip_queue_xmit+0x672/0x1910 [ 5880.569447][ C0] ? __skb_clone+0x57a/0x760 [ 5880.569690][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5880.569972][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5880.570270][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5880.570592][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5880.570849][ C0] ? tcp_current_mss+0x40a/0x510 [ 5880.571116][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5880.571395][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5880.571674][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5880.571929][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5880.572195][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5880.572511][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5880.572789][ C0] ? ktime_get+0xb6/0x190 [ 5880.573023][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5880.573297][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5880.573574][ C0] tcp_write_timer+0x82/0x1d0 [ 5880.573826][ C0] call_timer_fn+0x176/0x430 [ 5880.574076][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5880.574348][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5880.574623][ C0] __run_timers.part.0+0x52d/0x890 [ 5880.574893][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5880.575180][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5880.575476][ C0] ? lock_acquire+0x1c1/0x220 [ 5880.575727][ C0] ? clockevents_program_event+0xf6/0x300 [ 5880.576036][ C0] ? lock_release+0x1d5/0x250 [ 5880.576291][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5880.576568][ C0] ? ktime_get+0xb6/0x190 [ 5880.576803][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5880.577103][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5880.577411][ C0] run_timer_softirq+0x72/0x100 [ 5880.577672][ C0] __do_softirq+0x1bc/0x7ff [ 5880.577922][ C0] irq_exit_rcu+0x98/0xc0 [ 5880.578152][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5880.578451][ C0] [ 5880.578610][ C0] [ 5880.578768][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5880.579092][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5880.579359][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5880.580371][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5880.580693][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5880.581111][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5880.581527][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5880.581944][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5880.582361][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5880.582779][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5880.583080][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5880.583352][ C0] default_idle_call+0x69/0xa0 [ 5880.583608][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5880.583871][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5880.584166][ C0] ? lock_release+0x1d5/0x250 [ 5880.584417][ C0] do_idle+0xfb/0x160 [ 5880.584629][ C0] cpu_startup_entry+0x55/0x60 [ 5880.584881][ C0] rest_init+0x153/0x260 [ 5880.585112][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5880.585400][ C0] arch_call_rest_init+0x13/0x40 [ 5880.585665][ C0] start_kernel+0x314/0x3d0 [ 5880.585911][ C0] x86_64_start_reservations+0x18/0x30 [ 5880.586206][ C0] x86_64_start_kernel+0xba/0x110 [ 5880.586473][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5880.586799][ C0] [ 5880.586961][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4370s! [ksoftirqd/1:22] [ 5880.587422][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5880.588628][ C1] irq event stamp: 3886976 [ 5880.588865][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5880.589367][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5880.589864][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5880.590366][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5880.590858][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5880.591356][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5880.592004][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5880.592350][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5880.593376][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5880.593699][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5880.594132][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5880.594552][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5880.594973][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5880.595398][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5880.595823][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5880.596296][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5880.596645][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5880.597074][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5880.597494][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5880.597918][ C1] Call Trace: [ 5880.598096][ C1] [ 5880.598255][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5880.598531][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5880.598790][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5880.599083][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5880.599371][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5880.599676][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5880.599959][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5880.600288][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5880.600563][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5880.600890][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5880.601206][ C1] [ 5880.601362][ C1] [ 5880.601519][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5880.601848][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5880.602157][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5880.602469][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5880.602771][ C1] ? run_ksoftirqd+0xb/0x60 [ 5880.603014][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5880.603341][ C1] ? __orc_find+0x9c/0xf0 [ 5880.603575][ C1] ? lock_acquire+0x1c1/0x220 [ 5880.603828][ C1] ? irqentry_enter+0x2b/0x60 [ 5880.604082][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5880.604344][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5880.604633][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5880.604936][ C1] ? lock_acquire+0x1c1/0x220 [ 5880.605186][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5880.605439][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5880.605712][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5880.605961][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5880.606224][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5880.606499][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5880.606790][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5880.607083][ C1] ip_local_deliver+0x19d/0x480 [ 5880.607339][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5880.607620][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5880.607893][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5880.608170][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5880.608433][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5880.608769][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5880.609043][ C1] ip_rcv+0x564/0x740 [ 5880.609256][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5880.609497][ C1] ? set_track_prepare+0x8a/0xd0 [ 5880.609762][ C1] ? irqentry_enter+0x2b/0x60 [ 5880.610017][ C1] ? irqentry_enter+0x2b/0x60 [ 5880.610273][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5880.610518][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5880.610836][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5880.611178][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5880.611491][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5880.611829][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5880.612127][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5880.612463][ C1] netif_receive_skb+0x55/0x280 [ 5880.612724][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5880.613054][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5880.613406][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5880.613718][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5880.614009][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5880.614313][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5880.614644][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5880.614933][ C1] ? arch_stack_walk+0x68/0x100 [ 5880.615195][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5880.615474][ C1] ? irqentry_enter+0x2b/0x60 [ 5880.615724][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5880.616043][ C1] ? irqentry_enter+0x2b/0x60 [ 5880.616296][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5880.616622][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5880.616900][ C1] ? arch_stack_walk+0x68/0x100 [ 5880.617163][ C1] __tcf_classify+0x32c/0x7d0 [ 5880.617416][ C1] tcf_classify+0x283/0x930 [ 5880.617660][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5880.617937][ C1] tc_run+0x2e4/0x5d0 [ 5880.618153][ C1] ? __pfx_tc_run+0x10/0x10 [ 5880.618399][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5880.618666][ C1] ? irqentry_enter+0x2b/0x60 [ 5880.618921][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5880.619211][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5880.619534][ C1] ip_finish_output2+0x786/0x18e0 [ 5880.619803][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5880.620092][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5880.620357][ C1] ? __ip_finish_output+0x10f/0x770 [ 5880.620633][ C1] ip_output+0x16b/0x4f0 [ 5880.620862][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5880.621182][ C1] ? __pfx_ip_output+0x10/0x10 [ 5880.621436][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5880.621791][ C1] ? __pfx_ip_output+0x10/0x10 [ 5880.622051][ C1] __ip_queue_xmit+0x672/0x1910 [ 5880.622310][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5880.622589][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5880.622882][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5880.623166][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5880.623461][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5880.623746][ C1] tcp_delack_timer+0x84/0x240 [ 5880.624002][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5880.624292][ C1] call_timer_fn+0x176/0x430 [ 5880.624543][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5880.624816][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5880.625096][ C1] __run_timers.part.0+0x52d/0x890 [ 5880.625371][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5880.625658][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5880.625958][ C1] ? __pfx___schedule+0x10/0x10 [ 5880.626219][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5880.626544][ C1] run_timer_softirq+0x72/0x100 [ 5880.626803][ C1] __do_softirq+0x1bc/0x7ff [ 5880.627046][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5880.627320][ C1] run_ksoftirqd+0x2e/0x60 [ 5880.627561][ C1] smpboot_thread_fn+0x30e/0x840 [ 5880.627833][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5880.628124][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5880.628419][ C1] kthread+0x292/0x360 [ 5880.628637][ C1] ? __pfx_kthread+0x10/0x10 [ 5880.628885][ C1] ret_from_fork+0x34/0x70 [ 5880.629124][ C1] ? __pfx_kthread+0x10/0x10 [ 5880.629372][ C1] ret_from_fork_asm+0x1b/0x30 [ 5880.629629][ C1] [ 5905.394038][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5905.394428][ C1] rcu: 1-....: (4697509 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1117991 [ 5905.395012][ C1] rcu: (t=4711085 jiffies g=1007429 q=31 ncpus=4) [ 5905.395364][ C1] Sending NMI from CPU 1 to CPUs 0: [ 5905.395658][ C0] NMI backtrace for cpu 0 [ 5905.395666][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5905.395670][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5905.395673][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5905.395682][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5905.395685][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5905.395689][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5905.395691][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5905.395693][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5905.395695][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5905.395697][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5905.395699][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5905.395701][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5905.395704][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5905.395706][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5905.395707][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5905.395709][ C0] Call Trace: [ 5905.395713][ C0] [ 5905.395718][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 5905.395724][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5905.395730][ C0] ? nmi_handle+0x156/0x420 [ 5905.395735][ C0] ? default_do_nmi+0x41/0x100 [ 5905.395740][ C0] ? exc_nmi+0xf3/0x120 [ 5905.395742][ C0] ? end_repeat_nmi+0xf/0x60 [ 5905.395747][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5905.395751][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5905.395755][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5905.395758][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5905.395762][ C0] [ 5905.395763][ C0] [ 5905.395764][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5905.395767][ C0] ? get_stack_info+0x36/0xc0 [ 5905.395772][ C0] ? lock_acquire+0x1c1/0x220 [ 5905.395778][ C0] ? lock_release+0x1d5/0x250 [ 5905.395781][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5905.395785][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5905.395788][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5905.395792][ C0] ? lock_acquire+0x1c1/0x220 [ 5905.395794][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5905.395800][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5905.395803][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5905.395811][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5905.395814][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5905.395819][ C0] ? __inet_lookup_established+0x341/0x610 [ 5905.395825][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5905.395837][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5905.395841][ C0] ip_local_deliver+0x19d/0x480 [ 5905.395845][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5905.395847][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5905.395853][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5905.395856][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5905.395859][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5905.395863][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5905.395876][ C0] ip_rcv+0x564/0x740 [ 5905.395879][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5905.395882][ C0] ? set_track_prepare+0x8a/0xd0 [ 5905.395887][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5905.395889][ C0] ? rest_init+0x153/0x260 [ 5905.395892][ C0] ? skb_clone+0x10b/0x330 [ 5905.395898][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5905.395905][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5905.395910][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5905.395915][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5905.395924][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5905.395927][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5905.395929][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5905.395934][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5905.395937][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5905.395940][ C0] ? lock_acquire+0x1c1/0x220 [ 5905.395943][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5905.395946][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5905.395949][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5905.395953][ C0] ? __copy_skb_header+0xaf/0x490 [ 5905.395956][ C0] ? __skb_clone+0x57a/0x760 [ 5905.395958][ C0] netif_receive_skb+0x55/0x280 [ 5905.395961][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5905.395969][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5905.395977][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5905.395984][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5905.395989][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5905.395998][ C0] ? hlock_class+0x4e/0x130 [ 5905.396003][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5905.396013][ C0] ? place_entity+0x21/0x2f0 [ 5905.396016][ C0] ? resched_curr+0x219/0x280 [ 5905.396021][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5905.396024][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5905.396028][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5905.396033][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5905.396035][ C0] ? activate_task+0xf5/0x260 [ 5905.396038][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5905.396043][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5905.396047][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5905.396050][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5905.396053][ C0] ? get_stack_info+0x36/0xc0 [ 5905.396057][ C0] ? stack_access_ok+0xda/0x1f0 [ 5905.396059][ C0] ? get_reg+0x119/0x190 [ 5905.396063][ C0] __tcf_classify+0x32c/0x7d0 [ 5905.396067][ C0] tcf_classify+0x283/0x930 [ 5905.396070][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5905.396076][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5905.396078][ C0] ? arch_stack_walk+0x8c/0x100 [ 5905.396082][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5905.396086][ C0] tc_run+0x2e4/0x5d0 [ 5905.396090][ C0] ? __pfx_tc_run+0x10/0x10 [ 5905.396094][ C0] ? lock_acquire+0x1c1/0x220 [ 5905.396096][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5905.396102][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5905.396107][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5905.396110][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5905.396114][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5905.396119][ C0] ? neigh_hh_output+0x348/0x590 [ 5905.396123][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5905.396127][ C0] ip_finish_output2+0x786/0x18e0 [ 5905.396130][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5905.396137][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5905.396144][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5905.396147][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5905.396151][ C0] ? __ip_finish_output+0x10f/0x770 [ 5905.396155][ C0] ip_output+0x16b/0x4f0 [ 5905.396158][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5905.396164][ C0] ? __pfx_ip_output+0x10/0x10 [ 5905.396167][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5905.396172][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5905.396175][ C0] ? ip_local_out+0x114/0x3b0 [ 5905.396179][ C0] __ip_queue_xmit+0x672/0x1910 [ 5905.396183][ C0] ? __skb_clone+0x57a/0x760 [ 5905.396186][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5905.396194][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5905.396199][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5905.396203][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5905.396208][ C0] ? tcp_current_mss+0x40a/0x510 [ 5905.396211][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5905.396214][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5905.396217][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5905.396219][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5905.396222][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5905.396225][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5905.396230][ C0] ? ktime_get+0xb6/0x190 [ 5905.396234][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5905.396238][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5905.396241][ C0] tcp_write_timer+0x82/0x1d0 [ 5905.396245][ C0] call_timer_fn+0x176/0x430 [ 5905.396249][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5905.396253][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5905.396258][ C0] __run_timers.part.0+0x52d/0x890 [ 5905.396261][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5905.396265][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5905.396268][ C0] ? lock_acquire+0x1c1/0x220 [ 5905.396270][ C0] ? clockevents_program_event+0xf6/0x300 [ 5905.396275][ C0] ? lock_release+0x1d5/0x250 [ 5905.396277][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5905.396280][ C0] ? ktime_get+0xb6/0x190 [ 5905.396283][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5905.396287][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5905.396291][ C0] run_timer_softirq+0x72/0x100 [ 5905.396295][ C0] __do_softirq+0x1bc/0x7ff [ 5905.396299][ C0] irq_exit_rcu+0x98/0xc0 [ 5905.396302][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5905.396306][ C0] [ 5905.396307][ C0] [ 5905.396308][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5905.396314][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5905.396317][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5905.396319][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5905.396321][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5905.396323][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5905.396325][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5905.396326][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5905.396328][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5905.396331][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5905.396335][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5905.396339][ C0] default_idle_call+0x69/0xa0 [ 5905.396341][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5905.396344][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5905.396349][ C0] ? lock_release+0x1d5/0x250 [ 5905.396353][ C0] do_idle+0xfb/0x160 [ 5905.396356][ C0] cpu_startup_entry+0x55/0x60 [ 5905.396359][ C0] rest_init+0x153/0x260 [ 5905.396361][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5905.396367][ C0] arch_call_rest_init+0x13/0x40 [ 5905.396373][ C0] start_kernel+0x314/0x3d0 [ 5905.396377][ C0] x86_64_start_reservations+0x18/0x30 [ 5905.396381][ C0] x86_64_start_kernel+0xba/0x110 [ 5905.396385][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5905.396394][ C0] [ 5905.396648][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5905.396655][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5905.451164][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 5905.451507][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 5905.452521][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5905.452841][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5905.453259][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5905.453674][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5905.454090][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5905.454504][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5905.454921][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5905.455390][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5905.455740][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5905.456162][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5905.456588][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5905.457008][ C1] Call Trace: [ 5905.457187][ C1] [ 5905.457347][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5905.457638][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5905.457909][ C1] ? check_cpu_stall+0x284/0x500 [ 5905.458171][ C1] ? rcu_pending+0x92/0x360 [ 5905.458415][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5905.458697][ C1] ? update_process_times+0xb9/0x110 [ 5905.458978][ C1] ? tick_sched_handle+0x67/0x130 [ 5905.459249][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5905.459550][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5905.459803][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5905.460135][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5905.460420][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5905.460719][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5905.460995][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5905.461316][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5905.461592][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5905.461911][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5905.462221][ C1] [ 5905.462380][ C1] [ 5905.462540][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5905.462870][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5905.463171][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 5905.463471][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5905.463771][ C1] ? run_ksoftirqd+0xb/0x60 [ 5905.464013][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5905.464338][ C1] ? __orc_find+0x9c/0xf0 [ 5905.464572][ C1] ? lock_acquire+0x1c1/0x220 [ 5905.464823][ C1] ? irqentry_enter+0x2b/0x60 [ 5905.465077][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5905.465338][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5905.465626][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5905.465927][ C1] ? lock_acquire+0x1c1/0x220 [ 5905.466177][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5905.466429][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5905.466700][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5905.466952][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5905.467213][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5905.467487][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5905.467784][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5905.468075][ C1] ip_local_deliver+0x19d/0x480 [ 5905.468335][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5905.468620][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5905.468889][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5905.469166][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5905.469428][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5905.469763][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5905.470036][ C1] ip_rcv+0x564/0x740 [ 5905.470249][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5905.470487][ C1] ? set_track_prepare+0x8a/0xd0 [ 5905.470751][ C1] ? irqentry_enter+0x2b/0x60 [ 5905.471005][ C1] ? irqentry_enter+0x2b/0x60 [ 5905.471261][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5905.471505][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5905.471820][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5905.472164][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5905.472475][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5905.472814][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5905.473113][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5905.473447][ C1] netif_receive_skb+0x55/0x280 [ 5905.473709][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5905.474038][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5905.474390][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5905.474700][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5905.474989][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5905.475292][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5905.475625][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5905.475906][ C1] ? arch_stack_walk+0x68/0x100 [ 5905.476167][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5905.476441][ C1] ? irqentry_enter+0x2b/0x60 [ 5905.476691][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5905.477009][ C1] ? irqentry_enter+0x2b/0x60 [ 5905.477264][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5905.477588][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5905.477875][ C1] ? arch_stack_walk+0x68/0x100 [ 5905.478135][ C1] __tcf_classify+0x32c/0x7d0 [ 5905.478384][ C1] tcf_classify+0x283/0x930 [ 5905.478624][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5905.478891][ C1] tc_run+0x2e4/0x5d0 [ 5905.479105][ C1] ? __pfx_tc_run+0x10/0x10 [ 5905.479346][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5905.479611][ C1] ? irqentry_enter+0x2b/0x60 [ 5905.479866][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5905.480155][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5905.480476][ C1] ip_finish_output2+0x786/0x18e0 [ 5905.480744][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5905.481034][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5905.481299][ C1] ? __ip_finish_output+0x10f/0x770 [ 5905.481574][ C1] ip_output+0x16b/0x4f0 [ 5905.481801][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5905.482121][ C1] ? __pfx_ip_output+0x10/0x10 [ 5905.482375][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5905.482729][ C1] ? __pfx_ip_output+0x10/0x10 [ 5905.482985][ C1] __ip_queue_xmit+0x672/0x1910 [ 5905.483245][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5905.483523][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5905.483815][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5905.484099][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5905.484392][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5905.484676][ C1] tcp_delack_timer+0x84/0x240 [ 5905.484932][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5905.485221][ C1] call_timer_fn+0x176/0x430 [ 5905.485471][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5905.485742][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5905.486021][ C1] __run_timers.part.0+0x52d/0x890 [ 5905.486296][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5905.486583][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5905.486881][ C1] ? __pfx___schedule+0x10/0x10 [ 5905.487142][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5905.487464][ C1] run_timer_softirq+0x72/0x100 [ 5905.487727][ C1] __do_softirq+0x1bc/0x7ff [ 5905.487973][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5905.488247][ C1] run_ksoftirqd+0x2e/0x60 [ 5905.488483][ C1] smpboot_thread_fn+0x30e/0x840 [ 5905.488747][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5905.489036][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5905.489329][ C1] kthread+0x292/0x360 [ 5905.489545][ C1] ? __pfx_kthread+0x10/0x10 [ 5905.489793][ C1] ret_from_fork+0x34/0x70 [ 5905.490030][ C1] ? __pfx_kthread+0x10/0x10 [ 5905.490277][ C1] ret_from_fork_asm+0x1b/0x30 [ 5905.490534][ C1] [ 5932.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4419s! [swapper/0:0] [ 5932.527923][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5932.529137][ C0] irq event stamp: 27567077 [ 5932.529377][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5932.529907][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5932.530389][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5932.530905][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5932.531407][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5932.531893][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5932.532535][ C0] RIP: 0010:kasan_check_range+0x10f/0x1c0 [ 5932.532844][ C0] Code: 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff 5b b8 01 00 00 00 5d 41 5c cc cc cc cc 41 bc 08 00 00 00 45 29 dc 49 8d 14 2c eb 0c 48 83 [ 5932.533861][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000246 [ 5932.534182][ C0] RAX: 0000000000000001 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5932.534600][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5932.535020][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5932.535440][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5932.535858][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5932.536276][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5932.536754][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5932.537106][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5932.537531][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5932.537956][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5932.538379][ C0] Call Trace: [ 5932.538559][ C0] [ 5932.538715][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5932.538993][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5932.539247][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5932.539545][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5932.539830][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5932.540133][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5932.540413][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5932.540734][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5932.541012][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5932.541288][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5932.541615][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5932.541930][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5932.542264][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5932.542570][ C0] ? kasan_check_range+0x10f/0x1c0 [ 5932.542845][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 5932.543140][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5932.543466][ C0] ? get_stack_info+0x36/0xc0 [ 5932.543722][ C0] ? lock_acquire+0x1c1/0x220 [ 5932.543977][ C0] ? lock_release+0x1d5/0x250 [ 5932.544231][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5932.544492][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5932.544783][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5932.545087][ C0] ? lock_acquire+0x1c1/0x220 [ 5932.545337][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5932.545591][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5932.545863][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5932.546113][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5932.546374][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5932.546653][ C0] ? __inet_lookup_established+0x341/0x610 [ 5932.546966][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5932.547255][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5932.547548][ C0] ip_local_deliver+0x19d/0x480 [ 5932.547815][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5932.548099][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5932.548364][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5932.548647][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5932.548915][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5932.549252][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5932.549533][ C0] ip_rcv+0x564/0x740 [ 5932.549754][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5932.550004][ C0] ? set_track_prepare+0x8a/0xd0 [ 5932.550273][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5932.550561][ C0] ? rest_init+0x153/0x260 [ 5932.550801][ C0] ? skb_clone+0x10b/0x330 [ 5932.551039][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5932.551376][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5932.551701][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5932.551996][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5932.552305][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5932.552564][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5932.552805][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5932.553118][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5932.553414][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5932.553759][ C0] ? lock_acquire+0x1c1/0x220 [ 5932.554017][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5932.554329][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5932.554626][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5932.554961][ C0] ? __copy_skb_header+0xaf/0x490 [ 5932.555234][ C0] ? __skb_clone+0x57a/0x760 [ 5932.555483][ C0] netif_receive_skb+0x55/0x280 [ 5932.555741][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5932.556071][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5932.556420][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5932.556739][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5932.557028][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5932.557329][ C0] ? hlock_class+0x4e/0x130 [ 5932.557581][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5932.557912][ C0] ? place_entity+0x21/0x2f0 [ 5932.558162][ C0] ? resched_curr+0x219/0x280 [ 5932.558412][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5932.558679][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5932.558960][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5932.559242][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5932.559501][ C0] ? activate_task+0xf5/0x260 [ 5932.559756][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5932.560036][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5932.560310][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5932.560573][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5932.560866][ C0] ? get_stack_info+0x36/0xc0 [ 5932.561116][ C0] ? stack_access_ok+0xda/0x1f0 [ 5932.561372][ C0] ? get_reg+0x119/0x190 [ 5932.561599][ C0] __tcf_classify+0x32c/0x7d0 [ 5932.561855][ C0] tcf_classify+0x283/0x930 [ 5932.562102][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5932.562435][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5932.562701][ C0] ? arch_stack_walk+0x8c/0x100 [ 5932.562960][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5932.563250][ C0] tc_run+0x2e4/0x5d0 [ 5932.563471][ C0] ? __pfx_tc_run+0x10/0x10 [ 5932.563718][ C0] ? lock_acquire+0x1c1/0x220 [ 5932.563971][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5932.564252][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5932.564516][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5932.564807][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5932.565092][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5932.565416][ C0] ? neigh_hh_output+0x348/0x590 [ 5932.565680][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5932.565959][ C0] ip_finish_output2+0x786/0x18e0 [ 5932.566231][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5932.566532][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5932.566882][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5932.567170][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5932.567437][ C0] ? __ip_finish_output+0x10f/0x770 [ 5932.567720][ C0] ip_output+0x16b/0x4f0 [ 5932.567951][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5932.568236][ C0] ? __pfx_ip_output+0x10/0x10 [ 5932.568494][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5932.568793][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5932.569062][ C0] ? ip_local_out+0x114/0x3b0 [ 5932.569313][ C0] __ip_queue_xmit+0x672/0x1910 [ 5932.569574][ C0] ? __skb_clone+0x57a/0x760 [ 5932.569823][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5932.570108][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5932.570410][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5932.570730][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5932.570992][ C0] ? tcp_current_mss+0x40a/0x510 [ 5932.571256][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5932.571541][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5932.571818][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5932.572075][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5932.572348][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5932.572673][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5932.572950][ C0] ? ktime_get+0xb6/0x190 [ 5932.573183][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5932.573456][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5932.573740][ C0] tcp_write_timer+0x82/0x1d0 [ 5932.573991][ C0] call_timer_fn+0x176/0x430 [ 5932.574241][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5932.574517][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5932.574790][ C0] __run_timers.part.0+0x52d/0x890 [ 5932.575066][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5932.575349][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5932.575653][ C0] ? lock_acquire+0x1c1/0x220 [ 5932.575904][ C0] ? clockevents_program_event+0xf6/0x300 [ 5932.576210][ C0] ? lock_release+0x1d5/0x250 [ 5932.576457][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5932.576732][ C0] ? ktime_get+0xb6/0x190 [ 5932.576963][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5932.577261][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5932.577583][ C0] run_timer_softirq+0x72/0x100 [ 5932.577849][ C0] __do_softirq+0x1bc/0x7ff [ 5932.578098][ C0] irq_exit_rcu+0x98/0xc0 [ 5932.578333][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5932.578636][ C0] [ 5932.578793][ C0] [ 5932.578950][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5932.579268][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5932.579545][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5932.580570][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5932.580896][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5932.581329][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5932.581750][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5932.582170][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5932.582594][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5932.583027][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5932.583332][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5932.583608][ C0] default_idle_call+0x69/0xa0 [ 5932.583862][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5932.584126][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5932.584415][ C0] ? lock_release+0x1d5/0x250 [ 5932.584670][ C0] do_idle+0xfb/0x160 [ 5932.584890][ C0] cpu_startup_entry+0x55/0x60 [ 5932.585148][ C0] rest_init+0x153/0x260 [ 5932.585373][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5932.585666][ C0] arch_call_rest_init+0x13/0x40 [ 5932.585937][ C0] start_kernel+0x314/0x3d0 [ 5932.586182][ C0] x86_64_start_reservations+0x18/0x30 [ 5932.586473][ C0] x86_64_start_kernel+0xba/0x110 [ 5932.586744][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5932.587080][ C0] [ 5932.587247][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4419s! [ksoftirqd/1:22] [ 5932.587714][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5932.588910][ C1] irq event stamp: 3886976 [ 5932.589146][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5932.589646][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5932.590149][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5932.590649][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5932.591137][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5932.591635][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5932.592281][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5932.592624][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5932.593656][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5932.593982][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5932.594406][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5932.594830][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5932.595257][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5932.595678][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5932.596104][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5932.596577][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5932.596926][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5932.597349][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5932.597776][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5932.598201][ C1] Call Trace: [ 5932.598386][ C1] [ 5932.598542][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5932.598819][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5932.599076][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5932.599365][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5932.599659][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5932.599970][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5932.600254][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5932.600575][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5932.600848][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5932.601179][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5932.601490][ C1] [ 5932.601647][ C1] [ 5932.601803][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5932.602134][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5932.602439][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5932.602752][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5932.603055][ C1] ? run_ksoftirqd+0xb/0x60 [ 5932.603295][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5932.603622][ C1] ? __orc_find+0x9c/0xf0 [ 5932.603855][ C1] ? lock_acquire+0x1c1/0x220 [ 5932.604111][ C1] ? irqentry_enter+0x2b/0x60 [ 5932.604367][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5932.604629][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5932.604917][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5932.605218][ C1] ? lock_acquire+0x1c1/0x220 [ 5932.605466][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5932.605719][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5932.605991][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5932.606242][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5932.606504][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5932.606778][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5932.607071][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5932.607366][ C1] ip_local_deliver+0x19d/0x480 [ 5932.607632][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5932.607921][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5932.608192][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5932.608469][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5932.608731][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5932.609070][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5932.609343][ C1] ip_rcv+0x564/0x740 [ 5932.609555][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5932.609795][ C1] ? set_track_prepare+0x8a/0xd0 [ 5932.610059][ C1] ? irqentry_enter+0x2b/0x60 [ 5932.610312][ C1] ? irqentry_enter+0x2b/0x60 [ 5932.610564][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5932.610808][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5932.611129][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5932.611475][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5932.611784][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5932.612125][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5932.612422][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5932.612759][ C1] netif_receive_skb+0x55/0x280 [ 5932.613026][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5932.613362][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5932.613711][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5932.614026][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5932.614318][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5932.614630][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5932.614961][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5932.615246][ C1] ? arch_stack_walk+0x68/0x100 [ 5932.615507][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5932.615782][ C1] ? irqentry_enter+0x2b/0x60 [ 5932.616031][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5932.616348][ C1] ? irqentry_enter+0x2b/0x60 [ 5932.616601][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5932.616929][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5932.617211][ C1] ? arch_stack_walk+0x68/0x100 [ 5932.617477][ C1] __tcf_classify+0x32c/0x7d0 [ 5932.617752][ C1] tcf_classify+0x283/0x930 [ 5932.617994][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5932.618264][ C1] tc_run+0x2e4/0x5d0 [ 5932.618477][ C1] ? __pfx_tc_run+0x10/0x10 [ 5932.618720][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5932.618987][ C1] ? irqentry_enter+0x2b/0x60 [ 5932.619241][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5932.619528][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5932.619855][ C1] ip_finish_output2+0x786/0x18e0 [ 5932.620126][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5932.620413][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5932.620683][ C1] ? __ip_finish_output+0x10f/0x770 [ 5932.620965][ C1] ip_output+0x16b/0x4f0 [ 5932.621193][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5932.621520][ C1] ? __pfx_ip_output+0x10/0x10 [ 5932.621777][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5932.622137][ C1] ? __pfx_ip_output+0x10/0x10 [ 5932.622398][ C1] __ip_queue_xmit+0x672/0x1910 [ 5932.622659][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5932.622940][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5932.623236][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5932.623525][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5932.623820][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5932.624105][ C1] tcp_delack_timer+0x84/0x240 [ 5932.624359][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5932.624645][ C1] call_timer_fn+0x176/0x430 [ 5932.624894][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5932.625170][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5932.625450][ C1] __run_timers.part.0+0x52d/0x890 [ 5932.625725][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5932.626012][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5932.626313][ C1] ? __pfx___schedule+0x10/0x10 [ 5932.626577][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5932.626898][ C1] run_timer_softirq+0x72/0x100 [ 5932.627159][ C1] __do_softirq+0x1bc/0x7ff [ 5932.627400][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5932.627677][ C1] run_ksoftirqd+0x2e/0x60 [ 5932.627916][ C1] smpboot_thread_fn+0x30e/0x840 [ 5932.628187][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5932.628478][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5932.628769][ C1] kthread+0x292/0x360 [ 5932.628986][ C1] ? __pfx_kthread+0x10/0x10 [ 5932.629236][ C1] ret_from_fork+0x34/0x70 [ 5932.629472][ C1] ? __pfx_kthread+0x10/0x10 [ 5932.629720][ C1] ret_from_fork_asm+0x1b/0x30 [ 5932.629980][ C1] [ 5960.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4445s! [swapper/0:0] [ 5960.527917][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5960.529110][ C0] irq event stamp: 27567077 [ 5960.529349][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 5960.529883][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 5960.530360][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 5960.530866][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 5960.531374][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5960.531860][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5960.532502][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 5960.532837][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 5960.533860][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5960.534190][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5960.534610][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5960.535032][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5960.535458][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5960.535884][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5960.536305][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5960.536775][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5960.537123][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5960.537550][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5960.537970][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5960.538393][ C0] Call Trace: [ 5960.538576][ C0] [ 5960.538733][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5960.539008][ C0] ? __run_hrtimer+0x1c3/0x710 [ 5960.539265][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5960.539553][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 5960.539840][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5960.540149][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5960.540430][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5960.540754][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 5960.541027][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 5960.541306][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5960.541627][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5960.541937][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5960.542270][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5960.542572][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 5960.542874][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5960.543175][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5960.543501][ C0] ? get_stack_info+0x36/0xc0 [ 5960.543759][ C0] ? lock_acquire+0x1c1/0x220 [ 5960.544016][ C0] ? lock_release+0x1d5/0x250 [ 5960.544271][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5960.544535][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5960.544821][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5960.545121][ C0] ? lock_acquire+0x1c1/0x220 [ 5960.545366][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5960.545616][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5960.545894][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5960.546145][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5960.546406][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5960.546678][ C0] ? __inet_lookup_established+0x341/0x610 [ 5960.546993][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5960.547282][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5960.547580][ C0] ip_local_deliver+0x19d/0x480 [ 5960.547838][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5960.548122][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5960.548384][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5960.548663][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5960.548929][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5960.549270][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5960.549553][ C0] ip_rcv+0x564/0x740 [ 5960.549769][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5960.550016][ C0] ? set_track_prepare+0x8a/0xd0 [ 5960.550284][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5960.550572][ C0] ? rest_init+0x153/0x260 [ 5960.550811][ C0] ? skb_clone+0x10b/0x330 [ 5960.551049][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5960.551388][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5960.551712][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5960.552008][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5960.552315][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5960.552572][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5960.552811][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5960.553124][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5960.553420][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5960.553763][ C0] ? lock_acquire+0x1c1/0x220 [ 5960.554015][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5960.554327][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5960.554623][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5960.554956][ C0] ? __copy_skb_header+0xaf/0x490 [ 5960.555229][ C0] ? __skb_clone+0x57a/0x760 [ 5960.555478][ C0] netif_receive_skb+0x55/0x280 [ 5960.555736][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5960.556063][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5960.556409][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5960.556724][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5960.557009][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5960.557309][ C0] ? hlock_class+0x4e/0x130 [ 5960.557561][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5960.557894][ C0] ? place_entity+0x21/0x2f0 [ 5960.558143][ C0] ? resched_curr+0x219/0x280 [ 5960.558394][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5960.558659][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5960.558938][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5960.559219][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5960.559480][ C0] ? activate_task+0xf5/0x260 [ 5960.559732][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5960.560010][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5960.560283][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5960.560548][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5960.560843][ C0] ? get_stack_info+0x36/0xc0 [ 5960.561095][ C0] ? stack_access_ok+0xda/0x1f0 [ 5960.561352][ C0] ? get_reg+0x119/0x190 [ 5960.561580][ C0] __tcf_classify+0x32c/0x7d0 [ 5960.561836][ C0] tcf_classify+0x283/0x930 [ 5960.562082][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5960.562411][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5960.562676][ C0] ? arch_stack_walk+0x8c/0x100 [ 5960.562936][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5960.563224][ C0] tc_run+0x2e4/0x5d0 [ 5960.563441][ C0] ? __pfx_tc_run+0x10/0x10 [ 5960.563687][ C0] ? lock_acquire+0x1c1/0x220 [ 5960.563939][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5960.564216][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5960.564481][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5960.564768][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5960.565049][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5960.565373][ C0] ? neigh_hh_output+0x348/0x590 [ 5960.565638][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5960.565918][ C0] ip_finish_output2+0x786/0x18e0 [ 5960.566188][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5960.566482][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5960.566832][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5960.567122][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5960.567387][ C0] ? __ip_finish_output+0x10f/0x770 [ 5960.567667][ C0] ip_output+0x16b/0x4f0 [ 5960.567897][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5960.568180][ C0] ? __pfx_ip_output+0x10/0x10 [ 5960.568438][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5960.568736][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5960.569001][ C0] ? ip_local_out+0x114/0x3b0 [ 5960.569250][ C0] __ip_queue_xmit+0x672/0x1910 [ 5960.569508][ C0] ? __skb_clone+0x57a/0x760 [ 5960.569753][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5960.570037][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5960.570334][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5960.570655][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5960.570910][ C0] ? tcp_current_mss+0x40a/0x510 [ 5960.571177][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5960.571457][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5960.571740][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5960.571996][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5960.572263][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5960.572580][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5960.572860][ C0] ? ktime_get+0xb6/0x190 [ 5960.573095][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5960.573371][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5960.573651][ C0] tcp_write_timer+0x82/0x1d0 [ 5960.573911][ C0] call_timer_fn+0x176/0x430 [ 5960.574161][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5960.574434][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5960.574710][ C0] __run_timers.part.0+0x52d/0x890 [ 5960.574981][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5960.575267][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5960.575564][ C0] ? lock_acquire+0x1c1/0x220 [ 5960.575817][ C0] ? clockevents_program_event+0xf6/0x300 [ 5960.576126][ C0] ? lock_release+0x1d5/0x250 [ 5960.576378][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5960.576658][ C0] ? ktime_get+0xb6/0x190 [ 5960.576890][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5960.577194][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5960.577509][ C0] run_timer_softirq+0x72/0x100 [ 5960.577767][ C0] __do_softirq+0x1bc/0x7ff [ 5960.578008][ C0] irq_exit_rcu+0x98/0xc0 [ 5960.578238][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5960.578538][ C0] [ 5960.578698][ C0] [ 5960.578858][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5960.579182][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5960.579448][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5960.580463][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5960.580782][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5960.581198][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5960.581615][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5960.582030][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5960.582447][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5960.582865][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5960.583169][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5960.583440][ C0] default_idle_call+0x69/0xa0 [ 5960.583699][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5960.583961][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5960.584255][ C0] ? lock_release+0x1d5/0x250 [ 5960.584503][ C0] do_idle+0xfb/0x160 [ 5960.584713][ C0] cpu_startup_entry+0x55/0x60 [ 5960.584964][ C0] rest_init+0x153/0x260 [ 5960.585195][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5960.585480][ C0] arch_call_rest_init+0x13/0x40 [ 5960.585749][ C0] start_kernel+0x314/0x3d0 [ 5960.585995][ C0] x86_64_start_reservations+0x18/0x30 [ 5960.586288][ C0] x86_64_start_kernel+0xba/0x110 [ 5960.586560][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5960.586885][ C0] [ 5960.587050][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4445s! [ksoftirqd/1:22] [ 5960.587520][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 5960.588722][ C1] irq event stamp: 3886976 [ 5960.588960][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 5960.589456][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 5960.589948][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 5960.590447][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 5960.590938][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5960.591430][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5960.592072][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 5960.592408][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 5960.593429][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5960.593752][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5960.594178][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5960.594598][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5960.595019][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5960.595444][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5960.595868][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5960.596340][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5960.596688][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5960.597116][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5960.597544][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5960.597963][ C1] Call Trace: [ 5960.598142][ C1] [ 5960.598301][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5960.598577][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5960.598836][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5960.599127][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5960.599414][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5960.599718][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5960.600006][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5960.600332][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5960.600606][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5960.600933][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5960.601248][ C1] [ 5960.601404][ C1] [ 5960.601561][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5960.601890][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5960.602198][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 5960.602503][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5960.602808][ C1] ? run_ksoftirqd+0xb/0x60 [ 5960.603056][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5960.603384][ C1] ? __orc_find+0x9c/0xf0 [ 5960.603614][ C1] ? lock_acquire+0x1c1/0x220 [ 5960.603863][ C1] ? irqentry_enter+0x2b/0x60 [ 5960.604112][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5960.604371][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5960.604655][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5960.604953][ C1] ? lock_acquire+0x1c1/0x220 [ 5960.605205][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5960.605459][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5960.605734][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5960.605978][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5960.606236][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5960.606506][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5960.606791][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5960.607080][ C1] ip_local_deliver+0x19d/0x480 [ 5960.607342][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5960.607638][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5960.607905][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5960.608186][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5960.608454][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5960.608791][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5960.609068][ C1] ip_rcv+0x564/0x740 [ 5960.609289][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5960.609534][ C1] ? set_track_prepare+0x8a/0xd0 [ 5960.609804][ C1] ? irqentry_enter+0x2b/0x60 [ 5960.610057][ C1] ? irqentry_enter+0x2b/0x60 [ 5960.610308][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5960.610549][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5960.610862][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5960.611202][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5960.611511][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5960.611852][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5960.612153][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5960.612481][ C1] netif_receive_skb+0x55/0x280 [ 5960.612740][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5960.613065][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5960.613412][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5960.613729][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5960.614016][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5960.614317][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5960.614643][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5960.614923][ C1] ? arch_stack_walk+0x68/0x100 [ 5960.615186][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5960.615465][ C1] ? irqentry_enter+0x2b/0x60 [ 5960.615719][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5960.616043][ C1] ? irqentry_enter+0x2b/0x60 [ 5960.616294][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5960.616617][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5960.616901][ C1] ? arch_stack_walk+0x68/0x100 [ 5960.617159][ C1] __tcf_classify+0x32c/0x7d0 [ 5960.617409][ C1] tcf_classify+0x283/0x930 [ 5960.617658][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5960.617930][ C1] tc_run+0x2e4/0x5d0 [ 5960.618153][ C1] ? __pfx_tc_run+0x10/0x10 [ 5960.618401][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5960.618671][ C1] ? irqentry_enter+0x2b/0x60 [ 5960.618922][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5960.619209][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5960.619530][ C1] ip_finish_output2+0x786/0x18e0 [ 5960.619805][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5960.620098][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5960.620360][ C1] ? __ip_finish_output+0x10f/0x770 [ 5960.620641][ C1] ip_output+0x16b/0x4f0 [ 5960.620875][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5960.621194][ C1] ? __pfx_ip_output+0x10/0x10 [ 5960.621455][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5960.621808][ C1] ? __pfx_ip_output+0x10/0x10 [ 5960.622063][ C1] __ip_queue_xmit+0x672/0x1910 [ 5960.622328][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5960.622614][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5960.622913][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5960.623205][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5960.623506][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5960.623796][ C1] tcp_delack_timer+0x84/0x240 [ 5960.624055][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5960.624340][ C1] call_timer_fn+0x176/0x430 [ 5960.624590][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5960.624867][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5960.625145][ C1] __run_timers.part.0+0x52d/0x890 [ 5960.625417][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5960.625709][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5960.626013][ C1] ? __pfx___schedule+0x10/0x10 [ 5960.626272][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5960.626589][ C1] run_timer_softirq+0x72/0x100 [ 5960.626851][ C1] __do_softirq+0x1bc/0x7ff [ 5960.627097][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5960.627373][ C1] run_ksoftirqd+0x2e/0x60 [ 5960.627617][ C1] smpboot_thread_fn+0x30e/0x840 [ 5960.627881][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5960.628178][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5960.628469][ C1] kthread+0x292/0x360 [ 5960.628689][ C1] ? __pfx_kthread+0x10/0x10 [ 5960.628933][ C1] ret_from_fork+0x34/0x70 [ 5960.629175][ C1] ? __pfx_kthread+0x10/0x10 [ 5960.629421][ C1] ret_from_fork_asm+0x1b/0x30 [ 5960.629686][ C1] [ 5983.493024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5983.493400][ C1] rcu: 1-....: (4775328 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1136388 [ 5983.493991][ C1] rcu: (t=4789184 jiffies g=1007429 q=31 ncpus=4) [ 5983.494344][ C1] Sending NMI from CPU 1 to CPUs 0: [ 5983.494632][ C0] NMI backtrace for cpu 0 [ 5983.494649][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 5983.494653][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5983.494657][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5983.494670][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5983.494674][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 5983.494677][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5983.494679][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 5983.494681][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 5983.494683][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 5983.494685][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 5983.494687][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 5983.494689][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5983.494692][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 5983.494694][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5983.494695][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5983.494697][ C0] Call Trace: [ 5983.494700][ C0] [ 5983.494710][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 5983.494718][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5983.494724][ C0] ? nmi_handle+0x156/0x420 [ 5983.494729][ C0] ? default_do_nmi+0x41/0x100 [ 5983.494733][ C0] ? exc_nmi+0xf3/0x120 [ 5983.494736][ C0] ? end_repeat_nmi+0xf/0x60 [ 5983.494740][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5983.494745][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5983.494748][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5983.494752][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5983.494755][ C0] [ 5983.494756][ C0] [ 5983.494757][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5983.494760][ C0] ? get_stack_info+0x36/0xc0 [ 5983.494765][ C0] ? lock_acquire+0x1c1/0x220 [ 5983.494770][ C0] ? lock_release+0x1d5/0x250 [ 5983.494774][ C0] do_raw_spin_lock+0x1ec/0x270 [ 5983.494778][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5983.494781][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5983.494784][ C0] ? lock_acquire+0x1c1/0x220 [ 5983.494786][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 5983.494792][ C0] _raw_spin_lock_nested+0x65/0x80 [ 5983.494796][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 5983.494803][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5983.494806][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 5983.494810][ C0] ? __inet_lookup_established+0x341/0x610 [ 5983.494817][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 5983.494825][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 5983.494829][ C0] ip_local_deliver+0x19d/0x480 [ 5983.494832][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 5983.494835][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5983.494840][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 5983.494844][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5983.494847][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5983.494850][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5983.494861][ C0] ip_rcv+0x564/0x740 [ 5983.494864][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5983.494867][ C0] ? set_track_prepare+0x8a/0xd0 [ 5983.494871][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 5983.494873][ C0] ? rest_init+0x153/0x260 [ 5983.494876][ C0] ? skb_clone+0x10b/0x330 [ 5983.494882][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5983.494888][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5983.494893][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 5983.494898][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5983.494907][ C0] ? __tcf_classify+0x32c/0x7d0 [ 5983.494910][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 5983.494912][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 5983.494917][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5983.494920][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5983.494923][ C0] ? lock_acquire+0x1c1/0x220 [ 5983.494925][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 5983.494929][ C0] netif_receive_skb_internal+0xb0/0x300 [ 5983.494932][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5983.494935][ C0] ? __copy_skb_header+0xaf/0x490 [ 5983.494938][ C0] ? __skb_clone+0x57a/0x760 [ 5983.494941][ C0] netif_receive_skb+0x55/0x280 [ 5983.494943][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5983.494952][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5983.494958][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5983.494965][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 5983.494970][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 5983.494979][ C0] ? hlock_class+0x4e/0x130 [ 5983.494986][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5983.494996][ C0] ? place_entity+0x21/0x2f0 [ 5983.494999][ C0] ? resched_curr+0x219/0x280 [ 5983.495002][ C0] ? __pfx_resched_curr+0x10/0x10 [ 5983.495005][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 5983.495009][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 5983.495014][ C0] ? wakeup_preempt+0x161/0x2c0 [ 5983.495016][ C0] ? activate_task+0xf5/0x260 [ 5983.495021][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 5983.495027][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 5983.495030][ C0] ? _raw_spin_unlock+0x23/0x40 [ 5983.495034][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5983.495037][ C0] ? get_stack_info+0x36/0xc0 [ 5983.495040][ C0] ? stack_access_ok+0xda/0x1f0 [ 5983.495043][ C0] ? get_reg+0x119/0x190 [ 5983.495046][ C0] __tcf_classify+0x32c/0x7d0 [ 5983.495051][ C0] tcf_classify+0x283/0x930 [ 5983.495054][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5983.495060][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 5983.495062][ C0] ? arch_stack_walk+0x8c/0x100 [ 5983.495067][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 5983.495070][ C0] tc_run+0x2e4/0x5d0 [ 5983.495075][ C0] ? __pfx_tc_run+0x10/0x10 [ 5983.495078][ C0] ? lock_acquire+0x1c1/0x220 [ 5983.495080][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 5983.495086][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 5983.495092][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5983.495095][ C0] ? ip_finish_output2+0x786/0x18e0 [ 5983.495098][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5983.495104][ C0] ? neigh_hh_output+0x348/0x590 [ 5983.495108][ C0] ? ip_finish_output2+0x262/0x18e0 [ 5983.495112][ C0] ip_finish_output2+0x786/0x18e0 [ 5983.495116][ C0] ? stack_depot_save_flags+0x45/0x550 [ 5983.495122][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5983.495130][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 5983.495133][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5983.495137][ C0] ? __ip_finish_output+0x10f/0x770 [ 5983.495141][ C0] ip_output+0x16b/0x4f0 [ 5983.495145][ C0] ? __run_timers.part.0+0x52d/0x890 [ 5983.495150][ C0] ? __pfx_ip_output+0x10/0x10 [ 5983.495153][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5983.495158][ C0] ? rcu_read_lock_held+0xe/0x50 [ 5983.495160][ C0] ? ip_local_out+0x114/0x3b0 [ 5983.495165][ C0] __ip_queue_xmit+0x672/0x1910 [ 5983.495169][ C0] ? __skb_clone+0x57a/0x760 [ 5983.495172][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 5983.495180][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5983.495184][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 5983.495188][ C0] tcp_write_xmit+0xe42/0x24c0 [ 5983.495194][ C0] ? tcp_current_mss+0x40a/0x510 [ 5983.495197][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 5983.495200][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 5983.495203][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 5983.495205][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 5983.495208][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5983.495212][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5983.495217][ C0] ? ktime_get+0xb6/0x190 [ 5983.495221][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 5983.495225][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5983.495229][ C0] tcp_write_timer+0x82/0x1d0 [ 5983.495232][ C0] call_timer_fn+0x176/0x430 [ 5983.495236][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 5983.495241][ C0] ? next_expiry_recalc+0xcd/0x220 [ 5983.495245][ C0] __run_timers.part.0+0x52d/0x890 [ 5983.495248][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 5983.495253][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 5983.495256][ C0] ? lock_acquire+0x1c1/0x220 [ 5983.495258][ C0] ? clockevents_program_event+0xf6/0x300 [ 5983.495263][ C0] ? lock_release+0x1d5/0x250 [ 5983.495266][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 5983.495268][ C0] ? ktime_get+0xb6/0x190 [ 5983.495271][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 5983.495275][ C0] ? clockevents_program_event+0x1ed/0x300 [ 5983.495279][ C0] run_timer_softirq+0x72/0x100 [ 5983.495283][ C0] __do_softirq+0x1bc/0x7ff [ 5983.495287][ C0] irq_exit_rcu+0x98/0xc0 [ 5983.495290][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 5983.495294][ C0] [ 5983.495295][ C0] [ 5983.495296][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5983.495303][ C0] RIP: 0010:default_idle+0xf/0x20 [ 5983.495306][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5983.495308][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 5983.495310][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 5983.495312][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 5983.495314][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 5983.495315][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 5983.495317][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 5983.495321][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5983.495324][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 5983.495328][ C0] default_idle_call+0x69/0xa0 [ 5983.495330][ C0] cpuidle_idle_call+0x1f6/0x280 [ 5983.495333][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5983.495338][ C0] ? lock_release+0x1d5/0x250 [ 5983.495342][ C0] do_idle+0xfb/0x160 [ 5983.495344][ C0] cpu_startup_entry+0x55/0x60 [ 5983.495347][ C0] rest_init+0x153/0x260 [ 5983.495349][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 5983.495355][ C0] arch_call_rest_init+0x13/0x40 [ 5983.495361][ C0] start_kernel+0x314/0x3d0 [ 5983.495364][ C0] x86_64_start_reservations+0x18/0x30 [ 5983.495369][ C0] x86_64_start_kernel+0xba/0x110 [ 5983.495373][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 5983.495381][ C0] [ 5983.495628][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 5983.549717][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5983.550368][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5983.550716][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5983.551738][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 5983.552069][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 5983.552492][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 5983.552914][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 5983.553341][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 5983.553768][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 5983.554191][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5983.554662][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5983.555010][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 5983.555432][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5983.555850][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5983.556272][ C1] Call Trace: [ 5983.556450][ C1] [ 5983.556605][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5983.556895][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5983.557160][ C1] ? check_cpu_stall+0x284/0x500 [ 5983.557433][ C1] ? rcu_pending+0x92/0x360 [ 5983.557680][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5983.557965][ C1] ? update_process_times+0xb9/0x110 [ 5983.558248][ C1] ? tick_sched_handle+0x67/0x130 [ 5983.558522][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5983.558822][ C1] ? __run_hrtimer+0x1c3/0x710 [ 5983.559075][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5983.559404][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5983.559687][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5983.559989][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5983.560270][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 5983.560588][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5983.560868][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 5983.561192][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 5983.561504][ C1] [ 5983.561663][ C1] [ 5983.561821][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5983.562157][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5983.562458][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5983.562766][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5983.563071][ C1] ? run_ksoftirqd+0xb/0x60 [ 5983.563316][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5983.563646][ C1] ? __orc_find+0x9c/0xf0 [ 5983.563874][ C1] ? lock_acquire+0x1c1/0x220 [ 5983.564125][ C1] ? irqentry_enter+0x2b/0x60 [ 5983.564377][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5983.564636][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5983.564922][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5983.565220][ C1] ? lock_acquire+0x1c1/0x220 [ 5983.565470][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 5983.565723][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5983.565999][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 5983.566246][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5983.566504][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5983.566773][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5983.567060][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 5983.567352][ C1] ip_local_deliver+0x19d/0x480 [ 5983.567609][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5983.567894][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5983.568158][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 5983.568438][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5983.568704][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5983.569038][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5983.569317][ C1] ip_rcv+0x564/0x740 [ 5983.569532][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5983.569778][ C1] ? set_track_prepare+0x8a/0xd0 [ 5983.570046][ C1] ? irqentry_enter+0x2b/0x60 [ 5983.570295][ C1] ? irqentry_enter+0x2b/0x60 [ 5983.570543][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5983.570783][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5983.571095][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5983.571432][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5983.571739][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5983.572081][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5983.572382][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5983.572713][ C1] netif_receive_skb+0x55/0x280 [ 5983.572972][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5983.573299][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5983.573645][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5983.573960][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 5983.574247][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5983.574548][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5983.574874][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5983.575152][ C1] ? arch_stack_walk+0x68/0x100 [ 5983.575414][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 5983.575694][ C1] ? irqentry_enter+0x2b/0x60 [ 5983.575946][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5983.576270][ C1] ? irqentry_enter+0x2b/0x60 [ 5983.576521][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5983.576841][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 5983.577125][ C1] ? arch_stack_walk+0x68/0x100 [ 5983.577391][ C1] __tcf_classify+0x32c/0x7d0 [ 5983.577647][ C1] tcf_classify+0x283/0x930 [ 5983.577893][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5983.578166][ C1] tc_run+0x2e4/0x5d0 [ 5983.578383][ C1] ? __pfx_tc_run+0x10/0x10 [ 5983.578632][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 5983.578900][ C1] ? irqentry_enter+0x2b/0x60 [ 5983.579149][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5983.579432][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5983.579754][ C1] ip_finish_output2+0x786/0x18e0 [ 5983.580026][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5983.580317][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5983.580585][ C1] ? __ip_finish_output+0x10f/0x770 [ 5983.580865][ C1] ip_output+0x16b/0x4f0 [ 5983.581097][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5983.581415][ C1] ? __pfx_ip_output+0x10/0x10 [ 5983.581674][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 5983.582024][ C1] ? __pfx_ip_output+0x10/0x10 [ 5983.582280][ C1] __ip_queue_xmit+0x672/0x1910 [ 5983.582546][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5983.582828][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5983.583130][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5983.583421][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5983.583719][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5983.584006][ C1] tcp_delack_timer+0x84/0x240 [ 5983.584264][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5983.584548][ C1] call_timer_fn+0x176/0x430 [ 5983.584793][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5983.585071][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 5983.585347][ C1] __run_timers.part.0+0x52d/0x890 [ 5983.585617][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5983.585905][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5983.586208][ C1] ? __pfx___schedule+0x10/0x10 [ 5983.586466][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5983.586783][ C1] run_timer_softirq+0x72/0x100 [ 5983.587051][ C1] __do_softirq+0x1bc/0x7ff [ 5983.587297][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 5983.587580][ C1] run_ksoftirqd+0x2e/0x60 [ 5983.587822][ C1] smpboot_thread_fn+0x30e/0x840 [ 5983.588088][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5983.588381][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 5983.588670][ C1] kthread+0x292/0x360 [ 5983.588888][ C1] ? __pfx_kthread+0x10/0x10 [ 5983.589133][ C1] ret_from_fork+0x34/0x70 [ 5983.589373][ C1] ? __pfx_kthread+0x10/0x10 [ 5983.589619][ C1] ret_from_fork_asm+0x1b/0x30 [ 5983.589881][ C1] [ 6008.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4489s! [swapper/0:0] [ 6008.527918][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6008.529125][ C0] irq event stamp: 27567077 [ 6008.529369][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6008.529905][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6008.530378][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6008.530880][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6008.531375][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6008.531856][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6008.532507][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6008.532849][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6008.533873][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6008.534208][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6008.534631][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6008.535057][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6008.535480][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6008.535905][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6008.536326][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6008.536796][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6008.537143][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6008.537566][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6008.537985][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6008.538406][ C0] Call Trace: [ 6008.538589][ C0] [ 6008.538748][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6008.539022][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6008.539279][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6008.539566][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6008.539853][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6008.540159][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6008.540440][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6008.540762][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6008.541036][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6008.541322][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6008.541643][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6008.541955][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6008.542288][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6008.542589][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6008.542896][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6008.543205][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6008.543533][ C0] ? get_stack_info+0x36/0xc0 [ 6008.543790][ C0] ? lock_acquire+0x1c1/0x220 [ 6008.544046][ C0] ? lock_release+0x1d5/0x250 [ 6008.544296][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6008.544557][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6008.544842][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6008.545138][ C0] ? lock_acquire+0x1c1/0x220 [ 6008.545389][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6008.545644][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6008.545920][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6008.546167][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6008.546425][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6008.546693][ C0] ? __inet_lookup_established+0x341/0x610 [ 6008.547003][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6008.547302][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6008.547592][ C0] ip_local_deliver+0x19d/0x480 [ 6008.547854][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6008.548141][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6008.548407][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6008.548685][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6008.548947][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6008.549286][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6008.549559][ C0] ip_rcv+0x564/0x740 [ 6008.549771][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6008.550014][ C0] ? set_track_prepare+0x8a/0xd0 [ 6008.550278][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6008.550570][ C0] ? rest_init+0x153/0x260 [ 6008.550806][ C0] ? skb_clone+0x10b/0x330 [ 6008.551048][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6008.551382][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6008.551700][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6008.552002][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6008.552314][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6008.552575][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6008.552819][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6008.553138][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6008.553438][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6008.553776][ C0] ? lock_acquire+0x1c1/0x220 [ 6008.554022][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6008.554330][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6008.554631][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6008.554962][ C0] ? __copy_skb_header+0xaf/0x490 [ 6008.555229][ C0] ? __skb_clone+0x57a/0x760 [ 6008.555473][ C0] netif_receive_skb+0x55/0x280 [ 6008.555737][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6008.556066][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6008.556418][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6008.556728][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6008.557016][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6008.557322][ C0] ? hlock_class+0x4e/0x130 [ 6008.557565][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6008.557896][ C0] ? place_entity+0x21/0x2f0 [ 6008.558144][ C0] ? resched_curr+0x219/0x280 [ 6008.558398][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6008.558667][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6008.558950][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6008.559225][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6008.559483][ C0] ? activate_task+0xf5/0x260 [ 6008.559732][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6008.560007][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6008.560281][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6008.560539][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6008.560829][ C0] ? get_stack_info+0x36/0xc0 [ 6008.561086][ C0] ? stack_access_ok+0xda/0x1f0 [ 6008.561346][ C0] ? get_reg+0x119/0x190 [ 6008.561573][ C0] __tcf_classify+0x32c/0x7d0 [ 6008.561824][ C0] tcf_classify+0x283/0x930 [ 6008.562064][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6008.562389][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6008.562659][ C0] ? arch_stack_walk+0x8c/0x100 [ 6008.562923][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6008.563216][ C0] tc_run+0x2e4/0x5d0 [ 6008.563428][ C0] ? __pfx_tc_run+0x10/0x10 [ 6008.563667][ C0] ? lock_acquire+0x1c1/0x220 [ 6008.563914][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6008.564189][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6008.564460][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6008.564742][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6008.565018][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6008.565336][ C0] ? neigh_hh_output+0x348/0x590 [ 6008.565604][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6008.565881][ C0] ip_finish_output2+0x786/0x18e0 [ 6008.566149][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6008.566438][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6008.566796][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6008.567088][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6008.567358][ C0] ? __ip_finish_output+0x10f/0x770 [ 6008.567634][ C0] ip_output+0x16b/0x4f0 [ 6008.567858][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6008.568144][ C0] ? __pfx_ip_output+0x10/0x10 [ 6008.568397][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6008.568700][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6008.568962][ C0] ? ip_local_out+0x114/0x3b0 [ 6008.569216][ C0] __ip_queue_xmit+0x672/0x1910 [ 6008.569479][ C0] ? __skb_clone+0x57a/0x760 [ 6008.569727][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6008.570007][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6008.570299][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6008.570614][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6008.570880][ C0] ? tcp_current_mss+0x40a/0x510 [ 6008.571142][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6008.571424][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6008.571698][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6008.571949][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6008.572231][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6008.572551][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6008.572825][ C0] ? ktime_get+0xb6/0x190 [ 6008.573057][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6008.573330][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6008.573614][ C0] tcp_write_timer+0x82/0x1d0 [ 6008.573861][ C0] call_timer_fn+0x176/0x430 [ 6008.574106][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6008.574382][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6008.574655][ C0] __run_timers.part.0+0x52d/0x890 [ 6008.574931][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6008.575213][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6008.575513][ C0] ? lock_acquire+0x1c1/0x220 [ 6008.575758][ C0] ? clockevents_program_event+0xf6/0x300 [ 6008.576062][ C0] ? lock_release+0x1d5/0x250 [ 6008.576312][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6008.576587][ C0] ? ktime_get+0xb6/0x190 [ 6008.576817][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6008.577115][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6008.577433][ C0] run_timer_softirq+0x72/0x100 [ 6008.577695][ C0] __do_softirq+0x1bc/0x7ff [ 6008.577942][ C0] irq_exit_rcu+0x98/0xc0 [ 6008.578177][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6008.578483][ C0] [ 6008.578639][ C0] [ 6008.578796][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6008.579117][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6008.579388][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6008.580413][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6008.580740][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6008.581162][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6008.581586][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6008.582010][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6008.582431][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6008.582852][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6008.583162][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6008.583437][ C0] default_idle_call+0x69/0xa0 [ 6008.583688][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6008.583955][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6008.584249][ C0] ? lock_release+0x1d5/0x250 [ 6008.584502][ C0] do_idle+0xfb/0x160 [ 6008.584716][ C0] cpu_startup_entry+0x55/0x60 [ 6008.584972][ C0] rest_init+0x153/0x260 [ 6008.585197][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6008.585489][ C0] arch_call_rest_init+0x13/0x40 [ 6008.585754][ C0] start_kernel+0x314/0x3d0 [ 6008.585994][ C0] x86_64_start_reservations+0x18/0x30 [ 6008.586284][ C0] x86_64_start_kernel+0xba/0x110 [ 6008.586556][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6008.586885][ C0] [ 6008.587054][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4489s! [ksoftirqd/1:22] [ 6008.587524][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6008.588731][ C1] irq event stamp: 3886976 [ 6008.588970][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6008.589470][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6008.589962][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6008.590463][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6008.590959][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6008.591453][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6008.592096][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6008.592437][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6008.593459][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6008.593780][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6008.594201][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6008.594624][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6008.595045][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6008.595467][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6008.595887][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6008.596360][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6008.596712][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6008.597138][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6008.597565][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6008.597988][ C1] Call Trace: [ 6008.598169][ C1] [ 6008.598325][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6008.598604][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6008.598858][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6008.599155][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6008.599442][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6008.599744][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6008.600024][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6008.600347][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6008.600629][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6008.600955][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6008.601264][ C1] [ 6008.601425][ C1] [ 6008.601587][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6008.601922][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6008.602226][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6008.602535][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6008.602840][ C1] ? run_ksoftirqd+0xb/0x60 [ 6008.603087][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6008.603420][ C1] ? __orc_find+0x9c/0xf0 [ 6008.603649][ C1] ? lock_acquire+0x1c1/0x220 [ 6008.603901][ C1] ? irqentry_enter+0x2b/0x60 [ 6008.604155][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6008.604415][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6008.604701][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6008.604998][ C1] ? lock_acquire+0x1c1/0x220 [ 6008.605254][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6008.605512][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6008.605791][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6008.606038][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6008.606299][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6008.606570][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6008.606860][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6008.607154][ C1] ip_local_deliver+0x19d/0x480 [ 6008.607421][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6008.607709][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6008.607972][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6008.608255][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6008.608521][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6008.608855][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6008.609136][ C1] ip_rcv+0x564/0x740 [ 6008.609350][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6008.609596][ C1] ? set_track_prepare+0x8a/0xd0 [ 6008.609863][ C1] ? irqentry_enter+0x2b/0x60 [ 6008.610116][ C1] ? irqentry_enter+0x2b/0x60 [ 6008.610364][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6008.610607][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6008.610923][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6008.611263][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6008.611570][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6008.611914][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6008.612217][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6008.612550][ C1] netif_receive_skb+0x55/0x280 [ 6008.612809][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6008.613139][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6008.613486][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6008.613804][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6008.614094][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6008.614398][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6008.614727][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6008.615007][ C1] ? arch_stack_walk+0x68/0x100 [ 6008.615276][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6008.615556][ C1] ? irqentry_enter+0x2b/0x60 [ 6008.615812][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6008.616135][ C1] ? irqentry_enter+0x2b/0x60 [ 6008.616385][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6008.616709][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6008.616994][ C1] ? arch_stack_walk+0x68/0x100 [ 6008.617261][ C1] __tcf_classify+0x32c/0x7d0 [ 6008.617520][ C1] tcf_classify+0x283/0x930 [ 6008.617766][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6008.618041][ C1] tc_run+0x2e4/0x5d0 [ 6008.618257][ C1] ? __pfx_tc_run+0x10/0x10 [ 6008.618504][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6008.618772][ C1] ? irqentry_enter+0x2b/0x60 [ 6008.619021][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6008.619305][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6008.619625][ C1] ip_finish_output2+0x786/0x18e0 [ 6008.619899][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6008.620196][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6008.620461][ C1] ? __ip_finish_output+0x10f/0x770 [ 6008.620743][ C1] ip_output+0x16b/0x4f0 [ 6008.620972][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6008.621290][ C1] ? __pfx_ip_output+0x10/0x10 [ 6008.621548][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6008.621902][ C1] ? __pfx_ip_output+0x10/0x10 [ 6008.622161][ C1] __ip_queue_xmit+0x672/0x1910 [ 6008.622427][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6008.622713][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6008.623012][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6008.623302][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6008.623599][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6008.623887][ C1] tcp_delack_timer+0x84/0x240 [ 6008.624145][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6008.624428][ C1] call_timer_fn+0x176/0x430 [ 6008.624673][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6008.624950][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6008.625230][ C1] __run_timers.part.0+0x52d/0x890 [ 6008.625502][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6008.625792][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6008.626097][ C1] ? __pfx___schedule+0x10/0x10 [ 6008.626358][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6008.626677][ C1] run_timer_softirq+0x72/0x100 [ 6008.626943][ C1] __do_softirq+0x1bc/0x7ff [ 6008.627192][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6008.627472][ C1] run_ksoftirqd+0x2e/0x60 [ 6008.627714][ C1] smpboot_thread_fn+0x30e/0x840 [ 6008.627979][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6008.628274][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6008.628562][ C1] kthread+0x292/0x360 [ 6008.628787][ C1] ? __pfx_kthread+0x10/0x10 [ 6008.629034][ C1] ret_from_fork+0x34/0x70 [ 6008.629275][ C1] ? __pfx_kthread+0x10/0x10 [ 6008.629520][ C1] ret_from_fork_asm+0x1b/0x30 [ 6008.629781][ C1] [ 6036.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4515s! [swapper/0:0] [ 6036.527918][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6036.529108][ C0] irq event stamp: 27567077 [ 6036.529346][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6036.529874][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6036.530349][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6036.530856][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6036.531356][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6036.531840][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6036.532482][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6036.532821][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6036.533839][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6036.534168][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6036.534586][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6036.535004][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6036.535423][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6036.535841][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6036.536261][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6036.536729][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6036.537089][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6036.537510][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6036.537927][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6036.538343][ C0] Call Trace: [ 6036.538521][ C0] [ 6036.538675][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6036.538953][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6036.539206][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6036.539497][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6036.539779][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6036.540083][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6036.540362][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6036.540678][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6036.540953][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6036.541229][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6036.541555][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6036.541870][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6036.542203][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6036.542511][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6036.542822][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6036.543124][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6036.543449][ C0] ? get_stack_info+0x36/0xc0 [ 6036.543708][ C0] ? lock_acquire+0x1c1/0x220 [ 6036.543963][ C0] ? lock_release+0x1d5/0x250 [ 6036.544219][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6036.544481][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6036.544767][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6036.545066][ C0] ? lock_acquire+0x1c1/0x220 [ 6036.545312][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6036.545564][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6036.545834][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6036.546084][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6036.546345][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6036.546616][ C0] ? __inet_lookup_established+0x341/0x610 [ 6036.546934][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6036.547231][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6036.547525][ C0] ip_local_deliver+0x19d/0x480 [ 6036.547782][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6036.548065][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6036.548328][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6036.548607][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6036.548872][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6036.549207][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6036.549483][ C0] ip_rcv+0x564/0x740 [ 6036.549699][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6036.549943][ C0] ? set_track_prepare+0x8a/0xd0 [ 6036.550212][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6036.550500][ C0] ? rest_init+0x153/0x260 [ 6036.550738][ C0] ? skb_clone+0x10b/0x330 [ 6036.550976][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6036.551314][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6036.551639][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6036.551935][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6036.552242][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6036.552499][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6036.552738][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6036.553050][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6036.553347][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6036.553690][ C0] ? lock_acquire+0x1c1/0x220 [ 6036.553943][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6036.554256][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6036.554552][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6036.554886][ C0] ? __copy_skb_header+0xaf/0x490 [ 6036.555159][ C0] ? __skb_clone+0x57a/0x760 [ 6036.555408][ C0] netif_receive_skb+0x55/0x280 [ 6036.555667][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6036.555993][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6036.556340][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6036.556653][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6036.556937][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6036.557239][ C0] ? hlock_class+0x4e/0x130 [ 6036.557487][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6036.557822][ C0] ? place_entity+0x21/0x2f0 [ 6036.558076][ C0] ? resched_curr+0x219/0x280 [ 6036.558326][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6036.558591][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6036.558870][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6036.559149][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6036.559408][ C0] ? activate_task+0xf5/0x260 [ 6036.559659][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6036.559935][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6036.560207][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6036.560471][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6036.560763][ C0] ? get_stack_info+0x36/0xc0 [ 6036.561014][ C0] ? stack_access_ok+0xda/0x1f0 [ 6036.561272][ C0] ? get_reg+0x119/0x190 [ 6036.561498][ C0] __tcf_classify+0x32c/0x7d0 [ 6036.561757][ C0] tcf_classify+0x283/0x930 [ 6036.562002][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6036.562331][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6036.562595][ C0] ? arch_stack_walk+0x8c/0x100 [ 6036.562854][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6036.563142][ C0] tc_run+0x2e4/0x5d0 [ 6036.563359][ C0] ? __pfx_tc_run+0x10/0x10 [ 6036.563604][ C0] ? lock_acquire+0x1c1/0x220 [ 6036.563855][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6036.564133][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6036.564396][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6036.564683][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6036.564962][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6036.565286][ C0] ? neigh_hh_output+0x348/0x590 [ 6036.565549][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6036.565829][ C0] ip_finish_output2+0x786/0x18e0 [ 6036.566099][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6036.566391][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6036.566741][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6036.567030][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6036.567299][ C0] ? __ip_finish_output+0x10f/0x770 [ 6036.567579][ C0] ip_output+0x16b/0x4f0 [ 6036.567806][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6036.568087][ C0] ? __pfx_ip_output+0x10/0x10 [ 6036.568346][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6036.568643][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6036.568906][ C0] ? ip_local_out+0x114/0x3b0 [ 6036.569153][ C0] __ip_queue_xmit+0x672/0x1910 [ 6036.569411][ C0] ? __skb_clone+0x57a/0x760 [ 6036.569656][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6036.569938][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6036.570237][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6036.570556][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6036.570810][ C0] ? tcp_current_mss+0x40a/0x510 [ 6036.571076][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6036.571355][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6036.571633][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6036.571887][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6036.572153][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6036.572468][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6036.572747][ C0] ? ktime_get+0xb6/0x190 [ 6036.572981][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6036.573257][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6036.573540][ C0] tcp_write_timer+0x82/0x1d0 [ 6036.573794][ C0] call_timer_fn+0x176/0x430 [ 6036.574043][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6036.574315][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6036.574590][ C0] __run_timers.part.0+0x52d/0x890 [ 6036.574859][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6036.575143][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6036.575437][ C0] ? lock_acquire+0x1c1/0x220 [ 6036.575690][ C0] ? clockevents_program_event+0xf6/0x300 [ 6036.575999][ C0] ? lock_release+0x1d5/0x250 [ 6036.576250][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6036.576529][ C0] ? ktime_get+0xb6/0x190 [ 6036.576760][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6036.577062][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6036.577378][ C0] run_timer_softirq+0x72/0x100 [ 6036.577635][ C0] __do_softirq+0x1bc/0x7ff [ 6036.577875][ C0] irq_exit_rcu+0x98/0xc0 [ 6036.578104][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6036.578401][ C0] [ 6036.578560][ C0] [ 6036.578720][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6036.579042][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6036.579313][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6036.580326][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6036.580645][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6036.581062][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6036.581478][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6036.581895][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6036.582313][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6036.582731][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6036.583037][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6036.583312][ C0] default_idle_call+0x69/0xa0 [ 6036.583570][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6036.583832][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6036.584128][ C0] ? lock_release+0x1d5/0x250 [ 6036.584376][ C0] do_idle+0xfb/0x160 [ 6036.584587][ C0] cpu_startup_entry+0x55/0x60 [ 6036.584838][ C0] rest_init+0x153/0x260 [ 6036.585068][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6036.585353][ C0] arch_call_rest_init+0x13/0x40 [ 6036.585615][ C0] start_kernel+0x314/0x3d0 [ 6036.585859][ C0] x86_64_start_reservations+0x18/0x30 [ 6036.586160][ C0] x86_64_start_kernel+0xba/0x110 [ 6036.586428][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6036.586752][ C0] [ 6036.586917][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4515s! [ksoftirqd/1:22] [ 6036.587398][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6036.588596][ C1] irq event stamp: 3886976 [ 6036.588834][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6036.589332][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6036.589825][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6036.590329][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6036.590824][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6036.591317][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6036.591959][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6036.592299][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6036.593317][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6036.593637][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6036.594057][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6036.594476][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6036.594893][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6036.595311][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6036.595732][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6036.596202][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6036.596555][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6036.596979][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6036.597409][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6036.597828][ C1] Call Trace: [ 6036.598006][ C1] [ 6036.598163][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6036.598441][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6036.598698][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6036.598993][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6036.599280][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6036.599582][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6036.599860][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6036.600185][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6036.600462][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6036.600783][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6036.601097][ C1] [ 6036.601257][ C1] [ 6036.601418][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6036.601752][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6036.602056][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6036.602364][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6036.602671][ C1] ? run_ksoftirqd+0xb/0x60 [ 6036.602917][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6036.603247][ C1] ? __orc_find+0x9c/0xf0 [ 6036.603480][ C1] ? lock_acquire+0x1c1/0x220 [ 6036.603730][ C1] ? irqentry_enter+0x2b/0x60 [ 6036.603981][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6036.604241][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6036.604523][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6036.604822][ C1] ? lock_acquire+0x1c1/0x220 [ 6036.605078][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6036.605336][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6036.605610][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6036.605857][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6036.606115][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6036.606385][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6036.606675][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6036.606965][ C1] ip_local_deliver+0x19d/0x480 [ 6036.607235][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6036.607519][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6036.607783][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6036.608064][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6036.608331][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6036.608668][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6036.608944][ C1] ip_rcv+0x564/0x740 [ 6036.609163][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6036.609408][ C1] ? set_track_prepare+0x8a/0xd0 [ 6036.609677][ C1] ? irqentry_enter+0x2b/0x60 [ 6036.609928][ C1] ? irqentry_enter+0x2b/0x60 [ 6036.610180][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6036.610421][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6036.610735][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6036.611076][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6036.611386][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6036.611733][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6036.612038][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6036.612372][ C1] netif_receive_skb+0x55/0x280 [ 6036.612630][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6036.612957][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6036.613309][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6036.613627][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6036.613920][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6036.614225][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6036.614563][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6036.614845][ C1] ? arch_stack_walk+0x68/0x100 [ 6036.615111][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6036.615393][ C1] ? irqentry_enter+0x2b/0x60 [ 6036.615648][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6036.615969][ C1] ? irqentry_enter+0x2b/0x60 [ 6036.616219][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6036.616540][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6036.616830][ C1] ? arch_stack_walk+0x68/0x100 [ 6036.617100][ C1] __tcf_classify+0x32c/0x7d0 [ 6036.617356][ C1] tcf_classify+0x283/0x930 [ 6036.617604][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6036.617877][ C1] tc_run+0x2e4/0x5d0 [ 6036.618097][ C1] ? __pfx_tc_run+0x10/0x10 [ 6036.618346][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6036.618616][ C1] ? irqentry_enter+0x2b/0x60 [ 6036.618867][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6036.619154][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6036.619476][ C1] ip_finish_output2+0x786/0x18e0 [ 6036.619752][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6036.620046][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6036.620314][ C1] ? __ip_finish_output+0x10f/0x770 [ 6036.620595][ C1] ip_output+0x16b/0x4f0 [ 6036.620824][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6036.621142][ C1] ? __pfx_ip_output+0x10/0x10 [ 6036.621400][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6036.621752][ C1] ? __pfx_ip_output+0x10/0x10 [ 6036.622008][ C1] __ip_queue_xmit+0x672/0x1910 [ 6036.622274][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6036.622557][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6036.622855][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6036.623145][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6036.623444][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6036.623734][ C1] tcp_delack_timer+0x84/0x240 [ 6036.623995][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6036.624282][ C1] call_timer_fn+0x176/0x430 [ 6036.624534][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6036.624812][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6036.625090][ C1] __run_timers.part.0+0x52d/0x890 [ 6036.625366][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6036.625658][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6036.625962][ C1] ? __pfx___schedule+0x10/0x10 [ 6036.626223][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6036.626545][ C1] run_timer_softirq+0x72/0x100 [ 6036.626808][ C1] __do_softirq+0x1bc/0x7ff [ 6036.627056][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6036.627335][ C1] run_ksoftirqd+0x2e/0x60 [ 6036.627576][ C1] smpboot_thread_fn+0x30e/0x840 [ 6036.627839][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6036.628132][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6036.628420][ C1] kthread+0x292/0x360 [ 6036.628644][ C1] ? __pfx_kthread+0x10/0x10 [ 6036.628892][ C1] ret_from_fork+0x34/0x70 [ 6036.629133][ C1] ? __pfx_kthread+0x10/0x10 [ 6036.629377][ C1] ret_from_fork_asm+0x1b/0x30 [ 6036.629638][ C1] [ 6061.592024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6061.592403][ C0] rcu: 0-....: (4860543 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1154493 [ 6061.592930][ C0] rcu: (t=4867283 jiffies g=1007429 q=31 ncpus=4) [ 6061.593282][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6061.593761][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6061.594413][ C0] RIP: 0010:kasan_check_range+0x1b/0x1c0 [ 6061.594720][ C0] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 53 <72> 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 23 [ 6061.595737][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000286 [ 6061.596064][ C0] RAX: ffff88800a099b5c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6061.596484][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6061.596902][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6061.597329][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6061.597757][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6061.598179][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6061.598651][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6061.598999][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6061.599422][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6061.599841][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6061.600259][ C0] Call Trace: [ 6061.600438][ C0] [ 6061.600594][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6061.600883][ C0] ? print_cpu_stall+0x263/0x6a0 [ 6061.601148][ C0] ? check_cpu_stall+0x284/0x500 [ 6061.601414][ C0] ? rcu_pending+0x92/0x360 [ 6061.601660][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6061.601945][ C0] ? update_process_times+0xb9/0x110 [ 6061.602233][ C0] ? tick_sched_handle+0x67/0x130 [ 6061.602503][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6061.602800][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6061.603059][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6061.603385][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6061.603676][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6061.603982][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6061.604265][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6061.604587][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6061.604858][ C0] ? hrtimer_interrupt+0x31a/0x770 [ 6061.605135][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6061.605411][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6061.605740][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6061.606055][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6061.606384][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6061.606695][ C0] ? kasan_check_range+0x1b/0x1c0 [ 6061.606972][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 6061.607268][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6061.607591][ C0] ? get_stack_info+0x36/0xc0 [ 6061.607845][ C0] ? lock_acquire+0x1c1/0x220 [ 6061.608100][ C0] ? lock_release+0x1d5/0x250 [ 6061.608353][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6061.608618][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6061.608908][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6061.609212][ C0] ? lock_acquire+0x1c1/0x220 [ 6061.609461][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6061.609714][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6061.609990][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6061.610240][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6061.610502][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6061.610774][ C0] ? __inet_lookup_established+0x341/0x610 [ 6061.611089][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6061.611376][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6061.611668][ C0] ip_local_deliver+0x19d/0x480 [ 6061.611933][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6061.612223][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6061.612491][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6061.612767][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6061.613030][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6061.613369][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6061.613645][ C0] ip_rcv+0x564/0x740 [ 6061.613860][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6061.614103][ C0] ? set_track_prepare+0x8a/0xd0 [ 6061.614367][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6061.614657][ C0] ? rest_init+0x153/0x260 [ 6061.614894][ C0] ? skb_clone+0x10b/0x330 [ 6061.615137][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6061.615472][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6061.615790][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6061.616091][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6061.616406][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6061.616668][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6061.616912][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6061.617231][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6061.617530][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6061.617873][ C0] ? lock_acquire+0x1c1/0x220 [ 6061.618125][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6061.618438][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6061.618736][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6061.619073][ C0] ? __copy_skb_header+0xaf/0x490 [ 6061.619343][ C0] ? __skb_clone+0x57a/0x760 [ 6061.619590][ C0] netif_receive_skb+0x55/0x280 [ 6061.619846][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6061.620171][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6061.620521][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6061.620838][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6061.621125][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6061.621424][ C0] ? hlock_class+0x4e/0x130 [ 6061.621668][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6061.621996][ C0] ? place_entity+0x21/0x2f0 [ 6061.622243][ C0] ? resched_curr+0x219/0x280 [ 6061.622498][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6061.622770][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6061.623054][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6061.623331][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6061.623589][ C0] ? activate_task+0xf5/0x260 [ 6061.623840][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6061.624114][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6061.624390][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6061.624647][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6061.624935][ C0] ? get_stack_info+0x36/0xc0 [ 6061.625190][ C0] ? stack_access_ok+0xda/0x1f0 [ 6061.625454][ C0] ? get_reg+0x119/0x190 [ 6061.625681][ C0] __tcf_classify+0x32c/0x7d0 [ 6061.625930][ C0] tcf_classify+0x283/0x930 [ 6061.626170][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6061.626500][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6061.626769][ C0] ? arch_stack_walk+0x8c/0x100 [ 6061.627039][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6061.627330][ C0] tc_run+0x2e4/0x5d0 [ 6061.627546][ C0] ? __pfx_tc_run+0x10/0x10 [ 6061.627793][ C0] ? lock_acquire+0x1c1/0x220 [ 6061.628047][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6061.628324][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6061.628590][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6061.628879][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6061.629161][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6061.629483][ C0] ? neigh_hh_output+0x348/0x590 [ 6061.629745][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6061.630026][ C0] ip_finish_output2+0x786/0x18e0 [ 6061.630298][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6061.630593][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6061.630943][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6061.631232][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6061.631501][ C0] ? __ip_finish_output+0x10f/0x770 [ 6061.631778][ C0] ip_output+0x16b/0x4f0 [ 6061.632004][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6061.632288][ C0] ? __pfx_ip_output+0x10/0x10 [ 6061.632540][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6061.632841][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6061.633105][ C0] ? ip_local_out+0x114/0x3b0 [ 6061.633359][ C0] __ip_queue_xmit+0x672/0x1910 [ 6061.633621][ C0] ? __skb_clone+0x57a/0x760 [ 6061.633869][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6061.634149][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6061.634447][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6061.634767][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6061.635028][ C0] ? tcp_current_mss+0x40a/0x510 [ 6061.635295][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6061.635578][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6061.635853][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6061.636107][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6061.636381][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6061.636702][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6061.636982][ C0] ? ktime_get+0xb6/0x190 [ 6061.637216][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6061.637493][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6061.637777][ C0] tcp_write_timer+0x82/0x1d0 [ 6061.638031][ C0] call_timer_fn+0x176/0x430 [ 6061.638280][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6061.638554][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6061.638830][ C0] __run_timers.part.0+0x52d/0x890 [ 6061.639102][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6061.639388][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6061.639689][ C0] ? lock_acquire+0x1c1/0x220 [ 6061.639940][ C0] ? clockevents_program_event+0xf6/0x300 [ 6061.640247][ C0] ? lock_release+0x1d5/0x250 [ 6061.640500][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6061.640779][ C0] ? ktime_get+0xb6/0x190 [ 6061.641017][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6061.641316][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6061.641626][ C0] run_timer_softirq+0x72/0x100 [ 6061.641890][ C0] __do_softirq+0x1bc/0x7ff [ 6061.642138][ C0] irq_exit_rcu+0x98/0xc0 [ 6061.642372][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6061.642677][ C0] [ 6061.642834][ C0] [ 6061.642990][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6061.643310][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6061.643584][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6061.644611][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6061.644940][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6061.645363][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6061.645784][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6061.646210][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6061.646636][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6061.647066][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6061.647366][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6061.647637][ C0] default_idle_call+0x69/0xa0 [ 6061.647897][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6061.648162][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6061.648458][ C0] ? lock_release+0x1d5/0x250 [ 6061.648710][ C0] do_idle+0xfb/0x160 [ 6061.648924][ C0] cpu_startup_entry+0x55/0x60 [ 6061.649177][ C0] rest_init+0x153/0x260 [ 6061.649404][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6061.649692][ C0] arch_call_rest_init+0x13/0x40 [ 6061.649958][ C0] start_kernel+0x314/0x3d0 [ 6061.650205][ C0] x86_64_start_reservations+0x18/0x30 [ 6061.650500][ C0] x86_64_start_kernel+0xba/0x110 [ 6061.650767][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6061.651093][ C0] [ 6061.651257][ C0] Sending NMI from CPU 0 to CPUs 1: [ 6061.651548][ C1] NMI backtrace for cpu 1 [ 6061.651555][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6061.651560][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6061.651563][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6061.651572][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6061.651575][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6061.651578][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6061.651580][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6061.651582][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6061.651584][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6061.651586][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6061.651588][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6061.651590][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6061.651594][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6061.651595][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6061.651596][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6061.651598][ C1] Call Trace: [ 6061.651601][ C1] [ 6061.651604][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 6061.651611][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6061.651617][ C1] ? nmi_handle+0x156/0x420 [ 6061.651622][ C1] ? default_do_nmi+0x41/0x100 [ 6061.651626][ C1] ? exc_nmi+0xf3/0x120 [ 6061.651628][ C1] ? end_repeat_nmi+0xf/0x60 [ 6061.651633][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6061.651637][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6061.651640][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6061.651644][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6061.651647][ C1] [ 6061.651648][ C1] [ 6061.651649][ C1] ? run_ksoftirqd+0xb/0x60 [ 6061.651654][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6061.651657][ C1] ? __orc_find+0x9c/0xf0 [ 6061.651660][ C1] ? lock_acquire+0x1c1/0x220 [ 6061.651664][ C1] ? irqentry_enter+0x2b/0x60 [ 6061.651669][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6061.651672][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6061.651675][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6061.651678][ C1] ? lock_acquire+0x1c1/0x220 [ 6061.651681][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6061.651686][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6061.651689][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6061.651697][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6061.651699][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6061.651706][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6061.651713][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6061.651716][ C1] ip_local_deliver+0x19d/0x480 [ 6061.651720][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6061.651722][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6061.651728][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6061.651732][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6061.651735][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6061.651738][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6061.651748][ C1] ip_rcv+0x564/0x740 [ 6061.651751][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6061.651754][ C1] ? set_track_prepare+0x8a/0xd0 [ 6061.651758][ C1] ? irqentry_enter+0x2b/0x60 [ 6061.651762][ C1] ? irqentry_enter+0x2b/0x60 [ 6061.651765][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6061.651768][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6061.651772][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6061.651776][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6061.651779][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6061.651782][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6061.651785][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6061.651790][ C1] netif_receive_skb+0x55/0x280 [ 6061.651794][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6061.651802][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6061.651809][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6061.651816][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6061.651823][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6061.651835][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6061.651845][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6061.651847][ C1] ? arch_stack_walk+0x68/0x100 [ 6061.651853][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6061.651856][ C1] ? irqentry_enter+0x2b/0x60 [ 6061.651860][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6061.651865][ C1] ? irqentry_enter+0x2b/0x60 [ 6061.651868][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6061.651875][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6061.651878][ C1] ? arch_stack_walk+0x68/0x100 [ 6061.651882][ C1] __tcf_classify+0x32c/0x7d0 [ 6061.651888][ C1] tcf_classify+0x283/0x930 [ 6061.651892][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6061.651896][ C1] tc_run+0x2e4/0x5d0 [ 6061.651900][ C1] ? __pfx_tc_run+0x10/0x10 [ 6061.651905][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6061.651911][ C1] ? irqentry_enter+0x2b/0x60 [ 6061.651914][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6061.651917][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6061.651924][ C1] ip_finish_output2+0x786/0x18e0 [ 6061.651929][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6061.651932][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6061.651936][ C1] ? __ip_finish_output+0x10f/0x770 [ 6061.651941][ C1] ip_output+0x16b/0x4f0 [ 6061.651944][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6061.651947][ C1] ? __pfx_ip_output+0x10/0x10 [ 6061.651952][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6061.651959][ C1] ? __pfx_ip_output+0x10/0x10 [ 6061.651963][ C1] __ip_queue_xmit+0x672/0x1910 [ 6061.651968][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6061.651975][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6061.651979][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6061.651983][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6061.651987][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6061.651990][ C1] tcp_delack_timer+0x84/0x240 [ 6061.651994][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6061.651997][ C1] call_timer_fn+0x176/0x430 [ 6061.652001][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6061.652006][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6061.652010][ C1] __run_timers.part.0+0x52d/0x890 [ 6061.652013][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6061.652018][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6061.652024][ C1] ? __pfx___schedule+0x10/0x10 [ 6061.652028][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6061.652032][ C1] run_timer_softirq+0x72/0x100 [ 6061.652036][ C1] __do_softirq+0x1bc/0x7ff [ 6061.652039][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6061.652043][ C1] run_ksoftirqd+0x2e/0x60 [ 6061.652046][ C1] smpboot_thread_fn+0x30e/0x840 [ 6061.652051][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6061.652054][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6061.652058][ C1] kthread+0x292/0x360 [ 6061.652060][ C1] ? __pfx_kthread+0x10/0x10 [ 6061.652063][ C1] ret_from_fork+0x34/0x70 [ 6061.652066][ C1] ? __pfx_kthread+0x10/0x10 [ 6061.652068][ C1] ret_from_fork_asm+0x1b/0x30 [ 6061.652075][ C1] [ 6088.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4564s! [swapper/0:0] [ 6088.527918][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6088.529111][ C0] irq event stamp: 27567077 [ 6088.529351][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6088.529877][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6088.530360][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6088.530866][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6088.531363][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6088.531845][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6088.532494][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6088.532831][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6088.533849][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6088.534171][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6088.534590][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6088.535009][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6088.535429][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6088.535845][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6088.536265][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6088.536733][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6088.537086][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6088.537513][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6088.537935][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6088.538356][ C0] Call Trace: [ 6088.538532][ C0] [ 6088.538687][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6088.538965][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6088.539222][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6088.539515][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6088.539801][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6088.540103][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6088.540380][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6088.540703][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6088.540979][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6088.541255][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6088.541586][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6088.541898][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6088.542231][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6088.542537][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6088.542851][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6088.543153][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6088.543477][ C0] ? get_stack_info+0x36/0xc0 [ 6088.543734][ C0] ? lock_acquire+0x1c1/0x220 [ 6088.543989][ C0] ? lock_release+0x1d5/0x250 [ 6088.544243][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6088.544506][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6088.544795][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6088.545100][ C0] ? lock_acquire+0x1c1/0x220 [ 6088.545349][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6088.545602][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6088.545874][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6088.546124][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6088.546391][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6088.546664][ C0] ? __inet_lookup_established+0x341/0x610 [ 6088.546982][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6088.547276][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6088.547567][ C0] ip_local_deliver+0x19d/0x480 [ 6088.547828][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6088.548113][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6088.548378][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6088.548658][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6088.548924][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6088.549267][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6088.549546][ C0] ip_rcv+0x564/0x740 [ 6088.549761][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6088.550012][ C0] ? set_track_prepare+0x8a/0xd0 [ 6088.550279][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6088.550566][ C0] ? rest_init+0x153/0x260 [ 6088.550806][ C0] ? skb_clone+0x10b/0x330 [ 6088.551046][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6088.551381][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6088.551704][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6088.551995][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6088.552303][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6088.552561][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6088.552801][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6088.553114][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6088.553413][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6088.553755][ C0] ? lock_acquire+0x1c1/0x220 [ 6088.554011][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6088.554323][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6088.554621][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6088.554955][ C0] ? __copy_skb_header+0xaf/0x490 [ 6088.555226][ C0] ? __skb_clone+0x57a/0x760 [ 6088.555473][ C0] netif_receive_skb+0x55/0x280 [ 6088.555728][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6088.556052][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6088.556398][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6088.556714][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6088.557007][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6088.557312][ C0] ? hlock_class+0x4e/0x130 [ 6088.557561][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6088.557891][ C0] ? place_entity+0x21/0x2f0 [ 6088.558140][ C0] ? resched_curr+0x219/0x280 [ 6088.558386][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6088.558652][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6088.558933][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6088.559213][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6088.559475][ C0] ? activate_task+0xf5/0x260 [ 6088.559730][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6088.560007][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6088.560277][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6088.560537][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6088.560827][ C0] ? get_stack_info+0x36/0xc0 [ 6088.561075][ C0] ? stack_access_ok+0xda/0x1f0 [ 6088.561331][ C0] ? get_reg+0x119/0x190 [ 6088.561557][ C0] __tcf_classify+0x32c/0x7d0 [ 6088.561810][ C0] tcf_classify+0x283/0x930 [ 6088.562054][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6088.562386][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6088.562651][ C0] ? arch_stack_walk+0x8c/0x100 [ 6088.562910][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6088.563202][ C0] tc_run+0x2e4/0x5d0 [ 6088.563418][ C0] ? __pfx_tc_run+0x10/0x10 [ 6088.563663][ C0] ? lock_acquire+0x1c1/0x220 [ 6088.563916][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6088.564192][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6088.564457][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6088.564746][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6088.565026][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6088.565348][ C0] ? neigh_hh_output+0x348/0x590 [ 6088.565610][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6088.565891][ C0] ip_finish_output2+0x786/0x18e0 [ 6088.566164][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6088.566458][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6088.566807][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6088.567105][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6088.567369][ C0] ? __ip_finish_output+0x10f/0x770 [ 6088.567648][ C0] ip_output+0x16b/0x4f0 [ 6088.567878][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6088.568160][ C0] ? __pfx_ip_output+0x10/0x10 [ 6088.568417][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6088.568714][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6088.568981][ C0] ? ip_local_out+0x114/0x3b0 [ 6088.569233][ C0] __ip_queue_xmit+0x672/0x1910 [ 6088.569492][ C0] ? __skb_clone+0x57a/0x760 [ 6088.569735][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6088.570020][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6088.570318][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6088.570640][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6088.570897][ C0] ? tcp_current_mss+0x40a/0x510 [ 6088.571164][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6088.571442][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6088.571720][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6088.571977][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6088.572242][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6088.572557][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6088.572837][ C0] ? ktime_get+0xb6/0x190 [ 6088.573075][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6088.573352][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6088.573631][ C0] tcp_write_timer+0x82/0x1d0 [ 6088.573884][ C0] call_timer_fn+0x176/0x430 [ 6088.574136][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6088.574409][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6088.574685][ C0] __run_timers.part.0+0x52d/0x890 [ 6088.574957][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6088.575243][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6088.575541][ C0] ? lock_acquire+0x1c1/0x220 [ 6088.575794][ C0] ? clockevents_program_event+0xf6/0x300 [ 6088.576103][ C0] ? lock_release+0x1d5/0x250 [ 6088.576358][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6088.576637][ C0] ? ktime_get+0xb6/0x190 [ 6088.576875][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6088.577173][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6088.577489][ C0] run_timer_softirq+0x72/0x100 [ 6088.577748][ C0] __do_softirq+0x1bc/0x7ff [ 6088.577992][ C0] irq_exit_rcu+0x98/0xc0 [ 6088.578223][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6088.578523][ C0] [ 6088.578681][ C0] [ 6088.578840][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6088.579161][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6088.579428][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6088.580444][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6088.580769][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6088.581188][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6088.581607][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6088.582023][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6088.582443][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6088.582861][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6088.583166][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6088.583437][ C0] default_idle_call+0x69/0xa0 [ 6088.583692][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6088.583953][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6088.584251][ C0] ? lock_release+0x1d5/0x250 [ 6088.584501][ C0] do_idle+0xfb/0x160 [ 6088.584715][ C0] cpu_startup_entry+0x55/0x60 [ 6088.584968][ C0] rest_init+0x153/0x260 [ 6088.585195][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6088.585482][ C0] arch_call_rest_init+0x13/0x40 [ 6088.585747][ C0] start_kernel+0x314/0x3d0 [ 6088.585992][ C0] x86_64_start_reservations+0x18/0x30 [ 6088.586292][ C0] x86_64_start_kernel+0xba/0x110 [ 6088.586559][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6088.586891][ C0] [ 6088.587057][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4564s! [ksoftirqd/1:22] [ 6088.587533][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6088.588727][ C1] irq event stamp: 3886976 [ 6088.588963][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6088.589468][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6088.589967][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6088.590474][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6088.590962][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6088.591466][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6088.592115][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6088.592460][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6088.593490][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6088.593817][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6088.594246][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6088.594672][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6088.595094][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6088.595515][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6088.595940][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6088.596419][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6088.596766][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6088.597205][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6088.597630][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6088.598057][ C1] Call Trace: [ 6088.598238][ C1] [ 6088.598396][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6088.598671][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6088.598931][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6088.599223][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6088.599517][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6088.599822][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6088.600104][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6088.600429][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6088.600702][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6088.601031][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6088.601350][ C1] [ 6088.601506][ C1] [ 6088.601662][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6088.601989][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6088.602298][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6088.602610][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6088.602910][ C1] ? run_ksoftirqd+0xb/0x60 [ 6088.603152][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6088.603475][ C1] ? __orc_find+0x9c/0xf0 [ 6088.603709][ C1] ? lock_acquire+0x1c1/0x220 [ 6088.603963][ C1] ? irqentry_enter+0x2b/0x60 [ 6088.604218][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6088.604478][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6088.604765][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6088.605068][ C1] ? lock_acquire+0x1c1/0x220 [ 6088.605320][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6088.605572][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6088.605843][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6088.606093][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6088.606353][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6088.606629][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6088.606925][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6088.607219][ C1] ip_local_deliver+0x19d/0x480 [ 6088.607482][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6088.607770][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6088.608037][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6088.608313][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6088.608574][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6088.608914][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6088.609190][ C1] ip_rcv+0x564/0x740 [ 6088.609402][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6088.609641][ C1] ? set_track_prepare+0x8a/0xd0 [ 6088.609904][ C1] ? irqentry_enter+0x2b/0x60 [ 6088.610160][ C1] ? irqentry_enter+0x2b/0x60 [ 6088.610415][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6088.610660][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6088.610982][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6088.611325][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6088.611637][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6088.611979][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6088.612278][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6088.612615][ C1] netif_receive_skb+0x55/0x280 [ 6088.612875][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6088.613208][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6088.613563][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6088.613877][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6088.614172][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6088.614479][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6088.614813][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6088.615098][ C1] ? arch_stack_walk+0x68/0x100 [ 6088.615360][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6088.615637][ C1] ? irqentry_enter+0x2b/0x60 [ 6088.615888][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6088.616206][ C1] ? irqentry_enter+0x2b/0x60 [ 6088.616460][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6088.616787][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6088.617077][ C1] ? arch_stack_walk+0x68/0x100 [ 6088.617338][ C1] __tcf_classify+0x32c/0x7d0 [ 6088.617592][ C1] tcf_classify+0x283/0x930 [ 6088.617835][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6088.618106][ C1] tc_run+0x2e4/0x5d0 [ 6088.618319][ C1] ? __pfx_tc_run+0x10/0x10 [ 6088.618562][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6088.618828][ C1] ? irqentry_enter+0x2b/0x60 [ 6088.619085][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6088.619375][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6088.619704][ C1] ip_finish_output2+0x786/0x18e0 [ 6088.619973][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6088.620265][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6088.620533][ C1] ? __ip_finish_output+0x10f/0x770 [ 6088.620809][ C1] ip_output+0x16b/0x4f0 [ 6088.621035][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6088.621358][ C1] ? __pfx_ip_output+0x10/0x10 [ 6088.621612][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6088.621972][ C1] ? __pfx_ip_output+0x10/0x10 [ 6088.622234][ C1] __ip_queue_xmit+0x672/0x1910 [ 6088.622497][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6088.622778][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6088.623075][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6088.623359][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6088.623653][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6088.623936][ C1] tcp_delack_timer+0x84/0x240 [ 6088.624191][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6088.624480][ C1] call_timer_fn+0x176/0x430 [ 6088.624731][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6088.625005][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6088.625288][ C1] __run_timers.part.0+0x52d/0x890 [ 6088.625564][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6088.625850][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6088.626151][ C1] ? __pfx___schedule+0x10/0x10 [ 6088.626414][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6088.626739][ C1] run_timer_softirq+0x72/0x100 [ 6088.627006][ C1] __do_softirq+0x1bc/0x7ff [ 6088.627255][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6088.627532][ C1] run_ksoftirqd+0x2e/0x60 [ 6088.627771][ C1] smpboot_thread_fn+0x30e/0x840 [ 6088.628039][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6088.628327][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6088.628618][ C1] kthread+0x292/0x360 [ 6088.628837][ C1] ? __pfx_kthread+0x10/0x10 [ 6088.629087][ C1] ret_from_fork+0x34/0x70 [ 6088.629323][ C1] ? __pfx_kthread+0x10/0x10 [ 6088.629570][ C1] ret_from_fork_asm+0x1b/0x30 [ 6088.629827][ C1] [ 6116.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4590s! [swapper/0:0] [ 6116.527910][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6116.529102][ C0] irq event stamp: 27567077 [ 6116.529340][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6116.529867][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6116.530348][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6116.530857][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6116.531356][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6116.531839][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6116.532480][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6116.532817][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6116.533831][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6116.534154][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6116.534571][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6116.534987][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6116.535406][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6116.535823][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6116.536241][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6116.536709][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6116.537064][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6116.537487][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6116.537905][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6116.538323][ C0] Call Trace: [ 6116.538502][ C0] [ 6116.538657][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6116.538936][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6116.539188][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6116.539486][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6116.539769][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6116.540075][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6116.540353][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6116.540671][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6116.540946][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6116.541223][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6116.541549][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6116.541863][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6116.542190][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6116.542498][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6116.542809][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6116.543110][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6116.543436][ C0] ? get_stack_info+0x36/0xc0 [ 6116.543694][ C0] ? lock_acquire+0x1c1/0x220 [ 6116.543950][ C0] ? lock_release+0x1d5/0x250 [ 6116.544209][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6116.544472][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6116.544762][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6116.545062][ C0] ? lock_acquire+0x1c1/0x220 [ 6116.545307][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6116.545556][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6116.545827][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6116.546076][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6116.546338][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6116.546609][ C0] ? __inet_lookup_established+0x341/0x610 [ 6116.546927][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6116.547221][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6116.547516][ C0] ip_local_deliver+0x19d/0x480 [ 6116.547775][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6116.548058][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6116.548322][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6116.548600][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6116.548865][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6116.549201][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6116.549477][ C0] ip_rcv+0x564/0x740 [ 6116.549694][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6116.549939][ C0] ? set_track_prepare+0x8a/0xd0 [ 6116.550208][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6116.550497][ C0] ? rest_init+0x153/0x260 [ 6116.550735][ C0] ? skb_clone+0x10b/0x330 [ 6116.550973][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6116.551316][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6116.551641][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6116.551936][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6116.552243][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6116.552501][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6116.552740][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6116.553052][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6116.553350][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6116.553694][ C0] ? lock_acquire+0x1c1/0x220 [ 6116.553948][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6116.554260][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6116.554558][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6116.554892][ C0] ? __copy_skb_header+0xaf/0x490 [ 6116.555164][ C0] ? __skb_clone+0x57a/0x760 [ 6116.555412][ C0] netif_receive_skb+0x55/0x280 [ 6116.555670][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6116.555996][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6116.556342][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6116.556657][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6116.556947][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6116.557250][ C0] ? hlock_class+0x4e/0x130 [ 6116.557499][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6116.557832][ C0] ? place_entity+0x21/0x2f0 [ 6116.558081][ C0] ? resched_curr+0x219/0x280 [ 6116.558332][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6116.558598][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6116.558878][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6116.559158][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6116.559418][ C0] ? activate_task+0xf5/0x260 [ 6116.559672][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6116.559952][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6116.560225][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6116.560489][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6116.560781][ C0] ? get_stack_info+0x36/0xc0 [ 6116.561033][ C0] ? stack_access_ok+0xda/0x1f0 [ 6116.561290][ C0] ? get_reg+0x119/0x190 [ 6116.561517][ C0] __tcf_classify+0x32c/0x7d0 [ 6116.561773][ C0] tcf_classify+0x283/0x930 [ 6116.562017][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6116.562345][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6116.562609][ C0] ? arch_stack_walk+0x8c/0x100 [ 6116.562867][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6116.563153][ C0] tc_run+0x2e4/0x5d0 [ 6116.563372][ C0] ? __pfx_tc_run+0x10/0x10 [ 6116.563616][ C0] ? lock_acquire+0x1c1/0x220 [ 6116.563866][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6116.564144][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6116.564409][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6116.564694][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6116.564973][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6116.565296][ C0] ? neigh_hh_output+0x348/0x590 [ 6116.565559][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6116.565839][ C0] ip_finish_output2+0x786/0x18e0 [ 6116.566109][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6116.566402][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6116.566757][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6116.567049][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6116.567316][ C0] ? __ip_finish_output+0x10f/0x770 [ 6116.567595][ C0] ip_output+0x16b/0x4f0 [ 6116.567822][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6116.568103][ C0] ? __pfx_ip_output+0x10/0x10 [ 6116.568361][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6116.568659][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6116.568921][ C0] ? ip_local_out+0x114/0x3b0 [ 6116.569170][ C0] __ip_queue_xmit+0x672/0x1910 [ 6116.569427][ C0] ? __skb_clone+0x57a/0x760 [ 6116.569672][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6116.569955][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6116.570252][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6116.570572][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6116.570825][ C0] ? tcp_current_mss+0x40a/0x510 [ 6116.571096][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6116.571376][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6116.571653][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6116.571907][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6116.572177][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6116.572493][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6116.572771][ C0] ? ktime_get+0xb6/0x190 [ 6116.573004][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6116.573280][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6116.573558][ C0] tcp_write_timer+0x82/0x1d0 [ 6116.573813][ C0] call_timer_fn+0x176/0x430 [ 6116.574063][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6116.574334][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6116.574609][ C0] __run_timers.part.0+0x52d/0x890 [ 6116.574880][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6116.575165][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6116.575460][ C0] ? lock_acquire+0x1c1/0x220 [ 6116.575712][ C0] ? clockevents_program_event+0xf6/0x300 [ 6116.576026][ C0] ? lock_release+0x1d5/0x250 [ 6116.576277][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6116.576556][ C0] ? ktime_get+0xb6/0x190 [ 6116.576792][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6116.577090][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6116.577401][ C0] run_timer_softirq+0x72/0x100 [ 6116.577657][ C0] __do_softirq+0x1bc/0x7ff [ 6116.577898][ C0] irq_exit_rcu+0x98/0xc0 [ 6116.578127][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6116.578425][ C0] [ 6116.578585][ C0] [ 6116.578745][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6116.579068][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6116.579334][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6116.580347][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6116.580667][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6116.581084][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6116.581502][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6116.581918][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6116.582334][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6116.582752][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6116.583052][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6116.583324][ C0] default_idle_call+0x69/0xa0 [ 6116.583581][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6116.583843][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6116.584134][ C0] ? lock_release+0x1d5/0x250 [ 6116.584382][ C0] do_idle+0xfb/0x160 [ 6116.584593][ C0] cpu_startup_entry+0x55/0x60 [ 6116.584847][ C0] rest_init+0x153/0x260 [ 6116.585082][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6116.585369][ C0] arch_call_rest_init+0x13/0x40 [ 6116.585632][ C0] start_kernel+0x314/0x3d0 [ 6116.585878][ C0] x86_64_start_reservations+0x18/0x30 [ 6116.586169][ C0] x86_64_start_kernel+0xba/0x110 [ 6116.586435][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6116.586766][ C0] [ 6116.586933][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4590s! [ksoftirqd/1:22] [ 6116.587399][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6116.588593][ C1] irq event stamp: 3886976 [ 6116.588833][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6116.589334][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6116.589831][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6116.590334][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6116.590821][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6116.591319][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6116.591971][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6116.592317][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6116.593345][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6116.593671][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6116.594098][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6116.594518][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6116.594939][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6116.595364][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6116.595789][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6116.596261][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6116.596612][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6116.597044][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6116.597470][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6116.597892][ C1] Call Trace: [ 6116.598072][ C1] [ 6116.598231][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6116.598508][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6116.598766][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6116.599058][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6116.599346][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6116.599651][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6116.599932][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6116.600258][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6116.600533][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6116.600858][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6116.601174][ C1] [ 6116.601330][ C1] [ 6116.601486][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6116.601815][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6116.602123][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6116.602436][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6116.602743][ C1] ? run_ksoftirqd+0xb/0x60 [ 6116.602987][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6116.603312][ C1] ? __orc_find+0x9c/0xf0 [ 6116.603548][ C1] ? lock_acquire+0x1c1/0x220 [ 6116.603800][ C1] ? irqentry_enter+0x2b/0x60 [ 6116.604054][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6116.604317][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6116.604606][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6116.604909][ C1] ? lock_acquire+0x1c1/0x220 [ 6116.605160][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6116.605413][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6116.605685][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6116.605934][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6116.606197][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6116.606472][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6116.606774][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6116.607066][ C1] ip_local_deliver+0x19d/0x480 [ 6116.607327][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6116.607612][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6116.607880][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6116.608158][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6116.608423][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6116.608762][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6116.609036][ C1] ip_rcv+0x564/0x740 [ 6116.609249][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6116.609493][ C1] ? set_track_prepare+0x8a/0xd0 [ 6116.609758][ C1] ? irqentry_enter+0x2b/0x60 [ 6116.610014][ C1] ? irqentry_enter+0x2b/0x60 [ 6116.610274][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6116.610519][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6116.610836][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6116.611180][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6116.611494][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6116.611833][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6116.612131][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6116.612466][ C1] netif_receive_skb+0x55/0x280 [ 6116.612728][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6116.613058][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6116.613410][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6116.613722][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6116.614014][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6116.614318][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6116.614651][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6116.614934][ C1] ? arch_stack_walk+0x68/0x100 [ 6116.615195][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6116.615470][ C1] ? irqentry_enter+0x2b/0x60 [ 6116.615721][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6116.616039][ C1] ? irqentry_enter+0x2b/0x60 [ 6116.616294][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6116.616617][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6116.616905][ C1] ? arch_stack_walk+0x68/0x100 [ 6116.617166][ C1] __tcf_classify+0x32c/0x7d0 [ 6116.617417][ C1] tcf_classify+0x283/0x930 [ 6116.617658][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6116.617925][ C1] tc_run+0x2e4/0x5d0 [ 6116.618141][ C1] ? __pfx_tc_run+0x10/0x10 [ 6116.618387][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6116.618654][ C1] ? irqentry_enter+0x2b/0x60 [ 6116.618910][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6116.619204][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6116.619528][ C1] ip_finish_output2+0x786/0x18e0 [ 6116.619798][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6116.620089][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6116.620355][ C1] ? __ip_finish_output+0x10f/0x770 [ 6116.620631][ C1] ip_output+0x16b/0x4f0 [ 6116.620859][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6116.621179][ C1] ? __pfx_ip_output+0x10/0x10 [ 6116.621434][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6116.621792][ C1] ? __pfx_ip_output+0x10/0x10 [ 6116.622051][ C1] __ip_queue_xmit+0x672/0x1910 [ 6116.622311][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6116.622590][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6116.622884][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6116.623168][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6116.623462][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6116.623748][ C1] tcp_delack_timer+0x84/0x240 [ 6116.624005][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6116.624296][ C1] call_timer_fn+0x176/0x430 [ 6116.624547][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6116.624821][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6116.625102][ C1] __run_timers.part.0+0x52d/0x890 [ 6116.625378][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6116.625668][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6116.625969][ C1] ? __pfx___schedule+0x10/0x10 [ 6116.626236][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6116.626561][ C1] run_timer_softirq+0x72/0x100 [ 6116.626829][ C1] __do_softirq+0x1bc/0x7ff [ 6116.627079][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6116.627354][ C1] run_ksoftirqd+0x2e/0x60 [ 6116.627591][ C1] smpboot_thread_fn+0x30e/0x840 [ 6116.627858][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6116.628148][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6116.628443][ C1] kthread+0x292/0x360 [ 6116.628661][ C1] ? __pfx_kthread+0x10/0x10 [ 6116.628911][ C1] ret_from_fork+0x34/0x70 [ 6116.629150][ C1] ? __pfx_kthread+0x10/0x10 [ 6116.629398][ C1] ret_from_fork_asm+0x1b/0x30 [ 6116.629657][ C1] [ 6139.655024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6139.655401][ C1] rcu: 1-....: (4930990 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1172608 [ 6139.655994][ C1] rcu: (t=4945346 jiffies g=1007429 q=31 ncpus=4) [ 6139.656339][ C1] Sending NMI from CPU 1 to CPUs 0: [ 6139.656635][ C0] NMI backtrace for cpu 0 [ 6139.656652][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6139.656656][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6139.656659][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6139.656668][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6139.656671][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6139.656675][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6139.656677][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6139.656679][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6139.656680][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6139.656682][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6139.656684][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6139.656686][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6139.656690][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6139.656692][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6139.656693][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6139.656695][ C0] Call Trace: [ 6139.656698][ C0] [ 6139.656701][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 6139.656707][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6139.656713][ C0] ? nmi_handle+0x156/0x420 [ 6139.656718][ C0] ? default_do_nmi+0x41/0x100 [ 6139.656722][ C0] ? exc_nmi+0xf3/0x120 [ 6139.656725][ C0] ? end_repeat_nmi+0xf/0x60 [ 6139.656729][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6139.656734][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6139.656737][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6139.656741][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6139.656744][ C0] [ 6139.656745][ C0] [ 6139.656746][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6139.656749][ C0] ? get_stack_info+0x36/0xc0 [ 6139.656754][ C0] ? lock_acquire+0x1c1/0x220 [ 6139.656760][ C0] ? lock_release+0x1d5/0x250 [ 6139.656763][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6139.656767][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6139.656770][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6139.656774][ C0] ? lock_acquire+0x1c1/0x220 [ 6139.656776][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6139.656781][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6139.656785][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6139.656792][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6139.656795][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6139.656800][ C0] ? __inet_lookup_established+0x341/0x610 [ 6139.656806][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6139.656813][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6139.656817][ C0] ip_local_deliver+0x19d/0x480 [ 6139.656820][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6139.656823][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6139.656828][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6139.656832][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6139.656834][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6139.656838][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6139.656849][ C0] ip_rcv+0x564/0x740 [ 6139.656852][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6139.656855][ C0] ? set_track_prepare+0x8a/0xd0 [ 6139.656859][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6139.656862][ C0] ? rest_init+0x153/0x260 [ 6139.656864][ C0] ? skb_clone+0x10b/0x330 [ 6139.656870][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6139.656876][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6139.656881][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6139.656887][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6139.656897][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6139.656900][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6139.656902][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6139.656907][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6139.656910][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6139.656913][ C0] ? lock_acquire+0x1c1/0x220 [ 6139.656916][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6139.656919][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6139.656922][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6139.656925][ C0] ? __copy_skb_header+0xaf/0x490 [ 6139.656928][ C0] ? __skb_clone+0x57a/0x760 [ 6139.656931][ C0] netif_receive_skb+0x55/0x280 [ 6139.656933][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6139.656941][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6139.656948][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6139.656955][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6139.656960][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6139.656969][ C0] ? hlock_class+0x4e/0x130 [ 6139.656975][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6139.656985][ C0] ? place_entity+0x21/0x2f0 [ 6139.656989][ C0] ? resched_curr+0x219/0x280 [ 6139.656993][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6139.656996][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6139.657000][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6139.657004][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6139.657007][ C0] ? activate_task+0xf5/0x260 [ 6139.657010][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6139.657015][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6139.657019][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6139.657023][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6139.657026][ C0] ? get_stack_info+0x36/0xc0 [ 6139.657030][ C0] ? stack_access_ok+0xda/0x1f0 [ 6139.657032][ C0] ? get_reg+0x119/0x190 [ 6139.657036][ C0] __tcf_classify+0x32c/0x7d0 [ 6139.657040][ C0] tcf_classify+0x283/0x930 [ 6139.657043][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6139.657048][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6139.657050][ C0] ? arch_stack_walk+0x8c/0x100 [ 6139.657054][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6139.657058][ C0] tc_run+0x2e4/0x5d0 [ 6139.657062][ C0] ? __pfx_tc_run+0x10/0x10 [ 6139.657065][ C0] ? lock_acquire+0x1c1/0x220 [ 6139.657068][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6139.657072][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6139.657078][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6139.657081][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6139.657085][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6139.657090][ C0] ? neigh_hh_output+0x348/0x590 [ 6139.657094][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6139.657098][ C0] ip_finish_output2+0x786/0x18e0 [ 6139.657101][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6139.657108][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6139.657116][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6139.657119][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6139.657123][ C0] ? __ip_finish_output+0x10f/0x770 [ 6139.657127][ C0] ip_output+0x16b/0x4f0 [ 6139.657130][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6139.657135][ C0] ? __pfx_ip_output+0x10/0x10 [ 6139.657139][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6139.657143][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6139.657146][ C0] ? ip_local_out+0x114/0x3b0 [ 6139.657150][ C0] __ip_queue_xmit+0x672/0x1910 [ 6139.657154][ C0] ? __skb_clone+0x57a/0x760 [ 6139.657157][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6139.657165][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6139.657169][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6139.657173][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6139.657179][ C0] ? tcp_current_mss+0x40a/0x510 [ 6139.657182][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6139.657185][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6139.657188][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6139.657190][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6139.657193][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6139.657197][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6139.657202][ C0] ? ktime_get+0xb6/0x190 [ 6139.657206][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6139.657210][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6139.657213][ C0] tcp_write_timer+0x82/0x1d0 [ 6139.657217][ C0] call_timer_fn+0x176/0x430 [ 6139.657221][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6139.657226][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6139.657230][ C0] __run_timers.part.0+0x52d/0x890 [ 6139.657233][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6139.657238][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6139.657241][ C0] ? lock_acquire+0x1c1/0x220 [ 6139.657243][ C0] ? clockevents_program_event+0xf6/0x300 [ 6139.657248][ C0] ? lock_release+0x1d5/0x250 [ 6139.657250][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6139.657253][ C0] ? ktime_get+0xb6/0x190 [ 6139.657256][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6139.657260][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6139.657264][ C0] run_timer_softirq+0x72/0x100 [ 6139.657268][ C0] __do_softirq+0x1bc/0x7ff [ 6139.657273][ C0] irq_exit_rcu+0x98/0xc0 [ 6139.657276][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6139.657279][ C0] [ 6139.657280][ C0] [ 6139.657281][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6139.657287][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6139.657290][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6139.657292][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6139.657294][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6139.657296][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6139.657297][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6139.657299][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6139.657300][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6139.657304][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6139.657307][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6139.657312][ C0] default_idle_call+0x69/0xa0 [ 6139.657314][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6139.657316][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6139.657322][ C0] ? lock_release+0x1d5/0x250 [ 6139.657326][ C0] do_idle+0xfb/0x160 [ 6139.657329][ C0] cpu_startup_entry+0x55/0x60 [ 6139.657331][ C0] rest_init+0x153/0x260 [ 6139.657334][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6139.657340][ C0] arch_call_rest_init+0x13/0x40 [ 6139.657345][ C0] start_kernel+0x314/0x3d0 [ 6139.657349][ C0] x86_64_start_reservations+0x18/0x30 [ 6139.657354][ C0] x86_64_start_kernel+0xba/0x110 [ 6139.657357][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6139.657365][ C0] [ 6139.657632][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6139.711738][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6139.712390][ C1] RIP: 0010:queued_spin_lock_slowpath+0xc2/0xb90 [ 6139.712732][ C1] Code: 41 83 e4 07 49 01 c5 41 83 c4 03 be 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c 08 84 c0 0f 85 42 09 00 00 <8b> 5d 00 85 db 75 62 be 04 00 00 00 48 89 ef e8 da bb 0c fe 89 d8 [ 6139.713766][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000246 [ 6139.714090][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6139.714507][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6139.714925][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6139.715344][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6139.715765][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6139.716185][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6139.716665][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6139.717015][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6139.717442][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6139.717863][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6139.718281][ C1] Call Trace: [ 6139.718456][ C1] [ 6139.718611][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6139.718901][ C1] ? print_cpu_stall+0x263/0x6a0 [ 6139.719165][ C1] ? check_cpu_stall+0x284/0x500 [ 6139.719433][ C1] ? rcu_pending+0x92/0x360 [ 6139.719676][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6139.719957][ C1] ? update_process_times+0xb9/0x110 [ 6139.720244][ C1] ? tick_sched_handle+0x67/0x130 [ 6139.720512][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6139.720808][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6139.721064][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6139.721387][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6139.721674][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6139.721980][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6139.722261][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6139.722587][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6139.722862][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6139.723188][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6139.723501][ C1] [ 6139.723657][ C1] [ 6139.723814][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6139.724145][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6139.724450][ C1] ? queued_spin_lock_slowpath+0xc2/0xb90 [ 6139.724757][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6139.725062][ C1] ? run_ksoftirqd+0xb/0x60 [ 6139.725306][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6139.725636][ C1] ? __orc_find+0x9c/0xf0 [ 6139.725865][ C1] ? lock_acquire+0x1c1/0x220 [ 6139.726117][ C1] ? irqentry_enter+0x2b/0x60 [ 6139.726369][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6139.726636][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6139.726925][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6139.727226][ C1] ? lock_acquire+0x1c1/0x220 [ 6139.727473][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6139.727722][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6139.727995][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6139.728248][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6139.728512][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6139.728786][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6139.729078][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6139.729371][ C1] ip_local_deliver+0x19d/0x480 [ 6139.729630][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6139.729915][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6139.730180][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6139.730462][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6139.730729][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6139.731064][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6139.731343][ C1] ip_rcv+0x564/0x740 [ 6139.731558][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6139.731804][ C1] ? set_track_prepare+0x8a/0xd0 [ 6139.732073][ C1] ? irqentry_enter+0x2b/0x60 [ 6139.732323][ C1] ? irqentry_enter+0x2b/0x60 [ 6139.732571][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6139.732811][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6139.733125][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6139.733463][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6139.733770][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6139.734114][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6139.734415][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6139.734747][ C1] netif_receive_skb+0x55/0x280 [ 6139.735006][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6139.735335][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6139.735682][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6139.735997][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6139.736285][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6139.736587][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6139.736921][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6139.737205][ C1] ? arch_stack_walk+0x68/0x100 [ 6139.737461][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6139.737735][ C1] ? irqentry_enter+0x2b/0x60 [ 6139.737983][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6139.738309][ C1] ? irqentry_enter+0x2b/0x60 [ 6139.738564][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6139.738887][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6139.739166][ C1] ? arch_stack_walk+0x68/0x100 [ 6139.739429][ C1] __tcf_classify+0x32c/0x7d0 [ 6139.739687][ C1] tcf_classify+0x283/0x930 [ 6139.739933][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6139.740208][ C1] tc_run+0x2e4/0x5d0 [ 6139.740426][ C1] ? __pfx_tc_run+0x10/0x10 [ 6139.740674][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6139.740943][ C1] ? irqentry_enter+0x2b/0x60 [ 6139.741192][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6139.741475][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6139.741798][ C1] ip_finish_output2+0x786/0x18e0 [ 6139.742072][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6139.742362][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6139.742625][ C1] ? __ip_finish_output+0x10f/0x770 [ 6139.742906][ C1] ip_output+0x16b/0x4f0 [ 6139.743138][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6139.743457][ C1] ? __pfx_ip_output+0x10/0x10 [ 6139.743717][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6139.744068][ C1] ? __pfx_ip_output+0x10/0x10 [ 6139.744321][ C1] __ip_queue_xmit+0x672/0x1910 [ 6139.744589][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6139.744871][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6139.745172][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6139.745461][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6139.745759][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6139.746049][ C1] tcp_delack_timer+0x84/0x240 [ 6139.746306][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6139.746588][ C1] call_timer_fn+0x176/0x430 [ 6139.746840][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6139.747114][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6139.747395][ C1] __run_timers.part.0+0x52d/0x890 [ 6139.747670][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6139.747957][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6139.748256][ C1] ? __pfx___schedule+0x10/0x10 [ 6139.748518][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6139.748840][ C1] run_timer_softirq+0x72/0x100 [ 6139.749098][ C1] __do_softirq+0x1bc/0x7ff [ 6139.749338][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6139.749611][ C1] run_ksoftirqd+0x2e/0x60 [ 6139.749850][ C1] smpboot_thread_fn+0x30e/0x840 [ 6139.750116][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6139.750409][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6139.750697][ C1] kthread+0x292/0x360 [ 6139.750913][ C1] ? __pfx_kthread+0x10/0x10 [ 6139.751158][ C1] ret_from_fork+0x34/0x70 [ 6139.751397][ C1] ? __pfx_kthread+0x10/0x10 [ 6139.751644][ C1] ret_from_fork_asm+0x1b/0x30 [ 6139.751911][ C1] [ 6164.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4635s! [swapper/0:0] [ 6164.527924][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6164.529129][ C0] irq event stamp: 27567077 [ 6164.529373][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6164.529908][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6164.530378][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6164.530880][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6164.531375][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6164.531858][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6164.532513][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6164.532867][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6164.533887][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6164.534212][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6164.534633][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6164.535051][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6164.535469][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6164.535886][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6164.536305][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6164.536786][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6164.537133][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6164.537555][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6164.537973][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6164.538392][ C0] Call Trace: [ 6164.538570][ C0] [ 6164.538725][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6164.539005][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6164.539258][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6164.539550][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6164.539833][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6164.540134][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6164.540414][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6164.540733][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6164.541009][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6164.541288][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6164.541614][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6164.541930][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6164.542260][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6164.542568][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6164.542880][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6164.543182][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6164.543509][ C0] ? get_stack_info+0x36/0xc0 [ 6164.543767][ C0] ? lock_acquire+0x1c1/0x220 [ 6164.544024][ C0] ? lock_release+0x1d5/0x250 [ 6164.544280][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6164.544543][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6164.544831][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6164.545132][ C0] ? lock_acquire+0x1c1/0x220 [ 6164.545378][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6164.545629][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6164.545901][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6164.546152][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6164.546415][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6164.546695][ C0] ? __inet_lookup_established+0x341/0x610 [ 6164.547013][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6164.547309][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6164.547607][ C0] ip_local_deliver+0x19d/0x480 [ 6164.547865][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6164.548148][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6164.548411][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6164.548691][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6164.548957][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6164.549294][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6164.549571][ C0] ip_rcv+0x564/0x740 [ 6164.549788][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6164.550033][ C0] ? set_track_prepare+0x8a/0xd0 [ 6164.550300][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6164.550590][ C0] ? rest_init+0x153/0x260 [ 6164.550829][ C0] ? skb_clone+0x10b/0x330 [ 6164.551069][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6164.551410][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6164.551736][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6164.552031][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6164.552339][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6164.552601][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6164.552841][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6164.553157][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6164.553455][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6164.553798][ C0] ? lock_acquire+0x1c1/0x220 [ 6164.554053][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6164.554366][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6164.554664][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6164.554998][ C0] ? __copy_skb_header+0xaf/0x490 [ 6164.555271][ C0] ? __skb_clone+0x57a/0x760 [ 6164.555521][ C0] netif_receive_skb+0x55/0x280 [ 6164.555780][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6164.556106][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6164.556453][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6164.556769][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6164.557058][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6164.557361][ C0] ? hlock_class+0x4e/0x130 [ 6164.557610][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6164.557943][ C0] ? place_entity+0x21/0x2f0 [ 6164.558193][ C0] ? resched_curr+0x219/0x280 [ 6164.558444][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6164.558710][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6164.558990][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6164.559271][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6164.559531][ C0] ? activate_task+0xf5/0x260 [ 6164.559782][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6164.560066][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6164.560338][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6164.560603][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6164.560896][ C0] ? get_stack_info+0x36/0xc0 [ 6164.561147][ C0] ? stack_access_ok+0xda/0x1f0 [ 6164.561405][ C0] ? get_reg+0x119/0x190 [ 6164.561633][ C0] __tcf_classify+0x32c/0x7d0 [ 6164.561889][ C0] tcf_classify+0x283/0x930 [ 6164.562135][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6164.562465][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6164.562730][ C0] ? arch_stack_walk+0x8c/0x100 [ 6164.562991][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6164.563279][ C0] tc_run+0x2e4/0x5d0 [ 6164.563498][ C0] ? __pfx_tc_run+0x10/0x10 [ 6164.563743][ C0] ? lock_acquire+0x1c1/0x220 [ 6164.563995][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6164.564273][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6164.564538][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6164.564825][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6164.565106][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6164.565430][ C0] ? neigh_hh_output+0x348/0x590 [ 6164.565693][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6164.565974][ C0] ip_finish_output2+0x786/0x18e0 [ 6164.566245][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6164.566543][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6164.566901][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6164.567196][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6164.567460][ C0] ? __ip_finish_output+0x10f/0x770 [ 6164.567741][ C0] ip_output+0x16b/0x4f0 [ 6164.567969][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6164.568251][ C0] ? __pfx_ip_output+0x10/0x10 [ 6164.568510][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6164.568810][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6164.569074][ C0] ? ip_local_out+0x114/0x3b0 [ 6164.569322][ C0] __ip_queue_xmit+0x672/0x1910 [ 6164.569580][ C0] ? __skb_clone+0x57a/0x760 [ 6164.569826][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6164.570110][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6164.570407][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6164.570729][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6164.570983][ C0] ? tcp_current_mss+0x40a/0x510 [ 6164.571249][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6164.571530][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6164.571808][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6164.572064][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6164.572330][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6164.572648][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6164.572928][ C0] ? ktime_get+0xb6/0x190 [ 6164.573163][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6164.573440][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6164.573720][ C0] tcp_write_timer+0x82/0x1d0 [ 6164.573975][ C0] call_timer_fn+0x176/0x430 [ 6164.574225][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6164.574497][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6164.574772][ C0] __run_timers.part.0+0x52d/0x890 [ 6164.575048][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6164.575333][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6164.575630][ C0] ? lock_acquire+0x1c1/0x220 [ 6164.575883][ C0] ? clockevents_program_event+0xf6/0x300 [ 6164.576193][ C0] ? lock_release+0x1d5/0x250 [ 6164.576445][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6164.576727][ C0] ? ktime_get+0xb6/0x190 [ 6164.576957][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6164.577256][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6164.577568][ C0] run_timer_softirq+0x72/0x100 [ 6164.577823][ C0] __do_softirq+0x1bc/0x7ff [ 6164.578065][ C0] irq_exit_rcu+0x98/0xc0 [ 6164.578295][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6164.578593][ C0] [ 6164.578753][ C0] [ 6164.578914][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6164.579238][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6164.579503][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6164.580518][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6164.580837][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6164.581256][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6164.581675][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6164.582094][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6164.582515][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6164.582937][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6164.583240][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6164.583512][ C0] default_idle_call+0x69/0xa0 [ 6164.583770][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6164.584037][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6164.584331][ C0] ? lock_release+0x1d5/0x250 [ 6164.584582][ C0] do_idle+0xfb/0x160 [ 6164.584794][ C0] cpu_startup_entry+0x55/0x60 [ 6164.585051][ C0] rest_init+0x153/0x260 [ 6164.585284][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6164.585571][ C0] arch_call_rest_init+0x13/0x40 [ 6164.585835][ C0] start_kernel+0x314/0x3d0 [ 6164.586083][ C0] x86_64_start_reservations+0x18/0x30 [ 6164.586377][ C0] x86_64_start_kernel+0xba/0x110 [ 6164.586652][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6164.586983][ C0] [ 6164.587152][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4635s! [ksoftirqd/1:22] [ 6164.587622][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6164.588810][ C1] irq event stamp: 3886976 [ 6164.589045][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6164.589545][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6164.590041][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6164.590541][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6164.591033][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6164.591531][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6164.592189][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6164.592535][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6164.593562][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6164.593892][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6164.594314][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6164.594733][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6164.595158][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6164.595583][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6164.596004][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6164.596479][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6164.596835][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6164.597256][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6164.597674][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6164.598100][ C1] Call Trace: [ 6164.598280][ C1] [ 6164.598438][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6164.598713][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6164.598970][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6164.599259][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6164.599546][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6164.599853][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6164.600136][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6164.600459][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6164.600734][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6164.601061][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6164.601374][ C1] [ 6164.601530][ C1] [ 6164.601688][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6164.602020][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6164.602327][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6164.602643][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6164.602945][ C1] ? run_ksoftirqd+0xb/0x60 [ 6164.603188][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6164.603515][ C1] ? __orc_find+0x9c/0xf0 [ 6164.603747][ C1] ? lock_acquire+0x1c1/0x220 [ 6164.604003][ C1] ? irqentry_enter+0x2b/0x60 [ 6164.604261][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6164.604528][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6164.604818][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6164.605120][ C1] ? lock_acquire+0x1c1/0x220 [ 6164.605368][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6164.605621][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6164.605894][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6164.606145][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6164.606409][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6164.606688][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6164.606975][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6164.607265][ C1] ip_local_deliver+0x19d/0x480 [ 6164.607527][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6164.607819][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6164.608089][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6164.608369][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6164.608632][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6164.608973][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6164.609248][ C1] ip_rcv+0x564/0x740 [ 6164.609464][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6164.609706][ C1] ? set_track_prepare+0x8a/0xd0 [ 6164.609971][ C1] ? irqentry_enter+0x2b/0x60 [ 6164.610225][ C1] ? irqentry_enter+0x2b/0x60 [ 6164.610479][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6164.610725][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6164.611042][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6164.611388][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6164.611702][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6164.612043][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6164.612341][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6164.612677][ C1] netif_receive_skb+0x55/0x280 [ 6164.612942][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6164.613273][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6164.613625][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6164.613938][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6164.614231][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6164.614537][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6164.614869][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6164.615155][ C1] ? arch_stack_walk+0x68/0x100 [ 6164.615413][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6164.615691][ C1] ? irqentry_enter+0x2b/0x60 [ 6164.615942][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6164.616267][ C1] ? irqentry_enter+0x2b/0x60 [ 6164.616528][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6164.616850][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6164.617138][ C1] ? arch_stack_walk+0x68/0x100 [ 6164.617397][ C1] __tcf_classify+0x32c/0x7d0 [ 6164.617649][ C1] tcf_classify+0x283/0x930 [ 6164.617891][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6164.618163][ C1] tc_run+0x2e4/0x5d0 [ 6164.618380][ C1] ? __pfx_tc_run+0x10/0x10 [ 6164.618626][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6164.618894][ C1] ? irqentry_enter+0x2b/0x60 [ 6164.619150][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6164.619440][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6164.619769][ C1] ip_finish_output2+0x786/0x18e0 [ 6164.620041][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6164.620330][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6164.620599][ C1] ? __ip_finish_output+0x10f/0x770 [ 6164.620876][ C1] ip_output+0x16b/0x4f0 [ 6164.621105][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6164.621430][ C1] ? __pfx_ip_output+0x10/0x10 [ 6164.621688][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6164.622043][ C1] ? __pfx_ip_output+0x10/0x10 [ 6164.622301][ C1] __ip_queue_xmit+0x672/0x1910 [ 6164.622563][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6164.622842][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6164.623140][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6164.623428][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6164.623724][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6164.624010][ C1] tcp_delack_timer+0x84/0x240 [ 6164.624267][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6164.624556][ C1] call_timer_fn+0x176/0x430 [ 6164.624808][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6164.625084][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6164.625366][ C1] __run_timers.part.0+0x52d/0x890 [ 6164.625643][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6164.625932][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6164.626235][ C1] ? __pfx___schedule+0x10/0x10 [ 6164.626505][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6164.626826][ C1] run_timer_softirq+0x72/0x100 [ 6164.627091][ C1] __do_softirq+0x1bc/0x7ff [ 6164.627337][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6164.627614][ C1] run_ksoftirqd+0x2e/0x60 [ 6164.627851][ C1] smpboot_thread_fn+0x30e/0x840 [ 6164.628121][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6164.628413][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6164.628707][ C1] kthread+0x292/0x360 [ 6164.628923][ C1] ? __pfx_kthread+0x10/0x10 [ 6164.629172][ C1] ret_from_fork+0x34/0x70 [ 6164.629411][ C1] ? __pfx_kthread+0x10/0x10 [ 6164.629661][ C1] ret_from_fork_asm+0x1b/0x30 [ 6164.629922][ C1] [ 6192.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4661s! [swapper/0:0] [ 6192.527914][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6192.529114][ C0] irq event stamp: 27567077 [ 6192.529357][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6192.529894][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6192.530367][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6192.530865][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6192.531355][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6192.531836][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6192.532487][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6192.532830][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6192.533853][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6192.534182][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6192.534603][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6192.535025][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6192.535451][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6192.535877][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6192.536304][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6192.536778][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6192.537138][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6192.537560][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6192.537981][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6192.538403][ C0] Call Trace: [ 6192.538585][ C0] [ 6192.538743][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6192.539019][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6192.539274][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6192.539562][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6192.539849][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6192.540155][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6192.540437][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6192.540760][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6192.541033][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6192.541312][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6192.541632][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6192.541943][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6192.542278][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6192.542584][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6192.542891][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6192.543201][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6192.543529][ C0] ? get_stack_info+0x36/0xc0 [ 6192.543781][ C0] ? lock_acquire+0x1c1/0x220 [ 6192.544033][ C0] ? lock_release+0x1d5/0x250 [ 6192.544283][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6192.544543][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6192.544827][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6192.545125][ C0] ? lock_acquire+0x1c1/0x220 [ 6192.545376][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6192.545630][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6192.545905][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6192.546151][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6192.546413][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6192.546685][ C0] ? __inet_lookup_established+0x341/0x610 [ 6192.547005][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6192.547295][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6192.547586][ C0] ip_local_deliver+0x19d/0x480 [ 6192.547847][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6192.548135][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6192.548401][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6192.548676][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6192.548938][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6192.549278][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6192.549552][ C0] ip_rcv+0x564/0x740 [ 6192.549763][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6192.550002][ C0] ? set_track_prepare+0x8a/0xd0 [ 6192.550265][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6192.550558][ C0] ? rest_init+0x153/0x260 [ 6192.550792][ C0] ? skb_clone+0x10b/0x330 [ 6192.551035][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6192.551367][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6192.551686][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6192.551986][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6192.552298][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6192.552559][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6192.552803][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6192.553123][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6192.553423][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6192.553761][ C0] ? lock_acquire+0x1c1/0x220 [ 6192.554007][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6192.554315][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6192.554615][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6192.554944][ C0] ? __copy_skb_header+0xaf/0x490 [ 6192.555211][ C0] ? __skb_clone+0x57a/0x760 [ 6192.555456][ C0] netif_receive_skb+0x55/0x280 [ 6192.555720][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6192.556051][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6192.556408][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6192.556723][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6192.557007][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6192.557304][ C0] ? hlock_class+0x4e/0x130 [ 6192.557547][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6192.557876][ C0] ? place_entity+0x21/0x2f0 [ 6192.558125][ C0] ? resched_curr+0x219/0x280 [ 6192.558380][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6192.558649][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6192.558933][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6192.559210][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6192.559468][ C0] ? activate_task+0xf5/0x260 [ 6192.559716][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6192.559990][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6192.560263][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6192.560520][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6192.560813][ C0] ? get_stack_info+0x36/0xc0 [ 6192.561070][ C0] ? stack_access_ok+0xda/0x1f0 [ 6192.561331][ C0] ? get_reg+0x119/0x190 [ 6192.561559][ C0] __tcf_classify+0x32c/0x7d0 [ 6192.561812][ C0] tcf_classify+0x283/0x930 [ 6192.562056][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6192.562379][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6192.562650][ C0] ? arch_stack_walk+0x8c/0x100 [ 6192.562914][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6192.563206][ C0] tc_run+0x2e4/0x5d0 [ 6192.563419][ C0] ? __pfx_tc_run+0x10/0x10 [ 6192.563659][ C0] ? lock_acquire+0x1c1/0x220 [ 6192.563907][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6192.564180][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6192.564449][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6192.564732][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6192.565006][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6192.565325][ C0] ? neigh_hh_output+0x348/0x590 [ 6192.565593][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6192.565871][ C0] ip_finish_output2+0x786/0x18e0 [ 6192.566138][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6192.566432][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6192.566786][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6192.567076][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6192.567343][ C0] ? __ip_finish_output+0x10f/0x770 [ 6192.567619][ C0] ip_output+0x16b/0x4f0 [ 6192.567843][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6192.568128][ C0] ? __pfx_ip_output+0x10/0x10 [ 6192.568379][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6192.568686][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6192.568947][ C0] ? ip_local_out+0x114/0x3b0 [ 6192.569200][ C0] __ip_queue_xmit+0x672/0x1910 [ 6192.569463][ C0] ? __skb_clone+0x57a/0x760 [ 6192.569711][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6192.569988][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6192.570280][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6192.570595][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6192.570853][ C0] ? tcp_current_mss+0x40a/0x510 [ 6192.571115][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6192.571397][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6192.571671][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6192.571921][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6192.572194][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6192.572511][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6192.572786][ C0] ? ktime_get+0xb6/0x190 [ 6192.573016][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6192.573290][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6192.573577][ C0] tcp_write_timer+0x82/0x1d0 [ 6192.573825][ C0] call_timer_fn+0x176/0x430 [ 6192.574069][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6192.574346][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6192.574617][ C0] __run_timers.part.0+0x52d/0x890 [ 6192.574893][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6192.575176][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6192.575476][ C0] ? lock_acquire+0x1c1/0x220 [ 6192.575722][ C0] ? clockevents_program_event+0xf6/0x300 [ 6192.576026][ C0] ? lock_release+0x1d5/0x250 [ 6192.576276][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6192.576558][ C0] ? ktime_get+0xb6/0x190 [ 6192.576792][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6192.577094][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6192.577402][ C0] run_timer_softirq+0x72/0x100 [ 6192.577664][ C0] __do_softirq+0x1bc/0x7ff [ 6192.577910][ C0] irq_exit_rcu+0x98/0xc0 [ 6192.578142][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6192.578445][ C0] [ 6192.578601][ C0] [ 6192.578757][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6192.579077][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6192.579347][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6192.580381][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6192.580706][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6192.581127][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6192.581550][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6192.581974][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6192.582395][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6192.582819][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6192.583127][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6192.583401][ C0] default_idle_call+0x69/0xa0 [ 6192.583653][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6192.583922][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6192.584214][ C0] ? lock_release+0x1d5/0x250 [ 6192.584467][ C0] do_idle+0xfb/0x160 [ 6192.584679][ C0] cpu_startup_entry+0x55/0x60 [ 6192.584934][ C0] rest_init+0x153/0x260 [ 6192.585159][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6192.585449][ C0] arch_call_rest_init+0x13/0x40 [ 6192.585715][ C0] start_kernel+0x314/0x3d0 [ 6192.585955][ C0] x86_64_start_reservations+0x18/0x30 [ 6192.586245][ C0] x86_64_start_kernel+0xba/0x110 [ 6192.586519][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6192.586843][ C0] [ 6192.587006][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4661s! [ksoftirqd/1:22] [ 6192.587470][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6192.588673][ C1] irq event stamp: 3886976 [ 6192.588912][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6192.589407][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6192.589898][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6192.590394][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6192.590884][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6192.591375][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6192.592017][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 6192.592354][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 6192.593380][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6192.593705][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6192.594132][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6192.594554][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6192.594975][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6192.595401][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6192.595826][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6192.596299][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6192.596656][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6192.597080][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6192.597507][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6192.597929][ C1] Call Trace: [ 6192.598108][ C1] [ 6192.598268][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6192.598544][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6192.598802][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6192.599094][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6192.599382][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6192.599688][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6192.599971][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6192.600298][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6192.600572][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6192.600898][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6192.601214][ C1] [ 6192.601370][ C1] [ 6192.601527][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6192.601856][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6192.602165][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 6192.602472][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6192.602778][ C1] ? run_ksoftirqd+0xb/0x60 [ 6192.603026][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6192.603356][ C1] ? __orc_find+0x9c/0xf0 [ 6192.603589][ C1] ? lock_acquire+0x1c1/0x220 [ 6192.603838][ C1] ? irqentry_enter+0x2b/0x60 [ 6192.604088][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6192.604347][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6192.604631][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6192.604929][ C1] ? lock_acquire+0x1c1/0x220 [ 6192.605182][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6192.605436][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6192.605712][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6192.605956][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6192.606215][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6192.606493][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6192.606785][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6192.607079][ C1] ip_local_deliver+0x19d/0x480 [ 6192.607335][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6192.607617][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6192.607882][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6192.608165][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6192.608434][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6192.608769][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6192.609048][ C1] ip_rcv+0x564/0x740 [ 6192.609269][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6192.609514][ C1] ? set_track_prepare+0x8a/0xd0 [ 6192.609783][ C1] ? irqentry_enter+0x2b/0x60 [ 6192.610034][ C1] ? irqentry_enter+0x2b/0x60 [ 6192.610286][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6192.610528][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6192.610840][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6192.611180][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6192.611491][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6192.611832][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6192.612132][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6192.612461][ C1] netif_receive_skb+0x55/0x280 [ 6192.612719][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6192.613045][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6192.613393][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6192.613707][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6192.613995][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6192.614296][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6192.614623][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6192.614903][ C1] ? arch_stack_walk+0x68/0x100 [ 6192.615168][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6192.615447][ C1] ? irqentry_enter+0x2b/0x60 [ 6192.615700][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6192.616025][ C1] ? irqentry_enter+0x2b/0x60 [ 6192.616280][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6192.616607][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6192.616886][ C1] ? arch_stack_walk+0x68/0x100 [ 6192.617149][ C1] __tcf_classify+0x32c/0x7d0 [ 6192.617403][ C1] tcf_classify+0x283/0x930 [ 6192.617648][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6192.617920][ C1] tc_run+0x2e4/0x5d0 [ 6192.618143][ C1] ? __pfx_tc_run+0x10/0x10 [ 6192.618391][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6192.618661][ C1] ? irqentry_enter+0x2b/0x60 [ 6192.618912][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6192.619197][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6192.619519][ C1] ip_finish_output2+0x786/0x18e0 [ 6192.619794][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6192.620087][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6192.620350][ C1] ? __ip_finish_output+0x10f/0x770 [ 6192.620632][ C1] ip_output+0x16b/0x4f0 [ 6192.620861][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6192.621180][ C1] ? __pfx_ip_output+0x10/0x10 [ 6192.621440][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6192.621790][ C1] ? __pfx_ip_output+0x10/0x10 [ 6192.622045][ C1] __ip_queue_xmit+0x672/0x1910 [ 6192.622308][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6192.622592][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6192.622889][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6192.623179][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6192.623480][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6192.623769][ C1] tcp_delack_timer+0x84/0x240 [ 6192.624029][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6192.624314][ C1] call_timer_fn+0x176/0x430 [ 6192.624563][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6192.624837][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6192.625114][ C1] __run_timers.part.0+0x52d/0x890 [ 6192.625386][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6192.625677][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6192.625978][ C1] ? __pfx___schedule+0x10/0x10 [ 6192.626236][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6192.626562][ C1] run_timer_softirq+0x72/0x100 [ 6192.626821][ C1] __do_softirq+0x1bc/0x7ff [ 6192.627064][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6192.627337][ C1] run_ksoftirqd+0x2e/0x60 [ 6192.627578][ C1] smpboot_thread_fn+0x30e/0x840 [ 6192.627842][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6192.628138][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6192.628429][ C1] kthread+0x292/0x360 [ 6192.628648][ C1] ? __pfx_kthread+0x10/0x10 [ 6192.628891][ C1] ret_from_fork+0x34/0x70 [ 6192.629134][ C1] ? __pfx_kthread+0x10/0x10 [ 6192.629378][ C1] ret_from_fork_asm+0x1b/0x30 [ 6192.629643][ C1] [ 6217.753023][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6217.753428][ C0] rcu: 0-....: (5016411 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1190678 [ 6217.753950][ C0] rcu: (t=5023444 jiffies g=1007429 q=31 ncpus=4) [ 6217.754299][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6217.754777][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6217.755424][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6217.755776][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6217.756798][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6217.757121][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6217.757538][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6217.757955][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6217.758373][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6217.758789][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6217.759208][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6217.759676][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6217.760029][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6217.760454][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6217.760879][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6217.761302][ C0] Call Trace: [ 6217.761482][ C0] [ 6217.761642][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6217.761928][ C0] ? print_cpu_stall+0x263/0x6a0 [ 6217.762195][ C0] ? check_cpu_stall+0x284/0x500 [ 6217.762459][ C0] ? rcu_pending+0x92/0x360 [ 6217.762704][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6217.762990][ C0] ? update_process_times+0xb9/0x110 [ 6217.763271][ C0] ? tick_sched_handle+0x67/0x130 [ 6217.763545][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6217.763847][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6217.764098][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6217.764429][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6217.764712][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6217.765012][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6217.765289][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6217.765608][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6217.765887][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6217.766163][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6217.766494][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6217.766803][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6217.767136][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6217.767437][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6217.767745][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6217.768049][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6217.768377][ C0] ? get_stack_info+0x36/0xc0 [ 6217.768628][ C0] ? lock_acquire+0x1c1/0x220 [ 6217.768876][ C0] ? lock_release+0x1d5/0x250 [ 6217.769124][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6217.769383][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6217.769667][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6217.769965][ C0] ? lock_acquire+0x1c1/0x220 [ 6217.770217][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6217.770474][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6217.770755][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6217.770999][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6217.771257][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6217.771525][ C0] ? __inet_lookup_established+0x341/0x610 [ 6217.771837][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6217.772131][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6217.772425][ C0] ip_local_deliver+0x19d/0x480 [ 6217.772692][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6217.772976][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6217.773240][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6217.773520][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6217.773783][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6217.774124][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6217.774403][ C0] ip_rcv+0x564/0x740 [ 6217.774617][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6217.774860][ C0] ? set_track_prepare+0x8a/0xd0 [ 6217.775127][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6217.775413][ C0] ? rest_init+0x153/0x260 [ 6217.775654][ C0] ? skb_clone+0x10b/0x330 [ 6217.775900][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6217.776237][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6217.776562][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6217.776860][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6217.777173][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6217.777434][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6217.777682][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6217.778002][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6217.778304][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6217.778642][ C0] ? lock_acquire+0x1c1/0x220 [ 6217.778890][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6217.779200][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6217.779502][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6217.779833][ C0] ? __copy_skb_header+0xaf/0x490 [ 6217.780099][ C0] ? __skb_clone+0x57a/0x760 [ 6217.780343][ C0] netif_receive_skb+0x55/0x280 [ 6217.780604][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6217.780934][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6217.781287][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6217.781599][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6217.781890][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6217.782192][ C0] ? hlock_class+0x4e/0x130 [ 6217.782439][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6217.782774][ C0] ? place_entity+0x21/0x2f0 [ 6217.783025][ C0] ? resched_curr+0x219/0x280 [ 6217.783276][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6217.783542][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6217.783822][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6217.784102][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6217.784363][ C0] ? activate_task+0xf5/0x260 [ 6217.784616][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6217.784893][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6217.785165][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6217.785428][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6217.785722][ C0] ? get_stack_info+0x36/0xc0 [ 6217.785974][ C0] ? stack_access_ok+0xda/0x1f0 [ 6217.786231][ C0] ? get_reg+0x119/0x190 [ 6217.786462][ C0] __tcf_classify+0x32c/0x7d0 [ 6217.786710][ C0] tcf_classify+0x283/0x930 [ 6217.786950][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6217.787283][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6217.787551][ C0] ? arch_stack_walk+0x8c/0x100 [ 6217.787818][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6217.788111][ C0] tc_run+0x2e4/0x5d0 [ 6217.788323][ C0] ? __pfx_tc_run+0x10/0x10 [ 6217.788563][ C0] ? lock_acquire+0x1c1/0x220 [ 6217.788812][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6217.789086][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6217.789356][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6217.789640][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6217.789918][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6217.790236][ C0] ? neigh_hh_output+0x348/0x590 [ 6217.790504][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6217.790779][ C0] ip_finish_output2+0x786/0x18e0 [ 6217.791046][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6217.791338][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6217.791694][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6217.791987][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6217.792251][ C0] ? __ip_finish_output+0x10f/0x770 [ 6217.792531][ C0] ip_output+0x16b/0x4f0 [ 6217.792758][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6217.793036][ C0] ? __pfx_ip_output+0x10/0x10 [ 6217.793291][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6217.793590][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6217.793855][ C0] ? ip_local_out+0x114/0x3b0 [ 6217.794105][ C0] __ip_queue_xmit+0x672/0x1910 [ 6217.794362][ C0] ? __skb_clone+0x57a/0x760 [ 6217.794605][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6217.794888][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6217.795185][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6217.795507][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6217.795763][ C0] ? tcp_current_mss+0x40a/0x510 [ 6217.796027][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6217.796309][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6217.796586][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6217.796838][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6217.797109][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6217.797430][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6217.797704][ C0] ? ktime_get+0xb6/0x190 [ 6217.797935][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6217.798207][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6217.798490][ C0] tcp_write_timer+0x82/0x1d0 [ 6217.798739][ C0] call_timer_fn+0x176/0x430 [ 6217.798984][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6217.799261][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6217.799532][ C0] __run_timers.part.0+0x52d/0x890 [ 6217.799807][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6217.800090][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6217.800390][ C0] ? lock_acquire+0x1c1/0x220 [ 6217.800637][ C0] ? clockevents_program_event+0xf6/0x300 [ 6217.800940][ C0] ? lock_release+0x1d5/0x250 [ 6217.801190][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6217.801464][ C0] ? ktime_get+0xb6/0x190 [ 6217.801693][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6217.801988][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6217.802302][ C0] run_timer_softirq+0x72/0x100 [ 6217.802560][ C0] __do_softirq+0x1bc/0x7ff [ 6217.802801][ C0] irq_exit_rcu+0x98/0xc0 [ 6217.803031][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6217.803329][ C0] [ 6217.803487][ C0] [ 6217.803646][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6217.803969][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6217.804237][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6217.805249][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6217.805571][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6217.805987][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6217.806407][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6217.806830][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6217.807259][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6217.807680][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6217.807986][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6217.808263][ C0] default_idle_call+0x69/0xa0 [ 6217.808513][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6217.808779][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6217.809071][ C0] ? lock_release+0x1d5/0x250 [ 6217.809326][ C0] do_idle+0xfb/0x160 [ 6217.809540][ C0] cpu_startup_entry+0x55/0x60 [ 6217.809796][ C0] rest_init+0x153/0x260 [ 6217.810022][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6217.810314][ C0] arch_call_rest_init+0x13/0x40 [ 6217.810582][ C0] start_kernel+0x314/0x3d0 [ 6217.810822][ C0] x86_64_start_reservations+0x18/0x30 [ 6217.811113][ C0] x86_64_start_kernel+0xba/0x110 [ 6217.811383][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6217.811712][ C0] [ 6217.811879][ C0] Sending NMI from CPU 0 to CPUs 1: [ 6217.812166][ C1] NMI backtrace for cpu 1 [ 6217.812174][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6217.812178][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6217.812182][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6217.812189][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6217.812193][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6217.812197][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6217.812199][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6217.812201][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6217.812203][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6217.812205][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6217.812206][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6217.812208][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6217.812212][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6217.812214][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6217.812216][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6217.812217][ C1] Call Trace: [ 6217.812220][ C1] [ 6217.812225][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 6217.812231][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6217.812238][ C1] ? nmi_handle+0x156/0x420 [ 6217.812244][ C1] ? default_do_nmi+0x41/0x100 [ 6217.812247][ C1] ? exc_nmi+0xf3/0x120 [ 6217.812250][ C1] ? end_repeat_nmi+0xf/0x60 [ 6217.812255][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6217.812259][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6217.812263][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6217.812266][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6217.812269][ C1] [ 6217.812270][ C1] [ 6217.812271][ C1] ? run_ksoftirqd+0xb/0x60 [ 6217.812276][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6217.812279][ C1] ? __orc_find+0x9c/0xf0 [ 6217.812282][ C1] ? lock_acquire+0x1c1/0x220 [ 6217.812286][ C1] ? irqentry_enter+0x2b/0x60 [ 6217.812291][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6217.812295][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6217.812298][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6217.812302][ C1] ? lock_acquire+0x1c1/0x220 [ 6217.812304][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6217.812309][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6217.812313][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6217.812321][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6217.812324][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6217.812330][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6217.812338][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6217.812341][ C1] ip_local_deliver+0x19d/0x480 [ 6217.812344][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6217.812347][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6217.812352][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6217.812356][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6217.812359][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6217.812362][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6217.812372][ C1] ip_rcv+0x564/0x740 [ 6217.812375][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6217.812378][ C1] ? set_track_prepare+0x8a/0xd0 [ 6217.812382][ C1] ? irqentry_enter+0x2b/0x60 [ 6217.812385][ C1] ? irqentry_enter+0x2b/0x60 [ 6217.812389][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6217.812392][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6217.812396][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6217.812400][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6217.812402][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6217.812405][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6217.812409][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6217.812413][ C1] netif_receive_skb+0x55/0x280 [ 6217.812417][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6217.812426][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6217.812433][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6217.812440][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6217.812447][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6217.812459][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6217.812468][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6217.812471][ C1] ? arch_stack_walk+0x68/0x100 [ 6217.812476][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6217.812480][ C1] ? irqentry_enter+0x2b/0x60 [ 6217.812483][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6217.812488][ C1] ? irqentry_enter+0x2b/0x60 [ 6217.812491][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6217.812499][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6217.812502][ C1] ? arch_stack_walk+0x68/0x100 [ 6217.812506][ C1] __tcf_classify+0x32c/0x7d0 [ 6217.812511][ C1] tcf_classify+0x283/0x930 [ 6217.812514][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6217.812519][ C1] tc_run+0x2e4/0x5d0 [ 6217.812523][ C1] ? __pfx_tc_run+0x10/0x10 [ 6217.812528][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6217.812533][ C1] ? irqentry_enter+0x2b/0x60 [ 6217.812536][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6217.812539][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6217.812546][ C1] ip_finish_output2+0x786/0x18e0 [ 6217.812552][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6217.812555][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6217.812559][ C1] ? __ip_finish_output+0x10f/0x770 [ 6217.812562][ C1] ip_output+0x16b/0x4f0 [ 6217.812566][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6217.812569][ C1] ? __pfx_ip_output+0x10/0x10 [ 6217.812573][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6217.812581][ C1] ? __pfx_ip_output+0x10/0x10 [ 6217.812585][ C1] __ip_queue_xmit+0x672/0x1910 [ 6217.812591][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6217.812597][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6217.812601][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6217.812605][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6217.812609][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6217.812612][ C1] tcp_delack_timer+0x84/0x240 [ 6217.812616][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6217.812618][ C1] call_timer_fn+0x176/0x430 [ 6217.812623][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6217.812628][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6217.812632][ C1] __run_timers.part.0+0x52d/0x890 [ 6217.812636][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6217.812640][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6217.812645][ C1] ? __pfx___schedule+0x10/0x10 [ 6217.812649][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6217.812653][ C1] run_timer_softirq+0x72/0x100 [ 6217.812657][ C1] __do_softirq+0x1bc/0x7ff [ 6217.812660][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6217.812664][ C1] run_ksoftirqd+0x2e/0x60 [ 6217.812667][ C1] smpboot_thread_fn+0x30e/0x840 [ 6217.812671][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6217.812675][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6217.812678][ C1] kthread+0x292/0x360 [ 6217.812681][ C1] ? __pfx_kthread+0x10/0x10 [ 6217.812683][ C1] ret_from_fork+0x34/0x70 [ 6217.812686][ C1] ? __pfx_kthread+0x10/0x10 [ 6217.812688][ C1] ret_from_fork_asm+0x1b/0x30 [ 6217.812696][ C1] [ 6244.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4709s! [swapper/0:0] [ 6244.527920][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6244.529125][ C0] irq event stamp: 27567077 [ 6244.529370][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6244.529904][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6244.530378][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6244.530879][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6244.531369][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6244.531847][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6244.532499][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6244.532842][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6244.533866][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6244.534196][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6244.534617][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6244.535040][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6244.535465][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6244.535891][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6244.536319][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6244.536786][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6244.537142][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6244.537565][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6244.537984][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6244.538406][ C0] Call Trace: [ 6244.538592][ C0] [ 6244.538751][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6244.539025][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6244.539282][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6244.539570][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6244.539862][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6244.540168][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6244.540450][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6244.540773][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6244.541046][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6244.541324][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6244.541644][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6244.541955][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6244.542287][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6244.542589][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6244.542895][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6244.543202][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6244.543531][ C0] ? get_stack_info+0x36/0xc0 [ 6244.543785][ C0] ? lock_acquire+0x1c1/0x220 [ 6244.544038][ C0] ? lock_release+0x1d5/0x250 [ 6244.544288][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6244.544547][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6244.544832][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6244.545130][ C0] ? lock_acquire+0x1c1/0x220 [ 6244.545381][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6244.545636][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6244.545912][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6244.546163][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6244.546427][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6244.546698][ C0] ? __inet_lookup_established+0x341/0x610 [ 6244.547019][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6244.547313][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6244.547605][ C0] ip_local_deliver+0x19d/0x480 [ 6244.547867][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6244.548154][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6244.548420][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6244.548694][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6244.548955][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6244.549295][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6244.549569][ C0] ip_rcv+0x564/0x740 [ 6244.549781][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6244.550020][ C0] ? set_track_prepare+0x8a/0xd0 [ 6244.550284][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6244.550576][ C0] ? rest_init+0x153/0x260 [ 6244.550812][ C0] ? skb_clone+0x10b/0x330 [ 6244.551060][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6244.551394][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6244.551714][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6244.552016][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6244.552329][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6244.552591][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6244.552837][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6244.553157][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6244.553458][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6244.553796][ C0] ? lock_acquire+0x1c1/0x220 [ 6244.554044][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6244.554353][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6244.554655][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6244.554985][ C0] ? __copy_skb_header+0xaf/0x490 [ 6244.555252][ C0] ? __skb_clone+0x57a/0x760 [ 6244.555497][ C0] netif_receive_skb+0x55/0x280 [ 6244.555761][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6244.556090][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6244.556445][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6244.556760][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6244.557046][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6244.557343][ C0] ? hlock_class+0x4e/0x130 [ 6244.557588][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6244.557917][ C0] ? place_entity+0x21/0x2f0 [ 6244.558168][ C0] ? resched_curr+0x219/0x280 [ 6244.558425][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6244.558694][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6244.558978][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6244.559254][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6244.559511][ C0] ? activate_task+0xf5/0x260 [ 6244.559759][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6244.560036][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6244.560309][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6244.560568][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6244.560859][ C0] ? get_stack_info+0x36/0xc0 [ 6244.561116][ C0] ? stack_access_ok+0xda/0x1f0 [ 6244.561378][ C0] ? get_reg+0x119/0x190 [ 6244.561605][ C0] __tcf_classify+0x32c/0x7d0 [ 6244.561857][ C0] tcf_classify+0x283/0x930 [ 6244.562098][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6244.562423][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6244.562694][ C0] ? arch_stack_walk+0x8c/0x100 [ 6244.562958][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6244.563250][ C0] tc_run+0x2e4/0x5d0 [ 6244.563464][ C0] ? __pfx_tc_run+0x10/0x10 [ 6244.563703][ C0] ? lock_acquire+0x1c1/0x220 [ 6244.563951][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6244.564225][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6244.564493][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6244.564777][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6244.565053][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6244.565372][ C0] ? neigh_hh_output+0x348/0x590 [ 6244.565641][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6244.565918][ C0] ip_finish_output2+0x786/0x18e0 [ 6244.566191][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6244.566485][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6244.566838][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6244.567134][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6244.567401][ C0] ? __ip_finish_output+0x10f/0x770 [ 6244.567677][ C0] ip_output+0x16b/0x4f0 [ 6244.567901][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6244.568186][ C0] ? __pfx_ip_output+0x10/0x10 [ 6244.568439][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6244.568742][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6244.569004][ C0] ? ip_local_out+0x114/0x3b0 [ 6244.569261][ C0] __ip_queue_xmit+0x672/0x1910 [ 6244.569524][ C0] ? __skb_clone+0x57a/0x760 [ 6244.569772][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6244.570051][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6244.570343][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6244.570658][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6244.570916][ C0] ? tcp_current_mss+0x40a/0x510 [ 6244.571177][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6244.571460][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6244.571734][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6244.571984][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6244.572258][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6244.572575][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6244.572850][ C0] ? ktime_get+0xb6/0x190 [ 6244.573081][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6244.573353][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6244.573636][ C0] tcp_write_timer+0x82/0x1d0 [ 6244.573885][ C0] call_timer_fn+0x176/0x430 [ 6244.574129][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6244.574404][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6244.574678][ C0] __run_timers.part.0+0x52d/0x890 [ 6244.574953][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6244.575234][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6244.575534][ C0] ? lock_acquire+0x1c1/0x220 [ 6244.575779][ C0] ? clockevents_program_event+0xf6/0x300 [ 6244.576083][ C0] ? lock_release+0x1d5/0x250 [ 6244.576343][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6244.576621][ C0] ? ktime_get+0xb6/0x190 [ 6244.576856][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6244.577158][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6244.577467][ C0] run_timer_softirq+0x72/0x100 [ 6244.577728][ C0] __do_softirq+0x1bc/0x7ff [ 6244.577975][ C0] irq_exit_rcu+0x98/0xc0 [ 6244.578208][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6244.578509][ C0] [ 6244.578666][ C0] [ 6244.578823][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6244.579143][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6244.579413][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6244.580439][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6244.580767][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6244.581188][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6244.581612][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6244.582035][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6244.582454][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6244.582876][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6244.583188][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6244.583464][ C0] default_idle_call+0x69/0xa0 [ 6244.583716][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6244.583984][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6244.584275][ C0] ? lock_release+0x1d5/0x250 [ 6244.584528][ C0] do_idle+0xfb/0x160 [ 6244.584741][ C0] cpu_startup_entry+0x55/0x60 [ 6244.584996][ C0] rest_init+0x153/0x260 [ 6244.585222][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6244.585512][ C0] arch_call_rest_init+0x13/0x40 [ 6244.585778][ C0] start_kernel+0x314/0x3d0 [ 6244.586018][ C0] x86_64_start_reservations+0x18/0x30 [ 6244.586314][ C0] x86_64_start_kernel+0xba/0x110 [ 6244.586580][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6244.586905][ C0] [ 6244.587069][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4709s! [ksoftirqd/1:22] [ 6244.587530][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6244.588737][ C1] irq event stamp: 3886976 [ 6244.588979][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6244.589476][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6244.589970][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6244.590470][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6244.590965][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6244.591460][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6244.592107][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6244.592447][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6244.593472][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6244.593795][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6244.594215][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6244.594633][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6244.595052][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6244.595473][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6244.595891][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6244.596366][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6244.596718][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6244.597148][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6244.597567][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6244.597985][ C1] Call Trace: [ 6244.598164][ C1] [ 6244.598320][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6244.598601][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6244.598857][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6244.599153][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6244.599439][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6244.599741][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6244.600022][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6244.600343][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6244.600622][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6244.600945][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6244.601257][ C1] [ 6244.601417][ C1] [ 6244.601577][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6244.601914][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6244.602220][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6244.602533][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6244.602841][ C1] ? run_ksoftirqd+0xb/0x60 [ 6244.603096][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6244.603428][ C1] ? __orc_find+0x9c/0xf0 [ 6244.603660][ C1] ? lock_acquire+0x1c1/0x220 [ 6244.603911][ C1] ? irqentry_enter+0x2b/0x60 [ 6244.604163][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6244.604425][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6244.604713][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6244.605013][ C1] ? lock_acquire+0x1c1/0x220 [ 6244.605267][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6244.605524][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6244.605801][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6244.606050][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6244.606313][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6244.606593][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6244.606886][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6244.607181][ C1] ip_local_deliver+0x19d/0x480 [ 6244.607439][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6244.607723][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6244.607990][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6244.608274][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6244.608543][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6244.608880][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6244.609159][ C1] ip_rcv+0x564/0x740 [ 6244.609382][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6244.609629][ C1] ? set_track_prepare+0x8a/0xd0 [ 6244.609900][ C1] ? irqentry_enter+0x2b/0x60 [ 6244.610155][ C1] ? irqentry_enter+0x2b/0x60 [ 6244.610408][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6244.610652][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6244.610966][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6244.611309][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6244.611620][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6244.611965][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6244.612268][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6244.612599][ C1] netif_receive_skb+0x55/0x280 [ 6244.612860][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6244.613188][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6244.613538][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6244.613855][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6244.614147][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6244.614449][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6244.614778][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6244.615061][ C1] ? arch_stack_walk+0x68/0x100 [ 6244.615330][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6244.615612][ C1] ? irqentry_enter+0x2b/0x60 [ 6244.615868][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6244.616198][ C1] ? irqentry_enter+0x2b/0x60 [ 6244.616456][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6244.616783][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6244.617066][ C1] ? arch_stack_walk+0x68/0x100 [ 6244.617330][ C1] __tcf_classify+0x32c/0x7d0 [ 6244.617587][ C1] tcf_classify+0x283/0x930 [ 6244.617835][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6244.618110][ C1] tc_run+0x2e4/0x5d0 [ 6244.618333][ C1] ? __pfx_tc_run+0x10/0x10 [ 6244.618583][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6244.618856][ C1] ? irqentry_enter+0x2b/0x60 [ 6244.619110][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6244.619400][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6244.619724][ C1] ip_finish_output2+0x786/0x18e0 [ 6244.620000][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6244.620296][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6244.620561][ C1] ? __ip_finish_output+0x10f/0x770 [ 6244.620844][ C1] ip_output+0x16b/0x4f0 [ 6244.621077][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6244.621398][ C1] ? __pfx_ip_output+0x10/0x10 [ 6244.621661][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6244.622016][ C1] ? __pfx_ip_output+0x10/0x10 [ 6244.622272][ C1] __ip_queue_xmit+0x672/0x1910 [ 6244.622538][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6244.622824][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6244.623125][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6244.623416][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6244.623720][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6244.624011][ C1] tcp_delack_timer+0x84/0x240 [ 6244.624272][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6244.624559][ C1] call_timer_fn+0x176/0x430 [ 6244.624809][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6244.625089][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6244.625366][ C1] __run_timers.part.0+0x52d/0x890 [ 6244.625640][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6244.625933][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6244.626243][ C1] ? __pfx___schedule+0x10/0x10 [ 6244.626506][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6244.626833][ C1] run_timer_softirq+0x72/0x100 [ 6244.627096][ C1] __do_softirq+0x1bc/0x7ff [ 6244.627340][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6244.627614][ C1] run_ksoftirqd+0x2e/0x60 [ 6244.627857][ C1] smpboot_thread_fn+0x30e/0x840 [ 6244.628124][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6244.628421][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6244.628714][ C1] kthread+0x292/0x360 [ 6244.628934][ C1] ? __pfx_kthread+0x10/0x10 [ 6244.629182][ C1] ret_from_fork+0x34/0x70 [ 6244.629425][ C1] ? __pfx_kthread+0x10/0x10 [ 6244.629671][ C1] ret_from_fork_asm+0x1b/0x30 [ 6244.629938][ C1] [ 6272.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4735s! [swapper/0:0] [ 6272.527923][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6272.529118][ C0] irq event stamp: 27567077 [ 6272.529362][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6272.529893][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6272.530362][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6272.530869][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6272.531363][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6272.531841][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6272.532492][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa8/0xb90 [ 6272.532833][ C0] Code: 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 be 04 00 00 00 <48> 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c 08 84 c0 0f 85 [ 6272.533849][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6272.534177][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6272.534598][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6272.535014][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6272.535432][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6272.535849][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6272.536274][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6272.536745][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6272.537091][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6272.537513][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6272.537929][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6272.538346][ C0] Call Trace: [ 6272.538524][ C0] [ 6272.538679][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6272.538958][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6272.539211][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6272.539503][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6272.539786][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6272.540087][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6272.540366][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6272.540686][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6272.540962][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6272.541240][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6272.541567][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6272.541884][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6272.542214][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6272.542522][ C0] ? queued_spin_lock_slowpath+0xa8/0xb90 [ 6272.542827][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6272.543134][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6272.543465][ C0] ? get_stack_info+0x36/0xc0 [ 6272.543719][ C0] ? lock_acquire+0x1c1/0x220 [ 6272.543971][ C0] ? lock_release+0x1d5/0x250 [ 6272.544222][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6272.544482][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6272.544766][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6272.545063][ C0] ? lock_acquire+0x1c1/0x220 [ 6272.545316][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6272.545574][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6272.545850][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6272.546102][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6272.546365][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6272.546636][ C0] ? __inet_lookup_established+0x341/0x610 [ 6272.546956][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6272.547248][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6272.547539][ C0] ip_local_deliver+0x19d/0x480 [ 6272.547800][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6272.548086][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6272.548355][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6272.548631][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6272.548895][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6272.549233][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6272.549507][ C0] ip_rcv+0x564/0x740 [ 6272.549721][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6272.549961][ C0] ? set_track_prepare+0x8a/0xd0 [ 6272.550226][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6272.550520][ C0] ? rest_init+0x153/0x260 [ 6272.550757][ C0] ? skb_clone+0x10b/0x330 [ 6272.551000][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6272.551335][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6272.551657][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6272.551956][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6272.552266][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6272.552531][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6272.552777][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6272.553094][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6272.553393][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6272.553732][ C0] ? lock_acquire+0x1c1/0x220 [ 6272.553982][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6272.554291][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6272.554591][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6272.554918][ C0] ? __copy_skb_header+0xaf/0x490 [ 6272.555185][ C0] ? __skb_clone+0x57a/0x760 [ 6272.555434][ C0] netif_receive_skb+0x55/0x280 [ 6272.555695][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6272.556032][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6272.556380][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6272.556695][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6272.556980][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6272.557279][ C0] ? hlock_class+0x4e/0x130 [ 6272.557523][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6272.557849][ C0] ? place_entity+0x21/0x2f0 [ 6272.558093][ C0] ? resched_curr+0x219/0x280 [ 6272.558350][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6272.558620][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6272.558905][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6272.559180][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6272.559438][ C0] ? activate_task+0xf5/0x260 [ 6272.559686][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6272.559961][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6272.560236][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6272.560500][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6272.560791][ C0] ? get_stack_info+0x36/0xc0 [ 6272.561044][ C0] ? stack_access_ok+0xda/0x1f0 [ 6272.561303][ C0] ? get_reg+0x119/0x190 [ 6272.561535][ C0] __tcf_classify+0x32c/0x7d0 [ 6272.561788][ C0] tcf_classify+0x283/0x930 [ 6272.562031][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6272.562358][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6272.562630][ C0] ? arch_stack_walk+0x8c/0x100 [ 6272.562893][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6272.563185][ C0] tc_run+0x2e4/0x5d0 [ 6272.563400][ C0] ? __pfx_tc_run+0x10/0x10 [ 6272.563641][ C0] ? lock_acquire+0x1c1/0x220 [ 6272.563887][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6272.564161][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6272.564434][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6272.564716][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6272.564991][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6272.565312][ C0] ? neigh_hh_output+0x348/0x590 [ 6272.565578][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6272.565855][ C0] ip_finish_output2+0x786/0x18e0 [ 6272.566129][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6272.566423][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6272.566772][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6272.567062][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6272.567327][ C0] ? __ip_finish_output+0x10f/0x770 [ 6272.567602][ C0] ip_output+0x16b/0x4f0 [ 6272.567829][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6272.568115][ C0] ? __pfx_ip_output+0x10/0x10 [ 6272.568373][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6272.568675][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6272.568935][ C0] ? ip_local_out+0x114/0x3b0 [ 6272.569191][ C0] __ip_queue_xmit+0x672/0x1910 [ 6272.569457][ C0] ? __skb_clone+0x57a/0x760 [ 6272.569706][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6272.569985][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6272.570279][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6272.570597][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6272.570854][ C0] ? tcp_current_mss+0x40a/0x510 [ 6272.571117][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6272.571400][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6272.571674][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6272.571925][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6272.572197][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6272.572520][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6272.572795][ C0] ? ktime_get+0xb6/0x190 [ 6272.573024][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6272.573297][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6272.573581][ C0] tcp_write_timer+0x82/0x1d0 [ 6272.573832][ C0] call_timer_fn+0x176/0x430 [ 6272.574078][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6272.574355][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6272.574629][ C0] __run_timers.part.0+0x52d/0x890 [ 6272.574903][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6272.575183][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6272.575484][ C0] ? lock_acquire+0x1c1/0x220 [ 6272.575733][ C0] ? clockevents_program_event+0xf6/0x300 [ 6272.576044][ C0] ? lock_release+0x1d5/0x250 [ 6272.576297][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6272.576578][ C0] ? ktime_get+0xb6/0x190 [ 6272.576811][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6272.577116][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6272.577426][ C0] run_timer_softirq+0x72/0x100 [ 6272.577688][ C0] __do_softirq+0x1bc/0x7ff [ 6272.577934][ C0] irq_exit_rcu+0x98/0xc0 [ 6272.578168][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6272.578468][ C0] [ 6272.578624][ C0] [ 6272.578780][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6272.579097][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6272.579368][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6272.580393][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6272.580718][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6272.581144][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6272.581576][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6272.581997][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6272.582419][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6272.582844][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6272.583150][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6272.583426][ C0] default_idle_call+0x69/0xa0 [ 6272.583681][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6272.583946][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6272.584236][ C0] ? lock_release+0x1d5/0x250 [ 6272.584489][ C0] do_idle+0xfb/0x160 [ 6272.584707][ C0] cpu_startup_entry+0x55/0x60 [ 6272.584965][ C0] rest_init+0x153/0x260 [ 6272.585191][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6272.585481][ C0] arch_call_rest_init+0x13/0x40 [ 6272.585751][ C0] start_kernel+0x314/0x3d0 [ 6272.585992][ C0] x86_64_start_reservations+0x18/0x30 [ 6272.586290][ C0] x86_64_start_kernel+0xba/0x110 [ 6272.586558][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6272.586886][ C0] [ 6272.587052][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4735s! [ksoftirqd/1:22] [ 6272.587525][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6272.588726][ C1] irq event stamp: 3886976 [ 6272.588967][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6272.589467][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6272.589960][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6272.590463][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6272.590958][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6272.591455][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6272.592100][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6272.592439][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6272.593463][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6272.593783][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6272.594204][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6272.594621][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6272.595041][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6272.595459][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6272.595878][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6272.596357][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6272.596705][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6272.597133][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6272.597554][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6272.597972][ C1] Call Trace: [ 6272.598150][ C1] [ 6272.598307][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6272.598587][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6272.598845][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6272.599142][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6272.599429][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6272.599732][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6272.600012][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6272.600338][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6272.600619][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6272.600940][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6272.601252][ C1] [ 6272.601413][ C1] [ 6272.601575][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6272.601909][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6272.602215][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6272.602524][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6272.602831][ C1] ? run_ksoftirqd+0xb/0x60 [ 6272.603081][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6272.603411][ C1] ? __orc_find+0x9c/0xf0 [ 6272.603641][ C1] ? lock_acquire+0x1c1/0x220 [ 6272.603891][ C1] ? irqentry_enter+0x2b/0x60 [ 6272.604143][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6272.604401][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6272.604685][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6272.604985][ C1] ? lock_acquire+0x1c1/0x220 [ 6272.605242][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6272.605501][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6272.605776][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6272.606027][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6272.606296][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6272.606573][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6272.606867][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6272.607162][ C1] ip_local_deliver+0x19d/0x480 [ 6272.607422][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6272.607706][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6272.607969][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6272.608254][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6272.608520][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6272.608856][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6272.609134][ C1] ip_rcv+0x564/0x740 [ 6272.609352][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6272.609599][ C1] ? set_track_prepare+0x8a/0xd0 [ 6272.609867][ C1] ? irqentry_enter+0x2b/0x60 [ 6272.610120][ C1] ? irqentry_enter+0x2b/0x60 [ 6272.610371][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6272.610612][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6272.610925][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6272.611269][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6272.611579][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6272.611924][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6272.612227][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6272.612560][ C1] netif_receive_skb+0x55/0x280 [ 6272.612818][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6272.613146][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6272.613497][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6272.613814][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6272.614104][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6272.614408][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6272.614738][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6272.615020][ C1] ? arch_stack_walk+0x68/0x100 [ 6272.615286][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6272.615567][ C1] ? irqentry_enter+0x2b/0x60 [ 6272.615825][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6272.616154][ C1] ? irqentry_enter+0x2b/0x60 [ 6272.616408][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6272.616735][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6272.617017][ C1] ? arch_stack_walk+0x68/0x100 [ 6272.617283][ C1] __tcf_classify+0x32c/0x7d0 [ 6272.617541][ C1] tcf_classify+0x283/0x930 [ 6272.617789][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6272.618062][ C1] tc_run+0x2e4/0x5d0 [ 6272.618281][ C1] ? __pfx_tc_run+0x10/0x10 [ 6272.618529][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6272.618800][ C1] ? irqentry_enter+0x2b/0x60 [ 6272.619052][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6272.619338][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6272.619661][ C1] ip_finish_output2+0x786/0x18e0 [ 6272.619938][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6272.620233][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6272.620499][ C1] ? __ip_finish_output+0x10f/0x770 [ 6272.620781][ C1] ip_output+0x16b/0x4f0 [ 6272.621011][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6272.621330][ C1] ? __pfx_ip_output+0x10/0x10 [ 6272.621589][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6272.621942][ C1] ? __pfx_ip_output+0x10/0x10 [ 6272.622201][ C1] __ip_queue_xmit+0x672/0x1910 [ 6272.622467][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6272.622752][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6272.623051][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6272.623341][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6272.623639][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6272.623929][ C1] tcp_delack_timer+0x84/0x240 [ 6272.624192][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6272.624484][ C1] call_timer_fn+0x176/0x430 [ 6272.624733][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6272.625013][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6272.625293][ C1] __run_timers.part.0+0x52d/0x890 [ 6272.625567][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6272.625861][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6272.626172][ C1] ? __pfx___schedule+0x10/0x10 [ 6272.626436][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6272.626763][ C1] run_timer_softirq+0x72/0x100 [ 6272.627024][ C1] __do_softirq+0x1bc/0x7ff [ 6272.627270][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6272.627543][ C1] run_ksoftirqd+0x2e/0x60 [ 6272.627786][ C1] smpboot_thread_fn+0x30e/0x840 [ 6272.628051][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6272.628345][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6272.628635][ C1] kthread+0x292/0x360 [ 6272.628859][ C1] ? __pfx_kthread+0x10/0x10 [ 6272.629109][ C1] ret_from_fork+0x34/0x70 [ 6272.629350][ C1] ? __pfx_kthread+0x10/0x10 [ 6272.629595][ C1] ret_from_fork_asm+0x1b/0x30 [ 6272.629858][ C1] [ 6295.816025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6295.816412][ C1] rcu: 1-....: (5086648 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1208453 [ 6295.817006][ C1] rcu: (t=5101507 jiffies g=1007429 q=31 ncpus=4) [ 6295.817351][ C1] Sending NMI from CPU 1 to CPUs 0: [ 6295.817641][ C0] NMI backtrace for cpu 0 [ 6295.817649][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6295.817654][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6295.817657][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6295.817667][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6295.817670][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6295.817674][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6295.817676][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6295.817678][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6295.817680][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6295.817682][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6295.817684][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6295.817686][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6295.817690][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6295.817692][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6295.817693][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6295.817695][ C0] Call Trace: [ 6295.817698][ C0] [ 6295.817701][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 6295.817707][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6295.817712][ C0] ? nmi_handle+0x156/0x420 [ 6295.817718][ C0] ? default_do_nmi+0x41/0x100 [ 6295.817722][ C0] ? exc_nmi+0xf3/0x120 [ 6295.817725][ C0] ? end_repeat_nmi+0xf/0x60 [ 6295.817729][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6295.817734][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6295.817737][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6295.817741][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6295.817745][ C0] [ 6295.817746][ C0] [ 6295.817747][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6295.817750][ C0] ? get_stack_info+0x36/0xc0 [ 6295.817755][ C0] ? lock_acquire+0x1c1/0x220 [ 6295.817760][ C0] ? lock_release+0x1d5/0x250 [ 6295.817764][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6295.817768][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6295.817771][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6295.817774][ C0] ? lock_acquire+0x1c1/0x220 [ 6295.817776][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6295.817782][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6295.817785][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6295.817793][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6295.817795][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6295.817799][ C0] ? __inet_lookup_established+0x341/0x610 [ 6295.817806][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6295.817812][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6295.817817][ C0] ip_local_deliver+0x19d/0x480 [ 6295.817820][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6295.817822][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6295.817828][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6295.817832][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6295.817835][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6295.817839][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6295.817849][ C0] ip_rcv+0x564/0x740 [ 6295.817853][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6295.817855][ C0] ? set_track_prepare+0x8a/0xd0 [ 6295.817860][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6295.817862][ C0] ? rest_init+0x153/0x260 [ 6295.817865][ C0] ? skb_clone+0x10b/0x330 [ 6295.817870][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6295.817876][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6295.817881][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6295.817886][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6295.817895][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6295.817898][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6295.817900][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6295.817905][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6295.817908][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6295.817911][ C0] ? lock_acquire+0x1c1/0x220 [ 6295.817914][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6295.817917][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6295.817920][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6295.817923][ C0] ? __copy_skb_header+0xaf/0x490 [ 6295.817926][ C0] ? __skb_clone+0x57a/0x760 [ 6295.817929][ C0] netif_receive_skb+0x55/0x280 [ 6295.817931][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6295.817939][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6295.817947][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6295.817954][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6295.817959][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6295.817967][ C0] ? hlock_class+0x4e/0x130 [ 6295.817973][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6295.817983][ C0] ? place_entity+0x21/0x2f0 [ 6295.817986][ C0] ? resched_curr+0x219/0x280 [ 6295.817990][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6295.817993][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6295.817997][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6295.818002][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6295.818004][ C0] ? activate_task+0xf5/0x260 [ 6295.818007][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6295.818013][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6295.818016][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6295.818021][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6295.818024][ C0] ? get_stack_info+0x36/0xc0 [ 6295.818028][ C0] ? stack_access_ok+0xda/0x1f0 [ 6295.818030][ C0] ? get_reg+0x119/0x190 [ 6295.818034][ C0] __tcf_classify+0x32c/0x7d0 [ 6295.818039][ C0] tcf_classify+0x283/0x930 [ 6295.818042][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6295.818047][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6295.818049][ C0] ? arch_stack_walk+0x8c/0x100 [ 6295.818054][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6295.818057][ C0] tc_run+0x2e4/0x5d0 [ 6295.818062][ C0] ? __pfx_tc_run+0x10/0x10 [ 6295.818065][ C0] ? lock_acquire+0x1c1/0x220 [ 6295.818068][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6295.818072][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6295.818078][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6295.818081][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6295.818085][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6295.818089][ C0] ? neigh_hh_output+0x348/0x590 [ 6295.818093][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6295.818097][ C0] ip_finish_output2+0x786/0x18e0 [ 6295.818100][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6295.818106][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6295.818114][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6295.818117][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6295.818121][ C0] ? __ip_finish_output+0x10f/0x770 [ 6295.818125][ C0] ip_output+0x16b/0x4f0 [ 6295.818128][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6295.818133][ C0] ? __pfx_ip_output+0x10/0x10 [ 6295.818136][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6295.818141][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6295.818143][ C0] ? ip_local_out+0x114/0x3b0 [ 6295.818147][ C0] __ip_queue_xmit+0x672/0x1910 [ 6295.818152][ C0] ? __skb_clone+0x57a/0x760 [ 6295.818155][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6295.818162][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6295.818166][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6295.818170][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6295.818175][ C0] ? tcp_current_mss+0x40a/0x510 [ 6295.818178][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6295.818181][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6295.818184][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6295.818186][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6295.818189][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6295.818193][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6295.818198][ C0] ? ktime_get+0xb6/0x190 [ 6295.818202][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6295.818206][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6295.818209][ C0] tcp_write_timer+0x82/0x1d0 [ 6295.818213][ C0] call_timer_fn+0x176/0x430 [ 6295.818216][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6295.818221][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6295.818225][ C0] __run_timers.part.0+0x52d/0x890 [ 6295.818228][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6295.818233][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6295.818236][ C0] ? lock_acquire+0x1c1/0x220 [ 6295.818238][ C0] ? clockevents_program_event+0xf6/0x300 [ 6295.818244][ C0] ? lock_release+0x1d5/0x250 [ 6295.818246][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6295.818249][ C0] ? ktime_get+0xb6/0x190 [ 6295.818252][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6295.818256][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6295.818260][ C0] run_timer_softirq+0x72/0x100 [ 6295.818264][ C0] __do_softirq+0x1bc/0x7ff [ 6295.818268][ C0] irq_exit_rcu+0x98/0xc0 [ 6295.818271][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6295.818275][ C0] [ 6295.818275][ C0] [ 6295.818277][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6295.818282][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6295.818286][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6295.818288][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6295.818290][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6295.818292][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6295.818293][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6295.818295][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6295.818296][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6295.818300][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6295.818303][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6295.818307][ C0] default_idle_call+0x69/0xa0 [ 6295.818309][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6295.818311][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6295.818317][ C0] ? lock_release+0x1d5/0x250 [ 6295.818321][ C0] do_idle+0xfb/0x160 [ 6295.818324][ C0] cpu_startup_entry+0x55/0x60 [ 6295.818326][ C0] rest_init+0x153/0x260 [ 6295.818329][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6295.818335][ C0] arch_call_rest_init+0x13/0x40 [ 6295.818341][ C0] start_kernel+0x314/0x3d0 [ 6295.818344][ C0] x86_64_start_reservations+0x18/0x30 [ 6295.818350][ C0] x86_64_start_kernel+0xba/0x110 [ 6295.818354][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6295.818362][ C0] [ 6295.818637][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6295.872752][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6295.873396][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6295.873742][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6295.874760][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6295.875084][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6295.875503][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6295.875926][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6295.876349][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6295.876771][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6295.877196][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6295.877667][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6295.878015][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6295.878443][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6295.878862][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6295.879280][ C1] Call Trace: [ 6295.879456][ C1] [ 6295.879610][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6295.879902][ C1] ? print_cpu_stall+0x263/0x6a0 [ 6295.880166][ C1] ? check_cpu_stall+0x284/0x500 [ 6295.880438][ C1] ? rcu_pending+0x92/0x360 [ 6295.880680][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6295.880962][ C1] ? update_process_times+0xb9/0x110 [ 6295.881248][ C1] ? tick_sched_handle+0x67/0x130 [ 6295.881516][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6295.881814][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6295.882070][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6295.882394][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6295.882684][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6295.882991][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6295.883280][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6295.883603][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6295.883877][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6295.884202][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6295.884516][ C1] [ 6295.884671][ C1] [ 6295.884828][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6295.885159][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6295.885465][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6295.885778][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6295.886086][ C1] ? run_ksoftirqd+0xb/0x60 [ 6295.886334][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6295.886662][ C1] ? __orc_find+0x9c/0xf0 [ 6295.886891][ C1] ? lock_acquire+0x1c1/0x220 [ 6295.887140][ C1] ? irqentry_enter+0x2b/0x60 [ 6295.887388][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6295.887647][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6295.887936][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6295.888235][ C1] ? lock_acquire+0x1c1/0x220 [ 6295.888486][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6295.888740][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6295.889014][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6295.889259][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6295.889515][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6295.889785][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6295.890074][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6295.890362][ C1] ip_local_deliver+0x19d/0x480 [ 6295.890623][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6295.890912][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6295.891188][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6295.891465][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6295.891727][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6295.892067][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6295.892340][ C1] ip_rcv+0x564/0x740 [ 6295.892554][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6295.892795][ C1] ? set_track_prepare+0x8a/0xd0 [ 6295.893061][ C1] ? irqentry_enter+0x2b/0x60 [ 6295.893313][ C1] ? irqentry_enter+0x2b/0x60 [ 6295.893565][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6295.893811][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6295.894127][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6295.894470][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6295.894782][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6295.895120][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6295.895416][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6295.895752][ C1] netif_receive_skb+0x55/0x280 [ 6295.896019][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6295.896346][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6295.896694][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6295.897012][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6295.897301][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6295.897601][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6295.897927][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6295.898207][ C1] ? arch_stack_walk+0x68/0x100 [ 6295.898469][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6295.898749][ C1] ? irqentry_enter+0x2b/0x60 [ 6295.899005][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6295.899332][ C1] ? irqentry_enter+0x2b/0x60 [ 6295.899583][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6295.899903][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6295.900187][ C1] ? arch_stack_walk+0x68/0x100 [ 6295.900447][ C1] __tcf_classify+0x32c/0x7d0 [ 6295.900697][ C1] tcf_classify+0x283/0x930 [ 6295.900938][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6295.901209][ C1] tc_run+0x2e4/0x5d0 [ 6295.901425][ C1] ? __pfx_tc_run+0x10/0x10 [ 6295.901671][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6295.901937][ C1] ? irqentry_enter+0x2b/0x60 [ 6295.902194][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6295.902481][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6295.902806][ C1] ip_finish_output2+0x786/0x18e0 [ 6295.903080][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6295.903366][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6295.903636][ C1] ? __ip_finish_output+0x10f/0x770 [ 6295.903913][ C1] ip_output+0x16b/0x4f0 [ 6295.904140][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6295.904463][ C1] ? __pfx_ip_output+0x10/0x10 [ 6295.904720][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6295.905075][ C1] ? __pfx_ip_output+0x10/0x10 [ 6295.905332][ C1] __ip_queue_xmit+0x672/0x1910 [ 6295.905593][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6295.905873][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6295.906174][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6295.906464][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6295.906765][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6295.907055][ C1] tcp_delack_timer+0x84/0x240 [ 6295.907314][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6295.907599][ C1] call_timer_fn+0x176/0x430 [ 6295.907847][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6295.908124][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6295.908400][ C1] __run_timers.part.0+0x52d/0x890 [ 6295.908671][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6295.908963][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6295.909266][ C1] ? __pfx___schedule+0x10/0x10 [ 6295.909523][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6295.909838][ C1] run_timer_softirq+0x72/0x100 [ 6295.910100][ C1] __do_softirq+0x1bc/0x7ff [ 6295.910345][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6295.910621][ C1] run_ksoftirqd+0x2e/0x60 [ 6295.910856][ C1] smpboot_thread_fn+0x30e/0x840 [ 6295.911124][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6295.911414][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6295.911707][ C1] kthread+0x292/0x360 [ 6295.911924][ C1] ? __pfx_kthread+0x10/0x10 [ 6295.912176][ C1] ret_from_fork+0x34/0x70 [ 6295.912413][ C1] ? __pfx_kthread+0x10/0x10 [ 6295.912662][ C1] ret_from_fork_asm+0x1b/0x30 [ 6295.912922][ C1] [ 6320.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4780s! [swapper/0:0] [ 6320.527919][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6320.529119][ C0] irq event stamp: 27567077 [ 6320.529362][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6320.529900][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6320.530374][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6320.530876][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6320.531370][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6320.531852][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6320.532507][ C0] RIP: 0010:kasan_check_range+0x84/0x1c0 [ 6320.532816][ C0] Code: 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 89 da 48 29 ea <48> 83 fa 10 0f 8e c0 00 00 00 41 89 eb 41 83 e3 07 75 7d 48 85 d2 [ 6320.533834][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000202 [ 6320.534156][ C0] RAX: ffffed100141336b RBX: ffffed100141336c RCX: ffffffff90c7aaa0 [ 6320.534573][ C0] RDX: 0000000000000001 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6320.534990][ C0] RBP: ffffed100141336b R08: 0000000000000000 R09: ffffed100141336b [ 6320.535409][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6320.535836][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6320.536256][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6320.536727][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6320.537074][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6320.537494][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6320.537909][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6320.538325][ C0] Call Trace: [ 6320.538504][ C0] [ 6320.538659][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6320.538940][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6320.539197][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6320.539489][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6320.539772][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6320.540073][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6320.540353][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6320.540673][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6320.540949][ C0] ? hrtimer_interrupt+0x31a/0x770 [ 6320.541223][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6320.541505][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6320.541831][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6320.542140][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6320.542475][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6320.542778][ C0] ? kasan_check_range+0x84/0x1c0 [ 6320.543047][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 6320.543340][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6320.543663][ C0] ? get_stack_info+0x36/0xc0 [ 6320.543918][ C0] ? lock_acquire+0x1c1/0x220 [ 6320.544172][ C0] ? lock_release+0x1d5/0x250 [ 6320.544425][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6320.544688][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6320.544977][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6320.545281][ C0] ? lock_acquire+0x1c1/0x220 [ 6320.545534][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6320.545797][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6320.546071][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6320.546315][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6320.546570][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6320.546838][ C0] ? __inet_lookup_established+0x341/0x610 [ 6320.547148][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6320.547439][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6320.547732][ C0] ip_local_deliver+0x19d/0x480 [ 6320.547990][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6320.548275][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6320.548540][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6320.548821][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6320.549086][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6320.549419][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6320.549698][ C0] ip_rcv+0x564/0x740 [ 6320.549914][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6320.550160][ C0] ? set_track_prepare+0x8a/0xd0 [ 6320.550427][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6320.550713][ C0] ? rest_init+0x153/0x260 [ 6320.550956][ C0] ? skb_clone+0x10b/0x330 [ 6320.551196][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6320.551533][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6320.551859][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6320.552152][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6320.552458][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6320.552717][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6320.552956][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6320.553273][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6320.553571][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6320.553917][ C0] ? lock_acquire+0x1c1/0x220 [ 6320.554169][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6320.554481][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6320.554779][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6320.555112][ C0] ? __copy_skb_header+0xaf/0x490 [ 6320.555382][ C0] ? __skb_clone+0x57a/0x760 [ 6320.555631][ C0] netif_receive_skb+0x55/0x280 [ 6320.555893][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6320.556224][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6320.556576][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6320.556888][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6320.557179][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6320.557481][ C0] ? hlock_class+0x4e/0x130 [ 6320.557730][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6320.558061][ C0] ? place_entity+0x21/0x2f0 [ 6320.558310][ C0] ? resched_curr+0x219/0x280 [ 6320.558557][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6320.558830][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6320.559113][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6320.559392][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6320.559655][ C0] ? activate_task+0xf5/0x260 [ 6320.559909][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6320.560185][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6320.560456][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6320.560716][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6320.561005][ C0] ? get_stack_info+0x36/0xc0 [ 6320.561253][ C0] ? stack_access_ok+0xda/0x1f0 [ 6320.561510][ C0] ? get_reg+0x119/0x190 [ 6320.561736][ C0] __tcf_classify+0x32c/0x7d0 [ 6320.561990][ C0] tcf_classify+0x283/0x930 [ 6320.562234][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6320.562566][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6320.562830][ C0] ? arch_stack_walk+0x8c/0x100 [ 6320.563092][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6320.563383][ C0] tc_run+0x2e4/0x5d0 [ 6320.563599][ C0] ? __pfx_tc_run+0x10/0x10 [ 6320.563845][ C0] ? lock_acquire+0x1c1/0x220 [ 6320.564099][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6320.564375][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6320.564640][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6320.564928][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6320.565207][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6320.565529][ C0] ? neigh_hh_output+0x348/0x590 [ 6320.565796][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6320.566071][ C0] ip_finish_output2+0x786/0x18e0 [ 6320.566338][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6320.566633][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6320.566986][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6320.567277][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6320.567542][ C0] ? __ip_finish_output+0x10f/0x770 [ 6320.567822][ C0] ip_output+0x16b/0x4f0 [ 6320.568054][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6320.568334][ C0] ? __pfx_ip_output+0x10/0x10 [ 6320.568592][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6320.568894][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6320.569161][ C0] ? ip_local_out+0x114/0x3b0 [ 6320.569412][ C0] __ip_queue_xmit+0x672/0x1910 [ 6320.569671][ C0] ? __skb_clone+0x57a/0x760 [ 6320.569915][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6320.570200][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6320.570497][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6320.570820][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6320.571076][ C0] ? tcp_current_mss+0x40a/0x510 [ 6320.571341][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6320.571620][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6320.571900][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6320.572157][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6320.572423][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6320.572739][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6320.573020][ C0] ? ktime_get+0xb6/0x190 [ 6320.573253][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6320.573530][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6320.573808][ C0] tcp_write_timer+0x82/0x1d0 [ 6320.574066][ C0] call_timer_fn+0x176/0x430 [ 6320.574314][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6320.574587][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6320.574863][ C0] __run_timers.part.0+0x52d/0x890 [ 6320.575135][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6320.575420][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6320.575717][ C0] ? lock_acquire+0x1c1/0x220 [ 6320.575973][ C0] ? clockevents_program_event+0xf6/0x300 [ 6320.576278][ C0] ? lock_release+0x1d5/0x250 [ 6320.576524][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6320.576799][ C0] ? ktime_get+0xb6/0x190 [ 6320.577030][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6320.577325][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6320.577640][ C0] run_timer_softirq+0x72/0x100 [ 6320.577900][ C0] __do_softirq+0x1bc/0x7ff [ 6320.578144][ C0] irq_exit_rcu+0x98/0xc0 [ 6320.578373][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6320.578672][ C0] [ 6320.578830][ C0] [ 6320.578989][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6320.579308][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6320.579578][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6320.580595][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6320.580918][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6320.581336][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6320.581757][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6320.582174][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6320.582593][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6320.583012][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6320.583314][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6320.583585][ C0] default_idle_call+0x69/0xa0 [ 6320.583840][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6320.584102][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6320.584402][ C0] ? lock_release+0x1d5/0x250 [ 6320.584653][ C0] do_idle+0xfb/0x160 [ 6320.584868][ C0] cpu_startup_entry+0x55/0x60 [ 6320.585122][ C0] rest_init+0x153/0x260 [ 6320.585349][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6320.585636][ C0] arch_call_rest_init+0x13/0x40 [ 6320.585907][ C0] start_kernel+0x314/0x3d0 [ 6320.586150][ C0] x86_64_start_reservations+0x18/0x30 [ 6320.586443][ C0] x86_64_start_kernel+0xba/0x110 [ 6320.586713][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6320.587047][ C0] [ 6320.587212][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4780s! [ksoftirqd/1:22] [ 6320.587679][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6320.588882][ C1] irq event stamp: 3886976 [ 6320.589121][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6320.589618][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6320.590111][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6320.590607][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6320.591103][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6320.591593][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6320.592235][ C1] RIP: 0010:kasan_check_range+0x54/0x1c0 [ 6320.592536][ C1] Code: ff fe 48 39 c7 77 23 44 89 c2 e8 57 e8 ff ff 83 f0 01 5b 5d 41 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd <4c> 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 [ 6320.593563][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000212 [ 6320.593888][ C1] RAX: ffff7fffffffffff RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6320.594313][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6320.594734][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6320.595156][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6320.595575][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6320.595999][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6320.596470][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6320.596820][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6320.597242][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6320.597665][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6320.598089][ C1] Call Trace: [ 6320.598269][ C1] [ 6320.598427][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6320.598704][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6320.598966][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6320.599259][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6320.599548][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6320.599851][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6320.600133][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6320.600458][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6320.600732][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6320.601060][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6320.601371][ C1] [ 6320.601528][ C1] [ 6320.601684][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6320.602010][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6320.602319][ C1] ? kasan_check_range+0x54/0x1c0 [ 6320.602589][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 6320.602891][ C1] ? run_ksoftirqd+0xb/0x60 [ 6320.603138][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6320.603469][ C1] ? __orc_find+0x9c/0xf0 [ 6320.603701][ C1] ? lock_acquire+0x1c1/0x220 [ 6320.603954][ C1] ? irqentry_enter+0x2b/0x60 [ 6320.604209][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6320.604469][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6320.604753][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6320.605053][ C1] ? lock_acquire+0x1c1/0x220 [ 6320.605306][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6320.605562][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6320.605846][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6320.606097][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6320.606359][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6320.606632][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6320.606925][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6320.607222][ C1] ip_local_deliver+0x19d/0x480 [ 6320.607481][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6320.607767][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6320.608034][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6320.608315][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6320.608580][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6320.608913][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6320.609194][ C1] ip_rcv+0x564/0x740 [ 6320.609407][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6320.609652][ C1] ? set_track_prepare+0x8a/0xd0 [ 6320.609921][ C1] ? irqentry_enter+0x2b/0x60 [ 6320.610170][ C1] ? irqentry_enter+0x2b/0x60 [ 6320.610418][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6320.610657][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6320.610972][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6320.611313][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6320.611621][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6320.611964][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6320.612268][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6320.612601][ C1] netif_receive_skb+0x55/0x280 [ 6320.612860][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6320.613191][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6320.613542][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6320.613863][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6320.614154][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6320.614461][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6320.614792][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6320.615074][ C1] ? arch_stack_walk+0x68/0x100 [ 6320.615341][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6320.615621][ C1] ? irqentry_enter+0x2b/0x60 [ 6320.615877][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6320.616198][ C1] ? irqentry_enter+0x2b/0x60 [ 6320.616454][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6320.616783][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6320.617065][ C1] ? arch_stack_walk+0x68/0x100 [ 6320.617334][ C1] __tcf_classify+0x32c/0x7d0 [ 6320.617592][ C1] tcf_classify+0x283/0x930 [ 6320.617839][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6320.618114][ C1] tc_run+0x2e4/0x5d0 [ 6320.618330][ C1] ? __pfx_tc_run+0x10/0x10 [ 6320.618577][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6320.618846][ C1] ? irqentry_enter+0x2b/0x60 [ 6320.619097][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6320.619382][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6320.619704][ C1] ip_finish_output2+0x786/0x18e0 [ 6320.619978][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6320.620276][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6320.620541][ C1] ? __ip_finish_output+0x10f/0x770 [ 6320.620824][ C1] ip_output+0x16b/0x4f0 [ 6320.621053][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6320.621376][ C1] ? __pfx_ip_output+0x10/0x10 [ 6320.621634][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6320.621987][ C1] ? __pfx_ip_output+0x10/0x10 [ 6320.622246][ C1] __ip_queue_xmit+0x672/0x1910 [ 6320.622511][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6320.622796][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6320.623096][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6320.623385][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6320.623682][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6320.623969][ C1] tcp_delack_timer+0x84/0x240 [ 6320.624226][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6320.624509][ C1] call_timer_fn+0x176/0x430 [ 6320.624756][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6320.625034][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6320.625313][ C1] __run_timers.part.0+0x52d/0x890 [ 6320.625585][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6320.625879][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6320.626180][ C1] ? __pfx___schedule+0x10/0x10 [ 6320.626445][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6320.626765][ C1] run_timer_softirq+0x72/0x100 [ 6320.627025][ C1] __do_softirq+0x1bc/0x7ff [ 6320.627266][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6320.627539][ C1] run_ksoftirqd+0x2e/0x60 [ 6320.627783][ C1] smpboot_thread_fn+0x30e/0x840 [ 6320.628048][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6320.628340][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6320.628628][ C1] kthread+0x292/0x360 [ 6320.628849][ C1] ? __pfx_kthread+0x10/0x10 [ 6320.629095][ C1] ret_from_fork+0x34/0x70 [ 6320.629337][ C1] ? __pfx_kthread+0x10/0x10 [ 6320.629580][ C1] ret_from_fork_asm+0x1b/0x30 [ 6320.629842][ C1] [ 6348.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4806s! [swapper/0:0] [ 6348.527929][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6348.529139][ C0] irq event stamp: 27567077 [ 6348.529384][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6348.529923][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6348.530401][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6348.530905][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6348.531399][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6348.531880][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6348.532529][ C0] RIP: 0010:kasan_check_range+0x77/0x1c0 [ 6348.532837][ C0] Code: ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 <48> 89 e8 49 8d 59 01 48 89 da 48 29 ea 48 83 fa 10 0f 8e c0 00 00 [ 6348.533852][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000282 [ 6348.534176][ C0] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6348.534595][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6348.535013][ C0] RBP: ffffed100141336b R08: 0000000000000000 R09: ffffed100141336b [ 6348.535434][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6348.535859][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6348.536290][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6348.536762][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6348.537111][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6348.537539][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6348.537959][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6348.538378][ C0] Call Trace: [ 6348.538554][ C0] [ 6348.538710][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6348.538990][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6348.539245][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6348.539538][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6348.539822][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6348.540124][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6348.540401][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6348.540721][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6348.540996][ C0] ? hrtimer_interrupt+0x31a/0x770 [ 6348.541268][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6348.541547][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6348.541870][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6348.542180][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6348.542515][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6348.542817][ C0] ? kasan_check_range+0x77/0x1c0 [ 6348.543089][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 6348.543384][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6348.543710][ C0] ? get_stack_info+0x36/0xc0 [ 6348.543964][ C0] ? lock_acquire+0x1c1/0x220 [ 6348.544218][ C0] ? lock_release+0x1d5/0x250 [ 6348.544471][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6348.544733][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6348.545020][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6348.545325][ C0] ? lock_acquire+0x1c1/0x220 [ 6348.545575][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6348.545834][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6348.546111][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6348.546360][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6348.546617][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6348.546885][ C0] ? __inet_lookup_established+0x341/0x610 [ 6348.547196][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6348.547487][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6348.547780][ C0] ip_local_deliver+0x19d/0x480 [ 6348.548036][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6348.548317][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6348.548582][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6348.548861][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6348.549128][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6348.549463][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6348.549740][ C0] ip_rcv+0x564/0x740 [ 6348.549960][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6348.550205][ C0] ? set_track_prepare+0x8a/0xd0 [ 6348.550473][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6348.550762][ C0] ? rest_init+0x153/0x260 [ 6348.551001][ C0] ? skb_clone+0x10b/0x330 [ 6348.551239][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6348.551576][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6348.551901][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6348.552195][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6348.552502][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6348.552760][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6348.553002][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6348.553315][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6348.553612][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6348.553956][ C0] ? lock_acquire+0x1c1/0x220 [ 6348.554211][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6348.554523][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6348.554819][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6348.555153][ C0] ? __copy_skb_header+0xaf/0x490 [ 6348.555425][ C0] ? __skb_clone+0x57a/0x760 [ 6348.555681][ C0] netif_receive_skb+0x55/0x280 [ 6348.555943][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6348.556276][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6348.556626][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6348.556944][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6348.557236][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6348.557541][ C0] ? hlock_class+0x4e/0x130 [ 6348.557790][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6348.558121][ C0] ? place_entity+0x21/0x2f0 [ 6348.558370][ C0] ? resched_curr+0x219/0x280 [ 6348.558620][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6348.558886][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6348.559169][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6348.559452][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6348.559713][ C0] ? activate_task+0xf5/0x260 [ 6348.559967][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6348.560244][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6348.560516][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6348.560778][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6348.561070][ C0] ? get_stack_info+0x36/0xc0 [ 6348.561319][ C0] ? stack_access_ok+0xda/0x1f0 [ 6348.561574][ C0] ? get_reg+0x119/0x190 [ 6348.561801][ C0] __tcf_classify+0x32c/0x7d0 [ 6348.562055][ C0] tcf_classify+0x283/0x930 [ 6348.562301][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6348.562632][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6348.562899][ C0] ? arch_stack_walk+0x8c/0x100 [ 6348.563157][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6348.563446][ C0] tc_run+0x2e4/0x5d0 [ 6348.563668][ C0] ? __pfx_tc_run+0x10/0x10 [ 6348.563918][ C0] ? lock_acquire+0x1c1/0x220 [ 6348.564171][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6348.564448][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6348.564712][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6348.565002][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6348.565283][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6348.565607][ C0] ? neigh_hh_output+0x348/0x590 [ 6348.565881][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6348.566157][ C0] ip_finish_output2+0x786/0x18e0 [ 6348.566424][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6348.566715][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6348.567071][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6348.567362][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6348.567624][ C0] ? __ip_finish_output+0x10f/0x770 [ 6348.567905][ C0] ip_output+0x16b/0x4f0 [ 6348.568135][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6348.568418][ C0] ? __pfx_ip_output+0x10/0x10 [ 6348.568677][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6348.568976][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6348.569242][ C0] ? ip_local_out+0x114/0x3b0 [ 6348.569492][ C0] __ip_queue_xmit+0x672/0x1910 [ 6348.569752][ C0] ? __skb_clone+0x57a/0x760 [ 6348.570001][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6348.570285][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6348.570586][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6348.570906][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6348.571161][ C0] ? tcp_current_mss+0x40a/0x510 [ 6348.571429][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6348.571711][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6348.571993][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6348.572251][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6348.572518][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6348.572838][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6348.573118][ C0] ? ktime_get+0xb6/0x190 [ 6348.573354][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6348.573630][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6348.573912][ C0] tcp_write_timer+0x82/0x1d0 [ 6348.574167][ C0] call_timer_fn+0x176/0x430 [ 6348.574417][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6348.574695][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6348.574970][ C0] __run_timers.part.0+0x52d/0x890 [ 6348.575242][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6348.575526][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6348.575834][ C0] ? lock_acquire+0x1c1/0x220 [ 6348.576083][ C0] ? clockevents_program_event+0xf6/0x300 [ 6348.576386][ C0] ? lock_release+0x1d5/0x250 [ 6348.576633][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6348.576908][ C0] ? ktime_get+0xb6/0x190 [ 6348.577137][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6348.577435][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6348.577747][ C0] run_timer_softirq+0x72/0x100 [ 6348.578005][ C0] __do_softirq+0x1bc/0x7ff [ 6348.578247][ C0] irq_exit_rcu+0x98/0xc0 [ 6348.578476][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6348.578773][ C0] [ 6348.578933][ C0] [ 6348.579094][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6348.579415][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6348.579681][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6348.580695][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6348.581014][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6348.581431][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6348.581847][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6348.582263][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6348.582678][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6348.583097][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6348.583400][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6348.583672][ C0] default_idle_call+0x69/0xa0 [ 6348.583928][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6348.584190][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6348.584481][ C0] ? lock_release+0x1d5/0x250 [ 6348.584729][ C0] do_idle+0xfb/0x160 [ 6348.584941][ C0] cpu_startup_entry+0x55/0x60 [ 6348.585196][ C0] rest_init+0x153/0x260 [ 6348.585423][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6348.585715][ C0] arch_call_rest_init+0x13/0x40 [ 6348.585985][ C0] start_kernel+0x314/0x3d0 [ 6348.586226][ C0] x86_64_start_reservations+0x18/0x30 [ 6348.586518][ C0] x86_64_start_kernel+0xba/0x110 [ 6348.586790][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6348.587126][ C0] [ 6348.587294][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4806s! [ksoftirqd/1:22] [ 6348.587765][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6348.588967][ C1] irq event stamp: 3886976 [ 6348.589208][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6348.589704][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6348.590198][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6348.590697][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6348.591191][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6348.591685][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6348.592331][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6348.592670][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6348.593692][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6348.594014][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6348.594436][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6348.594856][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6348.595277][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6348.595703][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6348.596131][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6348.596608][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6348.596955][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6348.597389][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6348.597810][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6348.598230][ C1] Call Trace: [ 6348.598407][ C1] [ 6348.598564][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6348.598844][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6348.599101][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6348.599396][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6348.599683][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6348.599986][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6348.600266][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6348.600594][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6348.600871][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6348.601196][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6348.601507][ C1] [ 6348.601668][ C1] [ 6348.601829][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6348.602164][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6348.602469][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6348.602778][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6348.603086][ C1] ? run_ksoftirqd+0xb/0x60 [ 6348.603334][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6348.603662][ C1] ? __orc_find+0x9c/0xf0 [ 6348.603892][ C1] ? lock_acquire+0x1c1/0x220 [ 6348.604143][ C1] ? irqentry_enter+0x2b/0x60 [ 6348.604393][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6348.604651][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6348.604936][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6348.605237][ C1] ? lock_acquire+0x1c1/0x220 [ 6348.605492][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6348.605755][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6348.606028][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6348.606279][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6348.606540][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6348.606817][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6348.607115][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6348.607409][ C1] ip_local_deliver+0x19d/0x480 [ 6348.607669][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6348.607960][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6348.608225][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6348.608507][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6348.608774][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6348.609112][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6348.609390][ C1] ip_rcv+0x564/0x740 [ 6348.609607][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6348.609853][ C1] ? set_track_prepare+0x8a/0xd0 [ 6348.610124][ C1] ? irqentry_enter+0x2b/0x60 [ 6348.610375][ C1] ? irqentry_enter+0x2b/0x60 [ 6348.610627][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6348.610867][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6348.611183][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6348.611524][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6348.611834][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6348.612182][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6348.612483][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6348.612816][ C1] netif_receive_skb+0x55/0x280 [ 6348.613074][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6348.613399][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6348.613750][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6348.614068][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6348.614358][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6348.614659][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6348.614992][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6348.615275][ C1] ? arch_stack_walk+0x68/0x100 [ 6348.615539][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6348.615823][ C1] ? irqentry_enter+0x2b/0x60 [ 6348.616078][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6348.616400][ C1] ? irqentry_enter+0x2b/0x60 [ 6348.616653][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6348.616980][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6348.617264][ C1] ? arch_stack_walk+0x68/0x100 [ 6348.617528][ C1] __tcf_classify+0x32c/0x7d0 [ 6348.617783][ C1] tcf_classify+0x283/0x930 [ 6348.618032][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6348.618303][ C1] tc_run+0x2e4/0x5d0 [ 6348.618522][ C1] ? __pfx_tc_run+0x10/0x10 [ 6348.618770][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6348.619041][ C1] ? irqentry_enter+0x2b/0x60 [ 6348.619292][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6348.619577][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6348.619897][ C1] ip_finish_output2+0x786/0x18e0 [ 6348.620173][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6348.620467][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6348.620731][ C1] ? __ip_finish_output+0x10f/0x770 [ 6348.621011][ C1] ip_output+0x16b/0x4f0 [ 6348.621241][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6348.621559][ C1] ? __pfx_ip_output+0x10/0x10 [ 6348.621816][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6348.622169][ C1] ? __pfx_ip_output+0x10/0x10 [ 6348.622425][ C1] __ip_queue_xmit+0x672/0x1910 [ 6348.622688][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6348.622972][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6348.623270][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6348.623558][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6348.623855][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6348.624146][ C1] tcp_delack_timer+0x84/0x240 [ 6348.624407][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6348.624692][ C1] call_timer_fn+0x176/0x430 [ 6348.624942][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6348.625222][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6348.625498][ C1] __run_timers.part.0+0x52d/0x890 [ 6348.625776][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6348.626063][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6348.626362][ C1] ? __pfx___schedule+0x10/0x10 [ 6348.626625][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6348.626949][ C1] run_timer_softirq+0x72/0x100 [ 6348.627211][ C1] __do_softirq+0x1bc/0x7ff [ 6348.627455][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6348.627727][ C1] run_ksoftirqd+0x2e/0x60 [ 6348.627969][ C1] smpboot_thread_fn+0x30e/0x840 [ 6348.628235][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6348.628528][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6348.628817][ C1] kthread+0x292/0x360 [ 6348.629042][ C1] ? __pfx_kthread+0x10/0x10 [ 6348.629290][ C1] ret_from_fork+0x34/0x70 [ 6348.629530][ C1] ? __pfx_kthread+0x10/0x10 [ 6348.629774][ C1] ret_from_fork_asm+0x1b/0x30 [ 6348.630037][ C1] [ 6373.915025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6373.915404][ C1] rcu: 1-....: (5164466 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1224756 [ 6373.916004][ C1] rcu: (t=5179606 jiffies g=1007429 q=31 ncpus=4) [ 6373.916355][ C1] Sending NMI from CPU 1 to CPUs 0: [ 6373.916644][ C0] NMI backtrace for cpu 0 [ 6373.916651][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6373.916656][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6373.916659][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6373.916668][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6373.916671][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6373.916675][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6373.916677][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6373.916678][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6373.916680][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6373.916682][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6373.916683][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6373.916686][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6373.916690][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6373.916691][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6373.916693][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6373.916694][ C0] Call Trace: [ 6373.916697][ C0] [ 6373.916701][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 6373.916706][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6373.916712][ C0] ? nmi_handle+0x156/0x420 [ 6373.916717][ C0] ? default_do_nmi+0x41/0x100 [ 6373.916721][ C0] ? exc_nmi+0xf3/0x120 [ 6373.916723][ C0] ? end_repeat_nmi+0xf/0x60 [ 6373.916728][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6373.916732][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6373.916735][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6373.916739][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6373.916742][ C0] [ 6373.916743][ C0] [ 6373.916745][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6373.916748][ C0] ? get_stack_info+0x36/0xc0 [ 6373.916753][ C0] ? lock_acquire+0x1c1/0x220 [ 6373.916758][ C0] ? lock_release+0x1d5/0x250 [ 6373.916762][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6373.916766][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6373.916769][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6373.916772][ C0] ? lock_acquire+0x1c1/0x220 [ 6373.916774][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6373.916780][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6373.916784][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6373.916791][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6373.916794][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6373.916798][ C0] ? __inet_lookup_established+0x341/0x610 [ 6373.916805][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6373.916812][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6373.916816][ C0] ip_local_deliver+0x19d/0x480 [ 6373.916819][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6373.916822][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6373.916827][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6373.916831][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6373.916834][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6373.916838][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6373.916848][ C0] ip_rcv+0x564/0x740 [ 6373.916851][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6373.916854][ C0] ? set_track_prepare+0x8a/0xd0 [ 6373.916859][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6373.916861][ C0] ? rest_init+0x153/0x260 [ 6373.916863][ C0] ? skb_clone+0x10b/0x330 [ 6373.916868][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6373.916874][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6373.916880][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6373.916885][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6373.916894][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6373.916897][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6373.916900][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6373.916904][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6373.916908][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6373.916911][ C0] ? lock_acquire+0x1c1/0x220 [ 6373.916913][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6373.916917][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6373.916920][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6373.916923][ C0] ? __copy_skb_header+0xaf/0x490 [ 6373.916926][ C0] ? __skb_clone+0x57a/0x760 [ 6373.916928][ C0] netif_receive_skb+0x55/0x280 [ 6373.916931][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6373.916939][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6373.916946][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6373.916952][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6373.916958][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6373.916966][ C0] ? hlock_class+0x4e/0x130 [ 6373.916973][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6373.916983][ C0] ? place_entity+0x21/0x2f0 [ 6373.916986][ C0] ? resched_curr+0x219/0x280 [ 6373.916990][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6373.916993][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6373.916997][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6373.917001][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6373.917004][ C0] ? activate_task+0xf5/0x260 [ 6373.917007][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6373.917013][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6373.917016][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6373.917021][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6373.917024][ C0] ? get_stack_info+0x36/0xc0 [ 6373.917028][ C0] ? stack_access_ok+0xda/0x1f0 [ 6373.917030][ C0] ? get_reg+0x119/0x190 [ 6373.917034][ C0] __tcf_classify+0x32c/0x7d0 [ 6373.917038][ C0] tcf_classify+0x283/0x930 [ 6373.917041][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6373.917046][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6373.917048][ C0] ? arch_stack_walk+0x8c/0x100 [ 6373.917052][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6373.917055][ C0] tc_run+0x2e4/0x5d0 [ 6373.917060][ C0] ? __pfx_tc_run+0x10/0x10 [ 6373.917063][ C0] ? lock_acquire+0x1c1/0x220 [ 6373.917065][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6373.917070][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6373.917076][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6373.917079][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6373.917082][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6373.917087][ C0] ? neigh_hh_output+0x348/0x590 [ 6373.917092][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6373.917096][ C0] ip_finish_output2+0x786/0x18e0 [ 6373.917099][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6373.917105][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6373.917113][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6373.917116][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6373.917120][ C0] ? __ip_finish_output+0x10f/0x770 [ 6373.917124][ C0] ip_output+0x16b/0x4f0 [ 6373.917128][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6373.917133][ C0] ? __pfx_ip_output+0x10/0x10 [ 6373.917136][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6373.917141][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6373.917144][ C0] ? ip_local_out+0x114/0x3b0 [ 6373.917147][ C0] __ip_queue_xmit+0x672/0x1910 [ 6373.917151][ C0] ? __skb_clone+0x57a/0x760 [ 6373.917155][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6373.917161][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6373.917165][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6373.917169][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6373.917174][ C0] ? tcp_current_mss+0x40a/0x510 [ 6373.917177][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6373.917180][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6373.917183][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6373.917185][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6373.917188][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6373.917192][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6373.917197][ C0] ? ktime_get+0xb6/0x190 [ 6373.917201][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6373.917205][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6373.917209][ C0] tcp_write_timer+0x82/0x1d0 [ 6373.917213][ C0] call_timer_fn+0x176/0x430 [ 6373.917216][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6373.917221][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6373.917225][ C0] __run_timers.part.0+0x52d/0x890 [ 6373.917229][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6373.917233][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6373.917236][ C0] ? lock_acquire+0x1c1/0x220 [ 6373.917239][ C0] ? clockevents_program_event+0xf6/0x300 [ 6373.917245][ C0] ? lock_release+0x1d5/0x250 [ 6373.917247][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6373.917250][ C0] ? ktime_get+0xb6/0x190 [ 6373.917253][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6373.917257][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6373.917262][ C0] run_timer_softirq+0x72/0x100 [ 6373.917265][ C0] __do_softirq+0x1bc/0x7ff [ 6373.917270][ C0] irq_exit_rcu+0x98/0xc0 [ 6373.917273][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6373.917277][ C0] [ 6373.917278][ C0] [ 6373.917279][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6373.917283][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6373.917286][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6373.917289][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6373.917291][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6373.917292][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6373.917294][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6373.917295][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6373.917297][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6373.917300][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6373.917304][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6373.917307][ C0] default_idle_call+0x69/0xa0 [ 6373.917309][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6373.917312][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6373.917318][ C0] ? lock_release+0x1d5/0x250 [ 6373.917322][ C0] do_idle+0xfb/0x160 [ 6373.917324][ C0] cpu_startup_entry+0x55/0x60 [ 6373.917327][ C0] rest_init+0x153/0x260 [ 6373.917329][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6373.917335][ C0] arch_call_rest_init+0x13/0x40 [ 6373.917341][ C0] start_kernel+0x314/0x3d0 [ 6373.917345][ C0] x86_64_start_reservations+0x18/0x30 [ 6373.917350][ C0] x86_64_start_kernel+0xba/0x110 [ 6373.917354][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6373.917361][ C0] [ 6373.917640][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6373.971686][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6373.972335][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6373.972684][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6373.973713][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6373.974039][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6373.974464][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6373.974890][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6373.975311][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6373.975735][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6373.976151][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6373.976620][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6373.976974][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6373.977385][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6373.977821][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6373.978247][ C1] Call Trace: [ 6373.978427][ C1] [ 6373.978586][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6373.978878][ C1] ? print_cpu_stall+0x263/0x6a0 [ 6373.979148][ C1] ? check_cpu_stall+0x284/0x500 [ 6373.979411][ C1] ? rcu_pending+0x92/0x360 [ 6373.979658][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6373.979943][ C1] ? update_process_times+0xb9/0x110 [ 6373.980227][ C1] ? tick_sched_handle+0x67/0x130 [ 6373.980500][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6373.980804][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6373.981061][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6373.981393][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6373.981680][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6373.981981][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6373.982259][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6373.982583][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6373.982861][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6373.983184][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6373.983497][ C1] [ 6373.983657][ C1] [ 6373.983820][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6373.984152][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6373.984454][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6373.984761][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6373.985068][ C1] ? run_ksoftirqd+0xb/0x60 [ 6373.985314][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6373.985647][ C1] ? __orc_find+0x9c/0xf0 [ 6373.985884][ C1] ? lock_acquire+0x1c1/0x220 [ 6373.986139][ C1] ? irqentry_enter+0x2b/0x60 [ 6373.986393][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6373.986654][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6373.986940][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6373.987242][ C1] ? lock_acquire+0x1c1/0x220 [ 6373.987492][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6373.987744][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6373.988015][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6373.988264][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6373.988524][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6373.988799][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6373.989093][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6373.989386][ C1] ip_local_deliver+0x19d/0x480 [ 6373.989645][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6373.989927][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6373.990193][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6373.990473][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6373.990739][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6373.991075][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6373.991356][ C1] ip_rcv+0x564/0x740 [ 6373.991574][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6373.991819][ C1] ? set_track_prepare+0x8a/0xd0 [ 6373.992088][ C1] ? irqentry_enter+0x2b/0x60 [ 6373.992339][ C1] ? irqentry_enter+0x2b/0x60 [ 6373.992590][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6373.992830][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6373.993144][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6373.993482][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6373.993791][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6373.994141][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6373.994445][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6373.994779][ C1] netif_receive_skb+0x55/0x280 [ 6373.995039][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6373.995366][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6373.995721][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6373.996039][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6373.996333][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6373.996640][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6373.996977][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6373.997264][ C1] ? arch_stack_walk+0x68/0x100 [ 6373.997524][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6373.997802][ C1] ? irqentry_enter+0x2b/0x60 [ 6373.998055][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6373.998373][ C1] ? irqentry_enter+0x2b/0x60 [ 6373.998626][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6373.998954][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6373.999237][ C1] ? arch_stack_walk+0x68/0x100 [ 6373.999501][ C1] __tcf_classify+0x32c/0x7d0 [ 6373.999759][ C1] tcf_classify+0x283/0x930 [ 6374.000007][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6374.000280][ C1] tc_run+0x2e4/0x5d0 [ 6374.000500][ C1] ? __pfx_tc_run+0x10/0x10 [ 6374.000747][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6374.001017][ C1] ? irqentry_enter+0x2b/0x60 [ 6374.001269][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6374.001555][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6374.001875][ C1] ip_finish_output2+0x786/0x18e0 [ 6374.002151][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6374.002444][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6374.002708][ C1] ? __ip_finish_output+0x10f/0x770 [ 6374.002989][ C1] ip_output+0x16b/0x4f0 [ 6374.003218][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6374.003536][ C1] ? __pfx_ip_output+0x10/0x10 [ 6374.003794][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6374.004146][ C1] ? __pfx_ip_output+0x10/0x10 [ 6374.004402][ C1] __ip_queue_xmit+0x672/0x1910 [ 6374.004671][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6374.004959][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6374.005256][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6374.005557][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6374.005850][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6374.006133][ C1] tcp_delack_timer+0x84/0x240 [ 6374.006387][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6374.006677][ C1] call_timer_fn+0x176/0x430 [ 6374.006926][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6374.007201][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6374.007484][ C1] __run_timers.part.0+0x52d/0x890 [ 6374.007758][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6374.008045][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6374.008345][ C1] ? __pfx___schedule+0x10/0x10 [ 6374.008608][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6374.008933][ C1] run_timer_softirq+0x72/0x100 [ 6374.009193][ C1] __do_softirq+0x1bc/0x7ff [ 6374.009437][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6374.009709][ C1] run_ksoftirqd+0x2e/0x60 [ 6374.009951][ C1] smpboot_thread_fn+0x30e/0x840 [ 6374.010216][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6374.010508][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6374.010797][ C1] kthread+0x292/0x360 [ 6374.011020][ C1] ? __pfx_kthread+0x10/0x10 [ 6374.011269][ C1] ret_from_fork+0x34/0x70 [ 6374.011509][ C1] ? __pfx_kthread+0x10/0x10 [ 6374.011756][ C1] ret_from_fork_asm+0x1b/0x30 [ 6374.012017][ C1] [ 6400.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4854s! [swapper/0:0] [ 6400.527933][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6400.529141][ C0] irq event stamp: 27567077 [ 6400.529386][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6400.529919][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6400.530399][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6400.530904][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6400.531398][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6400.531878][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6400.532528][ C0] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 6400.532834][ C0] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 6400.533851][ C0] RSP: 0018:ffffc900000069c0 EFLAGS: 00000286 [ 6400.534177][ C0] RAX: ffff88800a099b5c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6400.534599][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6400.535016][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6400.535439][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6400.535868][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6400.536293][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6400.536774][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6400.537120][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6400.537548][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6400.537967][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6400.538385][ C0] Call Trace: [ 6400.538563][ C0] [ 6400.538719][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6400.538997][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6400.539253][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6400.539546][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6400.539831][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6400.540133][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6400.540408][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6400.540729][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6400.541004][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6400.541278][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6400.541607][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6400.541919][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6400.542249][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6400.542555][ C0] ? kasan_check_range+0x1a/0x1c0 [ 6400.542829][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 6400.543125][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6400.543454][ C0] ? get_stack_info+0x36/0xc0 [ 6400.543705][ C0] ? lock_acquire+0x1c1/0x220 [ 6400.543955][ C0] ? lock_release+0x1d5/0x250 [ 6400.544203][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6400.544460][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6400.544742][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6400.545040][ C0] ? lock_acquire+0x1c1/0x220 [ 6400.545294][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6400.545553][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6400.545823][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6400.546071][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6400.546331][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6400.546604][ C0] ? __inet_lookup_established+0x341/0x610 [ 6400.546916][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6400.547207][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6400.547494][ C0] ip_local_deliver+0x19d/0x480 [ 6400.547755][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6400.548044][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6400.548313][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6400.548590][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6400.548853][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6400.549196][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6400.549469][ C0] ip_rcv+0x564/0x740 [ 6400.549683][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6400.549925][ C0] ? set_track_prepare+0x8a/0xd0 [ 6400.550188][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6400.550482][ C0] ? rest_init+0x153/0x260 [ 6400.550719][ C0] ? skb_clone+0x10b/0x330 [ 6400.550960][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6400.551291][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6400.551607][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6400.551905][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6400.552219][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6400.552481][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6400.552726][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6400.553041][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6400.553343][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6400.553681][ C0] ? lock_acquire+0x1c1/0x220 [ 6400.553930][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6400.554237][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6400.554537][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6400.554867][ C0] ? __copy_skb_header+0xaf/0x490 [ 6400.555134][ C0] ? __skb_clone+0x57a/0x760 [ 6400.555377][ C0] netif_receive_skb+0x55/0x280 [ 6400.555641][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6400.555967][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6400.556314][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6400.556630][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6400.556917][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6400.557216][ C0] ? hlock_class+0x4e/0x130 [ 6400.557462][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6400.557787][ C0] ? place_entity+0x21/0x2f0 [ 6400.558031][ C0] ? resched_curr+0x219/0x280 [ 6400.558283][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6400.558554][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6400.558839][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6400.559114][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6400.559370][ C0] ? activate_task+0xf5/0x260 [ 6400.559620][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6400.559894][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6400.560170][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6400.560428][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6400.560715][ C0] ? get_stack_info+0x36/0xc0 [ 6400.560968][ C0] ? stack_access_ok+0xda/0x1f0 [ 6400.561228][ C0] ? get_reg+0x119/0x190 [ 6400.561459][ C0] __tcf_classify+0x32c/0x7d0 [ 6400.561708][ C0] tcf_classify+0x283/0x930 [ 6400.561948][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6400.562275][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6400.562543][ C0] ? arch_stack_walk+0x8c/0x100 [ 6400.562807][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6400.563100][ C0] tc_run+0x2e4/0x5d0 [ 6400.563316][ C0] ? __pfx_tc_run+0x10/0x10 [ 6400.563559][ C0] ? lock_acquire+0x1c1/0x220 [ 6400.563808][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6400.564082][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6400.564351][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6400.564635][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6400.564916][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6400.565233][ C0] ? neigh_hh_output+0x348/0x590 [ 6400.565504][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6400.565784][ C0] ip_finish_output2+0x786/0x18e0 [ 6400.566055][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6400.566351][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6400.566702][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6400.566988][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6400.567255][ C0] ? __ip_finish_output+0x10f/0x770 [ 6400.567531][ C0] ip_output+0x16b/0x4f0 [ 6400.567756][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6400.568043][ C0] ? __pfx_ip_output+0x10/0x10 [ 6400.568296][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6400.568597][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6400.568859][ C0] ? ip_local_out+0x114/0x3b0 [ 6400.569115][ C0] __ip_queue_xmit+0x672/0x1910 [ 6400.569382][ C0] ? __skb_clone+0x57a/0x760 [ 6400.569630][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6400.569911][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6400.570206][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6400.570524][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6400.570787][ C0] ? tcp_current_mss+0x40a/0x510 [ 6400.571051][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6400.571335][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6400.571612][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6400.571866][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6400.572138][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6400.572461][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6400.572738][ C0] ? ktime_get+0xb6/0x190 [ 6400.572969][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6400.573241][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6400.573526][ C0] tcp_write_timer+0x82/0x1d0 [ 6400.573777][ C0] call_timer_fn+0x176/0x430 [ 6400.574027][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6400.574302][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6400.574575][ C0] __run_timers.part.0+0x52d/0x890 [ 6400.574851][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6400.575135][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6400.575446][ C0] ? lock_acquire+0x1c1/0x220 [ 6400.575702][ C0] ? clockevents_program_event+0xf6/0x300 [ 6400.576010][ C0] ? lock_release+0x1d5/0x250 [ 6400.576262][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6400.576542][ C0] ? ktime_get+0xb6/0x190 [ 6400.576775][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6400.577076][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6400.577392][ C0] run_timer_softirq+0x72/0x100 [ 6400.577656][ C0] __do_softirq+0x1bc/0x7ff [ 6400.577903][ C0] irq_exit_rcu+0x98/0xc0 [ 6400.578139][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6400.578441][ C0] [ 6400.578597][ C0] [ 6400.578753][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6400.579071][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6400.579344][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6400.580370][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6400.580694][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6400.581118][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6400.581537][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6400.581955][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6400.582380][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6400.582805][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6400.583110][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6400.583385][ C0] default_idle_call+0x69/0xa0 [ 6400.583639][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6400.583903][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6400.584194][ C0] ? lock_release+0x1d5/0x250 [ 6400.584449][ C0] do_idle+0xfb/0x160 [ 6400.584669][ C0] cpu_startup_entry+0x55/0x60 [ 6400.584926][ C0] rest_init+0x153/0x260 [ 6400.585151][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6400.585449][ C0] arch_call_rest_init+0x13/0x40 [ 6400.585720][ C0] start_kernel+0x314/0x3d0 [ 6400.585965][ C0] x86_64_start_reservations+0x18/0x30 [ 6400.586261][ C0] x86_64_start_kernel+0xba/0x110 [ 6400.586530][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6400.586856][ C0] [ 6400.587023][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4854s! [ksoftirqd/1:22] [ 6400.587497][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6400.588696][ C1] irq event stamp: 3886976 [ 6400.588938][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6400.589435][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6400.589927][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6400.590430][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6400.590923][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6400.591418][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6400.592062][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6400.592401][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6400.593421][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6400.593742][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6400.594163][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6400.594581][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6400.594996][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6400.595421][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6400.595845][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6400.596323][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6400.596670][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6400.597098][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6400.597519][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6400.597937][ C1] Call Trace: [ 6400.598115][ C1] [ 6400.598272][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6400.598552][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6400.598809][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6400.599106][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6400.599393][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6400.599695][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6400.599974][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6400.600299][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6400.600577][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6400.600901][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6400.601213][ C1] [ 6400.601375][ C1] [ 6400.601535][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6400.601869][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6400.602173][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6400.602482][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6400.602788][ C1] ? run_ksoftirqd+0xb/0x60 [ 6400.603036][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6400.603367][ C1] ? __orc_find+0x9c/0xf0 [ 6400.603597][ C1] ? lock_acquire+0x1c1/0x220 [ 6400.603847][ C1] ? irqentry_enter+0x2b/0x60 [ 6400.604099][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6400.604357][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6400.604640][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6400.604940][ C1] ? lock_acquire+0x1c1/0x220 [ 6400.605195][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6400.605458][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6400.605732][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6400.605981][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6400.606243][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6400.606519][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6400.606812][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6400.607107][ C1] ip_local_deliver+0x19d/0x480 [ 6400.607367][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6400.607651][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6400.607918][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6400.608199][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6400.608466][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6400.608802][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6400.609081][ C1] ip_rcv+0x564/0x740 [ 6400.609299][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6400.609544][ C1] ? set_track_prepare+0x8a/0xd0 [ 6400.609813][ C1] ? irqentry_enter+0x2b/0x60 [ 6400.610065][ C1] ? irqentry_enter+0x2b/0x60 [ 6400.610317][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6400.610557][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6400.610871][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6400.611212][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6400.611522][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6400.611867][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6400.612169][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6400.612502][ C1] netif_receive_skb+0x55/0x280 [ 6400.612759][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6400.613089][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6400.613438][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6400.613756][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6400.614048][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6400.614352][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6400.614683][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6400.614969][ C1] ? arch_stack_walk+0x68/0x100 [ 6400.615235][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6400.615521][ C1] ? irqentry_enter+0x2b/0x60 [ 6400.615773][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6400.616092][ C1] ? irqentry_enter+0x2b/0x60 [ 6400.616346][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6400.616674][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6400.616957][ C1] ? arch_stack_walk+0x68/0x100 [ 6400.617223][ C1] __tcf_classify+0x32c/0x7d0 [ 6400.617482][ C1] tcf_classify+0x283/0x930 [ 6400.617731][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6400.618003][ C1] tc_run+0x2e4/0x5d0 [ 6400.618225][ C1] ? __pfx_tc_run+0x10/0x10 [ 6400.618473][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6400.618743][ C1] ? irqentry_enter+0x2b/0x60 [ 6400.618996][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6400.619284][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6400.619608][ C1] ip_finish_output2+0x786/0x18e0 [ 6400.619884][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6400.620180][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6400.620444][ C1] ? __ip_finish_output+0x10f/0x770 [ 6400.620725][ C1] ip_output+0x16b/0x4f0 [ 6400.620954][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6400.621274][ C1] ? __pfx_ip_output+0x10/0x10 [ 6400.621535][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6400.621886][ C1] ? __pfx_ip_output+0x10/0x10 [ 6400.622145][ C1] __ip_queue_xmit+0x672/0x1910 [ 6400.622409][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6400.622694][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6400.622993][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6400.623282][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6400.623580][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6400.623870][ C1] tcp_delack_timer+0x84/0x240 [ 6400.624133][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6400.624419][ C1] call_timer_fn+0x176/0x430 [ 6400.624668][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6400.624947][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6400.625226][ C1] __run_timers.part.0+0x52d/0x890 [ 6400.625505][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6400.625790][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6400.626093][ C1] ? __pfx___schedule+0x10/0x10 [ 6400.626355][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6400.626679][ C1] run_timer_softirq+0x72/0x100 [ 6400.626939][ C1] __do_softirq+0x1bc/0x7ff [ 6400.627185][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6400.627458][ C1] run_ksoftirqd+0x2e/0x60 [ 6400.627700][ C1] smpboot_thread_fn+0x30e/0x840 [ 6400.627966][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6400.628260][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6400.628548][ C1] kthread+0x292/0x360 [ 6400.628771][ C1] ? __pfx_kthread+0x10/0x10 [ 6400.629020][ C1] ret_from_fork+0x34/0x70 [ 6400.629261][ C1] ? __pfx_kthread+0x10/0x10 [ 6400.629505][ C1] ret_from_fork_asm+0x1b/0x30 [ 6400.629768][ C1] [ 6428.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4881s! [swapper/0:0] [ 6428.527921][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6428.529124][ C0] irq event stamp: 27567077 [ 6428.529367][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6428.529899][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6428.530369][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6428.530873][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6428.531368][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6428.531844][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6428.532495][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6428.532839][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6428.533866][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6428.534194][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6428.534615][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6428.535041][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6428.535470][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6428.535886][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6428.536304][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6428.536771][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6428.537128][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6428.537550][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6428.537971][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6428.538395][ C0] Call Trace: [ 6428.538581][ C0] [ 6428.538736][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6428.539011][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6428.539268][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6428.539556][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6428.539845][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6428.540151][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6428.540434][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6428.540754][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6428.541025][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6428.541305][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6428.541626][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6428.541936][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6428.542270][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6428.542576][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6428.542886][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6428.543193][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6428.543523][ C0] ? get_stack_info+0x36/0xc0 [ 6428.543777][ C0] ? lock_acquire+0x1c1/0x220 [ 6428.544034][ C0] ? lock_release+0x1d5/0x250 [ 6428.544285][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6428.544545][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6428.544828][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6428.545125][ C0] ? lock_acquire+0x1c1/0x220 [ 6428.545388][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6428.545638][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6428.545909][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6428.546160][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6428.546422][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6428.546694][ C0] ? __inet_lookup_established+0x341/0x610 [ 6428.547009][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6428.547299][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6428.547589][ C0] ip_local_deliver+0x19d/0x480 [ 6428.547849][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6428.548135][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6428.548404][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6428.548680][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6428.548944][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6428.549284][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6428.549558][ C0] ip_rcv+0x564/0x740 [ 6428.549771][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6428.550011][ C0] ? set_track_prepare+0x8a/0xd0 [ 6428.550276][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6428.550573][ C0] ? rest_init+0x153/0x260 [ 6428.550809][ C0] ? skb_clone+0x10b/0x330 [ 6428.551053][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6428.551386][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6428.551707][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6428.552004][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6428.552316][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6428.552581][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6428.552825][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6428.553141][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6428.553440][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6428.553778][ C0] ? lock_acquire+0x1c1/0x220 [ 6428.554028][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6428.554336][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6428.554635][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6428.554962][ C0] ? __copy_skb_header+0xaf/0x490 [ 6428.555228][ C0] ? __skb_clone+0x57a/0x760 [ 6428.555485][ C0] netif_receive_skb+0x55/0x280 [ 6428.555744][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6428.556071][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6428.556422][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6428.556737][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6428.557022][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6428.557320][ C0] ? hlock_class+0x4e/0x130 [ 6428.557563][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6428.557889][ C0] ? place_entity+0x21/0x2f0 [ 6428.558133][ C0] ? resched_curr+0x219/0x280 [ 6428.558387][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6428.558660][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6428.558944][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6428.559222][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6428.559477][ C0] ? activate_task+0xf5/0x260 [ 6428.559732][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6428.560014][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6428.560289][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6428.560547][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6428.560836][ C0] ? get_stack_info+0x36/0xc0 [ 6428.561089][ C0] ? stack_access_ok+0xda/0x1f0 [ 6428.561349][ C0] ? get_reg+0x119/0x190 [ 6428.561580][ C0] __tcf_classify+0x32c/0x7d0 [ 6428.561831][ C0] tcf_classify+0x283/0x930 [ 6428.562075][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6428.562402][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6428.562672][ C0] ? arch_stack_walk+0x8c/0x100 [ 6428.562935][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6428.563227][ C0] tc_run+0x2e4/0x5d0 [ 6428.563442][ C0] ? __pfx_tc_run+0x10/0x10 [ 6428.563686][ C0] ? lock_acquire+0x1c1/0x220 [ 6428.563932][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6428.564205][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6428.564472][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6428.564754][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6428.565030][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6428.565358][ C0] ? neigh_hh_output+0x348/0x590 [ 6428.565621][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6428.565902][ C0] ip_finish_output2+0x786/0x18e0 [ 6428.566177][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6428.566474][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6428.566824][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6428.567113][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6428.567378][ C0] ? __ip_finish_output+0x10f/0x770 [ 6428.567653][ C0] ip_output+0x16b/0x4f0 [ 6428.567880][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6428.568166][ C0] ? __pfx_ip_output+0x10/0x10 [ 6428.568421][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6428.568724][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6428.568985][ C0] ? ip_local_out+0x114/0x3b0 [ 6428.569241][ C0] __ip_queue_xmit+0x672/0x1910 [ 6428.569505][ C0] ? __skb_clone+0x57a/0x760 [ 6428.569755][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6428.570034][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6428.570328][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6428.570644][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6428.570901][ C0] ? tcp_current_mss+0x40a/0x510 [ 6428.571165][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6428.571448][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6428.571722][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6428.571973][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6428.572244][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6428.572566][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6428.572842][ C0] ? ktime_get+0xb6/0x190 [ 6428.573073][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6428.573346][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6428.573629][ C0] tcp_write_timer+0x82/0x1d0 [ 6428.573880][ C0] call_timer_fn+0x176/0x430 [ 6428.574126][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6428.574403][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6428.574675][ C0] __run_timers.part.0+0x52d/0x890 [ 6428.574948][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6428.575230][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6428.575535][ C0] ? lock_acquire+0x1c1/0x220 [ 6428.575788][ C0] ? clockevents_program_event+0xf6/0x300 [ 6428.576096][ C0] ? lock_release+0x1d5/0x250 [ 6428.576348][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6428.576631][ C0] ? ktime_get+0xb6/0x190 [ 6428.576864][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6428.577166][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6428.577474][ C0] run_timer_softirq+0x72/0x100 [ 6428.577735][ C0] __do_softirq+0x1bc/0x7ff [ 6428.577981][ C0] irq_exit_rcu+0x98/0xc0 [ 6428.578216][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6428.578514][ C0] [ 6428.578669][ C0] [ 6428.578825][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6428.579142][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6428.579412][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6428.580437][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6428.580761][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6428.581186][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6428.581611][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6428.582031][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6428.582452][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6428.582876][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6428.583184][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6428.583458][ C0] default_idle_call+0x69/0xa0 [ 6428.583712][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6428.583978][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6428.584266][ C0] ? lock_release+0x1d5/0x250 [ 6428.584518][ C0] do_idle+0xfb/0x160 [ 6428.584734][ C0] cpu_startup_entry+0x55/0x60 [ 6428.584992][ C0] rest_init+0x153/0x260 [ 6428.585218][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6428.585511][ C0] arch_call_rest_init+0x13/0x40 [ 6428.585775][ C0] start_kernel+0x314/0x3d0 [ 6428.586020][ C0] x86_64_start_reservations+0x18/0x30 [ 6428.586312][ C0] x86_64_start_kernel+0xba/0x110 [ 6428.586578][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6428.586904][ C0] [ 6428.587071][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4881s! [ksoftirqd/1:22] [ 6428.587537][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6428.588735][ C1] irq event stamp: 3886976 [ 6428.588974][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6428.589472][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6428.589965][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6428.590462][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6428.590959][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6428.591452][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6428.592099][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6428.592448][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6428.593470][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6428.593795][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6428.594215][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6428.594635][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6428.595057][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6428.595486][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6428.595909][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6428.596380][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6428.596726][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6428.597148][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6428.597566][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6428.597982][ C1] Call Trace: [ 6428.598161][ C1] [ 6428.598316][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6428.598597][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6428.598855][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6428.599151][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6428.599435][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6428.599738][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6428.600019][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6428.600337][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6428.600616][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6428.600947][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6428.601257][ C1] [ 6428.601416][ C1] [ 6428.601575][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6428.601910][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6428.602214][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6428.602525][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6428.602830][ C1] ? run_ksoftirqd+0xb/0x60 [ 6428.603076][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6428.603407][ C1] ? __orc_find+0x9c/0xf0 [ 6428.603636][ C1] ? lock_acquire+0x1c1/0x220 [ 6428.603889][ C1] ? irqentry_enter+0x2b/0x60 [ 6428.604143][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6428.604404][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6428.604690][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6428.604988][ C1] ? lock_acquire+0x1c1/0x220 [ 6428.605241][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6428.605500][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6428.605773][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6428.606023][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6428.606289][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6428.606562][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6428.606853][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6428.607147][ C1] ip_local_deliver+0x19d/0x480 [ 6428.607406][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6428.607690][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6428.607955][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6428.608238][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6428.608505][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6428.608840][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6428.609122][ C1] ip_rcv+0x564/0x740 [ 6428.609338][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6428.609586][ C1] ? set_track_prepare+0x8a/0xd0 [ 6428.609854][ C1] ? irqentry_enter+0x2b/0x60 [ 6428.610104][ C1] ? irqentry_enter+0x2b/0x60 [ 6428.610353][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6428.610593][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6428.610905][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6428.611245][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6428.611555][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6428.611896][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6428.612199][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6428.612535][ C1] netif_receive_skb+0x55/0x280 [ 6428.612795][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6428.613123][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6428.613476][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6428.613793][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6428.614082][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6428.614386][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6428.614714][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6428.614997][ C1] ? arch_stack_walk+0x68/0x100 [ 6428.615264][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6428.615540][ C1] ? irqentry_enter+0x2b/0x60 [ 6428.615790][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6428.616113][ C1] ? irqentry_enter+0x2b/0x60 [ 6428.616370][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6428.616695][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6428.616974][ C1] ? arch_stack_walk+0x68/0x100 [ 6428.617239][ C1] __tcf_classify+0x32c/0x7d0 [ 6428.617497][ C1] tcf_classify+0x283/0x930 [ 6428.617744][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6428.618019][ C1] tc_run+0x2e4/0x5d0 [ 6428.618238][ C1] ? __pfx_tc_run+0x10/0x10 [ 6428.618488][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6428.618758][ C1] ? irqentry_enter+0x2b/0x60 [ 6428.619009][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6428.619294][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6428.619619][ C1] ip_finish_output2+0x786/0x18e0 [ 6428.619893][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6428.620187][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6428.620452][ C1] ? __ip_finish_output+0x10f/0x770 [ 6428.620733][ C1] ip_output+0x16b/0x4f0 [ 6428.620965][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6428.621288][ C1] ? __pfx_ip_output+0x10/0x10 [ 6428.621549][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6428.621901][ C1] ? __pfx_ip_output+0x10/0x10 [ 6428.622158][ C1] __ip_queue_xmit+0x672/0x1910 [ 6428.622426][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6428.622711][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6428.623013][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6428.623306][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6428.623605][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6428.623894][ C1] tcp_delack_timer+0x84/0x240 [ 6428.624157][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6428.624442][ C1] call_timer_fn+0x176/0x430 [ 6428.624694][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6428.624972][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6428.625256][ C1] __run_timers.part.0+0x52d/0x890 [ 6428.625534][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6428.625822][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6428.626124][ C1] ? __pfx___schedule+0x10/0x10 [ 6428.626387][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6428.626711][ C1] run_timer_softirq+0x72/0x100 [ 6428.626968][ C1] __do_softirq+0x1bc/0x7ff [ 6428.627212][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6428.627487][ C1] run_ksoftirqd+0x2e/0x60 [ 6428.627728][ C1] smpboot_thread_fn+0x30e/0x840 [ 6428.627994][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6428.628290][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6428.628581][ C1] kthread+0x292/0x360 [ 6428.628799][ C1] ? __pfx_kthread+0x10/0x10 [ 6428.629045][ C1] ret_from_fork+0x34/0x70 [ 6428.629291][ C1] ? __pfx_kthread+0x10/0x10 [ 6428.629538][ C1] ret_from_fork_asm+0x1b/0x30 [ 6428.629801][ C1] [ 6452.014024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6452.014406][ C1] rcu: 1-....: (5242285 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1242399 [ 6452.015001][ C1] rcu: (t=5257705 jiffies g=1007429 q=31 ncpus=4) [ 6452.015355][ C1] Sending NMI from CPU 1 to CPUs 0: [ 6452.015641][ C0] NMI backtrace for cpu 0 [ 6452.015650][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6452.015654][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6452.015657][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6452.015667][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6452.015670][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6452.015674][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6452.015676][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6452.015678][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6452.015679][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6452.015682][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6452.015683][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6452.015686][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6452.015689][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6452.015691][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6452.015693][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6452.015694][ C0] Call Trace: [ 6452.015698][ C0] [ 6452.015701][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 6452.015707][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6452.015712][ C0] ? nmi_handle+0x156/0x420 [ 6452.015717][ C0] ? default_do_nmi+0x41/0x100 [ 6452.015722][ C0] ? exc_nmi+0xf3/0x120 [ 6452.015724][ C0] ? end_repeat_nmi+0xf/0x60 [ 6452.015729][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6452.015733][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6452.015736][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6452.015740][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6452.015744][ C0] [ 6452.015745][ C0] [ 6452.015746][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6452.015749][ C0] ? get_stack_info+0x36/0xc0 [ 6452.015754][ C0] ? lock_acquire+0x1c1/0x220 [ 6452.015759][ C0] ? lock_release+0x1d5/0x250 [ 6452.015763][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6452.015767][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6452.015769][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6452.015773][ C0] ? lock_acquire+0x1c1/0x220 [ 6452.015775][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6452.015782][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6452.015785][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6452.015793][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6452.015796][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6452.015800][ C0] ? __inet_lookup_established+0x341/0x610 [ 6452.015806][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6452.015813][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6452.015817][ C0] ip_local_deliver+0x19d/0x480 [ 6452.015820][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6452.015823][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6452.015829][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6452.015833][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6452.015836][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6452.015840][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6452.015850][ C0] ip_rcv+0x564/0x740 [ 6452.015854][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6452.015857][ C0] ? set_track_prepare+0x8a/0xd0 [ 6452.015862][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6452.015864][ C0] ? rest_init+0x153/0x260 [ 6452.015867][ C0] ? skb_clone+0x10b/0x330 [ 6452.015873][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6452.015879][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6452.015885][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6452.015890][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6452.015899][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6452.015902][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6452.015905][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6452.015909][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6452.015912][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6452.015916][ C0] ? lock_acquire+0x1c1/0x220 [ 6452.015918][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6452.015922][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6452.015925][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6452.015928][ C0] ? __copy_skb_header+0xaf/0x490 [ 6452.015931][ C0] ? __skb_clone+0x57a/0x760 [ 6452.015934][ C0] netif_receive_skb+0x55/0x280 [ 6452.015937][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6452.015945][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6452.015952][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6452.015959][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6452.015964][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6452.015973][ C0] ? hlock_class+0x4e/0x130 [ 6452.015979][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6452.015989][ C0] ? place_entity+0x21/0x2f0 [ 6452.015993][ C0] ? resched_curr+0x219/0x280 [ 6452.015996][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6452.015999][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6452.016003][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6452.016007][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6452.016010][ C0] ? activate_task+0xf5/0x260 [ 6452.016013][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6452.016018][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6452.016023][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6452.016026][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6452.016029][ C0] ? get_stack_info+0x36/0xc0 [ 6452.016033][ C0] ? stack_access_ok+0xda/0x1f0 [ 6452.016035][ C0] ? get_reg+0x119/0x190 [ 6452.016039][ C0] __tcf_classify+0x32c/0x7d0 [ 6452.016044][ C0] tcf_classify+0x283/0x930 [ 6452.016047][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6452.016053][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6452.016054][ C0] ? arch_stack_walk+0x8c/0x100 [ 6452.016059][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6452.016062][ C0] tc_run+0x2e4/0x5d0 [ 6452.016067][ C0] ? __pfx_tc_run+0x10/0x10 [ 6452.016070][ C0] ? lock_acquire+0x1c1/0x220 [ 6452.016072][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6452.016077][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6452.016083][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6452.016086][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6452.016089][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6452.016094][ C0] ? neigh_hh_output+0x348/0x590 [ 6452.016098][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6452.016102][ C0] ip_finish_output2+0x786/0x18e0 [ 6452.016105][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6452.016111][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6452.016119][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6452.016121][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6452.016126][ C0] ? __ip_finish_output+0x10f/0x770 [ 6452.016130][ C0] ip_output+0x16b/0x4f0 [ 6452.016133][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6452.016138][ C0] ? __pfx_ip_output+0x10/0x10 [ 6452.016141][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6452.016146][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6452.016149][ C0] ? ip_local_out+0x114/0x3b0 [ 6452.016153][ C0] __ip_queue_xmit+0x672/0x1910 [ 6452.016157][ C0] ? __skb_clone+0x57a/0x760 [ 6452.016161][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6452.016168][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6452.016172][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6452.016176][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6452.016181][ C0] ? tcp_current_mss+0x40a/0x510 [ 6452.016184][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6452.016187][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6452.016190][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6452.016192][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6452.016195][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6452.016199][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6452.016204][ C0] ? ktime_get+0xb6/0x190 [ 6452.016207][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6452.016211][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6452.016214][ C0] tcp_write_timer+0x82/0x1d0 [ 6452.016218][ C0] call_timer_fn+0x176/0x430 [ 6452.016222][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6452.016227][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6452.016231][ C0] __run_timers.part.0+0x52d/0x890 [ 6452.016234][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6452.016239][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6452.016242][ C0] ? lock_acquire+0x1c1/0x220 [ 6452.016244][ C0] ? clockevents_program_event+0xf6/0x300 [ 6452.016250][ C0] ? lock_release+0x1d5/0x250 [ 6452.016253][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6452.016255][ C0] ? ktime_get+0xb6/0x190 [ 6452.016258][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6452.016262][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6452.016266][ C0] run_timer_softirq+0x72/0x100 [ 6452.016270][ C0] __do_softirq+0x1bc/0x7ff [ 6452.016275][ C0] irq_exit_rcu+0x98/0xc0 [ 6452.016277][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6452.016281][ C0] [ 6452.016282][ C0] [ 6452.016283][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6452.016289][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6452.016293][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6452.016295][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6452.016297][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6452.016298][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6452.016300][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6452.016301][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6452.016303][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6452.016307][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6452.016310][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6452.016314][ C0] default_idle_call+0x69/0xa0 [ 6452.016316][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6452.016319][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6452.016325][ C0] ? lock_release+0x1d5/0x250 [ 6452.016329][ C0] do_idle+0xfb/0x160 [ 6452.016332][ C0] cpu_startup_entry+0x55/0x60 [ 6452.016334][ C0] rest_init+0x153/0x260 [ 6452.016336][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6452.016343][ C0] arch_call_rest_init+0x13/0x40 [ 6452.016348][ C0] start_kernel+0x314/0x3d0 [ 6452.016352][ C0] x86_64_start_reservations+0x18/0x30 [ 6452.016357][ C0] x86_64_start_kernel+0xba/0x110 [ 6452.016361][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6452.016369][ C0] [ 6452.016637][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6452.070726][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6452.071378][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6452.071730][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6452.072757][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6452.073083][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6452.073508][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6452.073929][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6452.074351][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6452.074777][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6452.075209][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6452.075678][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6452.076030][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6452.076453][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6452.076879][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6452.077301][ C1] Call Trace: [ 6452.077480][ C1] [ 6452.077639][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6452.077924][ C1] ? print_cpu_stall+0x263/0x6a0 [ 6452.078190][ C1] ? check_cpu_stall+0x284/0x500 [ 6452.078453][ C1] ? rcu_pending+0x92/0x360 [ 6452.078699][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6452.078983][ C1] ? update_process_times+0xb9/0x110 [ 6452.079265][ C1] ? tick_sched_handle+0x67/0x130 [ 6452.079538][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6452.079840][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6452.080092][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6452.080424][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6452.080708][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6452.081013][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6452.081292][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6452.081610][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6452.081887][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6452.082209][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6452.082520][ C1] [ 6452.082679][ C1] [ 6452.082839][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6452.083172][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6452.083475][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6452.083784][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6452.084090][ C1] ? run_ksoftirqd+0xb/0x60 [ 6452.084338][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6452.084667][ C1] ? __orc_find+0x9c/0xf0 [ 6452.084896][ C1] ? lock_acquire+0x1c1/0x220 [ 6452.085150][ C1] ? irqentry_enter+0x2b/0x60 [ 6452.085403][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6452.085665][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6452.085954][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6452.086258][ C1] ? lock_acquire+0x1c1/0x220 [ 6452.086508][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6452.086763][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6452.087037][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6452.087286][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6452.087547][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6452.087821][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6452.088115][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6452.088408][ C1] ip_local_deliver+0x19d/0x480 [ 6452.088665][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6452.088947][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6452.089214][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6452.089494][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6452.089762][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6452.090099][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6452.090378][ C1] ip_rcv+0x564/0x740 [ 6452.090598][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6452.090843][ C1] ? set_track_prepare+0x8a/0xd0 [ 6452.091113][ C1] ? irqentry_enter+0x2b/0x60 [ 6452.091364][ C1] ? irqentry_enter+0x2b/0x60 [ 6452.091616][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6452.091858][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6452.092171][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6452.092510][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6452.092818][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6452.093161][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6452.093460][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6452.093790][ C1] netif_receive_skb+0x55/0x280 [ 6452.094049][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6452.094374][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6452.094721][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6452.095040][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6452.095334][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6452.095637][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6452.095969][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6452.096253][ C1] ? arch_stack_walk+0x68/0x100 [ 6452.096513][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6452.096788][ C1] ? irqentry_enter+0x2b/0x60 [ 6452.097039][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6452.097359][ C1] ? irqentry_enter+0x2b/0x60 [ 6452.097612][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6452.097936][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6452.098216][ C1] ? arch_stack_walk+0x68/0x100 [ 6452.098478][ C1] __tcf_classify+0x32c/0x7d0 [ 6452.098732][ C1] tcf_classify+0x283/0x930 [ 6452.098976][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6452.099250][ C1] tc_run+0x2e4/0x5d0 [ 6452.099472][ C1] ? __pfx_tc_run+0x10/0x10 [ 6452.099718][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6452.099988][ C1] ? irqentry_enter+0x2b/0x60 [ 6452.100239][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6452.100524][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6452.100844][ C1] ip_finish_output2+0x786/0x18e0 [ 6452.101120][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6452.101410][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6452.101672][ C1] ? __ip_finish_output+0x10f/0x770 [ 6452.101952][ C1] ip_output+0x16b/0x4f0 [ 6452.102183][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6452.102500][ C1] ? __pfx_ip_output+0x10/0x10 [ 6452.102760][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6452.103112][ C1] ? __pfx_ip_output+0x10/0x10 [ 6452.103366][ C1] __ip_queue_xmit+0x672/0x1910 [ 6452.103629][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6452.103916][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6452.104219][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6452.104508][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6452.104809][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6452.105099][ C1] tcp_delack_timer+0x84/0x240 [ 6452.105364][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6452.105653][ C1] call_timer_fn+0x176/0x430 [ 6452.105904][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6452.106177][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6452.106458][ C1] __run_timers.part.0+0x52d/0x890 [ 6452.106733][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6452.107020][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6452.107320][ C1] ? __pfx___schedule+0x10/0x10 [ 6452.107580][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6452.107903][ C1] run_timer_softirq+0x72/0x100 [ 6452.108163][ C1] __do_softirq+0x1bc/0x7ff [ 6452.108404][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6452.108676][ C1] run_ksoftirqd+0x2e/0x60 [ 6452.108917][ C1] smpboot_thread_fn+0x30e/0x840 [ 6452.109181][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6452.109475][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6452.109765][ C1] kthread+0x292/0x360 [ 6452.109983][ C1] ? __pfx_kthread+0x10/0x10 [ 6452.110228][ C1] ret_from_fork+0x34/0x70 [ 6452.110467][ C1] ? __pfx_kthread+0x10/0x10 [ 6452.110711][ C1] ret_from_fork_asm+0x1b/0x30 [ 6452.110975][ C1] [ 6476.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4925s! [swapper/0:0] [ 6476.527924][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6476.529126][ C0] irq event stamp: 27567077 [ 6476.529365][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6476.529894][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6476.530374][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6476.530883][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6476.531385][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6476.531872][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6476.532515][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6476.532855][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6476.533871][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6476.534195][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6476.534614][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6476.535038][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6476.535464][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6476.535891][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6476.536315][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6476.536790][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6476.537139][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6476.537563][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6476.537980][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6476.538399][ C0] Call Trace: [ 6476.538578][ C0] [ 6476.538733][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6476.539015][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6476.539268][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6476.539559][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6476.539842][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6476.540144][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6476.540422][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6476.540740][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6476.541016][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6476.541294][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6476.541620][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6476.541936][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6476.542266][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6476.542574][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6476.542886][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6476.543193][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6476.543524][ C0] ? get_stack_info+0x36/0xc0 [ 6476.543782][ C0] ? lock_acquire+0x1c1/0x220 [ 6476.544039][ C0] ? lock_release+0x1d5/0x250 [ 6476.544295][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6476.544559][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6476.544847][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6476.545155][ C0] ? lock_acquire+0x1c1/0x220 [ 6476.545407][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6476.545662][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6476.545938][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6476.546186][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6476.546445][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6476.546715][ C0] ? __inet_lookup_established+0x341/0x610 [ 6476.547030][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6476.547324][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6476.547618][ C0] ip_local_deliver+0x19d/0x480 [ 6476.547876][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6476.548159][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6476.548423][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6476.548704][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6476.548972][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6476.549309][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6476.549587][ C0] ip_rcv+0x564/0x740 [ 6476.549805][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6476.550051][ C0] ? set_track_prepare+0x8a/0xd0 [ 6476.550319][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6476.550609][ C0] ? rest_init+0x153/0x260 [ 6476.550848][ C0] ? skb_clone+0x10b/0x330 [ 6476.551087][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6476.551426][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6476.551751][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6476.552046][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6476.552353][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6476.552610][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6476.552849][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6476.553162][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6476.553458][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6476.553802][ C0] ? lock_acquire+0x1c1/0x220 [ 6476.554056][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6476.554369][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6476.554667][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6476.555002][ C0] ? __copy_skb_header+0xaf/0x490 [ 6476.555279][ C0] ? __skb_clone+0x57a/0x760 [ 6476.555525][ C0] netif_receive_skb+0x55/0x280 [ 6476.555791][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6476.556121][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6476.556474][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6476.556789][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6476.557080][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6476.557382][ C0] ? hlock_class+0x4e/0x130 [ 6476.557631][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6476.557965][ C0] ? place_entity+0x21/0x2f0 [ 6476.558214][ C0] ? resched_curr+0x219/0x280 [ 6476.558466][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6476.558732][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6476.559011][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6476.559291][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6476.559550][ C0] ? activate_task+0xf5/0x260 [ 6476.559802][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6476.560081][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6476.560353][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6476.560620][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6476.560913][ C0] ? get_stack_info+0x36/0xc0 [ 6476.561167][ C0] ? stack_access_ok+0xda/0x1f0 [ 6476.561424][ C0] ? get_reg+0x119/0x190 [ 6476.561652][ C0] __tcf_classify+0x32c/0x7d0 [ 6476.561908][ C0] tcf_classify+0x283/0x930 [ 6476.562155][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6476.562485][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6476.562751][ C0] ? arch_stack_walk+0x8c/0x100 [ 6476.563012][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6476.563300][ C0] tc_run+0x2e4/0x5d0 [ 6476.563519][ C0] ? __pfx_tc_run+0x10/0x10 [ 6476.563764][ C0] ? lock_acquire+0x1c1/0x220 [ 6476.564015][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6476.564300][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6476.564565][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6476.564857][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6476.565148][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6476.565469][ C0] ? neigh_hh_output+0x348/0x590 [ 6476.565737][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6476.566015][ C0] ip_finish_output2+0x786/0x18e0 [ 6476.566283][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6476.566573][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6476.566930][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6476.567225][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6476.567488][ C0] ? __ip_finish_output+0x10f/0x770 [ 6476.567767][ C0] ip_output+0x16b/0x4f0 [ 6476.567996][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6476.568278][ C0] ? __pfx_ip_output+0x10/0x10 [ 6476.568537][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6476.568836][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6476.569100][ C0] ? ip_local_out+0x114/0x3b0 [ 6476.569348][ C0] __ip_queue_xmit+0x672/0x1910 [ 6476.569608][ C0] ? __skb_clone+0x57a/0x760 [ 6476.569854][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6476.570140][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6476.570437][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6476.570758][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6476.571012][ C0] ? tcp_current_mss+0x40a/0x510 [ 6476.571280][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6476.571560][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6476.571840][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6476.572096][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6476.572362][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6476.572679][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6476.572959][ C0] ? ktime_get+0xb6/0x190 [ 6476.573198][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6476.573474][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6476.573754][ C0] tcp_write_timer+0x82/0x1d0 [ 6476.574011][ C0] call_timer_fn+0x176/0x430 [ 6476.574262][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6476.574533][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6476.574814][ C0] __run_timers.part.0+0x52d/0x890 [ 6476.575090][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6476.575371][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6476.575671][ C0] ? lock_acquire+0x1c1/0x220 [ 6476.575917][ C0] ? clockevents_program_event+0xf6/0x300 [ 6476.576221][ C0] ? lock_release+0x1d5/0x250 [ 6476.576471][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6476.576748][ C0] ? ktime_get+0xb6/0x190 [ 6476.576978][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6476.577278][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6476.577590][ C0] run_timer_softirq+0x72/0x100 [ 6476.577846][ C0] __do_softirq+0x1bc/0x7ff [ 6476.578088][ C0] irq_exit_rcu+0x98/0xc0 [ 6476.578318][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6476.578616][ C0] [ 6476.578777][ C0] [ 6476.578939][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6476.579262][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6476.579529][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6476.580541][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6476.580861][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6476.581283][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6476.581706][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6476.582124][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6476.582541][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6476.582961][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6476.583263][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6476.583536][ C0] default_idle_call+0x69/0xa0 [ 6476.583794][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6476.584058][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6476.584351][ C0] ? lock_release+0x1d5/0x250 [ 6476.584599][ C0] do_idle+0xfb/0x160 [ 6476.584810][ C0] cpu_startup_entry+0x55/0x60 [ 6476.585066][ C0] rest_init+0x153/0x260 [ 6476.585291][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6476.585583][ C0] arch_call_rest_init+0x13/0x40 [ 6476.585849][ C0] start_kernel+0x314/0x3d0 [ 6476.586091][ C0] x86_64_start_reservations+0x18/0x30 [ 6476.586381][ C0] x86_64_start_kernel+0xba/0x110 [ 6476.586653][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6476.586982][ C0] [ 6476.587152][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4925s! [ksoftirqd/1:22] [ 6476.587621][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6476.588825][ C1] irq event stamp: 3886976 [ 6476.589066][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6476.589563][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6476.590061][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6476.590557][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6476.591053][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6476.591545][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6476.592189][ C1] RIP: 0010:kasan_check_range+0x74/0x1c0 [ 6476.592494][ C1] Code: ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 <49> 01 c1 48 89 e8 49 8d 59 01 48 89 da 48 29 ea 48 83 fa 10 0f 8e [ 6476.593522][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000286 [ 6476.593852][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6476.594277][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6476.594700][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: 1ffff110014131c3 [ 6476.595129][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6476.595551][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6476.595971][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6476.596446][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6476.596804][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6476.597229][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6476.597651][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6476.598075][ C1] Call Trace: [ 6476.598258][ C1] [ 6476.598417][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6476.598693][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6476.598951][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6476.599242][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6476.599531][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6476.599839][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6476.600123][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6476.600448][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6476.600725][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6476.601053][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6476.601369][ C1] [ 6476.601525][ C1] [ 6476.601683][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6476.602015][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6476.602323][ C1] ? kasan_check_range+0x74/0x1c0 [ 6476.602597][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 6476.602896][ C1] ? run_ksoftirqd+0xb/0x60 [ 6476.603145][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6476.603475][ C1] ? __orc_find+0x9c/0xf0 [ 6476.603706][ C1] ? lock_acquire+0x1c1/0x220 [ 6476.603955][ C1] ? irqentry_enter+0x2b/0x60 [ 6476.604206][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6476.604466][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6476.604757][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6476.605062][ C1] ? lock_acquire+0x1c1/0x220 [ 6476.605315][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6476.605569][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6476.605843][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6476.606093][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6476.606356][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6476.606632][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6476.606925][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6476.607225][ C1] ip_local_deliver+0x19d/0x480 [ 6476.607482][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6476.607765][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6476.608031][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6476.608312][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6476.608580][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6476.608916][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6476.609195][ C1] ip_rcv+0x564/0x740 [ 6476.609416][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6476.609662][ C1] ? set_track_prepare+0x8a/0xd0 [ 6476.609931][ C1] ? irqentry_enter+0x2b/0x60 [ 6476.610184][ C1] ? irqentry_enter+0x2b/0x60 [ 6476.610436][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6476.610680][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6476.610993][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6476.611334][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6476.611643][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6476.611992][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6476.612293][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6476.612624][ C1] netif_receive_skb+0x55/0x280 [ 6476.612883][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6476.613209][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6476.613559][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6476.613875][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6476.614164][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6476.614465][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6476.614793][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6476.615082][ C1] ? arch_stack_walk+0x68/0x100 [ 6476.615345][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6476.615621][ C1] ? irqentry_enter+0x2b/0x60 [ 6476.615873][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6476.616192][ C1] ? irqentry_enter+0x2b/0x60 [ 6476.616448][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6476.616774][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6476.617054][ C1] ? arch_stack_walk+0x68/0x100 [ 6476.617317][ C1] __tcf_classify+0x32c/0x7d0 [ 6476.617572][ C1] tcf_classify+0x283/0x930 [ 6476.617819][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6476.618093][ C1] tc_run+0x2e4/0x5d0 [ 6476.618316][ C1] ? __pfx_tc_run+0x10/0x10 [ 6476.618564][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6476.618835][ C1] ? irqentry_enter+0x2b/0x60 [ 6476.619088][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6476.619375][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6476.619697][ C1] ip_finish_output2+0x786/0x18e0 [ 6476.619972][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6476.620266][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6476.620529][ C1] ? __ip_finish_output+0x10f/0x770 [ 6476.620811][ C1] ip_output+0x16b/0x4f0 [ 6476.621044][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6476.621363][ C1] ? __pfx_ip_output+0x10/0x10 [ 6476.621625][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6476.621978][ C1] ? __pfx_ip_output+0x10/0x10 [ 6476.622234][ C1] __ip_queue_xmit+0x672/0x1910 [ 6476.622501][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6476.622786][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6476.623085][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6476.623376][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6476.623679][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6476.623971][ C1] tcp_delack_timer+0x84/0x240 [ 6476.624230][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6476.624517][ C1] call_timer_fn+0x176/0x430 [ 6476.624767][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6476.625051][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6476.625334][ C1] __run_timers.part.0+0x52d/0x890 [ 6476.625609][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6476.625897][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6476.626199][ C1] ? __pfx___schedule+0x10/0x10 [ 6476.626460][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6476.626784][ C1] run_timer_softirq+0x72/0x100 [ 6476.627045][ C1] __do_softirq+0x1bc/0x7ff [ 6476.627287][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6476.627561][ C1] run_ksoftirqd+0x2e/0x60 [ 6476.627803][ C1] smpboot_thread_fn+0x30e/0x840 [ 6476.628068][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6476.628364][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6476.628656][ C1] kthread+0x292/0x360 [ 6476.628875][ C1] ? __pfx_kthread+0x10/0x10 [ 6476.629122][ C1] ret_from_fork+0x34/0x70 [ 6476.629363][ C1] ? __pfx_kthread+0x10/0x10 [ 6476.629608][ C1] ret_from_fork_asm+0x1b/0x30 [ 6476.629873][ C1] [ 6504.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 4951s! [swapper/0:0] [ 6504.527919][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6504.529116][ C0] irq event stamp: 27567077 [ 6504.529355][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6504.529883][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6504.530363][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6504.530872][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6504.531377][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6504.531865][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6504.532509][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6504.532850][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6504.533874][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6504.534199][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6504.534617][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6504.535043][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6504.535468][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6504.535893][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6504.536314][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6504.536787][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6504.537133][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6504.537551][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6504.537966][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6504.538381][ C0] Call Trace: [ 6504.538558][ C0] [ 6504.538711][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6504.538991][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6504.539242][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6504.539534][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6504.539815][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6504.540115][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6504.540393][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6504.540710][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6504.540986][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6504.541262][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6504.541588][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6504.541904][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6504.542234][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6504.542542][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6504.542853][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6504.543155][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6504.543481][ C0] ? get_stack_info+0x36/0xc0 [ 6504.543740][ C0] ? lock_acquire+0x1c1/0x220 [ 6504.543995][ C0] ? lock_release+0x1d5/0x250 [ 6504.544252][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6504.544515][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6504.544802][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6504.545107][ C0] ? lock_acquire+0x1c1/0x220 [ 6504.545358][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6504.545612][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6504.545888][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6504.546134][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6504.546392][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6504.546659][ C0] ? __inet_lookup_established+0x341/0x610 [ 6504.546971][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6504.547264][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6504.547557][ C0] ip_local_deliver+0x19d/0x480 [ 6504.547816][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6504.548098][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6504.548362][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6504.548642][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6504.548908][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6504.549243][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6504.549520][ C0] ip_rcv+0x564/0x740 [ 6504.549741][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6504.549986][ C0] ? set_track_prepare+0x8a/0xd0 [ 6504.550254][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6504.550543][ C0] ? rest_init+0x153/0x260 [ 6504.550781][ C0] ? skb_clone+0x10b/0x330 [ 6504.551019][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6504.551357][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6504.551682][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6504.551977][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6504.552284][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6504.552542][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6504.552780][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6504.553093][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6504.553389][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6504.553731][ C0] ? lock_acquire+0x1c1/0x220 [ 6504.553984][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6504.554297][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6504.554592][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6504.554933][ C0] ? __copy_skb_header+0xaf/0x490 [ 6504.555199][ C0] ? __skb_clone+0x57a/0x760 [ 6504.555445][ C0] netif_receive_skb+0x55/0x280 [ 6504.555708][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6504.556038][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6504.556392][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6504.556703][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6504.556991][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6504.557294][ C0] ? hlock_class+0x4e/0x130 [ 6504.557542][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6504.557874][ C0] ? place_entity+0x21/0x2f0 [ 6504.558123][ C0] ? resched_curr+0x219/0x280 [ 6504.558373][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6504.558640][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6504.558919][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6504.559204][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6504.559463][ C0] ? activate_task+0xf5/0x260 [ 6504.559716][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6504.559992][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6504.560263][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6504.560527][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6504.560820][ C0] ? get_stack_info+0x36/0xc0 [ 6504.561072][ C0] ? stack_access_ok+0xda/0x1f0 [ 6504.561327][ C0] ? get_reg+0x119/0x190 [ 6504.561556][ C0] __tcf_classify+0x32c/0x7d0 [ 6504.561811][ C0] tcf_classify+0x283/0x930 [ 6504.562056][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6504.562386][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6504.562651][ C0] ? arch_stack_walk+0x8c/0x100 [ 6504.562910][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6504.563198][ C0] tc_run+0x2e4/0x5d0 [ 6504.563416][ C0] ? __pfx_tc_run+0x10/0x10 [ 6504.563660][ C0] ? lock_acquire+0x1c1/0x220 [ 6504.563910][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6504.564187][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6504.564451][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6504.564738][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6504.565025][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6504.565343][ C0] ? neigh_hh_output+0x348/0x590 [ 6504.565610][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6504.565887][ C0] ip_finish_output2+0x786/0x18e0 [ 6504.566154][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6504.566443][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6504.566800][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6504.567095][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6504.567357][ C0] ? __ip_finish_output+0x10f/0x770 [ 6504.567636][ C0] ip_output+0x16b/0x4f0 [ 6504.567863][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6504.568149][ C0] ? __pfx_ip_output+0x10/0x10 [ 6504.568407][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6504.568705][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6504.568970][ C0] ? ip_local_out+0x114/0x3b0 [ 6504.569218][ C0] __ip_queue_xmit+0x672/0x1910 [ 6504.569477][ C0] ? __skb_clone+0x57a/0x760 [ 6504.569722][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6504.570006][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6504.570303][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6504.570623][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6504.570880][ C0] ? tcp_current_mss+0x40a/0x510 [ 6504.571147][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6504.571430][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6504.571708][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6504.571962][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6504.572231][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6504.572548][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6504.572827][ C0] ? ktime_get+0xb6/0x190 [ 6504.573062][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6504.573337][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6504.573615][ C0] tcp_write_timer+0x82/0x1d0 [ 6504.573869][ C0] call_timer_fn+0x176/0x430 [ 6504.574117][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6504.574388][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6504.574662][ C0] __run_timers.part.0+0x52d/0x890 [ 6504.574939][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6504.575225][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6504.575524][ C0] ? lock_acquire+0x1c1/0x220 [ 6504.575769][ C0] ? clockevents_program_event+0xf6/0x300 [ 6504.576072][ C0] ? lock_release+0x1d5/0x250 [ 6504.576320][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6504.576596][ C0] ? ktime_get+0xb6/0x190 [ 6504.576824][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6504.577121][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6504.577432][ C0] run_timer_softirq+0x72/0x100 [ 6504.577687][ C0] __do_softirq+0x1bc/0x7ff [ 6504.577927][ C0] irq_exit_rcu+0x98/0xc0 [ 6504.578156][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6504.578454][ C0] [ 6504.578614][ C0] [ 6504.578773][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6504.579096][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6504.579367][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6504.580378][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6504.580698][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6504.581116][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6504.581534][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6504.581949][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6504.582364][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6504.582781][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6504.583081][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6504.583352][ C0] default_idle_call+0x69/0xa0 [ 6504.583610][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6504.583871][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6504.584165][ C0] ? lock_release+0x1d5/0x250 [ 6504.584412][ C0] do_idle+0xfb/0x160 [ 6504.584623][ C0] cpu_startup_entry+0x55/0x60 [ 6504.584874][ C0] rest_init+0x153/0x260 [ 6504.585109][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6504.585399][ C0] arch_call_rest_init+0x13/0x40 [ 6504.585665][ C0] start_kernel+0x314/0x3d0 [ 6504.585904][ C0] x86_64_start_reservations+0x18/0x30 [ 6504.586193][ C0] x86_64_start_kernel+0xba/0x110 [ 6504.586465][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6504.586793][ C0] [ 6504.586961][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4951s! [ksoftirqd/1:22] [ 6504.587427][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6504.588625][ C1] irq event stamp: 3886976 [ 6504.588860][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6504.589361][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6504.589858][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6504.590359][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6504.590848][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6504.591346][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6504.591993][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 6504.592290][ C1] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 6504.593318][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [ 6504.593646][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6504.594070][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6504.594497][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6504.594926][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6504.595345][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6504.595762][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6504.596231][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6504.596583][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6504.597003][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6504.597425][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6504.597849][ C1] Call Trace: [ 6504.598035][ C1] [ 6504.598193][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6504.598471][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6504.598727][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6504.599017][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6504.599308][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6504.599614][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6504.599896][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6504.600219][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6504.600493][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6504.600823][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6504.601137][ C1] [ 6504.601294][ C1] [ 6504.601452][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6504.601781][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6504.602088][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 6504.602390][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 6504.602689][ C1] ? run_ksoftirqd+0xb/0x60 [ 6504.602936][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6504.603268][ C1] ? __orc_find+0x9c/0xf0 [ 6504.603498][ C1] ? lock_acquire+0x1c1/0x220 [ 6504.603747][ C1] ? irqentry_enter+0x2b/0x60 [ 6504.603997][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6504.604258][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6504.604544][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6504.604843][ C1] ? lock_acquire+0x1c1/0x220 [ 6504.605100][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6504.605355][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6504.605627][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6504.605877][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6504.606140][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6504.606416][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6504.606708][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6504.607000][ C1] ip_local_deliver+0x19d/0x480 [ 6504.607258][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6504.607542][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6504.607812][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6504.608092][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6504.608359][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6504.608696][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6504.608973][ C1] ip_rcv+0x564/0x740 [ 6504.609195][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6504.609441][ C1] ? set_track_prepare+0x8a/0xd0 [ 6504.609709][ C1] ? irqentry_enter+0x2b/0x60 [ 6504.609960][ C1] ? irqentry_enter+0x2b/0x60 [ 6504.610212][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6504.610454][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6504.610767][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6504.611107][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6504.611417][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6504.611759][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6504.612058][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6504.612387][ C1] netif_receive_skb+0x55/0x280 [ 6504.612645][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6504.612970][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6504.613319][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6504.613633][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6504.613921][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6504.614222][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6504.614548][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6504.614828][ C1] ? arch_stack_walk+0x68/0x100 [ 6504.615098][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6504.615374][ C1] ? irqentry_enter+0x2b/0x60 [ 6504.615626][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6504.615944][ C1] ? irqentry_enter+0x2b/0x60 [ 6504.616201][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6504.616527][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6504.616806][ C1] ? arch_stack_walk+0x68/0x100 [ 6504.617069][ C1] __tcf_classify+0x32c/0x7d0 [ 6504.617323][ C1] tcf_classify+0x283/0x930 [ 6504.617568][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6504.617840][ C1] tc_run+0x2e4/0x5d0 [ 6504.618063][ C1] ? __pfx_tc_run+0x10/0x10 [ 6504.618310][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6504.618581][ C1] ? irqentry_enter+0x2b/0x60 [ 6504.618836][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6504.619123][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6504.619444][ C1] ip_finish_output2+0x786/0x18e0 [ 6504.619719][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6504.620011][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6504.620274][ C1] ? __ip_finish_output+0x10f/0x770 [ 6504.620555][ C1] ip_output+0x16b/0x4f0 [ 6504.620787][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6504.621105][ C1] ? __pfx_ip_output+0x10/0x10 [ 6504.621366][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6504.621719][ C1] ? __pfx_ip_output+0x10/0x10 [ 6504.621973][ C1] __ip_queue_xmit+0x672/0x1910 [ 6504.622240][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6504.622524][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6504.622822][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6504.623113][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6504.623414][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6504.623704][ C1] tcp_delack_timer+0x84/0x240 [ 6504.623962][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6504.624249][ C1] call_timer_fn+0x176/0x430 [ 6504.624499][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6504.624776][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6504.625059][ C1] __run_timers.part.0+0x52d/0x890 [ 6504.625335][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6504.625623][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6504.625922][ C1] ? __pfx___schedule+0x10/0x10 [ 6504.626184][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6504.626509][ C1] run_timer_softirq+0x72/0x100 [ 6504.626768][ C1] __do_softirq+0x1bc/0x7ff [ 6504.627011][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6504.627288][ C1] run_ksoftirqd+0x2e/0x60 [ 6504.627529][ C1] smpboot_thread_fn+0x30e/0x840 [ 6504.627792][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6504.628087][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6504.628378][ C1] kthread+0x292/0x360 [ 6504.628597][ C1] ? __pfx_kthread+0x10/0x10 [ 6504.628841][ C1] ret_from_fork+0x34/0x70 [ 6504.629083][ C1] ? __pfx_kthread+0x10/0x10 [ 6504.629328][ C1] ret_from_fork_asm+0x1b/0x30 [ 6504.629592][ C1] [ 6530.113024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6530.113404][ C1] rcu: 1-....: (5320103 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1260379 [ 6530.113997][ C1] rcu: (t=5335804 jiffies g=1007429 q=31 ncpus=4) [ 6530.114350][ C1] Sending NMI from CPU 1 to CPUs 0: [ 6530.114634][ C0] NMI backtrace for cpu 0 [ 6530.114642][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6530.114647][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6530.114650][ C0] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 6530.114661][ C0] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 6530.114664][ C0] RSP: 0018:ffffc900000069c8 EFLAGS: 00000202 [ 6530.114668][ C0] RAX: ffff88800a099b58 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6530.114670][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6530.114672][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6530.114673][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6530.114675][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6530.114677][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6530.114679][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6530.114682][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6530.114684][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6530.114686][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6530.114688][ C0] Call Trace: [ 6530.114691][ C0] [ 6530.114696][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 6530.114702][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6530.114708][ C0] ? nmi_handle+0x156/0x420 [ 6530.114713][ C0] ? default_do_nmi+0x41/0x100 [ 6530.114718][ C0] ? exc_nmi+0xf3/0x120 [ 6530.114721][ C0] ? end_repeat_nmi+0xf/0x60 [ 6530.114726][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6530.114732][ C0] ? kasan_check_range+0x12/0x1c0 [ 6530.114736][ C0] ? kasan_check_range+0x12/0x1c0 [ 6530.114739][ C0] ? kasan_check_range+0x12/0x1c0 [ 6530.114743][ C0] [ 6530.114743][ C0] [ 6530.114744][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 6530.114748][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6530.114751][ C0] ? get_stack_info+0x36/0xc0 [ 6530.114757][ C0] ? lock_acquire+0x1c1/0x220 [ 6530.114768][ C0] ? lock_release+0x1d5/0x250 [ 6530.114772][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6530.114776][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6530.114779][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6530.114782][ C0] ? lock_acquire+0x1c1/0x220 [ 6530.114785][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6530.114790][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6530.114793][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6530.114800][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6530.114803][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6530.114807][ C0] ? __inet_lookup_established+0x341/0x610 [ 6530.114813][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6530.114820][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6530.114824][ C0] ip_local_deliver+0x19d/0x480 [ 6530.114827][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6530.114830][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6530.114835][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6530.114839][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6530.114842][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6530.114846][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6530.114857][ C0] ip_rcv+0x564/0x740 [ 6530.114860][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6530.114863][ C0] ? set_track_prepare+0x8a/0xd0 [ 6530.114868][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6530.114870][ C0] ? rest_init+0x153/0x260 [ 6530.114872][ C0] ? skb_clone+0x10b/0x330 [ 6530.114878][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6530.114884][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6530.114889][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6530.114894][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6530.114903][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6530.114906][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6530.114909][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6530.114913][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6530.114916][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6530.114920][ C0] ? lock_acquire+0x1c1/0x220 [ 6530.114922][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6530.114925][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6530.114928][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6530.114931][ C0] ? __copy_skb_header+0xaf/0x490 [ 6530.114935][ C0] ? __skb_clone+0x57a/0x760 [ 6530.114937][ C0] netif_receive_skb+0x55/0x280 [ 6530.114940][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6530.114956][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6530.114963][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6530.114970][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6530.114975][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6530.114984][ C0] ? hlock_class+0x4e/0x130 [ 6530.114991][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6530.115001][ C0] ? place_entity+0x21/0x2f0 [ 6530.115005][ C0] ? resched_curr+0x219/0x280 [ 6530.115009][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6530.115012][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6530.115016][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6530.115021][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6530.115023][ C0] ? activate_task+0xf5/0x260 [ 6530.115026][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6530.115032][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6530.115035][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6530.115038][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6530.115041][ C0] ? get_stack_info+0x36/0xc0 [ 6530.115045][ C0] ? stack_access_ok+0xda/0x1f0 [ 6530.115047][ C0] ? get_reg+0x119/0x190 [ 6530.115051][ C0] __tcf_classify+0x32c/0x7d0 [ 6530.115056][ C0] tcf_classify+0x283/0x930 [ 6530.115058][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6530.115064][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6530.115066][ C0] ? arch_stack_walk+0x8c/0x100 [ 6530.115071][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6530.115074][ C0] tc_run+0x2e4/0x5d0 [ 6530.115079][ C0] ? __pfx_tc_run+0x10/0x10 [ 6530.115082][ C0] ? lock_acquire+0x1c1/0x220 [ 6530.115084][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6530.115089][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6530.115095][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6530.115098][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6530.115102][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6530.115106][ C0] ? neigh_hh_output+0x348/0x590 [ 6530.115110][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6530.115114][ C0] ip_finish_output2+0x786/0x18e0 [ 6530.115118][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6530.115124][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6530.115132][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6530.115135][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6530.115139][ C0] ? __ip_finish_output+0x10f/0x770 [ 6530.115143][ C0] ip_output+0x16b/0x4f0 [ 6530.115146][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6530.115151][ C0] ? __pfx_ip_output+0x10/0x10 [ 6530.115154][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6530.115159][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6530.115162][ C0] ? ip_local_out+0x114/0x3b0 [ 6530.115166][ C0] __ip_queue_xmit+0x672/0x1910 [ 6530.115170][ C0] ? __skb_clone+0x57a/0x760 [ 6530.115173][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6530.115181][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6530.115185][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6530.115189][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6530.115194][ C0] ? tcp_current_mss+0x40a/0x510 [ 6530.115197][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6530.115200][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6530.115203][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6530.115205][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6530.115208][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6530.115212][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6530.115217][ C0] ? ktime_get+0xb6/0x190 [ 6530.115221][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6530.115225][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6530.115228][ C0] tcp_write_timer+0x82/0x1d0 [ 6530.115232][ C0] call_timer_fn+0x176/0x430 [ 6530.115235][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6530.115240][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6530.115244][ C0] __run_timers.part.0+0x52d/0x890 [ 6530.115247][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6530.115251][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6530.115254][ C0] ? lock_acquire+0x1c1/0x220 [ 6530.115257][ C0] ? clockevents_program_event+0xf6/0x300 [ 6530.115261][ C0] ? lock_release+0x1d5/0x250 [ 6530.115264][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6530.115267][ C0] ? ktime_get+0xb6/0x190 [ 6530.115269][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6530.115273][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6530.115277][ C0] run_timer_softirq+0x72/0x100 [ 6530.115281][ C0] __do_softirq+0x1bc/0x7ff [ 6530.115285][ C0] irq_exit_rcu+0x98/0xc0 [ 6530.115288][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6530.115292][ C0] [ 6530.115293][ C0] [ 6530.115294][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6530.115300][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6530.115304][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6530.115306][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6530.115308][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6530.115310][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6530.115311][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6530.115313][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6530.115314][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6530.115318][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6530.115321][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6530.115325][ C0] default_idle_call+0x69/0xa0 [ 6530.115327][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6530.115330][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6530.115335][ C0] ? lock_release+0x1d5/0x250 [ 6530.115339][ C0] do_idle+0xfb/0x160 [ 6530.115342][ C0] cpu_startup_entry+0x55/0x60 [ 6530.115345][ C0] rest_init+0x153/0x260 [ 6530.115347][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6530.115353][ C0] arch_call_rest_init+0x13/0x40 [ 6530.115359][ C0] start_kernel+0x314/0x3d0 [ 6530.115362][ C0] x86_64_start_reservations+0x18/0x30 [ 6530.115367][ C0] x86_64_start_kernel+0xba/0x110 [ 6530.115371][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6530.115379][ C0] [ 6530.115631][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6530.170024][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6530.170676][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6530.171032][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6530.172064][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6530.172394][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6530.172820][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6530.173248][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6530.173671][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6530.174095][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6530.174525][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6530.175008][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6530.175361][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6530.175784][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6530.176213][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6530.176640][ C1] Call Trace: [ 6530.176821][ C1] [ 6530.176979][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6530.177270][ C1] ? print_cpu_stall+0x263/0x6a0 [ 6530.177539][ C1] ? check_cpu_stall+0x284/0x500 [ 6530.177802][ C1] ? rcu_pending+0x92/0x360 [ 6530.178049][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6530.178335][ C1] ? update_process_times+0xb9/0x110 [ 6530.178623][ C1] ? tick_sched_handle+0x67/0x130 [ 6530.178896][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6530.179201][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6530.179457][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6530.179789][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6530.180076][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6530.180378][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6530.180654][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6530.180976][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6530.181255][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6530.181577][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6530.181888][ C1] [ 6530.182050][ C1] [ 6530.182211][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6530.182544][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6530.182846][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6530.183156][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6530.183463][ C1] ? run_ksoftirqd+0xb/0x60 [ 6530.183711][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6530.184041][ C1] ? __orc_find+0x9c/0xf0 [ 6530.184270][ C1] ? lock_acquire+0x1c1/0x220 [ 6530.184520][ C1] ? irqentry_enter+0x2b/0x60 [ 6530.184774][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6530.185041][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6530.185328][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6530.185631][ C1] ? lock_acquire+0x1c1/0x220 [ 6530.185881][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6530.186135][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6530.186407][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6530.186656][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6530.186917][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6530.187193][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6530.187488][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6530.187784][ C1] ip_local_deliver+0x19d/0x480 [ 6530.188044][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6530.188328][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6530.188591][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6530.188872][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6530.189141][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6530.189478][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6530.189757][ C1] ip_rcv+0x564/0x740 [ 6530.189975][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6530.190222][ C1] ? set_track_prepare+0x8a/0xd0 [ 6530.190491][ C1] ? irqentry_enter+0x2b/0x60 [ 6530.190742][ C1] ? irqentry_enter+0x2b/0x60 [ 6530.190993][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6530.191234][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6530.191548][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6530.191887][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6530.192198][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6530.192543][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6530.192844][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6530.193177][ C1] netif_receive_skb+0x55/0x280 [ 6530.193434][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6530.193763][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6530.194113][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6530.194430][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6530.194719][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6530.195031][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6530.195369][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6530.195653][ C1] ? arch_stack_walk+0x68/0x100 [ 6530.195914][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6530.196192][ C1] ? irqentry_enter+0x2b/0x60 [ 6530.196443][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6530.196761][ C1] ? irqentry_enter+0x2b/0x60 [ 6530.197018][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6530.197345][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6530.197628][ C1] ? arch_stack_walk+0x68/0x100 [ 6530.197895][ C1] __tcf_classify+0x32c/0x7d0 [ 6530.198151][ C1] tcf_classify+0x283/0x930 [ 6530.198398][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6530.198670][ C1] tc_run+0x2e4/0x5d0 [ 6530.198890][ C1] ? __pfx_tc_run+0x10/0x10 [ 6530.199138][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6530.199407][ C1] ? irqentry_enter+0x2b/0x60 [ 6530.199658][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6530.199944][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6530.200266][ C1] ip_finish_output2+0x786/0x18e0 [ 6530.200542][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6530.200837][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6530.201102][ C1] ? __ip_finish_output+0x10f/0x770 [ 6530.201384][ C1] ip_output+0x16b/0x4f0 [ 6530.201613][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6530.201932][ C1] ? __pfx_ip_output+0x10/0x10 [ 6530.202192][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6530.202544][ C1] ? __pfx_ip_output+0x10/0x10 [ 6530.202802][ C1] __ip_queue_xmit+0x672/0x1910 [ 6530.203067][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6530.203352][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6530.203651][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6530.203940][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6530.204240][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6530.204531][ C1] tcp_delack_timer+0x84/0x240 [ 6530.204798][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6530.205093][ C1] call_timer_fn+0x176/0x430 [ 6530.205344][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6530.205618][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6530.205901][ C1] __run_timers.part.0+0x52d/0x890 [ 6530.206177][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6530.206463][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6530.206765][ C1] ? __pfx___schedule+0x10/0x10 [ 6530.207029][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6530.207356][ C1] run_timer_softirq+0x72/0x100 [ 6530.207616][ C1] __do_softirq+0x1bc/0x7ff [ 6530.207860][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6530.208134][ C1] run_ksoftirqd+0x2e/0x60 [ 6530.208376][ C1] smpboot_thread_fn+0x30e/0x840 [ 6530.208641][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6530.208934][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6530.209225][ C1] kthread+0x292/0x360 [ 6530.209449][ C1] ? __pfx_kthread+0x10/0x10 [ 6530.209701][ C1] ret_from_fork+0x34/0x70 [ 6530.209942][ C1] ? __pfx_kthread+0x10/0x10 [ 6530.210188][ C1] ret_from_fork_asm+0x1b/0x30 [ 6530.210449][ C1] [ 6556.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5000s! [swapper/0:0] [ 6556.527919][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6556.529128][ C0] irq event stamp: 27567077 [ 6556.529371][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6556.529905][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6556.530380][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6556.530883][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6556.531376][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6556.531856][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6556.532515][ C0] RIP: 0010:__kasan_check_read+0x0/0x20 [ 6556.532814][ C0] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 6556.533843][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000202 [ 6556.534173][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6556.534596][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6556.535022][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6556.535442][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6556.535861][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6556.536280][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6556.536749][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6556.537105][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6556.537528][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6556.537949][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6556.538373][ C0] Call Trace: [ 6556.538555][ C0] [ 6556.538713][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6556.538987][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6556.539244][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6556.539533][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6556.539821][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6556.540128][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6556.540410][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6556.540734][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6556.541009][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6556.541289][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6556.541616][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6556.541927][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6556.542263][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6556.542565][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 6556.542858][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 6556.543151][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6556.543474][ C0] ? get_stack_info+0x36/0xc0 [ 6556.543729][ C0] ? lock_acquire+0x1c1/0x220 [ 6556.543983][ C0] ? lock_release+0x1d5/0x250 [ 6556.544237][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6556.544501][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6556.544793][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6556.545093][ C0] ? lock_acquire+0x1c1/0x220 [ 6556.545348][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6556.545606][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6556.545881][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6556.546130][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6556.546386][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6556.546653][ C0] ? __inet_lookup_established+0x341/0x610 [ 6556.546962][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6556.547257][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6556.547547][ C0] ip_local_deliver+0x19d/0x480 [ 6556.547805][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6556.548091][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6556.548356][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6556.548638][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6556.548905][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6556.549240][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6556.549520][ C0] ip_rcv+0x564/0x740 [ 6556.549740][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6556.549986][ C0] ? set_track_prepare+0x8a/0xd0 [ 6556.550254][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6556.550539][ C0] ? rest_init+0x153/0x260 [ 6556.550780][ C0] ? skb_clone+0x10b/0x330 [ 6556.551019][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6556.551360][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6556.551684][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6556.551976][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6556.552285][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6556.552544][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6556.552784][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6556.553098][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6556.553397][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6556.553743][ C0] ? lock_acquire+0x1c1/0x220 [ 6556.553995][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6556.554308][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6556.554607][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6556.554946][ C0] ? __copy_skb_header+0xaf/0x490 [ 6556.555214][ C0] ? __skb_clone+0x57a/0x760 [ 6556.555457][ C0] netif_receive_skb+0x55/0x280 [ 6556.555719][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6556.556051][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6556.556401][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6556.556713][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6556.557005][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6556.557308][ C0] ? hlock_class+0x4e/0x130 [ 6556.557559][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6556.557891][ C0] ? place_entity+0x21/0x2f0 [ 6556.558140][ C0] ? resched_curr+0x219/0x280 [ 6556.558388][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6556.558655][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6556.558938][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6556.559220][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6556.559484][ C0] ? activate_task+0xf5/0x260 [ 6556.559741][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6556.560018][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6556.560289][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6556.560552][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6556.560843][ C0] ? get_stack_info+0x36/0xc0 [ 6556.561092][ C0] ? stack_access_ok+0xda/0x1f0 [ 6556.561349][ C0] ? get_reg+0x119/0x190 [ 6556.561576][ C0] __tcf_classify+0x32c/0x7d0 [ 6556.561829][ C0] tcf_classify+0x283/0x930 [ 6556.562074][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6556.562407][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6556.562672][ C0] ? arch_stack_walk+0x8c/0x100 [ 6556.562933][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6556.563225][ C0] tc_run+0x2e4/0x5d0 [ 6556.563443][ C0] ? __pfx_tc_run+0x10/0x10 [ 6556.563690][ C0] ? lock_acquire+0x1c1/0x220 [ 6556.563945][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6556.564223][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6556.564495][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6556.564790][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6556.565066][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6556.565384][ C0] ? neigh_hh_output+0x348/0x590 [ 6556.565651][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6556.565927][ C0] ip_finish_output2+0x786/0x18e0 [ 6556.566195][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6556.566488][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6556.566843][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6556.567134][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6556.567399][ C0] ? __ip_finish_output+0x10f/0x770 [ 6556.567680][ C0] ip_output+0x16b/0x4f0 [ 6556.567914][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6556.568195][ C0] ? __pfx_ip_output+0x10/0x10 [ 6556.568451][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6556.568750][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6556.569018][ C0] ? ip_local_out+0x114/0x3b0 [ 6556.569270][ C0] __ip_queue_xmit+0x672/0x1910 [ 6556.569533][ C0] ? __skb_clone+0x57a/0x760 [ 6556.569778][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6556.570064][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6556.570364][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6556.570689][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6556.570949][ C0] ? tcp_current_mss+0x40a/0x510 [ 6556.571217][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6556.571497][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6556.571778][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6556.572037][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6556.572304][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6556.572620][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6556.572903][ C0] ? ktime_get+0xb6/0x190 [ 6556.573138][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6556.573416][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6556.573696][ C0] tcp_write_timer+0x82/0x1d0 [ 6556.573951][ C0] call_timer_fn+0x176/0x430 [ 6556.574202][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6556.574476][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6556.574761][ C0] __run_timers.part.0+0x52d/0x890 [ 6556.575039][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6556.575327][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6556.575634][ C0] ? lock_acquire+0x1c1/0x220 [ 6556.575884][ C0] ? clockevents_program_event+0xf6/0x300 [ 6556.576194][ C0] ? lock_release+0x1d5/0x250 [ 6556.576440][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6556.576715][ C0] ? ktime_get+0xb6/0x190 [ 6556.576946][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6556.577244][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6556.577560][ C0] run_timer_softirq+0x72/0x100 [ 6556.577819][ C0] __do_softirq+0x1bc/0x7ff [ 6556.578064][ C0] irq_exit_rcu+0x98/0xc0 [ 6556.578295][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6556.578594][ C0] [ 6556.578753][ C0] [ 6556.578913][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6556.579233][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6556.579500][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6556.580517][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6556.580840][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6556.581260][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6556.581677][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6556.582096][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6556.582523][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6556.582944][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6556.583246][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6556.583517][ C0] default_idle_call+0x69/0xa0 [ 6556.583773][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6556.584035][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6556.584332][ C0] ? lock_release+0x1d5/0x250 [ 6556.584584][ C0] do_idle+0xfb/0x160 [ 6556.584809][ C0] cpu_startup_entry+0x55/0x60 [ 6556.585067][ C0] rest_init+0x153/0x260 [ 6556.585292][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6556.585589][ C0] arch_call_rest_init+0x13/0x40 [ 6556.585860][ C0] start_kernel+0x314/0x3d0 [ 6556.586105][ C0] x86_64_start_reservations+0x18/0x30 [ 6556.586398][ C0] x86_64_start_kernel+0xba/0x110 [ 6556.586669][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6556.587001][ C0] [ 6556.587168][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5000s! [ksoftirqd/1:22] [ 6556.587638][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6556.588838][ C1] irq event stamp: 3886976 [ 6556.589080][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6556.589577][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6556.590072][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6556.590570][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6556.591066][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6556.591559][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6556.592202][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6556.592541][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6556.593559][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6556.593880][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6556.594299][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6556.594725][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6556.595151][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6556.595571][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6556.595998][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6556.596473][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6556.596819][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6556.597247][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6556.597668][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6556.598087][ C1] Call Trace: [ 6556.598263][ C1] [ 6556.598418][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6556.598698][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6556.598955][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6556.599250][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6556.599538][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6556.599841][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6556.600120][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6556.600445][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6556.600723][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6556.601046][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6556.601358][ C1] [ 6556.601519][ C1] [ 6556.601680][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6556.602014][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6556.602318][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6556.602628][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6556.602934][ C1] ? run_ksoftirqd+0xb/0x60 [ 6556.603183][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6556.603512][ C1] ? __orc_find+0x9c/0xf0 [ 6556.603743][ C1] ? lock_acquire+0x1c1/0x220 [ 6556.603994][ C1] ? irqentry_enter+0x2b/0x60 [ 6556.604246][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6556.604506][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6556.604795][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6556.605100][ C1] ? lock_acquire+0x1c1/0x220 [ 6556.605351][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6556.605605][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6556.605878][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6556.606131][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6556.606393][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6556.606671][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6556.606965][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6556.607260][ C1] ip_local_deliver+0x19d/0x480 [ 6556.607520][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6556.607805][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6556.608071][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6556.608353][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6556.608621][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6556.608959][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6556.609238][ C1] ip_rcv+0x564/0x740 [ 6556.609456][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6556.609703][ C1] ? set_track_prepare+0x8a/0xd0 [ 6556.609972][ C1] ? irqentry_enter+0x2b/0x60 [ 6556.610225][ C1] ? irqentry_enter+0x2b/0x60 [ 6556.610478][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6556.610719][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6556.611034][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6556.611375][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6556.611687][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6556.612034][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6556.612340][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6556.612674][ C1] netif_receive_skb+0x55/0x280 [ 6556.612933][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6556.613261][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6556.613610][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6556.613929][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6556.614220][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6556.614526][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6556.614868][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6556.615153][ C1] ? arch_stack_walk+0x68/0x100 [ 6556.615415][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6556.615693][ C1] ? irqentry_enter+0x2b/0x60 [ 6556.615948][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6556.616268][ C1] ? irqentry_enter+0x2b/0x60 [ 6556.616522][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6556.616849][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6556.617133][ C1] ? arch_stack_walk+0x68/0x100 [ 6556.617397][ C1] __tcf_classify+0x32c/0x7d0 [ 6556.617654][ C1] tcf_classify+0x283/0x930 [ 6556.617902][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6556.618176][ C1] tc_run+0x2e4/0x5d0 [ 6556.618396][ C1] ? __pfx_tc_run+0x10/0x10 [ 6556.618644][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6556.618917][ C1] ? irqentry_enter+0x2b/0x60 [ 6556.619173][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6556.619461][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6556.619783][ C1] ip_finish_output2+0x786/0x18e0 [ 6556.620061][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6556.620355][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6556.620621][ C1] ? __ip_finish_output+0x10f/0x770 [ 6556.620902][ C1] ip_output+0x16b/0x4f0 [ 6556.621134][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6556.621451][ C1] ? __pfx_ip_output+0x10/0x10 [ 6556.621710][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6556.622063][ C1] ? __pfx_ip_output+0x10/0x10 [ 6556.622321][ C1] __ip_queue_xmit+0x672/0x1910 [ 6556.622587][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6556.622872][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6556.623172][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6556.623462][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6556.623761][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6556.624053][ C1] tcp_delack_timer+0x84/0x240 [ 6556.624315][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6556.624601][ C1] call_timer_fn+0x176/0x430 [ 6556.624857][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6556.625133][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6556.625417][ C1] __run_timers.part.0+0x52d/0x890 [ 6556.625693][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6556.625979][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6556.626283][ C1] ? __pfx___schedule+0x10/0x10 [ 6556.626548][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6556.626874][ C1] run_timer_softirq+0x72/0x100 [ 6556.627138][ C1] __do_softirq+0x1bc/0x7ff [ 6556.627382][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6556.627656][ C1] run_ksoftirqd+0x2e/0x60 [ 6556.627899][ C1] smpboot_thread_fn+0x30e/0x840 [ 6556.628166][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6556.628460][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6556.628750][ C1] kthread+0x292/0x360 [ 6556.628974][ C1] ? __pfx_kthread+0x10/0x10 [ 6556.629227][ C1] ret_from_fork+0x34/0x70 [ 6556.629468][ C1] ? __pfx_kthread+0x10/0x10 [ 6556.629712][ C1] ret_from_fork_asm+0x1b/0x30 [ 6556.629974][ C1] [ 6584.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5026s! [swapper/0:0] [ 6584.527938][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6584.529132][ C0] irq event stamp: 27567077 [ 6584.529369][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6584.529897][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6584.530375][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6584.530887][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6584.531389][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6584.531876][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6584.532519][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 6584.532854][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 6584.533880][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6584.534209][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6584.534638][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6584.535057][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6584.535473][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6584.535893][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6584.536311][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6584.536778][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6584.537138][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6584.537560][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6584.537981][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6584.538404][ C0] Call Trace: [ 6584.538586][ C0] [ 6584.538750][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6584.539030][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6584.539284][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6584.539577][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6584.539861][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6584.540162][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6584.540440][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6584.540759][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6584.541035][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6584.541311][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6584.541639][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6584.541953][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6584.542282][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6584.542590][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 6584.542896][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6584.543205][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6584.543537][ C0] ? get_stack_info+0x36/0xc0 [ 6584.543792][ C0] ? lock_acquire+0x1c1/0x220 [ 6584.544044][ C0] ? lock_release+0x1d5/0x250 [ 6584.544296][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6584.544565][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6584.544854][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6584.545156][ C0] ? lock_acquire+0x1c1/0x220 [ 6584.545403][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6584.545654][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6584.545927][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6584.546176][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6584.546440][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6584.546710][ C0] ? __inet_lookup_established+0x341/0x610 [ 6584.547025][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6584.547315][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6584.547607][ C0] ip_local_deliver+0x19d/0x480 [ 6584.547868][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6584.548156][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6584.548423][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6584.548697][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6584.548959][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6584.549302][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6584.549576][ C0] ip_rcv+0x564/0x740 [ 6584.549788][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6584.550027][ C0] ? set_track_prepare+0x8a/0xd0 [ 6584.550290][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6584.550583][ C0] ? rest_init+0x153/0x260 [ 6584.550819][ C0] ? skb_clone+0x10b/0x330 [ 6584.551062][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6584.551394][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6584.551713][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6584.552015][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6584.552325][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6584.552586][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6584.552831][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6584.553150][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6584.553451][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6584.553791][ C0] ? lock_acquire+0x1c1/0x220 [ 6584.554038][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6584.554347][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6584.554652][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6584.554988][ C0] ? __copy_skb_header+0xaf/0x490 [ 6584.555260][ C0] ? __skb_clone+0x57a/0x760 [ 6584.555508][ C0] netif_receive_skb+0x55/0x280 [ 6584.555766][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6584.556096][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6584.556444][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6584.556759][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6584.557044][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6584.557341][ C0] ? hlock_class+0x4e/0x130 [ 6584.557583][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6584.557913][ C0] ? place_entity+0x21/0x2f0 [ 6584.558162][ C0] ? resched_curr+0x219/0x280 [ 6584.558418][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6584.558688][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6584.558972][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6584.559247][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6584.559505][ C0] ? activate_task+0xf5/0x260 [ 6584.559758][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6584.560034][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6584.560309][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6584.560567][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6584.560858][ C0] ? get_stack_info+0x36/0xc0 [ 6584.561116][ C0] ? stack_access_ok+0xda/0x1f0 [ 6584.561376][ C0] ? get_reg+0x119/0x190 [ 6584.561604][ C0] __tcf_classify+0x32c/0x7d0 [ 6584.561856][ C0] tcf_classify+0x283/0x930 [ 6584.562097][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6584.562420][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6584.562691][ C0] ? arch_stack_walk+0x8c/0x100 [ 6584.562954][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6584.563247][ C0] tc_run+0x2e4/0x5d0 [ 6584.563459][ C0] ? __pfx_tc_run+0x10/0x10 [ 6584.563699][ C0] ? lock_acquire+0x1c1/0x220 [ 6584.563946][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6584.564220][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6584.564490][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6584.564789][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6584.565071][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6584.565393][ C0] ? neigh_hh_output+0x348/0x590 [ 6584.565656][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6584.565937][ C0] ip_finish_output2+0x786/0x18e0 [ 6584.566210][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6584.566505][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6584.566857][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6584.567148][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6584.567415][ C0] ? __ip_finish_output+0x10f/0x770 [ 6584.567691][ C0] ip_output+0x16b/0x4f0 [ 6584.567916][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6584.568201][ C0] ? __pfx_ip_output+0x10/0x10 [ 6584.568454][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6584.568758][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6584.569020][ C0] ? ip_local_out+0x114/0x3b0 [ 6584.569274][ C0] __ip_queue_xmit+0x672/0x1910 [ 6584.569537][ C0] ? __skb_clone+0x57a/0x760 [ 6584.569786][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6584.570069][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6584.570362][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6584.570678][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6584.570937][ C0] ? tcp_current_mss+0x40a/0x510 [ 6584.571199][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6584.571491][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6584.571770][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6584.572021][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6584.572293][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6584.572612][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6584.572887][ C0] ? ktime_get+0xb6/0x190 [ 6584.573119][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6584.573392][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6584.573676][ C0] tcp_write_timer+0x82/0x1d0 [ 6584.573925][ C0] call_timer_fn+0x176/0x430 [ 6584.574169][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6584.574446][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6584.574724][ C0] __run_timers.part.0+0x52d/0x890 [ 6584.574996][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6584.575281][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6584.575579][ C0] ? lock_acquire+0x1c1/0x220 [ 6584.575830][ C0] ? clockevents_program_event+0xf6/0x300 [ 6584.576141][ C0] ? lock_release+0x1d5/0x250 [ 6584.576395][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6584.576675][ C0] ? ktime_get+0xb6/0x190 [ 6584.576910][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6584.577212][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6584.577521][ C0] run_timer_softirq+0x72/0x100 [ 6584.577782][ C0] __do_softirq+0x1bc/0x7ff [ 6584.578028][ C0] irq_exit_rcu+0x98/0xc0 [ 6584.578261][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6584.578563][ C0] [ 6584.578720][ C0] [ 6584.578877][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6584.579198][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6584.579469][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6584.580496][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6584.580823][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6584.581249][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6584.581670][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6584.582095][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6584.582515][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6584.582937][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6584.583245][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6584.583519][ C0] default_idle_call+0x69/0xa0 [ 6584.583771][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6584.584039][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6584.584335][ C0] ? lock_release+0x1d5/0x250 [ 6584.584597][ C0] do_idle+0xfb/0x160 [ 6584.584809][ C0] cpu_startup_entry+0x55/0x60 [ 6584.585063][ C0] rest_init+0x153/0x260 [ 6584.585292][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6584.585579][ C0] arch_call_rest_init+0x13/0x40 [ 6584.585844][ C0] start_kernel+0x314/0x3d0 [ 6584.586090][ C0] x86_64_start_reservations+0x18/0x30 [ 6584.586383][ C0] x86_64_start_kernel+0xba/0x110 [ 6584.586651][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6584.586974][ C0] [ 6584.587138][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5026s! [ksoftirqd/1:22] [ 6584.587611][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6584.588801][ C1] irq event stamp: 3886976 [ 6584.589037][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6584.589535][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6584.590030][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6584.590532][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6584.591020][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6584.591516][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6584.592167][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6584.592509][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6584.593530][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6584.593859][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6584.594282][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6584.594710][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6584.595130][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6584.595552][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6584.595972][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6584.596443][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6584.596800][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6584.597224][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6584.597646][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6584.598070][ C1] Call Trace: [ 6584.598253][ C1] [ 6584.598412][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6584.598686][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6584.598943][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6584.599233][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6584.599520][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6584.599826][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6584.600108][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6584.600432][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6584.600708][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6584.601034][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6584.601348][ C1] [ 6584.601504][ C1] [ 6584.601662][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6584.601993][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6584.602301][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6584.602615][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6584.602919][ C1] ? run_ksoftirqd+0xb/0x60 [ 6584.603163][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6584.603491][ C1] ? __orc_find+0x9c/0xf0 [ 6584.603723][ C1] ? lock_acquire+0x1c1/0x220 [ 6584.603978][ C1] ? irqentry_enter+0x2b/0x60 [ 6584.604235][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6584.604501][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6584.604793][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6584.605093][ C1] ? lock_acquire+0x1c1/0x220 [ 6584.605346][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6584.605602][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6584.605877][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6584.606123][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6584.606383][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6584.606654][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6584.606941][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6584.607232][ C1] ip_local_deliver+0x19d/0x480 [ 6584.607494][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6584.607783][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6584.608053][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6584.608338][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6584.608601][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6584.608941][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6584.609215][ C1] ip_rcv+0x564/0x740 [ 6584.609430][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6584.609674][ C1] ? set_track_prepare+0x8a/0xd0 [ 6584.609941][ C1] ? irqentry_enter+0x2b/0x60 [ 6584.610195][ C1] ? irqentry_enter+0x2b/0x60 [ 6584.610449][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6584.610700][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6584.611016][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6584.611364][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6584.611678][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6584.612017][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6584.612315][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6584.612654][ C1] netif_receive_skb+0x55/0x280 [ 6584.612920][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6584.613252][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6584.613607][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6584.613920][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6584.614216][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6584.614526][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6584.614856][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6584.615138][ C1] ? arch_stack_walk+0x68/0x100 [ 6584.615408][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6584.615690][ C1] ? irqentry_enter+0x2b/0x60 [ 6584.615945][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6584.616272][ C1] ? irqentry_enter+0x2b/0x60 [ 6584.616525][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6584.616846][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6584.617131][ C1] ? arch_stack_walk+0x68/0x100 [ 6584.617390][ C1] __tcf_classify+0x32c/0x7d0 [ 6584.617641][ C1] tcf_classify+0x283/0x930 [ 6584.617884][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6584.618156][ C1] tc_run+0x2e4/0x5d0 [ 6584.618372][ C1] ? __pfx_tc_run+0x10/0x10 [ 6584.618619][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6584.618886][ C1] ? irqentry_enter+0x2b/0x60 [ 6584.619142][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6584.619435][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6584.619764][ C1] ip_finish_output2+0x786/0x18e0 [ 6584.620037][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6584.620326][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6584.620594][ C1] ? __ip_finish_output+0x10f/0x770 [ 6584.620872][ C1] ip_output+0x16b/0x4f0 [ 6584.621102][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6584.621427][ C1] ? __pfx_ip_output+0x10/0x10 [ 6584.621686][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6584.622044][ C1] ? __pfx_ip_output+0x10/0x10 [ 6584.622303][ C1] __ip_queue_xmit+0x672/0x1910 [ 6584.622565][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6584.622847][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6584.623144][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6584.623432][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6584.623728][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6584.624015][ C1] tcp_delack_timer+0x84/0x240 [ 6584.624273][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6584.624570][ C1] call_timer_fn+0x176/0x430 [ 6584.624822][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6584.625101][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6584.625378][ C1] __run_timers.part.0+0x52d/0x890 [ 6584.625653][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6584.625946][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6584.626251][ C1] ? __pfx___schedule+0x10/0x10 [ 6584.626509][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6584.626828][ C1] run_timer_softirq+0x72/0x100 [ 6584.627092][ C1] __do_softirq+0x1bc/0x7ff [ 6584.627338][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6584.627616][ C1] run_ksoftirqd+0x2e/0x60 [ 6584.627853][ C1] smpboot_thread_fn+0x30e/0x840 [ 6584.628123][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6584.628415][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6584.628709][ C1] kthread+0x292/0x360 [ 6584.628927][ C1] ? __pfx_kthread+0x10/0x10 [ 6584.629177][ C1] ret_from_fork+0x34/0x70 [ 6584.629418][ C1] ? __pfx_kthread+0x10/0x10 [ 6584.629669][ C1] ret_from_fork_asm+0x1b/0x30 [ 6584.629930][ C1] [ 6608.211024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6608.211406][ C1] rcu: 1-....: (5397919 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1278320 [ 6608.211999][ C1] rcu: (t=5413902 jiffies g=1007429 q=31 ncpus=4) [ 6608.212344][ C1] Sending NMI from CPU 1 to CPUs 0: [ 6608.212634][ C0] NMI backtrace for cpu 0 [ 6608.212642][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6608.212647][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6608.212650][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6608.212659][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6608.212663][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6608.212667][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6608.212669][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6608.212671][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6608.212673][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6608.212675][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6608.212677][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6608.212679][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6608.212682][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6608.212684][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6608.212685][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6608.212687][ C0] Call Trace: [ 6608.212690][ C0] [ 6608.212692][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 6608.212699][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6608.212704][ C0] ? nmi_handle+0x156/0x420 [ 6608.212709][ C0] ? default_do_nmi+0x41/0x100 [ 6608.212713][ C0] ? exc_nmi+0xf3/0x120 [ 6608.212716][ C0] ? end_repeat_nmi+0xf/0x60 [ 6608.212721][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6608.212725][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6608.212728][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6608.212732][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6608.212735][ C0] [ 6608.212736][ C0] [ 6608.212737][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6608.212741][ C0] ? get_stack_info+0x36/0xc0 [ 6608.212746][ C0] ? lock_acquire+0x1c1/0x220 [ 6608.212751][ C0] ? lock_release+0x1d5/0x250 [ 6608.212755][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6608.212758][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6608.212761][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6608.212764][ C0] ? lock_acquire+0x1c1/0x220 [ 6608.212767][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6608.212772][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6608.212776][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6608.212783][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6608.212786][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6608.212791][ C0] ? __inet_lookup_established+0x341/0x610 [ 6608.212797][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6608.212805][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6608.212809][ C0] ip_local_deliver+0x19d/0x480 [ 6608.212812][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6608.212815][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6608.212820][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6608.212824][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6608.212827][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6608.212831][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6608.212842][ C0] ip_rcv+0x564/0x740 [ 6608.212845][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6608.212848][ C0] ? set_track_prepare+0x8a/0xd0 [ 6608.212853][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6608.212855][ C0] ? rest_init+0x153/0x260 [ 6608.212858][ C0] ? skb_clone+0x10b/0x330 [ 6608.212864][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6608.212870][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6608.212875][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6608.212880][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6608.212890][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6608.212892][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6608.212895][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6608.212899][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6608.212903][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6608.212906][ C0] ? lock_acquire+0x1c1/0x220 [ 6608.212908][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6608.212912][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6608.212915][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6608.212918][ C0] ? __copy_skb_header+0xaf/0x490 [ 6608.212922][ C0] ? __skb_clone+0x57a/0x760 [ 6608.212925][ C0] netif_receive_skb+0x55/0x280 [ 6608.212927][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6608.212936][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6608.212943][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6608.212949][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6608.212955][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6608.212963][ C0] ? hlock_class+0x4e/0x130 [ 6608.212970][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6608.212980][ C0] ? place_entity+0x21/0x2f0 [ 6608.212984][ C0] ? resched_curr+0x219/0x280 [ 6608.212988][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6608.212991][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6608.212994][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6608.212999][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6608.213002][ C0] ? activate_task+0xf5/0x260 [ 6608.213005][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6608.213010][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6608.213014][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6608.213017][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6608.213022][ C0] ? get_stack_info+0x36/0xc0 [ 6608.213026][ C0] ? stack_access_ok+0xda/0x1f0 [ 6608.213028][ C0] ? get_reg+0x119/0x190 [ 6608.213032][ C0] __tcf_classify+0x32c/0x7d0 [ 6608.213037][ C0] tcf_classify+0x283/0x930 [ 6608.213040][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6608.213045][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6608.213048][ C0] ? arch_stack_walk+0x8c/0x100 [ 6608.213052][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6608.213056][ C0] tc_run+0x2e4/0x5d0 [ 6608.213060][ C0] ? __pfx_tc_run+0x10/0x10 [ 6608.213063][ C0] ? lock_acquire+0x1c1/0x220 [ 6608.213065][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6608.213070][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6608.213076][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6608.213079][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6608.213082][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6608.213087][ C0] ? neigh_hh_output+0x348/0x590 [ 6608.213092][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6608.213096][ C0] ip_finish_output2+0x786/0x18e0 [ 6608.213099][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6608.213106][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6608.213113][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6608.213116][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6608.213120][ C0] ? __ip_finish_output+0x10f/0x770 [ 6608.213124][ C0] ip_output+0x16b/0x4f0 [ 6608.213128][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6608.213132][ C0] ? __pfx_ip_output+0x10/0x10 [ 6608.213135][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6608.213140][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6608.213143][ C0] ? ip_local_out+0x114/0x3b0 [ 6608.213147][ C0] __ip_queue_xmit+0x672/0x1910 [ 6608.213152][ C0] ? __skb_clone+0x57a/0x760 [ 6608.213155][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6608.213163][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6608.213167][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6608.213171][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6608.213176][ C0] ? tcp_current_mss+0x40a/0x510 [ 6608.213179][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6608.213182][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6608.213185][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6608.213187][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6608.213190][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6608.213194][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6608.213198][ C0] ? ktime_get+0xb6/0x190 [ 6608.213203][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6608.213207][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6608.213210][ C0] tcp_write_timer+0x82/0x1d0 [ 6608.213214][ C0] call_timer_fn+0x176/0x430 [ 6608.213218][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6608.213223][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6608.213227][ C0] __run_timers.part.0+0x52d/0x890 [ 6608.213231][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6608.213235][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6608.213238][ C0] ? lock_acquire+0x1c1/0x220 [ 6608.213241][ C0] ? clockevents_program_event+0xf6/0x300 [ 6608.213245][ C0] ? lock_release+0x1d5/0x250 [ 6608.213248][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6608.213251][ C0] ? ktime_get+0xb6/0x190 [ 6608.213253][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6608.213257][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6608.213262][ C0] run_timer_softirq+0x72/0x100 [ 6608.213265][ C0] __do_softirq+0x1bc/0x7ff [ 6608.213270][ C0] irq_exit_rcu+0x98/0xc0 [ 6608.213273][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6608.213277][ C0] [ 6608.213278][ C0] [ 6608.213279][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6608.213285][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6608.213289][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6608.213291][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6608.213293][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6608.213294][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6608.213296][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6608.213297][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6608.213299][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6608.213302][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6608.213306][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6608.213310][ C0] default_idle_call+0x69/0xa0 [ 6608.213312][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6608.213315][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6608.213320][ C0] ? lock_release+0x1d5/0x250 [ 6608.213324][ C0] do_idle+0xfb/0x160 [ 6608.213327][ C0] cpu_startup_entry+0x55/0x60 [ 6608.213330][ C0] rest_init+0x153/0x260 [ 6608.213332][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6608.213339][ C0] arch_call_rest_init+0x13/0x40 [ 6608.213344][ C0] start_kernel+0x314/0x3d0 [ 6608.213348][ C0] x86_64_start_reservations+0x18/0x30 [ 6608.213353][ C0] x86_64_start_kernel+0xba/0x110 [ 6608.213357][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6608.213366][ C0] [ 6608.213629][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6608.267762][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6608.268418][ C1] RIP: 0010:kasan_check_range+0x106/0x1c0 [ 6608.268730][ C1] Code: 00 74 f2 48 89 c2 b8 01 00 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff <5b> b8 01 00 00 00 5d 41 5c c3 cc cc cc cc 41 bc 08 00 00 00 45 29 [ 6608.269755][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000246 [ 6608.270086][ C1] RAX: ffffed10014131c4 RBX: ffffed10014131c4 RCX: ffffffff90c7aaa0 [ 6608.270508][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6608.270930][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: ffffed10014131c3 [ 6608.271357][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6608.271787][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6608.272210][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6608.272680][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6608.273028][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6608.273449][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6608.273866][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6608.274284][ C1] Call Trace: [ 6608.274466][ C1] [ 6608.274624][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6608.274908][ C1] ? print_cpu_stall+0x263/0x6a0 [ 6608.275175][ C1] ? check_cpu_stall+0x284/0x500 [ 6608.275438][ C1] ? rcu_pending+0x92/0x360 [ 6608.275684][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6608.275969][ C1] ? update_process_times+0xb9/0x110 [ 6608.276252][ C1] ? tick_sched_handle+0x67/0x130 [ 6608.276525][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6608.276824][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6608.277076][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6608.277405][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6608.277688][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6608.277988][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6608.278268][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6608.278585][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6608.278862][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6608.279187][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6608.279497][ C1] [ 6608.279655][ C1] [ 6608.279813][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6608.280148][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6608.280450][ C1] ? kasan_check_range+0x106/0x1c0 [ 6608.280720][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 6608.281014][ C1] ? run_ksoftirqd+0xb/0x60 [ 6608.281263][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6608.281592][ C1] ? __orc_find+0x9c/0xf0 [ 6608.281821][ C1] ? lock_acquire+0x1c1/0x220 [ 6608.282073][ C1] ? irqentry_enter+0x2b/0x60 [ 6608.282324][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6608.282582][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6608.282866][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6608.283163][ C1] ? lock_acquire+0x1c1/0x220 [ 6608.283413][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6608.283666][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6608.283943][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6608.284190][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6608.284455][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6608.284727][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6608.285017][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6608.285308][ C1] ip_local_deliver+0x19d/0x480 [ 6608.285565][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6608.285849][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6608.286115][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6608.286394][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6608.286660][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6608.286993][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6608.287272][ C1] ip_rcv+0x564/0x740 [ 6608.287486][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6608.287731][ C1] ? set_track_prepare+0x8a/0xd0 [ 6608.287997][ C1] ? irqentry_enter+0x2b/0x60 [ 6608.288245][ C1] ? irqentry_enter+0x2b/0x60 [ 6608.288493][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6608.288731][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6608.289044][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6608.289380][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6608.289686][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6608.290028][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6608.290328][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6608.290658][ C1] netif_receive_skb+0x55/0x280 [ 6608.290917][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6608.291245][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6608.291592][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6608.291907][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6608.292196][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6608.292497][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6608.292822][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6608.293100][ C1] ? arch_stack_walk+0x68/0x100 [ 6608.293363][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6608.293642][ C1] ? irqentry_enter+0x2b/0x60 [ 6608.293894][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6608.294222][ C1] ? irqentry_enter+0x2b/0x60 [ 6608.294481][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6608.294805][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6608.295084][ C1] ? arch_stack_walk+0x68/0x100 [ 6608.295350][ C1] __tcf_classify+0x32c/0x7d0 [ 6608.295606][ C1] tcf_classify+0x283/0x930 [ 6608.295851][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6608.296126][ C1] tc_run+0x2e4/0x5d0 [ 6608.296342][ C1] ? __pfx_tc_run+0x10/0x10 [ 6608.296591][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6608.296859][ C1] ? irqentry_enter+0x2b/0x60 [ 6608.297108][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6608.297390][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6608.297713][ C1] ip_finish_output2+0x786/0x18e0 [ 6608.297986][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6608.298278][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6608.298541][ C1] ? __ip_finish_output+0x10f/0x770 [ 6608.298822][ C1] ip_output+0x16b/0x4f0 [ 6608.299054][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6608.299373][ C1] ? __pfx_ip_output+0x10/0x10 [ 6608.299633][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6608.299983][ C1] ? __pfx_ip_output+0x10/0x10 [ 6608.300238][ C1] __ip_queue_xmit+0x672/0x1910 [ 6608.300505][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6608.300788][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6608.301090][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6608.301384][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6608.301682][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6608.301971][ C1] tcp_delack_timer+0x84/0x240 [ 6608.302230][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6608.302513][ C1] call_timer_fn+0x176/0x430 [ 6608.302757][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6608.303035][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6608.303313][ C1] __run_timers.part.0+0x52d/0x890 [ 6608.303583][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6608.303873][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6608.304175][ C1] ? __pfx___schedule+0x10/0x10 [ 6608.304438][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6608.304762][ C1] run_timer_softirq+0x72/0x100 [ 6608.305020][ C1] __do_softirq+0x1bc/0x7ff [ 6608.305260][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6608.305534][ C1] run_ksoftirqd+0x2e/0x60 [ 6608.305774][ C1] smpboot_thread_fn+0x30e/0x840 [ 6608.306041][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6608.306334][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6608.306624][ C1] kthread+0x292/0x360 [ 6608.306841][ C1] ? __pfx_kthread+0x10/0x10 [ 6608.307086][ C1] ret_from_fork+0x34/0x70 [ 6608.307327][ C1] ? __pfx_kthread+0x10/0x10 [ 6608.307574][ C1] ret_from_fork_asm+0x1b/0x30 [ 6608.307837][ C1] [ 6632.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5071s! [swapper/0:0] [ 6632.527913][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6632.529110][ C0] irq event stamp: 27567077 [ 6632.529349][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6632.529878][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6632.530359][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6632.530874][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6632.531374][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6632.531857][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6632.532496][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6632.532836][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6632.533852][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6632.534173][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6632.534598][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6632.535025][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6632.535451][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6632.535873][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6632.536296][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6632.536771][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6632.537119][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6632.537545][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6632.537965][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6632.538385][ C0] Call Trace: [ 6632.538565][ C0] [ 6632.538722][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6632.539003][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6632.539258][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6632.539557][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6632.539846][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6632.540149][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6632.540427][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6632.540748][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6632.541030][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6632.541307][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6632.541634][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6632.541949][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6632.542282][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6632.542589][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6632.542903][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6632.543206][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6632.543532][ C0] ? get_stack_info+0x36/0xc0 [ 6632.543794][ C0] ? lock_acquire+0x1c1/0x220 [ 6632.544049][ C0] ? lock_release+0x1d5/0x250 [ 6632.544308][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6632.544569][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6632.544853][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6632.545151][ C0] ? lock_acquire+0x1c1/0x220 [ 6632.545405][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6632.545664][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6632.545941][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6632.546188][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6632.546446][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6632.546715][ C0] ? __inet_lookup_established+0x341/0x610 [ 6632.547031][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6632.547323][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6632.547616][ C0] ip_local_deliver+0x19d/0x480 [ 6632.547872][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6632.548155][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6632.548422][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6632.548703][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6632.548971][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6632.549306][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6632.549584][ C0] ip_rcv+0x564/0x740 [ 6632.549804][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6632.550050][ C0] ? set_track_prepare+0x8a/0xd0 [ 6632.550319][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6632.550607][ C0] ? rest_init+0x153/0x260 [ 6632.550848][ C0] ? skb_clone+0x10b/0x330 [ 6632.551087][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6632.551426][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6632.551751][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6632.552046][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6632.552355][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6632.552615][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6632.552857][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6632.553170][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6632.553468][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6632.553814][ C0] ? lock_acquire+0x1c1/0x220 [ 6632.554069][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6632.554383][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6632.554686][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6632.555014][ C0] ? __copy_skb_header+0xaf/0x490 [ 6632.555282][ C0] ? __skb_clone+0x57a/0x760 [ 6632.555530][ C0] netif_receive_skb+0x55/0x280 [ 6632.555792][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6632.556126][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6632.556476][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6632.556789][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6632.557081][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6632.557386][ C0] ? hlock_class+0x4e/0x130 [ 6632.557638][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6632.557969][ C0] ? place_entity+0x21/0x2f0 [ 6632.558219][ C0] ? resched_curr+0x219/0x280 [ 6632.558469][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6632.558736][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6632.559018][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6632.559299][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6632.559561][ C0] ? activate_task+0xf5/0x260 [ 6632.559816][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6632.560096][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6632.560369][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6632.560632][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6632.560924][ C0] ? get_stack_info+0x36/0xc0 [ 6632.561174][ C0] ? stack_access_ok+0xda/0x1f0 [ 6632.561429][ C0] ? get_reg+0x119/0x190 [ 6632.561656][ C0] __tcf_classify+0x32c/0x7d0 [ 6632.561914][ C0] tcf_classify+0x283/0x930 [ 6632.562164][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6632.562495][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6632.562762][ C0] ? arch_stack_walk+0x8c/0x100 [ 6632.563022][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6632.563311][ C0] tc_run+0x2e4/0x5d0 [ 6632.563533][ C0] ? __pfx_tc_run+0x10/0x10 [ 6632.563779][ C0] ? lock_acquire+0x1c1/0x220 [ 6632.564033][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6632.564319][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6632.564591][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6632.564872][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6632.565148][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6632.565473][ C0] ? neigh_hh_output+0x348/0x590 [ 6632.565741][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6632.566019][ C0] ip_finish_output2+0x786/0x18e0 [ 6632.566287][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6632.566578][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6632.566935][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6632.567228][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6632.567490][ C0] ? __ip_finish_output+0x10f/0x770 [ 6632.567771][ C0] ip_output+0x16b/0x4f0 [ 6632.568003][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6632.568287][ C0] ? __pfx_ip_output+0x10/0x10 [ 6632.568545][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6632.568844][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6632.569115][ C0] ? ip_local_out+0x114/0x3b0 [ 6632.569366][ C0] __ip_queue_xmit+0x672/0x1910 [ 6632.569626][ C0] ? __skb_clone+0x57a/0x760 [ 6632.569874][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6632.570163][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6632.570464][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6632.570783][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6632.571040][ C0] ? tcp_current_mss+0x40a/0x510 [ 6632.571308][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6632.571591][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6632.571871][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6632.572129][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6632.572395][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6632.572720][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6632.573000][ C0] ? ktime_get+0xb6/0x190 [ 6632.573236][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6632.573513][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6632.573795][ C0] tcp_write_timer+0x82/0x1d0 [ 6632.574053][ C0] call_timer_fn+0x176/0x430 [ 6632.574308][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6632.574585][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6632.574858][ C0] __run_timers.part.0+0x52d/0x890 [ 6632.575133][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6632.575414][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6632.575716][ C0] ? lock_acquire+0x1c1/0x220 [ 6632.575965][ C0] ? clockevents_program_event+0xf6/0x300 [ 6632.576269][ C0] ? lock_release+0x1d5/0x250 [ 6632.576517][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6632.576792][ C0] ? ktime_get+0xb6/0x190 [ 6632.577021][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6632.577320][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6632.577634][ C0] run_timer_softirq+0x72/0x100 [ 6632.577893][ C0] __do_softirq+0x1bc/0x7ff [ 6632.578135][ C0] irq_exit_rcu+0x98/0xc0 [ 6632.578364][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6632.578661][ C0] [ 6632.578822][ C0] [ 6632.578983][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6632.579307][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6632.579574][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6632.580599][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6632.580920][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6632.581340][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6632.581759][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6632.582176][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6632.582595][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6632.583017][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6632.583320][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6632.583593][ C0] default_idle_call+0x69/0xa0 [ 6632.583850][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6632.584112][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6632.584414][ C0] ? lock_release+0x1d5/0x250 [ 6632.584667][ C0] do_idle+0xfb/0x160 [ 6632.584883][ C0] cpu_startup_entry+0x55/0x60 [ 6632.585143][ C0] rest_init+0x153/0x260 [ 6632.585369][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6632.585661][ C0] arch_call_rest_init+0x13/0x40 [ 6632.585930][ C0] start_kernel+0x314/0x3d0 [ 6632.586172][ C0] x86_64_start_reservations+0x18/0x30 [ 6632.586462][ C0] x86_64_start_kernel+0xba/0x110 [ 6632.586739][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6632.587073][ C0] [ 6632.587241][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5071s! [ksoftirqd/1:22] [ 6632.587709][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6632.588914][ C1] irq event stamp: 3886976 [ 6632.589153][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6632.589650][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6632.590145][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6632.590642][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6632.591137][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6632.591630][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6632.592275][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6632.592615][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6632.593637][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6632.593960][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6632.594386][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6632.594812][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6632.595240][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6632.595661][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6632.596085][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6632.596560][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6632.596908][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6632.597332][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6632.597751][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6632.598171][ C1] Call Trace: [ 6632.598350][ C1] [ 6632.598508][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6632.598785][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6632.599038][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6632.599334][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6632.599620][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6632.599921][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6632.600200][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6632.600520][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6632.600798][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6632.601123][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6632.601431][ C1] [ 6632.601591][ C1] [ 6632.601752][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6632.602088][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6632.602391][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6632.602699][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6632.603003][ C1] ? run_ksoftirqd+0xb/0x60 [ 6632.603250][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6632.603584][ C1] ? __orc_find+0x9c/0xf0 [ 6632.603817][ C1] ? lock_acquire+0x1c1/0x220 [ 6632.604071][ C1] ? irqentry_enter+0x2b/0x60 [ 6632.604328][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6632.604592][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6632.604880][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6632.605180][ C1] ? lock_acquire+0x1c1/0x220 [ 6632.605427][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6632.605676][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6632.605947][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6632.606198][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6632.606461][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6632.606738][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6632.607032][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6632.607328][ C1] ip_local_deliver+0x19d/0x480 [ 6632.607588][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6632.607874][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6632.608139][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6632.608420][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6632.608685][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6632.609019][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6632.609299][ C1] ip_rcv+0x564/0x740 [ 6632.609514][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6632.609758][ C1] ? set_track_prepare+0x8a/0xd0 [ 6632.610025][ C1] ? irqentry_enter+0x2b/0x60 [ 6632.610274][ C1] ? irqentry_enter+0x2b/0x60 [ 6632.610522][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6632.610762][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6632.611080][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6632.611419][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6632.611727][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6632.612073][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6632.612376][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6632.612709][ C1] netif_receive_skb+0x55/0x280 [ 6632.612969][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6632.613298][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6632.613646][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6632.613965][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6632.614256][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6632.614566][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6632.614902][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6632.615190][ C1] ? arch_stack_walk+0x68/0x100 [ 6632.615450][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6632.615726][ C1] ? irqentry_enter+0x2b/0x60 [ 6632.615975][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6632.616295][ C1] ? irqentry_enter+0x2b/0x60 [ 6632.616549][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6632.616877][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6632.617159][ C1] ? arch_stack_walk+0x68/0x100 [ 6632.617426][ C1] __tcf_classify+0x32c/0x7d0 [ 6632.617684][ C1] tcf_classify+0x283/0x930 [ 6632.617932][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6632.618206][ C1] tc_run+0x2e4/0x5d0 [ 6632.618424][ C1] ? __pfx_tc_run+0x10/0x10 [ 6632.618671][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6632.618943][ C1] ? irqentry_enter+0x2b/0x60 [ 6632.619194][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6632.619477][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6632.619798][ C1] ip_finish_output2+0x786/0x18e0 [ 6632.620073][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6632.620369][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6632.620634][ C1] ? __ip_finish_output+0x10f/0x770 [ 6632.620916][ C1] ip_output+0x16b/0x4f0 [ 6632.621146][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6632.621462][ C1] ? __pfx_ip_output+0x10/0x10 [ 6632.621721][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6632.622075][ C1] ? __pfx_ip_output+0x10/0x10 [ 6632.622334][ C1] __ip_queue_xmit+0x672/0x1910 [ 6632.622600][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6632.622885][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6632.623186][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6632.623475][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6632.623773][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6632.624062][ C1] tcp_delack_timer+0x84/0x240 [ 6632.624325][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6632.624614][ C1] call_timer_fn+0x176/0x430 [ 6632.624865][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6632.625141][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6632.625430][ C1] __run_timers.part.0+0x52d/0x890 [ 6632.625706][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6632.625992][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6632.626292][ C1] ? __pfx___schedule+0x10/0x10 [ 6632.626558][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6632.626879][ C1] run_timer_softirq+0x72/0x100 [ 6632.627140][ C1] __do_softirq+0x1bc/0x7ff [ 6632.627382][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6632.627655][ C1] run_ksoftirqd+0x2e/0x60 [ 6632.627897][ C1] smpboot_thread_fn+0x30e/0x840 [ 6632.628163][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6632.628456][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6632.628743][ C1] kthread+0x292/0x360 [ 6632.628966][ C1] ? __pfx_kthread+0x10/0x10 [ 6632.629214][ C1] ret_from_fork+0x34/0x70 [ 6632.629455][ C1] ? __pfx_kthread+0x10/0x10 [ 6632.629700][ C1] ret_from_fork_asm+0x1b/0x30 [ 6632.629961][ C1] [ 6660.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5097s! [swapper/0:0] [ 6660.527931][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6660.529135][ C0] irq event stamp: 27567077 [ 6660.529379][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6660.529912][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6660.530386][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6660.530894][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6660.531387][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6660.531867][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6660.532515][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6660.532864][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6660.533899][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6660.534229][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6660.534647][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6660.535066][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6660.535483][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6660.535900][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6660.536322][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6660.536792][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6660.537144][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6660.537565][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6660.537995][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6660.538421][ C0] Call Trace: [ 6660.538602][ C0] [ 6660.538759][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6660.539036][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6660.539296][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6660.539593][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6660.539883][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6660.540188][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6660.540470][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6660.540795][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6660.541068][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6660.541348][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6660.541672][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6660.541983][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6660.542319][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6660.542622][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6660.542931][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6660.543238][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6660.543569][ C0] ? get_stack_info+0x36/0xc0 [ 6660.543822][ C0] ? lock_acquire+0x1c1/0x220 [ 6660.544074][ C0] ? lock_release+0x1d5/0x250 [ 6660.544331][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6660.544594][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6660.544881][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6660.545184][ C0] ? lock_acquire+0x1c1/0x220 [ 6660.545434][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6660.545689][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6660.545961][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6660.546211][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6660.546472][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6660.546747][ C0] ? __inet_lookup_established+0x341/0x610 [ 6660.547065][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6660.547354][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6660.547641][ C0] ip_local_deliver+0x19d/0x480 [ 6660.547906][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6660.548196][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6660.548466][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6660.548743][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6660.549006][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6660.549345][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6660.549619][ C0] ip_rcv+0x564/0x740 [ 6660.549833][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6660.550076][ C0] ? set_track_prepare+0x8a/0xd0 [ 6660.550341][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6660.550632][ C0] ? rest_init+0x153/0x260 [ 6660.550870][ C0] ? skb_clone+0x10b/0x330 [ 6660.551113][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6660.551444][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6660.551762][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6660.552060][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6660.552373][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6660.552635][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6660.552880][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6660.553197][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6660.553498][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6660.553838][ C0] ? lock_acquire+0x1c1/0x220 [ 6660.554087][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6660.554403][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6660.554700][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6660.555038][ C0] ? __copy_skb_header+0xaf/0x490 [ 6660.555310][ C0] ? __skb_clone+0x57a/0x760 [ 6660.555559][ C0] netif_receive_skb+0x55/0x280 [ 6660.555817][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6660.556152][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6660.556498][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6660.556816][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6660.557105][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6660.557406][ C0] ? hlock_class+0x4e/0x130 [ 6660.557652][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6660.557979][ C0] ? place_entity+0x21/0x2f0 [ 6660.558225][ C0] ? resched_curr+0x219/0x280 [ 6660.558480][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6660.558753][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6660.559038][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6660.559314][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6660.559571][ C0] ? activate_task+0xf5/0x260 [ 6660.559822][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6660.560097][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6660.560375][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6660.560634][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6660.560922][ C0] ? get_stack_info+0x36/0xc0 [ 6660.561176][ C0] ? stack_access_ok+0xda/0x1f0 [ 6660.561439][ C0] ? get_reg+0x119/0x190 [ 6660.561672][ C0] __tcf_classify+0x32c/0x7d0 [ 6660.561928][ C0] tcf_classify+0x283/0x930 [ 6660.562171][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6660.562499][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6660.562768][ C0] ? arch_stack_walk+0x8c/0x100 [ 6660.563033][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6660.563327][ C0] tc_run+0x2e4/0x5d0 [ 6660.563544][ C0] ? __pfx_tc_run+0x10/0x10 [ 6660.563787][ C0] ? lock_acquire+0x1c1/0x220 [ 6660.564036][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6660.564319][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6660.564583][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6660.564872][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6660.565154][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6660.565478][ C0] ? neigh_hh_output+0x348/0x590 [ 6660.565742][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6660.566032][ C0] ip_finish_output2+0x786/0x18e0 [ 6660.566304][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6660.566601][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6660.566953][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6660.567245][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6660.567512][ C0] ? __ip_finish_output+0x10f/0x770 [ 6660.567788][ C0] ip_output+0x16b/0x4f0 [ 6660.568014][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6660.568300][ C0] ? __pfx_ip_output+0x10/0x10 [ 6660.568555][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6660.568856][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6660.569120][ C0] ? ip_local_out+0x114/0x3b0 [ 6660.569377][ C0] __ip_queue_xmit+0x672/0x1910 [ 6660.569641][ C0] ? __skb_clone+0x57a/0x760 [ 6660.569890][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6660.570171][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6660.570466][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6660.570783][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6660.571045][ C0] ? tcp_current_mss+0x40a/0x510 [ 6660.571308][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6660.571591][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6660.571871][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6660.572126][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6660.572397][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6660.572719][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6660.572995][ C0] ? ktime_get+0xb6/0x190 [ 6660.573227][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6660.573498][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6660.573781][ C0] tcp_write_timer+0x82/0x1d0 [ 6660.574033][ C0] call_timer_fn+0x176/0x430 [ 6660.574288][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6660.574562][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6660.574838][ C0] __run_timers.part.0+0x52d/0x890 [ 6660.575112][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6660.575397][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6660.575694][ C0] ? lock_acquire+0x1c1/0x220 [ 6660.575948][ C0] ? clockevents_program_event+0xf6/0x300 [ 6660.576258][ C0] ? lock_release+0x1d5/0x250 [ 6660.576510][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6660.576790][ C0] ? ktime_get+0xb6/0x190 [ 6660.577029][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6660.577330][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6660.577641][ C0] run_timer_softirq+0x72/0x100 [ 6660.577906][ C0] __do_softirq+0x1bc/0x7ff [ 6660.578153][ C0] irq_exit_rcu+0x98/0xc0 [ 6660.578388][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6660.578692][ C0] [ 6660.578848][ C0] [ 6660.579006][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6660.579324][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6660.579598][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6660.580622][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6660.580947][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6660.581374][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6660.581799][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6660.582222][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6660.582647][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6660.583077][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6660.583383][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6660.583659][ C0] default_idle_call+0x69/0xa0 [ 6660.583914][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6660.584185][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6660.584480][ C0] ? lock_release+0x1d5/0x250 [ 6660.584728][ C0] do_idle+0xfb/0x160 [ 6660.584941][ C0] cpu_startup_entry+0x55/0x60 [ 6660.585197][ C0] rest_init+0x153/0x260 [ 6660.585423][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6660.585709][ C0] arch_call_rest_init+0x13/0x40 [ 6660.585976][ C0] start_kernel+0x314/0x3d0 [ 6660.586223][ C0] x86_64_start_reservations+0x18/0x30 [ 6660.586519][ C0] x86_64_start_kernel+0xba/0x110 [ 6660.586786][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6660.587114][ C0] [ 6660.587279][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5097s! [ksoftirqd/1:22] [ 6660.587756][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6660.588953][ C1] irq event stamp: 3886976 [ 6660.589192][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6660.589695][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6660.590199][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6660.590702][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6660.591193][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6660.591690][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6660.592343][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6660.592689][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6660.593718][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6660.594043][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6660.594473][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6660.594891][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6660.595309][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6660.595726][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6660.596147][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6660.596618][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6660.596971][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6660.597396][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6660.597821][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6660.598243][ C1] Call Trace: [ 6660.598422][ C1] [ 6660.598583][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6660.598859][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6660.599121][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6660.599411][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6660.599699][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6660.600004][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6660.600287][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6660.600612][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6660.600886][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6660.601214][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6660.601529][ C1] [ 6660.601685][ C1] [ 6660.601844][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6660.602176][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6660.602483][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6660.602797][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6660.603101][ C1] ? run_ksoftirqd+0xb/0x60 [ 6660.603345][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6660.603670][ C1] ? __orc_find+0x9c/0xf0 [ 6660.603904][ C1] ? lock_acquire+0x1c1/0x220 [ 6660.604164][ C1] ? irqentry_enter+0x2b/0x60 [ 6660.604417][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6660.604675][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6660.604957][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6660.605258][ C1] ? lock_acquire+0x1c1/0x220 [ 6660.605512][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6660.605769][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6660.606044][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6660.606289][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6660.606545][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6660.606815][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6660.607106][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6660.607396][ C1] ip_local_deliver+0x19d/0x480 [ 6660.607656][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6660.607943][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6660.608211][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6660.608486][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6660.608749][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6660.609088][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6660.609362][ C1] ip_rcv+0x564/0x740 [ 6660.609575][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6660.609815][ C1] ? set_track_prepare+0x8a/0xd0 [ 6660.610081][ C1] ? irqentry_enter+0x2b/0x60 [ 6660.610336][ C1] ? irqentry_enter+0x2b/0x60 [ 6660.610594][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6660.610838][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6660.611157][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6660.611499][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6660.611821][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6660.612151][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6660.612440][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6660.612786][ C1] netif_receive_skb+0x55/0x280 [ 6660.613049][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6660.613379][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6660.613731][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6660.614044][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6660.614341][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6660.614644][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6660.614974][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6660.615259][ C1] ? arch_stack_walk+0x68/0x100 [ 6660.615524][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6660.615805][ C1] ? irqentry_enter+0x2b/0x60 [ 6660.616061][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6660.616382][ C1] ? irqentry_enter+0x2b/0x60 [ 6660.616632][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6660.616953][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6660.617238][ C1] ? arch_stack_walk+0x68/0x100 [ 6660.617500][ C1] __tcf_classify+0x32c/0x7d0 [ 6660.617752][ C1] tcf_classify+0x283/0x930 [ 6660.617994][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6660.618265][ C1] tc_run+0x2e4/0x5d0 [ 6660.618481][ C1] ? __pfx_tc_run+0x10/0x10 [ 6660.618724][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6660.618992][ C1] ? irqentry_enter+0x2b/0x60 [ 6660.619250][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6660.619541][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6660.619864][ C1] ip_finish_output2+0x786/0x18e0 [ 6660.620136][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6660.620427][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6660.620693][ C1] ? __ip_finish_output+0x10f/0x770 [ 6660.620970][ C1] ip_output+0x16b/0x4f0 [ 6660.621205][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6660.621524][ C1] ? __pfx_ip_output+0x10/0x10 [ 6660.621779][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6660.622138][ C1] ? __pfx_ip_output+0x10/0x10 [ 6660.622397][ C1] __ip_queue_xmit+0x672/0x1910 [ 6660.622657][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6660.622936][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6660.623232][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6660.623516][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6660.623811][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6660.624099][ C1] tcp_delack_timer+0x84/0x240 [ 6660.624362][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6660.624653][ C1] call_timer_fn+0x176/0x430 [ 6660.624902][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6660.625181][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6660.625459][ C1] __run_timers.part.0+0x52d/0x890 [ 6660.625732][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6660.626024][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6660.626329][ C1] ? __pfx___schedule+0x10/0x10 [ 6660.626591][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6660.626912][ C1] run_timer_softirq+0x72/0x100 [ 6660.627175][ C1] __do_softirq+0x1bc/0x7ff [ 6660.627422][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6660.627697][ C1] run_ksoftirqd+0x2e/0x60 [ 6660.627934][ C1] smpboot_thread_fn+0x30e/0x840 [ 6660.628201][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6660.628490][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6660.628784][ C1] kthread+0x292/0x360 [ 6660.629003][ C1] ? __pfx_kthread+0x10/0x10 [ 6660.629252][ C1] ret_from_fork+0x34/0x70 [ 6660.629490][ C1] ? __pfx_kthread+0x10/0x10 [ 6660.629738][ C1] ret_from_fork_asm+0x1b/0x30 [ 6660.629996][ C1] [ 6686.310024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6686.310409][ C0] rcu: 0-....: (5484202 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1296232 [ 6686.310934][ C0] rcu: (t=5492001 jiffies g=1007429 q=31 ncpus=4) [ 6686.311284][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6686.311763][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6686.312413][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6686.312763][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6686.313796][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6686.314128][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6686.314547][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6686.314967][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6686.315387][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6686.315805][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6686.316224][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6686.316695][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6686.317047][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6686.317469][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6686.317895][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6686.318323][ C0] Call Trace: [ 6686.318503][ C0] [ 6686.318660][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6686.318948][ C0] ? print_cpu_stall+0x263/0x6a0 [ 6686.319215][ C0] ? check_cpu_stall+0x284/0x500 [ 6686.319477][ C0] ? rcu_pending+0x92/0x360 [ 6686.319722][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6686.320008][ C0] ? update_process_times+0xb9/0x110 [ 6686.320289][ C0] ? tick_sched_handle+0x67/0x130 [ 6686.320561][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6686.320864][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6686.321119][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6686.321450][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6686.321736][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6686.322037][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6686.322314][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6686.322635][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6686.322911][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6686.323187][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6686.323518][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6686.323830][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6686.324178][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6686.324480][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6686.324789][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6686.325094][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6686.325424][ C0] ? get_stack_info+0x36/0xc0 [ 6686.325676][ C0] ? lock_acquire+0x1c1/0x220 [ 6686.325926][ C0] ? lock_release+0x1d5/0x250 [ 6686.326175][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6686.326433][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6686.326716][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6686.327018][ C0] ? lock_acquire+0x1c1/0x220 [ 6686.327275][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6686.327532][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6686.327808][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6686.328053][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6686.328309][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6686.328577][ C0] ? __inet_lookup_established+0x341/0x610 [ 6686.328887][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6686.329180][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6686.329471][ C0] ip_local_deliver+0x19d/0x480 [ 6686.329729][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6686.330013][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6686.330280][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6686.330561][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6686.330827][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6686.331162][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6686.331442][ C0] ip_rcv+0x564/0x740 [ 6686.331657][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6686.331904][ C0] ? set_track_prepare+0x8a/0xd0 [ 6686.332177][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6686.332463][ C0] ? rest_init+0x153/0x260 [ 6686.332703][ C0] ? skb_clone+0x10b/0x330 [ 6686.332942][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6686.333279][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6686.333601][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6686.333894][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6686.334207][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6686.334475][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6686.334720][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6686.335036][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6686.335339][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6686.335683][ C0] ? lock_acquire+0x1c1/0x220 [ 6686.335933][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6686.336241][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6686.336543][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6686.336873][ C0] ? __copy_skb_header+0xaf/0x490 [ 6686.337140][ C0] ? __skb_clone+0x57a/0x760 [ 6686.337384][ C0] netif_receive_skb+0x55/0x280 [ 6686.337645][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6686.337975][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6686.338327][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6686.338638][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6686.338934][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6686.339237][ C0] ? hlock_class+0x4e/0x130 [ 6686.339487][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6686.339819][ C0] ? place_entity+0x21/0x2f0 [ 6686.340068][ C0] ? resched_curr+0x219/0x280 [ 6686.340317][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6686.340583][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6686.340866][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6686.341147][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6686.341411][ C0] ? activate_task+0xf5/0x260 [ 6686.341671][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6686.341947][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6686.342218][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6686.342479][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6686.342771][ C0] ? get_stack_info+0x36/0xc0 [ 6686.343019][ C0] ? stack_access_ok+0xda/0x1f0 [ 6686.343276][ C0] ? get_reg+0x119/0x190 [ 6686.343502][ C0] __tcf_classify+0x32c/0x7d0 [ 6686.343755][ C0] tcf_classify+0x283/0x930 [ 6686.344000][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6686.344336][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6686.344604][ C0] ? arch_stack_walk+0x8c/0x100 [ 6686.344869][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6686.345169][ C0] tc_run+0x2e4/0x5d0 [ 6686.345385][ C0] ? __pfx_tc_run+0x10/0x10 [ 6686.345628][ C0] ? lock_acquire+0x1c1/0x220 [ 6686.345877][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6686.346151][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6686.346420][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6686.346709][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6686.346985][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6686.347301][ C0] ? neigh_hh_output+0x348/0x590 [ 6686.347567][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6686.347842][ C0] ip_finish_output2+0x786/0x18e0 [ 6686.348109][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6686.348407][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6686.348760][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6686.349051][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6686.349315][ C0] ? __ip_finish_output+0x10f/0x770 [ 6686.349595][ C0] ip_output+0x16b/0x4f0 [ 6686.349825][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6686.350104][ C0] ? __pfx_ip_output+0x10/0x10 [ 6686.350361][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6686.350658][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6686.350924][ C0] ? ip_local_out+0x114/0x3b0 [ 6686.351175][ C0] __ip_queue_xmit+0x672/0x1910 [ 6686.351434][ C0] ? __skb_clone+0x57a/0x760 [ 6686.351677][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6686.351961][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6686.352259][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6686.352582][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6686.352842][ C0] ? tcp_current_mss+0x40a/0x510 [ 6686.353109][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6686.353388][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6686.353668][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6686.353924][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6686.354202][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6686.354524][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6686.354801][ C0] ? ktime_get+0xb6/0x190 [ 6686.355031][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6686.355301][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6686.355589][ C0] tcp_write_timer+0x82/0x1d0 [ 6686.355839][ C0] call_timer_fn+0x176/0x430 [ 6686.356087][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6686.356361][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6686.356632][ C0] __run_timers.part.0+0x52d/0x890 [ 6686.356907][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6686.357189][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6686.357492][ C0] ? lock_acquire+0x1c1/0x220 [ 6686.357741][ C0] ? clockevents_program_event+0xf6/0x300 [ 6686.358045][ C0] ? lock_release+0x1d5/0x250 [ 6686.358291][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6686.358565][ C0] ? ktime_get+0xb6/0x190 [ 6686.358798][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6686.359096][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6686.359411][ C0] run_timer_softirq+0x72/0x100 [ 6686.359670][ C0] __do_softirq+0x1bc/0x7ff [ 6686.359913][ C0] irq_exit_rcu+0x98/0xc0 [ 6686.360143][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6686.360441][ C0] [ 6686.360599][ C0] [ 6686.360758][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6686.361077][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6686.361343][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6686.362360][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6686.362683][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6686.363102][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6686.363518][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6686.363935][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6686.364375][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6686.364804][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6686.365111][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6686.365387][ C0] default_idle_call+0x69/0xa0 [ 6686.365641][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6686.365905][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6686.366199][ C0] ? lock_release+0x1d5/0x250 [ 6686.366454][ C0] do_idle+0xfb/0x160 [ 6686.366675][ C0] cpu_startup_entry+0x55/0x60 [ 6686.366931][ C0] rest_init+0x153/0x260 [ 6686.367155][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6686.367448][ C0] arch_call_rest_init+0x13/0x40 [ 6686.367719][ C0] start_kernel+0x314/0x3d0 [ 6686.367962][ C0] x86_64_start_reservations+0x18/0x30 [ 6686.368255][ C0] x86_64_start_kernel+0xba/0x110 [ 6686.368529][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6686.368862][ C0] [ 6686.369028][ C0] Sending NMI from CPU 0 to CPUs 1: [ 6686.369317][ C1] NMI backtrace for cpu 1 [ 6686.369325][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6686.369329][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6686.369332][ C1] RIP: 0010:kasan_check_range+0x106/0x1c0 [ 6686.369341][ C1] Code: 00 74 f2 48 89 c2 b8 01 00 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff <5b> b8 01 00 00 00 5d 41 5c c3 cc cc cc cc 41 bc 08 00 00 00 45 29 [ 6686.369344][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000246 [ 6686.369348][ C1] RAX: ffffed10014131c4 RBX: ffffed10014131c4 RCX: ffffffff90c7aaa0 [ 6686.369350][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6686.369352][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: ffffed10014131c3 [ 6686.369354][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6686.369356][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6686.369358][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6686.369360][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6686.369364][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6686.369366][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6686.369367][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6686.369368][ C1] Call Trace: [ 6686.369371][ C1] [ 6686.369375][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 6686.369381][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6686.369387][ C1] ? nmi_handle+0x156/0x420 [ 6686.369393][ C1] ? default_do_nmi+0x41/0x100 [ 6686.369397][ C1] ? exc_nmi+0xf3/0x120 [ 6686.369399][ C1] ? end_repeat_nmi+0xf/0x60 [ 6686.369404][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6686.369410][ C1] ? kasan_check_range+0x106/0x1c0 [ 6686.369413][ C1] ? kasan_check_range+0x106/0x1c0 [ 6686.369417][ C1] ? kasan_check_range+0x106/0x1c0 [ 6686.369420][ C1] [ 6686.369421][ C1] [ 6686.369423][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 6686.369426][ C1] ? run_ksoftirqd+0xb/0x60 [ 6686.369431][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6686.369434][ C1] ? __orc_find+0x9c/0xf0 [ 6686.369438][ C1] ? lock_acquire+0x1c1/0x220 [ 6686.369442][ C1] ? irqentry_enter+0x2b/0x60 [ 6686.369447][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6686.369451][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6686.369454][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6686.369457][ C1] ? lock_acquire+0x1c1/0x220 [ 6686.369460][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6686.369465][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6686.369469][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6686.369476][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6686.369479][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6686.369485][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6686.369492][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6686.369496][ C1] ip_local_deliver+0x19d/0x480 [ 6686.369499][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6686.369502][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6686.369506][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6686.369511][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6686.369513][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6686.369517][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6686.369527][ C1] ip_rcv+0x564/0x740 [ 6686.369530][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6686.369533][ C1] ? set_track_prepare+0x8a/0xd0 [ 6686.369538][ C1] ? irqentry_enter+0x2b/0x60 [ 6686.369541][ C1] ? irqentry_enter+0x2b/0x60 [ 6686.369545][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6686.369548][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6686.369552][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6686.369555][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6686.369558][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6686.369561][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6686.369564][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6686.369569][ C1] netif_receive_skb+0x55/0x280 [ 6686.369572][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6686.369581][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6686.369588][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6686.369596][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6686.369603][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6686.369615][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6686.369625][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6686.369627][ C1] ? arch_stack_walk+0x68/0x100 [ 6686.369633][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6686.369636][ C1] ? irqentry_enter+0x2b/0x60 [ 6686.369640][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6686.369644][ C1] ? irqentry_enter+0x2b/0x60 [ 6686.369648][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6686.369655][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6686.369658][ C1] ? arch_stack_walk+0x68/0x100 [ 6686.369662][ C1] __tcf_classify+0x32c/0x7d0 [ 6686.369667][ C1] tcf_classify+0x283/0x930 [ 6686.369671][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6686.369676][ C1] tc_run+0x2e4/0x5d0 [ 6686.369681][ C1] ? __pfx_tc_run+0x10/0x10 [ 6686.369686][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6686.369692][ C1] ? irqentry_enter+0x2b/0x60 [ 6686.369695][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6686.369698][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6686.369706][ C1] ip_finish_output2+0x786/0x18e0 [ 6686.369711][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6686.369714][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6686.369718][ C1] ? __ip_finish_output+0x10f/0x770 [ 6686.369722][ C1] ip_output+0x16b/0x4f0 [ 6686.369725][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6686.369729][ C1] ? __pfx_ip_output+0x10/0x10 [ 6686.369733][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6686.369740][ C1] ? __pfx_ip_output+0x10/0x10 [ 6686.369744][ C1] __ip_queue_xmit+0x672/0x1910 [ 6686.369750][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6686.369757][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6686.369762][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6686.369765][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6686.369769][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6686.369772][ C1] tcp_delack_timer+0x84/0x240 [ 6686.369776][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6686.369779][ C1] call_timer_fn+0x176/0x430 [ 6686.369784][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6686.369789][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6686.369793][ C1] __run_timers.part.0+0x52d/0x890 [ 6686.369796][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6686.369800][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6686.369805][ C1] ? __pfx___schedule+0x10/0x10 [ 6686.369808][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6686.369813][ C1] run_timer_softirq+0x72/0x100 [ 6686.369817][ C1] __do_softirq+0x1bc/0x7ff [ 6686.369821][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6686.369825][ C1] run_ksoftirqd+0x2e/0x60 [ 6686.369828][ C1] smpboot_thread_fn+0x30e/0x840 [ 6686.369832][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6686.369836][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6686.369839][ C1] kthread+0x292/0x360 [ 6686.369841][ C1] ? __pfx_kthread+0x10/0x10 [ 6686.369844][ C1] ret_from_fork+0x34/0x70 [ 6686.369847][ C1] ? __pfx_kthread+0x10/0x10 [ 6686.369849][ C1] ret_from_fork_asm+0x1b/0x30 [ 6686.369857][ C1] [ 6712.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5145s! [swapper/0:0] [ 6712.527924][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6712.529116][ C0] irq event stamp: 27567077 [ 6712.529359][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6712.529890][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6712.530370][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6712.530881][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6712.531394][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6712.531877][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6712.532533][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6712.532883][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6712.533918][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6712.534247][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6712.534668][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6712.535090][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6712.535509][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6712.535929][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6712.536350][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6712.536822][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6712.537174][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6712.537597][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6712.538023][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6712.538449][ C0] Call Trace: [ 6712.538634][ C0] [ 6712.538792][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6712.539069][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6712.539329][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6712.539621][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6712.539912][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6712.540218][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6712.540500][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6712.540827][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6712.541101][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6712.541381][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6712.541706][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6712.542017][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6712.542358][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6712.542660][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6712.542970][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6712.543276][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6712.543610][ C0] ? get_stack_info+0x36/0xc0 [ 6712.543862][ C0] ? lock_acquire+0x1c1/0x220 [ 6712.544122][ C0] ? lock_release+0x1d5/0x250 [ 6712.544375][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6712.544636][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6712.544926][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6712.545228][ C0] ? lock_acquire+0x1c1/0x220 [ 6712.545477][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6712.545732][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6712.546004][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6712.546256][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6712.546516][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6712.546790][ C0] ? __inet_lookup_established+0x341/0x610 [ 6712.547107][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6712.547395][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6712.547682][ C0] ip_local_deliver+0x19d/0x480 [ 6712.547944][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6712.548234][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6712.548506][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6712.548783][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6712.549046][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6712.549385][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6712.549659][ C0] ip_rcv+0x564/0x740 [ 6712.549873][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6712.550117][ C0] ? set_track_prepare+0x8a/0xd0 [ 6712.550382][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6712.550673][ C0] ? rest_init+0x153/0x260 [ 6712.550910][ C0] ? skb_clone+0x10b/0x330 [ 6712.551153][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6712.551484][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6712.551801][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6712.552099][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6712.552413][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6712.552678][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6712.552924][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6712.553240][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6712.553542][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6712.553881][ C0] ? lock_acquire+0x1c1/0x220 [ 6712.554142][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6712.554454][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6712.554752][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6712.555088][ C0] ? __copy_skb_header+0xaf/0x490 [ 6712.555361][ C0] ? __skb_clone+0x57a/0x760 [ 6712.555611][ C0] netif_receive_skb+0x55/0x280 [ 6712.555870][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6712.556200][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6712.556551][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6712.556869][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6712.557159][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6712.557459][ C0] ? hlock_class+0x4e/0x130 [ 6712.557706][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6712.558035][ C0] ? place_entity+0x21/0x2f0 [ 6712.558279][ C0] ? resched_curr+0x219/0x280 [ 6712.558533][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6712.558805][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6712.559092][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6712.559368][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6712.559625][ C0] ? activate_task+0xf5/0x260 [ 6712.559878][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6712.560154][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6712.560430][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6712.560690][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6712.560977][ C0] ? get_stack_info+0x36/0xc0 [ 6712.561233][ C0] ? stack_access_ok+0xda/0x1f0 [ 6712.561494][ C0] ? get_reg+0x119/0x190 [ 6712.561726][ C0] __tcf_classify+0x32c/0x7d0 [ 6712.561976][ C0] tcf_classify+0x283/0x930 [ 6712.562217][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6712.562546][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6712.562816][ C0] ? arch_stack_walk+0x8c/0x100 [ 6712.563082][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6712.563377][ C0] tc_run+0x2e4/0x5d0 [ 6712.563593][ C0] ? __pfx_tc_run+0x10/0x10 [ 6712.563836][ C0] ? lock_acquire+0x1c1/0x220 [ 6712.564091][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6712.564370][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6712.564635][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6712.564926][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6712.565207][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6712.565536][ C0] ? neigh_hh_output+0x348/0x590 [ 6712.565800][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6712.566082][ C0] ip_finish_output2+0x786/0x18e0 [ 6712.566354][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6712.566656][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6712.567008][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6712.567297][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6712.567564][ C0] ? __ip_finish_output+0x10f/0x770 [ 6712.567841][ C0] ip_output+0x16b/0x4f0 [ 6712.568069][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6712.568354][ C0] ? __pfx_ip_output+0x10/0x10 [ 6712.568609][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6712.568911][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6712.569175][ C0] ? ip_local_out+0x114/0x3b0 [ 6712.569432][ C0] __ip_queue_xmit+0x672/0x1910 [ 6712.569696][ C0] ? __skb_clone+0x57a/0x760 [ 6712.569945][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6712.570227][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6712.570522][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6712.570841][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6712.571103][ C0] ? tcp_current_mss+0x40a/0x510 [ 6712.571367][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6712.571651][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6712.571929][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6712.572185][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6712.572456][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6712.572779][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6712.573057][ C0] ? ktime_get+0xb6/0x190 [ 6712.573288][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6712.573561][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6712.573848][ C0] tcp_write_timer+0x82/0x1d0 [ 6712.574110][ C0] call_timer_fn+0x176/0x430 [ 6712.574362][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6712.574635][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6712.574911][ C0] __run_timers.part.0+0x52d/0x890 [ 6712.575184][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6712.575471][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6712.575774][ C0] ? lock_acquire+0x1c1/0x220 [ 6712.576029][ C0] ? clockevents_program_event+0xf6/0x300 [ 6712.576339][ C0] ? lock_release+0x1d5/0x250 [ 6712.576591][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6712.576871][ C0] ? ktime_get+0xb6/0x190 [ 6712.577105][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6712.577406][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6712.577718][ C0] run_timer_softirq+0x72/0x100 [ 6712.577982][ C0] __do_softirq+0x1bc/0x7ff [ 6712.578231][ C0] irq_exit_rcu+0x98/0xc0 [ 6712.578466][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6712.578770][ C0] [ 6712.578926][ C0] [ 6712.579084][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6712.579402][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6712.579676][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6712.580703][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6712.581029][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6712.581457][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6712.581879][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6712.582307][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6712.582736][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6712.583166][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6712.583472][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6712.583749][ C0] default_idle_call+0x69/0xa0 [ 6712.584010][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6712.584274][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6712.584569][ C0] ? lock_release+0x1d5/0x250 [ 6712.584817][ C0] do_idle+0xfb/0x160 [ 6712.585031][ C0] cpu_startup_entry+0x55/0x60 [ 6712.585287][ C0] rest_init+0x153/0x260 [ 6712.585513][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6712.585799][ C0] arch_call_rest_init+0x13/0x40 [ 6712.586066][ C0] start_kernel+0x314/0x3d0 [ 6712.586312][ C0] x86_64_start_reservations+0x18/0x30 [ 6712.586609][ C0] x86_64_start_kernel+0xba/0x110 [ 6712.586877][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6712.587206][ C0] [ 6712.587371][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5145s! [ksoftirqd/1:22] [ 6712.587842][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6712.589048][ C1] irq event stamp: 3886976 [ 6712.589288][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6712.589783][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6712.590278][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6712.590777][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6712.591282][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6712.591775][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6712.592421][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6712.592764][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6712.593787][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6712.594116][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6712.594540][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6712.594965][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6712.595392][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6712.595817][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6712.596240][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6712.596715][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6712.597062][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6712.597484][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6712.597903][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6712.598322][ C1] Call Trace: [ 6712.598502][ C1] [ 6712.598659][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6712.598937][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6712.599191][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6712.599487][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6712.599773][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6712.600076][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6712.600353][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6712.600674][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6712.600952][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6712.601278][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6712.601585][ C1] [ 6712.601746][ C1] [ 6712.601907][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6712.602244][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6712.602547][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6712.602856][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6712.603161][ C1] ? run_ksoftirqd+0xb/0x60 [ 6712.603409][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6712.603742][ C1] ? __orc_find+0x9c/0xf0 [ 6712.603982][ C1] ? lock_acquire+0x1c1/0x220 [ 6712.604239][ C1] ? irqentry_enter+0x2b/0x60 [ 6712.604497][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6712.604761][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6712.605050][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6712.605350][ C1] ? lock_acquire+0x1c1/0x220 [ 6712.605597][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6712.605847][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6712.606120][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6712.606370][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6712.606632][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6712.606906][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6712.607205][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6712.607499][ C1] ip_local_deliver+0x19d/0x480 [ 6712.607758][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6712.608043][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6712.608307][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6712.608586][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6712.608850][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6712.609184][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6712.609463][ C1] ip_rcv+0x564/0x740 [ 6712.609676][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6712.609922][ C1] ? set_track_prepare+0x8a/0xd0 [ 6712.610189][ C1] ? irqentry_enter+0x2b/0x60 [ 6712.610437][ C1] ? irqentry_enter+0x2b/0x60 [ 6712.610686][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6712.610926][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6712.611241][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6712.611580][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6712.611886][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6712.612230][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6712.612533][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6712.612864][ C1] netif_receive_skb+0x55/0x280 [ 6712.613124][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6712.613452][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6712.613798][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6712.614121][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6712.614415][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6712.614724][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6712.615057][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6712.615345][ C1] ? arch_stack_walk+0x68/0x100 [ 6712.615606][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6712.615882][ C1] ? irqentry_enter+0x2b/0x60 [ 6712.616132][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6712.616449][ C1] ? irqentry_enter+0x2b/0x60 [ 6712.616711][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6712.617040][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6712.617319][ C1] ? arch_stack_walk+0x68/0x100 [ 6712.617586][ C1] __tcf_classify+0x32c/0x7d0 [ 6712.617844][ C1] tcf_classify+0x283/0x930 [ 6712.618095][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6712.618369][ C1] tc_run+0x2e4/0x5d0 [ 6712.618584][ C1] ? __pfx_tc_run+0x10/0x10 [ 6712.618831][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6712.619101][ C1] ? irqentry_enter+0x2b/0x60 [ 6712.619348][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6712.619632][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6712.619953][ C1] ip_finish_output2+0x786/0x18e0 [ 6712.620228][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6712.620522][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6712.620786][ C1] ? __ip_finish_output+0x10f/0x770 [ 6712.621069][ C1] ip_output+0x16b/0x4f0 [ 6712.621296][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6712.621615][ C1] ? __pfx_ip_output+0x10/0x10 [ 6712.621875][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6712.622230][ C1] ? __pfx_ip_output+0x10/0x10 [ 6712.622488][ C1] __ip_queue_xmit+0x672/0x1910 [ 6712.622753][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6712.623039][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6712.623338][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6712.623626][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6712.623928][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6712.624215][ C1] tcp_delack_timer+0x84/0x240 [ 6712.624468][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6712.624755][ C1] call_timer_fn+0x176/0x430 [ 6712.625005][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6712.625280][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6712.625559][ C1] __run_timers.part.0+0x52d/0x890 [ 6712.625836][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6712.626123][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6712.626421][ C1] ? __pfx___schedule+0x10/0x10 [ 6712.626687][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6712.627007][ C1] run_timer_softirq+0x72/0x100 [ 6712.627268][ C1] __do_softirq+0x1bc/0x7ff [ 6712.627509][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6712.627782][ C1] run_ksoftirqd+0x2e/0x60 [ 6712.628024][ C1] smpboot_thread_fn+0x30e/0x840 [ 6712.628290][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6712.628583][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6712.628878][ C1] kthread+0x292/0x360 [ 6712.629102][ C1] ? __pfx_kthread+0x10/0x10 [ 6712.629348][ C1] ret_from_fork+0x34/0x70 [ 6712.629590][ C1] ? __pfx_kthread+0x10/0x10 [ 6712.629833][ C1] ret_from_fork_asm+0x1b/0x30 [ 6712.630097][ C1] [ 6740.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5171s! [swapper/0:0] [ 6740.527924][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6740.529132][ C0] irq event stamp: 27567077 [ 6740.529377][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6740.529913][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6740.530386][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6740.530890][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6740.531383][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6740.531862][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6740.532512][ C0] RIP: 0010:kasan_check_range+0x69/0x1c0 [ 6740.532820][ C0] Code: 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 <48> c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 [ 6740.533844][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000216 [ 6740.534172][ C0] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6740.534598][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6740.535024][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffff88800a099b5b [ 6740.535447][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6740.535869][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6740.536295][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6740.536772][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6740.537120][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6740.537550][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6740.537972][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6740.538391][ C0] Call Trace: [ 6740.538569][ C0] [ 6740.538725][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6740.539004][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6740.539261][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6740.539555][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6740.539841][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6740.540143][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6740.540420][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6740.540745][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6740.541019][ C0] ? hrtimer_interrupt+0x31a/0x770 [ 6740.541291][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6740.541571][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6740.541892][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6740.542204][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6740.542538][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6740.542841][ C0] ? kasan_check_range+0x69/0x1c0 [ 6740.543110][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 6740.543405][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6740.543732][ C0] ? get_stack_info+0x36/0xc0 [ 6740.543994][ C0] ? lock_acquire+0x1c1/0x220 [ 6740.544246][ C0] ? lock_release+0x1d5/0x250 [ 6740.544498][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6740.544758][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6740.545044][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6740.545341][ C0] ? lock_acquire+0x1c1/0x220 [ 6740.545592][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6740.545846][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6740.546123][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6740.546370][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6740.546629][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6740.546897][ C0] ? __inet_lookup_established+0x341/0x610 [ 6740.547213][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6740.547507][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6740.547801][ C0] ip_local_deliver+0x19d/0x480 [ 6740.548060][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6740.548344][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6740.548609][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6740.548891][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6740.549159][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6740.549495][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6740.549773][ C0] ip_rcv+0x564/0x740 [ 6740.549990][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6740.550237][ C0] ? set_track_prepare+0x8a/0xd0 [ 6740.550504][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6740.550794][ C0] ? rest_init+0x153/0x260 [ 6740.551033][ C0] ? skb_clone+0x10b/0x330 [ 6740.551272][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6740.551611][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6740.551937][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6740.552233][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6740.552539][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6740.552798][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6740.553038][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6740.553351][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6740.553649][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6740.553998][ C0] ? lock_acquire+0x1c1/0x220 [ 6740.554247][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6740.554556][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6740.554858][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6740.555189][ C0] ? __copy_skb_header+0xaf/0x490 [ 6740.555456][ C0] ? __skb_clone+0x57a/0x760 [ 6740.555702][ C0] netif_receive_skb+0x55/0x280 [ 6740.555968][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6740.556298][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6740.556650][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6740.556961][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6740.557252][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6740.557555][ C0] ? hlock_class+0x4e/0x130 [ 6740.557804][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6740.558139][ C0] ? place_entity+0x21/0x2f0 [ 6740.558388][ C0] ? resched_curr+0x219/0x280 [ 6740.558640][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6740.558906][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6740.559187][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6740.559467][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6740.559727][ C0] ? activate_task+0xf5/0x260 [ 6740.559982][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6740.560260][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6740.560533][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6740.560798][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6740.561093][ C0] ? get_stack_info+0x36/0xc0 [ 6740.561344][ C0] ? stack_access_ok+0xda/0x1f0 [ 6740.561602][ C0] ? get_reg+0x119/0x190 [ 6740.561830][ C0] __tcf_classify+0x32c/0x7d0 [ 6740.562088][ C0] tcf_classify+0x283/0x930 [ 6740.562334][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6740.562664][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6740.562931][ C0] ? arch_stack_walk+0x8c/0x100 [ 6740.563192][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6740.563479][ C0] tc_run+0x2e4/0x5d0 [ 6740.563698][ C0] ? __pfx_tc_run+0x10/0x10 [ 6740.563947][ C0] ? lock_acquire+0x1c1/0x220 [ 6740.564195][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6740.564475][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6740.564745][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6740.565029][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6740.565305][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6740.565623][ C0] ? neigh_hh_output+0x348/0x590 [ 6740.565893][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6740.566172][ C0] ip_finish_output2+0x786/0x18e0 [ 6740.566440][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6740.566730][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6740.567089][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6740.567385][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6740.567649][ C0] ? __ip_finish_output+0x10f/0x770 [ 6740.567929][ C0] ip_output+0x16b/0x4f0 [ 6740.568158][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6740.568441][ C0] ? __pfx_ip_output+0x10/0x10 [ 6740.568701][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6740.569002][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6740.569267][ C0] ? ip_local_out+0x114/0x3b0 [ 6740.569515][ C0] __ip_queue_xmit+0x672/0x1910 [ 6740.569775][ C0] ? __skb_clone+0x57a/0x760 [ 6740.570021][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6740.570307][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6740.570604][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6740.570926][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6740.571182][ C0] ? tcp_current_mss+0x40a/0x510 [ 6740.571448][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6740.571729][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6740.572009][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6740.572265][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6740.572532][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6740.572854][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6740.573135][ C0] ? ktime_get+0xb6/0x190 [ 6740.573369][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6740.573646][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6740.573932][ C0] tcp_write_timer+0x82/0x1d0 [ 6740.574181][ C0] call_timer_fn+0x176/0x430 [ 6740.574425][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6740.574703][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6740.574976][ C0] __run_timers.part.0+0x52d/0x890 [ 6740.575253][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6740.575533][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6740.575832][ C0] ? lock_acquire+0x1c1/0x220 [ 6740.576080][ C0] ? clockevents_program_event+0xf6/0x300 [ 6740.576383][ C0] ? lock_release+0x1d5/0x250 [ 6740.576633][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6740.576910][ C0] ? ktime_get+0xb6/0x190 [ 6740.577141][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6740.577439][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6740.577751][ C0] run_timer_softirq+0x72/0x100 [ 6740.578008][ C0] __do_softirq+0x1bc/0x7ff [ 6740.578251][ C0] irq_exit_rcu+0x98/0xc0 [ 6740.578481][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6740.578780][ C0] [ 6740.578940][ C0] [ 6740.579101][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6740.579428][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6740.579695][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6740.580708][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6740.581028][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6740.581446][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6740.581864][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6740.582285][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6740.582702][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6740.583124][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6740.583426][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6740.583699][ C0] default_idle_call+0x69/0xa0 [ 6740.583960][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6740.584228][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6740.584520][ C0] ? lock_release+0x1d5/0x250 [ 6740.584773][ C0] do_idle+0xfb/0x160 [ 6740.584991][ C0] cpu_startup_entry+0x55/0x60 [ 6740.585247][ C0] rest_init+0x153/0x260 [ 6740.585473][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6740.585762][ C0] arch_call_rest_init+0x13/0x40 [ 6740.586029][ C0] start_kernel+0x314/0x3d0 [ 6740.586270][ C0] x86_64_start_reservations+0x18/0x30 [ 6740.586559][ C0] x86_64_start_kernel+0xba/0x110 [ 6740.586832][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6740.587162][ C0] [ 6740.587331][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5171s! [ksoftirqd/1:22] [ 6740.587797][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6740.589000][ C1] irq event stamp: 3886976 [ 6740.589241][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6740.589736][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6740.590228][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6740.590722][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6740.591216][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6740.591709][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6740.592354][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6740.592694][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6740.593713][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6740.594064][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6740.594488][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6740.594911][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6740.595338][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6740.595764][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6740.596188][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6740.596658][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6740.597005][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6740.597427][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6740.597843][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6740.598260][ C1] Call Trace: [ 6740.598440][ C1] [ 6740.598593][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6740.598873][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6740.599127][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6740.599418][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6740.599700][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6740.600002][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6740.600283][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6740.600601][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6740.600877][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6740.601204][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6740.601515][ C1] [ 6740.601674][ C1] [ 6740.601833][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6740.602169][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6740.602470][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6740.602779][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6740.603085][ C1] ? run_ksoftirqd+0xb/0x60 [ 6740.603330][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6740.603661][ C1] ? __orc_find+0x9c/0xf0 [ 6740.603896][ C1] ? lock_acquire+0x1c1/0x220 [ 6740.604152][ C1] ? irqentry_enter+0x2b/0x60 [ 6740.604412][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6740.604677][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6740.604967][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6740.605268][ C1] ? lock_acquire+0x1c1/0x220 [ 6740.605516][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6740.605766][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6740.606041][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6740.606291][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6740.606554][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6740.606827][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6740.607119][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6740.607411][ C1] ip_local_deliver+0x19d/0x480 [ 6740.607669][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6740.607954][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6740.608220][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6740.608501][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6740.608766][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6740.609103][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6740.609381][ C1] ip_rcv+0x564/0x740 [ 6740.609596][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6740.609842][ C1] ? set_track_prepare+0x8a/0xd0 [ 6740.610111][ C1] ? irqentry_enter+0x2b/0x60 [ 6740.610360][ C1] ? irqentry_enter+0x2b/0x60 [ 6740.610609][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6740.610849][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6740.611166][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6740.611505][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6740.611812][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6740.612162][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6740.612464][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6740.612796][ C1] netif_receive_skb+0x55/0x280 [ 6740.613056][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6740.613385][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6740.613733][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6740.614055][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6740.614347][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6740.614652][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6740.614983][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6740.615268][ C1] ? arch_stack_walk+0x68/0x100 [ 6740.615527][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6740.615803][ C1] ? irqentry_enter+0x2b/0x60 [ 6740.616053][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6740.616375][ C1] ? irqentry_enter+0x2b/0x60 [ 6740.616630][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6740.616953][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6740.617233][ C1] ? arch_stack_walk+0x68/0x100 [ 6740.617495][ C1] __tcf_classify+0x32c/0x7d0 [ 6740.617751][ C1] tcf_classify+0x283/0x930 [ 6740.617997][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6740.618274][ C1] tc_run+0x2e4/0x5d0 [ 6740.618491][ C1] ? __pfx_tc_run+0x10/0x10 [ 6740.618739][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6740.619009][ C1] ? irqentry_enter+0x2b/0x60 [ 6740.619258][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6740.619542][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6740.619865][ C1] ip_finish_output2+0x786/0x18e0 [ 6740.620139][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6740.620429][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6740.620694][ C1] ? __ip_finish_output+0x10f/0x770 [ 6740.620974][ C1] ip_output+0x16b/0x4f0 [ 6740.621207][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6740.621528][ C1] ? __pfx_ip_output+0x10/0x10 [ 6740.621788][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6740.622141][ C1] ? __pfx_ip_output+0x10/0x10 [ 6740.622396][ C1] __ip_queue_xmit+0x672/0x1910 [ 6740.622664][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6740.622947][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6740.623250][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6740.623540][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6740.623843][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6740.624129][ C1] tcp_delack_timer+0x84/0x240 [ 6740.624384][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6740.624673][ C1] call_timer_fn+0x176/0x430 [ 6740.624924][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6740.625200][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6740.625481][ C1] __run_timers.part.0+0x52d/0x890 [ 6740.625757][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6740.626045][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6740.626345][ C1] ? __pfx___schedule+0x10/0x10 [ 6740.626606][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6740.626928][ C1] run_timer_softirq+0x72/0x100 [ 6740.627187][ C1] __do_softirq+0x1bc/0x7ff [ 6740.627427][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6740.627702][ C1] run_ksoftirqd+0x2e/0x60 [ 6740.627941][ C1] smpboot_thread_fn+0x30e/0x840 [ 6740.628208][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6740.628502][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6740.628792][ C1] kthread+0x292/0x360 [ 6740.629010][ C1] ? __pfx_kthread+0x10/0x10 [ 6740.629256][ C1] ret_from_fork+0x34/0x70 [ 6740.629497][ C1] ? __pfx_kthread+0x10/0x10 [ 6740.629744][ C1] ret_from_fork_asm+0x1b/0x30 [ 6740.630007][ C1] [ 6764.373024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6764.373426][ C1] rcu: 1-....: (5553577 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1314572 [ 6764.374017][ C1] rcu: (t=5570064 jiffies g=1007429 q=31 ncpus=4) [ 6764.374364][ C1] Sending NMI from CPU 1 to CPUs 0: [ 6764.374663][ C0] NMI backtrace for cpu 0 [ 6764.374677][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6764.374682][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6764.374685][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6764.374694][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6764.374698][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6764.374701][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6764.374703][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6764.374705][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6764.374707][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6764.374708][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6764.374710][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6764.374712][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6764.374716][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6764.374717][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6764.374719][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6764.374720][ C0] Call Trace: [ 6764.374724][ C0] [ 6764.374728][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 6764.374734][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6764.374740][ C0] ? nmi_handle+0x156/0x420 [ 6764.374745][ C0] ? default_do_nmi+0x41/0x100 [ 6764.374750][ C0] ? exc_nmi+0xf3/0x120 [ 6764.374752][ C0] ? end_repeat_nmi+0xf/0x60 [ 6764.374757][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6764.374761][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6764.374765][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6764.374768][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6764.374772][ C0] [ 6764.374773][ C0] [ 6764.374774][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6764.374777][ C0] ? get_stack_info+0x36/0xc0 [ 6764.374782][ C0] ? lock_acquire+0x1c1/0x220 [ 6764.374787][ C0] ? lock_release+0x1d5/0x250 [ 6764.374791][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6764.374795][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6764.374798][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6764.374801][ C0] ? lock_acquire+0x1c1/0x220 [ 6764.374803][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6764.374809][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6764.374813][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6764.374820][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6764.374823][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6764.374827][ C0] ? __inet_lookup_established+0x341/0x610 [ 6764.374833][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6764.374841][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6764.374844][ C0] ip_local_deliver+0x19d/0x480 [ 6764.374847][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6764.374850][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6764.374855][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6764.374859][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6764.374862][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6764.374866][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6764.374878][ C0] ip_rcv+0x564/0x740 [ 6764.374881][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6764.374884][ C0] ? set_track_prepare+0x8a/0xd0 [ 6764.374889][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6764.374891][ C0] ? rest_init+0x153/0x260 [ 6764.374894][ C0] ? skb_clone+0x10b/0x330 [ 6764.374900][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6764.374906][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6764.374912][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6764.374918][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6764.374927][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6764.374930][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6764.374933][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6764.374937][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6764.374940][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6764.374943][ C0] ? lock_acquire+0x1c1/0x220 [ 6764.374946][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6764.374949][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6764.374952][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6764.374955][ C0] ? __copy_skb_header+0xaf/0x490 [ 6764.374959][ C0] ? __skb_clone+0x57a/0x760 [ 6764.374961][ C0] netif_receive_skb+0x55/0x280 [ 6764.374964][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6764.374972][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6764.374979][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6764.374986][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6764.374991][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6764.375000][ C0] ? hlock_class+0x4e/0x130 [ 6764.375007][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6764.375017][ C0] ? place_entity+0x21/0x2f0 [ 6764.375021][ C0] ? resched_curr+0x219/0x280 [ 6764.375025][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6764.375028][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6764.375033][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6764.375038][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6764.375040][ C0] ? activate_task+0xf5/0x260 [ 6764.375043][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6764.375049][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6764.375052][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6764.375055][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6764.375058][ C0] ? get_stack_info+0x36/0xc0 [ 6764.375062][ C0] ? stack_access_ok+0xda/0x1f0 [ 6764.375064][ C0] ? get_reg+0x119/0x190 [ 6764.375068][ C0] __tcf_classify+0x32c/0x7d0 [ 6764.375072][ C0] tcf_classify+0x283/0x930 [ 6764.375075][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6764.375081][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6764.375083][ C0] ? arch_stack_walk+0x8c/0x100 [ 6764.375087][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6764.375090][ C0] tc_run+0x2e4/0x5d0 [ 6764.375094][ C0] ? __pfx_tc_run+0x10/0x10 [ 6764.375098][ C0] ? lock_acquire+0x1c1/0x220 [ 6764.375100][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6764.375105][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6764.375111][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6764.375114][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6764.375117][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6764.375122][ C0] ? neigh_hh_output+0x348/0x590 [ 6764.375127][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6764.375131][ C0] ip_finish_output2+0x786/0x18e0 [ 6764.375134][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6764.375141][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6764.375149][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6764.375152][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6764.375156][ C0] ? __ip_finish_output+0x10f/0x770 [ 6764.375160][ C0] ip_output+0x16b/0x4f0 [ 6764.375163][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6764.375168][ C0] ? __pfx_ip_output+0x10/0x10 [ 6764.375171][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6764.375175][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6764.375178][ C0] ? ip_local_out+0x114/0x3b0 [ 6764.375182][ C0] __ip_queue_xmit+0x672/0x1910 [ 6764.375186][ C0] ? __skb_clone+0x57a/0x760 [ 6764.375189][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6764.375196][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6764.375201][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6764.375205][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6764.375210][ C0] ? tcp_current_mss+0x40a/0x510 [ 6764.375213][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6764.375215][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6764.375218][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6764.375220][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6764.375223][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6764.375227][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6764.375232][ C0] ? ktime_get+0xb6/0x190 [ 6764.375236][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6764.375241][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6764.375244][ C0] tcp_write_timer+0x82/0x1d0 [ 6764.375248][ C0] call_timer_fn+0x176/0x430 [ 6764.375251][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6764.375256][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6764.375261][ C0] __run_timers.part.0+0x52d/0x890 [ 6764.375264][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6764.375269][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6764.375272][ C0] ? lock_acquire+0x1c1/0x220 [ 6764.375274][ C0] ? clockevents_program_event+0xf6/0x300 [ 6764.375279][ C0] ? lock_release+0x1d5/0x250 [ 6764.375282][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6764.375284][ C0] ? ktime_get+0xb6/0x190 [ 6764.375288][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6764.375291][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6764.375296][ C0] run_timer_softirq+0x72/0x100 [ 6764.375299][ C0] __do_softirq+0x1bc/0x7ff [ 6764.375304][ C0] irq_exit_rcu+0x98/0xc0 [ 6764.375307][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6764.375311][ C0] [ 6764.375312][ C0] [ 6764.375313][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6764.375319][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6764.375323][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6764.375325][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6764.375327][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6764.375328][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6764.375330][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6764.375331][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6764.375333][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6764.375336][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6764.375340][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6764.375344][ C0] default_idle_call+0x69/0xa0 [ 6764.375346][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6764.375348][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6764.375354][ C0] ? lock_release+0x1d5/0x250 [ 6764.375357][ C0] do_idle+0xfb/0x160 [ 6764.375360][ C0] cpu_startup_entry+0x55/0x60 [ 6764.375363][ C0] rest_init+0x153/0x260 [ 6764.375365][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6764.375372][ C0] arch_call_rest_init+0x13/0x40 [ 6764.375378][ C0] start_kernel+0x314/0x3d0 [ 6764.375382][ C0] x86_64_start_reservations+0x18/0x30 [ 6764.375387][ C0] x86_64_start_kernel+0xba/0x110 [ 6764.375390][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6764.375399][ C0] [ 6764.375652][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6764.429638][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6764.430279][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6764.430622][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6764.431638][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6764.431960][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6764.432380][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6764.432802][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6764.433222][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6764.433641][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6764.434065][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6764.434544][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6764.434890][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6764.435312][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6764.435728][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6764.436146][ C1] Call Trace: [ 6764.436327][ C1] [ 6764.436483][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6764.436773][ C1] ? print_cpu_stall+0x263/0x6a0 [ 6764.437039][ C1] ? check_cpu_stall+0x284/0x500 [ 6764.437304][ C1] ? rcu_pending+0x92/0x360 [ 6764.437543][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6764.437824][ C1] ? update_process_times+0xb9/0x110 [ 6764.438110][ C1] ? tick_sched_handle+0x67/0x130 [ 6764.438379][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6764.438677][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6764.438933][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6764.439262][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6764.439551][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6764.439854][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6764.440137][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6764.440461][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6764.440734][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6764.441067][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6764.441379][ C1] [ 6764.441535][ C1] [ 6764.441690][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6764.442015][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6764.442324][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6764.442633][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6764.442932][ C1] ? run_ksoftirqd+0xb/0x60 [ 6764.443175][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6764.443497][ C1] ? __orc_find+0x9c/0xf0 [ 6764.443733][ C1] ? lock_acquire+0x1c1/0x220 [ 6764.443985][ C1] ? irqentry_enter+0x2b/0x60 [ 6764.444236][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6764.444494][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6764.444779][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6764.445077][ C1] ? lock_acquire+0x1c1/0x220 [ 6764.445331][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6764.445587][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6764.445863][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6764.446111][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6764.446369][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6764.446639][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6764.446928][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6764.447221][ C1] ip_local_deliver+0x19d/0x480 [ 6764.447482][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6764.447768][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6764.448034][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6764.448309][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6764.448570][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6764.448909][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6764.449184][ C1] ip_rcv+0x564/0x740 [ 6764.449395][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6764.449635][ C1] ? set_track_prepare+0x8a/0xd0 [ 6764.449899][ C1] ? irqentry_enter+0x2b/0x60 [ 6764.450154][ C1] ? irqentry_enter+0x2b/0x60 [ 6764.450408][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6764.450652][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6764.450973][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6764.451316][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6764.451627][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6764.451965][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6764.452264][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6764.452600][ C1] netif_receive_skb+0x55/0x280 [ 6764.452861][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6764.453193][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6764.453542][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6764.453862][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6764.454152][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6764.454454][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6764.454782][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6764.455063][ C1] ? arch_stack_walk+0x68/0x100 [ 6764.455330][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6764.455609][ C1] ? irqentry_enter+0x2b/0x60 [ 6764.455863][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6764.456186][ C1] ? irqentry_enter+0x2b/0x60 [ 6764.456434][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6764.456757][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6764.457042][ C1] ? arch_stack_walk+0x68/0x100 [ 6764.457301][ C1] __tcf_classify+0x32c/0x7d0 [ 6764.457553][ C1] tcf_classify+0x283/0x930 [ 6764.457795][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6764.458065][ C1] tc_run+0x2e4/0x5d0 [ 6764.458277][ C1] ? __pfx_tc_run+0x10/0x10 [ 6764.458518][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6764.458782][ C1] ? irqentry_enter+0x2b/0x60 [ 6764.459038][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6764.459327][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6764.459651][ C1] ip_finish_output2+0x786/0x18e0 [ 6764.459920][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6764.460212][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6764.460479][ C1] ? __ip_finish_output+0x10f/0x770 [ 6764.460754][ C1] ip_output+0x16b/0x4f0 [ 6764.460980][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6764.461301][ C1] ? __pfx_ip_output+0x10/0x10 [ 6764.461554][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6764.461914][ C1] ? __pfx_ip_output+0x10/0x10 [ 6764.462173][ C1] __ip_queue_xmit+0x672/0x1910 [ 6764.462434][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6764.462712][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6764.463007][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6764.463292][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6764.463584][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6764.463870][ C1] tcp_delack_timer+0x84/0x240 [ 6764.464128][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6764.464411][ C1] call_timer_fn+0x176/0x430 [ 6764.464659][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6764.464936][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6764.465215][ C1] __run_timers.part.0+0x52d/0x890 [ 6764.465485][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6764.465774][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6764.466078][ C1] ? __pfx___schedule+0x10/0x10 [ 6764.466338][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6764.466656][ C1] run_timer_softirq+0x72/0x100 [ 6764.466920][ C1] __do_softirq+0x1bc/0x7ff [ 6764.467167][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6764.467443][ C1] run_ksoftirqd+0x2e/0x60 [ 6764.467680][ C1] smpboot_thread_fn+0x30e/0x840 [ 6764.467948][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6764.468236][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6764.468531][ C1] kthread+0x292/0x360 [ 6764.468748][ C1] ? __pfx_kthread+0x10/0x10 [ 6764.468996][ C1] ret_from_fork+0x34/0x70 [ 6764.469232][ C1] ? __pfx_kthread+0x10/0x10 [ 6764.469478][ C1] ret_from_fork_asm+0x1b/0x30 [ 6764.469734][ C1] [ 6788.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5216s! [swapper/0:0] [ 6788.527919][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6788.529122][ C0] irq event stamp: 27567077 [ 6788.529365][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6788.529902][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6788.530374][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6788.530881][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6788.531375][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6788.531856][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6788.532506][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6788.532856][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6788.533891][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6788.534216][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6788.534635][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6788.535052][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6788.535470][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6788.535887][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6788.536303][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6788.536769][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6788.537121][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6788.537539][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6788.537959][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6788.538387][ C0] Call Trace: [ 6788.538571][ C0] [ 6788.538727][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6788.539002][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6788.539259][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6788.539549][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6788.539841][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6788.540148][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6788.540436][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6788.540759][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6788.541032][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6788.541312][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6788.541635][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6788.541945][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6788.542280][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6788.542583][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6788.542898][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6788.543206][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6788.543535][ C0] ? get_stack_info+0x36/0xc0 [ 6788.543801][ C0] ? lock_acquire+0x1c1/0x220 [ 6788.544059][ C0] ? lock_release+0x1d5/0x250 [ 6788.544315][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6788.544578][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6788.544866][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6788.545166][ C0] ? lock_acquire+0x1c1/0x220 [ 6788.545412][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6788.545662][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6788.545932][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6788.546183][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6788.546444][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6788.546716][ C0] ? __inet_lookup_established+0x341/0x610 [ 6788.547035][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6788.547324][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6788.547613][ C0] ip_local_deliver+0x19d/0x480 [ 6788.547873][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6788.548160][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6788.548435][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6788.548710][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6788.548973][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6788.549311][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6788.549585][ C0] ip_rcv+0x564/0x740 [ 6788.549799][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6788.550039][ C0] ? set_track_prepare+0x8a/0xd0 [ 6788.550304][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6788.550596][ C0] ? rest_init+0x153/0x260 [ 6788.550832][ C0] ? skb_clone+0x10b/0x330 [ 6788.551076][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6788.551409][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6788.551731][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6788.552030][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6788.552341][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6788.552611][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6788.552855][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6788.553172][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6788.553470][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6788.553813][ C0] ? lock_acquire+0x1c1/0x220 [ 6788.554068][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6788.554380][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6788.554677][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6788.555011][ C0] ? __copy_skb_header+0xaf/0x490 [ 6788.555282][ C0] ? __skb_clone+0x57a/0x760 [ 6788.555532][ C0] netif_receive_skb+0x55/0x280 [ 6788.555790][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6788.556117][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6788.556463][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6788.556779][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6788.557065][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6788.557363][ C0] ? hlock_class+0x4e/0x130 [ 6788.557607][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6788.557931][ C0] ? place_entity+0x21/0x2f0 [ 6788.558176][ C0] ? resched_curr+0x219/0x280 [ 6788.558430][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6788.558699][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6788.558984][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6788.559260][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6788.559514][ C0] ? activate_task+0xf5/0x260 [ 6788.559761][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6788.560037][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6788.560312][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6788.560571][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6788.560861][ C0] ? get_stack_info+0x36/0xc0 [ 6788.561115][ C0] ? stack_access_ok+0xda/0x1f0 [ 6788.561374][ C0] ? get_reg+0x119/0x190 [ 6788.561604][ C0] __tcf_classify+0x32c/0x7d0 [ 6788.561857][ C0] tcf_classify+0x283/0x930 [ 6788.562100][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6788.562426][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6788.562697][ C0] ? arch_stack_walk+0x8c/0x100 [ 6788.562960][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6788.563251][ C0] tc_run+0x2e4/0x5d0 [ 6788.563465][ C0] ? __pfx_tc_run+0x10/0x10 [ 6788.563711][ C0] ? lock_acquire+0x1c1/0x220 [ 6788.563962][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6788.564239][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6788.564504][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6788.564791][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6788.565071][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6788.565396][ C0] ? neigh_hh_output+0x348/0x590 [ 6788.565659][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6788.565939][ C0] ip_finish_output2+0x786/0x18e0 [ 6788.566211][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6788.566507][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6788.566858][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6788.567148][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6788.567413][ C0] ? __ip_finish_output+0x10f/0x770 [ 6788.567688][ C0] ip_output+0x16b/0x4f0 [ 6788.567915][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6788.568202][ C0] ? __pfx_ip_output+0x10/0x10 [ 6788.568458][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6788.568760][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6788.569022][ C0] ? ip_local_out+0x114/0x3b0 [ 6788.569278][ C0] __ip_queue_xmit+0x672/0x1910 [ 6788.569544][ C0] ? __skb_clone+0x57a/0x760 [ 6788.569794][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6788.570073][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6788.570366][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6788.570681][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6788.570939][ C0] ? tcp_current_mss+0x40a/0x510 [ 6788.571204][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6788.571487][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6788.571761][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6788.572012][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6788.572288][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6788.572610][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6788.572885][ C0] ? ktime_get+0xb6/0x190 [ 6788.573116][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6788.573388][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6788.573675][ C0] tcp_write_timer+0x82/0x1d0 [ 6788.573930][ C0] call_timer_fn+0x176/0x430 [ 6788.574180][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6788.574452][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6788.574728][ C0] __run_timers.part.0+0x52d/0x890 [ 6788.574999][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6788.575284][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6788.575583][ C0] ? lock_acquire+0x1c1/0x220 [ 6788.575837][ C0] ? clockevents_program_event+0xf6/0x300 [ 6788.576147][ C0] ? lock_release+0x1d5/0x250 [ 6788.576399][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6788.576679][ C0] ? ktime_get+0xb6/0x190 [ 6788.576911][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6788.577216][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6788.577524][ C0] run_timer_softirq+0x72/0x100 [ 6788.577786][ C0] __do_softirq+0x1bc/0x7ff [ 6788.578033][ C0] irq_exit_rcu+0x98/0xc0 [ 6788.578267][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6788.578567][ C0] [ 6788.578723][ C0] [ 6788.578878][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6788.579196][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6788.579466][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6788.580495][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6788.580819][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6788.581242][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6788.581666][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6788.582084][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6788.582506][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6788.582931][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6788.583243][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6788.583519][ C0] default_idle_call+0x69/0xa0 [ 6788.583781][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6788.584045][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6788.584338][ C0] ? lock_release+0x1d5/0x250 [ 6788.584587][ C0] do_idle+0xfb/0x160 [ 6788.584799][ C0] cpu_startup_entry+0x55/0x60 [ 6788.585052][ C0] rest_init+0x153/0x260 [ 6788.585282][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6788.585567][ C0] arch_call_rest_init+0x13/0x40 [ 6788.585832][ C0] start_kernel+0x314/0x3d0 [ 6788.586078][ C0] x86_64_start_reservations+0x18/0x30 [ 6788.586376][ C0] x86_64_start_kernel+0xba/0x110 [ 6788.586642][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6788.586969][ C0] [ 6788.587135][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5216s! [ksoftirqd/1:22] [ 6788.587599][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6788.588800][ C1] irq event stamp: 3886976 [ 6788.589038][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6788.589530][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6788.590022][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6788.590519][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6788.591014][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6788.591507][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6788.592149][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6788.592488][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6788.593503][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6788.593832][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6788.594255][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6788.594678][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6788.595104][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6788.595524][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6788.595944][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6788.596418][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6788.596765][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6788.597190][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6788.597608][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6788.598028][ C1] Call Trace: [ 6788.598208][ C1] [ 6788.598365][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6788.598642][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6788.598894][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6788.599190][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6788.599475][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6788.599776][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6788.600055][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6788.600373][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6788.600652][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6788.600977][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6788.601285][ C1] [ 6788.601445][ C1] [ 6788.601606][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6788.601940][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6788.602243][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6788.602551][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6788.602856][ C1] ? run_ksoftirqd+0xb/0x60 [ 6788.603103][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6788.603432][ C1] ? __orc_find+0x9c/0xf0 [ 6788.603671][ C1] ? lock_acquire+0x1c1/0x220 [ 6788.603927][ C1] ? irqentry_enter+0x2b/0x60 [ 6788.604184][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6788.604447][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6788.604735][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6788.605034][ C1] ? lock_acquire+0x1c1/0x220 [ 6788.605280][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6788.605530][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6788.605800][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6788.606051][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6788.606313][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6788.606586][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6788.606879][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6788.607178][ C1] ip_local_deliver+0x19d/0x480 [ 6788.607436][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6788.607721][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6788.607984][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6788.608265][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6788.608528][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6788.608861][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6788.609139][ C1] ip_rcv+0x564/0x740 [ 6788.609352][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6788.609596][ C1] ? set_track_prepare+0x8a/0xd0 [ 6788.609861][ C1] ? irqentry_enter+0x2b/0x60 [ 6788.610108][ C1] ? irqentry_enter+0x2b/0x60 [ 6788.610356][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6788.610594][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6788.610908][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6788.611248][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6788.611553][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6788.611895][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6788.612198][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6788.612529][ C1] netif_receive_skb+0x55/0x280 [ 6788.612792][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6788.613122][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6788.613469][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6788.613791][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6788.614086][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6788.614395][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6788.614724][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6788.615007][ C1] ? arch_stack_walk+0x68/0x100 [ 6788.615267][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6788.615542][ C1] ? irqentry_enter+0x2b/0x60 [ 6788.615791][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6788.616109][ C1] ? irqentry_enter+0x2b/0x60 [ 6788.616362][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6788.616688][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6788.616968][ C1] ? arch_stack_walk+0x68/0x100 [ 6788.617234][ C1] __tcf_classify+0x32c/0x7d0 [ 6788.617491][ C1] tcf_classify+0x283/0x930 [ 6788.617738][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6788.618011][ C1] tc_run+0x2e4/0x5d0 [ 6788.618227][ C1] ? __pfx_tc_run+0x10/0x10 [ 6788.618473][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6788.618740][ C1] ? irqentry_enter+0x2b/0x60 [ 6788.618988][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6788.619272][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6788.619593][ C1] ip_finish_output2+0x786/0x18e0 [ 6788.619866][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6788.620161][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6788.620425][ C1] ? __ip_finish_output+0x10f/0x770 [ 6788.620707][ C1] ip_output+0x16b/0x4f0 [ 6788.620933][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6788.621251][ C1] ? __pfx_ip_output+0x10/0x10 [ 6788.621509][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6788.621861][ C1] ? __pfx_ip_output+0x10/0x10 [ 6788.622119][ C1] __ip_queue_xmit+0x672/0x1910 [ 6788.622387][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6788.622672][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6788.622972][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6788.623263][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6788.623561][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6788.623852][ C1] tcp_delack_timer+0x84/0x240 [ 6788.624107][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6788.624397][ C1] call_timer_fn+0x176/0x430 [ 6788.624646][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6788.624920][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6788.625201][ C1] __run_timers.part.0+0x52d/0x890 [ 6788.625476][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6788.625761][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6788.626062][ C1] ? __pfx___schedule+0x10/0x10 [ 6788.626325][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6788.626645][ C1] run_timer_softirq+0x72/0x100 [ 6788.626905][ C1] __do_softirq+0x1bc/0x7ff [ 6788.627147][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6788.627419][ C1] run_ksoftirqd+0x2e/0x60 [ 6788.627660][ C1] smpboot_thread_fn+0x30e/0x840 [ 6788.627925][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6788.628218][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6788.628506][ C1] kthread+0x292/0x360 [ 6788.628728][ C1] ? __pfx_kthread+0x10/0x10 [ 6788.628974][ C1] ret_from_fork+0x34/0x70 [ 6788.629215][ C1] ? __pfx_kthread+0x10/0x10 [ 6788.629459][ C1] ret_from_fork_asm+0x1b/0x30 [ 6788.629721][ C1] [ 6816.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5242s! [swapper/0:0] [ 6816.527925][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6816.529134][ C0] irq event stamp: 27567077 [ 6816.529378][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6816.529911][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6816.530385][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6816.530890][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6816.531384][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6816.531861][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6816.532513][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6816.532858][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6816.533891][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6816.534212][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6816.534630][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6816.535050][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6816.535467][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6816.535885][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6816.536303][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6816.536775][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6816.537127][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6816.537551][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6816.537977][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6816.538403][ C0] Call Trace: [ 6816.538583][ C0] [ 6816.538740][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6816.539017][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6816.539277][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6816.539569][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6816.539860][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6816.540166][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6816.540447][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6816.540773][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6816.541046][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6816.541327][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6816.541650][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6816.541960][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6816.542299][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6816.542600][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6816.542914][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6816.543220][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6816.543556][ C0] ? get_stack_info+0x36/0xc0 [ 6816.543812][ C0] ? lock_acquire+0x1c1/0x220 [ 6816.544069][ C0] ? lock_release+0x1d5/0x250 [ 6816.544326][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6816.544588][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6816.544875][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6816.545176][ C0] ? lock_acquire+0x1c1/0x220 [ 6816.545427][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6816.545680][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6816.545952][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6816.546201][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6816.546462][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6816.546735][ C0] ? __inet_lookup_established+0x341/0x610 [ 6816.547054][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6816.547342][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6816.547629][ C0] ip_local_deliver+0x19d/0x480 [ 6816.547891][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6816.548180][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6816.548451][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6816.548729][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6816.548992][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6816.549338][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6816.549613][ C0] ip_rcv+0x564/0x740 [ 6816.549827][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6816.550071][ C0] ? set_track_prepare+0x8a/0xd0 [ 6816.550336][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6816.550627][ C0] ? rest_init+0x153/0x260 [ 6816.550865][ C0] ? skb_clone+0x10b/0x330 [ 6816.551108][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6816.551440][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6816.551759][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6816.552058][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6816.552377][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6816.552644][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6816.552894][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6816.553209][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6816.553517][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6816.553868][ C0] ? lock_acquire+0x1c1/0x220 [ 6816.554123][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6816.554436][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6816.554733][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6816.555070][ C0] ? __copy_skb_header+0xaf/0x490 [ 6816.555341][ C0] ? __skb_clone+0x57a/0x760 [ 6816.555590][ C0] netif_receive_skb+0x55/0x280 [ 6816.555848][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6816.556177][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6816.556523][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6816.556841][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6816.557129][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6816.557428][ C0] ? hlock_class+0x4e/0x130 [ 6816.557675][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6816.558003][ C0] ? place_entity+0x21/0x2f0 [ 6816.558248][ C0] ? resched_curr+0x219/0x280 [ 6816.558502][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6816.558775][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6816.559063][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6816.559339][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6816.559598][ C0] ? activate_task+0xf5/0x260 [ 6816.559850][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6816.560125][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6816.560401][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6816.560660][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6816.560948][ C0] ? get_stack_info+0x36/0xc0 [ 6816.561204][ C0] ? stack_access_ok+0xda/0x1f0 [ 6816.561465][ C0] ? get_reg+0x119/0x190 [ 6816.561698][ C0] __tcf_classify+0x32c/0x7d0 [ 6816.561949][ C0] tcf_classify+0x283/0x930 [ 6816.562192][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6816.562523][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6816.562792][ C0] ? arch_stack_walk+0x8c/0x100 [ 6816.563058][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6816.563353][ C0] tc_run+0x2e4/0x5d0 [ 6816.563582][ C0] ? __pfx_tc_run+0x10/0x10 [ 6816.563833][ C0] ? lock_acquire+0x1c1/0x220 [ 6816.564094][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6816.564374][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6816.564639][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6816.564929][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6816.565211][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6816.565535][ C0] ? neigh_hh_output+0x348/0x590 [ 6816.565799][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6816.566080][ C0] ip_finish_output2+0x786/0x18e0 [ 6816.566350][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6816.566648][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6816.567002][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6816.567290][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6816.567557][ C0] ? __ip_finish_output+0x10f/0x770 [ 6816.567833][ C0] ip_output+0x16b/0x4f0 [ 6816.568059][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6816.568345][ C0] ? __pfx_ip_output+0x10/0x10 [ 6816.568600][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6816.568902][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6816.569165][ C0] ? ip_local_out+0x114/0x3b0 [ 6816.569422][ C0] __ip_queue_xmit+0x672/0x1910 [ 6816.569685][ C0] ? __skb_clone+0x57a/0x760 [ 6816.569935][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6816.570216][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6816.570511][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6816.570829][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6816.571091][ C0] ? tcp_current_mss+0x40a/0x510 [ 6816.571355][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6816.571638][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6816.571915][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6816.572171][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6816.572442][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6816.572765][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6816.573042][ C0] ? ktime_get+0xb6/0x190 [ 6816.573273][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6816.573550][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6816.573832][ C0] tcp_write_timer+0x82/0x1d0 [ 6816.574090][ C0] call_timer_fn+0x176/0x430 [ 6816.574342][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6816.574614][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6816.574891][ C0] __run_timers.part.0+0x52d/0x890 [ 6816.575164][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6816.575450][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6816.575749][ C0] ? lock_acquire+0x1c1/0x220 [ 6816.576004][ C0] ? clockevents_program_event+0xf6/0x300 [ 6816.576314][ C0] ? lock_release+0x1d5/0x250 [ 6816.576571][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6816.576850][ C0] ? ktime_get+0xb6/0x190 [ 6816.577085][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6816.577386][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6816.577701][ C0] run_timer_softirq+0x72/0x100 [ 6816.577967][ C0] __do_softirq+0x1bc/0x7ff [ 6816.578215][ C0] irq_exit_rcu+0x98/0xc0 [ 6816.578450][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6816.578753][ C0] [ 6816.578910][ C0] [ 6816.579067][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6816.579384][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6816.579665][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6816.580694][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6816.581020][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6816.581448][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6816.581870][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6816.582292][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6816.582722][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6816.583150][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6816.583461][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6816.583734][ C0] default_idle_call+0x69/0xa0 [ 6816.583992][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6816.584254][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6816.584548][ C0] ? lock_release+0x1d5/0x250 [ 6816.584796][ C0] do_idle+0xfb/0x160 [ 6816.585009][ C0] cpu_startup_entry+0x55/0x60 [ 6816.585266][ C0] rest_init+0x153/0x260 [ 6816.585492][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6816.585776][ C0] arch_call_rest_init+0x13/0x40 [ 6816.586042][ C0] start_kernel+0x314/0x3d0 [ 6816.586288][ C0] x86_64_start_reservations+0x18/0x30 [ 6816.586588][ C0] x86_64_start_kernel+0xba/0x110 [ 6816.586856][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6816.587185][ C0] [ 6816.587350][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5242s! [ksoftirqd/1:22] [ 6816.587817][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6816.589019][ C1] irq event stamp: 3886976 [ 6816.589257][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6816.589751][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6816.590241][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6816.590737][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6816.591232][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6816.591723][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6816.592365][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6816.592705][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6816.593732][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6816.594058][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6816.594478][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6816.594900][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6816.595324][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6816.595744][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6816.596164][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6816.596637][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6816.596983][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6816.597404][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6816.597821][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6816.598238][ C1] Call Trace: [ 6816.598417][ C1] [ 6816.598573][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6816.598851][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6816.599106][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6816.599401][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6816.599687][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6816.599988][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6816.600265][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6816.600584][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6816.600862][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6816.601186][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6816.601493][ C1] [ 6816.601656][ C1] [ 6816.601816][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6816.602151][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6816.602453][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6816.602764][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6816.603070][ C1] ? run_ksoftirqd+0xb/0x60 [ 6816.603317][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6816.603653][ C1] ? __orc_find+0x9c/0xf0 [ 6816.603887][ C1] ? lock_acquire+0x1c1/0x220 [ 6816.604145][ C1] ? irqentry_enter+0x2b/0x60 [ 6816.604402][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6816.604666][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6816.604956][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6816.605256][ C1] ? lock_acquire+0x1c1/0x220 [ 6816.605503][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6816.605754][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6816.606026][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6816.606277][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6816.606538][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6816.606811][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6816.607105][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6816.607399][ C1] ip_local_deliver+0x19d/0x480 [ 6816.607658][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6816.607943][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6816.608208][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6816.608489][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6816.608753][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6816.609088][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6816.609366][ C1] ip_rcv+0x564/0x740 [ 6816.609579][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6816.609823][ C1] ? set_track_prepare+0x8a/0xd0 [ 6816.610090][ C1] ? irqentry_enter+0x2b/0x60 [ 6816.610342][ C1] ? irqentry_enter+0x2b/0x60 [ 6816.610590][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6816.610830][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6816.611147][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6816.611485][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6816.611792][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6816.612135][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6816.612440][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6816.612771][ C1] netif_receive_skb+0x55/0x280 [ 6816.613031][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6816.613358][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6816.613710][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6816.614025][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6816.614320][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6816.614629][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6816.614959][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6816.615242][ C1] ? arch_stack_walk+0x68/0x100 [ 6816.615502][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6816.615778][ C1] ? irqentry_enter+0x2b/0x60 [ 6816.616031][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6816.616349][ C1] ? irqentry_enter+0x2b/0x60 [ 6816.616604][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6816.616930][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6816.617211][ C1] ? arch_stack_walk+0x68/0x100 [ 6816.617478][ C1] __tcf_classify+0x32c/0x7d0 [ 6816.617736][ C1] tcf_classify+0x283/0x930 [ 6816.617982][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6816.618256][ C1] tc_run+0x2e4/0x5d0 [ 6816.618473][ C1] ? __pfx_tc_run+0x10/0x10 [ 6816.618719][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6816.618987][ C1] ? irqentry_enter+0x2b/0x60 [ 6816.619235][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6816.619519][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6816.619840][ C1] ip_finish_output2+0x786/0x18e0 [ 6816.620115][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6816.620409][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6816.620674][ C1] ? __ip_finish_output+0x10f/0x770 [ 6816.620956][ C1] ip_output+0x16b/0x4f0 [ 6816.621184][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6816.621500][ C1] ? __pfx_ip_output+0x10/0x10 [ 6816.621758][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6816.622111][ C1] ? __pfx_ip_output+0x10/0x10 [ 6816.622368][ C1] __ip_queue_xmit+0x672/0x1910 [ 6816.622632][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6816.622916][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6816.623216][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6816.623508][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6816.623805][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6816.624091][ C1] tcp_delack_timer+0x84/0x240 [ 6816.624344][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6816.624632][ C1] call_timer_fn+0x176/0x430 [ 6816.624889][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6816.625164][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6816.625445][ C1] __run_timers.part.0+0x52d/0x890 [ 6816.625721][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6816.626007][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6816.626306][ C1] ? __pfx___schedule+0x10/0x10 [ 6816.626571][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6816.626891][ C1] run_timer_softirq+0x72/0x100 [ 6816.627152][ C1] __do_softirq+0x1bc/0x7ff [ 6816.627393][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6816.627665][ C1] run_ksoftirqd+0x2e/0x60 [ 6816.627907][ C1] smpboot_thread_fn+0x30e/0x840 [ 6816.628173][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6816.628466][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6816.628755][ C1] kthread+0x292/0x360 [ 6816.628976][ C1] ? __pfx_kthread+0x10/0x10 [ 6816.629224][ C1] ret_from_fork+0x34/0x70 [ 6816.629465][ C1] ? __pfx_kthread+0x10/0x10 [ 6816.629709][ C1] ret_from_fork_asm+0x1b/0x30 [ 6816.629971][ C1] [ 6842.472024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6842.472414][ C0] rcu: 0-....: (5640069 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1333045 [ 6842.472935][ C0] rcu: (t=5648163 jiffies g=1007429 q=31 ncpus=4) [ 6842.473283][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6842.473777][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6842.474429][ C0] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 6842.474740][ C0] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 6842.475760][ C0] RSP: 0018:ffffc900000069c8 EFLAGS: 00000202 [ 6842.476087][ C0] RAX: ffff88800a099b58 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6842.476507][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6842.476927][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6842.477348][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6842.477767][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6842.478187][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6842.478657][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6842.479017][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6842.479441][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6842.479864][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6842.480292][ C0] Call Trace: [ 6842.480479][ C0] [ 6842.480637][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6842.480924][ C0] ? print_cpu_stall+0x263/0x6a0 [ 6842.481195][ C0] ? check_cpu_stall+0x284/0x500 [ 6842.481458][ C0] ? rcu_pending+0x92/0x360 [ 6842.481703][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6842.481990][ C0] ? update_process_times+0xb9/0x110 [ 6842.482275][ C0] ? tick_sched_handle+0x67/0x130 [ 6842.482548][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6842.482851][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6842.483107][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6842.483442][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6842.483733][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6842.484041][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6842.484323][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6842.484646][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6842.484918][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6842.485200][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6842.485522][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6842.485833][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6842.486167][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6842.486473][ C0] ? kasan_check_range+0x12/0x1c0 [ 6842.486742][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 6842.487039][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6842.487370][ C0] ? get_stack_info+0x36/0xc0 [ 6842.487628][ C0] ? lock_acquire+0x1c1/0x220 [ 6842.487885][ C0] ? lock_release+0x1d5/0x250 [ 6842.488142][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6842.488406][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6842.488693][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6842.488993][ C0] ? lock_acquire+0x1c1/0x220 [ 6842.489239][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6842.489489][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6842.489760][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6842.490011][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6842.490273][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6842.490544][ C0] ? __inet_lookup_established+0x341/0x610 [ 6842.490859][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6842.491152][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6842.491443][ C0] ip_local_deliver+0x19d/0x480 [ 6842.491705][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6842.491992][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6842.492262][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6842.492539][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6842.492802][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6842.493141][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6842.493421][ C0] ip_rcv+0x564/0x740 [ 6842.493638][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6842.493883][ C0] ? set_track_prepare+0x8a/0xd0 [ 6842.494152][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6842.494447][ C0] ? rest_init+0x153/0x260 [ 6842.494686][ C0] ? skb_clone+0x10b/0x330 [ 6842.494925][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6842.495264][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6842.495589][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6842.495887][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6842.496195][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6842.496453][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6842.496693][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6842.497005][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6842.497303][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6842.497648][ C0] ? lock_acquire+0x1c1/0x220 [ 6842.497902][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6842.498216][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6842.498513][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6842.498851][ C0] ? __copy_skb_header+0xaf/0x490 [ 6842.499124][ C0] ? __skb_clone+0x57a/0x760 [ 6842.499374][ C0] netif_receive_skb+0x55/0x280 [ 6842.499638][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6842.499966][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6842.500316][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6842.500633][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6842.500919][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6842.501218][ C0] ? hlock_class+0x4e/0x130 [ 6842.501462][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6842.501789][ C0] ? place_entity+0x21/0x2f0 [ 6842.502036][ C0] ? resched_curr+0x219/0x280 [ 6842.502290][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6842.502561][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6842.502847][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6842.503123][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6842.503388][ C0] ? activate_task+0xf5/0x260 [ 6842.503640][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6842.503920][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6842.504194][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6842.504460][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6842.504753][ C0] ? get_stack_info+0x36/0xc0 [ 6842.505007][ C0] ? stack_access_ok+0xda/0x1f0 [ 6842.505266][ C0] ? get_reg+0x119/0x190 [ 6842.505495][ C0] __tcf_classify+0x32c/0x7d0 [ 6842.505752][ C0] tcf_classify+0x283/0x930 [ 6842.505997][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6842.506329][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6842.506595][ C0] ? arch_stack_walk+0x8c/0x100 [ 6842.506857][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6842.507146][ C0] tc_run+0x2e4/0x5d0 [ 6842.507365][ C0] ? __pfx_tc_run+0x10/0x10 [ 6842.507611][ C0] ? lock_acquire+0x1c1/0x220 [ 6842.507863][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6842.508140][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6842.508405][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6842.508694][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6842.508975][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6842.509300][ C0] ? neigh_hh_output+0x348/0x590 [ 6842.509564][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6842.509847][ C0] ip_finish_output2+0x786/0x18e0 [ 6842.510118][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6842.510412][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6842.510763][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6842.511057][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6842.511323][ C0] ? __ip_finish_output+0x10f/0x770 [ 6842.511598][ C0] ip_output+0x16b/0x4f0 [ 6842.511826][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6842.512111][ C0] ? __pfx_ip_output+0x10/0x10 [ 6842.512367][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6842.512670][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6842.512931][ C0] ? ip_local_out+0x114/0x3b0 [ 6842.513187][ C0] __ip_queue_xmit+0x672/0x1910 [ 6842.513458][ C0] ? __skb_clone+0x57a/0x760 [ 6842.513704][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6842.513989][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6842.514287][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6842.514607][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6842.514862][ C0] ? tcp_current_mss+0x40a/0x510 [ 6842.515129][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6842.515409][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6842.515688][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6842.515943][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6842.516208][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6842.516524][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6842.516804][ C0] ? ktime_get+0xb6/0x190 [ 6842.517040][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6842.517316][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6842.517596][ C0] tcp_write_timer+0x82/0x1d0 [ 6842.517856][ C0] call_timer_fn+0x176/0x430 [ 6842.518107][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6842.518379][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6842.518655][ C0] __run_timers.part.0+0x52d/0x890 [ 6842.518926][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6842.519212][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6842.519507][ C0] ? lock_acquire+0x1c1/0x220 [ 6842.519762][ C0] ? clockevents_program_event+0xf6/0x300 [ 6842.520072][ C0] ? lock_release+0x1d5/0x250 [ 6842.520324][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6842.520604][ C0] ? ktime_get+0xb6/0x190 [ 6842.520837][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6842.521140][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6842.521448][ C0] run_timer_softirq+0x72/0x100 [ 6842.521711][ C0] __do_softirq+0x1bc/0x7ff [ 6842.521957][ C0] irq_exit_rcu+0x98/0xc0 [ 6842.522193][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6842.522493][ C0] [ 6842.522648][ C0] [ 6842.522805][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6842.523122][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6842.523399][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6842.524415][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6842.524737][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6842.525157][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6842.525577][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6842.525996][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6842.526417][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6842.526836][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6842.527138][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6842.527411][ C0] default_idle_call+0x69/0xa0 [ 6842.527670][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6842.527932][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6842.528227][ C0] ? lock_release+0x1d5/0x250 [ 6842.528476][ C0] do_idle+0xfb/0x160 [ 6842.528687][ C0] cpu_startup_entry+0x55/0x60 [ 6842.528940][ C0] rest_init+0x153/0x260 [ 6842.529170][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6842.529457][ C0] arch_call_rest_init+0x13/0x40 [ 6842.529721][ C0] start_kernel+0x314/0x3d0 [ 6842.529967][ C0] x86_64_start_reservations+0x18/0x30 [ 6842.530261][ C0] x86_64_start_kernel+0xba/0x110 [ 6842.530528][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6842.530854][ C0] [ 6842.531020][ C0] Sending NMI from CPU 0 to CPUs 1: [ 6842.531311][ C1] NMI backtrace for cpu 1 [ 6842.531320][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6842.531325][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6842.531327][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6842.531337][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6842.531341][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6842.531344][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6842.531346][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6842.531348][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6842.531350][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6842.531352][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6842.531354][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6842.531356][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6842.531359][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6842.531361][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6842.531363][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6842.531364][ C1] Call Trace: [ 6842.531368][ C1] [ 6842.531372][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 6842.531378][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6842.531384][ C1] ? nmi_handle+0x156/0x420 [ 6842.531390][ C1] ? default_do_nmi+0x41/0x100 [ 6842.531393][ C1] ? exc_nmi+0xf3/0x120 [ 6842.531396][ C1] ? end_repeat_nmi+0xf/0x60 [ 6842.531401][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6842.531404][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6842.531408][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6842.531411][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6842.531415][ C1] [ 6842.531416][ C1] [ 6842.531417][ C1] ? run_ksoftirqd+0xb/0x60 [ 6842.531422][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6842.531425][ C1] ? __orc_find+0x9c/0xf0 [ 6842.531429][ C1] ? lock_acquire+0x1c1/0x220 [ 6842.531433][ C1] ? irqentry_enter+0x2b/0x60 [ 6842.531438][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6842.531441][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6842.531444][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6842.531448][ C1] ? lock_acquire+0x1c1/0x220 [ 6842.531450][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6842.531455][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6842.531459][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6842.531466][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6842.531469][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6842.531475][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6842.531482][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6842.531486][ C1] ip_local_deliver+0x19d/0x480 [ 6842.531490][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6842.531492][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6842.531497][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6842.531501][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6842.531504][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6842.531508][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6842.531517][ C1] ip_rcv+0x564/0x740 [ 6842.531520][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6842.531523][ C1] ? set_track_prepare+0x8a/0xd0 [ 6842.531529][ C1] ? irqentry_enter+0x2b/0x60 [ 6842.531532][ C1] ? irqentry_enter+0x2b/0x60 [ 6842.531535][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6842.531538][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6842.531542][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6842.531545][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6842.531548][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6842.531551][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6842.531554][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6842.531558][ C1] netif_receive_skb+0x55/0x280 [ 6842.531562][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6842.531571][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6842.531578][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6842.531585][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6842.531592][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6842.531604][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6842.531613][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6842.531616][ C1] ? arch_stack_walk+0x68/0x100 [ 6842.531621][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6842.531624][ C1] ? irqentry_enter+0x2b/0x60 [ 6842.531628][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6842.531632][ C1] ? irqentry_enter+0x2b/0x60 [ 6842.531636][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6842.531643][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6842.531646][ C1] ? arch_stack_walk+0x68/0x100 [ 6842.531650][ C1] __tcf_classify+0x32c/0x7d0 [ 6842.531655][ C1] tcf_classify+0x283/0x930 [ 6842.531659][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6842.531664][ C1] tc_run+0x2e4/0x5d0 [ 6842.531669][ C1] ? __pfx_tc_run+0x10/0x10 [ 6842.531674][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6842.531679][ C1] ? irqentry_enter+0x2b/0x60 [ 6842.531682][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6842.531685][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6842.531692][ C1] ip_finish_output2+0x786/0x18e0 [ 6842.531698][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6842.531701][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6842.531705][ C1] ? __ip_finish_output+0x10f/0x770 [ 6842.531709][ C1] ip_output+0x16b/0x4f0 [ 6842.531711][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6842.531715][ C1] ? __pfx_ip_output+0x10/0x10 [ 6842.531719][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6842.531726][ C1] ? __pfx_ip_output+0x10/0x10 [ 6842.531731][ C1] __ip_queue_xmit+0x672/0x1910 [ 6842.531736][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6842.531743][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6842.531748][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6842.531751][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6842.531755][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6842.531758][ C1] tcp_delack_timer+0x84/0x240 [ 6842.531762][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6842.531765][ C1] call_timer_fn+0x176/0x430 [ 6842.531770][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6842.531774][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6842.531778][ C1] __run_timers.part.0+0x52d/0x890 [ 6842.531781][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6842.531786][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6842.531791][ C1] ? __pfx___schedule+0x10/0x10 [ 6842.531794][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6842.531799][ C1] run_timer_softirq+0x72/0x100 [ 6842.531802][ C1] __do_softirq+0x1bc/0x7ff [ 6842.531806][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6842.531809][ C1] run_ksoftirqd+0x2e/0x60 [ 6842.531813][ C1] smpboot_thread_fn+0x30e/0x840 [ 6842.531817][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6842.531820][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6842.531823][ C1] kthread+0x292/0x360 [ 6842.531826][ C1] ? __pfx_kthread+0x10/0x10 [ 6842.531828][ C1] ret_from_fork+0x34/0x70 [ 6842.531831][ C1] ? __pfx_kthread+0x10/0x10 [ 6842.531833][ C1] ret_from_fork_asm+0x1b/0x30 [ 6842.531840][ C1] [ 6868.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5290s! [swapper/0:0] [ 6868.527920][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6868.529122][ C0] irq event stamp: 27567077 [ 6868.529364][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6868.529892][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6868.530374][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6868.530883][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6868.531382][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6868.531869][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6868.532515][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6868.532854][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6868.533886][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6868.534213][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6868.534640][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6868.535069][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6868.535494][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6868.535918][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6868.536345][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6868.536823][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6868.537172][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6868.537602][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6868.538025][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6868.538444][ C0] Call Trace: [ 6868.538622][ C0] [ 6868.538778][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6868.539059][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6868.539316][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6868.539610][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6868.539896][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6868.540198][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6868.540476][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6868.540800][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6868.541080][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6868.541358][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6868.541690][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6868.542005][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6868.542338][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6868.542647][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6868.542965][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6868.543276][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6868.543613][ C0] ? get_stack_info+0x36/0xc0 [ 6868.543864][ C0] ? lock_acquire+0x1c1/0x220 [ 6868.544116][ C0] ? lock_release+0x1d5/0x250 [ 6868.544366][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6868.544624][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6868.544907][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6868.545207][ C0] ? lock_acquire+0x1c1/0x220 [ 6868.545462][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6868.545721][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6868.545996][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6868.546241][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6868.546497][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6868.546765][ C0] ? __inet_lookup_established+0x341/0x610 [ 6868.547079][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6868.547371][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6868.547663][ C0] ip_local_deliver+0x19d/0x480 [ 6868.547922][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6868.548208][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6868.548475][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6868.548757][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6868.549025][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6868.549360][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6868.549641][ C0] ip_rcv+0x564/0x740 [ 6868.549857][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6868.550104][ C0] ? set_track_prepare+0x8a/0xd0 [ 6868.550373][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6868.550660][ C0] ? rest_init+0x153/0x260 [ 6868.550900][ C0] ? skb_clone+0x10b/0x330 [ 6868.551142][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6868.551480][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6868.551804][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6868.552098][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6868.552406][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6868.552664][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6868.552906][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6868.553225][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6868.553529][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6868.553869][ C0] ? lock_acquire+0x1c1/0x220 [ 6868.554120][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6868.554429][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6868.554732][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6868.555064][ C0] ? __copy_skb_header+0xaf/0x490 [ 6868.555332][ C0] ? __skb_clone+0x57a/0x760 [ 6868.555576][ C0] netif_receive_skb+0x55/0x280 [ 6868.555837][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6868.556171][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6868.556523][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6868.556836][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6868.557130][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6868.557438][ C0] ? hlock_class+0x4e/0x130 [ 6868.557688][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6868.558024][ C0] ? place_entity+0x21/0x2f0 [ 6868.558274][ C0] ? resched_curr+0x219/0x280 [ 6868.558523][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6868.558790][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6868.559074][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6868.559356][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6868.559621][ C0] ? activate_task+0xf5/0x260 [ 6868.559877][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6868.560154][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6868.560425][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6868.560693][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6868.560986][ C0] ? get_stack_info+0x36/0xc0 [ 6868.561236][ C0] ? stack_access_ok+0xda/0x1f0 [ 6868.561493][ C0] ? get_reg+0x119/0x190 [ 6868.561721][ C0] __tcf_classify+0x32c/0x7d0 [ 6868.561975][ C0] tcf_classify+0x283/0x930 [ 6868.562221][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6868.562555][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6868.562820][ C0] ? arch_stack_walk+0x8c/0x100 [ 6868.563081][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6868.563376][ C0] tc_run+0x2e4/0x5d0 [ 6868.563594][ C0] ? __pfx_tc_run+0x10/0x10 [ 6868.563837][ C0] ? lock_acquire+0x1c1/0x220 [ 6868.564088][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6868.564361][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6868.564632][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6868.564922][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6868.565200][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6868.565519][ C0] ? neigh_hh_output+0x348/0x590 [ 6868.565787][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6868.566065][ C0] ip_finish_output2+0x786/0x18e0 [ 6868.566332][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6868.566628][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6868.566983][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6868.567276][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6868.567541][ C0] ? __ip_finish_output+0x10f/0x770 [ 6868.567823][ C0] ip_output+0x16b/0x4f0 [ 6868.568057][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6868.568339][ C0] ? __pfx_ip_output+0x10/0x10 [ 6868.568600][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6868.568898][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6868.569167][ C0] ? ip_local_out+0x114/0x3b0 [ 6868.569419][ C0] __ip_queue_xmit+0x672/0x1910 [ 6868.569679][ C0] ? __skb_clone+0x57a/0x760 [ 6868.569923][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6868.570209][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6868.570509][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6868.570833][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6868.571093][ C0] ? tcp_current_mss+0x40a/0x510 [ 6868.571360][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6868.571641][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6868.571922][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6868.572181][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6868.572448][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6868.572765][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6868.573049][ C0] ? ktime_get+0xb6/0x190 [ 6868.573288][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6868.573561][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6868.573845][ C0] tcp_write_timer+0x82/0x1d0 [ 6868.574098][ C0] call_timer_fn+0x176/0x430 [ 6868.574348][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6868.574626][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6868.574900][ C0] __run_timers.part.0+0x52d/0x890 [ 6868.575177][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6868.575460][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6868.575764][ C0] ? lock_acquire+0x1c1/0x220 [ 6868.576015][ C0] ? clockevents_program_event+0xf6/0x300 [ 6868.576320][ C0] ? lock_release+0x1d5/0x250 [ 6868.576567][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6868.576843][ C0] ? ktime_get+0xb6/0x190 [ 6868.577074][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6868.577373][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6868.577690][ C0] run_timer_softirq+0x72/0x100 [ 6868.577951][ C0] __do_softirq+0x1bc/0x7ff [ 6868.578198][ C0] irq_exit_rcu+0x98/0xc0 [ 6868.578429][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6868.578731][ C0] [ 6868.578891][ C0] [ 6868.579051][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6868.579374][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6868.579643][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6868.580663][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6868.580987][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6868.581408][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6868.581828][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6868.582248][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6868.582670][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6868.583092][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6868.583404][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6868.583682][ C0] default_idle_call+0x69/0xa0 [ 6868.583937][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6868.584203][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6868.584494][ C0] ? lock_release+0x1d5/0x250 [ 6868.584750][ C0] do_idle+0xfb/0x160 [ 6868.584971][ C0] cpu_startup_entry+0x55/0x60 [ 6868.585231][ C0] rest_init+0x153/0x260 [ 6868.585455][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6868.585753][ C0] arch_call_rest_init+0x13/0x40 [ 6868.586024][ C0] start_kernel+0x314/0x3d0 [ 6868.586269][ C0] x86_64_start_reservations+0x18/0x30 [ 6868.586568][ C0] x86_64_start_kernel+0xba/0x110 [ 6868.586839][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6868.587172][ C0] [ 6868.587340][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5290s! [ksoftirqd/1:22] [ 6868.587809][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6868.589003][ C1] irq event stamp: 3886976 [ 6868.589241][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6868.589742][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6868.590243][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6868.590745][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6868.591234][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6868.591732][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6868.592381][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6868.592725][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6868.593754][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6868.594080][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6868.594499][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6868.594917][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6868.595339][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6868.595758][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6868.596181][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6868.596653][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6868.597007][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6868.597427][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6868.597849][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6868.598275][ C1] Call Trace: [ 6868.598460][ C1] [ 6868.598617][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6868.598892][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6868.599151][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6868.599441][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6868.599731][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6868.600038][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6868.600322][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6868.600644][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6868.600918][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6868.601249][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6868.601560][ C1] [ 6868.601718][ C1] [ 6868.601874][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6868.602205][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6868.602512][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6868.602826][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6868.603130][ C1] ? run_ksoftirqd+0xb/0x60 [ 6868.603376][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6868.603709][ C1] ? __orc_find+0x9c/0xf0 [ 6868.603941][ C1] ? lock_acquire+0x1c1/0x220 [ 6868.604197][ C1] ? irqentry_enter+0x2b/0x60 [ 6868.604450][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6868.604710][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6868.604996][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6868.605295][ C1] ? lock_acquire+0x1c1/0x220 [ 6868.605549][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6868.605804][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6868.606082][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6868.606329][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6868.606589][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6868.606859][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6868.607148][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6868.607438][ C1] ip_local_deliver+0x19d/0x480 [ 6868.607702][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6868.607992][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6868.608260][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6868.608538][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6868.608801][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6868.609141][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6868.609416][ C1] ip_rcv+0x564/0x740 [ 6868.609629][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6868.609870][ C1] ? set_track_prepare+0x8a/0xd0 [ 6868.610137][ C1] ? irqentry_enter+0x2b/0x60 [ 6868.610390][ C1] ? irqentry_enter+0x2b/0x60 [ 6868.610643][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6868.610887][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6868.611208][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6868.611554][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6868.611865][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6868.612205][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6868.612505][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6868.612841][ C1] netif_receive_skb+0x55/0x280 [ 6868.613105][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6868.613440][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6868.613790][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6868.614108][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6868.614397][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6868.614700][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6868.615027][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6868.615307][ C1] ? arch_stack_walk+0x68/0x100 [ 6868.615571][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6868.615852][ C1] ? irqentry_enter+0x2b/0x60 [ 6868.616107][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6868.616432][ C1] ? irqentry_enter+0x2b/0x60 [ 6868.616685][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6868.617007][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6868.617293][ C1] ? arch_stack_walk+0x68/0x100 [ 6868.617554][ C1] __tcf_classify+0x32c/0x7d0 [ 6868.617807][ C1] tcf_classify+0x283/0x930 [ 6868.618054][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6868.618324][ C1] tc_run+0x2e4/0x5d0 [ 6868.618538][ C1] ? __pfx_tc_run+0x10/0x10 [ 6868.618782][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6868.619049][ C1] ? irqentry_enter+0x2b/0x60 [ 6868.619301][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6868.619589][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6868.619916][ C1] ip_finish_output2+0x786/0x18e0 [ 6868.620187][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6868.620476][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6868.620745][ C1] ? __ip_finish_output+0x10f/0x770 [ 6868.621025][ C1] ip_output+0x16b/0x4f0 [ 6868.621254][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6868.621577][ C1] ? __pfx_ip_output+0x10/0x10 [ 6868.621835][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6868.622192][ C1] ? __pfx_ip_output+0x10/0x10 [ 6868.622454][ C1] __ip_queue_xmit+0x672/0x1910 [ 6868.622718][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6868.623000][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6868.623303][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6868.623593][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6868.623891][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6868.624181][ C1] tcp_delack_timer+0x84/0x240 [ 6868.624439][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6868.624723][ C1] call_timer_fn+0x176/0x430 [ 6868.624969][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6868.625248][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6868.625525][ C1] __run_timers.part.0+0x52d/0x890 [ 6868.625797][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6868.626088][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6868.626391][ C1] ? __pfx___schedule+0x10/0x10 [ 6868.626650][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6868.626968][ C1] run_timer_softirq+0x72/0x100 [ 6868.627232][ C1] __do_softirq+0x1bc/0x7ff [ 6868.627478][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6868.627755][ C1] run_ksoftirqd+0x2e/0x60 [ 6868.627994][ C1] smpboot_thread_fn+0x30e/0x840 [ 6868.628265][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6868.628556][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6868.628849][ C1] kthread+0x292/0x360 [ 6868.629067][ C1] ? __pfx_kthread+0x10/0x10 [ 6868.629317][ C1] ret_from_fork+0x34/0x70 [ 6868.629553][ C1] ? __pfx_kthread+0x10/0x10 [ 6868.629802][ C1] ret_from_fork_asm+0x1b/0x30 [ 6868.630062][ C1] [ 6896.527475][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5316s! [swapper/0:0] [ 6896.527956][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6896.529169][ C0] irq event stamp: 27567077 [ 6896.529411][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6896.529939][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6896.530424][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6896.530938][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6896.531438][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6896.531919][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6896.532562][ C0] RIP: 0010:kasan_check_range+0x4/0x1c0 [ 6896.532858][ C0] Code: 6a 00 5b 5d 41 5c 41 5d c3 cc cc cc cc 66 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 <48> 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 [ 6896.533892][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000246 [ 6896.534220][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6896.534642][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6896.535072][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6896.535498][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6896.535919][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6896.536348][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6896.536828][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6896.537178][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6896.537603][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6896.538029][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6896.538449][ C0] Call Trace: [ 6896.538629][ C0] [ 6896.538787][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6896.539067][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6896.539321][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6896.539617][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6896.539904][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6896.540207][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6896.540485][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6896.540806][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6896.541086][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6896.541364][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6896.541693][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6896.542008][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6896.542342][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6896.542650][ C0] ? kasan_check_range+0x4/0x1c0 [ 6896.542919][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 6896.543222][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6896.543552][ C0] ? get_stack_info+0x36/0xc0 [ 6896.543808][ C0] ? lock_acquire+0x1c1/0x220 [ 6896.544060][ C0] ? lock_release+0x1d5/0x250 [ 6896.544312][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6896.544573][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6896.544858][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6896.545157][ C0] ? lock_acquire+0x1c1/0x220 [ 6896.545408][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6896.545665][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6896.545944][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6896.546193][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6896.546452][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6896.546720][ C0] ? __inet_lookup_established+0x341/0x610 [ 6896.547032][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6896.547336][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6896.547626][ C0] ip_local_deliver+0x19d/0x480 [ 6896.547892][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6896.548183][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6896.548453][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6896.548728][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6896.548991][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6896.549330][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6896.549612][ C0] ip_rcv+0x564/0x740 [ 6896.549827][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6896.550074][ C0] ? set_track_prepare+0x8a/0xd0 [ 6896.550342][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6896.550629][ C0] ? rest_init+0x153/0x260 [ 6896.550870][ C0] ? skb_clone+0x10b/0x330 [ 6896.551111][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6896.551449][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6896.551772][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6896.552067][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6896.552374][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6896.552633][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6896.552873][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6896.553195][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6896.553496][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6896.553835][ C0] ? lock_acquire+0x1c1/0x220 [ 6896.554086][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6896.554393][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6896.554695][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6896.555024][ C0] ? __copy_skb_header+0xaf/0x490 [ 6896.555292][ C0] ? __skb_clone+0x57a/0x760 [ 6896.555535][ C0] netif_receive_skb+0x55/0x280 [ 6896.555795][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6896.556127][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6896.556478][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6896.556789][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6896.557083][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6896.557386][ C0] ? hlock_class+0x4e/0x130 [ 6896.557635][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6896.557967][ C0] ? place_entity+0x21/0x2f0 [ 6896.558218][ C0] ? resched_curr+0x219/0x280 [ 6896.558466][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6896.558733][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6896.559016][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6896.559297][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6896.559562][ C0] ? activate_task+0xf5/0x260 [ 6896.559823][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6896.560102][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6896.560374][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6896.560635][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6896.560927][ C0] ? get_stack_info+0x36/0xc0 [ 6896.561178][ C0] ? stack_access_ok+0xda/0x1f0 [ 6896.561440][ C0] ? get_reg+0x119/0x190 [ 6896.561668][ C0] __tcf_classify+0x32c/0x7d0 [ 6896.561924][ C0] tcf_classify+0x283/0x930 [ 6896.562170][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6896.562505][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6896.562770][ C0] ? arch_stack_walk+0x8c/0x100 [ 6896.563031][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6896.563331][ C0] tc_run+0x2e4/0x5d0 [ 6896.563547][ C0] ? __pfx_tc_run+0x10/0x10 [ 6896.563790][ C0] ? lock_acquire+0x1c1/0x220 [ 6896.564040][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6896.564313][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6896.564583][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6896.564869][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6896.565146][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6896.565463][ C0] ? neigh_hh_output+0x348/0x590 [ 6896.565735][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6896.566011][ C0] ip_finish_output2+0x786/0x18e0 [ 6896.566279][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6896.566574][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6896.566928][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6896.567221][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6896.567485][ C0] ? __ip_finish_output+0x10f/0x770 [ 6896.567766][ C0] ip_output+0x16b/0x4f0 [ 6896.568002][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6896.568284][ C0] ? __pfx_ip_output+0x10/0x10 [ 6896.568542][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6896.568842][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6896.569111][ C0] ? ip_local_out+0x114/0x3b0 [ 6896.569363][ C0] __ip_queue_xmit+0x672/0x1910 [ 6896.569623][ C0] ? __skb_clone+0x57a/0x760 [ 6896.569868][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6896.570159][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6896.570458][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6896.570782][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6896.571041][ C0] ? tcp_current_mss+0x40a/0x510 [ 6896.571309][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6896.571589][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6896.571870][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6896.572128][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6896.572395][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6896.572711][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6896.572991][ C0] ? ktime_get+0xb6/0x190 [ 6896.573234][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6896.573506][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6896.573790][ C0] tcp_write_timer+0x82/0x1d0 [ 6896.574042][ C0] call_timer_fn+0x176/0x430 [ 6896.574292][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6896.574568][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6896.574840][ C0] __run_timers.part.0+0x52d/0x890 [ 6896.575116][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6896.575398][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6896.575702][ C0] ? lock_acquire+0x1c1/0x220 [ 6896.575952][ C0] ? clockevents_program_event+0xf6/0x300 [ 6896.576257][ C0] ? lock_release+0x1d5/0x250 [ 6896.576504][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6896.576779][ C0] ? ktime_get+0xb6/0x190 [ 6896.577010][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6896.577308][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6896.577624][ C0] run_timer_softirq+0x72/0x100 [ 6896.577884][ C0] __do_softirq+0x1bc/0x7ff [ 6896.578130][ C0] irq_exit_rcu+0x98/0xc0 [ 6896.578360][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6896.578661][ C0] [ 6896.578820][ C0] [ 6896.578980][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6896.579302][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6896.579570][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6896.580589][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6896.580914][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6896.581335][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6896.581754][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6896.582174][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6896.582594][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6896.583014][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6896.583325][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6896.583602][ C0] default_idle_call+0x69/0xa0 [ 6896.583856][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6896.584123][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6896.584412][ C0] ? lock_release+0x1d5/0x250 [ 6896.584668][ C0] do_idle+0xfb/0x160 [ 6896.584888][ C0] cpu_startup_entry+0x55/0x60 [ 6896.585147][ C0] rest_init+0x153/0x260 [ 6896.585372][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6896.585665][ C0] arch_call_rest_init+0x13/0x40 [ 6896.585938][ C0] start_kernel+0x314/0x3d0 [ 6896.586183][ C0] x86_64_start_reservations+0x18/0x30 [ 6896.586477][ C0] x86_64_start_kernel+0xba/0x110 [ 6896.586749][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6896.587083][ C0] [ 6896.587249][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5316s! [ksoftirqd/1:22] [ 6896.587718][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6896.588912][ C1] irq event stamp: 3886976 [ 6896.589150][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6896.589652][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6896.590153][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6896.590657][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6896.591148][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6896.591644][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6896.592300][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6896.592644][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6896.593672][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6896.593999][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6896.594418][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6896.594836][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6896.595257][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6896.595675][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6896.596093][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6896.596560][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6896.596913][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6896.597332][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6896.597753][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6896.598178][ C1] Call Trace: [ 6896.598367][ C1] [ 6896.598523][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6896.598797][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6896.599054][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6896.599344][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6896.599634][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6896.599945][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6896.600230][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6896.600552][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6896.600825][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6896.601157][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6896.601468][ C1] [ 6896.601625][ C1] [ 6896.601782][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6896.602114][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6896.602420][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6896.602732][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6896.603033][ C1] ? run_ksoftirqd+0xb/0x60 [ 6896.603279][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6896.603611][ C1] ? __orc_find+0x9c/0xf0 [ 6896.603841][ C1] ? lock_acquire+0x1c1/0x220 [ 6896.604094][ C1] ? irqentry_enter+0x2b/0x60 [ 6896.604346][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6896.604607][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6896.604893][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6896.605192][ C1] ? lock_acquire+0x1c1/0x220 [ 6896.605443][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6896.605698][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6896.605974][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6896.606224][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6896.606482][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6896.606752][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6896.607042][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6896.607332][ C1] ip_local_deliver+0x19d/0x480 [ 6896.607597][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6896.607887][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6896.608157][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6896.608434][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6896.608697][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6896.609037][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6896.609312][ C1] ip_rcv+0x564/0x740 [ 6896.609525][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6896.609766][ C1] ? set_track_prepare+0x8a/0xd0 [ 6896.610033][ C1] ? irqentry_enter+0x2b/0x60 [ 6896.610287][ C1] ? irqentry_enter+0x2b/0x60 [ 6896.610540][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6896.610784][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6896.611106][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6896.611451][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6896.611763][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6896.612103][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6896.612402][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6896.612739][ C1] netif_receive_skb+0x55/0x280 [ 6896.613002][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6896.613339][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6896.613687][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6896.614004][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6896.614293][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6896.614597][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6896.614923][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6896.615206][ C1] ? arch_stack_walk+0x68/0x100 [ 6896.615471][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6896.615752][ C1] ? irqentry_enter+0x2b/0x60 [ 6896.616005][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6896.616330][ C1] ? irqentry_enter+0x2b/0x60 [ 6896.616583][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6896.616905][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6896.617189][ C1] ? arch_stack_walk+0x68/0x100 [ 6896.617450][ C1] __tcf_classify+0x32c/0x7d0 [ 6896.617704][ C1] tcf_classify+0x283/0x930 [ 6896.617946][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6896.618216][ C1] tc_run+0x2e4/0x5d0 [ 6896.618432][ C1] ? __pfx_tc_run+0x10/0x10 [ 6896.618677][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6896.618944][ C1] ? irqentry_enter+0x2b/0x60 [ 6896.619200][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6896.619488][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6896.619816][ C1] ip_finish_output2+0x786/0x18e0 [ 6896.620089][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6896.620379][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6896.620649][ C1] ? __ip_finish_output+0x10f/0x770 [ 6896.620928][ C1] ip_output+0x16b/0x4f0 [ 6896.621157][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6896.621481][ C1] ? __pfx_ip_output+0x10/0x10 [ 6896.621738][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6896.622098][ C1] ? __pfx_ip_output+0x10/0x10 [ 6896.622359][ C1] __ip_queue_xmit+0x672/0x1910 [ 6896.622621][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6896.622903][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6896.623208][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6896.623499][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6896.623798][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6896.624088][ C1] tcp_delack_timer+0x84/0x240 [ 6896.624346][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6896.624631][ C1] call_timer_fn+0x176/0x430 [ 6896.624877][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6896.625156][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6896.625432][ C1] __run_timers.part.0+0x52d/0x890 [ 6896.625703][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6896.625994][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6896.626299][ C1] ? __pfx___schedule+0x10/0x10 [ 6896.626559][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6896.626876][ C1] run_timer_softirq+0x72/0x100 [ 6896.627141][ C1] __do_softirq+0x1bc/0x7ff [ 6896.627387][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6896.627665][ C1] run_ksoftirqd+0x2e/0x60 [ 6896.627904][ C1] smpboot_thread_fn+0x30e/0x840 [ 6896.628175][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6896.628467][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6896.628761][ C1] kthread+0x292/0x360 [ 6896.628979][ C1] ? __pfx_kthread+0x10/0x10 [ 6896.629229][ C1] ret_from_fork+0x34/0x70 [ 6896.629466][ C1] ? __pfx_kthread+0x10/0x10 [ 6896.629715][ C1] ret_from_fork_asm+0x1b/0x30 [ 6896.629976][ C1] [ 6920.535025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6920.535418][ C1] rcu: 1-....: (5709237 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1351365 [ 6920.536016][ C1] rcu: (t=5726226 jiffies g=1007429 q=31 ncpus=4) [ 6920.536363][ C1] Sending NMI from CPU 1 to CPUs 0: [ 6920.536651][ C0] NMI backtrace for cpu 0 [ 6920.536659][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6920.536663][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6920.536666][ C0] RIP: 0010:kasan_check_range+0x1b/0x1c0 [ 6920.536677][ C0] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 53 <72> 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 23 [ 6920.536680][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000286 [ 6920.536685][ C0] RAX: ffff88800a099b5c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6920.536686][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6920.536688][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6920.536690][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6920.536692][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6920.536693][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6920.536696][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6920.536699][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6920.536701][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6920.536703][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6920.536704][ C0] Call Trace: [ 6920.536708][ C0] [ 6920.536712][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 6920.536718][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6920.536723][ C0] ? nmi_handle+0x156/0x420 [ 6920.536729][ C0] ? default_do_nmi+0x41/0x100 [ 6920.536734][ C0] ? exc_nmi+0xf3/0x120 [ 6920.536736][ C0] ? end_repeat_nmi+0xf/0x60 [ 6920.536741][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6920.536747][ C0] ? kasan_check_range+0x1b/0x1c0 [ 6920.536751][ C0] ? kasan_check_range+0x1b/0x1c0 [ 6920.536755][ C0] ? kasan_check_range+0x1b/0x1c0 [ 6920.536759][ C0] [ 6920.536759][ C0] [ 6920.536761][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 6920.536765][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6920.536768][ C0] ? get_stack_info+0x36/0xc0 [ 6920.536775][ C0] ? lock_acquire+0x1c1/0x220 [ 6920.536780][ C0] ? lock_release+0x1d5/0x250 [ 6920.536784][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6920.536787][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6920.536790][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6920.536794][ C0] ? lock_acquire+0x1c1/0x220 [ 6920.536796][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6920.536802][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6920.536806][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6920.536813][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6920.536816][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6920.536821][ C0] ? __inet_lookup_established+0x341/0x610 [ 6920.536827][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6920.536834][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6920.536838][ C0] ip_local_deliver+0x19d/0x480 [ 6920.536841][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6920.536844][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6920.536849][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6920.536853][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6920.536856][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6920.536859][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6920.536870][ C0] ip_rcv+0x564/0x740 [ 6920.536873][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6920.536876][ C0] ? set_track_prepare+0x8a/0xd0 [ 6920.536881][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6920.536883][ C0] ? rest_init+0x153/0x260 [ 6920.536886][ C0] ? skb_clone+0x10b/0x330 [ 6920.536891][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6920.536898][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6920.536903][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6920.536908][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6920.536917][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6920.536920][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6920.536923][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6920.536928][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6920.536931][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6920.536935][ C0] ? lock_acquire+0x1c1/0x220 [ 6920.536937][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6920.536941][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6920.536944][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6920.536947][ C0] ? __copy_skb_header+0xaf/0x490 [ 6920.536950][ C0] ? __skb_clone+0x57a/0x760 [ 6920.536953][ C0] netif_receive_skb+0x55/0x280 [ 6920.536955][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6920.536963][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6920.536970][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6920.536977][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6920.536982][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6920.536991][ C0] ? hlock_class+0x4e/0x130 [ 6920.536996][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6920.537006][ C0] ? place_entity+0x21/0x2f0 [ 6920.537010][ C0] ? resched_curr+0x219/0x280 [ 6920.537013][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6920.537016][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6920.537019][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6920.537025][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6920.537027][ C0] ? activate_task+0xf5/0x260 [ 6920.537030][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6920.537035][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6920.537038][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6920.537041][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6920.537044][ C0] ? get_stack_info+0x36/0xc0 [ 6920.537048][ C0] ? stack_access_ok+0xda/0x1f0 [ 6920.537050][ C0] ? get_reg+0x119/0x190 [ 6920.537054][ C0] __tcf_classify+0x32c/0x7d0 [ 6920.537058][ C0] tcf_classify+0x283/0x930 [ 6920.537061][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6920.537066][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6920.537068][ C0] ? arch_stack_walk+0x8c/0x100 [ 6920.537073][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6920.537077][ C0] tc_run+0x2e4/0x5d0 [ 6920.537081][ C0] ? __pfx_tc_run+0x10/0x10 [ 6920.537085][ C0] ? lock_acquire+0x1c1/0x220 [ 6920.537087][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6920.537091][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6920.537097][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6920.537100][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6920.537104][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6920.537109][ C0] ? neigh_hh_output+0x348/0x590 [ 6920.537113][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6920.537117][ C0] ip_finish_output2+0x786/0x18e0 [ 6920.537121][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6920.537127][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6920.537135][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6920.537138][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6920.537142][ C0] ? __ip_finish_output+0x10f/0x770 [ 6920.537146][ C0] ip_output+0x16b/0x4f0 [ 6920.537150][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6920.537154][ C0] ? __pfx_ip_output+0x10/0x10 [ 6920.537158][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6920.537163][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6920.537166][ C0] ? ip_local_out+0x114/0x3b0 [ 6920.537170][ C0] __ip_queue_xmit+0x672/0x1910 [ 6920.537174][ C0] ? __skb_clone+0x57a/0x760 [ 6920.537177][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6920.537184][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6920.537189][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6920.537192][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6920.537198][ C0] ? tcp_current_mss+0x40a/0x510 [ 6920.537201][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6920.537204][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6920.537207][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6920.537209][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6920.537212][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6920.537216][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6920.537221][ C0] ? ktime_get+0xb6/0x190 [ 6920.537225][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6920.537229][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6920.537232][ C0] tcp_write_timer+0x82/0x1d0 [ 6920.537236][ C0] call_timer_fn+0x176/0x430 [ 6920.537240][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6920.537244][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6920.537249][ C0] __run_timers.part.0+0x52d/0x890 [ 6920.537252][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6920.537257][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6920.537259][ C0] ? lock_acquire+0x1c1/0x220 [ 6920.537262][ C0] ? clockevents_program_event+0xf6/0x300 [ 6920.537266][ C0] ? lock_release+0x1d5/0x250 [ 6920.537269][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6920.537271][ C0] ? ktime_get+0xb6/0x190 [ 6920.537274][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6920.537278][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6920.537282][ C0] run_timer_softirq+0x72/0x100 [ 6920.537285][ C0] __do_softirq+0x1bc/0x7ff [ 6920.537290][ C0] irq_exit_rcu+0x98/0xc0 [ 6920.537293][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6920.537297][ C0] [ 6920.537298][ C0] [ 6920.537299][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6920.537305][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6920.537308][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6920.537310][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6920.537312][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6920.537314][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6920.537315][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6920.537317][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6920.537318][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6920.537322][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6920.537325][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6920.537329][ C0] default_idle_call+0x69/0xa0 [ 6920.537331][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6920.537334][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6920.537339][ C0] ? lock_release+0x1d5/0x250 [ 6920.537343][ C0] do_idle+0xfb/0x160 [ 6920.537346][ C0] cpu_startup_entry+0x55/0x60 [ 6920.537349][ C0] rest_init+0x153/0x260 [ 6920.537352][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6920.537358][ C0] arch_call_rest_init+0x13/0x40 [ 6920.537363][ C0] start_kernel+0x314/0x3d0 [ 6920.537367][ C0] x86_64_start_reservations+0x18/0x30 [ 6920.537372][ C0] x86_64_start_kernel+0xba/0x110 [ 6920.537376][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6920.537383][ C0] [ 6920.537648][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6920.591932][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6920.592585][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6920.592935][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6920.593966][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6920.594291][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6920.594711][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6920.595135][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6920.595556][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6920.595977][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6920.596400][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6920.596873][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6920.597230][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6920.597655][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6920.598083][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6920.598511][ C1] Call Trace: [ 6920.598691][ C1] [ 6920.598850][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6920.599143][ C1] ? print_cpu_stall+0x263/0x6a0 [ 6920.599410][ C1] ? check_cpu_stall+0x284/0x500 [ 6920.599673][ C1] ? rcu_pending+0x92/0x360 [ 6920.599918][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6920.600205][ C1] ? update_process_times+0xb9/0x110 [ 6920.600486][ C1] ? tick_sched_handle+0x67/0x130 [ 6920.600757][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6920.601062][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6920.601315][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6920.601651][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6920.601937][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6920.602239][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6920.602516][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6920.602838][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6920.603121][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6920.603449][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6920.603763][ C1] [ 6920.603919][ C1] [ 6920.604078][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6920.604405][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6920.604713][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6920.605026][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6920.605328][ C1] ? run_ksoftirqd+0xb/0x60 [ 6920.605569][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6920.605893][ C1] ? __orc_find+0x9c/0xf0 [ 6920.606128][ C1] ? lock_acquire+0x1c1/0x220 [ 6920.606382][ C1] ? irqentry_enter+0x2b/0x60 [ 6920.606637][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6920.606904][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6920.607193][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6920.607494][ C1] ? lock_acquire+0x1c1/0x220 [ 6920.607744][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6920.607997][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6920.608270][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6920.608519][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6920.608779][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6920.609056][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6920.609350][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6920.609644][ C1] ip_local_deliver+0x19d/0x480 [ 6920.609903][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6920.610187][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6920.610449][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6920.610731][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6920.610997][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6920.611335][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6920.611611][ C1] ip_rcv+0x564/0x740 [ 6920.611829][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6920.612075][ C1] ? set_track_prepare+0x8a/0xd0 [ 6920.612343][ C1] ? irqentry_enter+0x2b/0x60 [ 6920.612594][ C1] ? irqentry_enter+0x2b/0x60 [ 6920.612845][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6920.613093][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6920.613415][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6920.613758][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6920.614071][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6920.614409][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6920.614707][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6920.615045][ C1] netif_receive_skb+0x55/0x280 [ 6920.615308][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6920.615641][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6920.615992][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6920.616308][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6920.616603][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6920.616910][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6920.617246][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6920.617531][ C1] ? arch_stack_walk+0x68/0x100 [ 6920.617792][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6920.618071][ C1] ? irqentry_enter+0x2b/0x60 [ 6920.618326][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6920.618645][ C1] ? irqentry_enter+0x2b/0x60 [ 6920.618898][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6920.619226][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6920.619509][ C1] ? arch_stack_walk+0x68/0x100 [ 6920.619773][ C1] __tcf_classify+0x32c/0x7d0 [ 6920.620030][ C1] tcf_classify+0x283/0x930 [ 6920.620277][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6920.620549][ C1] tc_run+0x2e4/0x5d0 [ 6920.620768][ C1] ? __pfx_tc_run+0x10/0x10 [ 6920.621015][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6920.621286][ C1] ? irqentry_enter+0x2b/0x60 [ 6920.621537][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6920.621824][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6920.622146][ C1] ip_finish_output2+0x786/0x18e0 [ 6920.622421][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6920.622715][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6920.622984][ C1] ? __ip_finish_output+0x10f/0x770 [ 6920.623263][ C1] ip_output+0x16b/0x4f0 [ 6920.623488][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6920.623809][ C1] ? __pfx_ip_output+0x10/0x10 [ 6920.624064][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6920.624423][ C1] ? __pfx_ip_output+0x10/0x10 [ 6920.624683][ C1] __ip_queue_xmit+0x672/0x1910 [ 6920.624944][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6920.625225][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6920.625520][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6920.625805][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6920.626098][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6920.626382][ C1] tcp_delack_timer+0x84/0x240 [ 6920.626636][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6920.626925][ C1] call_timer_fn+0x176/0x430 [ 6920.627175][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6920.627448][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6920.627733][ C1] __run_timers.part.0+0x52d/0x890 [ 6920.628009][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6920.628296][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6920.628597][ C1] ? __pfx___schedule+0x10/0x10 [ 6920.628861][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6920.629187][ C1] run_timer_softirq+0x72/0x100 [ 6920.629447][ C1] __do_softirq+0x1bc/0x7ff [ 6920.629691][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6920.629963][ C1] run_ksoftirqd+0x2e/0x60 [ 6920.630206][ C1] smpboot_thread_fn+0x30e/0x840 [ 6920.630470][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6920.630763][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6920.631054][ C1] kthread+0x292/0x360 [ 6920.631277][ C1] ? __pfx_kthread+0x10/0x10 [ 6920.631525][ C1] ret_from_fork+0x34/0x70 [ 6920.631765][ C1] ? __pfx_kthread+0x10/0x10 [ 6920.632009][ C1] ret_from_fork_asm+0x1b/0x30 [ 6920.632272][ C1] [ 6944.536460][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5361s! [ksoftirqd/1:22] [ 6944.536933][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6944.538132][ C1] irq event stamp: 3886976 [ 6944.538371][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6944.538875][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6944.539381][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6944.539889][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6944.540382][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6944.540879][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6944.541529][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6944.541876][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6944.542906][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 6944.543228][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6944.543650][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6944.544072][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6944.544490][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6944.544908][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6944.545328][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6944.545796][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6944.546148][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6944.546571][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6944.546999][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6944.547421][ C1] Call Trace: [ 6944.547600][ C1] [ 6944.547760][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6944.548038][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6944.548298][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6944.548589][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6944.548879][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6944.549186][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6944.549470][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6944.549797][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6944.550073][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6944.550401][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6944.550718][ C1] [ 6944.550874][ C1] [ 6944.551032][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6944.551362][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6944.551671][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6944.551985][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6944.552289][ C1] ? run_ksoftirqd+0xb/0x60 [ 6944.552535][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6944.552864][ C1] ? __orc_find+0x9c/0xf0 [ 6944.553099][ C1] ? lock_acquire+0x1c1/0x220 [ 6944.553352][ C1] ? irqentry_enter+0x2b/0x60 [ 6944.553603][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6944.553862][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6944.554147][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6944.554447][ C1] ? lock_acquire+0x1c1/0x220 [ 6944.554702][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6944.554962][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6944.555237][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6944.555482][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6944.555740][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6944.556014][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6944.556305][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6944.556596][ C1] ip_local_deliver+0x19d/0x480 [ 6944.556859][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6944.557149][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6944.557418][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6944.557695][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6944.557960][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6944.558300][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6944.558574][ C1] ip_rcv+0x564/0x740 [ 6944.558789][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6944.559030][ C1] ? set_track_prepare+0x8a/0xd0 [ 6944.559296][ C1] ? irqentry_enter+0x2b/0x60 [ 6944.559553][ C1] ? irqentry_enter+0x2b/0x60 [ 6944.559811][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6944.560058][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6944.560377][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6944.560724][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6944.561039][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6944.561380][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6944.561680][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6944.562017][ C1] netif_receive_skb+0x55/0x280 [ 6944.562281][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6944.562611][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6944.562976][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6944.563296][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6944.563585][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6944.563889][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6944.564219][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6944.564501][ C1] ? arch_stack_walk+0x68/0x100 [ 6944.564766][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6944.565047][ C1] ? irqentry_enter+0x2b/0x60 [ 6944.565303][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6944.565624][ C1] ? irqentry_enter+0x2b/0x60 [ 6944.565872][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6944.566194][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6944.566477][ C1] ? arch_stack_walk+0x68/0x100 [ 6944.566737][ C1] __tcf_classify+0x32c/0x7d0 [ 6944.566988][ C1] tcf_classify+0x283/0x930 [ 6944.567231][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6944.567499][ C1] tc_run+0x2e4/0x5d0 [ 6944.567715][ C1] ? __pfx_tc_run+0x10/0x10 [ 6944.567959][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6944.568226][ C1] ? irqentry_enter+0x2b/0x60 [ 6944.568482][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6944.568773][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6944.569096][ C1] ip_finish_output2+0x786/0x18e0 [ 6944.569366][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6944.569656][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6944.569923][ C1] ? __ip_finish_output+0x10f/0x770 [ 6944.570201][ C1] ip_output+0x16b/0x4f0 [ 6944.570430][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6944.570750][ C1] ? __pfx_ip_output+0x10/0x10 [ 6944.571005][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6944.571363][ C1] ? __pfx_ip_output+0x10/0x10 [ 6944.571622][ C1] __ip_queue_xmit+0x672/0x1910 [ 6944.571882][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6944.572163][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6944.572457][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6944.572741][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6944.573047][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6944.573337][ C1] tcp_delack_timer+0x84/0x240 [ 6944.573601][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6944.573888][ C1] call_timer_fn+0x176/0x430 [ 6944.574137][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6944.574416][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6944.574694][ C1] __run_timers.part.0+0x52d/0x890 [ 6944.574968][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6944.575261][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6944.575567][ C1] ? __pfx___schedule+0x10/0x10 [ 6944.575828][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6944.576153][ C1] run_timer_softirq+0x72/0x100 [ 6944.576417][ C1] __do_softirq+0x1bc/0x7ff [ 6944.576666][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6944.576942][ C1] run_ksoftirqd+0x2e/0x60 [ 6944.577180][ C1] smpboot_thread_fn+0x30e/0x840 [ 6944.577448][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6944.577738][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6944.578034][ C1] kthread+0x292/0x360 [ 6944.578253][ C1] ? __pfx_kthread+0x10/0x10 [ 6944.578502][ C1] ret_from_fork+0x34/0x70 [ 6944.578742][ C1] ? __pfx_kthread+0x10/0x10 [ 6944.578991][ C1] ret_from_fork_asm+0x1b/0x30 [ 6944.579253][ C1] [ 6948.527470][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5365s! [swapper/0:0] [ 6948.527946][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6948.529157][ C0] irq event stamp: 27567077 [ 6948.529400][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6948.529934][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6948.530418][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6948.530928][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6948.531429][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6948.531910][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6948.532561][ C0] RIP: 0010:kasan_check_range+0x106/0x1c0 [ 6948.532875][ C0] Code: 00 74 f2 48 89 c2 b8 01 00 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff <5b> b8 01 00 00 00 5d 41 5c c3 cc cc cc cc 41 bc 08 00 00 00 45 29 [ 6948.533902][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000246 [ 6948.534228][ C0] RAX: ffffed100141336c RBX: ffffed100141336c RCX: ffffffff90c7aaa0 [ 6948.534653][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6948.535080][ C0] RBP: ffffed100141336b R08: 0000000000000000 R09: ffffed100141336b [ 6948.535500][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6948.535921][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6948.536347][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6948.536824][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6948.537172][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6948.537601][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6948.538023][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6948.538442][ C0] Call Trace: [ 6948.538620][ C0] [ 6948.538784][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6948.539061][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6948.539318][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6948.539607][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6948.539895][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6948.540203][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6948.540485][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6948.540809][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6948.541083][ C0] ? hrtimer_interrupt+0x31a/0x770 [ 6948.541358][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6948.541633][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6948.541964][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6948.542278][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6948.542611][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6948.542922][ C0] ? kasan_check_range+0x106/0x1c0 [ 6948.543196][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 6948.543493][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6948.543824][ C0] ? get_stack_info+0x36/0xc0 [ 6948.544076][ C0] ? lock_acquire+0x1c1/0x220 [ 6948.544327][ C0] ? lock_release+0x1d5/0x250 [ 6948.544576][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6948.544834][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6948.545118][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6948.545416][ C0] ? lock_acquire+0x1c1/0x220 [ 6948.545671][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6948.545929][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6948.546205][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6948.546450][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6948.546706][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6948.546975][ C0] ? __inet_lookup_established+0x341/0x610 [ 6948.547287][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6948.547577][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6948.547868][ C0] ip_local_deliver+0x19d/0x480 [ 6948.548128][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6948.548419][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6948.548684][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6948.548965][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6948.549232][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6948.549566][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6948.549845][ C0] ip_rcv+0x564/0x740 [ 6948.550061][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6948.550307][ C0] ? set_track_prepare+0x8a/0xd0 [ 6948.550574][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6948.550860][ C0] ? rest_init+0x153/0x260 [ 6948.551101][ C0] ? skb_clone+0x10b/0x330 [ 6948.551346][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6948.551682][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6948.552006][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6948.552300][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6948.552607][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6948.552873][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6948.553120][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6948.553435][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6948.553737][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6948.554078][ C0] ? lock_acquire+0x1c1/0x220 [ 6948.554328][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6948.554635][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6948.554937][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6948.555267][ C0] ? __copy_skb_header+0xaf/0x490 [ 6948.555535][ C0] ? __skb_clone+0x57a/0x760 [ 6948.555779][ C0] netif_receive_skb+0x55/0x280 [ 6948.556039][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6948.556370][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6948.556720][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6948.557033][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6948.557325][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6948.557628][ C0] ? hlock_class+0x4e/0x130 [ 6948.557880][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6948.558213][ C0] ? place_entity+0x21/0x2f0 [ 6948.558462][ C0] ? resched_curr+0x219/0x280 [ 6948.558709][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6948.558975][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6948.559261][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6948.559541][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6948.559804][ C0] ? activate_task+0xf5/0x260 [ 6948.560061][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6948.560338][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6948.560608][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6948.560868][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6948.561160][ C0] ? get_stack_info+0x36/0xc0 [ 6948.561408][ C0] ? stack_access_ok+0xda/0x1f0 [ 6948.561665][ C0] ? get_reg+0x119/0x190 [ 6948.561892][ C0] __tcf_classify+0x32c/0x7d0 [ 6948.562146][ C0] tcf_classify+0x283/0x930 [ 6948.562391][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6948.562726][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6948.563002][ C0] ? arch_stack_walk+0x8c/0x100 [ 6948.563268][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6948.563562][ C0] tc_run+0x2e4/0x5d0 [ 6948.563778][ C0] ? __pfx_tc_run+0x10/0x10 [ 6948.564021][ C0] ? lock_acquire+0x1c1/0x220 [ 6948.564270][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6948.564543][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6948.564813][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6948.565098][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6948.565375][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6948.565692][ C0] ? neigh_hh_output+0x348/0x590 [ 6948.565961][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6948.566238][ C0] ip_finish_output2+0x786/0x18e0 [ 6948.566505][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6948.566798][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6948.567153][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6948.567443][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6948.567707][ C0] ? __ip_finish_output+0x10f/0x770 [ 6948.567996][ C0] ip_output+0x16b/0x4f0 [ 6948.568228][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6948.568508][ C0] ? __pfx_ip_output+0x10/0x10 [ 6948.568764][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6948.569064][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6948.569331][ C0] ? ip_local_out+0x114/0x3b0 [ 6948.569583][ C0] __ip_queue_xmit+0x672/0x1910 [ 6948.569843][ C0] ? __skb_clone+0x57a/0x760 [ 6948.570088][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6948.570372][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6948.570670][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6948.570993][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6948.571253][ C0] ? tcp_current_mss+0x40a/0x510 [ 6948.571518][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6948.571798][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6948.572083][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6948.572340][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6948.572606][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6948.572931][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6948.573209][ C0] ? ktime_get+0xb6/0x190 [ 6948.573440][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6948.573711][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6948.573994][ C0] tcp_write_timer+0x82/0x1d0 [ 6948.574246][ C0] call_timer_fn+0x176/0x430 [ 6948.574495][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6948.574772][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6948.575044][ C0] __run_timers.part.0+0x52d/0x890 [ 6948.575320][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6948.575601][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6948.575904][ C0] ? lock_acquire+0x1c1/0x220 [ 6948.576155][ C0] ? clockevents_program_event+0xf6/0x300 [ 6948.576459][ C0] ? lock_release+0x1d5/0x250 [ 6948.576705][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6948.576982][ C0] ? ktime_get+0xb6/0x190 [ 6948.577215][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6948.577512][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6948.577830][ C0] run_timer_softirq+0x72/0x100 [ 6948.578090][ C0] __do_softirq+0x1bc/0x7ff [ 6948.578334][ C0] irq_exit_rcu+0x98/0xc0 [ 6948.578564][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6948.578863][ C0] [ 6948.579022][ C0] [ 6948.579181][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6948.579501][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6948.579768][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6948.580784][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6948.581108][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6948.581526][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6948.581943][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6948.582360][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6948.582778][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6948.583214][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6948.583519][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6948.583795][ C0] default_idle_call+0x69/0xa0 [ 6948.584050][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6948.584314][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6948.584605][ C0] ? lock_release+0x1d5/0x250 [ 6948.584860][ C0] do_idle+0xfb/0x160 [ 6948.585080][ C0] cpu_startup_entry+0x55/0x60 [ 6948.585337][ C0] rest_init+0x153/0x260 [ 6948.585561][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6948.585855][ C0] arch_call_rest_init+0x13/0x40 [ 6948.586127][ C0] start_kernel+0x314/0x3d0 [ 6948.586370][ C0] x86_64_start_reservations+0x18/0x30 [ 6948.586662][ C0] x86_64_start_kernel+0xba/0x110 [ 6948.586933][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6948.587269][ C0] [ 6972.536460][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5387s! [ksoftirqd/1:22] [ 6972.536936][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6972.538131][ C1] irq event stamp: 3886976 [ 6972.538366][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 6972.538872][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 6972.539371][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 6972.539877][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 6972.540367][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6972.540867][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6972.541522][ C1] RIP: 0010:kasan_check_range+0x106/0x1c0 [ 6972.541833][ C1] Code: 00 74 f2 48 89 c2 b8 01 00 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff <5b> b8 01 00 00 00 5d 41 5c c3 cc cc cc cc 41 bc 08 00 00 00 45 29 [ 6972.542871][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000246 [ 6972.543194][ C1] RAX: ffffed10014131c4 RBX: ffffed10014131c4 RCX: ffffffff90c7aaa0 [ 6972.543614][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6972.544037][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: ffffed10014131c3 [ 6972.544457][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6972.544877][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6972.545298][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6972.545772][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6972.546126][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6972.546550][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6972.546977][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6972.547406][ C1] Call Trace: [ 6972.547587][ C1] [ 6972.547745][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6972.548023][ C1] ? __run_hrtimer+0x1c3/0x710 [ 6972.548286][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6972.548579][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6972.548870][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6972.549176][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6972.549458][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6972.549784][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6972.550059][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6972.550388][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 6972.550701][ C1] [ 6972.550858][ C1] [ 6972.551015][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6972.551345][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6972.551655][ C1] ? kasan_check_range+0x106/0x1c0 [ 6972.551932][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 6972.552228][ C1] ? run_ksoftirqd+0xb/0x60 [ 6972.552471][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6972.552804][ C1] ? __orc_find+0x9c/0xf0 [ 6972.553037][ C1] ? lock_acquire+0x1c1/0x220 [ 6972.553290][ C1] ? irqentry_enter+0x2b/0x60 [ 6972.553544][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6972.553804][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6972.554090][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6972.554388][ C1] ? lock_acquire+0x1c1/0x220 [ 6972.554643][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6972.554902][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6972.555180][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6972.555430][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6972.555691][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6972.555962][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6972.556256][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6972.556549][ C1] ip_local_deliver+0x19d/0x480 [ 6972.556812][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6972.557102][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6972.557369][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6972.557647][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6972.557911][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6972.558252][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6972.558528][ C1] ip_rcv+0x564/0x740 [ 6972.558739][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6972.558979][ C1] ? set_track_prepare+0x8a/0xd0 [ 6972.559245][ C1] ? irqentry_enter+0x2b/0x60 [ 6972.559500][ C1] ? irqentry_enter+0x2b/0x60 [ 6972.559756][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6972.560002][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6972.560326][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6972.560670][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6972.560983][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6972.561324][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6972.561629][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6972.561967][ C1] netif_receive_skb+0x55/0x280 [ 6972.562230][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6972.562562][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6972.562918][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6972.563240][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6972.563532][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6972.563837][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6972.564168][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6972.564449][ C1] ? arch_stack_walk+0x68/0x100 [ 6972.564717][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6972.564998][ C1] ? irqentry_enter+0x2b/0x60 [ 6972.565255][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6972.565580][ C1] ? irqentry_enter+0x2b/0x60 [ 6972.565831][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6972.566158][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6972.566443][ C1] ? arch_stack_walk+0x68/0x100 [ 6972.566705][ C1] __tcf_classify+0x32c/0x7d0 [ 6972.566959][ C1] tcf_classify+0x283/0x930 [ 6972.567208][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6972.567477][ C1] tc_run+0x2e4/0x5d0 [ 6972.567691][ C1] ? __pfx_tc_run+0x10/0x10 [ 6972.567934][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6972.568201][ C1] ? irqentry_enter+0x2b/0x60 [ 6972.568456][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6972.568746][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6972.569073][ C1] ip_finish_output2+0x786/0x18e0 [ 6972.569343][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6972.569634][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6972.569902][ C1] ? __ip_finish_output+0x10f/0x770 [ 6972.570180][ C1] ip_output+0x16b/0x4f0 [ 6972.570409][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6972.570731][ C1] ? __pfx_ip_output+0x10/0x10 [ 6972.570985][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6972.571345][ C1] ? __pfx_ip_output+0x10/0x10 [ 6972.571605][ C1] __ip_queue_xmit+0x672/0x1910 [ 6972.571867][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6972.572149][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6972.572445][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6972.572735][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6972.573037][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6972.573324][ C1] tcp_delack_timer+0x84/0x240 [ 6972.573581][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6972.573865][ C1] call_timer_fn+0x176/0x430 [ 6972.574111][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6972.574389][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6972.574667][ C1] __run_timers.part.0+0x52d/0x890 [ 6972.574939][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6972.575234][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6972.575542][ C1] ? __pfx___schedule+0x10/0x10 [ 6972.575802][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6972.576123][ C1] run_timer_softirq+0x72/0x100 [ 6972.576390][ C1] __do_softirq+0x1bc/0x7ff [ 6972.576636][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6972.576913][ C1] run_ksoftirqd+0x2e/0x60 [ 6972.577153][ C1] smpboot_thread_fn+0x30e/0x840 [ 6972.577420][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6972.577710][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6972.578005][ C1] kthread+0x292/0x360 [ 6972.578225][ C1] ? __pfx_kthread+0x10/0x10 [ 6972.578476][ C1] ret_from_fork+0x34/0x70 [ 6972.578713][ C1] ? __pfx_kthread+0x10/0x10 [ 6972.578961][ C1] ret_from_fork_asm+0x1b/0x30 [ 6972.579220][ C1] [ 6976.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5391s! [swapper/0:0] [ 6976.527927][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 6976.529121][ C0] irq event stamp: 27567077 [ 6976.529362][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 6976.529897][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 6976.530385][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 6976.530892][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 6976.531388][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6976.531871][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6976.532513][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6976.532869][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6976.533897][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6976.534228][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6976.534655][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6976.535081][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6976.535503][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6976.535925][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6976.536353][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6976.536830][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6976.537179][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6976.537607][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6976.538028][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6976.538447][ C0] Call Trace: [ 6976.538624][ C0] [ 6976.538780][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6976.539061][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6976.539322][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6976.539616][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6976.539908][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6976.540211][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6976.540493][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6976.540817][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6976.541094][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6976.541371][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6976.541701][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6976.542014][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6976.542346][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6976.542653][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6976.542975][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6976.543282][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6976.543614][ C0] ? get_stack_info+0x36/0xc0 [ 6976.543866][ C0] ? lock_acquire+0x1c1/0x220 [ 6976.544116][ C0] ? lock_release+0x1d5/0x250 [ 6976.544366][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6976.544624][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6976.544909][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6976.545209][ C0] ? lock_acquire+0x1c1/0x220 [ 6976.545464][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6976.545726][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6976.546003][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6976.546252][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6976.546507][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6976.546775][ C0] ? __inet_lookup_established+0x341/0x610 [ 6976.547090][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6976.547382][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6976.547674][ C0] ip_local_deliver+0x19d/0x480 [ 6976.547932][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6976.548217][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6976.548483][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6976.548768][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6976.549036][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6976.549372][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6976.549652][ C0] ip_rcv+0x564/0x740 [ 6976.549868][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6976.550116][ C0] ? set_track_prepare+0x8a/0xd0 [ 6976.550384][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6976.550671][ C0] ? rest_init+0x153/0x260 [ 6976.550915][ C0] ? skb_clone+0x10b/0x330 [ 6976.551156][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6976.551494][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6976.551820][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6976.552116][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6976.552425][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6976.552691][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6976.552937][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6976.553259][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6976.553561][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6976.553900][ C0] ? lock_acquire+0x1c1/0x220 [ 6976.554150][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6976.554458][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6976.554761][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6976.555097][ C0] ? __copy_skb_header+0xaf/0x490 [ 6976.555364][ C0] ? __skb_clone+0x57a/0x760 [ 6976.555608][ C0] netif_receive_skb+0x55/0x280 [ 6976.555870][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6976.556203][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6976.556553][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6976.556865][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6976.557159][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6976.557462][ C0] ? hlock_class+0x4e/0x130 [ 6976.557713][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6976.558045][ C0] ? place_entity+0x21/0x2f0 [ 6976.558296][ C0] ? resched_curr+0x219/0x280 [ 6976.558544][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6976.558811][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6976.559094][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6976.559376][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6976.559641][ C0] ? activate_task+0xf5/0x260 [ 6976.559897][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6976.560175][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6976.560446][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6976.560708][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6976.560999][ C0] ? get_stack_info+0x36/0xc0 [ 6976.561248][ C0] ? stack_access_ok+0xda/0x1f0 [ 6976.561505][ C0] ? get_reg+0x119/0x190 [ 6976.561732][ C0] __tcf_classify+0x32c/0x7d0 [ 6976.561987][ C0] tcf_classify+0x283/0x930 [ 6976.562233][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6976.562566][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6976.562839][ C0] ? arch_stack_walk+0x8c/0x100 [ 6976.563110][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6976.563404][ C0] tc_run+0x2e4/0x5d0 [ 6976.563619][ C0] ? __pfx_tc_run+0x10/0x10 [ 6976.563862][ C0] ? lock_acquire+0x1c1/0x220 [ 6976.564112][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6976.564386][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6976.564655][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6976.564941][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6976.565216][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6976.565533][ C0] ? neigh_hh_output+0x348/0x590 [ 6976.565797][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6976.566073][ C0] ip_finish_output2+0x786/0x18e0 [ 6976.566340][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6976.566634][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6976.566987][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6976.567279][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6976.567543][ C0] ? __ip_finish_output+0x10f/0x770 [ 6976.567823][ C0] ip_output+0x16b/0x4f0 [ 6976.568055][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6976.568337][ C0] ? __pfx_ip_output+0x10/0x10 [ 6976.568594][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6976.568892][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6976.569161][ C0] ? ip_local_out+0x114/0x3b0 [ 6976.569412][ C0] __ip_queue_xmit+0x672/0x1910 [ 6976.569671][ C0] ? __skb_clone+0x57a/0x760 [ 6976.569916][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6976.570202][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6976.570504][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6976.570828][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6976.571087][ C0] ? tcp_current_mss+0x40a/0x510 [ 6976.571352][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6976.571637][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6976.571917][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6976.572176][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6976.572443][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6976.572766][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6976.573044][ C0] ? ktime_get+0xb6/0x190 [ 6976.573276][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6976.573548][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6976.573833][ C0] tcp_write_timer+0x82/0x1d0 [ 6976.574086][ C0] call_timer_fn+0x176/0x430 [ 6976.574334][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6976.574611][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6976.574883][ C0] __run_timers.part.0+0x52d/0x890 [ 6976.575161][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6976.575444][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6976.575747][ C0] ? lock_acquire+0x1c1/0x220 [ 6976.576000][ C0] ? clockevents_program_event+0xf6/0x300 [ 6976.576306][ C0] ? lock_release+0x1d5/0x250 [ 6976.576553][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6976.576829][ C0] ? ktime_get+0xb6/0x190 [ 6976.577060][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6976.577359][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6976.577675][ C0] run_timer_softirq+0x72/0x100 [ 6976.577935][ C0] __do_softirq+0x1bc/0x7ff [ 6976.578181][ C0] irq_exit_rcu+0x98/0xc0 [ 6976.578411][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6976.578712][ C0] [ 6976.578870][ C0] [ 6976.579030][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6976.579351][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6976.579623][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6976.580643][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6976.580967][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6976.581387][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6976.581805][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6976.582226][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6976.582646][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6976.583082][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6976.583389][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6976.583666][ C0] default_idle_call+0x69/0xa0 [ 6976.583921][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6976.584186][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6976.584477][ C0] ? lock_release+0x1d5/0x250 [ 6976.584733][ C0] do_idle+0xfb/0x160 [ 6976.584954][ C0] cpu_startup_entry+0x55/0x60 [ 6976.585213][ C0] rest_init+0x153/0x260 [ 6976.585439][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6976.585732][ C0] arch_call_rest_init+0x13/0x40 [ 6976.586003][ C0] start_kernel+0x314/0x3d0 [ 6976.586248][ C0] x86_64_start_reservations+0x18/0x30 [ 6976.586543][ C0] x86_64_start_kernel+0xba/0x110 [ 6976.586815][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6976.587149][ C0] [ 6998.634024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6998.634409][ C0] rcu: 0-....: (5795936 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1369745 [ 6998.634929][ C0] rcu: (t=5804325 jiffies g=1007429 q=31 ncpus=4) [ 6998.635276][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 6998.635764][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6998.636408][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6998.636755][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6998.637772][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 6998.638092][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6998.638510][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 6998.638930][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 6998.639347][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 6998.639763][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 6998.640180][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 6998.640647][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6998.640998][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 6998.641424][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6998.641849][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6998.642269][ C0] Call Trace: [ 6998.642448][ C0] [ 6998.642615][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6998.642903][ C0] ? print_cpu_stall+0x263/0x6a0 [ 6998.643167][ C0] ? check_cpu_stall+0x284/0x500 [ 6998.643433][ C0] ? rcu_pending+0x92/0x360 [ 6998.643673][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6998.643952][ C0] ? update_process_times+0xb9/0x110 [ 6998.644239][ C0] ? tick_sched_handle+0x67/0x130 [ 6998.644507][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6998.644804][ C0] ? __run_hrtimer+0x1c3/0x710 [ 6998.645060][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6998.645387][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 6998.645674][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6998.645978][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6998.646260][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 6998.646586][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 6998.646858][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 6998.647140][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 6998.647468][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6998.647777][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6998.648112][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6998.648414][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6998.648722][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6998.649027][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6998.649354][ C0] ? get_stack_info+0x36/0xc0 [ 6998.649605][ C0] ? lock_acquire+0x1c1/0x220 [ 6998.649853][ C0] ? lock_release+0x1d5/0x250 [ 6998.650100][ C0] do_raw_spin_lock+0x1ec/0x270 [ 6998.650359][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6998.650643][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6998.650941][ C0] ? lock_acquire+0x1c1/0x220 [ 6998.651192][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 6998.651454][ C0] _raw_spin_lock_nested+0x65/0x80 [ 6998.651729][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 6998.651972][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6998.652229][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 6998.652498][ C0] ? __inet_lookup_established+0x341/0x610 [ 6998.652816][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 6998.653103][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 6998.653391][ C0] ip_local_deliver+0x19d/0x480 [ 6998.653659][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 6998.653947][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6998.654217][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 6998.654492][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6998.654754][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6998.655092][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6998.655369][ C0] ip_rcv+0x564/0x740 [ 6998.655581][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6998.655820][ C0] ? set_track_prepare+0x8a/0xd0 [ 6998.656084][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 6998.656377][ C0] ? rest_init+0x153/0x260 [ 6998.656611][ C0] ? skb_clone+0x10b/0x330 [ 6998.656854][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6998.657187][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6998.657504][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 6998.657803][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6998.658114][ C0] ? __tcf_classify+0x32c/0x7d0 [ 6998.658374][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 6998.658618][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 6998.658940][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6998.659242][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6998.659579][ C0] ? lock_acquire+0x1c1/0x220 [ 6998.659826][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 6998.660135][ C0] netif_receive_skb_internal+0xb0/0x300 [ 6998.660438][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6998.660768][ C0] ? __copy_skb_header+0xaf/0x490 [ 6998.661034][ C0] ? __skb_clone+0x57a/0x760 [ 6998.661282][ C0] netif_receive_skb+0x55/0x280 [ 6998.661542][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6998.661871][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6998.662223][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6998.662533][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 6998.662832][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 6998.663131][ C0] ? hlock_class+0x4e/0x130 [ 6998.663374][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6998.663702][ C0] ? place_entity+0x21/0x2f0 [ 6998.663947][ C0] ? resched_curr+0x219/0x280 [ 6998.664203][ C0] ? __pfx_resched_curr+0x10/0x10 [ 6998.664475][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 6998.664760][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 6998.665037][ C0] ? wakeup_preempt+0x161/0x2c0 [ 6998.665295][ C0] ? activate_task+0xf5/0x260 [ 6998.665545][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 6998.665819][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 6998.666096][ C0] ? _raw_spin_unlock+0x23/0x40 [ 6998.666351][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6998.666640][ C0] ? get_stack_info+0x36/0xc0 [ 6998.666894][ C0] ? stack_access_ok+0xda/0x1f0 [ 6998.667158][ C0] ? get_reg+0x119/0x190 [ 6998.667385][ C0] __tcf_classify+0x32c/0x7d0 [ 6998.667633][ C0] tcf_classify+0x283/0x930 [ 6998.667872][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6998.668201][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 6998.668469][ C0] ? arch_stack_walk+0x8c/0x100 [ 6998.668737][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 6998.669030][ C0] tc_run+0x2e4/0x5d0 [ 6998.669244][ C0] ? __pfx_tc_run+0x10/0x10 [ 6998.669485][ C0] ? lock_acquire+0x1c1/0x220 [ 6998.669734][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 6998.670013][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 6998.670284][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6998.670568][ C0] ? ip_finish_output2+0x786/0x18e0 [ 6998.670846][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6998.671163][ C0] ? neigh_hh_output+0x348/0x590 [ 6998.671431][ C0] ? ip_finish_output2+0x262/0x18e0 [ 6998.671707][ C0] ip_finish_output2+0x786/0x18e0 [ 6998.671975][ C0] ? stack_depot_save_flags+0x45/0x550 [ 6998.672268][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6998.672627][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 6998.672916][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6998.673185][ C0] ? __ip_finish_output+0x10f/0x770 [ 6998.673463][ C0] ip_output+0x16b/0x4f0 [ 6998.673689][ C0] ? __run_timers.part.0+0x52d/0x890 [ 6998.673972][ C0] ? __pfx_ip_output+0x10/0x10 [ 6998.674223][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6998.674529][ C0] ? rcu_read_lock_held+0xe/0x50 [ 6998.674792][ C0] ? ip_local_out+0x114/0x3b0 [ 6998.675050][ C0] __ip_queue_xmit+0x672/0x1910 [ 6998.675319][ C0] ? __skb_clone+0x57a/0x760 [ 6998.675567][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 6998.675846][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6998.676142][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 6998.676462][ C0] tcp_write_xmit+0xe42/0x24c0 [ 6998.676722][ C0] ? tcp_current_mss+0x40a/0x510 [ 6998.676984][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 6998.677268][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 6998.677543][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 6998.677796][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 6998.678066][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6998.678392][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6998.678669][ C0] ? ktime_get+0xb6/0x190 [ 6998.678900][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 6998.679172][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6998.679455][ C0] tcp_write_timer+0x82/0x1d0 [ 6998.679705][ C0] call_timer_fn+0x176/0x430 [ 6998.679950][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 6998.680227][ C0] ? next_expiry_recalc+0xcd/0x220 [ 6998.680498][ C0] __run_timers.part.0+0x52d/0x890 [ 6998.680774][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 6998.681057][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 6998.681357][ C0] ? lock_acquire+0x1c1/0x220 [ 6998.681605][ C0] ? clockevents_program_event+0xf6/0x300 [ 6998.681908][ C0] ? lock_release+0x1d5/0x250 [ 6998.682158][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 6998.682434][ C0] ? ktime_get+0xb6/0x190 [ 6998.682670][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 6998.682970][ C0] ? clockevents_program_event+0x1ed/0x300 [ 6998.683280][ C0] run_timer_softirq+0x72/0x100 [ 6998.683541][ C0] __do_softirq+0x1bc/0x7ff [ 6998.683788][ C0] irq_exit_rcu+0x98/0xc0 [ 6998.684021][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 6998.684325][ C0] [ 6998.684481][ C0] [ 6998.684638][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6998.684955][ C0] RIP: 0010:default_idle+0xf/0x20 [ 6998.685228][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6998.686259][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 6998.686592][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 6998.687011][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 6998.687430][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 6998.687853][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 6998.688277][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 6998.688697][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6998.689002][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 6998.689279][ C0] default_idle_call+0x69/0xa0 [ 6998.689531][ C0] cpuidle_idle_call+0x1f6/0x280 [ 6998.689796][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6998.690092][ C0] ? lock_release+0x1d5/0x250 [ 6998.690357][ C0] do_idle+0xfb/0x160 [ 6998.690573][ C0] cpu_startup_entry+0x55/0x60 [ 6998.690828][ C0] rest_init+0x153/0x260 [ 6998.691057][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 6998.691349][ C0] arch_call_rest_init+0x13/0x40 [ 6998.691616][ C0] start_kernel+0x314/0x3d0 [ 6998.691857][ C0] x86_64_start_reservations+0x18/0x30 [ 6998.692148][ C0] x86_64_start_kernel+0xba/0x110 [ 6998.692418][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 6998.692753][ C0] [ 6998.692917][ C0] Sending NMI from CPU 0 to CPUs 1: [ 6998.693209][ C1] NMI backtrace for cpu 1 [ 6998.693217][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 6998.693222][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6998.693225][ C1] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 6998.693235][ C1] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 6998.693238][ C1] RSP: 0018:ffffc9000019e9d0 EFLAGS: 00000282 [ 6998.693242][ C1] RAX: ffff88800a098e1c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 6998.693244][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 6998.693247][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 6998.693249][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 6998.693251][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 6998.693252][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6998.693254][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6998.693258][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 6998.693260][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6998.693262][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6998.693264][ C1] Call Trace: [ 6998.693267][ C1] [ 6998.693272][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 6998.693279][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6998.693286][ C1] ? nmi_handle+0x156/0x420 [ 6998.693292][ C1] ? default_do_nmi+0x41/0x100 [ 6998.693296][ C1] ? exc_nmi+0xf3/0x120 [ 6998.693299][ C1] ? end_repeat_nmi+0xf/0x60 [ 6998.693304][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6998.693310][ C1] ? kasan_check_range+0x1a/0x1c0 [ 6998.693314][ C1] ? kasan_check_range+0x1a/0x1c0 [ 6998.693318][ C1] ? kasan_check_range+0x1a/0x1c0 [ 6998.693321][ C1] [ 6998.693322][ C1] [ 6998.693324][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 6998.693327][ C1] ? run_ksoftirqd+0xb/0x60 [ 6998.693333][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6998.693336][ C1] ? __orc_find+0x9c/0xf0 [ 6998.693340][ C1] ? lock_acquire+0x1c1/0x220 [ 6998.693344][ C1] ? irqentry_enter+0x2b/0x60 [ 6998.693349][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6998.693353][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6998.693356][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6998.693359][ C1] ? lock_acquire+0x1c1/0x220 [ 6998.693362][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 6998.693367][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6998.693371][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 6998.693379][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6998.693382][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6998.693388][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6998.693396][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 6998.693400][ C1] ip_local_deliver+0x19d/0x480 [ 6998.693403][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6998.693406][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6998.693411][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 6998.693415][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6998.693418][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6998.693422][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6998.693432][ C1] ip_rcv+0x564/0x740 [ 6998.693435][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6998.693438][ C1] ? set_track_prepare+0x8a/0xd0 [ 6998.693443][ C1] ? irqentry_enter+0x2b/0x60 [ 6998.693446][ C1] ? irqentry_enter+0x2b/0x60 [ 6998.693450][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6998.693452][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6998.693457][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6998.693461][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6998.693464][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6998.693467][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6998.693470][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6998.693475][ C1] netif_receive_skb+0x55/0x280 [ 6998.693479][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6998.693487][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6998.693495][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6998.693501][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 6998.693509][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6998.693521][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6998.693531][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6998.693534][ C1] ? arch_stack_walk+0x68/0x100 [ 6998.693539][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 6998.693542][ C1] ? irqentry_enter+0x2b/0x60 [ 6998.693546][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6998.693550][ C1] ? irqentry_enter+0x2b/0x60 [ 6998.693553][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6998.693561][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 6998.693563][ C1] ? arch_stack_walk+0x68/0x100 [ 6998.693567][ C1] __tcf_classify+0x32c/0x7d0 [ 6998.693573][ C1] tcf_classify+0x283/0x930 [ 6998.693577][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6998.693581][ C1] tc_run+0x2e4/0x5d0 [ 6998.693585][ C1] ? __pfx_tc_run+0x10/0x10 [ 6998.693590][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 6998.693596][ C1] ? irqentry_enter+0x2b/0x60 [ 6998.693599][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6998.693602][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6998.693609][ C1] ip_finish_output2+0x786/0x18e0 [ 6998.693614][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6998.693617][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6998.693621][ C1] ? __ip_finish_output+0x10f/0x770 [ 6998.693625][ C1] ip_output+0x16b/0x4f0 [ 6998.693628][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6998.693631][ C1] ? __pfx_ip_output+0x10/0x10 [ 6998.693636][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 6998.693643][ C1] ? __pfx_ip_output+0x10/0x10 [ 6998.693647][ C1] __ip_queue_xmit+0x672/0x1910 [ 6998.693652][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6998.693659][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6998.693664][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6998.693667][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6998.693672][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6998.693675][ C1] tcp_delack_timer+0x84/0x240 [ 6998.693679][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6998.693682][ C1] call_timer_fn+0x176/0x430 [ 6998.693687][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6998.693693][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 6998.693697][ C1] __run_timers.part.0+0x52d/0x890 [ 6998.693700][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6998.693705][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6998.693711][ C1] ? __pfx___schedule+0x10/0x10 [ 6998.693715][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6998.693719][ C1] run_timer_softirq+0x72/0x100 [ 6998.693723][ C1] __do_softirq+0x1bc/0x7ff [ 6998.693727][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 6998.693730][ C1] run_ksoftirqd+0x2e/0x60 [ 6998.693734][ C1] smpboot_thread_fn+0x30e/0x840 [ 6998.693738][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6998.693742][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 6998.693745][ C1] kthread+0x292/0x360 [ 6998.693747][ C1] ? __pfx_kthread+0x10/0x10 [ 6998.693750][ C1] ret_from_fork+0x34/0x70 [ 6998.693753][ C1] ? __pfx_kthread+0x10/0x10 [ 6998.693755][ C1] ret_from_fork_asm+0x1b/0x30 [ 6998.693763][ C1] [ 7024.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5436s! [swapper/0:0] [ 7024.527932][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7024.529137][ C0] irq event stamp: 27567077 [ 7024.529382][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7024.529915][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7024.530390][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7024.530892][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7024.531386][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7024.531866][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7024.532520][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 7024.532854][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 7024.533886][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7024.534212][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7024.534637][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7024.535063][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7024.535484][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7024.535906][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7024.536333][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7024.536810][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7024.537157][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7024.537585][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7024.538006][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7024.538426][ C0] Call Trace: [ 7024.538603][ C0] [ 7024.538759][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7024.539039][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7024.539295][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7024.539589][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7024.539877][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7024.540179][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7024.540461][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7024.540784][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7024.541060][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7024.541336][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7024.541666][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7024.541979][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7024.542311][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7024.542624][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 7024.542925][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7024.543228][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7024.543551][ C0] ? get_stack_info+0x36/0xc0 [ 7024.543807][ C0] ? lock_acquire+0x1c1/0x220 [ 7024.544061][ C0] ? lock_release+0x1d5/0x250 [ 7024.544315][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7024.544579][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7024.544867][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7024.545171][ C0] ? lock_acquire+0x1c1/0x220 [ 7024.545422][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7024.545675][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7024.545953][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7024.546203][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7024.546464][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7024.546738][ C0] ? __inet_lookup_established+0x341/0x610 [ 7024.547060][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7024.547349][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7024.547638][ C0] ip_local_deliver+0x19d/0x480 [ 7024.547902][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7024.548191][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7024.548459][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7024.548734][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7024.548996][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7024.549334][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7024.549607][ C0] ip_rcv+0x564/0x740 [ 7024.549818][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7024.550058][ C0] ? set_track_prepare+0x8a/0xd0 [ 7024.550322][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7024.550612][ C0] ? rest_init+0x153/0x260 [ 7024.550846][ C0] ? skb_clone+0x10b/0x330 [ 7024.551089][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7024.551432][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7024.551749][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7024.552048][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7024.552361][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7024.552628][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7024.552868][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7024.553180][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7024.553478][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7024.553819][ C0] ? lock_acquire+0x1c1/0x220 [ 7024.554070][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7024.554382][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7024.554680][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7024.555017][ C0] ? __copy_skb_header+0xaf/0x490 [ 7024.555287][ C0] ? __skb_clone+0x57a/0x760 [ 7024.555535][ C0] netif_receive_skb+0x55/0x280 [ 7024.555791][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7024.556117][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7024.556464][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7024.556780][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7024.557071][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7024.557371][ C0] ? hlock_class+0x4e/0x130 [ 7024.557614][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7024.557942][ C0] ? place_entity+0x21/0x2f0 [ 7024.558188][ C0] ? resched_curr+0x219/0x280 [ 7024.558443][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7024.558714][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7024.558999][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7024.559277][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7024.559535][ C0] ? activate_task+0xf5/0x260 [ 7024.559785][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7024.560061][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7024.560337][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7024.560594][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7024.560880][ C0] ? get_stack_info+0x36/0xc0 [ 7024.561137][ C0] ? stack_access_ok+0xda/0x1f0 [ 7024.561400][ C0] ? get_reg+0x119/0x190 [ 7024.561630][ C0] __tcf_classify+0x32c/0x7d0 [ 7024.561878][ C0] tcf_classify+0x283/0x930 [ 7024.562119][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7024.562448][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7024.562724][ C0] ? arch_stack_walk+0x8c/0x100 [ 7024.562986][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7024.563278][ C0] tc_run+0x2e4/0x5d0 [ 7024.563496][ C0] ? __pfx_tc_run+0x10/0x10 [ 7024.563743][ C0] ? lock_acquire+0x1c1/0x220 [ 7024.563998][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7024.564275][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7024.564543][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7024.564832][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7024.565114][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7024.565437][ C0] ? neigh_hh_output+0x348/0x590 [ 7024.565700][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7024.565981][ C0] ip_finish_output2+0x786/0x18e0 [ 7024.566255][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7024.566553][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7024.566905][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7024.567195][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7024.567468][ C0] ? __ip_finish_output+0x10f/0x770 [ 7024.567746][ C0] ip_output+0x16b/0x4f0 [ 7024.567972][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7024.568260][ C0] ? __pfx_ip_output+0x10/0x10 [ 7024.568512][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7024.568816][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7024.569080][ C0] ? ip_local_out+0x114/0x3b0 [ 7024.569334][ C0] __ip_queue_xmit+0x672/0x1910 [ 7024.569596][ C0] ? __skb_clone+0x57a/0x760 [ 7024.569845][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7024.570125][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7024.570421][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7024.570744][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7024.571010][ C0] ? tcp_current_mss+0x40a/0x510 [ 7024.571272][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7024.571556][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7024.571830][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7024.572085][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7024.572355][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7024.572679][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7024.572961][ C0] ? ktime_get+0xb6/0x190 [ 7024.573195][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7024.573473][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7024.573759][ C0] tcp_write_timer+0x82/0x1d0 [ 7024.574012][ C0] call_timer_fn+0x176/0x430 [ 7024.574263][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7024.574535][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7024.574812][ C0] __run_timers.part.0+0x52d/0x890 [ 7024.575085][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7024.575371][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7024.575669][ C0] ? lock_acquire+0x1c1/0x220 [ 7024.575921][ C0] ? clockevents_program_event+0xf6/0x300 [ 7024.576229][ C0] ? lock_release+0x1d5/0x250 [ 7024.576484][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7024.576762][ C0] ? ktime_get+0xb6/0x190 [ 7024.576996][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7024.577296][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7024.577605][ C0] run_timer_softirq+0x72/0x100 [ 7024.577868][ C0] __do_softirq+0x1bc/0x7ff [ 7024.578116][ C0] irq_exit_rcu+0x98/0xc0 [ 7024.578347][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7024.578652][ C0] [ 7024.578808][ C0] [ 7024.578969][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7024.579289][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7024.579562][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7024.580589][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7024.580916][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7024.581337][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7024.581758][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7024.582182][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7024.582614][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7024.583033][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7024.583334][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7024.583606][ C0] default_idle_call+0x69/0xa0 [ 7024.583862][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7024.584124][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7024.584420][ C0] ? lock_release+0x1d5/0x250 [ 7024.584671][ C0] do_idle+0xfb/0x160 [ 7024.584885][ C0] cpu_startup_entry+0x55/0x60 [ 7024.585140][ C0] rest_init+0x153/0x260 [ 7024.585367][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7024.585656][ C0] arch_call_rest_init+0x13/0x40 [ 7024.585922][ C0] start_kernel+0x314/0x3d0 [ 7024.586170][ C0] x86_64_start_reservations+0x18/0x30 [ 7024.586465][ C0] x86_64_start_kernel+0xba/0x110 [ 7024.586731][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7024.587061][ C0] [ 7024.587226][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5436s! [ksoftirqd/1:22] [ 7024.587705][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7024.588914][ C1] irq event stamp: 3886976 [ 7024.589155][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7024.589655][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7024.590153][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7024.590657][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7024.591154][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7024.591648][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7024.592298][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7024.592647][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7024.593678][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7024.594005][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7024.594434][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7024.594856][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7024.595280][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7024.595705][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7024.596133][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7024.596606][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7024.596956][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7024.597385][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7024.597806][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7024.598226][ C1] Call Trace: [ 7024.598402][ C1] [ 7024.598558][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7024.598840][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7024.599097][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7024.599392][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7024.599676][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7024.599979][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7024.600259][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7024.600580][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7024.600859][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7024.601183][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7024.601495][ C1] [ 7024.601655][ C1] [ 7024.601817][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7024.602155][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7024.602466][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7024.602779][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7024.603083][ C1] ? run_ksoftirqd+0xb/0x60 [ 7024.603328][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7024.603654][ C1] ? __orc_find+0x9c/0xf0 [ 7024.603889][ C1] ? lock_acquire+0x1c1/0x220 [ 7024.604145][ C1] ? irqentry_enter+0x2b/0x60 [ 7024.604402][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7024.604666][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7024.604957][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7024.605262][ C1] ? lock_acquire+0x1c1/0x220 [ 7024.605513][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7024.605768][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7024.606043][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7024.606293][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7024.606559][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7024.606836][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7024.607129][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7024.607424][ C1] ip_local_deliver+0x19d/0x480 [ 7024.607682][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7024.607965][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7024.608233][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7024.608517][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7024.608786][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7024.609124][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7024.609402][ C1] ip_rcv+0x564/0x740 [ 7024.609624][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7024.609871][ C1] ? set_track_prepare+0x8a/0xd0 [ 7024.610141][ C1] ? irqentry_enter+0x2b/0x60 [ 7024.610392][ C1] ? irqentry_enter+0x2b/0x60 [ 7024.610645][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7024.610887][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7024.611202][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7024.611542][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7024.611851][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7024.612194][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7024.612499][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7024.612838][ C1] netif_receive_skb+0x55/0x280 [ 7024.613102][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7024.613438][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7024.613795][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7024.614112][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7024.614409][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7024.614715][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7024.615051][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7024.615336][ C1] ? arch_stack_walk+0x68/0x100 [ 7024.615599][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7024.615876][ C1] ? irqentry_enter+0x2b/0x60 [ 7024.616130][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7024.616450][ C1] ? irqentry_enter+0x2b/0x60 [ 7024.616707][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7024.617034][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7024.617315][ C1] ? arch_stack_walk+0x68/0x100 [ 7024.617578][ C1] __tcf_classify+0x32c/0x7d0 [ 7024.617834][ C1] tcf_classify+0x283/0x930 [ 7024.618082][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7024.618354][ C1] tc_run+0x2e4/0x5d0 [ 7024.618577][ C1] ? __pfx_tc_run+0x10/0x10 [ 7024.618826][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7024.619100][ C1] ? irqentry_enter+0x2b/0x60 [ 7024.619353][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7024.619640][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7024.619964][ C1] ip_finish_output2+0x786/0x18e0 [ 7024.620242][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7024.620535][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7024.620800][ C1] ? __ip_finish_output+0x10f/0x770 [ 7024.621091][ C1] ip_output+0x16b/0x4f0 [ 7024.621323][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7024.621643][ C1] ? __pfx_ip_output+0x10/0x10 [ 7024.621904][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7024.622257][ C1] ? __pfx_ip_output+0x10/0x10 [ 7024.622519][ C1] __ip_queue_xmit+0x672/0x1910 [ 7024.622778][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7024.623058][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7024.623352][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7024.623636][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7024.623932][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7024.624219][ C1] tcp_delack_timer+0x84/0x240 [ 7024.624476][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7024.624765][ C1] call_timer_fn+0x176/0x430 [ 7024.625020][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7024.625293][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7024.625572][ C1] __run_timers.part.0+0x52d/0x890 [ 7024.625848][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7024.626136][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7024.626436][ C1] ? __pfx___schedule+0x10/0x10 [ 7024.626699][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7024.627023][ C1] run_timer_softirq+0x72/0x100 [ 7024.627283][ C1] __do_softirq+0x1bc/0x7ff [ 7024.627526][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7024.627801][ C1] run_ksoftirqd+0x2e/0x60 [ 7024.628043][ C1] smpboot_thread_fn+0x30e/0x840 [ 7024.628307][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7024.628602][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7024.628897][ C1] kthread+0x292/0x360 [ 7024.629117][ C1] ? __pfx_kthread+0x10/0x10 [ 7024.629363][ C1] ret_from_fork+0x34/0x70 [ 7024.629605][ C1] ? __pfx_kthread+0x10/0x10 [ 7024.629851][ C1] ret_from_fork_asm+0x1b/0x30 [ 7024.630115][ C1] [ 7052.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5462s! [swapper/0:0] [ 7052.527923][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7052.529116][ C0] irq event stamp: 27567077 [ 7052.529354][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7052.529883][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7052.530362][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7052.530871][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7052.531374][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7052.531862][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7052.532518][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7052.532861][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7052.533890][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7052.534219][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7052.534644][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7052.535068][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7052.535493][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7052.535920][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7052.536343][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7052.536815][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7052.537164][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7052.537586][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7052.538004][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7052.538422][ C0] Call Trace: [ 7052.538601][ C0] [ 7052.538756][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7052.539037][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7052.539291][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7052.539583][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7052.539867][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7052.540169][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7052.540448][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7052.540768][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7052.541045][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7052.541321][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7052.541649][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7052.541966][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7052.542298][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7052.542611][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7052.542919][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7052.543227][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7052.543557][ C0] ? get_stack_info+0x36/0xc0 [ 7052.543811][ C0] ? lock_acquire+0x1c1/0x220 [ 7052.544064][ C0] ? lock_release+0x1d5/0x250 [ 7052.544316][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7052.544576][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7052.544862][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7052.545169][ C0] ? lock_acquire+0x1c1/0x220 [ 7052.545419][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7052.545675][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7052.545950][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7052.546198][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7052.546457][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7052.546724][ C0] ? __inet_lookup_established+0x341/0x610 [ 7052.547038][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7052.547333][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7052.547627][ C0] ip_local_deliver+0x19d/0x480 [ 7052.547886][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7052.548169][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7052.548433][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7052.548713][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7052.548979][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7052.549315][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7052.549593][ C0] ip_rcv+0x564/0x740 [ 7052.549810][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7052.550056][ C0] ? set_track_prepare+0x8a/0xd0 [ 7052.550324][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7052.550613][ C0] ? rest_init+0x153/0x260 [ 7052.550851][ C0] ? skb_clone+0x10b/0x330 [ 7052.551092][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7052.551430][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7052.551754][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7052.552049][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7052.552367][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7052.552629][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7052.552873][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7052.553200][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7052.553501][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7052.553839][ C0] ? lock_acquire+0x1c1/0x220 [ 7052.554087][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7052.554396][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7052.554697][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7052.555029][ C0] ? __copy_skb_header+0xaf/0x490 [ 7052.555296][ C0] ? __skb_clone+0x57a/0x760 [ 7052.555541][ C0] netif_receive_skb+0x55/0x280 [ 7052.555806][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7052.556136][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7052.556488][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7052.556799][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7052.557090][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7052.557392][ C0] ? hlock_class+0x4e/0x130 [ 7052.557640][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7052.557974][ C0] ? place_entity+0x21/0x2f0 [ 7052.558224][ C0] ? resched_curr+0x219/0x280 [ 7052.558476][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7052.558742][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7052.559023][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7052.559303][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7052.559563][ C0] ? activate_task+0xf5/0x260 [ 7052.559815][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7052.560092][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7052.560365][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7052.560630][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7052.560923][ C0] ? get_stack_info+0x36/0xc0 [ 7052.561175][ C0] ? stack_access_ok+0xda/0x1f0 [ 7052.561433][ C0] ? get_reg+0x119/0x190 [ 7052.561661][ C0] __tcf_classify+0x32c/0x7d0 [ 7052.561919][ C0] tcf_classify+0x283/0x930 [ 7052.562170][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7052.562504][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7052.562775][ C0] ? arch_stack_walk+0x8c/0x100 [ 7052.563041][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7052.563334][ C0] tc_run+0x2e4/0x5d0 [ 7052.563548][ C0] ? __pfx_tc_run+0x10/0x10 [ 7052.563789][ C0] ? lock_acquire+0x1c1/0x220 [ 7052.564038][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7052.564313][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7052.564583][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7052.564867][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7052.565144][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7052.565464][ C0] ? neigh_hh_output+0x348/0x590 [ 7052.565736][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7052.566016][ C0] ip_finish_output2+0x786/0x18e0 [ 7052.566285][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7052.566577][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7052.566937][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7052.567232][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7052.567496][ C0] ? __ip_finish_output+0x10f/0x770 [ 7052.567777][ C0] ip_output+0x16b/0x4f0 [ 7052.568005][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7052.568289][ C0] ? __pfx_ip_output+0x10/0x10 [ 7052.568550][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7052.568851][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7052.569117][ C0] ? ip_local_out+0x114/0x3b0 [ 7052.569366][ C0] __ip_queue_xmit+0x672/0x1910 [ 7052.569626][ C0] ? __skb_clone+0x57a/0x760 [ 7052.569873][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7052.570159][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7052.570457][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7052.570779][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7052.571035][ C0] ? tcp_current_mss+0x40a/0x510 [ 7052.571302][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7052.571584][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7052.571867][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7052.572123][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7052.572398][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7052.572717][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7052.572992][ C0] ? ktime_get+0xb6/0x190 [ 7052.573224][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7052.573496][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7052.573780][ C0] tcp_write_timer+0x82/0x1d0 [ 7052.574028][ C0] call_timer_fn+0x176/0x430 [ 7052.574273][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7052.574549][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7052.574823][ C0] __run_timers.part.0+0x52d/0x890 [ 7052.575098][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7052.575380][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7052.575679][ C0] ? lock_acquire+0x1c1/0x220 [ 7052.575926][ C0] ? clockevents_program_event+0xf6/0x300 [ 7052.576230][ C0] ? lock_release+0x1d5/0x250 [ 7052.576481][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7052.576758][ C0] ? ktime_get+0xb6/0x190 [ 7052.576991][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7052.577291][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7052.577604][ C0] run_timer_softirq+0x72/0x100 [ 7052.577861][ C0] __do_softirq+0x1bc/0x7ff [ 7052.578103][ C0] irq_exit_rcu+0x98/0xc0 [ 7052.578333][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7052.578632][ C0] [ 7052.578793][ C0] [ 7052.578953][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7052.579278][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7052.579545][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7052.580560][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7052.580880][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7052.581298][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7052.581717][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7052.582135][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7052.582560][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7052.582983][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7052.583292][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7052.583567][ C0] default_idle_call+0x69/0xa0 [ 7052.583819][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7052.584088][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7052.584381][ C0] ? lock_release+0x1d5/0x250 [ 7052.584635][ C0] do_idle+0xfb/0x160 [ 7052.584848][ C0] cpu_startup_entry+0x55/0x60 [ 7052.585106][ C0] rest_init+0x153/0x260 [ 7052.585331][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7052.585621][ C0] arch_call_rest_init+0x13/0x40 [ 7052.585889][ C0] start_kernel+0x314/0x3d0 [ 7052.586130][ C0] x86_64_start_reservations+0x18/0x30 [ 7052.586420][ C0] x86_64_start_kernel+0xba/0x110 [ 7052.586692][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7052.587021][ C0] [ 7052.587190][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5462s! [ksoftirqd/1:22] [ 7052.587663][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7052.588868][ C1] irq event stamp: 3886976 [ 7052.589110][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7052.589609][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7052.590105][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7052.590607][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7052.591105][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7052.591604][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7052.592258][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7052.592605][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7052.593634][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7052.593964][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7052.594388][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7052.594812][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7052.595238][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7052.595665][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7052.596093][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7052.596565][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7052.596914][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7052.597336][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7052.597754][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7052.598174][ C1] Call Trace: [ 7052.598354][ C1] [ 7052.598510][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7052.598792][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7052.599049][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7052.599344][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7052.599630][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7052.599934][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7052.600217][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7052.600538][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7052.600819][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7052.601146][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7052.601458][ C1] [ 7052.601619][ C1] [ 7052.601779][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7052.602118][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7052.602431][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7052.602751][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7052.603056][ C1] ? run_ksoftirqd+0xb/0x60 [ 7052.603299][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7052.603629][ C1] ? __orc_find+0x9c/0xf0 [ 7052.603863][ C1] ? lock_acquire+0x1c1/0x220 [ 7052.604125][ C1] ? irqentry_enter+0x2b/0x60 [ 7052.604383][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7052.604650][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7052.604942][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7052.605247][ C1] ? lock_acquire+0x1c1/0x220 [ 7052.605496][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7052.605750][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7052.606025][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7052.606277][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7052.606546][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7052.606823][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7052.607117][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7052.607410][ C1] ip_local_deliver+0x19d/0x480 [ 7052.607669][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7052.607956][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7052.608224][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7052.608507][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7052.608775][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7052.609112][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7052.609392][ C1] ip_rcv+0x564/0x740 [ 7052.609608][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7052.609856][ C1] ? set_track_prepare+0x8a/0xd0 [ 7052.610126][ C1] ? irqentry_enter+0x2b/0x60 [ 7052.610376][ C1] ? irqentry_enter+0x2b/0x60 [ 7052.610626][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7052.610868][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7052.611183][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7052.611522][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7052.611832][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7052.612178][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7052.612486][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7052.612824][ C1] netif_receive_skb+0x55/0x280 [ 7052.613092][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7052.613425][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7052.613782][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7052.614098][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7052.614393][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7052.614702][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7052.615037][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7052.615322][ C1] ? arch_stack_walk+0x68/0x100 [ 7052.615582][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7052.615859][ C1] ? irqentry_enter+0x2b/0x60 [ 7052.616111][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7052.616434][ C1] ? irqentry_enter+0x2b/0x60 [ 7052.616691][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7052.617016][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7052.617300][ C1] ? arch_stack_walk+0x68/0x100 [ 7052.617564][ C1] __tcf_classify+0x32c/0x7d0 [ 7052.617825][ C1] tcf_classify+0x283/0x930 [ 7052.618075][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7052.618354][ C1] tc_run+0x2e4/0x5d0 [ 7052.618572][ C1] ? __pfx_tc_run+0x10/0x10 [ 7052.618824][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7052.619097][ C1] ? irqentry_enter+0x2b/0x60 [ 7052.619348][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7052.619634][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7052.619961][ C1] ip_finish_output2+0x786/0x18e0 [ 7052.620238][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7052.620532][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7052.620799][ C1] ? __ip_finish_output+0x10f/0x770 [ 7052.621083][ C1] ip_output+0x16b/0x4f0 [ 7052.621317][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7052.621640][ C1] ? __pfx_ip_output+0x10/0x10 [ 7052.621901][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7052.622256][ C1] ? __pfx_ip_output+0x10/0x10 [ 7052.622519][ C1] __ip_queue_xmit+0x672/0x1910 [ 7052.622781][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7052.623061][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7052.623357][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7052.623648][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7052.623945][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7052.624233][ C1] tcp_delack_timer+0x84/0x240 [ 7052.624490][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7052.624779][ C1] call_timer_fn+0x176/0x430 [ 7052.625032][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7052.625307][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7052.625591][ C1] __run_timers.part.0+0x52d/0x890 [ 7052.625871][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7052.626161][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7052.626462][ C1] ? __pfx___schedule+0x10/0x10 [ 7052.626726][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7052.627049][ C1] run_timer_softirq+0x72/0x100 [ 7052.627308][ C1] __do_softirq+0x1bc/0x7ff [ 7052.627550][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7052.627826][ C1] run_ksoftirqd+0x2e/0x60 [ 7052.628068][ C1] smpboot_thread_fn+0x30e/0x840 [ 7052.628335][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7052.628629][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7052.628920][ C1] kthread+0x292/0x360 [ 7052.629140][ C1] ? __pfx_kthread+0x10/0x10 [ 7052.629385][ C1] ret_from_fork+0x34/0x70 [ 7052.629629][ C1] ? __pfx_kthread+0x10/0x10 [ 7052.629878][ C1] ret_from_fork_asm+0x1b/0x30 [ 7052.630142][ C1] [ 7076.697023][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7076.697413][ C0] rcu: 0-....: (5873822 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1387948 [ 7076.697932][ C0] rcu: (t=5882388 jiffies g=1007429 q=31 ncpus=4) [ 7076.698279][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7076.698762][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7076.699403][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7076.699747][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7076.700762][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7076.701085][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7076.701504][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7076.701920][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7076.702344][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7076.702765][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7076.703190][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7076.703665][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7076.704012][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7076.704439][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7076.704860][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7076.705278][ C0] Call Trace: [ 7076.705455][ C0] [ 7076.705610][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7076.705898][ C0] ? print_cpu_stall+0x263/0x6a0 [ 7076.706162][ C0] ? check_cpu_stall+0x284/0x500 [ 7076.706429][ C0] ? rcu_pending+0x92/0x360 [ 7076.706669][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7076.706948][ C0] ? update_process_times+0xb9/0x110 [ 7076.707234][ C0] ? tick_sched_handle+0x67/0x130 [ 7076.707502][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7076.707801][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7076.708058][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7076.708385][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7076.708672][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7076.708977][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7076.709259][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7076.709584][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7076.709857][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7076.710139][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7076.710463][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7076.710772][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7076.711107][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7076.711409][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7076.711717][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7076.712021][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7076.712361][ C0] ? get_stack_info+0x36/0xc0 [ 7076.712616][ C0] ? lock_acquire+0x1c1/0x220 [ 7076.712871][ C0] ? lock_release+0x1d5/0x250 [ 7076.713124][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7076.713387][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7076.713675][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7076.713978][ C0] ? lock_acquire+0x1c1/0x220 [ 7076.714228][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7076.714480][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7076.714760][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7076.715008][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7076.715270][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7076.715543][ C0] ? __inet_lookup_established+0x341/0x610 [ 7076.715863][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7076.716150][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7076.716438][ C0] ip_local_deliver+0x19d/0x480 [ 7076.716705][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7076.716995][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7076.717262][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7076.717538][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7076.717800][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7076.718138][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7076.718412][ C0] ip_rcv+0x564/0x740 [ 7076.718623][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7076.718863][ C0] ? set_track_prepare+0x8a/0xd0 [ 7076.719126][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7076.719416][ C0] ? rest_init+0x153/0x260 [ 7076.719651][ C0] ? skb_clone+0x10b/0x330 [ 7076.719893][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7076.720225][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7076.720542][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7076.720841][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7076.721154][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7076.721414][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7076.721658][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7076.721982][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7076.722293][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7076.722635][ C0] ? lock_acquire+0x1c1/0x220 [ 7076.722887][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7076.723198][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7076.723497][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7076.723831][ C0] ? __copy_skb_header+0xaf/0x490 [ 7076.724101][ C0] ? __skb_clone+0x57a/0x760 [ 7076.724349][ C0] netif_receive_skb+0x55/0x280 [ 7076.724604][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7076.724929][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7076.725281][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7076.725597][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7076.725885][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7076.726186][ C0] ? hlock_class+0x4e/0x130 [ 7076.726428][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7076.726755][ C0] ? place_entity+0x21/0x2f0 [ 7076.727004][ C0] ? resched_curr+0x219/0x280 [ 7076.727261][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7076.727534][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7076.727818][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7076.728101][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7076.728359][ C0] ? activate_task+0xf5/0x260 [ 7076.728610][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7076.728885][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7076.729160][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7076.729417][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7076.729705][ C0] ? get_stack_info+0x36/0xc0 [ 7076.729960][ C0] ? stack_access_ok+0xda/0x1f0 [ 7076.730224][ C0] ? get_reg+0x119/0x190 [ 7076.730453][ C0] __tcf_classify+0x32c/0x7d0 [ 7076.730702][ C0] tcf_classify+0x283/0x930 [ 7076.730943][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7076.731271][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7076.731541][ C0] ? arch_stack_walk+0x8c/0x100 [ 7076.731808][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7076.732102][ C0] tc_run+0x2e4/0x5d0 [ 7076.732325][ C0] ? __pfx_tc_run+0x10/0x10 [ 7076.732571][ C0] ? lock_acquire+0x1c1/0x220 [ 7076.732826][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7076.733102][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7076.733368][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7076.733659][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7076.733939][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7076.734263][ C0] ? neigh_hh_output+0x348/0x590 [ 7076.734527][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7076.734809][ C0] ip_finish_output2+0x786/0x18e0 [ 7076.735082][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7076.735379][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7076.735729][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7076.736015][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7076.736284][ C0] ? __ip_finish_output+0x10f/0x770 [ 7076.736561][ C0] ip_output+0x16b/0x4f0 [ 7076.736788][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7076.737071][ C0] ? __pfx_ip_output+0x10/0x10 [ 7076.737328][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7076.737630][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7076.737893][ C0] ? ip_local_out+0x114/0x3b0 [ 7076.738147][ C0] __ip_queue_xmit+0x672/0x1910 [ 7076.738408][ C0] ? __skb_clone+0x57a/0x760 [ 7076.738658][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7076.738939][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7076.739234][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7076.739555][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7076.739817][ C0] ? tcp_current_mss+0x40a/0x510 [ 7076.740080][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7076.740363][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7076.740638][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7076.740891][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7076.741161][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7076.741481][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7076.741756][ C0] ? ktime_get+0xb6/0x190 [ 7076.741985][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7076.742265][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7076.742544][ C0] tcp_write_timer+0x82/0x1d0 [ 7076.742798][ C0] call_timer_fn+0x176/0x430 [ 7076.743047][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7076.743321][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7076.743597][ C0] __run_timers.part.0+0x52d/0x890 [ 7076.743870][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7076.744156][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7076.744458][ C0] ? lock_acquire+0x1c1/0x220 [ 7076.744709][ C0] ? clockevents_program_event+0xf6/0x300 [ 7076.745015][ C0] ? lock_release+0x1d5/0x250 [ 7076.745268][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7076.745547][ C0] ? ktime_get+0xb6/0x190 [ 7076.745781][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7076.746080][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7076.746388][ C0] run_timer_softirq+0x72/0x100 [ 7076.746651][ C0] __do_softirq+0x1bc/0x7ff [ 7076.746898][ C0] irq_exit_rcu+0x98/0xc0 [ 7076.747131][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7076.747435][ C0] [ 7076.747591][ C0] [ 7076.747748][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7076.748069][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7076.748341][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7076.749371][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7076.749699][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7076.750123][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7076.750543][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7076.750965][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7076.751389][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7076.751814][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7076.752120][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7076.752401][ C0] default_idle_call+0x69/0xa0 [ 7076.752656][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7076.752917][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7076.753212][ C0] ? lock_release+0x1d5/0x250 [ 7076.753463][ C0] do_idle+0xfb/0x160 [ 7076.753678][ C0] cpu_startup_entry+0x55/0x60 [ 7076.753937][ C0] rest_init+0x153/0x260 [ 7076.754164][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7076.754452][ C0] arch_call_rest_init+0x13/0x40 [ 7076.754717][ C0] start_kernel+0x314/0x3d0 [ 7076.754964][ C0] x86_64_start_reservations+0x18/0x30 [ 7076.755259][ C0] x86_64_start_kernel+0xba/0x110 [ 7076.755525][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7076.755850][ C0] [ 7076.756014][ C0] Sending NMI from CPU 0 to CPUs 1: [ 7076.756303][ C1] NMI backtrace for cpu 1 [ 7076.756323][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7076.756328][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7076.756331][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 7076.756339][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 7076.756342][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7076.756346][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7076.756349][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7076.756351][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7076.756353][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7076.756355][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7076.756356][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7076.756359][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7076.756362][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7076.756364][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7076.756365][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7076.756366][ C1] Call Trace: [ 7076.756370][ C1] [ 7076.756373][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 7076.756379][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7076.756383][ C1] ? nmi_handle+0x156/0x420 [ 7076.756388][ C1] ? default_do_nmi+0x41/0x100 [ 7076.756392][ C1] ? exc_nmi+0xf3/0x120 [ 7076.756394][ C1] ? end_repeat_nmi+0xf/0x60 [ 7076.756399][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7076.756403][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 7076.756407][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 7076.756410][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 7076.756414][ C1] [ 7076.756415][ C1] [ 7076.756416][ C1] ? run_ksoftirqd+0xb/0x60 [ 7076.756421][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7076.756424][ C1] ? __orc_find+0x9c/0xf0 [ 7076.756427][ C1] ? lock_acquire+0x1c1/0x220 [ 7076.756431][ C1] ? irqentry_enter+0x2b/0x60 [ 7076.756437][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7076.756441][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7076.756444][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7076.756447][ C1] ? lock_acquire+0x1c1/0x220 [ 7076.756449][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7076.756455][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7076.756458][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7076.756465][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7076.756468][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7076.756474][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7076.756481][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7076.756485][ C1] ip_local_deliver+0x19d/0x480 [ 7076.756489][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7076.756491][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7076.756496][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7076.756500][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7076.756503][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7076.756507][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7076.756516][ C1] ip_rcv+0x564/0x740 [ 7076.756520][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7076.756523][ C1] ? set_track_prepare+0x8a/0xd0 [ 7076.756527][ C1] ? irqentry_enter+0x2b/0x60 [ 7076.756531][ C1] ? irqentry_enter+0x2b/0x60 [ 7076.756534][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7076.756537][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7076.756541][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7076.756544][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7076.756547][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7076.756550][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7076.756553][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7076.756558][ C1] netif_receive_skb+0x55/0x280 [ 7076.756561][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7076.756569][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7076.756576][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7076.756582][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7076.756589][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7076.756601][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7076.756611][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7076.756613][ C1] ? arch_stack_walk+0x68/0x100 [ 7076.756618][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7076.756621][ C1] ? irqentry_enter+0x2b/0x60 [ 7076.756625][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7076.756630][ C1] ? irqentry_enter+0x2b/0x60 [ 7076.756633][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7076.756640][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7076.756643][ C1] ? arch_stack_walk+0x68/0x100 [ 7076.756647][ C1] __tcf_classify+0x32c/0x7d0 [ 7076.756652][ C1] tcf_classify+0x283/0x930 [ 7076.756656][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7076.756661][ C1] tc_run+0x2e4/0x5d0 [ 7076.756666][ C1] ? __pfx_tc_run+0x10/0x10 [ 7076.756671][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7076.756676][ C1] ? irqentry_enter+0x2b/0x60 [ 7076.756679][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7076.756683][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7076.756690][ C1] ip_finish_output2+0x786/0x18e0 [ 7076.756696][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7076.756698][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7076.756702][ C1] ? __ip_finish_output+0x10f/0x770 [ 7076.756707][ C1] ip_output+0x16b/0x4f0 [ 7076.756710][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7076.756714][ C1] ? __pfx_ip_output+0x10/0x10 [ 7076.756718][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7076.756725][ C1] ? __pfx_ip_output+0x10/0x10 [ 7076.756730][ C1] __ip_queue_xmit+0x672/0x1910 [ 7076.756736][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7076.756743][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7076.756747][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7076.756751][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7076.756755][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7076.756758][ C1] tcp_delack_timer+0x84/0x240 [ 7076.756761][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7076.756764][ C1] call_timer_fn+0x176/0x430 [ 7076.756770][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7076.756775][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7076.756778][ C1] __run_timers.part.0+0x52d/0x890 [ 7076.756781][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7076.756786][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7076.756791][ C1] ? __pfx___schedule+0x10/0x10 [ 7076.756795][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7076.756799][ C1] run_timer_softirq+0x72/0x100 [ 7076.756803][ C1] __do_softirq+0x1bc/0x7ff [ 7076.756807][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7076.756811][ C1] run_ksoftirqd+0x2e/0x60 [ 7076.756814][ C1] smpboot_thread_fn+0x30e/0x840 [ 7076.756819][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7076.756823][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7076.756825][ C1] kthread+0x292/0x360 [ 7076.756828][ C1] ? __pfx_kthread+0x10/0x10 [ 7076.756831][ C1] ret_from_fork+0x34/0x70 [ 7076.756833][ C1] ? __pfx_kthread+0x10/0x10 [ 7076.756835][ C1] ret_from_fork_asm+0x1b/0x30 [ 7076.756843][ C1] [ 7104.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5510s! [swapper/0:0] [ 7104.527922][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7104.529129][ C0] irq event stamp: 27567077 [ 7104.529373][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7104.529922][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7104.530392][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7104.530896][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7104.531391][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7104.531872][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7104.532526][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7104.532865][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7104.533883][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7104.534208][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7104.534627][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7104.535045][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7104.535467][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7104.535886][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7104.536305][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7104.536775][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7104.537130][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7104.537551][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7104.537973][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7104.538398][ C0] Call Trace: [ 7104.538585][ C0] [ 7104.538742][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7104.539017][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7104.539274][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7104.539563][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7104.539853][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7104.540161][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7104.540445][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7104.540768][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7104.541040][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7104.541321][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7104.541644][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7104.541954][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7104.542294][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7104.542602][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7104.542914][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7104.543217][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7104.543544][ C0] ? get_stack_info+0x36/0xc0 [ 7104.543803][ C0] ? lock_acquire+0x1c1/0x220 [ 7104.544061][ C0] ? lock_release+0x1d5/0x250 [ 7104.544316][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7104.544581][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7104.544868][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7104.545169][ C0] ? lock_acquire+0x1c1/0x220 [ 7104.545416][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7104.545666][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7104.545938][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7104.546189][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7104.546451][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7104.546725][ C0] ? __inet_lookup_established+0x341/0x610 [ 7104.547042][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7104.547332][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7104.547622][ C0] ip_local_deliver+0x19d/0x480 [ 7104.547883][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7104.548170][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7104.548444][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7104.548720][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7104.548983][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7104.549321][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7104.549596][ C0] ip_rcv+0x564/0x740 [ 7104.549809][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7104.550050][ C0] ? set_track_prepare+0x8a/0xd0 [ 7104.550314][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7104.550606][ C0] ? rest_init+0x153/0x260 [ 7104.550843][ C0] ? skb_clone+0x10b/0x330 [ 7104.551087][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7104.551420][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7104.551741][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7104.552040][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7104.552358][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7104.552616][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7104.552856][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7104.553169][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7104.553467][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7104.553811][ C0] ? lock_acquire+0x1c1/0x220 [ 7104.554065][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7104.554378][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7104.554675][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7104.555014][ C0] ? __copy_skb_header+0xaf/0x490 [ 7104.555287][ C0] ? __skb_clone+0x57a/0x760 [ 7104.555536][ C0] netif_receive_skb+0x55/0x280 [ 7104.555794][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7104.556120][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7104.556466][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7104.556782][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7104.557067][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7104.557370][ C0] ? hlock_class+0x4e/0x130 [ 7104.557615][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7104.557942][ C0] ? place_entity+0x21/0x2f0 [ 7104.558188][ C0] ? resched_curr+0x219/0x280 [ 7104.558442][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7104.558711][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7104.558997][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7104.559273][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7104.559528][ C0] ? activate_task+0xf5/0x260 [ 7104.559776][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7104.560050][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7104.560324][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7104.560584][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7104.560874][ C0] ? get_stack_info+0x36/0xc0 [ 7104.561128][ C0] ? stack_access_ok+0xda/0x1f0 [ 7104.561387][ C0] ? get_reg+0x119/0x190 [ 7104.561618][ C0] __tcf_classify+0x32c/0x7d0 [ 7104.561870][ C0] tcf_classify+0x283/0x930 [ 7104.562121][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7104.562452][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7104.562717][ C0] ? arch_stack_walk+0x8c/0x100 [ 7104.562978][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7104.563266][ C0] tc_run+0x2e4/0x5d0 [ 7104.563485][ C0] ? __pfx_tc_run+0x10/0x10 [ 7104.563730][ C0] ? lock_acquire+0x1c1/0x220 [ 7104.563981][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7104.564258][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7104.564523][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7104.564810][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7104.565093][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7104.565419][ C0] ? neigh_hh_output+0x348/0x590 [ 7104.565683][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7104.565964][ C0] ip_finish_output2+0x786/0x18e0 [ 7104.566235][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7104.566528][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7104.566878][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7104.567168][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7104.567433][ C0] ? __ip_finish_output+0x10f/0x770 [ 7104.567708][ C0] ip_output+0x16b/0x4f0 [ 7104.567935][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7104.568221][ C0] ? __pfx_ip_output+0x10/0x10 [ 7104.568477][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7104.568783][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7104.569046][ C0] ? ip_local_out+0x114/0x3b0 [ 7104.569301][ C0] __ip_queue_xmit+0x672/0x1910 [ 7104.569568][ C0] ? __skb_clone+0x57a/0x760 [ 7104.569817][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7104.570097][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7104.570390][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7104.570707][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7104.570965][ C0] ? tcp_current_mss+0x40a/0x510 [ 7104.571228][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7104.571511][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7104.571786][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7104.572039][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7104.572313][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7104.572633][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7104.572914][ C0] ? ktime_get+0xb6/0x190 [ 7104.573150][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7104.573426][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7104.573708][ C0] tcp_write_timer+0x82/0x1d0 [ 7104.573963][ C0] call_timer_fn+0x176/0x430 [ 7104.574213][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7104.574485][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7104.574761][ C0] __run_timers.part.0+0x52d/0x890 [ 7104.575033][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7104.575317][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7104.575614][ C0] ? lock_acquire+0x1c1/0x220 [ 7104.575871][ C0] ? clockevents_program_event+0xf6/0x300 [ 7104.576182][ C0] ? lock_release+0x1d5/0x250 [ 7104.576435][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7104.576714][ C0] ? ktime_get+0xb6/0x190 [ 7104.576946][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7104.577249][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7104.577557][ C0] run_timer_softirq+0x72/0x100 [ 7104.577820][ C0] __do_softirq+0x1bc/0x7ff [ 7104.578067][ C0] irq_exit_rcu+0x98/0xc0 [ 7104.578301][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7104.578602][ C0] [ 7104.578757][ C0] [ 7104.578914][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7104.579232][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7104.579503][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7104.580531][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7104.580856][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7104.581286][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7104.581711][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7104.582137][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7104.582562][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7104.582983][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7104.583284][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7104.583556][ C0] default_idle_call+0x69/0xa0 [ 7104.583814][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7104.584077][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7104.584372][ C0] ? lock_release+0x1d5/0x250 [ 7104.584621][ C0] do_idle+0xfb/0x160 [ 7104.584832][ C0] cpu_startup_entry+0x55/0x60 [ 7104.585086][ C0] rest_init+0x153/0x260 [ 7104.585316][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7104.585603][ C0] arch_call_rest_init+0x13/0x40 [ 7104.585868][ C0] start_kernel+0x314/0x3d0 [ 7104.586113][ C0] x86_64_start_reservations+0x18/0x30 [ 7104.586406][ C0] x86_64_start_kernel+0xba/0x110 [ 7104.586673][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7104.587000][ C0] [ 7104.587166][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5510s! [ksoftirqd/1:22] [ 7104.587643][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7104.588837][ C1] irq event stamp: 3886976 [ 7104.589073][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7104.589575][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7104.590075][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7104.590578][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7104.591076][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7104.591570][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7104.592224][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7104.592564][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7104.593581][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7104.593905][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7104.594323][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7104.594741][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7104.595158][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7104.595576][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7104.595995][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7104.596462][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7104.596816][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7104.597238][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7104.597657][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7104.598080][ C1] Call Trace: [ 7104.598262][ C1] [ 7104.598420][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7104.598695][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7104.598953][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7104.599243][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7104.599531][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7104.599838][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7104.600122][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7104.600446][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7104.600722][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7104.601049][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7104.601363][ C1] [ 7104.601520][ C1] [ 7104.601677][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7104.602008][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7104.602320][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7104.602630][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7104.602936][ C1] ? run_ksoftirqd+0xb/0x60 [ 7104.603185][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7104.603514][ C1] ? __orc_find+0x9c/0xf0 [ 7104.603744][ C1] ? lock_acquire+0x1c1/0x220 [ 7104.603995][ C1] ? irqentry_enter+0x2b/0x60 [ 7104.604245][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7104.604506][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7104.604792][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7104.605093][ C1] ? lock_acquire+0x1c1/0x220 [ 7104.605346][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7104.605601][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7104.605878][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7104.606125][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7104.606384][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7104.606655][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7104.606944][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7104.607234][ C1] ip_local_deliver+0x19d/0x480 [ 7104.607497][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7104.607786][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7104.608058][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7104.608337][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7104.608600][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7104.608942][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7104.609218][ C1] ip_rcv+0x564/0x740 [ 7104.609434][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7104.609677][ C1] ? set_track_prepare+0x8a/0xd0 [ 7104.609943][ C1] ? irqentry_enter+0x2b/0x60 [ 7104.610197][ C1] ? irqentry_enter+0x2b/0x60 [ 7104.610455][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7104.610704][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7104.611023][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7104.611368][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7104.611681][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7104.612020][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7104.612324][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7104.612654][ C1] netif_receive_skb+0x55/0x280 [ 7104.612913][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7104.613241][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7104.613589][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7104.613905][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7104.614196][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7104.614498][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7104.614826][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7104.615111][ C1] ? arch_stack_walk+0x68/0x100 [ 7104.615374][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7104.615654][ C1] ? irqentry_enter+0x2b/0x60 [ 7104.615909][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7104.616237][ C1] ? irqentry_enter+0x2b/0x60 [ 7104.616489][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7104.616810][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7104.617095][ C1] ? arch_stack_walk+0x68/0x100 [ 7104.617354][ C1] __tcf_classify+0x32c/0x7d0 [ 7104.617604][ C1] tcf_classify+0x283/0x930 [ 7104.617848][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7104.618120][ C1] tc_run+0x2e4/0x5d0 [ 7104.618337][ C1] ? __pfx_tc_run+0x10/0x10 [ 7104.618582][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7104.618850][ C1] ? irqentry_enter+0x2b/0x60 [ 7104.619107][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7104.619396][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7104.619724][ C1] ip_finish_output2+0x786/0x18e0 [ 7104.619994][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7104.620284][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7104.620552][ C1] ? __ip_finish_output+0x10f/0x770 [ 7104.620829][ C1] ip_output+0x16b/0x4f0 [ 7104.621058][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7104.621386][ C1] ? __pfx_ip_output+0x10/0x10 [ 7104.621644][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7104.622000][ C1] ? __pfx_ip_output+0x10/0x10 [ 7104.622266][ C1] __ip_queue_xmit+0x672/0x1910 [ 7104.622531][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7104.622816][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7104.623115][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7104.623406][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7104.623708][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7104.623998][ C1] tcp_delack_timer+0x84/0x240 [ 7104.624258][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7104.624544][ C1] call_timer_fn+0x176/0x430 [ 7104.624795][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7104.625073][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7104.625351][ C1] __run_timers.part.0+0x52d/0x890 [ 7104.625624][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7104.625916][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7104.626220][ C1] ? __pfx___schedule+0x10/0x10 [ 7104.626478][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7104.626796][ C1] run_timer_softirq+0x72/0x100 [ 7104.627059][ C1] __do_softirq+0x1bc/0x7ff [ 7104.627304][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7104.627581][ C1] run_ksoftirqd+0x2e/0x60 [ 7104.627817][ C1] smpboot_thread_fn+0x30e/0x840 [ 7104.628087][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7104.628378][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7104.628671][ C1] kthread+0x292/0x360 [ 7104.628887][ C1] ? __pfx_kthread+0x10/0x10 [ 7104.629136][ C1] ret_from_fork+0x34/0x70 [ 7104.629376][ C1] ? __pfx_kthread+0x10/0x10 [ 7104.629625][ C1] ret_from_fork_asm+0x1b/0x30 [ 7104.629886][ C1] [ 7132.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5536s! [swapper/0:0] [ 7132.527932][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7132.529136][ C0] irq event stamp: 27567077 [ 7132.529384][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7132.529920][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7132.530397][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7132.530901][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7132.531393][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7132.531871][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7132.532525][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7132.532875][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7132.533906][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7132.534234][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7132.534659][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7132.535081][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7132.535502][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7132.535928][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7132.536355][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7132.536828][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7132.537179][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7132.537610][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7132.538031][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7132.538451][ C0] Call Trace: [ 7132.538628][ C0] [ 7132.538784][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7132.539065][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7132.539321][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7132.539614][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7132.539899][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7132.540203][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7132.540480][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7132.540799][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7132.541080][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7132.541358][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7132.541687][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7132.542004][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7132.542346][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7132.542650][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7132.542961][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7132.543268][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7132.543599][ C0] ? get_stack_info+0x36/0xc0 [ 7132.543851][ C0] ? lock_acquire+0x1c1/0x220 [ 7132.544102][ C0] ? lock_release+0x1d5/0x250 [ 7132.544351][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7132.544611][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7132.544899][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7132.545199][ C0] ? lock_acquire+0x1c1/0x220 [ 7132.545457][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7132.545715][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7132.545992][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7132.546240][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7132.546499][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7132.546768][ C0] ? __inet_lookup_established+0x341/0x610 [ 7132.547086][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7132.547381][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7132.547677][ C0] ip_local_deliver+0x19d/0x480 [ 7132.547941][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7132.548227][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7132.548493][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7132.548778][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7132.549044][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7132.549378][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7132.549663][ C0] ip_rcv+0x564/0x740 [ 7132.549881][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7132.550126][ C0] ? set_track_prepare+0x8a/0xd0 [ 7132.550393][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7132.550680][ C0] ? rest_init+0x153/0x260 [ 7132.550920][ C0] ? skb_clone+0x10b/0x330 [ 7132.551161][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7132.551501][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7132.551823][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7132.552125][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7132.552438][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7132.552713][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7132.552958][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7132.553279][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7132.553583][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7132.553922][ C0] ? lock_acquire+0x1c1/0x220 [ 7132.554172][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7132.554481][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7132.554783][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7132.555115][ C0] ? __copy_skb_header+0xaf/0x490 [ 7132.555382][ C0] ? __skb_clone+0x57a/0x760 [ 7132.555624][ C0] netif_receive_skb+0x55/0x280 [ 7132.555886][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7132.556218][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7132.556570][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7132.556888][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7132.557171][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7132.557483][ C0] ? hlock_class+0x4e/0x130 [ 7132.557731][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7132.558071][ C0] ? place_entity+0x21/0x2f0 [ 7132.558321][ C0] ? resched_curr+0x219/0x280 [ 7132.558575][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7132.558842][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7132.559124][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7132.559405][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7132.559671][ C0] ? activate_task+0xf5/0x260 [ 7132.559923][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7132.560202][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7132.560473][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7132.560736][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7132.561030][ C0] ? get_stack_info+0x36/0xc0 [ 7132.561282][ C0] ? stack_access_ok+0xda/0x1f0 [ 7132.561539][ C0] ? get_reg+0x119/0x190 [ 7132.561765][ C0] __tcf_classify+0x32c/0x7d0 [ 7132.562026][ C0] tcf_classify+0x283/0x930 [ 7132.562265][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7132.562592][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7132.562860][ C0] ? arch_stack_walk+0x8c/0x100 [ 7132.563128][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7132.563421][ C0] tc_run+0x2e4/0x5d0 [ 7132.563635][ C0] ? __pfx_tc_run+0x10/0x10 [ 7132.563875][ C0] ? lock_acquire+0x1c1/0x220 [ 7132.564127][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7132.564401][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7132.564672][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7132.564957][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7132.565236][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7132.565553][ C0] ? neigh_hh_output+0x348/0x590 [ 7132.565822][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7132.566099][ C0] ip_finish_output2+0x786/0x18e0 [ 7132.566365][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7132.566659][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7132.567014][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7132.567309][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7132.567572][ C0] ? __ip_finish_output+0x10f/0x770 [ 7132.567853][ C0] ip_output+0x16b/0x4f0 [ 7132.568081][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7132.568360][ C0] ? __pfx_ip_output+0x10/0x10 [ 7132.568616][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7132.568917][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7132.569183][ C0] ? ip_local_out+0x114/0x3b0 [ 7132.569432][ C0] __ip_queue_xmit+0x672/0x1910 [ 7132.569688][ C0] ? __skb_clone+0x57a/0x760 [ 7132.569931][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7132.570217][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7132.570513][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7132.570836][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7132.571093][ C0] ? tcp_current_mss+0x40a/0x510 [ 7132.571358][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7132.571636][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7132.571914][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7132.572178][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7132.572447][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7132.572768][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7132.573044][ C0] ? ktime_get+0xb6/0x190 [ 7132.573274][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7132.573546][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7132.573828][ C0] tcp_write_timer+0x82/0x1d0 [ 7132.574082][ C0] call_timer_fn+0x176/0x430 [ 7132.574327][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7132.574604][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7132.574876][ C0] __run_timers.part.0+0x52d/0x890 [ 7132.575152][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7132.575440][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7132.575742][ C0] ? lock_acquire+0x1c1/0x220 [ 7132.575990][ C0] ? clockevents_program_event+0xf6/0x300 [ 7132.576297][ C0] ? lock_release+0x1d5/0x250 [ 7132.576547][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7132.576822][ C0] ? ktime_get+0xb6/0x190 [ 7132.577053][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7132.577350][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7132.577665][ C0] run_timer_softirq+0x72/0x100 [ 7132.577924][ C0] __do_softirq+0x1bc/0x7ff [ 7132.578172][ C0] irq_exit_rcu+0x98/0xc0 [ 7132.578401][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7132.578700][ C0] [ 7132.578858][ C0] [ 7132.579016][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7132.579342][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7132.579609][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7132.580624][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7132.580948][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7132.581367][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7132.581784][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7132.582215][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7132.582640][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7132.583065][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7132.583368][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7132.583646][ C0] default_idle_call+0x69/0xa0 [ 7132.583898][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7132.584164][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7132.584456][ C0] ? lock_release+0x1d5/0x250 [ 7132.584712][ C0] do_idle+0xfb/0x160 [ 7132.584926][ C0] cpu_startup_entry+0x55/0x60 [ 7132.585183][ C0] rest_init+0x153/0x260 [ 7132.585413][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7132.585705][ C0] arch_call_rest_init+0x13/0x40 [ 7132.585974][ C0] start_kernel+0x314/0x3d0 [ 7132.586216][ C0] x86_64_start_reservations+0x18/0x30 [ 7132.586507][ C0] x86_64_start_kernel+0xba/0x110 [ 7132.586777][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7132.587107][ C0] [ 7132.587278][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5536s! [ksoftirqd/1:22] [ 7132.587745][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7132.588942][ C1] irq event stamp: 3886976 [ 7132.589181][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7132.589674][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7132.590166][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7132.590664][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7132.591157][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7132.591649][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7132.592302][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7132.592644][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7132.593666][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7132.593995][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7132.594415][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7132.594836][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7132.595260][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7132.595686][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7132.596106][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7132.596576][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7132.596923][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7132.597344][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7132.597760][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7132.598178][ C1] Call Trace: [ 7132.598356][ C1] [ 7132.598510][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7132.598789][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7132.599042][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7132.599334][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7132.599616][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7132.599917][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7132.600196][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7132.600514][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7132.600790][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7132.601113][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7132.601420][ C1] [ 7132.601578][ C1] [ 7132.601737][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7132.602076][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7132.602381][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7132.602695][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7132.602996][ C1] ? run_ksoftirqd+0xb/0x60 [ 7132.603240][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7132.603566][ C1] ? __orc_find+0x9c/0xf0 [ 7132.603797][ C1] ? lock_acquire+0x1c1/0x220 [ 7132.604056][ C1] ? irqentry_enter+0x2b/0x60 [ 7132.604311][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7132.604577][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7132.604864][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7132.605165][ C1] ? lock_acquire+0x1c1/0x220 [ 7132.605412][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7132.605663][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7132.605937][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7132.606187][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7132.606450][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7132.606721][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7132.607012][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7132.607303][ C1] ip_local_deliver+0x19d/0x480 [ 7132.607561][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7132.607846][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7132.608110][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7132.608392][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7132.608657][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7132.608992][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7132.609273][ C1] ip_rcv+0x564/0x740 [ 7132.609488][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7132.609734][ C1] ? set_track_prepare+0x8a/0xd0 [ 7132.609999][ C1] ? irqentry_enter+0x2b/0x60 [ 7132.610248][ C1] ? irqentry_enter+0x2b/0x60 [ 7132.610498][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7132.610738][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7132.611055][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7132.611393][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7132.611701][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7132.612046][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7132.612343][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7132.612679][ C1] netif_receive_skb+0x55/0x280 [ 7132.612944][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7132.613274][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7132.613630][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7132.613942][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7132.614232][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7132.614536][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7132.614866][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7132.615148][ C1] ? arch_stack_walk+0x68/0x100 [ 7132.615405][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7132.615680][ C1] ? irqentry_enter+0x2b/0x60 [ 7132.615929][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7132.616251][ C1] ? irqentry_enter+0x2b/0x60 [ 7132.616510][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7132.616832][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7132.617110][ C1] ? arch_stack_walk+0x68/0x100 [ 7132.617372][ C1] __tcf_classify+0x32c/0x7d0 [ 7132.617628][ C1] tcf_classify+0x283/0x930 [ 7132.617874][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7132.618147][ C1] tc_run+0x2e4/0x5d0 [ 7132.618364][ C1] ? __pfx_tc_run+0x10/0x10 [ 7132.618611][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7132.618880][ C1] ? irqentry_enter+0x2b/0x60 [ 7132.619129][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7132.619414][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7132.619739][ C1] ip_finish_output2+0x786/0x18e0 [ 7132.620011][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7132.620301][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7132.620565][ C1] ? __ip_finish_output+0x10f/0x770 [ 7132.620845][ C1] ip_output+0x16b/0x4f0 [ 7132.621077][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7132.621396][ C1] ? __pfx_ip_output+0x10/0x10 [ 7132.621655][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7132.622013][ C1] ? __pfx_ip_output+0x10/0x10 [ 7132.622271][ C1] __ip_queue_xmit+0x672/0x1910 [ 7132.622531][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7132.622814][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7132.623109][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7132.623394][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7132.623689][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7132.623974][ C1] tcp_delack_timer+0x84/0x240 [ 7132.624230][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7132.624517][ C1] call_timer_fn+0x176/0x430 [ 7132.624769][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7132.625043][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7132.625324][ C1] __run_timers.part.0+0x52d/0x890 [ 7132.625601][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7132.625888][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7132.626187][ C1] ? __pfx___schedule+0x10/0x10 [ 7132.626448][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7132.626769][ C1] run_timer_softirq+0x72/0x100 [ 7132.627026][ C1] __do_softirq+0x1bc/0x7ff [ 7132.627267][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7132.627540][ C1] run_ksoftirqd+0x2e/0x60 [ 7132.627780][ C1] smpboot_thread_fn+0x30e/0x840 [ 7132.628045][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7132.628337][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7132.628629][ C1] kthread+0x292/0x360 [ 7132.628846][ C1] ? __pfx_kthread+0x10/0x10 [ 7132.629090][ C1] ret_from_fork+0x34/0x70 [ 7132.629330][ C1] ? __pfx_kthread+0x10/0x10 [ 7132.629576][ C1] ret_from_fork_asm+0x1b/0x30 [ 7132.629838][ C1] [ 7154.760025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7154.760434][ C1] rcu: 1-....: (5942839 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1406061 [ 7154.761042][ C1] rcu: (t=5960451 jiffies g=1007429 q=31 ncpus=4) [ 7154.761395][ C1] Sending NMI from CPU 1 to CPUs 0: [ 7154.761692][ C0] NMI backtrace for cpu 0 [ 7154.761697][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7154.761701][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7154.761704][ C0] RIP: 0010:__kasan_check_read+0x0/0x20 [ 7154.761712][ C0] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 7154.761715][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000202 [ 7154.761718][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7154.761720][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7154.761723][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7154.761724][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7154.761726][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7154.761728][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7154.761730][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7154.761734][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7154.761735][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7154.761737][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7154.761738][ C0] Call Trace: [ 7154.761741][ C0] [ 7154.761744][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 7154.761750][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7154.761756][ C0] ? nmi_handle+0x156/0x420 [ 7154.761762][ C0] ? default_do_nmi+0x41/0x100 [ 7154.761766][ C0] ? exc_nmi+0xf3/0x120 [ 7154.761769][ C0] ? end_repeat_nmi+0xf/0x60 [ 7154.761774][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7154.761780][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 7154.761783][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 7154.761786][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 7154.761788][ C0] [ 7154.761790][ C0] [ 7154.761790][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 7154.761795][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7154.761798][ C0] ? get_stack_info+0x36/0xc0 [ 7154.761804][ C0] ? lock_acquire+0x1c1/0x220 [ 7154.761809][ C0] ? lock_release+0x1d5/0x250 [ 7154.761813][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7154.761817][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7154.761820][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7154.761823][ C0] ? lock_acquire+0x1c1/0x220 [ 7154.761825][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7154.761831][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7154.761835][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7154.761842][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7154.761845][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7154.761849][ C0] ? __inet_lookup_established+0x341/0x610 [ 7154.761855][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7154.761863][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7154.761867][ C0] ip_local_deliver+0x19d/0x480 [ 7154.761870][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7154.761879][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7154.761884][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7154.761888][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7154.761891][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7154.761895][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7154.761906][ C0] ip_rcv+0x564/0x740 [ 7154.761909][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7154.761912][ C0] ? set_track_prepare+0x8a/0xd0 [ 7154.761917][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7154.761919][ C0] ? rest_init+0x153/0x260 [ 7154.761922][ C0] ? skb_clone+0x10b/0x330 [ 7154.761927][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7154.761933][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7154.761939][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7154.761944][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7154.761953][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7154.761956][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7154.761959][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7154.761963][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7154.761967][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7154.761970][ C0] ? lock_acquire+0x1c1/0x220 [ 7154.761972][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7154.761975][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7154.761979][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7154.761982][ C0] ? __copy_skb_header+0xaf/0x490 [ 7154.761985][ C0] ? __skb_clone+0x57a/0x760 [ 7154.761987][ C0] netif_receive_skb+0x55/0x280 [ 7154.761990][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7154.761998][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7154.762005][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7154.762012][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7154.762018][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7154.762027][ C0] ? hlock_class+0x4e/0x130 [ 7154.762035][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7154.762045][ C0] ? place_entity+0x21/0x2f0 [ 7154.762048][ C0] ? resched_curr+0x219/0x280 [ 7154.762052][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7154.762055][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7154.762058][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7154.762063][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7154.762066][ C0] ? activate_task+0xf5/0x260 [ 7154.762069][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7154.762075][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7154.762078][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7154.762082][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7154.762085][ C0] ? get_stack_info+0x36/0xc0 [ 7154.762089][ C0] ? stack_access_ok+0xda/0x1f0 [ 7154.762091][ C0] ? get_reg+0x119/0x190 [ 7154.762095][ C0] __tcf_classify+0x32c/0x7d0 [ 7154.762099][ C0] tcf_classify+0x283/0x930 [ 7154.762102][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7154.762108][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7154.762110][ C0] ? arch_stack_walk+0x8c/0x100 [ 7154.762116][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7154.762119][ C0] tc_run+0x2e4/0x5d0 [ 7154.762124][ C0] ? __pfx_tc_run+0x10/0x10 [ 7154.762128][ C0] ? lock_acquire+0x1c1/0x220 [ 7154.762130][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7154.762135][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7154.762141][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7154.762144][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7154.762147][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7154.762151][ C0] ? neigh_hh_output+0x348/0x590 [ 7154.762156][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7154.762160][ C0] ip_finish_output2+0x786/0x18e0 [ 7154.762164][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7154.762169][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7154.762177][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7154.762180][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7154.762184][ C0] ? __ip_finish_output+0x10f/0x770 [ 7154.762188][ C0] ip_output+0x16b/0x4f0 [ 7154.762191][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7154.762196][ C0] ? __pfx_ip_output+0x10/0x10 [ 7154.762199][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7154.762204][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7154.762207][ C0] ? ip_local_out+0x114/0x3b0 [ 7154.762211][ C0] __ip_queue_xmit+0x672/0x1910 [ 7154.762215][ C0] ? __skb_clone+0x57a/0x760 [ 7154.762218][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7154.762226][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7154.762230][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7154.762234][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7154.762240][ C0] ? tcp_current_mss+0x40a/0x510 [ 7154.762243][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7154.762246][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7154.762248][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7154.762250][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7154.762254][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7154.762257][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7154.762262][ C0] ? ktime_get+0xb6/0x190 [ 7154.762266][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7154.762270][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7154.762273][ C0] tcp_write_timer+0x82/0x1d0 [ 7154.762277][ C0] call_timer_fn+0x176/0x430 [ 7154.762281][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7154.762286][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7154.762290][ C0] __run_timers.part.0+0x52d/0x890 [ 7154.762293][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7154.762298][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7154.762301][ C0] ? lock_acquire+0x1c1/0x220 [ 7154.762303][ C0] ? clockevents_program_event+0xf6/0x300 [ 7154.762307][ C0] ? lock_release+0x1d5/0x250 [ 7154.762310][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7154.762313][ C0] ? ktime_get+0xb6/0x190 [ 7154.762315][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7154.762319][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7154.762324][ C0] run_timer_softirq+0x72/0x100 [ 7154.762327][ C0] __do_softirq+0x1bc/0x7ff [ 7154.762332][ C0] irq_exit_rcu+0x98/0xc0 [ 7154.762335][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7154.762340][ C0] [ 7154.762340][ C0] [ 7154.762342][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7154.762346][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7154.762349][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7154.762351][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7154.762353][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7154.762355][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7154.762356][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7154.762358][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7154.762359][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7154.762363][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7154.762366][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7154.762370][ C0] default_idle_call+0x69/0xa0 [ 7154.762372][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7154.762375][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7154.762381][ C0] ? lock_release+0x1d5/0x250 [ 7154.762385][ C0] do_idle+0xfb/0x160 [ 7154.762387][ C0] cpu_startup_entry+0x55/0x60 [ 7154.762390][ C0] rest_init+0x153/0x260 [ 7154.762392][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7154.762399][ C0] arch_call_rest_init+0x13/0x40 [ 7154.762404][ C0] start_kernel+0x314/0x3d0 [ 7154.762408][ C0] x86_64_start_reservations+0x18/0x30 [ 7154.762413][ C0] x86_64_start_kernel+0xba/0x110 [ 7154.762417][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7154.762424][ C0] [ 7154.762688][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7154.818221][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7154.818884][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7154.819238][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7154.820281][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7154.820613][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7154.821043][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7154.821470][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7154.821903][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7154.822338][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7154.822772][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7154.823260][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7154.823615][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7154.824051][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7154.824483][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7154.824910][ C1] Call Trace: [ 7154.825093][ C1] [ 7154.825254][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7154.825550][ C1] ? print_cpu_stall+0x263/0x6a0 [ 7154.825821][ C1] ? check_cpu_stall+0x284/0x500 [ 7154.826095][ C1] ? rcu_pending+0x92/0x360 [ 7154.826343][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7154.826630][ C1] ? update_process_times+0xb9/0x110 [ 7154.826921][ C1] ? tick_sched_handle+0x67/0x130 [ 7154.827197][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7154.827502][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7154.827765][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7154.828102][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7154.828397][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7154.828709][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7154.828998][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7154.829331][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7154.829612][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7154.829946][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7154.830268][ C1] [ 7154.830430][ C1] [ 7154.830591][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7154.830927][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7154.831244][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7154.831564][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7154.831879][ C1] ? run_ksoftirqd+0xb/0x60 [ 7154.832135][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7154.832473][ C1] ? __orc_find+0x9c/0xf0 [ 7154.832710][ C1] ? lock_acquire+0x1c1/0x220 [ 7154.832966][ C1] ? irqentry_enter+0x2b/0x60 [ 7154.833223][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7154.833488][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7154.833780][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7154.834087][ C1] ? lock_acquire+0x1c1/0x220 [ 7154.834350][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7154.834613][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7154.834895][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7154.835147][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7154.835410][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7154.835687][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7154.835982][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7154.836281][ C1] ip_local_deliver+0x19d/0x480 [ 7154.836549][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7154.836842][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7154.837118][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7154.837401][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7154.837671][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7154.838019][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7154.838299][ C1] ip_rcv+0x564/0x740 [ 7154.838519][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7154.838765][ C1] ? set_track_prepare+0x8a/0xd0 [ 7154.839038][ C1] ? irqentry_enter+0x2b/0x60 [ 7154.839301][ C1] ? irqentry_enter+0x2b/0x60 [ 7154.839564][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7154.839815][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7154.840141][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7154.840492][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7154.840814][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7154.841161][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7154.841467][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7154.841811][ C1] netif_receive_skb+0x55/0x280 [ 7154.842084][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7154.842417][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7154.842774][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7154.843099][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7154.843397][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7154.843712][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7154.844051][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7154.844344][ C1] ? arch_stack_walk+0x68/0x100 [ 7154.844618][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7154.844908][ C1] ? irqentry_enter+0x2b/0x60 [ 7154.845172][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7154.845500][ C1] ? irqentry_enter+0x2b/0x60 [ 7154.845756][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7154.846086][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7154.846377][ C1] ? arch_stack_walk+0x68/0x100 [ 7154.846643][ C1] __tcf_classify+0x32c/0x7d0 [ 7154.846900][ C1] tcf_classify+0x283/0x930 [ 7154.847149][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7154.847426][ C1] tc_run+0x2e4/0x5d0 [ 7154.847647][ C1] ? __pfx_tc_run+0x10/0x10 [ 7154.847896][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7154.848170][ C1] ? irqentry_enter+0x2b/0x60 [ 7154.848432][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7154.848730][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7154.849062][ C1] ip_finish_output2+0x786/0x18e0 [ 7154.849338][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7154.849635][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7154.849907][ C1] ? __ip_finish_output+0x10f/0x770 [ 7154.850195][ C1] ip_output+0x16b/0x4f0 [ 7154.850427][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7154.850754][ C1] ? __pfx_ip_output+0x10/0x10 [ 7154.851017][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7154.851382][ C1] ? __pfx_ip_output+0x10/0x10 [ 7154.851647][ C1] __ip_queue_xmit+0x672/0x1910 [ 7154.851921][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7154.852214][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7154.852519][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7154.852815][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7154.853121][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7154.853419][ C1] tcp_delack_timer+0x84/0x240 [ 7154.853686][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7154.853979][ C1] call_timer_fn+0x176/0x430 [ 7154.854233][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7154.854518][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7154.854802][ C1] __run_timers.part.0+0x52d/0x890 [ 7154.855082][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7154.855380][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7154.855692][ C1] ? __pfx___schedule+0x10/0x10 [ 7154.855960][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7154.856291][ C1] run_timer_softirq+0x72/0x100 [ 7154.856562][ C1] __do_softirq+0x1bc/0x7ff [ 7154.856816][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7154.857099][ C1] run_ksoftirqd+0x2e/0x60 [ 7154.857344][ C1] smpboot_thread_fn+0x30e/0x840 [ 7154.857617][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7154.857915][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7154.858217][ C1] kthread+0x292/0x360 [ 7154.858442][ C1] ? __pfx_kthread+0x10/0x10 [ 7154.858698][ C1] ret_from_fork+0x34/0x70 [ 7154.858946][ C1] ? __pfx_kthread+0x10/0x10 [ 7154.859201][ C1] ret_from_fork_asm+0x1b/0x30 [ 7154.859466][ C1] [ 7180.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5581s! [swapper/0:0] [ 7180.527926][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7180.529125][ C0] irq event stamp: 27567077 [ 7180.529366][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7180.529896][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7180.530381][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7180.530889][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7180.531390][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7180.531885][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7180.532536][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7180.532882][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7180.533912][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7180.534239][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7180.534665][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7180.535087][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7180.535508][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7180.535937][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7180.536364][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7180.536837][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7180.537188][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7180.537619][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7180.538039][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7180.538459][ C0] Call Trace: [ 7180.538636][ C0] [ 7180.538792][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7180.539073][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7180.539335][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7180.539629][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7180.539913][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7180.540215][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7180.540494][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7180.540813][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7180.541092][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7180.541369][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7180.541703][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7180.542022][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7180.542359][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7180.542662][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7180.542971][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7180.543280][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7180.543610][ C0] ? get_stack_info+0x36/0xc0 [ 7180.543861][ C0] ? lock_acquire+0x1c1/0x220 [ 7180.544110][ C0] ? lock_release+0x1d5/0x250 [ 7180.544359][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7180.544621][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7180.544907][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7180.545206][ C0] ? lock_acquire+0x1c1/0x220 [ 7180.545459][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7180.545715][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7180.545991][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7180.546240][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7180.546498][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7180.546767][ C0] ? __inet_lookup_established+0x341/0x610 [ 7180.547082][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7180.547377][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7180.547674][ C0] ip_local_deliver+0x19d/0x480 [ 7180.547934][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7180.548220][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7180.548486][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7180.548767][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7180.549034][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7180.549367][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7180.549649][ C0] ip_rcv+0x564/0x740 [ 7180.549862][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7180.550108][ C0] ? set_track_prepare+0x8a/0xd0 [ 7180.550373][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7180.550661][ C0] ? rest_init+0x153/0x260 [ 7180.550903][ C0] ? skb_clone+0x10b/0x330 [ 7180.551145][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7180.551484][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7180.551811][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7180.552113][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7180.552426][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7180.552687][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7180.552932][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7180.553252][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7180.553557][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7180.553897][ C0] ? lock_acquire+0x1c1/0x220 [ 7180.554147][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7180.554458][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7180.554763][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7180.555096][ C0] ? __copy_skb_header+0xaf/0x490 [ 7180.555363][ C0] ? __skb_clone+0x57a/0x760 [ 7180.555607][ C0] netif_receive_skb+0x55/0x280 [ 7180.555869][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7180.556201][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7180.556555][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7180.556867][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7180.557158][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7180.557460][ C0] ? hlock_class+0x4e/0x130 [ 7180.557709][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7180.558047][ C0] ? place_entity+0x21/0x2f0 [ 7180.558299][ C0] ? resched_curr+0x219/0x280 [ 7180.558552][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7180.558821][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7180.559104][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7180.559388][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7180.559651][ C0] ? activate_task+0xf5/0x260 [ 7180.559905][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7180.560184][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7180.560457][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7180.560721][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7180.561018][ C0] ? get_stack_info+0x36/0xc0 [ 7180.561271][ C0] ? stack_access_ok+0xda/0x1f0 [ 7180.561531][ C0] ? get_reg+0x119/0x190 [ 7180.561761][ C0] __tcf_classify+0x32c/0x7d0 [ 7180.562011][ C0] tcf_classify+0x283/0x930 [ 7180.562254][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7180.562584][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7180.562855][ C0] ? arch_stack_walk+0x8c/0x100 [ 7180.563124][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7180.563419][ C0] tc_run+0x2e4/0x5d0 [ 7180.563634][ C0] ? __pfx_tc_run+0x10/0x10 [ 7180.563875][ C0] ? lock_acquire+0x1c1/0x220 [ 7180.564126][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7180.564405][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7180.564677][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7180.564963][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7180.565244][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7180.565563][ C0] ? neigh_hh_output+0x348/0x590 [ 7180.565832][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7180.566111][ C0] ip_finish_output2+0x786/0x18e0 [ 7180.566379][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7180.566678][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7180.567035][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7180.567330][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7180.567595][ C0] ? __ip_finish_output+0x10f/0x770 [ 7180.567877][ C0] ip_output+0x16b/0x4f0 [ 7180.568106][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7180.568388][ C0] ? __pfx_ip_output+0x10/0x10 [ 7180.568645][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7180.568951][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7180.569220][ C0] ? ip_local_out+0x114/0x3b0 [ 7180.569470][ C0] __ip_queue_xmit+0x672/0x1910 [ 7180.569728][ C0] ? __skb_clone+0x57a/0x760 [ 7180.569972][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7180.570259][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7180.570558][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7180.570882][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7180.571140][ C0] ? tcp_current_mss+0x40a/0x510 [ 7180.571406][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7180.571684][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7180.571966][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7180.572222][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7180.572494][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7180.572817][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7180.573094][ C0] ? ktime_get+0xb6/0x190 [ 7180.573326][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7180.573599][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7180.573883][ C0] tcp_write_timer+0x82/0x1d0 [ 7180.574134][ C0] call_timer_fn+0x176/0x430 [ 7180.574381][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7180.574658][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7180.574931][ C0] __run_timers.part.0+0x52d/0x890 [ 7180.575207][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7180.575492][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7180.575794][ C0] ? lock_acquire+0x1c1/0x220 [ 7180.576043][ C0] ? clockevents_program_event+0xf6/0x300 [ 7180.576350][ C0] ? lock_release+0x1d5/0x250 [ 7180.576601][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7180.576876][ C0] ? ktime_get+0xb6/0x190 [ 7180.577108][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7180.577405][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7180.577720][ C0] run_timer_softirq+0x72/0x100 [ 7180.577980][ C0] __do_softirq+0x1bc/0x7ff [ 7180.578223][ C0] irq_exit_rcu+0x98/0xc0 [ 7180.578452][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7180.578752][ C0] [ 7180.578911][ C0] [ 7180.579071][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7180.579400][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7180.579668][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7180.580693][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7180.581017][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7180.581436][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7180.581864][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7180.582291][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7180.582723][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7180.583147][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7180.583452][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7180.583729][ C0] default_idle_call+0x69/0xa0 [ 7180.583980][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7180.584252][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7180.584546][ C0] ? lock_release+0x1d5/0x250 [ 7180.584802][ C0] do_idle+0xfb/0x160 [ 7180.585019][ C0] cpu_startup_entry+0x55/0x60 [ 7180.585276][ C0] rest_init+0x153/0x260 [ 7180.585503][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7180.585797][ C0] arch_call_rest_init+0x13/0x40 [ 7180.586068][ C0] start_kernel+0x314/0x3d0 [ 7180.586314][ C0] x86_64_start_reservations+0x18/0x30 [ 7180.586611][ C0] x86_64_start_kernel+0xba/0x110 [ 7180.586882][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7180.587215][ C0] [ 7180.587383][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5581s! [ksoftirqd/1:22] [ 7180.587852][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7180.589088][ C1] irq event stamp: 3886976 [ 7180.589338][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7180.589845][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7180.590352][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7180.590859][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7180.591367][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7180.591873][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7180.592544][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7180.592899][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7180.593956][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7180.594293][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7180.594723][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7180.595154][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7180.595587][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7180.596021][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7180.596451][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7180.596932][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7180.597289][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7180.597719][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7180.598146][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7180.598571][ C1] Call Trace: [ 7180.598753][ C1] [ 7180.598911][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7180.599197][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7180.599456][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7180.599759][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7180.600051][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7180.600360][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7180.600644][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7180.600971][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7180.601258][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7180.601588][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7180.601912][ C1] [ 7180.602076][ C1] [ 7180.602239][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7180.602578][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7180.602892][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7180.603218][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7180.603527][ C1] ? run_ksoftirqd+0xb/0x60 [ 7180.603777][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7180.604113][ C1] ? __orc_find+0x9c/0xf0 [ 7180.604351][ C1] ? lock_acquire+0x1c1/0x220 [ 7180.604612][ C1] ? irqentry_enter+0x2b/0x60 [ 7180.604873][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7180.605146][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7180.605444][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7180.605752][ C1] ? lock_acquire+0x1c1/0x220 [ 7180.606006][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7180.606263][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7180.606542][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7180.606798][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7180.607069][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7180.607349][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7180.607650][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7180.607948][ C1] ip_local_deliver+0x19d/0x480 [ 7180.608215][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7180.608506][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7180.608777][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7180.609066][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7180.609338][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7180.609681][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7180.609965][ C1] ip_rcv+0x564/0x740 [ 7180.610189][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7180.610441][ C1] ? set_track_prepare+0x8a/0xd0 [ 7180.610715][ C1] ? irqentry_enter+0x2b/0x60 [ 7180.610970][ C1] ? irqentry_enter+0x2b/0x60 [ 7180.611228][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7180.611477][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7180.611800][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7180.612158][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7180.612478][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7180.612825][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7180.613130][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7180.613473][ C1] netif_receive_skb+0x55/0x280 [ 7180.613744][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7180.614082][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7180.614444][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7180.614773][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7180.615074][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7180.615387][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7180.615729][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7180.616021][ C1] ? arch_stack_walk+0x68/0x100 [ 7180.616285][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7180.616569][ C1] ? irqentry_enter+0x2b/0x60 [ 7180.616825][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7180.617155][ C1] ? irqentry_enter+0x2b/0x60 [ 7180.617419][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7180.617751][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7180.618039][ C1] ? arch_stack_walk+0x68/0x100 [ 7180.618310][ C1] __tcf_classify+0x32c/0x7d0 [ 7180.618573][ C1] tcf_classify+0x283/0x930 [ 7180.618826][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7180.619108][ C1] tc_run+0x2e4/0x5d0 [ 7180.619331][ C1] ? __pfx_tc_run+0x10/0x10 [ 7180.619586][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7180.619862][ C1] ? irqentry_enter+0x2b/0x60 [ 7180.620120][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7180.620412][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7180.620745][ C1] ip_finish_output2+0x786/0x18e0 [ 7180.621025][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7180.621325][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7180.621598][ C1] ? __ip_finish_output+0x10f/0x770 [ 7180.621890][ C1] ip_output+0x16b/0x4f0 [ 7180.622125][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7180.622458][ C1] ? __pfx_ip_output+0x10/0x10 [ 7180.622723][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7180.623088][ C1] ? __pfx_ip_output+0x10/0x10 [ 7180.623352][ C1] __ip_queue_xmit+0x672/0x1910 [ 7180.623620][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7180.623906][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7180.624209][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7180.624504][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7180.624809][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7180.625104][ C1] tcp_delack_timer+0x84/0x240 [ 7180.625369][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7180.625666][ C1] call_timer_fn+0x176/0x430 [ 7180.625923][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7180.626207][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7180.626497][ C1] __run_timers.part.0+0x52d/0x890 [ 7180.626782][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7180.627080][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7180.627388][ C1] ? __pfx___schedule+0x10/0x10 [ 7180.627656][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7180.627990][ C1] run_timer_softirq+0x72/0x100 [ 7180.628255][ C1] __do_softirq+0x1bc/0x7ff [ 7180.628503][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7180.628785][ C1] run_ksoftirqd+0x2e/0x60 [ 7180.629032][ C1] smpboot_thread_fn+0x30e/0x840 [ 7180.629305][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7180.629607][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7180.629909][ C1] kthread+0x292/0x360 [ 7180.630134][ C1] ? __pfx_kthread+0x10/0x10 [ 7180.630385][ C1] ret_from_fork+0x34/0x70 [ 7180.630632][ C1] ? __pfx_kthread+0x10/0x10 [ 7180.630886][ C1] ret_from_fork_asm+0x1b/0x30 [ 7180.631156][ C1] [ 7208.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5607s! [swapper/0:0] [ 7208.527996][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7208.529197][ C0] irq event stamp: 27567077 [ 7208.529442][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7208.529977][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7208.530453][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7208.530957][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7208.531453][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7208.531940][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7208.532581][ C0] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 7208.532884][ C0] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 7208.533912][ C0] RSP: 0018:ffffc900000069c0 EFLAGS: 00000286 [ 7208.534237][ C0] RAX: ffff88800a099b5c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7208.534662][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7208.535083][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7208.535504][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7208.535929][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7208.536355][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7208.536828][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7208.537183][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7208.537611][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7208.538030][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7208.538447][ C0] Call Trace: [ 7208.538626][ C0] [ 7208.538782][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7208.539063][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7208.539322][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7208.539615][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7208.539898][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7208.540204][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7208.540482][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7208.540800][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7208.541077][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7208.541352][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7208.541688][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7208.541996][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7208.542332][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7208.542635][ C0] ? kasan_check_range+0x1a/0x1c0 [ 7208.542903][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 7208.543195][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7208.543518][ C0] ? get_stack_info+0x36/0xc0 [ 7208.543775][ C0] ? lock_acquire+0x1c1/0x220 [ 7208.544030][ C0] ? lock_release+0x1d5/0x250 [ 7208.544283][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7208.544546][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7208.544839][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7208.545143][ C0] ? lock_acquire+0x1c1/0x220 [ 7208.545393][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7208.545647][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7208.545928][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7208.546178][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7208.546440][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7208.546714][ C0] ? __inet_lookup_established+0x341/0x610 [ 7208.547029][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7208.547319][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7208.547608][ C0] ip_local_deliver+0x19d/0x480 [ 7208.547873][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7208.548166][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7208.548435][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7208.548710][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7208.548971][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7208.549312][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7208.549586][ C0] ip_rcv+0x564/0x740 [ 7208.549797][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7208.550037][ C0] ? set_track_prepare+0x8a/0xd0 [ 7208.550301][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7208.550591][ C0] ? rest_init+0x153/0x260 [ 7208.550827][ C0] ? skb_clone+0x10b/0x330 [ 7208.551072][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7208.551407][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7208.551729][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7208.552023][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7208.552330][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7208.552589][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7208.552829][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7208.553141][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7208.553440][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7208.553786][ C0] ? lock_acquire+0x1c1/0x220 [ 7208.554039][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7208.554355][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7208.554654][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7208.554988][ C0] ? __copy_skb_header+0xaf/0x490 [ 7208.555259][ C0] ? __skb_clone+0x57a/0x760 [ 7208.555507][ C0] netif_receive_skb+0x55/0x280 [ 7208.555767][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7208.556092][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7208.556439][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7208.556756][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7208.557043][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7208.557342][ C0] ? hlock_class+0x4e/0x130 [ 7208.557587][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7208.557916][ C0] ? place_entity+0x21/0x2f0 [ 7208.558164][ C0] ? resched_curr+0x219/0x280 [ 7208.558421][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7208.558694][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7208.558979][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7208.559258][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7208.559520][ C0] ? activate_task+0xf5/0x260 [ 7208.559772][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7208.560048][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7208.560324][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7208.560581][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7208.560870][ C0] ? get_stack_info+0x36/0xc0 [ 7208.561127][ C0] ? stack_access_ok+0xda/0x1f0 [ 7208.561392][ C0] ? get_reg+0x119/0x190 [ 7208.561625][ C0] __tcf_classify+0x32c/0x7d0 [ 7208.561879][ C0] tcf_classify+0x283/0x930 [ 7208.562125][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7208.562461][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7208.562726][ C0] ? arch_stack_walk+0x8c/0x100 [ 7208.562991][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7208.563283][ C0] tc_run+0x2e4/0x5d0 [ 7208.563501][ C0] ? __pfx_tc_run+0x10/0x10 [ 7208.563748][ C0] ? lock_acquire+0x1c1/0x220 [ 7208.564004][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7208.564281][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7208.564548][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7208.564839][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7208.565120][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7208.565444][ C0] ? neigh_hh_output+0x348/0x590 [ 7208.565707][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7208.565989][ C0] ip_finish_output2+0x786/0x18e0 [ 7208.566264][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7208.566561][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7208.566913][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7208.567200][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7208.567471][ C0] ? __ip_finish_output+0x10f/0x770 [ 7208.567749][ C0] ip_output+0x16b/0x4f0 [ 7208.567976][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7208.568262][ C0] ? __pfx_ip_output+0x10/0x10 [ 7208.568515][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7208.568820][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7208.569084][ C0] ? ip_local_out+0x114/0x3b0 [ 7208.569337][ C0] __ip_queue_xmit+0x672/0x1910 [ 7208.569599][ C0] ? __skb_clone+0x57a/0x760 [ 7208.569848][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7208.570134][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7208.570429][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7208.570751][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7208.571011][ C0] ? tcp_current_mss+0x40a/0x510 [ 7208.571276][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7208.571560][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7208.571846][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7208.572105][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7208.572372][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7208.572688][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7208.572969][ C0] ? ktime_get+0xb6/0x190 [ 7208.573203][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7208.573481][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7208.573760][ C0] tcp_write_timer+0x82/0x1d0 [ 7208.574014][ C0] call_timer_fn+0x176/0x430 [ 7208.574265][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7208.574539][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7208.574816][ C0] __run_timers.part.0+0x52d/0x890 [ 7208.575089][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7208.575377][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7208.575676][ C0] ? lock_acquire+0x1c1/0x220 [ 7208.575929][ C0] ? clockevents_program_event+0xf6/0x300 [ 7208.576239][ C0] ? lock_release+0x1d5/0x250 [ 7208.576495][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7208.576776][ C0] ? ktime_get+0xb6/0x190 [ 7208.577010][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7208.577310][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7208.577621][ C0] run_timer_softirq+0x72/0x100 [ 7208.577885][ C0] __do_softirq+0x1bc/0x7ff [ 7208.578134][ C0] irq_exit_rcu+0x98/0xc0 [ 7208.578366][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7208.578671][ C0] [ 7208.578828][ C0] [ 7208.578985][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7208.579304][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7208.579578][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7208.580604][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7208.580941][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7208.581364][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7208.581787][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7208.582206][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7208.582625][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7208.583045][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7208.583348][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7208.583619][ C0] default_idle_call+0x69/0xa0 [ 7208.583874][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7208.584136][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7208.584432][ C0] ? lock_release+0x1d5/0x250 [ 7208.584683][ C0] do_idle+0xfb/0x160 [ 7208.584897][ C0] cpu_startup_entry+0x55/0x60 [ 7208.585151][ C0] rest_init+0x153/0x260 [ 7208.585378][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7208.585667][ C0] arch_call_rest_init+0x13/0x40 [ 7208.585933][ C0] start_kernel+0x314/0x3d0 [ 7208.586181][ C0] x86_64_start_reservations+0x18/0x30 [ 7208.586480][ C0] x86_64_start_kernel+0xba/0x110 [ 7208.586747][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7208.587073][ C0] [ 7208.587236][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5607s! [ksoftirqd/1:22] [ 7208.587703][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7208.588929][ C1] irq event stamp: 3886976 [ 7208.589175][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7208.589691][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7208.590204][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7208.590720][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7208.591222][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7208.591739][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7208.592398][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7208.592749][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7208.593797][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7208.594129][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7208.594557][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7208.594985][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7208.595417][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7208.595844][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7208.596273][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7208.596762][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7208.597123][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7208.597553][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7208.597984][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7208.598421][ C1] Call Trace: [ 7208.598610][ C1] [ 7208.598771][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7208.599055][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7208.599317][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7208.599614][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7208.599911][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7208.600226][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7208.600515][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7208.600845][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7208.601127][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7208.601464][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7208.601788][ C1] [ 7208.601951][ C1] [ 7208.602115][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7208.602458][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7208.602770][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7208.603091][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7208.603404][ C1] ? run_ksoftirqd+0xb/0x60 [ 7208.603657][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7208.603997][ C1] ? __orc_find+0x9c/0xf0 [ 7208.604235][ C1] ? lock_acquire+0x1c1/0x220 [ 7208.604493][ C1] ? irqentry_enter+0x2b/0x60 [ 7208.604753][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7208.605021][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7208.605315][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7208.605621][ C1] ? lock_acquire+0x1c1/0x220 [ 7208.605879][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7208.606144][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7208.606427][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7208.606682][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7208.606948][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7208.607229][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7208.607524][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7208.607821][ C1] ip_local_deliver+0x19d/0x480 [ 7208.608096][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7208.608394][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7208.608667][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7208.608952][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7208.609223][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7208.609572][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7208.609852][ C1] ip_rcv+0x564/0x740 [ 7208.610072][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7208.610320][ C1] ? set_track_prepare+0x8a/0xd0 [ 7208.610591][ C1] ? irqentry_enter+0x2b/0x60 [ 7208.610850][ C1] ? irqentry_enter+0x2b/0x60 [ 7208.611113][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7208.611364][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7208.611694][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7208.612049][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7208.612366][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7208.612718][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7208.613032][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7208.613374][ C1] netif_receive_skb+0x55/0x280 [ 7208.613641][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7208.613979][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7208.614337][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7208.614662][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7208.614958][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7208.615272][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7208.615608][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7208.615896][ C1] ? arch_stack_walk+0x68/0x100 [ 7208.616168][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7208.616457][ C1] ? irqentry_enter+0x2b/0x60 [ 7208.616719][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7208.617051][ C1] ? irqentry_enter+0x2b/0x60 [ 7208.617311][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7208.617641][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7208.617933][ C1] ? arch_stack_walk+0x68/0x100 [ 7208.618201][ C1] __tcf_classify+0x32c/0x7d0 [ 7208.618461][ C1] tcf_classify+0x283/0x930 [ 7208.618710][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7208.618987][ C1] tc_run+0x2e4/0x5d0 [ 7208.619209][ C1] ? __pfx_tc_run+0x10/0x10 [ 7208.619459][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7208.619731][ C1] ? irqentry_enter+0x2b/0x60 [ 7208.619991][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7208.620290][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7208.620626][ C1] ip_finish_output2+0x786/0x18e0 [ 7208.620904][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7208.621204][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7208.621481][ C1] ? __ip_finish_output+0x10f/0x770 [ 7208.621772][ C1] ip_output+0x16b/0x4f0 [ 7208.622014][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7208.622343][ C1] ? __pfx_ip_output+0x10/0x10 [ 7208.622611][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7208.622972][ C1] ? __pfx_ip_output+0x10/0x10 [ 7208.623236][ C1] __ip_queue_xmit+0x672/0x1910 [ 7208.623511][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7208.623803][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7208.624113][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7208.624411][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7208.624717][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7208.625013][ C1] tcp_delack_timer+0x84/0x240 [ 7208.625279][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7208.625570][ C1] call_timer_fn+0x176/0x430 [ 7208.625823][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7208.626110][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7208.626394][ C1] __run_timers.part.0+0x52d/0x890 [ 7208.626673][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7208.626971][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7208.627283][ C1] ? __pfx___schedule+0x10/0x10 [ 7208.627549][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7208.627875][ C1] run_timer_softirq+0x72/0x100 [ 7208.628146][ C1] __do_softirq+0x1bc/0x7ff [ 7208.628399][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7208.628683][ C1] run_ksoftirqd+0x2e/0x60 [ 7208.628927][ C1] smpboot_thread_fn+0x30e/0x840 [ 7208.629205][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7208.629504][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7208.629804][ C1] kthread+0x292/0x360 [ 7208.630027][ C1] ? __pfx_kthread+0x10/0x10 [ 7208.630284][ C1] ret_from_fork+0x34/0x70 [ 7208.630527][ C1] ? __pfx_kthread+0x10/0x10 [ 7208.630783][ C1] ret_from_fork_asm+0x1b/0x30 [ 7208.631051][ C1] [ 7232.858025][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7232.858421][ C0] rcu: 0-....: (6029688 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1423769 [ 7232.858939][ C0] rcu: (t=6038549 jiffies g=1007429 q=31 ncpus=4) [ 7232.859284][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7232.859770][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7232.860413][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 7232.860758][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 7232.861789][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7232.862113][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7232.862533][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7232.862952][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7232.863370][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7232.863788][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7232.864209][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7232.864678][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7232.865030][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7232.865452][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7232.865879][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7232.866302][ C0] Call Trace: [ 7232.866482][ C0] [ 7232.866643][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7232.866929][ C0] ? print_cpu_stall+0x263/0x6a0 [ 7232.867195][ C0] ? check_cpu_stall+0x284/0x500 [ 7232.867459][ C0] ? rcu_pending+0x92/0x360 [ 7232.867704][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7232.867989][ C0] ? update_process_times+0xb9/0x110 [ 7232.868272][ C0] ? tick_sched_handle+0x67/0x130 [ 7232.868545][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7232.868846][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7232.869099][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7232.869430][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7232.869719][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7232.870018][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7232.870295][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7232.870613][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7232.870889][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7232.871164][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7232.871495][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7232.871813][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7232.872148][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7232.872450][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 7232.872752][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7232.873054][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7232.873380][ C0] ? get_stack_info+0x36/0xc0 [ 7232.873638][ C0] ? lock_acquire+0x1c1/0x220 [ 7232.873895][ C0] ? lock_release+0x1d5/0x250 [ 7232.874150][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7232.874416][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7232.874705][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7232.875007][ C0] ? lock_acquire+0x1c1/0x220 [ 7232.875255][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7232.875506][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7232.875782][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7232.876033][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7232.876298][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7232.876569][ C0] ? __inet_lookup_established+0x341/0x610 [ 7232.876887][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7232.877178][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7232.877469][ C0] ip_local_deliver+0x19d/0x480 [ 7232.877731][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7232.878018][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7232.878286][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7232.878562][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7232.878823][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7232.879162][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7232.879437][ C0] ip_rcv+0x564/0x740 [ 7232.879648][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7232.879888][ C0] ? set_track_prepare+0x8a/0xd0 [ 7232.880154][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7232.880448][ C0] ? rest_init+0x153/0x260 [ 7232.880684][ C0] ? skb_clone+0x10b/0x330 [ 7232.880932][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7232.881267][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7232.881593][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7232.881889][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7232.882198][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7232.882455][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7232.882694][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7232.883010][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7232.883309][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7232.883652][ C0] ? lock_acquire+0x1c1/0x220 [ 7232.883904][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7232.884220][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7232.884518][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7232.884853][ C0] ? __copy_skb_header+0xaf/0x490 [ 7232.885123][ C0] ? __skb_clone+0x57a/0x760 [ 7232.885372][ C0] netif_receive_skb+0x55/0x280 [ 7232.885629][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7232.885954][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7232.886302][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7232.886618][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7232.886904][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7232.887205][ C0] ? hlock_class+0x4e/0x130 [ 7232.887449][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7232.887779][ C0] ? place_entity+0x21/0x2f0 [ 7232.888027][ C0] ? resched_curr+0x219/0x280 [ 7232.888284][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7232.888555][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7232.888839][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7232.889116][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7232.889374][ C0] ? activate_task+0xf5/0x260 [ 7232.889623][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7232.889898][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7232.890174][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7232.890432][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7232.890724][ C0] ? get_stack_info+0x36/0xc0 [ 7232.890980][ C0] ? stack_access_ok+0xda/0x1f0 [ 7232.891243][ C0] ? get_reg+0x119/0x190 [ 7232.891471][ C0] __tcf_classify+0x32c/0x7d0 [ 7232.891733][ C0] tcf_classify+0x283/0x930 [ 7232.891979][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7232.892314][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7232.892580][ C0] ? arch_stack_walk+0x8c/0x100 [ 7232.892840][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7232.893130][ C0] tc_run+0x2e4/0x5d0 [ 7232.893347][ C0] ? __pfx_tc_run+0x10/0x10 [ 7232.893593][ C0] ? lock_acquire+0x1c1/0x220 [ 7232.893846][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7232.894124][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7232.894390][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7232.894678][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7232.894960][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7232.895285][ C0] ? neigh_hh_output+0x348/0x590 [ 7232.895549][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7232.895830][ C0] ip_finish_output2+0x786/0x18e0 [ 7232.896104][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7232.896399][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7232.896752][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7232.897042][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7232.897309][ C0] ? __ip_finish_output+0x10f/0x770 [ 7232.897584][ C0] ip_output+0x16b/0x4f0 [ 7232.897809][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7232.898094][ C0] ? __pfx_ip_output+0x10/0x10 [ 7232.898347][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7232.898651][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7232.898912][ C0] ? ip_local_out+0x114/0x3b0 [ 7232.899166][ C0] __ip_queue_xmit+0x672/0x1910 [ 7232.899428][ C0] ? __skb_clone+0x57a/0x760 [ 7232.899676][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7232.899955][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7232.900252][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7232.900568][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7232.900826][ C0] ? tcp_current_mss+0x40a/0x510 [ 7232.901087][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7232.901370][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7232.901651][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7232.901907][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7232.902173][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7232.902492][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7232.902773][ C0] ? ktime_get+0xb6/0x190 [ 7232.903006][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7232.903282][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7232.903560][ C0] tcp_write_timer+0x82/0x1d0 [ 7232.903813][ C0] call_timer_fn+0x176/0x430 [ 7232.904065][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7232.904338][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7232.904616][ C0] __run_timers.part.0+0x52d/0x890 [ 7232.904885][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7232.905170][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7232.905466][ C0] ? lock_acquire+0x1c1/0x220 [ 7232.905721][ C0] ? clockevents_program_event+0xf6/0x300 [ 7232.906028][ C0] ? lock_release+0x1d5/0x250 [ 7232.906282][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7232.906560][ C0] ? ktime_get+0xb6/0x190 [ 7232.906793][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7232.907095][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7232.907402][ C0] run_timer_softirq+0x72/0x100 [ 7232.907666][ C0] __do_softirq+0x1bc/0x7ff [ 7232.907910][ C0] irq_exit_rcu+0x98/0xc0 [ 7232.908144][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7232.908445][ C0] [ 7232.908601][ C0] [ 7232.908757][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7232.909078][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7232.909349][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7232.910374][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7232.910700][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7232.911122][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7232.911550][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7232.911966][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7232.912385][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7232.912803][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7232.913105][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7232.913377][ C0] default_idle_call+0x69/0xa0 [ 7232.913634][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7232.913896][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7232.914191][ C0] ? lock_release+0x1d5/0x250 [ 7232.914442][ C0] do_idle+0xfb/0x160 [ 7232.914653][ C0] cpu_startup_entry+0x55/0x60 [ 7232.914909][ C0] rest_init+0x153/0x260 [ 7232.915139][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7232.915427][ C0] arch_call_rest_init+0x13/0x40 [ 7232.915691][ C0] start_kernel+0x314/0x3d0 [ 7232.915938][ C0] x86_64_start_reservations+0x18/0x30 [ 7232.916231][ C0] x86_64_start_kernel+0xba/0x110 [ 7232.916498][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7232.916822][ C0] [ 7232.916985][ C0] Sending NMI from CPU 0 to CPUs 1: [ 7232.917276][ C1] NMI backtrace for cpu 1 [ 7232.917283][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7232.917287][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7232.917290][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7232.917297][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7232.917300][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7232.917303][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7232.917305][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7232.917307][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7232.917308][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7232.917310][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7232.917312][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7232.917314][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7232.917317][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7232.917319][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7232.917320][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7232.917322][ C1] Call Trace: [ 7232.917325][ C1] [ 7232.917328][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 7232.917334][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7232.917339][ C1] ? nmi_handle+0x156/0x420 [ 7232.917344][ C1] ? default_do_nmi+0x41/0x100 [ 7232.917347][ C1] ? exc_nmi+0xf3/0x120 [ 7232.917350][ C1] ? end_repeat_nmi+0xf/0x60 [ 7232.917354][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7232.917358][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7232.917361][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7232.917365][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7232.917368][ C1] [ 7232.917369][ C1] [ 7232.917370][ C1] ? run_ksoftirqd+0xb/0x60 [ 7232.917376][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7232.917379][ C1] ? __orc_find+0x9c/0xf0 [ 7232.917382][ C1] ? lock_acquire+0x1c1/0x220 [ 7232.917385][ C1] ? irqentry_enter+0x2b/0x60 [ 7232.917390][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7232.917394][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7232.917396][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7232.917400][ C1] ? lock_acquire+0x1c1/0x220 [ 7232.917402][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7232.917407][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7232.917410][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7232.917417][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7232.917420][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7232.917426][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7232.917432][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7232.917436][ C1] ip_local_deliver+0x19d/0x480 [ 7232.917439][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7232.917442][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7232.917446][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7232.917450][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7232.917453][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7232.917457][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7232.917466][ C1] ip_rcv+0x564/0x740 [ 7232.917469][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7232.917472][ C1] ? set_track_prepare+0x8a/0xd0 [ 7232.917476][ C1] ? irqentry_enter+0x2b/0x60 [ 7232.917480][ C1] ? irqentry_enter+0x2b/0x60 [ 7232.917483][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7232.917486][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7232.917490][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7232.917493][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7232.917496][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7232.917499][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7232.917502][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7232.917506][ C1] netif_receive_skb+0x55/0x280 [ 7232.917509][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7232.917517][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7232.917524][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7232.917530][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7232.917536][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7232.917548][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7232.917557][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7232.917560][ C1] ? arch_stack_walk+0x68/0x100 [ 7232.917564][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7232.917568][ C1] ? irqentry_enter+0x2b/0x60 [ 7232.917571][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7232.917575][ C1] ? irqentry_enter+0x2b/0x60 [ 7232.917579][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7232.917586][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7232.917588][ C1] ? arch_stack_walk+0x68/0x100 [ 7232.917592][ C1] __tcf_classify+0x32c/0x7d0 [ 7232.917597][ C1] tcf_classify+0x283/0x930 [ 7232.917601][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7232.917605][ C1] tc_run+0x2e4/0x5d0 [ 7232.917610][ C1] ? __pfx_tc_run+0x10/0x10 [ 7232.917615][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7232.917621][ C1] ? irqentry_enter+0x2b/0x60 [ 7232.917624][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7232.917627][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7232.917634][ C1] ip_finish_output2+0x786/0x18e0 [ 7232.917639][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7232.917642][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7232.917646][ C1] ? __ip_finish_output+0x10f/0x770 [ 7232.917650][ C1] ip_output+0x16b/0x4f0 [ 7232.917653][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7232.917656][ C1] ? __pfx_ip_output+0x10/0x10 [ 7232.917661][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7232.917668][ C1] ? __pfx_ip_output+0x10/0x10 [ 7232.917672][ C1] __ip_queue_xmit+0x672/0x1910 [ 7232.917678][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7232.917684][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7232.917689][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7232.917693][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7232.917697][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7232.917700][ C1] tcp_delack_timer+0x84/0x240 [ 7232.917703][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7232.917706][ C1] call_timer_fn+0x176/0x430 [ 7232.917711][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7232.917716][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7232.917720][ C1] __run_timers.part.0+0x52d/0x890 [ 7232.917723][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7232.917728][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7232.917733][ C1] ? __pfx___schedule+0x10/0x10 [ 7232.917738][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7232.917743][ C1] run_timer_softirq+0x72/0x100 [ 7232.917746][ C1] __do_softirq+0x1bc/0x7ff [ 7232.917750][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7232.917755][ C1] run_ksoftirqd+0x2e/0x60 [ 7232.917758][ C1] smpboot_thread_fn+0x30e/0x840 [ 7232.917764][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7232.917767][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7232.917770][ C1] kthread+0x292/0x360 [ 7232.917774][ C1] ? __pfx_kthread+0x10/0x10 [ 7232.917776][ C1] ret_from_fork+0x34/0x70 [ 7232.917779][ C1] ? __pfx_kthread+0x10/0x10 [ 7232.917781][ C1] ret_from_fork_asm+0x1b/0x30 [ 7232.917788][ C1] [ 7260.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5655s! [swapper/0:0] [ 7260.527925][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7260.529119][ C0] irq event stamp: 27567077 [ 7260.529358][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7260.529884][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7260.530360][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7260.530872][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7260.531373][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7260.531859][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7260.532510][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7260.532853][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7260.533881][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7260.534209][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7260.534632][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7260.535057][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7260.535484][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7260.535905][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7260.536329][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7260.536805][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7260.537154][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7260.537579][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7260.538005][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7260.538427][ C0] Call Trace: [ 7260.538608][ C0] [ 7260.538765][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7260.539044][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7260.539298][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7260.539592][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7260.539878][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7260.540179][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7260.540457][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7260.540776][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7260.541054][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7260.541333][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7260.541663][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7260.541973][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7260.542305][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7260.542607][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7260.542916][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7260.543223][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7260.543552][ C0] ? get_stack_info+0x36/0xc0 [ 7260.543805][ C0] ? lock_acquire+0x1c1/0x220 [ 7260.544057][ C0] ? lock_release+0x1d5/0x250 [ 7260.544308][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7260.544567][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7260.544849][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7260.545145][ C0] ? lock_acquire+0x1c1/0x220 [ 7260.545398][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7260.545657][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7260.545932][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7260.546178][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7260.546436][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7260.546703][ C0] ? __inet_lookup_established+0x341/0x610 [ 7260.547014][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7260.547308][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7260.547600][ C0] ip_local_deliver+0x19d/0x480 [ 7260.547855][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7260.548136][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7260.548401][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7260.548681][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7260.548947][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7260.549283][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7260.549564][ C0] ip_rcv+0x564/0x740 [ 7260.549783][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7260.550028][ C0] ? set_track_prepare+0x8a/0xd0 [ 7260.550297][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7260.550585][ C0] ? rest_init+0x153/0x260 [ 7260.550825][ C0] ? skb_clone+0x10b/0x330 [ 7260.551063][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7260.551405][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7260.551729][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7260.552027][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7260.552338][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7260.552603][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7260.552847][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7260.553164][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7260.553464][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7260.553801][ C0] ? lock_acquire+0x1c1/0x220 [ 7260.554051][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7260.554360][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7260.554659][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7260.554987][ C0] ? __copy_skb_header+0xaf/0x490 [ 7260.555253][ C0] ? __skb_clone+0x57a/0x760 [ 7260.555499][ C0] netif_receive_skb+0x55/0x280 [ 7260.555761][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7260.556098][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7260.556448][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7260.556760][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7260.557051][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7260.557356][ C0] ? hlock_class+0x4e/0x130 [ 7260.557606][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7260.557937][ C0] ? place_entity+0x21/0x2f0 [ 7260.558187][ C0] ? resched_curr+0x219/0x280 [ 7260.558436][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7260.558703][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7260.558983][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7260.559264][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7260.559525][ C0] ? activate_task+0xf5/0x260 [ 7260.559781][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7260.560065][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7260.560338][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7260.560601][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7260.560893][ C0] ? get_stack_info+0x36/0xc0 [ 7260.561145][ C0] ? stack_access_ok+0xda/0x1f0 [ 7260.561408][ C0] ? get_reg+0x119/0x190 [ 7260.561639][ C0] __tcf_classify+0x32c/0x7d0 [ 7260.561890][ C0] tcf_classify+0x283/0x930 [ 7260.562134][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7260.562461][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7260.562732][ C0] ? arch_stack_walk+0x8c/0x100 [ 7260.562995][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7260.563288][ C0] tc_run+0x2e4/0x5d0 [ 7260.563504][ C0] ? __pfx_tc_run+0x10/0x10 [ 7260.563744][ C0] ? lock_acquire+0x1c1/0x220 [ 7260.563993][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7260.564267][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7260.564534][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7260.564815][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7260.565091][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7260.565412][ C0] ? neigh_hh_output+0x348/0x590 [ 7260.565679][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7260.565959][ C0] ip_finish_output2+0x786/0x18e0 [ 7260.566227][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7260.566517][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7260.566874][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7260.567166][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7260.567428][ C0] ? __ip_finish_output+0x10f/0x770 [ 7260.567708][ C0] ip_output+0x16b/0x4f0 [ 7260.567939][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7260.568223][ C0] ? __pfx_ip_output+0x10/0x10 [ 7260.568481][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7260.568782][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7260.569049][ C0] ? ip_local_out+0x114/0x3b0 [ 7260.569300][ C0] __ip_queue_xmit+0x672/0x1910 [ 7260.569561][ C0] ? __skb_clone+0x57a/0x760 [ 7260.569814][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7260.570098][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7260.570398][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7260.570718][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7260.570973][ C0] ? tcp_current_mss+0x40a/0x510 [ 7260.571242][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7260.571532][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7260.571807][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7260.572061][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7260.572332][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7260.572655][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7260.572930][ C0] ? ktime_get+0xb6/0x190 [ 7260.573161][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7260.573434][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7260.573718][ C0] tcp_write_timer+0x82/0x1d0 [ 7260.573969][ C0] call_timer_fn+0x176/0x430 [ 7260.574216][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7260.574495][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7260.574768][ C0] __run_timers.part.0+0x52d/0x890 [ 7260.575042][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7260.575323][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7260.575624][ C0] ? lock_acquire+0x1c1/0x220 [ 7260.575873][ C0] ? clockevents_program_event+0xf6/0x300 [ 7260.576179][ C0] ? lock_release+0x1d5/0x250 [ 7260.576427][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7260.576702][ C0] ? ktime_get+0xb6/0x190 [ 7260.576931][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7260.577231][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7260.577544][ C0] run_timer_softirq+0x72/0x100 [ 7260.577804][ C0] __do_softirq+0x1bc/0x7ff [ 7260.578047][ C0] irq_exit_rcu+0x98/0xc0 [ 7260.578277][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7260.578575][ C0] [ 7260.578735][ C0] [ 7260.578895][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7260.579220][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7260.579487][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7260.580502][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7260.580827][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7260.581248][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7260.581678][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7260.582106][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7260.582527][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7260.582952][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7260.583261][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7260.583537][ C0] default_idle_call+0x69/0xa0 [ 7260.583791][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7260.584057][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7260.584347][ C0] ? lock_release+0x1d5/0x250 [ 7260.584600][ C0] do_idle+0xfb/0x160 [ 7260.584816][ C0] cpu_startup_entry+0x55/0x60 [ 7260.585080][ C0] rest_init+0x153/0x260 [ 7260.585305][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7260.585597][ C0] arch_call_rest_init+0x13/0x40 [ 7260.585866][ C0] start_kernel+0x314/0x3d0 [ 7260.586109][ C0] x86_64_start_reservations+0x18/0x30 [ 7260.586399][ C0] x86_64_start_kernel+0xba/0x110 [ 7260.586672][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7260.587007][ C0] [ 7260.587175][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5655s! [ksoftirqd/1:22] [ 7260.587660][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7260.588895][ C1] irq event stamp: 3886976 [ 7260.589143][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7260.589665][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7260.590186][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7260.590709][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7260.591212][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7260.591733][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7260.592394][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa8/0xb90 [ 7260.592739][ C1] Code: 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 be 04 00 00 00 <48> 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c 08 84 c0 0f 85 [ 7260.593790][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7260.594128][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7260.594571][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7260.595011][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7260.595450][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7260.595888][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7260.596330][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7260.596824][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7260.597184][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7260.597623][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7260.598055][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7260.598486][ C1] Call Trace: [ 7260.598667][ C1] [ 7260.598828][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7260.599115][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7260.599378][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7260.599681][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7260.599977][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7260.600289][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7260.600573][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7260.600904][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7260.601190][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7260.601530][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7260.601857][ C1] [ 7260.602019][ C1] [ 7260.602182][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7260.602519][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7260.602836][ C1] ? queued_spin_lock_slowpath+0xa8/0xb90 [ 7260.603152][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7260.603468][ C1] ? run_ksoftirqd+0xb/0x60 [ 7260.603722][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7260.604063][ C1] ? __orc_find+0x9c/0xf0 [ 7260.604300][ C1] ? lock_acquire+0x1c1/0x220 [ 7260.604558][ C1] ? irqentry_enter+0x2b/0x60 [ 7260.604817][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7260.605085][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7260.605376][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7260.605684][ C1] ? lock_acquire+0x1c1/0x220 [ 7260.605947][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7260.606214][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7260.606497][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7260.606750][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7260.607015][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7260.607295][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7260.607596][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7260.607896][ C1] ip_local_deliver+0x19d/0x480 [ 7260.608167][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7260.608463][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7260.608738][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7260.609023][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7260.609296][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7260.609645][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7260.609927][ C1] ip_rcv+0x564/0x740 [ 7260.610150][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7260.610399][ C1] ? set_track_prepare+0x8a/0xd0 [ 7260.610677][ C1] ? irqentry_enter+0x2b/0x60 [ 7260.610943][ C1] ? irqentry_enter+0x2b/0x60 [ 7260.611207][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7260.611460][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7260.611789][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7260.612139][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7260.612460][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7260.612815][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7260.613127][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7260.613469][ C1] netif_receive_skb+0x55/0x280 [ 7260.613733][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7260.614069][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7260.614427][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7260.614754][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7260.615053][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7260.615367][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7260.615706][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7260.615998][ C1] ? arch_stack_walk+0x68/0x100 [ 7260.616273][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7260.616563][ C1] ? irqentry_enter+0x2b/0x60 [ 7260.616828][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7260.617159][ C1] ? irqentry_enter+0x2b/0x60 [ 7260.617415][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7260.617744][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7260.618036][ C1] ? arch_stack_walk+0x68/0x100 [ 7260.618305][ C1] __tcf_classify+0x32c/0x7d0 [ 7260.618563][ C1] tcf_classify+0x283/0x930 [ 7260.618813][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7260.619092][ C1] tc_run+0x2e4/0x5d0 [ 7260.619314][ C1] ? __pfx_tc_run+0x10/0x10 [ 7260.619564][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7260.619839][ C1] ? irqentry_enter+0x2b/0x60 [ 7260.620105][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7260.620404][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7260.620738][ C1] ip_finish_output2+0x786/0x18e0 [ 7260.621017][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7260.621317][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7260.621597][ C1] ? __ip_finish_output+0x10f/0x770 [ 7260.621890][ C1] ip_output+0x16b/0x4f0 [ 7260.622127][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7260.622452][ C1] ? __pfx_ip_output+0x10/0x10 [ 7260.622718][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7260.623083][ C1] ? __pfx_ip_output+0x10/0x10 [ 7260.623347][ C1] __ip_queue_xmit+0x672/0x1910 [ 7260.623619][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7260.623913][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7260.624220][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7260.624519][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7260.624826][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7260.625124][ C1] tcp_delack_timer+0x84/0x240 [ 7260.625392][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7260.625686][ C1] call_timer_fn+0x176/0x430 [ 7260.625943][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7260.626232][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7260.626517][ C1] __run_timers.part.0+0x52d/0x890 [ 7260.626798][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7260.627099][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7260.627412][ C1] ? __pfx___schedule+0x10/0x10 [ 7260.627678][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7260.628009][ C1] run_timer_softirq+0x72/0x100 [ 7260.628283][ C1] __do_softirq+0x1bc/0x7ff [ 7260.628538][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7260.628822][ C1] run_ksoftirqd+0x2e/0x60 [ 7260.629067][ C1] smpboot_thread_fn+0x30e/0x840 [ 7260.629342][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7260.629640][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7260.629943][ C1] kthread+0x292/0x360 [ 7260.630169][ C1] ? __pfx_kthread+0x10/0x10 [ 7260.630425][ C1] ret_from_fork+0x34/0x70 [ 7260.630671][ C1] ? __pfx_kthread+0x10/0x10 [ 7260.630927][ C1] ret_from_fork_asm+0x1b/0x30 [ 7260.631193][ C1] [ 7288.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5681s! [swapper/0:0] [ 7288.527919][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7288.529113][ C0] irq event stamp: 27567077 [ 7288.529351][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7288.529879][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7288.530361][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7288.530866][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7288.531373][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7288.531859][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7288.532510][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7288.532860][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7288.533888][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7288.534214][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7288.534640][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7288.535061][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7288.535482][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7288.535906][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7288.536332][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7288.536804][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7288.537154][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7288.537583][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7288.538001][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7288.538419][ C0] Call Trace: [ 7288.538597][ C0] [ 7288.538751][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7288.539030][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7288.539285][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7288.539585][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7288.539868][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7288.540175][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7288.540452][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7288.540770][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7288.541047][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7288.541329][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7288.541653][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7288.541962][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7288.542298][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7288.542601][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7288.542909][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7288.543214][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7288.543542][ C0] ? get_stack_info+0x36/0xc0 [ 7288.543794][ C0] ? lock_acquire+0x1c1/0x220 [ 7288.544045][ C0] ? lock_release+0x1d5/0x250 [ 7288.544293][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7288.544553][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7288.544838][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7288.545136][ C0] ? lock_acquire+0x1c1/0x220 [ 7288.545388][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7288.545643][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7288.545918][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7288.546163][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7288.546419][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7288.546688][ C0] ? __inet_lookup_established+0x341/0x610 [ 7288.547000][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7288.547294][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7288.547590][ C0] ip_local_deliver+0x19d/0x480 [ 7288.547849][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7288.548133][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7288.548398][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7288.548678][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7288.548943][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7288.549276][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7288.549555][ C0] ip_rcv+0x564/0x740 [ 7288.549768][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7288.550012][ C0] ? set_track_prepare+0x8a/0xd0 [ 7288.550279][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7288.550565][ C0] ? rest_init+0x153/0x260 [ 7288.550806][ C0] ? skb_clone+0x10b/0x330 [ 7288.551046][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7288.551386][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7288.551704][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7288.552001][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7288.552314][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7288.552575][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7288.552818][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7288.553138][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7288.553441][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7288.553778][ C0] ? lock_acquire+0x1c1/0x220 [ 7288.554025][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7288.554335][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7288.554636][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7288.554967][ C0] ? __copy_skb_header+0xaf/0x490 [ 7288.555233][ C0] ? __skb_clone+0x57a/0x760 [ 7288.555476][ C0] netif_receive_skb+0x55/0x280 [ 7288.555737][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7288.556067][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7288.556421][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7288.556733][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7288.557023][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7288.557325][ C0] ? hlock_class+0x4e/0x130 [ 7288.557572][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7288.557907][ C0] ? place_entity+0x21/0x2f0 [ 7288.558158][ C0] ? resched_curr+0x219/0x280 [ 7288.558408][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7288.558675][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7288.558955][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7288.559237][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7288.559498][ C0] ? activate_task+0xf5/0x260 [ 7288.559751][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7288.560029][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7288.560299][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7288.560562][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7288.560856][ C0] ? get_stack_info+0x36/0xc0 [ 7288.561108][ C0] ? stack_access_ok+0xda/0x1f0 [ 7288.561374][ C0] ? get_reg+0x119/0x190 [ 7288.561602][ C0] __tcf_classify+0x32c/0x7d0 [ 7288.561850][ C0] tcf_classify+0x283/0x930 [ 7288.562091][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7288.562422][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7288.562691][ C0] ? arch_stack_walk+0x8c/0x100 [ 7288.562958][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7288.563252][ C0] tc_run+0x2e4/0x5d0 [ 7288.563467][ C0] ? __pfx_tc_run+0x10/0x10 [ 7288.563707][ C0] ? lock_acquire+0x1c1/0x220 [ 7288.563956][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7288.564231][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7288.564501][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7288.564786][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7288.565064][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7288.565381][ C0] ? neigh_hh_output+0x348/0x590 [ 7288.565649][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7288.565928][ C0] ip_finish_output2+0x786/0x18e0 [ 7288.566196][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7288.566487][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7288.566842][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7288.567138][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7288.567401][ C0] ? __ip_finish_output+0x10f/0x770 [ 7288.567684][ C0] ip_output+0x16b/0x4f0 [ 7288.567912][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7288.568193][ C0] ? __pfx_ip_output+0x10/0x10 [ 7288.568450][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7288.568750][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7288.569015][ C0] ? ip_local_out+0x114/0x3b0 [ 7288.569264][ C0] __ip_queue_xmit+0x672/0x1910 [ 7288.569522][ C0] ? __skb_clone+0x57a/0x760 [ 7288.569765][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7288.570048][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7288.570345][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7288.570667][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7288.570928][ C0] ? tcp_current_mss+0x40a/0x510 [ 7288.571193][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7288.571475][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7288.571752][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7288.572005][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7288.572277][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7288.572599][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7288.572875][ C0] ? ktime_get+0xb6/0x190 [ 7288.573106][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7288.573378][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7288.573666][ C0] tcp_write_timer+0x82/0x1d0 [ 7288.573915][ C0] call_timer_fn+0x176/0x430 [ 7288.574160][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7288.574437][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7288.574709][ C0] __run_timers.part.0+0x52d/0x890 [ 7288.574983][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7288.575267][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7288.575568][ C0] ? lock_acquire+0x1c1/0x220 [ 7288.575816][ C0] ? clockevents_program_event+0xf6/0x300 [ 7288.576122][ C0] ? lock_release+0x1d5/0x250 [ 7288.576372][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7288.576648][ C0] ? ktime_get+0xb6/0x190 [ 7288.576877][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7288.577175][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7288.577489][ C0] run_timer_softirq+0x72/0x100 [ 7288.577749][ C0] __do_softirq+0x1bc/0x7ff [ 7288.577998][ C0] irq_exit_rcu+0x98/0xc0 [ 7288.578227][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7288.578527][ C0] [ 7288.578685][ C0] [ 7288.578843][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7288.579168][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7288.579435][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7288.580449][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7288.580771][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7288.581187][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7288.581616][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7288.582041][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7288.582466][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7288.582889][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7288.583195][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7288.583471][ C0] default_idle_call+0x69/0xa0 [ 7288.583722][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7288.583987][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7288.584280][ C0] ? lock_release+0x1d5/0x250 [ 7288.584535][ C0] do_idle+0xfb/0x160 [ 7288.584754][ C0] cpu_startup_entry+0x55/0x60 [ 7288.585011][ C0] rest_init+0x153/0x260 [ 7288.585238][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7288.585531][ C0] arch_call_rest_init+0x13/0x40 [ 7288.585800][ C0] start_kernel+0x314/0x3d0 [ 7288.586041][ C0] x86_64_start_reservations+0x18/0x30 [ 7288.586332][ C0] x86_64_start_kernel+0xba/0x110 [ 7288.586602][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7288.586930][ C0] [ 7288.587099][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5681s! [ksoftirqd/1:22] [ 7288.587563][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7288.588801][ C1] irq event stamp: 3886976 [ 7288.589051][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7288.589557][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7288.590062][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7288.590569][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7288.591075][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7288.591584][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7288.592251][ C1] RIP: 0010:kasan_check_range+0x156/0x1c0 [ 7288.592567][ C1] Code: d0 74 11 80 38 00 74 ef 4d 8d 1c 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea 09 48 83 c0 01 48 39 d0 74 a5 80 38 00 74 f2 e9 74 ff ff ff b8 [ 7288.593617][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000282 [ 7288.593951][ C1] RAX: ffffed10014131c3 RBX: ffffed10014131c4 RCX: ffffffff90c7aaa0 [ 7288.594382][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7288.594818][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: ffffed10014131c3 [ 7288.595253][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7288.595682][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7288.596114][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7288.596600][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7288.596956][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7288.597390][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7288.597819][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7288.598253][ C1] Call Trace: [ 7288.598437][ C1] [ 7288.598596][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7288.598881][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7288.599142][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7288.599445][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7288.599738][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7288.600051][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7288.600334][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7288.600663][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7288.600948][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7288.601289][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7288.601612][ C1] [ 7288.601773][ C1] [ 7288.601934][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7288.602275][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7288.602589][ C1] ? kasan_check_range+0x156/0x1c0 [ 7288.602872][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 7288.603173][ C1] ? run_ksoftirqd+0xb/0x60 [ 7288.603421][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7288.603756][ C1] ? __orc_find+0x9c/0xf0 [ 7288.603995][ C1] ? lock_acquire+0x1c1/0x220 [ 7288.604258][ C1] ? irqentry_enter+0x2b/0x60 [ 7288.604521][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7288.604792][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7288.605087][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7288.605394][ C1] ? lock_acquire+0x1c1/0x220 [ 7288.605648][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7288.605905][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7288.606184][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7288.606441][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7288.606711][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7288.606990][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7288.607290][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7288.607594][ C1] ip_local_deliver+0x19d/0x480 [ 7288.607861][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7288.608154][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7288.608425][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7288.608713][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7288.608983][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7288.609326][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7288.609611][ C1] ip_rcv+0x564/0x740 [ 7288.609831][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7288.610081][ C1] ? set_track_prepare+0x8a/0xd0 [ 7288.610352][ C1] ? irqentry_enter+0x2b/0x60 [ 7288.610606][ C1] ? irqentry_enter+0x2b/0x60 [ 7288.610860][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7288.611108][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7288.611435][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7288.611793][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7288.612113][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7288.612459][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7288.612765][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7288.613111][ C1] netif_receive_skb+0x55/0x280 [ 7288.613379][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7288.613721][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7288.614079][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7288.614400][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7288.614699][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7288.615014][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7288.615352][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7288.615643][ C1] ? arch_stack_walk+0x68/0x100 [ 7288.615909][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7288.616192][ C1] ? irqentry_enter+0x2b/0x60 [ 7288.616447][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7288.616772][ C1] ? irqentry_enter+0x2b/0x60 [ 7288.617033][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7288.617366][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7288.617654][ C1] ? arch_stack_walk+0x68/0x100 [ 7288.617926][ C1] __tcf_classify+0x32c/0x7d0 [ 7288.618191][ C1] tcf_classify+0x283/0x930 [ 7288.618443][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7288.618723][ C1] tc_run+0x2e4/0x5d0 [ 7288.618944][ C1] ? __pfx_tc_run+0x10/0x10 [ 7288.619198][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7288.619473][ C1] ? irqentry_enter+0x2b/0x60 [ 7288.619729][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7288.620020][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7288.620349][ C1] ip_finish_output2+0x786/0x18e0 [ 7288.620630][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7288.620930][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7288.621202][ C1] ? __ip_finish_output+0x10f/0x770 [ 7288.621494][ C1] ip_output+0x16b/0x4f0 [ 7288.621729][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7288.622060][ C1] ? __pfx_ip_output+0x10/0x10 [ 7288.622324][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7288.622689][ C1] ? __pfx_ip_output+0x10/0x10 [ 7288.622955][ C1] __ip_queue_xmit+0x672/0x1910 [ 7288.623224][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7288.623511][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7288.623813][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7288.624107][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7288.624409][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7288.624699][ C1] tcp_delack_timer+0x84/0x240 [ 7288.624958][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7288.625253][ C1] call_timer_fn+0x176/0x430 [ 7288.625508][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7288.625788][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7288.626076][ C1] __run_timers.part.0+0x52d/0x890 [ 7288.626358][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7288.626650][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7288.626955][ C1] ? __pfx___schedule+0x10/0x10 [ 7288.627227][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7288.627560][ C1] run_timer_softirq+0x72/0x100 [ 7288.627827][ C1] __do_softirq+0x1bc/0x7ff [ 7288.628076][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7288.628355][ C1] run_ksoftirqd+0x2e/0x60 [ 7288.628603][ C1] smpboot_thread_fn+0x30e/0x840 [ 7288.628875][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7288.629177][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7288.629471][ C1] kthread+0x292/0x360 [ 7288.629698][ C1] ? __pfx_kthread+0x10/0x10 [ 7288.629950][ C1] ret_from_fork+0x34/0x70 [ 7288.630198][ C1] ? __pfx_kthread+0x10/0x10 [ 7288.630448][ C1] ret_from_fork_asm+0x1b/0x30 [ 7288.630716][ C1] [ 7310.921025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7310.921437][ C1] rcu: 1-....: (6098490 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1441414 [ 7310.922042][ C1] rcu: (t=6116612 jiffies g=1007429 q=31 ncpus=4) [ 7310.922396][ C1] Sending NMI from CPU 1 to CPUs 0: [ 7310.922695][ C0] NMI backtrace for cpu 0 [ 7310.922701][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7310.922705][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7310.922708][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7310.922718][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7310.922722][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7310.922726][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7310.922728][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7310.922729][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7310.922731][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7310.922733][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7310.922735][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7310.922737][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7310.922740][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7310.922742][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7310.922743][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7310.922745][ C0] Call Trace: [ 7310.922748][ C0] [ 7310.922752][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 7310.922758][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7310.922765][ C0] ? nmi_handle+0x156/0x420 [ 7310.922771][ C0] ? default_do_nmi+0x41/0x100 [ 7310.922775][ C0] ? exc_nmi+0xf3/0x120 [ 7310.922778][ C0] ? end_repeat_nmi+0xf/0x60 [ 7310.922783][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7310.922787][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7310.922790][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7310.922794][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7310.922797][ C0] [ 7310.922798][ C0] [ 7310.922800][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7310.922803][ C0] ? get_stack_info+0x36/0xc0 [ 7310.922808][ C0] ? lock_acquire+0x1c1/0x220 [ 7310.922813][ C0] ? lock_release+0x1d5/0x250 [ 7310.922817][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7310.922821][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7310.922824][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7310.922827][ C0] ? lock_acquire+0x1c1/0x220 [ 7310.922829][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7310.922835][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7310.922839][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7310.922846][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7310.922849][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7310.922853][ C0] ? __inet_lookup_established+0x341/0x610 [ 7310.922859][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7310.922867][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7310.922871][ C0] ip_local_deliver+0x19d/0x480 [ 7310.922874][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7310.922876][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7310.922882][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7310.922886][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7310.922889][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7310.922892][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7310.922903][ C0] ip_rcv+0x564/0x740 [ 7310.922907][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7310.922910][ C0] ? set_track_prepare+0x8a/0xd0 [ 7310.922915][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7310.922917][ C0] ? rest_init+0x153/0x260 [ 7310.922920][ C0] ? skb_clone+0x10b/0x330 [ 7310.922925][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7310.922932][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7310.922937][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7310.922942][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7310.922952][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7310.922955][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7310.922957][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7310.922962][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7310.922966][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7310.922969][ C0] ? lock_acquire+0x1c1/0x220 [ 7310.922972][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7310.922975][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7310.922978][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7310.922982][ C0] ? __copy_skb_header+0xaf/0x490 [ 7310.922984][ C0] ? __skb_clone+0x57a/0x760 [ 7310.922987][ C0] netif_receive_skb+0x55/0x280 [ 7310.922990][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7310.922998][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7310.923005][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7310.923011][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7310.923016][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7310.923026][ C0] ? hlock_class+0x4e/0x130 [ 7310.923032][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7310.923042][ C0] ? place_entity+0x21/0x2f0 [ 7310.923045][ C0] ? resched_curr+0x219/0x280 [ 7310.923049][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7310.923052][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7310.923056][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7310.923061][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7310.923063][ C0] ? activate_task+0xf5/0x260 [ 7310.923066][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7310.923071][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7310.923075][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7310.923079][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7310.923081][ C0] ? get_stack_info+0x36/0xc0 [ 7310.923085][ C0] ? stack_access_ok+0xda/0x1f0 [ 7310.923087][ C0] ? get_reg+0x119/0x190 [ 7310.923091][ C0] __tcf_classify+0x32c/0x7d0 [ 7310.923096][ C0] tcf_classify+0x283/0x930 [ 7310.923099][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7310.923103][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7310.923105][ C0] ? arch_stack_walk+0x8c/0x100 [ 7310.923109][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7310.923112][ C0] tc_run+0x2e4/0x5d0 [ 7310.923117][ C0] ? __pfx_tc_run+0x10/0x10 [ 7310.923120][ C0] ? lock_acquire+0x1c1/0x220 [ 7310.923122][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7310.923127][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7310.923133][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7310.923136][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7310.923139][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7310.923146][ C0] ? neigh_hh_output+0x348/0x590 [ 7310.923150][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7310.923154][ C0] ip_finish_output2+0x786/0x18e0 [ 7310.923157][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7310.923164][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7310.923172][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7310.923175][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7310.923179][ C0] ? __ip_finish_output+0x10f/0x770 [ 7310.923183][ C0] ip_output+0x16b/0x4f0 [ 7310.923186][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7310.923193][ C0] ? __pfx_ip_output+0x10/0x10 [ 7310.923196][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7310.923201][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7310.923203][ C0] ? ip_local_out+0x114/0x3b0 [ 7310.923208][ C0] __ip_queue_xmit+0x672/0x1910 [ 7310.923212][ C0] ? __skb_clone+0x57a/0x760 [ 7310.923215][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7310.923223][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7310.923227][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7310.923231][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7310.923236][ C0] ? tcp_current_mss+0x40a/0x510 [ 7310.923239][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7310.923242][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7310.923245][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7310.923247][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7310.923250][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7310.923253][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7310.923258][ C0] ? ktime_get+0xb6/0x190 [ 7310.923262][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7310.923267][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7310.923269][ C0] tcp_write_timer+0x82/0x1d0 [ 7310.923274][ C0] call_timer_fn+0x176/0x430 [ 7310.923277][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7310.923282][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7310.923286][ C0] __run_timers.part.0+0x52d/0x890 [ 7310.923289][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7310.923294][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7310.923297][ C0] ? lock_acquire+0x1c1/0x220 [ 7310.923300][ C0] ? clockevents_program_event+0xf6/0x300 [ 7310.923304][ C0] ? lock_release+0x1d5/0x250 [ 7310.923307][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7310.923309][ C0] ? ktime_get+0xb6/0x190 [ 7310.923312][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7310.923316][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7310.923321][ C0] run_timer_softirq+0x72/0x100 [ 7310.923324][ C0] __do_softirq+0x1bc/0x7ff [ 7310.923329][ C0] irq_exit_rcu+0x98/0xc0 [ 7310.923332][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7310.923336][ C0] [ 7310.923338][ C0] [ 7310.923339][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7310.923345][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7310.923349][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7310.923351][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7310.923353][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7310.923354][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7310.923356][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7310.923357][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7310.923359][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7310.923362][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7310.923365][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7310.923369][ C0] default_idle_call+0x69/0xa0 [ 7310.923371][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7310.923373][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7310.923379][ C0] ? lock_release+0x1d5/0x250 [ 7310.923382][ C0] do_idle+0xfb/0x160 [ 7310.923385][ C0] cpu_startup_entry+0x55/0x60 [ 7310.923387][ C0] rest_init+0x153/0x260 [ 7310.923390][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7310.923395][ C0] arch_call_rest_init+0x13/0x40 [ 7310.923399][ C0] start_kernel+0x314/0x3d0 [ 7310.923403][ C0] x86_64_start_reservations+0x18/0x30 [ 7310.923408][ C0] x86_64_start_kernel+0xba/0x110 [ 7310.923412][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7310.923421][ C0] [ 7310.923691][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7310.978992][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7310.979650][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7310.980002][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7310.981044][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7310.981380][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7310.981811][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7310.982245][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7310.982678][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7310.983108][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7310.983541][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7310.984030][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7310.984385][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7310.984818][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7310.985247][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7310.985675][ C1] Call Trace: [ 7310.985859][ C1] [ 7310.986021][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7310.986318][ C1] ? print_cpu_stall+0x263/0x6a0 [ 7310.986590][ C1] ? check_cpu_stall+0x284/0x500 [ 7310.986861][ C1] ? rcu_pending+0x92/0x360 [ 7310.987108][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7310.987395][ C1] ? update_process_times+0xb9/0x110 [ 7310.987687][ C1] ? tick_sched_handle+0x67/0x130 [ 7310.987961][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7310.988268][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7310.988532][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7310.988868][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7310.989167][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7310.989480][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7310.989768][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7310.990100][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7310.990381][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7310.990717][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7310.991037][ C1] [ 7310.991203][ C1] [ 7310.991368][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7310.991711][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7310.992022][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7310.992339][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7310.992650][ C1] ? run_ksoftirqd+0xb/0x60 [ 7310.992903][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7310.993242][ C1] ? __orc_find+0x9c/0xf0 [ 7310.993481][ C1] ? lock_acquire+0x1c1/0x220 [ 7310.993738][ C1] ? irqentry_enter+0x2b/0x60 [ 7310.993997][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7310.994265][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7310.994554][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7310.994858][ C1] ? lock_acquire+0x1c1/0x220 [ 7310.995118][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7310.995382][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7310.995664][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7310.995915][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7310.996180][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7310.996455][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7310.996751][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7310.997051][ C1] ip_local_deliver+0x19d/0x480 [ 7310.997321][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7310.997616][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7310.997888][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7310.998171][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7310.998439][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7310.998786][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7310.999069][ C1] ip_rcv+0x564/0x740 [ 7310.999286][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7310.999532][ C1] ? set_track_prepare+0x8a/0xd0 [ 7310.999801][ C1] ? irqentry_enter+0x2b/0x60 [ 7311.000062][ C1] ? irqentry_enter+0x2b/0x60 [ 7311.000323][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7311.000573][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7311.000902][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7311.001257][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7311.001575][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7311.001927][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7311.002237][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7311.002576][ C1] netif_receive_skb+0x55/0x280 [ 7311.002842][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7311.003179][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7311.003533][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7311.003858][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7311.004154][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7311.004465][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7311.004801][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7311.005089][ C1] ? arch_stack_walk+0x68/0x100 [ 7311.005361][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7311.005648][ C1] ? irqentry_enter+0x2b/0x60 [ 7311.005908][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7311.006239][ C1] ? irqentry_enter+0x2b/0x60 [ 7311.006494][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7311.006825][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7311.007115][ C1] ? arch_stack_walk+0x68/0x100 [ 7311.007383][ C1] __tcf_classify+0x32c/0x7d0 [ 7311.007641][ C1] tcf_classify+0x283/0x930 [ 7311.007890][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7311.008165][ C1] tc_run+0x2e4/0x5d0 [ 7311.008384][ C1] ? __pfx_tc_run+0x10/0x10 [ 7311.008631][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7311.008902][ C1] ? irqentry_enter+0x2b/0x60 [ 7311.009166][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7311.009463][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7311.009793][ C1] ip_finish_output2+0x786/0x18e0 [ 7311.010069][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7311.010367][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7311.010640][ C1] ? __ip_finish_output+0x10f/0x770 [ 7311.010924][ C1] ip_output+0x16b/0x4f0 [ 7311.011160][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7311.011484][ C1] ? __pfx_ip_output+0x10/0x10 [ 7311.011749][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7311.012112][ C1] ? __pfx_ip_output+0x10/0x10 [ 7311.012375][ C1] __ip_queue_xmit+0x672/0x1910 [ 7311.012646][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7311.012941][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7311.013246][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7311.013542][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7311.013850][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7311.014149][ C1] tcp_delack_timer+0x84/0x240 [ 7311.014413][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7311.014701][ C1] call_timer_fn+0x176/0x430 [ 7311.014953][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7311.015238][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7311.015523][ C1] __run_timers.part.0+0x52d/0x890 [ 7311.015801][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7311.016098][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7311.016409][ C1] ? __pfx___schedule+0x10/0x10 [ 7311.016676][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7311.017003][ C1] run_timer_softirq+0x72/0x100 [ 7311.017274][ C1] __do_softirq+0x1bc/0x7ff [ 7311.017527][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7311.017813][ C1] run_ksoftirqd+0x2e/0x60 [ 7311.018057][ C1] smpboot_thread_fn+0x30e/0x840 [ 7311.018333][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7311.018628][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7311.018929][ C1] kthread+0x292/0x360 [ 7311.019154][ C1] ? __pfx_kthread+0x10/0x10 [ 7311.019409][ C1] ret_from_fork+0x34/0x70 [ 7311.019651][ C1] ? __pfx_kthread+0x10/0x10 [ 7311.019907][ C1] ret_from_fork_asm+0x1b/0x30 [ 7311.020171][ C1] [ 7336.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5726s! [swapper/0:0] [ 7336.527938][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7336.529147][ C0] irq event stamp: 27567077 [ 7336.529391][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7336.529926][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7336.530398][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7336.530900][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7336.531410][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7336.531899][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7336.532546][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7336.532887][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7336.533907][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7336.534233][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7336.534654][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7336.535075][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7336.535497][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7336.535917][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7336.536340][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7336.536811][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7336.537167][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7336.537589][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7336.538014][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7336.538450][ C0] Call Trace: [ 7336.538639][ C0] [ 7336.538797][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7336.539074][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7336.539332][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7336.539621][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7336.539912][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7336.540221][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7336.540506][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7336.540831][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7336.541109][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7336.541387][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7336.541714][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7336.542033][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7336.542365][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7336.542675][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7336.542994][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7336.543297][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7336.543626][ C0] ? get_stack_info+0x36/0xc0 [ 7336.543887][ C0] ? lock_acquire+0x1c1/0x220 [ 7336.544147][ C0] ? lock_release+0x1d5/0x250 [ 7336.544404][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7336.544673][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7336.544961][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7336.545261][ C0] ? lock_acquire+0x1c1/0x220 [ 7336.545508][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7336.545759][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7336.546031][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7336.546282][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7336.546544][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7336.546816][ C0] ? __inet_lookup_established+0x341/0x610 [ 7336.547137][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7336.547427][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7336.547719][ C0] ip_local_deliver+0x19d/0x480 [ 7336.547980][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7336.548268][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7336.548537][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7336.548813][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7336.549077][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7336.549415][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7336.549691][ C0] ip_rcv+0x564/0x740 [ 7336.549905][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7336.550145][ C0] ? set_track_prepare+0x8a/0xd0 [ 7336.550410][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7336.550702][ C0] ? rest_init+0x153/0x260 [ 7336.550940][ C0] ? skb_clone+0x10b/0x330 [ 7336.551187][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7336.551526][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7336.551851][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7336.552150][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7336.552458][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7336.552717][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7336.552957][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7336.553270][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7336.553568][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7336.553912][ C0] ? lock_acquire+0x1c1/0x220 [ 7336.554167][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7336.554486][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7336.554783][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7336.555118][ C0] ? __copy_skb_header+0xaf/0x490 [ 7336.555391][ C0] ? __skb_clone+0x57a/0x760 [ 7336.555641][ C0] netif_receive_skb+0x55/0x280 [ 7336.555899][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7336.556229][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7336.556576][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7336.556893][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7336.557179][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7336.557479][ C0] ? hlock_class+0x4e/0x130 [ 7336.557723][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7336.558051][ C0] ? place_entity+0x21/0x2f0 [ 7336.558297][ C0] ? resched_curr+0x219/0x280 [ 7336.558551][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7336.558822][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7336.559108][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7336.559384][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7336.559640][ C0] ? activate_task+0xf5/0x260 [ 7336.559888][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7336.560163][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7336.560439][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7336.560699][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7336.560990][ C0] ? get_stack_info+0x36/0xc0 [ 7336.561249][ C0] ? stack_access_ok+0xda/0x1f0 [ 7336.561508][ C0] ? get_reg+0x119/0x190 [ 7336.561736][ C0] __tcf_classify+0x32c/0x7d0 [ 7336.561993][ C0] tcf_classify+0x283/0x930 [ 7336.562240][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7336.562570][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7336.562836][ C0] ? arch_stack_walk+0x8c/0x100 [ 7336.563098][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7336.563386][ C0] tc_run+0x2e4/0x5d0 [ 7336.563606][ C0] ? __pfx_tc_run+0x10/0x10 [ 7336.563852][ C0] ? lock_acquire+0x1c1/0x220 [ 7336.564105][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7336.564384][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7336.564649][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7336.564937][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7336.565219][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7336.565545][ C0] ? neigh_hh_output+0x348/0x590 [ 7336.565809][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7336.566093][ C0] ip_finish_output2+0x786/0x18e0 [ 7336.566364][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7336.566658][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7336.567010][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7336.567300][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7336.567566][ C0] ? __ip_finish_output+0x10f/0x770 [ 7336.567842][ C0] ip_output+0x16b/0x4f0 [ 7336.568070][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7336.568357][ C0] ? __pfx_ip_output+0x10/0x10 [ 7336.568613][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7336.568915][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7336.569177][ C0] ? ip_local_out+0x114/0x3b0 [ 7336.569433][ C0] __ip_queue_xmit+0x672/0x1910 [ 7336.569699][ C0] ? __skb_clone+0x57a/0x760 [ 7336.569950][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7336.570229][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7336.570522][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7336.570838][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7336.571104][ C0] ? tcp_current_mss+0x40a/0x510 [ 7336.571372][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7336.571653][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7336.571937][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7336.572192][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7336.572458][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7336.572775][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7336.573056][ C0] ? ktime_get+0xb6/0x190 [ 7336.573292][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7336.573567][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7336.573847][ C0] tcp_write_timer+0x82/0x1d0 [ 7336.574103][ C0] call_timer_fn+0x176/0x430 [ 7336.574355][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7336.574626][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7336.574902][ C0] __run_timers.part.0+0x52d/0x890 [ 7336.575173][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7336.575458][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7336.575755][ C0] ? lock_acquire+0x1c1/0x220 [ 7336.576008][ C0] ? clockevents_program_event+0xf6/0x300 [ 7336.576319][ C0] ? lock_release+0x1d5/0x250 [ 7336.576571][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7336.576850][ C0] ? ktime_get+0xb6/0x190 [ 7336.577084][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7336.577387][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7336.577695][ C0] run_timer_softirq+0x72/0x100 [ 7336.577958][ C0] __do_softirq+0x1bc/0x7ff [ 7336.578205][ C0] irq_exit_rcu+0x98/0xc0 [ 7336.578439][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7336.578739][ C0] [ 7336.578895][ C0] [ 7336.579051][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7336.579367][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7336.579638][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7336.580666][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7336.580991][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7336.581420][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7336.581839][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7336.582258][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7336.582676][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7336.583097][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7336.583398][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7336.583673][ C0] default_idle_call+0x69/0xa0 [ 7336.583932][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7336.584195][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7336.584488][ C0] ? lock_release+0x1d5/0x250 [ 7336.584738][ C0] do_idle+0xfb/0x160 [ 7336.584949][ C0] cpu_startup_entry+0x55/0x60 [ 7336.585203][ C0] rest_init+0x153/0x260 [ 7336.585433][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7336.585719][ C0] arch_call_rest_init+0x13/0x40 [ 7336.585985][ C0] start_kernel+0x314/0x3d0 [ 7336.586232][ C0] x86_64_start_reservations+0x18/0x30 [ 7336.586525][ C0] x86_64_start_kernel+0xba/0x110 [ 7336.586792][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7336.587126][ C0] [ 7336.587292][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5726s! [ksoftirqd/1:22] [ 7336.587763][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7336.589005][ C1] irq event stamp: 3886976 [ 7336.589255][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7336.589762][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7336.590267][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7336.590773][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7336.591283][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7336.591788][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7336.592454][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7336.592809][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7336.593867][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7336.594203][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7336.594633][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7336.595067][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7336.595502][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7336.595939][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7336.596372][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7336.596853][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7336.597210][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7336.597642][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7336.598071][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7336.598499][ C1] Call Trace: [ 7336.598682][ C1] [ 7336.598840][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7336.599131][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7336.599392][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7336.599690][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7336.599981][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7336.600294][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7336.600582][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7336.600907][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7336.601197][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7336.601529][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7336.601849][ C1] [ 7336.602009][ C1] [ 7336.602171][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7336.602509][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7336.602822][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7336.603144][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7336.603452][ C1] ? run_ksoftirqd+0xb/0x60 [ 7336.603701][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7336.604040][ C1] ? __orc_find+0x9c/0xf0 [ 7336.604281][ C1] ? lock_acquire+0x1c1/0x220 [ 7336.604547][ C1] ? irqentry_enter+0x2b/0x60 [ 7336.604809][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7336.605081][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7336.605380][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7336.605689][ C1] ? lock_acquire+0x1c1/0x220 [ 7336.605943][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7336.606200][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7336.606480][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7336.606735][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7336.607004][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7336.607285][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7336.607583][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7336.607882][ C1] ip_local_deliver+0x19d/0x480 [ 7336.608147][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7336.608438][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7336.608709][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7336.608999][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7336.609272][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7336.609614][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7336.609900][ C1] ip_rcv+0x564/0x740 [ 7336.610122][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7336.610375][ C1] ? set_track_prepare+0x8a/0xd0 [ 7336.610648][ C1] ? irqentry_enter+0x2b/0x60 [ 7336.610902][ C1] ? irqentry_enter+0x2b/0x60 [ 7336.611170][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7336.611422][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7336.611747][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7336.612100][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7336.612419][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7336.612766][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7336.613072][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7336.613420][ C1] netif_receive_skb+0x55/0x280 [ 7336.613690][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7336.614029][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7336.614389][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7336.614707][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7336.615004][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7336.615318][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7336.615658][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7336.615949][ C1] ? arch_stack_walk+0x68/0x100 [ 7336.616215][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7336.616498][ C1] ? irqentry_enter+0x2b/0x60 [ 7336.616754][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7336.617085][ C1] ? irqentry_enter+0x2b/0x60 [ 7336.617348][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7336.617678][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7336.617964][ C1] ? arch_stack_walk+0x68/0x100 [ 7336.618236][ C1] __tcf_classify+0x32c/0x7d0 [ 7336.618500][ C1] tcf_classify+0x283/0x930 [ 7336.618751][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7336.619030][ C1] tc_run+0x2e4/0x5d0 [ 7336.619253][ C1] ? __pfx_tc_run+0x10/0x10 [ 7336.619508][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7336.619783][ C1] ? irqentry_enter+0x2b/0x60 [ 7336.620039][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7336.620330][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7336.620663][ C1] ip_finish_output2+0x786/0x18e0 [ 7336.620942][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7336.621245][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7336.621520][ C1] ? __ip_finish_output+0x10f/0x770 [ 7336.621806][ C1] ip_output+0x16b/0x4f0 [ 7336.622040][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7336.622371][ C1] ? __pfx_ip_output+0x10/0x10 [ 7336.622635][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7336.622998][ C1] ? __pfx_ip_output+0x10/0x10 [ 7336.623264][ C1] __ip_queue_xmit+0x672/0x1910 [ 7336.623531][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7336.623816][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7336.624118][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7336.624411][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7336.624712][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7336.625004][ C1] tcp_delack_timer+0x84/0x240 [ 7336.625266][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7336.625560][ C1] call_timer_fn+0x176/0x430 [ 7336.625818][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7336.626101][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7336.626389][ C1] __run_timers.part.0+0x52d/0x890 [ 7336.626670][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7336.626964][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7336.627273][ C1] ? __pfx___schedule+0x10/0x10 [ 7336.627543][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7336.627874][ C1] run_timer_softirq+0x72/0x100 [ 7336.628137][ C1] __do_softirq+0x1bc/0x7ff [ 7336.628385][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7336.628666][ C1] run_ksoftirqd+0x2e/0x60 [ 7336.628912][ C1] smpboot_thread_fn+0x30e/0x840 [ 7336.629187][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7336.629490][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7336.629785][ C1] kthread+0x292/0x360 [ 7336.630008][ C1] ? __pfx_kthread+0x10/0x10 [ 7336.630258][ C1] ret_from_fork+0x34/0x70 [ 7336.630504][ C1] ? __pfx_kthread+0x10/0x10 [ 7336.630756][ C1] ret_from_fork_asm+0x1b/0x30 [ 7336.631029][ C1] [ 7364.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5752s! [swapper/0:0] [ 7364.527929][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7364.529135][ C0] irq event stamp: 27567077 [ 7364.529379][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7364.529915][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7364.530390][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7364.530900][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7364.531400][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7364.531883][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7364.532524][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7364.532865][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7364.533883][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7364.534205][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7364.534625][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7364.535047][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7364.535467][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7364.535887][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7364.536308][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7364.536780][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7364.537134][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7364.537557][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7364.537984][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7364.538416][ C0] Call Trace: [ 7364.538599][ C0] [ 7364.538758][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7364.539034][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7364.539295][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7364.539587][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7364.539878][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7364.540184][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7364.540467][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7364.540793][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7364.541075][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7364.541352][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7364.541679][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7364.541995][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7364.542328][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7364.542636][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7364.542951][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7364.543256][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7364.543583][ C0] ? get_stack_info+0x36/0xc0 [ 7364.543840][ C0] ? lock_acquire+0x1c1/0x220 [ 7364.544097][ C0] ? lock_release+0x1d5/0x250 [ 7364.544351][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7364.544613][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7364.544901][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7364.545204][ C0] ? lock_acquire+0x1c1/0x220 [ 7364.545455][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7364.545709][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7364.545982][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7364.546232][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7364.546494][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7364.546769][ C0] ? __inet_lookup_established+0x341/0x610 [ 7364.547094][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7364.547383][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7364.547671][ C0] ip_local_deliver+0x19d/0x480 [ 7364.547933][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7364.548224][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7364.548495][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7364.548773][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7364.549038][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7364.549378][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7364.549654][ C0] ip_rcv+0x564/0x740 [ 7364.549869][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7364.550114][ C0] ? set_track_prepare+0x8a/0xd0 [ 7364.550379][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7364.550671][ C0] ? rest_init+0x153/0x260 [ 7364.550914][ C0] ? skb_clone+0x10b/0x330 [ 7364.551155][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7364.551497][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7364.551821][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7364.552118][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7364.552425][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7364.552684][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7364.552926][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7364.553240][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7364.553537][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7364.553882][ C0] ? lock_acquire+0x1c1/0x220 [ 7364.554138][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7364.554449][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7364.554746][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7364.555081][ C0] ? __copy_skb_header+0xaf/0x490 [ 7364.555353][ C0] ? __skb_clone+0x57a/0x760 [ 7364.555601][ C0] netif_receive_skb+0x55/0x280 [ 7364.555860][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7364.556189][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7364.556539][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7364.556857][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7364.557146][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7364.557446][ C0] ? hlock_class+0x4e/0x130 [ 7364.557693][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7364.558025][ C0] ? place_entity+0x21/0x2f0 [ 7364.558270][ C0] ? resched_curr+0x219/0x280 [ 7364.558523][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7364.558796][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7364.559083][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7364.559363][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7364.559621][ C0] ? activate_task+0xf5/0x260 [ 7364.559872][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7364.560147][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7364.560423][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7364.560682][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7364.560979][ C0] ? get_stack_info+0x36/0xc0 [ 7364.561230][ C0] ? stack_access_ok+0xda/0x1f0 [ 7364.561485][ C0] ? get_reg+0x119/0x190 [ 7364.561712][ C0] __tcf_classify+0x32c/0x7d0 [ 7364.561967][ C0] tcf_classify+0x283/0x930 [ 7364.562215][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7364.562546][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7364.562813][ C0] ? arch_stack_walk+0x8c/0x100 [ 7364.563073][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7364.563362][ C0] tc_run+0x2e4/0x5d0 [ 7364.563585][ C0] ? __pfx_tc_run+0x10/0x10 [ 7364.563832][ C0] ? lock_acquire+0x1c1/0x220 [ 7364.564089][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7364.564369][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7364.564635][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7364.564924][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7364.565207][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7364.565533][ C0] ? neigh_hh_output+0x348/0x590 [ 7364.565797][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7364.566080][ C0] ip_finish_output2+0x786/0x18e0 [ 7364.566351][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7364.566648][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7364.567000][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7364.567288][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7364.567557][ C0] ? __ip_finish_output+0x10f/0x770 [ 7364.567833][ C0] ip_output+0x16b/0x4f0 [ 7364.568060][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7364.568354][ C0] ? __pfx_ip_output+0x10/0x10 [ 7364.568610][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7364.568911][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7364.569177][ C0] ? ip_local_out+0x114/0x3b0 [ 7364.569433][ C0] __ip_queue_xmit+0x672/0x1910 [ 7364.569697][ C0] ? __skb_clone+0x57a/0x760 [ 7364.569946][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7364.570229][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7364.570524][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7364.570842][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7364.571109][ C0] ? tcp_current_mss+0x40a/0x510 [ 7364.571378][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7364.571659][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7364.571939][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7364.572199][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7364.572467][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7364.572787][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7364.573069][ C0] ? ktime_get+0xb6/0x190 [ 7364.573305][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7364.573581][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7364.573865][ C0] tcp_write_timer+0x82/0x1d0 [ 7364.574123][ C0] call_timer_fn+0x176/0x430 [ 7364.574373][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7364.574646][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7364.574922][ C0] __run_timers.part.0+0x52d/0x890 [ 7364.575195][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7364.575481][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7364.575779][ C0] ? lock_acquire+0x1c1/0x220 [ 7364.576036][ C0] ? clockevents_program_event+0xf6/0x300 [ 7364.576344][ C0] ? lock_release+0x1d5/0x250 [ 7364.576595][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7364.576878][ C0] ? ktime_get+0xb6/0x190 [ 7364.577112][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7364.577413][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7364.577724][ C0] run_timer_softirq+0x72/0x100 [ 7364.577990][ C0] __do_softirq+0x1bc/0x7ff [ 7364.578239][ C0] irq_exit_rcu+0x98/0xc0 [ 7364.578474][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7364.578777][ C0] [ 7364.578934][ C0] [ 7364.579091][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7364.579408][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7364.579683][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7364.580709][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7364.581036][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7364.581453][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7364.581870][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7364.582288][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7364.582704][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7364.583125][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7364.583427][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7364.583706][ C0] default_idle_call+0x69/0xa0 [ 7364.583964][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7364.584226][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7364.584521][ C0] ? lock_release+0x1d5/0x250 [ 7364.584769][ C0] do_idle+0xfb/0x160 [ 7364.584982][ C0] cpu_startup_entry+0x55/0x60 [ 7364.585238][ C0] rest_init+0x153/0x260 [ 7364.585464][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7364.585750][ C0] arch_call_rest_init+0x13/0x40 [ 7364.586017][ C0] start_kernel+0x314/0x3d0 [ 7364.586264][ C0] x86_64_start_reservations+0x18/0x30 [ 7364.586562][ C0] x86_64_start_kernel+0xba/0x110 [ 7364.586830][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7364.587159][ C0] [ 7364.587326][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5752s! [ksoftirqd/1:22] [ 7364.587796][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7364.589016][ C1] irq event stamp: 3886976 [ 7364.589264][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7364.589770][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7364.590274][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7364.590782][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7364.591290][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7364.591800][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7364.592464][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7364.592817][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7364.593867][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7364.594200][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7364.594635][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7364.595066][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7364.595496][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7364.595930][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7364.596365][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7364.596847][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7364.597205][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7364.597642][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7364.598072][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7364.598500][ C1] Call Trace: [ 7364.598680][ C1] [ 7364.598839][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7364.599125][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7364.599385][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7364.599685][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7364.599976][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7364.600287][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7364.600570][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7364.600900][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7364.601184][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7364.601517][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7364.601838][ C1] [ 7364.602000][ C1] [ 7364.602162][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7364.602499][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7364.602814][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7364.603136][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7364.603447][ C1] ? run_ksoftirqd+0xb/0x60 [ 7364.603701][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7364.604038][ C1] ? __orc_find+0x9c/0xf0 [ 7364.604278][ C1] ? lock_acquire+0x1c1/0x220 [ 7364.604541][ C1] ? irqentry_enter+0x2b/0x60 [ 7364.604800][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7364.605070][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7364.605367][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7364.605676][ C1] ? lock_acquire+0x1c1/0x220 [ 7364.605932][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7364.606191][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7364.606470][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7364.606725][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7364.606992][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7364.607274][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7364.607570][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7364.607870][ C1] ip_local_deliver+0x19d/0x480 [ 7364.608133][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7364.608424][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7364.608696][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7364.608984][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7364.609258][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7364.609604][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7364.609887][ C1] ip_rcv+0x564/0x740 [ 7364.610112][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7364.610365][ C1] ? set_track_prepare+0x8a/0xd0 [ 7364.610639][ C1] ? irqentry_enter+0x2b/0x60 [ 7364.610900][ C1] ? irqentry_enter+0x2b/0x60 [ 7364.611165][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7364.611416][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7364.611741][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7364.612092][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7364.612413][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7364.612761][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7364.613067][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7364.613410][ C1] netif_receive_skb+0x55/0x280 [ 7364.613679][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7364.614017][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7364.614379][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7364.614700][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7364.614999][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7364.615312][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7364.615652][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7364.615942][ C1] ? arch_stack_walk+0x68/0x100 [ 7364.616208][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7364.616490][ C1] ? irqentry_enter+0x2b/0x60 [ 7364.616751][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7364.617078][ C1] ? irqentry_enter+0x2b/0x60 [ 7364.617339][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7364.617672][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7364.617958][ C1] ? arch_stack_walk+0x68/0x100 [ 7364.618226][ C1] __tcf_classify+0x32c/0x7d0 [ 7364.618488][ C1] tcf_classify+0x283/0x930 [ 7364.618739][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7364.619017][ C1] tc_run+0x2e4/0x5d0 [ 7364.619244][ C1] ? __pfx_tc_run+0x10/0x10 [ 7364.619499][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7364.619777][ C1] ? irqentry_enter+0x2b/0x60 [ 7364.620036][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7364.620329][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7364.620661][ C1] ip_finish_output2+0x786/0x18e0 [ 7364.620949][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7364.621248][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7364.621520][ C1] ? __ip_finish_output+0x10f/0x770 [ 7364.621802][ C1] ip_output+0x16b/0x4f0 [ 7364.622036][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7364.622363][ C1] ? __pfx_ip_output+0x10/0x10 [ 7364.622625][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7364.622993][ C1] ? __pfx_ip_output+0x10/0x10 [ 7364.623258][ C1] __ip_queue_xmit+0x672/0x1910 [ 7364.623523][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7364.623809][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7364.624109][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7364.624400][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7364.624702][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7364.624997][ C1] tcp_delack_timer+0x84/0x240 [ 7364.625262][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7364.625557][ C1] call_timer_fn+0x176/0x430 [ 7364.625814][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7364.626097][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7364.626383][ C1] __run_timers.part.0+0x52d/0x890 [ 7364.626664][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7364.626959][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7364.627269][ C1] ? __pfx___schedule+0x10/0x10 [ 7364.627535][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7364.627867][ C1] run_timer_softirq+0x72/0x100 [ 7364.628133][ C1] __do_softirq+0x1bc/0x7ff [ 7364.628380][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7364.628662][ C1] run_ksoftirqd+0x2e/0x60 [ 7364.628909][ C1] smpboot_thread_fn+0x30e/0x840 [ 7364.629181][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7364.629483][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7364.629783][ C1] kthread+0x292/0x360 [ 7364.630008][ C1] ? __pfx_kthread+0x10/0x10 [ 7364.630260][ C1] ret_from_fork+0x34/0x70 [ 7364.630507][ C1] ? __pfx_kthread+0x10/0x10 [ 7364.630757][ C1] ret_from_fork_asm+0x1b/0x30 [ 7364.631030][ C1] [ 7389.019025][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7389.019432][ C0] rcu: 0-....: (6185554 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1458797 [ 7389.019959][ C0] rcu: (t=6194710 jiffies g=1007429 q=31 ncpus=4) [ 7389.020313][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7389.020800][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7389.021444][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7389.021791][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7389.022814][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7389.023139][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7389.023558][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7389.023978][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7389.024399][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7389.024817][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7389.025236][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7389.025705][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7389.026058][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7389.026479][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7389.026903][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7389.027329][ C0] Call Trace: [ 7389.027516][ C0] [ 7389.027674][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7389.027960][ C0] ? print_cpu_stall+0x263/0x6a0 [ 7389.028230][ C0] ? check_cpu_stall+0x284/0x500 [ 7389.028493][ C0] ? rcu_pending+0x92/0x360 [ 7389.028737][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7389.029024][ C0] ? update_process_times+0xb9/0x110 [ 7389.029309][ C0] ? tick_sched_handle+0x67/0x130 [ 7389.029582][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7389.029884][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7389.030140][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7389.030470][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7389.030756][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7389.031073][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7389.031355][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7389.031677][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7389.031949][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7389.032230][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7389.032552][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7389.032864][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7389.033201][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7389.033505][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7389.033816][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7389.034123][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7389.034455][ C0] ? get_stack_info+0x36/0xc0 [ 7389.034711][ C0] ? lock_acquire+0x1c1/0x220 [ 7389.034970][ C0] ? lock_release+0x1d5/0x250 [ 7389.035222][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7389.035483][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7389.035766][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7389.036064][ C0] ? lock_acquire+0x1c1/0x220 [ 7389.036318][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7389.036577][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7389.036853][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7389.037099][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7389.037358][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7389.037627][ C0] ? __inet_lookup_established+0x341/0x610 [ 7389.037939][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7389.038234][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7389.038527][ C0] ip_local_deliver+0x19d/0x480 [ 7389.038786][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7389.039068][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7389.039335][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7389.039615][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7389.039883][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7389.040222][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7389.040500][ C0] ip_rcv+0x564/0x740 [ 7389.040720][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7389.040967][ C0] ? set_track_prepare+0x8a/0xd0 [ 7389.041234][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7389.041526][ C0] ? rest_init+0x153/0x260 [ 7389.041764][ C0] ? skb_clone+0x10b/0x330 [ 7389.042008][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7389.042342][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7389.042665][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7389.042965][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7389.043278][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7389.043544][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7389.043789][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7389.044107][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7389.044407][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7389.044745][ C0] ? lock_acquire+0x1c1/0x220 [ 7389.044995][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7389.045303][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7389.045603][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7389.045930][ C0] ? __copy_skb_header+0xaf/0x490 [ 7389.046197][ C0] ? __skb_clone+0x57a/0x760 [ 7389.046444][ C0] netif_receive_skb+0x55/0x280 [ 7389.046706][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7389.047042][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7389.047391][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7389.047705][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7389.048001][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7389.048308][ C0] ? hlock_class+0x4e/0x130 [ 7389.048557][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7389.048889][ C0] ? place_entity+0x21/0x2f0 [ 7389.049139][ C0] ? resched_curr+0x219/0x280 [ 7389.049388][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7389.049655][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7389.049937][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7389.050223][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7389.050484][ C0] ? activate_task+0xf5/0x260 [ 7389.050740][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7389.051024][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7389.051301][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7389.051561][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7389.051852][ C0] ? get_stack_info+0x36/0xc0 [ 7389.052106][ C0] ? stack_access_ok+0xda/0x1f0 [ 7389.052366][ C0] ? get_reg+0x119/0x190 [ 7389.052597][ C0] __tcf_classify+0x32c/0x7d0 [ 7389.052850][ C0] tcf_classify+0x283/0x930 [ 7389.053096][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7389.053428][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7389.053698][ C0] ? arch_stack_walk+0x8c/0x100 [ 7389.053962][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7389.054253][ C0] tc_run+0x2e4/0x5d0 [ 7389.054469][ C0] ? __pfx_tc_run+0x10/0x10 [ 7389.054710][ C0] ? lock_acquire+0x1c1/0x220 [ 7389.054956][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7389.055230][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7389.055499][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7389.055781][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7389.056056][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7389.056377][ C0] ? neigh_hh_output+0x348/0x590 [ 7389.056643][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7389.056920][ C0] ip_finish_output2+0x786/0x18e0 [ 7389.057186][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7389.057477][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7389.057833][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7389.058124][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7389.058387][ C0] ? __ip_finish_output+0x10f/0x770 [ 7389.058667][ C0] ip_output+0x16b/0x4f0 [ 7389.058898][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7389.059181][ C0] ? __pfx_ip_output+0x10/0x10 [ 7389.059438][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7389.059737][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7389.060003][ C0] ? ip_local_out+0x114/0x3b0 [ 7389.060255][ C0] __ip_queue_xmit+0x672/0x1910 [ 7389.060516][ C0] ? __skb_clone+0x57a/0x760 [ 7389.060764][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7389.061053][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7389.061352][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7389.061668][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7389.061927][ C0] ? tcp_current_mss+0x40a/0x510 [ 7389.062190][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7389.062474][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7389.062749][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7389.063001][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7389.063273][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7389.063602][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7389.063876][ C0] ? ktime_get+0xb6/0x190 [ 7389.064107][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7389.064380][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7389.064664][ C0] tcp_write_timer+0x82/0x1d0 [ 7389.064915][ C0] call_timer_fn+0x176/0x430 [ 7389.065162][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7389.065440][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7389.065713][ C0] __run_timers.part.0+0x52d/0x890 [ 7389.065988][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7389.066270][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7389.066571][ C0] ? lock_acquire+0x1c1/0x220 [ 7389.066822][ C0] ? clockevents_program_event+0xf6/0x300 [ 7389.067131][ C0] ? lock_release+0x1d5/0x250 [ 7389.067379][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7389.067654][ C0] ? ktime_get+0xb6/0x190 [ 7389.067884][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7389.068182][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7389.068495][ C0] run_timer_softirq+0x72/0x100 [ 7389.068754][ C0] __do_softirq+0x1bc/0x7ff [ 7389.068995][ C0] irq_exit_rcu+0x98/0xc0 [ 7389.069227][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7389.069524][ C0] [ 7389.069683][ C0] [ 7389.069844][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7389.070166][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7389.070434][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7389.071460][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7389.071786][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7389.072211][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7389.072635][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7389.073057][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7389.073477][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7389.073905][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7389.074213][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7389.074488][ C0] default_idle_call+0x69/0xa0 [ 7389.074743][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7389.075008][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7389.075298][ C0] ? lock_release+0x1d5/0x250 [ 7389.075551][ C0] do_idle+0xfb/0x160 [ 7389.075772][ C0] cpu_startup_entry+0x55/0x60 [ 7389.076031][ C0] rest_init+0x153/0x260 [ 7389.076256][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7389.076546][ C0] arch_call_rest_init+0x13/0x40 [ 7389.076814][ C0] start_kernel+0x314/0x3d0 [ 7389.077055][ C0] x86_64_start_reservations+0x18/0x30 [ 7389.077344][ C0] x86_64_start_kernel+0xba/0x110 [ 7389.077616][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7389.077948][ C0] [ 7389.078117][ C0] Sending NMI from CPU 0 to CPUs 1: [ 7389.078402][ C1] NMI backtrace for cpu 1 [ 7389.078409][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7389.078413][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7389.078415][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7389.078423][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7389.078426][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7389.078429][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7389.078431][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7389.078433][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7389.078435][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7389.078436][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7389.078438][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7389.078440][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7389.078443][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7389.078445][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7389.078446][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7389.078448][ C1] Call Trace: [ 7389.078450][ C1] [ 7389.078453][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 7389.078459][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7389.078464][ C1] ? nmi_handle+0x156/0x420 [ 7389.078469][ C1] ? default_do_nmi+0x41/0x100 [ 7389.078473][ C1] ? exc_nmi+0xf3/0x120 [ 7389.078475][ C1] ? end_repeat_nmi+0xf/0x60 [ 7389.078480][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7389.078484][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7389.078487][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7389.078491][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7389.078494][ C1] [ 7389.078495][ C1] [ 7389.078497][ C1] ? run_ksoftirqd+0xb/0x60 [ 7389.078503][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7389.078506][ C1] ? __orc_find+0x9c/0xf0 [ 7389.078509][ C1] ? lock_acquire+0x1c1/0x220 [ 7389.078512][ C1] ? irqentry_enter+0x2b/0x60 [ 7389.078517][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7389.078521][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7389.078524][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7389.078527][ C1] ? lock_acquire+0x1c1/0x220 [ 7389.078529][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7389.078534][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7389.078537][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7389.078545][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7389.078548][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7389.078553][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7389.078559][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7389.078563][ C1] ip_local_deliver+0x19d/0x480 [ 7389.078566][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7389.078568][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7389.078573][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7389.078577][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7389.078580][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7389.078583][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7389.078592][ C1] ip_rcv+0x564/0x740 [ 7389.078596][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7389.078599][ C1] ? set_track_prepare+0x8a/0xd0 [ 7389.078602][ C1] ? irqentry_enter+0x2b/0x60 [ 7389.078606][ C1] ? irqentry_enter+0x2b/0x60 [ 7389.078609][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7389.078612][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7389.078616][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7389.078619][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7389.078622][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7389.078625][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7389.078629][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7389.078634][ C1] netif_receive_skb+0x55/0x280 [ 7389.078637][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7389.078645][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7389.078651][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7389.078658][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7389.078664][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7389.078675][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7389.078685][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7389.078688][ C1] ? arch_stack_walk+0x68/0x100 [ 7389.078692][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7389.078695][ C1] ? irqentry_enter+0x2b/0x60 [ 7389.078699][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7389.078703][ C1] ? irqentry_enter+0x2b/0x60 [ 7389.078707][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7389.078714][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7389.078717][ C1] ? arch_stack_walk+0x68/0x100 [ 7389.078721][ C1] __tcf_classify+0x32c/0x7d0 [ 7389.078726][ C1] tcf_classify+0x283/0x930 [ 7389.078730][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7389.078734][ C1] tc_run+0x2e4/0x5d0 [ 7389.078738][ C1] ? __pfx_tc_run+0x10/0x10 [ 7389.078743][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7389.078748][ C1] ? irqentry_enter+0x2b/0x60 [ 7389.078751][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7389.078754][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7389.078761][ C1] ip_finish_output2+0x786/0x18e0 [ 7389.078767][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7389.078769][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7389.078774][ C1] ? __ip_finish_output+0x10f/0x770 [ 7389.078778][ C1] ip_output+0x16b/0x4f0 [ 7389.078781][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7389.078784][ C1] ? __pfx_ip_output+0x10/0x10 [ 7389.078789][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7389.078796][ C1] ? __pfx_ip_output+0x10/0x10 [ 7389.078800][ C1] __ip_queue_xmit+0x672/0x1910 [ 7389.078805][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7389.078812][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7389.078816][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7389.078820][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7389.078824][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7389.078827][ C1] tcp_delack_timer+0x84/0x240 [ 7389.078831][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7389.078834][ C1] call_timer_fn+0x176/0x430 [ 7389.078838][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7389.078843][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7389.078847][ C1] __run_timers.part.0+0x52d/0x890 [ 7389.078850][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7389.078855][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7389.078860][ C1] ? __pfx___schedule+0x10/0x10 [ 7389.078864][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7389.078869][ C1] run_timer_softirq+0x72/0x100 [ 7389.078872][ C1] __do_softirq+0x1bc/0x7ff [ 7389.078876][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7389.078880][ C1] run_ksoftirqd+0x2e/0x60 [ 7389.078883][ C1] smpboot_thread_fn+0x30e/0x840 [ 7389.078888][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7389.078892][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7389.078895][ C1] kthread+0x292/0x360 [ 7389.078898][ C1] ? __pfx_kthread+0x10/0x10 [ 7389.078900][ C1] ret_from_fork+0x34/0x70 [ 7389.078904][ C1] ? __pfx_kthread+0x10/0x10 [ 7389.078907][ C1] ret_from_fork_asm+0x1b/0x30 [ 7389.078914][ C1] [ 7416.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5801s! [swapper/0:0] [ 7416.527925][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7416.529130][ C0] irq event stamp: 27567077 [ 7416.529375][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7416.529909][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7416.530383][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7416.530890][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7416.531389][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7416.531872][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7416.532513][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7416.532851][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7416.533861][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7416.534199][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7416.534617][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7416.535034][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7416.535454][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7416.535872][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7416.536289][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7416.536756][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7416.537112][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7416.537533][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7416.537951][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7416.538372][ C0] Call Trace: [ 7416.538555][ C0] [ 7416.538713][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7416.538989][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7416.539246][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7416.539534][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7416.539821][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7416.540127][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7416.540410][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7416.540738][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7416.541017][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7416.541294][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7416.541622][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7416.541936][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7416.542267][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7416.542574][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7416.542886][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7416.543189][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7416.543515][ C0] ? get_stack_info+0x36/0xc0 [ 7416.543773][ C0] ? lock_acquire+0x1c1/0x220 [ 7416.544030][ C0] ? lock_release+0x1d5/0x250 [ 7416.544285][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7416.544552][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7416.544842][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7416.545144][ C0] ? lock_acquire+0x1c1/0x220 [ 7416.545395][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7416.545646][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7416.545918][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7416.546168][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7416.546435][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7416.546707][ C0] ? __inet_lookup_established+0x341/0x610 [ 7416.547027][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7416.547316][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7416.547607][ C0] ip_local_deliver+0x19d/0x480 [ 7416.547868][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7416.548155][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7416.548422][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7416.548696][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7416.548957][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7416.549295][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7416.549570][ C0] ip_rcv+0x564/0x740 [ 7416.549781][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7416.550021][ C0] ? set_track_prepare+0x8a/0xd0 [ 7416.550285][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7416.550577][ C0] ? rest_init+0x153/0x260 [ 7416.550822][ C0] ? skb_clone+0x10b/0x330 [ 7416.551063][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7416.551401][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7416.551722][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7416.552016][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7416.552325][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7416.552580][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7416.552819][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7416.553134][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7416.553432][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7416.553773][ C0] ? lock_acquire+0x1c1/0x220 [ 7416.554023][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7416.554336][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7416.554632][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7416.554966][ C0] ? __copy_skb_header+0xaf/0x490 [ 7416.555237][ C0] ? __skb_clone+0x57a/0x760 [ 7416.555484][ C0] netif_receive_skb+0x55/0x280 [ 7416.555741][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7416.556067][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7416.556414][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7416.556728][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7416.557013][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7416.557310][ C0] ? hlock_class+0x4e/0x130 [ 7416.557554][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7416.557882][ C0] ? place_entity+0x21/0x2f0 [ 7416.558131][ C0] ? resched_curr+0x219/0x280 [ 7416.558387][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7416.558655][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7416.558938][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7416.559216][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7416.559474][ C0] ? activate_task+0xf5/0x260 [ 7416.559722][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7416.559996][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7416.560271][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7416.560529][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7416.560826][ C0] ? get_stack_info+0x36/0xc0 [ 7416.561082][ C0] ? stack_access_ok+0xda/0x1f0 [ 7416.561340][ C0] ? get_reg+0x119/0x190 [ 7416.561565][ C0] __tcf_classify+0x32c/0x7d0 [ 7416.561820][ C0] tcf_classify+0x283/0x930 [ 7416.562066][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7416.562398][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7416.562662][ C0] ? arch_stack_walk+0x8c/0x100 [ 7416.562921][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7416.563211][ C0] tc_run+0x2e4/0x5d0 [ 7416.563426][ C0] ? __pfx_tc_run+0x10/0x10 [ 7416.563670][ C0] ? lock_acquire+0x1c1/0x220 [ 7416.563922][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7416.564204][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7416.564470][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7416.564756][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7416.565042][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7416.565362][ C0] ? neigh_hh_output+0x348/0x590 [ 7416.565626][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7416.565905][ C0] ip_finish_output2+0x786/0x18e0 [ 7416.566178][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7416.566470][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7416.566823][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7416.567113][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7416.567379][ C0] ? __ip_finish_output+0x10f/0x770 [ 7416.567654][ C0] ip_output+0x16b/0x4f0 [ 7416.567879][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7416.568165][ C0] ? __pfx_ip_output+0x10/0x10 [ 7416.568417][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7416.568720][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7416.568981][ C0] ? ip_local_out+0x114/0x3b0 [ 7416.569235][ C0] __ip_queue_xmit+0x672/0x1910 [ 7416.569498][ C0] ? __skb_clone+0x57a/0x760 [ 7416.569746][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7416.570025][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7416.570317][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7416.570632][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7416.570896][ C0] ? tcp_current_mss+0x40a/0x510 [ 7416.571161][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7416.571439][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7416.571716][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7416.571971][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7416.572237][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7416.572553][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7416.572831][ C0] ? ktime_get+0xb6/0x190 [ 7416.573066][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7416.573339][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7416.573617][ C0] tcp_write_timer+0x82/0x1d0 [ 7416.573869][ C0] call_timer_fn+0x176/0x430 [ 7416.574123][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7416.574397][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7416.574671][ C0] __run_timers.part.0+0x52d/0x890 [ 7416.574946][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7416.575231][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7416.575528][ C0] ? lock_acquire+0x1c1/0x220 [ 7416.575779][ C0] ? clockevents_program_event+0xf6/0x300 [ 7416.576087][ C0] ? lock_release+0x1d5/0x250 [ 7416.576341][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7416.576624][ C0] ? ktime_get+0xb6/0x190 [ 7416.576859][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7416.577161][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7416.577471][ C0] run_timer_softirq+0x72/0x100 [ 7416.577731][ C0] __do_softirq+0x1bc/0x7ff [ 7416.577978][ C0] irq_exit_rcu+0x98/0xc0 [ 7416.578212][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7416.578515][ C0] [ 7416.578672][ C0] [ 7416.578829][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7416.579151][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7416.579421][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7416.580450][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7416.580782][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7416.581201][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7416.581617][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7416.582036][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7416.582453][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7416.582871][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7416.583173][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7416.583445][ C0] default_idle_call+0x69/0xa0 [ 7416.583700][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7416.583962][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7416.584257][ C0] ? lock_release+0x1d5/0x250 [ 7416.584508][ C0] do_idle+0xfb/0x160 [ 7416.584719][ C0] cpu_startup_entry+0x55/0x60 [ 7416.584970][ C0] rest_init+0x153/0x260 [ 7416.585201][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7416.585489][ C0] arch_call_rest_init+0x13/0x40 [ 7416.585753][ C0] start_kernel+0x314/0x3d0 [ 7416.585998][ C0] x86_64_start_reservations+0x18/0x30 [ 7416.586291][ C0] x86_64_start_kernel+0xba/0x110 [ 7416.586557][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7416.586881][ C0] [ 7416.587045][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5801s! [ksoftirqd/1:22] [ 7416.587520][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7416.588756][ C1] irq event stamp: 3886976 [ 7416.589000][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7416.589511][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7416.590021][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7416.590535][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7416.591046][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7416.591545][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7416.592203][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7416.592550][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7416.593589][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7416.593918][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7416.594347][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7416.594773][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7416.595202][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7416.595630][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7416.596059][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7416.596536][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7416.596897][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7416.597328][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7416.597757][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7416.598192][ C1] Call Trace: [ 7416.598378][ C1] [ 7416.598539][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7416.598819][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7416.599081][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7416.599374][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7416.599669][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7416.599982][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7416.600268][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7416.600597][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7416.600886][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7416.601215][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7416.601531][ C1] [ 7416.601693][ C1] [ 7416.601855][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7416.602196][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7416.602504][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7416.602820][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7416.603134][ C1] ? run_ksoftirqd+0xb/0x60 [ 7416.603388][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7416.603723][ C1] ? __orc_find+0x9c/0xf0 [ 7416.603957][ C1] ? lock_acquire+0x1c1/0x220 [ 7416.604212][ C1] ? irqentry_enter+0x2b/0x60 [ 7416.604467][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7416.604732][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7416.605023][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7416.605329][ C1] ? lock_acquire+0x1c1/0x220 [ 7416.605588][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7416.605848][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7416.606132][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7416.606381][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7416.606645][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7416.606923][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7416.607216][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7416.607511][ C1] ip_local_deliver+0x19d/0x480 [ 7416.607778][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7416.608074][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7416.608349][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7416.608634][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7416.608906][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7416.609253][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7416.609533][ C1] ip_rcv+0x564/0x740 [ 7416.609751][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7416.609999][ C1] ? set_track_prepare+0x8a/0xd0 [ 7416.610270][ C1] ? irqentry_enter+0x2b/0x60 [ 7416.610529][ C1] ? irqentry_enter+0x2b/0x60 [ 7416.610792][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7416.611045][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7416.611365][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7416.611711][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7416.612027][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7416.612377][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7416.612683][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7416.613019][ C1] netif_receive_skb+0x55/0x280 [ 7416.613287][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7416.613619][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7416.613975][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7416.614297][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7416.614595][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7416.614903][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7416.615240][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7416.615525][ C1] ? arch_stack_walk+0x68/0x100 [ 7416.615792][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7416.616081][ C1] ? irqentry_enter+0x2b/0x60 [ 7416.616340][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7416.616671][ C1] ? irqentry_enter+0x2b/0x60 [ 7416.616929][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7416.617258][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7416.617546][ C1] ? arch_stack_walk+0x68/0x100 [ 7416.617809][ C1] __tcf_classify+0x32c/0x7d0 [ 7416.618067][ C1] tcf_classify+0x283/0x930 [ 7416.618314][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7416.618589][ C1] tc_run+0x2e4/0x5d0 [ 7416.618809][ C1] ? __pfx_tc_run+0x10/0x10 [ 7416.619059][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7416.619335][ C1] ? irqentry_enter+0x2b/0x60 [ 7416.619593][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7416.619888][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7416.620220][ C1] ip_finish_output2+0x786/0x18e0 [ 7416.620496][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7416.620798][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7416.621074][ C1] ? __ip_finish_output+0x10f/0x770 [ 7416.621362][ C1] ip_output+0x16b/0x4f0 [ 7416.621598][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7416.621922][ C1] ? __pfx_ip_output+0x10/0x10 [ 7416.622188][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7416.622546][ C1] ? __pfx_ip_output+0x10/0x10 [ 7416.622806][ C1] __ip_queue_xmit+0x672/0x1910 [ 7416.623077][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7416.623367][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7416.623671][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7416.623967][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7416.624275][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7416.624575][ C1] tcp_delack_timer+0x84/0x240 [ 7416.624840][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7416.625132][ C1] call_timer_fn+0x176/0x430 [ 7416.625387][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7416.625673][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7416.625955][ C1] __run_timers.part.0+0x52d/0x890 [ 7416.626234][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7416.626531][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7416.626839][ C1] ? __pfx___schedule+0x10/0x10 [ 7416.627103][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7416.627427][ C1] run_timer_softirq+0x72/0x100 [ 7416.627694][ C1] __do_softirq+0x1bc/0x7ff [ 7416.627945][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7416.628227][ C1] run_ksoftirqd+0x2e/0x60 [ 7416.628468][ C1] smpboot_thread_fn+0x30e/0x840 [ 7416.628743][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7416.629042][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7416.629341][ C1] kthread+0x292/0x360 [ 7416.629562][ C1] ? __pfx_kthread+0x10/0x10 [ 7416.629816][ C1] ret_from_fork+0x34/0x70 [ 7416.630060][ C1] ? __pfx_kthread+0x10/0x10 [ 7416.630315][ C1] ret_from_fork_asm+0x1b/0x30 [ 7416.630580][ C1] [ 7444.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5827s! [swapper/0:0] [ 7444.527932][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7444.529135][ C0] irq event stamp: 27567077 [ 7444.529374][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7444.529901][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7444.530377][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7444.530889][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7444.531386][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7444.531865][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7444.532513][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7444.532857][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7444.533886][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7444.534215][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7444.534636][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7444.535062][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7444.535489][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7444.535913][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7444.536335][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7444.536811][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7444.537160][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7444.537586][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7444.538006][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7444.538424][ C0] Call Trace: [ 7444.538603][ C0] [ 7444.538761][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7444.539040][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7444.539295][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7444.539589][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7444.539875][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7444.540176][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7444.540455][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7444.540782][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7444.541057][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7444.541336][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7444.541658][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7444.541968][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7444.542303][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7444.542606][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7444.542914][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7444.543222][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7444.543552][ C0] ? get_stack_info+0x36/0xc0 [ 7444.543805][ C0] ? lock_acquire+0x1c1/0x220 [ 7444.544059][ C0] ? lock_release+0x1d5/0x250 [ 7444.544309][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7444.544569][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7444.544852][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7444.545150][ C0] ? lock_acquire+0x1c1/0x220 [ 7444.545403][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7444.545661][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7444.545937][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7444.546183][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7444.546440][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7444.546712][ C0] ? __inet_lookup_established+0x341/0x610 [ 7444.547026][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7444.547318][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7444.547610][ C0] ip_local_deliver+0x19d/0x480 [ 7444.547866][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7444.548146][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7444.548411][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7444.548691][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7444.548962][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7444.549296][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7444.549574][ C0] ip_rcv+0x564/0x740 [ 7444.549794][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7444.550039][ C0] ? set_track_prepare+0x8a/0xd0 [ 7444.550307][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7444.550604][ C0] ? rest_init+0x153/0x260 [ 7444.550841][ C0] ? skb_clone+0x10b/0x330 [ 7444.551084][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7444.551418][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7444.551739][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7444.552038][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7444.552349][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7444.552613][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7444.552858][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7444.553176][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7444.553475][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7444.553812][ C0] ? lock_acquire+0x1c1/0x220 [ 7444.554062][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7444.554374][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7444.554677][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7444.555004][ C0] ? __copy_skb_header+0xaf/0x490 [ 7444.555271][ C0] ? __skb_clone+0x57a/0x760 [ 7444.555518][ C0] netif_receive_skb+0x55/0x280 [ 7444.555781][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7444.556116][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7444.556464][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7444.556779][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7444.557065][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7444.557363][ C0] ? hlock_class+0x4e/0x130 [ 7444.557607][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7444.557933][ C0] ? place_entity+0x21/0x2f0 [ 7444.558182][ C0] ? resched_curr+0x219/0x280 [ 7444.558436][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7444.558705][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7444.558990][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7444.559265][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7444.559519][ C0] ? activate_task+0xf5/0x260 [ 7444.559766][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7444.560040][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7444.560314][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7444.560581][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7444.560873][ C0] ? get_stack_info+0x36/0xc0 [ 7444.561125][ C0] ? stack_access_ok+0xda/0x1f0 [ 7444.561382][ C0] ? get_reg+0x119/0x190 [ 7444.561610][ C0] __tcf_classify+0x32c/0x7d0 [ 7444.561866][ C0] tcf_classify+0x283/0x930 [ 7444.562111][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7444.562441][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7444.562705][ C0] ? arch_stack_walk+0x8c/0x100 [ 7444.562965][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7444.563253][ C0] tc_run+0x2e4/0x5d0 [ 7444.563470][ C0] ? __pfx_tc_run+0x10/0x10 [ 7444.563715][ C0] ? lock_acquire+0x1c1/0x220 [ 7444.563965][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7444.564243][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7444.564507][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7444.564793][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7444.565073][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7444.565402][ C0] ? neigh_hh_output+0x348/0x590 [ 7444.565665][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7444.565945][ C0] ip_finish_output2+0x786/0x18e0 [ 7444.566215][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7444.566512][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7444.566862][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7444.567151][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7444.567415][ C0] ? __ip_finish_output+0x10f/0x770 [ 7444.567690][ C0] ip_output+0x16b/0x4f0 [ 7444.567916][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7444.568201][ C0] ? __pfx_ip_output+0x10/0x10 [ 7444.568456][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7444.568757][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7444.569019][ C0] ? ip_local_out+0x114/0x3b0 [ 7444.569274][ C0] __ip_queue_xmit+0x672/0x1910 [ 7444.569539][ C0] ? __skb_clone+0x57a/0x760 [ 7444.569790][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7444.570070][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7444.570363][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7444.570685][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7444.570939][ C0] ? tcp_current_mss+0x40a/0x510 [ 7444.571205][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7444.571485][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7444.571764][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7444.572017][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7444.572283][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7444.572600][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7444.572879][ C0] ? ktime_get+0xb6/0x190 [ 7444.573114][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7444.573389][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7444.573669][ C0] tcp_write_timer+0x82/0x1d0 [ 7444.573928][ C0] call_timer_fn+0x176/0x430 [ 7444.574177][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7444.574449][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7444.574724][ C0] __run_timers.part.0+0x52d/0x890 [ 7444.574994][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7444.575282][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7444.575578][ C0] ? lock_acquire+0x1c1/0x220 [ 7444.575831][ C0] ? clockevents_program_event+0xf6/0x300 [ 7444.576141][ C0] ? lock_release+0x1d5/0x250 [ 7444.576393][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7444.576673][ C0] ? ktime_get+0xb6/0x190 [ 7444.576905][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7444.577210][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7444.577518][ C0] run_timer_softirq+0x72/0x100 [ 7444.577779][ C0] __do_softirq+0x1bc/0x7ff [ 7444.578030][ C0] irq_exit_rcu+0x98/0xc0 [ 7444.578263][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7444.578563][ C0] [ 7444.578719][ C0] [ 7444.578874][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7444.579192][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7444.579462][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7444.580493][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7444.580827][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7444.581242][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7444.581659][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7444.582074][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7444.582489][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7444.582906][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7444.583209][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7444.583481][ C0] default_idle_call+0x69/0xa0 [ 7444.583740][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7444.584003][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7444.584298][ C0] ? lock_release+0x1d5/0x250 [ 7444.584546][ C0] do_idle+0xfb/0x160 [ 7444.584756][ C0] cpu_startup_entry+0x55/0x60 [ 7444.585008][ C0] rest_init+0x153/0x260 [ 7444.585239][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7444.585526][ C0] arch_call_rest_init+0x13/0x40 [ 7444.585791][ C0] start_kernel+0x314/0x3d0 [ 7444.586036][ C0] x86_64_start_reservations+0x18/0x30 [ 7444.586329][ C0] x86_64_start_kernel+0xba/0x110 [ 7444.586596][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7444.586922][ C0] [ 7444.587091][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5827s! [ksoftirqd/1:22] [ 7444.587862][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7444.589697][ C1] irq event stamp: 3886976 [ 7444.590074][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7444.590874][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7444.591671][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7444.592464][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7444.593196][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7444.593980][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7444.595004][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7444.595553][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7444.597142][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7444.597657][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7444.598328][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7444.598983][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7444.599653][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7444.600321][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7444.601004][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7444.601753][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7444.602355][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7444.602994][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7444.603660][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7444.604328][ C1] Call Trace: [ 7444.604611][ C1] [ 7444.604861][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7444.605310][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7444.605718][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7444.606177][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7444.606640][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7444.607132][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7444.607579][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7444.608102][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7444.608546][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7444.608981][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7444.609587][ C1] [ 7444.609823][ C1] [ 7444.610087][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7444.610676][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7444.611166][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7444.611666][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7444.612149][ C1] ? run_ksoftirqd+0xb/0x60 [ 7444.612542][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7444.613058][ C1] ? __orc_find+0x9c/0xf0 [ 7444.613433][ C1] ? lock_acquire+0x1c1/0x220 [ 7444.613860][ C1] ? irqentry_enter+0x2b/0x60 [ 7444.614295][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7444.614769][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7444.615277][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7444.615807][ C1] ? lock_acquire+0x1c1/0x220 [ 7444.616248][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7444.616696][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7444.617184][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7444.617628][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7444.618086][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7444.618578][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7444.619125][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7444.619643][ C1] ip_local_deliver+0x19d/0x480 [ 7444.620098][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7444.620627][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7444.621104][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7444.621610][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7444.622090][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7444.622701][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7444.623207][ C1] ip_rcv+0x564/0x740 [ 7444.623616][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7444.624050][ C1] ? set_track_prepare+0x8a/0xd0 [ 7444.624526][ C1] ? irqentry_enter+0x2b/0x60 [ 7444.624980][ C1] ? irqentry_enter+0x2b/0x60 [ 7444.625438][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7444.625895][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7444.626470][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7444.627079][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7444.627644][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7444.628264][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7444.628801][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7444.629399][ C1] netif_receive_skb+0x55/0x280 [ 7444.629868][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7444.630459][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7444.631093][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7444.631651][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7444.632172][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7444.632637][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7444.633153][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7444.633604][ C1] ? arch_stack_walk+0x68/0x100 [ 7444.634029][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7444.634478][ C1] ? irqentry_enter+0x2b/0x60 [ 7444.634886][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7444.635401][ C1] ? irqentry_enter+0x2b/0x60 [ 7444.635800][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7444.636318][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7444.636772][ C1] ? arch_stack_walk+0x68/0x100 [ 7444.637197][ C1] __tcf_classify+0x32c/0x7d0 [ 7444.637607][ C1] tcf_classify+0x283/0x930 [ 7444.638002][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7444.638436][ C1] tc_run+0x2e4/0x5d0 [ 7444.638784][ C1] ? __pfx_tc_run+0x10/0x10 [ 7444.639179][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7444.639630][ C1] ? irqentry_enter+0x2b/0x60 [ 7444.640005][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7444.640448][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7444.640979][ C1] ip_finish_output2+0x786/0x18e0 [ 7444.641418][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7444.641889][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7444.642315][ C1] ? __ip_finish_output+0x10f/0x770 [ 7444.642763][ C1] ip_output+0x16b/0x4f0 [ 7444.643129][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7444.643741][ C1] ? __pfx_ip_output+0x10/0x10 [ 7444.644131][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7444.644695][ C1] ? __pfx_ip_output+0x10/0x10 [ 7444.645108][ C1] __ip_queue_xmit+0x672/0x1910 [ 7444.645530][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7444.645982][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7444.646464][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7444.646916][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7444.647398][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7444.647860][ C1] tcp_delack_timer+0x84/0x240 [ 7444.648271][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7444.648725][ C1] call_timer_fn+0x176/0x430 [ 7444.649120][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7444.649562][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7444.649942][ C1] __run_timers.part.0+0x52d/0x890 [ 7444.650367][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7444.650863][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7444.651412][ C1] ? __pfx___schedule+0x10/0x10 [ 7444.651868][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7444.652421][ C1] run_timer_softirq+0x72/0x100 [ 7444.652878][ C1] __do_softirq+0x1bc/0x7ff [ 7444.653306][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7444.653796][ C1] run_ksoftirqd+0x2e/0x60 [ 7444.654221][ C1] smpboot_thread_fn+0x30e/0x840 [ 7444.654675][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7444.655177][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7444.655698][ C1] kthread+0x292/0x360 [ 7444.656089][ C1] ? __pfx_kthread+0x10/0x10 [ 7444.656525][ C1] ret_from_fork+0x34/0x70 [ 7444.656950][ C1] ? __pfx_kthread+0x10/0x10 [ 7444.657391][ C1] ret_from_fork_asm+0x1b/0x30 [ 7444.657868][ C1] [ 7467.082025][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7467.082410][ C0] rcu: 0-....: (6263440 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1476953 [ 7467.082930][ C0] rcu: (t=6272773 jiffies g=1007429 q=31 ncpus=4) [ 7467.083277][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7467.083764][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7467.084408][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7467.084752][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7467.085770][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7467.086096][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7467.086513][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7467.086934][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7467.087354][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7467.087772][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7467.088189][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7467.088658][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7467.089010][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7467.089429][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7467.089850][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7467.090275][ C0] Call Trace: [ 7467.090461][ C0] [ 7467.090615][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7467.090904][ C0] ? print_cpu_stall+0x263/0x6a0 [ 7467.091174][ C0] ? check_cpu_stall+0x284/0x500 [ 7467.091440][ C0] ? rcu_pending+0x92/0x360 [ 7467.091680][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7467.091964][ C0] ? update_process_times+0xb9/0x110 [ 7467.092252][ C0] ? tick_sched_handle+0x67/0x130 [ 7467.092522][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7467.092817][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7467.093076][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7467.093402][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7467.093691][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7467.093997][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7467.094281][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7467.094602][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7467.094874][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7467.095154][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7467.095474][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7467.095783][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7467.096122][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7467.096425][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7467.096734][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7467.097041][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7467.097371][ C0] ? get_stack_info+0x36/0xc0 [ 7467.097625][ C0] ? lock_acquire+0x1c1/0x220 [ 7467.097882][ C0] ? lock_release+0x1d5/0x250 [ 7467.098134][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7467.098394][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7467.098678][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7467.098974][ C0] ? lock_acquire+0x1c1/0x220 [ 7467.099229][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7467.099488][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7467.099766][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7467.100012][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7467.100272][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7467.100548][ C0] ? __inet_lookup_established+0x341/0x610 [ 7467.100865][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7467.101156][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7467.101447][ C0] ip_local_deliver+0x19d/0x480 [ 7467.101711][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7467.101998][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7467.102267][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7467.102543][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7467.102807][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7467.103148][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7467.103422][ C0] ip_rcv+0x564/0x740 [ 7467.103646][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7467.103899][ C0] ? set_track_prepare+0x8a/0xd0 [ 7467.104164][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7467.104454][ C0] ? rest_init+0x153/0x260 [ 7467.104696][ C0] ? skb_clone+0x10b/0x330 [ 7467.104938][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7467.105272][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7467.105593][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7467.105893][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7467.106205][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7467.106469][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7467.106713][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7467.107030][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7467.107329][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7467.107665][ C0] ? lock_acquire+0x1c1/0x220 [ 7467.107915][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7467.108223][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7467.108522][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7467.108851][ C0] ? __copy_skb_header+0xaf/0x490 [ 7467.109117][ C0] ? __skb_clone+0x57a/0x760 [ 7467.109364][ C0] netif_receive_skb+0x55/0x280 [ 7467.109625][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7467.109957][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7467.110308][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7467.110626][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7467.110911][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7467.111209][ C0] ? hlock_class+0x4e/0x130 [ 7467.111457][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7467.111782][ C0] ? place_entity+0x21/0x2f0 [ 7467.112027][ C0] ? resched_curr+0x219/0x280 [ 7467.112280][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7467.112549][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7467.112833][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7467.113108][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7467.113363][ C0] ? activate_task+0xf5/0x260 [ 7467.113609][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7467.113883][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7467.114159][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7467.114417][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7467.114706][ C0] ? get_stack_info+0x36/0xc0 [ 7467.114963][ C0] ? stack_access_ok+0xda/0x1f0 [ 7467.115223][ C0] ? get_reg+0x119/0x190 [ 7467.115454][ C0] __tcf_classify+0x32c/0x7d0 [ 7467.115706][ C0] tcf_classify+0x283/0x930 [ 7467.115947][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7467.116275][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7467.116547][ C0] ? arch_stack_walk+0x8c/0x100 [ 7467.116810][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7467.117106][ C0] tc_run+0x2e4/0x5d0 [ 7467.117322][ C0] ? __pfx_tc_run+0x10/0x10 [ 7467.117561][ C0] ? lock_acquire+0x1c1/0x220 [ 7467.117808][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7467.118081][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7467.118348][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7467.118631][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7467.118905][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7467.119227][ C0] ? neigh_hh_output+0x348/0x590 [ 7467.119493][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7467.119768][ C0] ip_finish_output2+0x786/0x18e0 [ 7467.120036][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7467.120327][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7467.120684][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7467.120973][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7467.121239][ C0] ? __ip_finish_output+0x10f/0x770 [ 7467.121514][ C0] ip_output+0x16b/0x4f0 [ 7467.121741][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7467.122026][ C0] ? __pfx_ip_output+0x10/0x10 [ 7467.122281][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7467.122584][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7467.122845][ C0] ? ip_local_out+0x114/0x3b0 [ 7467.123101][ C0] __ip_queue_xmit+0x672/0x1910 [ 7467.123368][ C0] ? __skb_clone+0x57a/0x760 [ 7467.123617][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7467.123895][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7467.124190][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7467.124506][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7467.124763][ C0] ? tcp_current_mss+0x40a/0x510 [ 7467.125026][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7467.125311][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7467.125585][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7467.125837][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7467.126110][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7467.126432][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7467.126706][ C0] ? ktime_get+0xb6/0x190 [ 7467.126935][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7467.127209][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7467.127492][ C0] tcp_write_timer+0x82/0x1d0 [ 7467.127743][ C0] call_timer_fn+0x176/0x430 [ 7467.127989][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7467.128268][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7467.128541][ C0] __run_timers.part.0+0x52d/0x890 [ 7467.128813][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7467.129094][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7467.129395][ C0] ? lock_acquire+0x1c1/0x220 [ 7467.129644][ C0] ? clockevents_program_event+0xf6/0x300 [ 7467.129947][ C0] ? lock_release+0x1d5/0x250 [ 7467.130196][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7467.130480][ C0] ? ktime_get+0xb6/0x190 [ 7467.130712][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7467.131020][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7467.131329][ C0] run_timer_softirq+0x72/0x100 [ 7467.131590][ C0] __do_softirq+0x1bc/0x7ff [ 7467.131837][ C0] irq_exit_rcu+0x98/0xc0 [ 7467.132072][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7467.132371][ C0] [ 7467.132526][ C0] [ 7467.132682][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7467.132999][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7467.133272][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7467.134297][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7467.134621][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7467.135046][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7467.135469][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7467.135887][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7467.136307][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7467.136731][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7467.137039][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7467.137314][ C0] default_idle_call+0x69/0xa0 [ 7467.137569][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7467.137834][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7467.138123][ C0] ? lock_release+0x1d5/0x250 [ 7467.138375][ C0] do_idle+0xfb/0x160 [ 7467.138592][ C0] cpu_startup_entry+0x55/0x60 [ 7467.138850][ C0] rest_init+0x153/0x260 [ 7467.139076][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7467.139369][ C0] arch_call_rest_init+0x13/0x40 [ 7467.139639][ C0] start_kernel+0x314/0x3d0 [ 7467.139879][ C0] x86_64_start_reservations+0x18/0x30 [ 7467.140169][ C0] x86_64_start_kernel+0xba/0x110 [ 7467.140448][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7467.140776][ C0] [ 7467.140941][ C0] Sending NMI from CPU 0 to CPUs 1: [ 7467.141233][ C1] NMI backtrace for cpu 1 [ 7467.141241][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7467.141246][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7467.141248][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7467.141258][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7467.141261][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7467.141265][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7467.141267][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7467.141269][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7467.141271][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7467.141272][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7467.141274][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7467.141276][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7467.141279][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7467.141281][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7467.141283][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7467.141284][ C1] Call Trace: [ 7467.141287][ C1] [ 7467.141293][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 7467.141299][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7467.141305][ C1] ? nmi_handle+0x156/0x420 [ 7467.141311][ C1] ? default_do_nmi+0x41/0x100 [ 7467.141315][ C1] ? exc_nmi+0xf3/0x120 [ 7467.141317][ C1] ? end_repeat_nmi+0xf/0x60 [ 7467.141322][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7467.141326][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7467.141329][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7467.141333][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7467.141336][ C1] [ 7467.141337][ C1] [ 7467.141338][ C1] ? run_ksoftirqd+0xb/0x60 [ 7467.141344][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7467.141347][ C1] ? __orc_find+0x9c/0xf0 [ 7467.141350][ C1] ? lock_acquire+0x1c1/0x220 [ 7467.141355][ C1] ? irqentry_enter+0x2b/0x60 [ 7467.141360][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7467.141364][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7467.141367][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7467.141370][ C1] ? lock_acquire+0x1c1/0x220 [ 7467.141372][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7467.141378][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7467.141381][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7467.141389][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7467.141392][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7467.141398][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7467.141405][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7467.141410][ C1] ip_local_deliver+0x19d/0x480 [ 7467.141413][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7467.141415][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7467.141420][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7467.141424][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7467.141427][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7467.141431][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7467.141441][ C1] ip_rcv+0x564/0x740 [ 7467.141444][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7467.141447][ C1] ? set_track_prepare+0x8a/0xd0 [ 7467.141452][ C1] ? irqentry_enter+0x2b/0x60 [ 7467.141455][ C1] ? irqentry_enter+0x2b/0x60 [ 7467.141459][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7467.141462][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7467.141466][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7467.141469][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7467.141472][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7467.141475][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7467.141478][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7467.141483][ C1] netif_receive_skb+0x55/0x280 [ 7467.141486][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7467.141495][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7467.141502][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7467.141509][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7467.141516][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7467.141528][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7467.141538][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7467.141540][ C1] ? arch_stack_walk+0x68/0x100 [ 7467.141545][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7467.141549][ C1] ? irqentry_enter+0x2b/0x60 [ 7467.141552][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7467.141558][ C1] ? irqentry_enter+0x2b/0x60 [ 7467.141561][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7467.141568][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7467.141571][ C1] ? arch_stack_walk+0x68/0x100 [ 7467.141575][ C1] __tcf_classify+0x32c/0x7d0 [ 7467.141580][ C1] tcf_classify+0x283/0x930 [ 7467.141584][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7467.141588][ C1] tc_run+0x2e4/0x5d0 [ 7467.141593][ C1] ? __pfx_tc_run+0x10/0x10 [ 7467.141598][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7467.141603][ C1] ? irqentry_enter+0x2b/0x60 [ 7467.141607][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7467.141610][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7467.141617][ C1] ip_finish_output2+0x786/0x18e0 [ 7467.141622][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7467.141625][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7467.141629][ C1] ? __ip_finish_output+0x10f/0x770 [ 7467.141633][ C1] ip_output+0x16b/0x4f0 [ 7467.141636][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7467.141640][ C1] ? __pfx_ip_output+0x10/0x10 [ 7467.141644][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7467.141651][ C1] ? __pfx_ip_output+0x10/0x10 [ 7467.141656][ C1] __ip_queue_xmit+0x672/0x1910 [ 7467.141661][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7467.141668][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7467.141672][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7467.141676][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7467.141680][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7467.141683][ C1] tcp_delack_timer+0x84/0x240 [ 7467.141687][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7467.141689][ C1] call_timer_fn+0x176/0x430 [ 7467.141694][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7467.141699][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7467.141703][ C1] __run_timers.part.0+0x52d/0x890 [ 7467.141706][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7467.141711][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7467.141715][ C1] ? __pfx___schedule+0x10/0x10 [ 7467.141719][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7467.141724][ C1] run_timer_softirq+0x72/0x100 [ 7467.141727][ C1] __do_softirq+0x1bc/0x7ff [ 7467.141731][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7467.141735][ C1] run_ksoftirqd+0x2e/0x60 [ 7467.141738][ C1] smpboot_thread_fn+0x30e/0x840 [ 7467.141742][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7467.141746][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7467.141749][ C1] kthread+0x292/0x360 [ 7467.141752][ C1] ? __pfx_kthread+0x10/0x10 [ 7467.141754][ C1] ret_from_fork+0x34/0x70 [ 7467.141757][ C1] ? __pfx_kthread+0x10/0x10 [ 7467.141760][ C1] ret_from_fork_asm+0x1b/0x30 [ 7467.141768][ C1] [ 7492.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5871s! [swapper/0:0] [ 7492.527930][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7492.529142][ C0] irq event stamp: 27567077 [ 7492.529385][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7492.529917][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7492.530397][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7492.530908][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7492.531409][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7492.531897][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7492.532541][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7492.532882][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7492.533900][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7492.534224][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7492.534643][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7492.535064][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7492.535482][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7492.535900][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7492.536319][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7492.536790][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7492.537143][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7492.537565][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7492.537991][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7492.538420][ C0] Call Trace: [ 7492.538601][ C0] [ 7492.538760][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7492.539036][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7492.539296][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7492.539589][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7492.539879][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7492.540184][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7492.540473][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7492.540792][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7492.541070][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7492.541347][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7492.541673][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7492.541988][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7492.542321][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7492.542627][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7492.542946][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7492.543250][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7492.543576][ C0] ? get_stack_info+0x36/0xc0 [ 7492.543832][ C0] ? lock_acquire+0x1c1/0x220 [ 7492.544087][ C0] ? lock_release+0x1d5/0x250 [ 7492.544343][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7492.544604][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7492.544891][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7492.545194][ C0] ? lock_acquire+0x1c1/0x220 [ 7492.545443][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7492.545697][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7492.545969][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7492.546220][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7492.546481][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7492.546754][ C0] ? __inet_lookup_established+0x341/0x610 [ 7492.547071][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7492.547358][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7492.547646][ C0] ip_local_deliver+0x19d/0x480 [ 7492.547908][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7492.548196][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7492.548467][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7492.548744][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7492.549007][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7492.549346][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7492.549619][ C0] ip_rcv+0x564/0x740 [ 7492.549833][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7492.550076][ C0] ? set_track_prepare+0x8a/0xd0 [ 7492.550346][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7492.550635][ C0] ? rest_init+0x153/0x260 [ 7492.550874][ C0] ? skb_clone+0x10b/0x330 [ 7492.551116][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7492.551453][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7492.551777][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7492.552073][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7492.552381][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7492.552640][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7492.552886][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7492.553199][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7492.553496][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7492.553841][ C0] ? lock_acquire+0x1c1/0x220 [ 7492.554100][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7492.554410][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7492.554706][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7492.555040][ C0] ? __copy_skb_header+0xaf/0x490 [ 7492.555312][ C0] ? __skb_clone+0x57a/0x760 [ 7492.555561][ C0] netif_receive_skb+0x55/0x280 [ 7492.555819][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7492.556148][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7492.556494][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7492.556811][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7492.557103][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7492.557402][ C0] ? hlock_class+0x4e/0x130 [ 7492.557648][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7492.557975][ C0] ? place_entity+0x21/0x2f0 [ 7492.558220][ C0] ? resched_curr+0x219/0x280 [ 7492.558474][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7492.558746][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7492.559033][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7492.559310][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7492.559572][ C0] ? activate_task+0xf5/0x260 [ 7492.559824][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7492.560100][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7492.560382][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7492.560645][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7492.560938][ C0] ? get_stack_info+0x36/0xc0 [ 7492.561188][ C0] ? stack_access_ok+0xda/0x1f0 [ 7492.561444][ C0] ? get_reg+0x119/0x190 [ 7492.561670][ C0] __tcf_classify+0x32c/0x7d0 [ 7492.561925][ C0] tcf_classify+0x283/0x930 [ 7492.562172][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7492.562504][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7492.562771][ C0] ? arch_stack_walk+0x8c/0x100 [ 7492.563030][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7492.563319][ C0] tc_run+0x2e4/0x5d0 [ 7492.563542][ C0] ? __pfx_tc_run+0x10/0x10 [ 7492.563789][ C0] ? lock_acquire+0x1c1/0x220 [ 7492.564044][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7492.564323][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7492.564589][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7492.564883][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7492.565165][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7492.565489][ C0] ? neigh_hh_output+0x348/0x590 [ 7492.565752][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7492.566033][ C0] ip_finish_output2+0x786/0x18e0 [ 7492.566303][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7492.566599][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7492.566953][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7492.567242][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7492.567510][ C0] ? __ip_finish_output+0x10f/0x770 [ 7492.567787][ C0] ip_output+0x16b/0x4f0 [ 7492.568014][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7492.568300][ C0] ? __pfx_ip_output+0x10/0x10 [ 7492.568554][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7492.568855][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7492.569119][ C0] ? ip_local_out+0x114/0x3b0 [ 7492.569375][ C0] __ip_queue_xmit+0x672/0x1910 [ 7492.569639][ C0] ? __skb_clone+0x57a/0x760 [ 7492.569888][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7492.570172][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7492.570474][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7492.570796][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7492.571055][ C0] ? tcp_current_mss+0x40a/0x510 [ 7492.571323][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7492.571605][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7492.571884][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7492.572143][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7492.572411][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7492.572732][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7492.573012][ C0] ? ktime_get+0xb6/0x190 [ 7492.573249][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7492.573526][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7492.573808][ C0] tcp_write_timer+0x82/0x1d0 [ 7492.574065][ C0] call_timer_fn+0x176/0x430 [ 7492.574317][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7492.574590][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7492.574867][ C0] __run_timers.part.0+0x52d/0x890 [ 7492.575141][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7492.575427][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7492.575727][ C0] ? lock_acquire+0x1c1/0x220 [ 7492.575986][ C0] ? clockevents_program_event+0xf6/0x300 [ 7492.576297][ C0] ? lock_release+0x1d5/0x250 [ 7492.576549][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7492.576827][ C0] ? ktime_get+0xb6/0x190 [ 7492.577060][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7492.577365][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7492.577675][ C0] run_timer_softirq+0x72/0x100 [ 7492.577940][ C0] __do_softirq+0x1bc/0x7ff [ 7492.578188][ C0] irq_exit_rcu+0x98/0xc0 [ 7492.578424][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7492.578725][ C0] [ 7492.578882][ C0] [ 7492.579039][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7492.579358][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7492.579632][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7492.580664][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7492.580984][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7492.581404][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7492.581821][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7492.582238][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7492.582654][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7492.583074][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7492.583376][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7492.583649][ C0] default_idle_call+0x69/0xa0 [ 7492.583905][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7492.584168][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7492.584461][ C0] ? lock_release+0x1d5/0x250 [ 7492.584708][ C0] do_idle+0xfb/0x160 [ 7492.584921][ C0] cpu_startup_entry+0x55/0x60 [ 7492.585183][ C0] rest_init+0x153/0x260 [ 7492.585409][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7492.585695][ C0] arch_call_rest_init+0x13/0x40 [ 7492.585964][ C0] start_kernel+0x314/0x3d0 [ 7492.586212][ C0] x86_64_start_reservations+0x18/0x30 [ 7492.586507][ C0] x86_64_start_kernel+0xba/0x110 [ 7492.586774][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7492.587107][ C0] [ 7492.587271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5871s! [ksoftirqd/1:22] [ 7492.587750][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7492.588958][ C1] irq event stamp: 3886976 [ 7492.589198][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7492.589698][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7492.590194][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7492.590703][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7492.591194][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7492.591694][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7492.592342][ C1] RIP: 0010:kasan_check_range+0x158/0x1c0 [ 7492.592655][ C1] Code: 11 80 38 00 74 ef 4d 8d 1c 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 <48> 83 c0 01 48 39 d0 74 a5 80 38 00 74 f2 e9 74 ff ff ff b8 01 00 [ 7492.593687][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000246 [ 7492.594012][ C1] RAX: ffffed10014131c3 RBX: ffffed10014131c4 RCX: ffffffff90c7aaa0 [ 7492.594438][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7492.594861][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: ffffed10014131c3 [ 7492.595283][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7492.595705][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7492.596131][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7492.596603][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7492.596952][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7492.597380][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7492.597800][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7492.598218][ C1] Call Trace: [ 7492.598393][ C1] [ 7492.598549][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7492.598829][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7492.599085][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7492.599380][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7492.599665][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7492.599968][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7492.600247][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7492.600574][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7492.600851][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7492.601179][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7492.601498][ C1] [ 7492.601654][ C1] [ 7492.601811][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7492.602143][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7492.602452][ C1] ? kasan_check_range+0x158/0x1c0 [ 7492.602730][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 7492.603026][ C1] ? run_ksoftirqd+0xb/0x60 [ 7492.603272][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7492.603598][ C1] ? __orc_find+0x9c/0xf0 [ 7492.603835][ C1] ? lock_acquire+0x1c1/0x220 [ 7492.604090][ C1] ? irqentry_enter+0x2b/0x60 [ 7492.604345][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7492.604610][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7492.604902][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7492.605207][ C1] ? lock_acquire+0x1c1/0x220 [ 7492.605458][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7492.605714][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7492.605988][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7492.606239][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7492.606502][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7492.606778][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7492.607076][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7492.607370][ C1] ip_local_deliver+0x19d/0x480 [ 7492.607627][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7492.607910][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7492.608175][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7492.608457][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7492.608725][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7492.609066][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7492.609344][ C1] ip_rcv+0x564/0x740 [ 7492.609565][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7492.609811][ C1] ? set_track_prepare+0x8a/0xd0 [ 7492.610081][ C1] ? irqentry_enter+0x2b/0x60 [ 7492.610339][ C1] ? irqentry_enter+0x2b/0x60 [ 7492.610596][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7492.610845][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7492.611166][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7492.611512][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7492.611828][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7492.612170][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7492.612469][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7492.612806][ C1] netif_receive_skb+0x55/0x280 [ 7492.613070][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7492.613402][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7492.613756][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7492.614070][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7492.614364][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7492.614671][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7492.615004][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7492.615289][ C1] ? arch_stack_walk+0x68/0x100 [ 7492.615554][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7492.615831][ C1] ? irqentry_enter+0x2b/0x60 [ 7492.616084][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7492.616404][ C1] ? irqentry_enter+0x2b/0x60 [ 7492.616661][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7492.616988][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7492.617276][ C1] ? arch_stack_walk+0x68/0x100 [ 7492.617540][ C1] __tcf_classify+0x32c/0x7d0 [ 7492.617795][ C1] tcf_classify+0x283/0x930 [ 7492.618042][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7492.618315][ C1] tc_run+0x2e4/0x5d0 [ 7492.618539][ C1] ? __pfx_tc_run+0x10/0x10 [ 7492.618787][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7492.619060][ C1] ? irqentry_enter+0x2b/0x60 [ 7492.619312][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7492.619599][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7492.619922][ C1] ip_finish_output2+0x786/0x18e0 [ 7492.620199][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7492.620496][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7492.620764][ C1] ? __ip_finish_output+0x10f/0x770 [ 7492.621041][ C1] ip_output+0x16b/0x4f0 [ 7492.621269][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7492.621589][ C1] ? __pfx_ip_output+0x10/0x10 [ 7492.621844][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7492.622202][ C1] ? __pfx_ip_output+0x10/0x10 [ 7492.622461][ C1] __ip_queue_xmit+0x672/0x1910 [ 7492.622721][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7492.623001][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7492.623296][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7492.623581][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7492.623876][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7492.624163][ C1] tcp_delack_timer+0x84/0x240 [ 7492.624420][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7492.624710][ C1] call_timer_fn+0x176/0x430 [ 7492.624962][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7492.625237][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7492.625518][ C1] __run_timers.part.0+0x52d/0x890 [ 7492.625794][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7492.626082][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7492.626384][ C1] ? __pfx___schedule+0x10/0x10 [ 7492.626645][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7492.626970][ C1] run_timer_softirq+0x72/0x100 [ 7492.627231][ C1] __do_softirq+0x1bc/0x7ff [ 7492.627473][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7492.627747][ C1] run_ksoftirqd+0x2e/0x60 [ 7492.627989][ C1] smpboot_thread_fn+0x30e/0x840 [ 7492.628254][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7492.628550][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7492.628842][ C1] kthread+0x292/0x360 [ 7492.629065][ C1] ? __pfx_kthread+0x10/0x10 [ 7492.629310][ C1] ret_from_fork+0x34/0x70 [ 7492.629552][ C1] ? __pfx_kthread+0x10/0x10 [ 7492.629797][ C1] ret_from_fork_asm+0x1b/0x30 [ 7492.630063][ C1] [ 7520.527459][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5898s! [swapper/0:0] [ 7520.527925][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7520.529119][ C0] irq event stamp: 27567077 [ 7520.529356][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7520.529882][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7520.530366][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7520.530864][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7520.531356][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7520.531832][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7520.532486][ C0] RIP: 0010:kasan_check_range+0x84/0x1c0 [ 7520.532790][ C0] Code: 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 89 da 48 29 ea <48> 83 fa 10 0f 8e c0 00 00 00 41 89 eb 41 83 e3 07 75 7d 48 85 d2 [ 7520.533804][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000202 [ 7520.534128][ C0] RAX: ffffed100141336b RBX: ffffed100141336c RCX: ffffffff90c7aaa0 [ 7520.534545][ C0] RDX: 0000000000000001 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7520.534962][ C0] RBP: ffffed100141336b R08: 0000000000000000 R09: ffffed100141336b [ 7520.535383][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7520.535800][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7520.536218][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7520.536685][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7520.537038][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7520.537456][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7520.537878][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7520.538304][ C0] Call Trace: [ 7520.538491][ C0] [ 7520.538648][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7520.538922][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7520.539176][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7520.539464][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7520.539752][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7520.540058][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7520.540348][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7520.540665][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7520.540940][ C0] ? hrtimer_interrupt+0x31a/0x770 [ 7520.541212][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7520.541491][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7520.541817][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7520.542126][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7520.542461][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7520.542767][ C0] ? kasan_check_range+0x84/0x1c0 [ 7520.543035][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 7520.543327][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7520.543649][ C0] ? get_stack_info+0x36/0xc0 [ 7520.543902][ C0] ? lock_acquire+0x1c1/0x220 [ 7520.544156][ C0] ? lock_release+0x1d5/0x250 [ 7520.544407][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7520.544670][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7520.544960][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7520.545264][ C0] ? lock_acquire+0x1c1/0x220 [ 7520.545513][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7520.545766][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7520.546042][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7520.546291][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7520.546556][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7520.546830][ C0] ? __inet_lookup_established+0x341/0x610 [ 7520.547148][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7520.547436][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7520.547723][ C0] ip_local_deliver+0x19d/0x480 [ 7520.547993][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7520.548285][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7520.548554][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7520.548830][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7520.549094][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7520.549433][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7520.549707][ C0] ip_rcv+0x564/0x740 [ 7520.549919][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7520.550160][ C0] ? set_track_prepare+0x8a/0xd0 [ 7520.550434][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7520.550721][ C0] ? rest_init+0x153/0x260 [ 7520.550961][ C0] ? skb_clone+0x10b/0x330 [ 7520.551202][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7520.551542][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7520.551865][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7520.552159][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7520.552467][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7520.552726][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7520.552966][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7520.553284][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7520.553582][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7520.553925][ C0] ? lock_acquire+0x1c1/0x220 [ 7520.554178][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7520.554491][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7520.554790][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7520.555125][ C0] ? __copy_skb_header+0xaf/0x490 [ 7520.555394][ C0] ? __skb_clone+0x57a/0x760 [ 7520.555647][ C0] netif_receive_skb+0x55/0x280 [ 7520.555902][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7520.556225][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7520.556571][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7520.556886][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7520.557174][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7520.557472][ C0] ? hlock_class+0x4e/0x130 [ 7520.557717][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7520.558046][ C0] ? place_entity+0x21/0x2f0 [ 7520.558292][ C0] ? resched_curr+0x219/0x280 [ 7520.558548][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7520.558820][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7520.559105][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7520.559382][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7520.559640][ C0] ? activate_task+0xf5/0x260 [ 7520.559891][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7520.560172][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7520.560445][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7520.560708][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7520.560999][ C0] ? get_stack_info+0x36/0xc0 [ 7520.561250][ C0] ? stack_access_ok+0xda/0x1f0 [ 7520.561507][ C0] ? get_reg+0x119/0x190 [ 7520.561732][ C0] __tcf_classify+0x32c/0x7d0 [ 7520.561987][ C0] tcf_classify+0x283/0x930 [ 7520.562232][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7520.562564][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7520.562829][ C0] ? arch_stack_walk+0x8c/0x100 [ 7520.563090][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7520.563381][ C0] tc_run+0x2e4/0x5d0 [ 7520.563600][ C0] ? __pfx_tc_run+0x10/0x10 [ 7520.563847][ C0] ? lock_acquire+0x1c1/0x220 [ 7520.564102][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7520.564377][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7520.564643][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7520.564932][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7520.565212][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7520.565533][ C0] ? neigh_hh_output+0x348/0x590 [ 7520.565795][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7520.566076][ C0] ip_finish_output2+0x786/0x18e0 [ 7520.566347][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7520.566641][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7520.566991][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7520.567279][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7520.567547][ C0] ? __ip_finish_output+0x10f/0x770 [ 7520.567824][ C0] ip_output+0x16b/0x4f0 [ 7520.568051][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7520.568337][ C0] ? __pfx_ip_output+0x10/0x10 [ 7520.568589][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7520.568892][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7520.569156][ C0] ? ip_local_out+0x114/0x3b0 [ 7520.569409][ C0] __ip_queue_xmit+0x672/0x1910 [ 7520.569671][ C0] ? __skb_clone+0x57a/0x760 [ 7520.569919][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7520.570211][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7520.570508][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7520.570830][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7520.571088][ C0] ? tcp_current_mss+0x40a/0x510 [ 7520.571353][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7520.571631][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7520.571909][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7520.572168][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7520.572433][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7520.572753][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7520.573033][ C0] ? ktime_get+0xb6/0x190 [ 7520.573266][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7520.573541][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7520.573819][ C0] tcp_write_timer+0x82/0x1d0 [ 7520.574075][ C0] call_timer_fn+0x176/0x430 [ 7520.574323][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7520.574597][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7520.574872][ C0] __run_timers.part.0+0x52d/0x890 [ 7520.575144][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7520.575429][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7520.575735][ C0] ? lock_acquire+0x1c1/0x220 [ 7520.576001][ C0] ? clockevents_program_event+0xf6/0x300 [ 7520.576309][ C0] ? lock_release+0x1d5/0x250 [ 7520.576561][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7520.576838][ C0] ? ktime_get+0xb6/0x190 [ 7520.577073][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7520.577370][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7520.577677][ C0] run_timer_softirq+0x72/0x100 [ 7520.577939][ C0] __do_softirq+0x1bc/0x7ff [ 7520.578185][ C0] irq_exit_rcu+0x98/0xc0 [ 7520.578416][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7520.578717][ C0] [ 7520.578873][ C0] [ 7520.579035][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7520.579352][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7520.579623][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7520.580641][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7520.580961][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7520.581377][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7520.581791][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7520.582207][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7520.582623][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7520.583045][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7520.583344][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7520.583614][ C0] default_idle_call+0x69/0xa0 [ 7520.583868][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7520.584129][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7520.584424][ C0] ? lock_release+0x1d5/0x250 [ 7520.584673][ C0] do_idle+0xfb/0x160 [ 7520.584887][ C0] cpu_startup_entry+0x55/0x60 [ 7520.585141][ C0] rest_init+0x153/0x260 [ 7520.585368][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7520.585655][ C0] arch_call_rest_init+0x13/0x40 [ 7520.585926][ C0] start_kernel+0x314/0x3d0 [ 7520.586173][ C0] x86_64_start_reservations+0x18/0x30 [ 7520.586466][ C0] x86_64_start_kernel+0xba/0x110 [ 7520.586732][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7520.587056][ C0] [ 7520.587220][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5898s! [ksoftirqd/1:22] [ 7520.587699][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7520.588892][ C1] irq event stamp: 3886976 [ 7520.589128][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7520.589634][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7520.590136][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7520.590691][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7520.591187][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7520.591679][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7520.592322][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7520.592662][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7520.593677][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7520.594000][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7520.594417][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7520.594837][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7520.595258][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7520.595676][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7520.596095][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7520.596563][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7520.596917][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7520.597338][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7520.597760][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7520.598187][ C1] Call Trace: [ 7520.598373][ C1] [ 7520.598531][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7520.598807][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7520.599064][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7520.599354][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7520.599646][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7520.599953][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7520.600243][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7520.600562][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7520.600839][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7520.601164][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7520.601473][ C1] [ 7520.601631][ C1] [ 7520.601791][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7520.602125][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7520.602427][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7520.602739][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7520.603045][ C1] ? run_ksoftirqd+0xb/0x60 [ 7520.603291][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7520.603623][ C1] ? __orc_find+0x9c/0xf0 [ 7520.603852][ C1] ? lock_acquire+0x1c1/0x220 [ 7520.604105][ C1] ? irqentry_enter+0x2b/0x60 [ 7520.604357][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7520.604617][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7520.604905][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7520.605204][ C1] ? lock_acquire+0x1c1/0x220 [ 7520.605455][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7520.605710][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7520.605986][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7520.606233][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7520.606492][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7520.606762][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7520.607049][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7520.607338][ C1] ip_local_deliver+0x19d/0x480 [ 7520.607604][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7520.607894][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7520.608166][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7520.608443][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7520.608707][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7520.609045][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7520.609320][ C1] ip_rcv+0x564/0x740 [ 7520.609532][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7520.609772][ C1] ? set_track_prepare+0x8a/0xd0 [ 7520.610037][ C1] ? irqentry_enter+0x2b/0x60 [ 7520.610319][ C1] ? irqentry_enter+0x2b/0x60 [ 7520.610569][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7520.610809][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7520.611122][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7520.611460][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7520.611768][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7520.612112][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7520.612415][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7520.612747][ C1] netif_receive_skb+0x55/0x280 [ 7520.613006][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7520.613333][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7520.613680][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7520.613996][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7520.614284][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7520.614591][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7520.614918][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7520.615197][ C1] ? arch_stack_walk+0x68/0x100 [ 7520.615460][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7520.615741][ C1] ? irqentry_enter+0x2b/0x60 [ 7520.615993][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7520.616318][ C1] ? irqentry_enter+0x2b/0x60 [ 7520.616570][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7520.616892][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7520.617179][ C1] ? arch_stack_walk+0x68/0x100 [ 7520.617438][ C1] __tcf_classify+0x32c/0x7d0 [ 7520.617691][ C1] tcf_classify+0x283/0x930 [ 7520.617932][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7520.618201][ C1] tc_run+0x2e4/0x5d0 [ 7520.618416][ C1] ? __pfx_tc_run+0x10/0x10 [ 7520.618659][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7520.618927][ C1] ? irqentry_enter+0x2b/0x60 [ 7520.619180][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7520.619468][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7520.619795][ C1] ip_finish_output2+0x786/0x18e0 [ 7520.620066][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7520.620390][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7520.620655][ C1] ? __ip_finish_output+0x10f/0x770 [ 7520.620935][ C1] ip_output+0x16b/0x4f0 [ 7520.621169][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7520.621490][ C1] ? __pfx_ip_output+0x10/0x10 [ 7520.621750][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7520.622101][ C1] ? __pfx_ip_output+0x10/0x10 [ 7520.622356][ C1] __ip_queue_xmit+0x672/0x1910 [ 7520.622625][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7520.622909][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7520.623212][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7520.623502][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7520.623801][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7520.624090][ C1] tcp_delack_timer+0x84/0x240 [ 7520.624348][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7520.624632][ C1] call_timer_fn+0x176/0x430 [ 7520.624879][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7520.625156][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7520.625433][ C1] __run_timers.part.0+0x52d/0x890 [ 7520.625704][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7520.625994][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7520.626296][ C1] ? __pfx___schedule+0x10/0x10 [ 7520.626554][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7520.626872][ C1] run_timer_softirq+0x72/0x100 [ 7520.627136][ C1] __do_softirq+0x1bc/0x7ff [ 7520.627382][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7520.627658][ C1] run_ksoftirqd+0x2e/0x60 [ 7520.627897][ C1] smpboot_thread_fn+0x30e/0x840 [ 7520.628167][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7520.628458][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7520.628750][ C1] kthread+0x292/0x360 [ 7520.628967][ C1] ? __pfx_kthread+0x10/0x10 [ 7520.629217][ C1] ret_from_fork+0x34/0x70 [ 7520.629454][ C1] ? __pfx_kthread+0x10/0x10 [ 7520.629702][ C1] ret_from_fork_asm+0x1b/0x30 [ 7520.629962][ C1] [ 7545.145024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7545.145411][ C0] rcu: 0-....: (6341326 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1496103 [ 7545.145937][ C0] rcu: (t=6350836 jiffies g=1007429 q=31 ncpus=4) [ 7545.146287][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7545.146767][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7545.147422][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7545.147770][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7545.148795][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7545.149128][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7545.149551][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7545.149972][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7545.150399][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7545.150822][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7545.151239][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7545.151705][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7545.152061][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7545.152481][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7545.152900][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7545.153322][ C0] Call Trace: [ 7545.153504][ C0] [ 7545.153661][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7545.153945][ C0] ? print_cpu_stall+0x263/0x6a0 [ 7545.154211][ C0] ? check_cpu_stall+0x284/0x500 [ 7545.154474][ C0] ? rcu_pending+0x92/0x360 [ 7545.154719][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7545.155003][ C0] ? update_process_times+0xb9/0x110 [ 7545.155287][ C0] ? tick_sched_handle+0x67/0x130 [ 7545.155560][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7545.155858][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7545.156117][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7545.156435][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7545.156708][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7545.157021][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7545.157299][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7545.157616][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7545.157891][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7545.158168][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7545.158493][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7545.158807][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7545.159135][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7545.159441][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7545.159752][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7545.160058][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7545.160385][ C0] ? get_stack_info+0x36/0xc0 [ 7545.160639][ C0] ? lock_acquire+0x1c1/0x220 [ 7545.160891][ C0] ? lock_release+0x1d5/0x250 [ 7545.161146][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7545.161405][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7545.161689][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7545.161985][ C0] ? lock_acquire+0x1c1/0x220 [ 7545.162236][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7545.162490][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7545.162765][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7545.163011][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7545.163269][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7545.163536][ C0] ? __inet_lookup_established+0x341/0x610 [ 7545.163848][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7545.164142][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7545.164435][ C0] ip_local_deliver+0x19d/0x480 [ 7545.164693][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7545.164974][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7545.165236][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7545.165515][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7545.165785][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7545.166120][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7545.166396][ C0] ip_rcv+0x564/0x740 [ 7545.166611][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7545.166855][ C0] ? set_track_prepare+0x8a/0xd0 [ 7545.167122][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7545.167410][ C0] ? rest_init+0x153/0x260 [ 7545.167648][ C0] ? skb_clone+0x10b/0x330 [ 7545.167885][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7545.168222][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7545.168544][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7545.168837][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7545.169147][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7545.169404][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7545.169642][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7545.169951][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7545.170256][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7545.170593][ C0] ? lock_acquire+0x1c1/0x220 [ 7545.170843][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7545.171152][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7545.171452][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7545.171781][ C0] ? __copy_skb_header+0xaf/0x490 [ 7545.172047][ C0] ? __skb_clone+0x57a/0x760 [ 7545.172290][ C0] netif_receive_skb+0x55/0x280 [ 7545.172553][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7545.172880][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7545.173231][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7545.173540][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7545.173828][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7545.174130][ C0] ? hlock_class+0x4e/0x130 [ 7545.174377][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7545.174708][ C0] ? place_entity+0x21/0x2f0 [ 7545.174956][ C0] ? resched_curr+0x219/0x280 [ 7545.175208][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7545.175472][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7545.175750][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7545.176030][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7545.176288][ C0] ? activate_task+0xf5/0x260 [ 7545.176540][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7545.176816][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7545.177088][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7545.177351][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7545.177643][ C0] ? get_stack_info+0x36/0xc0 [ 7545.177893][ C0] ? stack_access_ok+0xda/0x1f0 [ 7545.178151][ C0] ? get_reg+0x119/0x190 [ 7545.178378][ C0] __tcf_classify+0x32c/0x7d0 [ 7545.178637][ C0] tcf_classify+0x283/0x930 [ 7545.178881][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7545.179209][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7545.179473][ C0] ? arch_stack_walk+0x8c/0x100 [ 7545.179733][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7545.180019][ C0] tc_run+0x2e4/0x5d0 [ 7545.180241][ C0] ? __pfx_tc_run+0x10/0x10 [ 7545.180481][ C0] ? lock_acquire+0x1c1/0x220 [ 7545.180727][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7545.181000][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7545.181269][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7545.181551][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7545.181831][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7545.182149][ C0] ? neigh_hh_output+0x348/0x590 [ 7545.182417][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7545.182693][ C0] ip_finish_output2+0x786/0x18e0 [ 7545.182959][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7545.183247][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7545.183604][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7545.183896][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7545.184159][ C0] ? __ip_finish_output+0x10f/0x770 [ 7545.184439][ C0] ip_output+0x16b/0x4f0 [ 7545.184665][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7545.184949][ C0] ? __pfx_ip_output+0x10/0x10 [ 7545.185212][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7545.185515][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7545.185779][ C0] ? ip_local_out+0x114/0x3b0 [ 7545.186028][ C0] __ip_queue_xmit+0x672/0x1910 [ 7545.186286][ C0] ? __skb_clone+0x57a/0x760 [ 7545.186532][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7545.186815][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7545.187115][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7545.187436][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7545.187690][ C0] ? tcp_current_mss+0x40a/0x510 [ 7545.187957][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7545.188238][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7545.188516][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7545.188771][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7545.189038][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7545.189354][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7545.189632][ C0] ? ktime_get+0xb6/0x190 [ 7545.189870][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7545.190152][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7545.190435][ C0] tcp_write_timer+0x82/0x1d0 [ 7545.190683][ C0] call_timer_fn+0x176/0x430 [ 7545.190927][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7545.191205][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7545.191478][ C0] __run_timers.part.0+0x52d/0x890 [ 7545.191753][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7545.192034][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7545.192337][ C0] ? lock_acquire+0x1c1/0x220 [ 7545.192582][ C0] ? clockevents_program_event+0xf6/0x300 [ 7545.192885][ C0] ? lock_release+0x1d5/0x250 [ 7545.193136][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7545.193412][ C0] ? ktime_get+0xb6/0x190 [ 7545.193641][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7545.193942][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7545.194255][ C0] run_timer_softirq+0x72/0x100 [ 7545.194511][ C0] __do_softirq+0x1bc/0x7ff [ 7545.194751][ C0] irq_exit_rcu+0x98/0xc0 [ 7545.194981][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7545.195279][ C0] [ 7545.195439][ C0] [ 7545.195599][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7545.195926][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7545.196194][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7545.197208][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7545.197528][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7545.197945][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7545.198362][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7545.198777][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7545.199195][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7545.199616][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7545.199915][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7545.200201][ C0] default_idle_call+0x69/0xa0 [ 7545.200452][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7545.200718][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7545.201008][ C0] ? lock_release+0x1d5/0x250 [ 7545.201262][ C0] do_idle+0xfb/0x160 [ 7545.201474][ C0] cpu_startup_entry+0x55/0x60 [ 7545.201728][ C0] rest_init+0x153/0x260 [ 7545.201952][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7545.202247][ C0] arch_call_rest_init+0x13/0x40 [ 7545.202515][ C0] start_kernel+0x314/0x3d0 [ 7545.202754][ C0] x86_64_start_reservations+0x18/0x30 [ 7545.203042][ C0] x86_64_start_kernel+0xba/0x110 [ 7545.203313][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7545.203643][ C0] [ 7545.203811][ C0] Sending NMI from CPU 0 to CPUs 1: [ 7545.204097][ C1] NMI backtrace for cpu 1 [ 7545.204107][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7545.204111][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7545.204114][ C1] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 7545.204126][ C1] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 7545.204129][ C1] RSP: 0018:ffffc9000019e9d8 EFLAGS: 00000202 [ 7545.204133][ C1] RAX: ffff88800a098e18 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7545.204135][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7545.204136][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7545.204138][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7545.204140][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7545.204142][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7545.204144][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7545.204147][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7545.204149][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7545.204151][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7545.204152][ C1] Call Trace: [ 7545.204155][ C1] [ 7545.204160][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 7545.204165][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7545.204170][ C1] ? nmi_handle+0x156/0x420 [ 7545.204175][ C1] ? default_do_nmi+0x41/0x100 [ 7545.204179][ C1] ? exc_nmi+0xf3/0x120 [ 7545.204182][ C1] ? end_repeat_nmi+0xf/0x60 [ 7545.204187][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7545.204192][ C1] ? kasan_check_range+0x12/0x1c0 [ 7545.204196][ C1] ? kasan_check_range+0x12/0x1c0 [ 7545.204199][ C1] ? kasan_check_range+0x12/0x1c0 [ 7545.204203][ C1] [ 7545.204204][ C1] [ 7545.204205][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 7545.204209][ C1] ? run_ksoftirqd+0xb/0x60 [ 7545.204214][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7545.204217][ C1] ? __orc_find+0x9c/0xf0 [ 7545.204220][ C1] ? lock_acquire+0x1c1/0x220 [ 7545.204224][ C1] ? irqentry_enter+0x2b/0x60 [ 7545.204229][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7545.204233][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7545.204236][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7545.204239][ C1] ? lock_acquire+0x1c1/0x220 [ 7545.204241][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7545.204247][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7545.204250][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7545.204257][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7545.204260][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7545.204266][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7545.204273][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7545.204277][ C1] ip_local_deliver+0x19d/0x480 [ 7545.204280][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7545.204283][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7545.204288][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7545.204292][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7545.204295][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7545.204298][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7545.204308][ C1] ip_rcv+0x564/0x740 [ 7545.204311][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7545.204314][ C1] ? set_track_prepare+0x8a/0xd0 [ 7545.204318][ C1] ? irqentry_enter+0x2b/0x60 [ 7545.204321][ C1] ? irqentry_enter+0x2b/0x60 [ 7545.204325][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7545.204328][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7545.204332][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7545.204335][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7545.204338][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7545.204341][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7545.204344][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7545.204349][ C1] netif_receive_skb+0x55/0x280 [ 7545.204352][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7545.204361][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7545.204369][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7545.204376][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7545.204382][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7545.204394][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7545.204404][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7545.204407][ C1] ? arch_stack_walk+0x68/0x100 [ 7545.204412][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7545.204415][ C1] ? irqentry_enter+0x2b/0x60 [ 7545.204419][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7545.204423][ C1] ? irqentry_enter+0x2b/0x60 [ 7545.204426][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7545.204434][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7545.204436][ C1] ? arch_stack_walk+0x68/0x100 [ 7545.204440][ C1] __tcf_classify+0x32c/0x7d0 [ 7545.204445][ C1] tcf_classify+0x283/0x930 [ 7545.204450][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7545.204454][ C1] tc_run+0x2e4/0x5d0 [ 7545.204459][ C1] ? __pfx_tc_run+0x10/0x10 [ 7545.204465][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7545.204470][ C1] ? irqentry_enter+0x2b/0x60 [ 7545.204473][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7545.204476][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7545.204483][ C1] ip_finish_output2+0x786/0x18e0 [ 7545.204489][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7545.204492][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7545.204496][ C1] ? __ip_finish_output+0x10f/0x770 [ 7545.204500][ C1] ip_output+0x16b/0x4f0 [ 7545.204503][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7545.204506][ C1] ? __pfx_ip_output+0x10/0x10 [ 7545.204511][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7545.204518][ C1] ? __pfx_ip_output+0x10/0x10 [ 7545.204522][ C1] __ip_queue_xmit+0x672/0x1910 [ 7545.204528][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7545.204534][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7545.204539][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7545.204542][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7545.204547][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7545.204549][ C1] tcp_delack_timer+0x84/0x240 [ 7545.204553][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7545.204556][ C1] call_timer_fn+0x176/0x430 [ 7545.204561][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7545.204566][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7545.204570][ C1] __run_timers.part.0+0x52d/0x890 [ 7545.204574][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7545.204579][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7545.204584][ C1] ? __pfx___schedule+0x10/0x10 [ 7545.204587][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7545.204592][ C1] run_timer_softirq+0x72/0x100 [ 7545.204596][ C1] __do_softirq+0x1bc/0x7ff [ 7545.204599][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7545.204603][ C1] run_ksoftirqd+0x2e/0x60 [ 7545.204606][ C1] smpboot_thread_fn+0x30e/0x840 [ 7545.204611][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7545.204614][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7545.204617][ C1] kthread+0x292/0x360 [ 7545.204620][ C1] ? __pfx_kthread+0x10/0x10 [ 7545.204622][ C1] ret_from_fork+0x34/0x70 [ 7545.204625][ C1] ? __pfx_kthread+0x10/0x10 [ 7545.204627][ C1] ret_from_fork_asm+0x1b/0x30 [ 7545.204635][ C1] [ 7572.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5946s! [swapper/0:0] [ 7572.527933][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7572.529137][ C0] irq event stamp: 27567077 [ 7572.529380][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7572.529917][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7572.530401][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7572.530913][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7572.531414][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7572.531899][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7572.532540][ C0] RIP: 0010:kasan_check_range+0x106/0x1c0 [ 7572.532848][ C0] Code: 00 74 f2 48 89 c2 b8 01 00 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff <5b> b8 01 00 00 00 5d 41 5c c3 cc cc cc cc 41 bc 08 00 00 00 45 29 [ 7572.533893][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000246 [ 7572.534213][ C0] RAX: ffffed100141336c RBX: ffffed100141336c RCX: ffffffff90c7aaa0 [ 7572.534630][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7572.535046][ C0] RBP: ffffed100141336b R08: 0000000000000000 R09: ffffed100141336b [ 7572.535462][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7572.535888][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7572.536317][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7572.536786][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7572.537139][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7572.537562][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7572.538012][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7572.538434][ C0] Call Trace: [ 7572.538613][ C0] [ 7572.538781][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7572.539062][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7572.539319][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7572.539612][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7572.539897][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7572.540208][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7572.540490][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7572.540816][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7572.541089][ C0] ? hrtimer_interrupt+0x31a/0x770 [ 7572.541364][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7572.541640][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7572.541991][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7572.542307][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7572.542637][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7572.542945][ C0] ? kasan_check_range+0x106/0x1c0 [ 7572.543227][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 7572.543513][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7572.543829][ C0] ? get_stack_info+0x36/0xc0 [ 7572.544100][ C0] ? lock_acquire+0x1c1/0x220 [ 7572.544356][ C0] ? lock_release+0x1d5/0x250 [ 7572.544611][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7572.544875][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7572.545163][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7572.545462][ C0] ? lock_acquire+0x1c1/0x220 [ 7572.545708][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7572.545983][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7572.546257][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7572.546507][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7572.546769][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7572.547042][ C0] ? __inet_lookup_established+0x341/0x610 [ 7572.547358][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7572.547674][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7572.547964][ C0] ip_local_deliver+0x19d/0x480 [ 7572.548225][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7572.548511][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7572.548780][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7572.549055][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7572.549318][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7572.549656][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7572.549937][ C0] ip_rcv+0x564/0x740 [ 7572.550155][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7572.550400][ C0] ? set_track_prepare+0x8a/0xd0 [ 7572.550667][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7572.550956][ C0] ? rest_init+0x153/0x260 [ 7572.551196][ C0] ? skb_clone+0x10b/0x330 [ 7572.551434][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7572.551771][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7572.552096][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7572.552395][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7572.552702][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7572.552960][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7572.553201][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7572.553513][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7572.553811][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7572.554155][ C0] ? lock_acquire+0x1c1/0x220 [ 7572.554408][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7572.554722][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7572.555018][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7572.555353][ C0] ? __copy_skb_header+0xaf/0x490 [ 7572.555625][ C0] ? __skb_clone+0x57a/0x760 [ 7572.555875][ C0] netif_receive_skb+0x55/0x280 [ 7572.556134][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7572.556461][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7572.556809][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7572.557126][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7572.557411][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7572.557709][ C0] ? hlock_class+0x4e/0x130 [ 7572.557953][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7572.558281][ C0] ? place_entity+0x21/0x2f0 [ 7572.558525][ C0] ? resched_curr+0x219/0x280 [ 7572.558780][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7572.559051][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7572.559336][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7572.559611][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7572.559866][ C0] ? activate_task+0xf5/0x260 [ 7572.560145][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7572.560423][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7572.560695][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7572.560959][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7572.561254][ C0] ? get_stack_info+0x36/0xc0 [ 7572.561509][ C0] ? stack_access_ok+0xda/0x1f0 [ 7572.561766][ C0] ? get_reg+0x119/0x190 [ 7572.561993][ C0] __tcf_classify+0x32c/0x7d0 [ 7572.562251][ C0] tcf_classify+0x283/0x930 [ 7572.562497][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7572.562827][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7572.563092][ C0] ? arch_stack_walk+0x8c/0x100 [ 7572.563351][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7572.563638][ C0] tc_run+0x2e4/0x5d0 [ 7572.563856][ C0] ? __pfx_tc_run+0x10/0x10 [ 7572.564101][ C0] ? lock_acquire+0x1c1/0x220 [ 7572.564352][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7572.564630][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7572.564895][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7572.565183][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7572.565463][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7572.565789][ C0] ? neigh_hh_output+0x348/0x590 [ 7572.566053][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7572.566333][ C0] ip_finish_output2+0x786/0x18e0 [ 7572.566603][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7572.566896][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7572.567246][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7572.567534][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7572.567799][ C0] ? __ip_finish_output+0x10f/0x770 [ 7572.568074][ C0] ip_output+0x16b/0x4f0 [ 7572.568300][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7572.568586][ C0] ? __pfx_ip_output+0x10/0x10 [ 7572.568846][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7572.569148][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7572.569410][ C0] ? ip_local_out+0x114/0x3b0 [ 7572.569665][ C0] __ip_queue_xmit+0x672/0x1910 [ 7572.569935][ C0] ? __skb_clone+0x57a/0x760 [ 7572.570182][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7572.570466][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7572.570763][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7572.571085][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7572.571338][ C0] ? tcp_current_mss+0x40a/0x510 [ 7572.571604][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7572.571883][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7572.572163][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7572.572417][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7572.572684][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7572.573000][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7572.573282][ C0] ? ktime_get+0xb6/0x190 [ 7572.573516][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7572.573791][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7572.574071][ C0] tcp_write_timer+0x82/0x1d0 [ 7572.574326][ C0] call_timer_fn+0x176/0x430 [ 7572.574574][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7572.574845][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7572.575122][ C0] __run_timers.part.0+0x52d/0x890 [ 7572.575393][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7572.575676][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7572.575976][ C0] ? lock_acquire+0x1c1/0x220 [ 7572.576231][ C0] ? clockevents_program_event+0xf6/0x300 [ 7572.576539][ C0] ? lock_release+0x1d5/0x250 [ 7572.576790][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7572.577070][ C0] ? ktime_get+0xb6/0x190 [ 7572.577311][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7572.577627][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7572.577935][ C0] run_timer_softirq+0x72/0x100 [ 7572.578197][ C0] __do_softirq+0x1bc/0x7ff [ 7572.578444][ C0] irq_exit_rcu+0x98/0xc0 [ 7572.578678][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7572.578977][ C0] [ 7572.579133][ C0] [ 7572.579289][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7572.579605][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7572.579876][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7572.580898][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7572.581218][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7572.581634][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7572.582051][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7572.582466][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7572.582881][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7572.583300][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7572.583601][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7572.583874][ C0] default_idle_call+0x69/0xa0 [ 7572.584132][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7572.584394][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7572.584686][ C0] ? lock_release+0x1d5/0x250 [ 7572.584934][ C0] do_idle+0xfb/0x160 [ 7572.585146][ C0] cpu_startup_entry+0x55/0x60 [ 7572.585398][ C0] rest_init+0x153/0x260 [ 7572.585627][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7572.585913][ C0] arch_call_rest_init+0x13/0x40 [ 7572.586178][ C0] start_kernel+0x314/0x3d0 [ 7572.586423][ C0] x86_64_start_reservations+0x18/0x30 [ 7572.586715][ C0] x86_64_start_kernel+0xba/0x110 [ 7572.586982][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7572.587312][ C0] [ 7572.587477][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5946s! [ksoftirqd/1:22] [ 7572.587961][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7572.589157][ C1] irq event stamp: 3886976 [ 7572.589396][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7572.589903][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7572.590412][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7572.590914][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7572.591409][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7572.591904][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7572.592548][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7572.592888][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7572.593909][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7572.594233][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7572.594652][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7572.595071][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7572.595489][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7572.595906][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7572.596325][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7572.596795][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7572.597148][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7572.597571][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7572.597998][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7572.598421][ C1] Call Trace: [ 7572.598601][ C1] [ 7572.598762][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7572.599039][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7572.599299][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7572.599590][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7572.599879][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7572.600190][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7572.600468][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7572.600793][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7572.601071][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7572.601392][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7572.601702][ C1] [ 7572.601863][ C1] [ 7572.602025][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7572.602359][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7572.602662][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7572.602971][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7572.603279][ C1] ? run_ksoftirqd+0xb/0x60 [ 7572.603527][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7572.603856][ C1] ? __orc_find+0x9c/0xf0 [ 7572.604087][ C1] ? lock_acquire+0x1c1/0x220 [ 7572.604338][ C1] ? irqentry_enter+0x2b/0x60 [ 7572.604588][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7572.604845][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7572.605129][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7572.605430][ C1] ? lock_acquire+0x1c1/0x220 [ 7572.605686][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7572.605946][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7572.606222][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7572.606467][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7572.606724][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7572.606995][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7572.607285][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7572.607577][ C1] ip_local_deliver+0x19d/0x480 [ 7572.607839][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7572.608127][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7572.608396][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7572.608673][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7572.608937][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7572.609276][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7572.609551][ C1] ip_rcv+0x564/0x740 [ 7572.609765][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7572.610013][ C1] ? set_track_prepare+0x8a/0xd0 [ 7572.610283][ C1] ? irqentry_enter+0x2b/0x60 [ 7572.610534][ C1] ? irqentry_enter+0x2b/0x60 [ 7572.610787][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7572.611028][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7572.611343][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7572.611683][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7572.611993][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7572.612339][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7572.612641][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7572.612975][ C1] netif_receive_skb+0x55/0x280 [ 7572.613233][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7572.613559][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7572.613910][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7572.614229][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7572.614519][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7572.614823][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7572.615155][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7572.615439][ C1] ? arch_stack_walk+0x68/0x100 [ 7572.615704][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7572.615985][ C1] ? irqentry_enter+0x2b/0x60 [ 7572.616243][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7572.616564][ C1] ? irqentry_enter+0x2b/0x60 [ 7572.616813][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7572.617134][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7572.617418][ C1] ? arch_stack_walk+0x68/0x100 [ 7572.617679][ C1] __tcf_classify+0x32c/0x7d0 [ 7572.617930][ C1] tcf_classify+0x283/0x930 [ 7572.618172][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7572.618441][ C1] tc_run+0x2e4/0x5d0 [ 7572.618657][ C1] ? __pfx_tc_run+0x10/0x10 [ 7572.618899][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7572.619167][ C1] ? irqentry_enter+0x2b/0x60 [ 7572.619424][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7572.619714][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7572.620041][ C1] ip_finish_output2+0x786/0x18e0 [ 7572.620318][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7572.620611][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7572.620877][ C1] ? __ip_finish_output+0x10f/0x770 [ 7572.621160][ C1] ip_output+0x16b/0x4f0 [ 7572.621389][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7572.621707][ C1] ? __pfx_ip_output+0x10/0x10 [ 7572.621965][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7572.622318][ C1] ? __pfx_ip_output+0x10/0x10 [ 7572.622575][ C1] __ip_queue_xmit+0x672/0x1910 [ 7572.622839][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7572.623123][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7572.623421][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7572.623710][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7572.624008][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7572.624299][ C1] tcp_delack_timer+0x84/0x240 [ 7572.624560][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7572.624847][ C1] call_timer_fn+0x176/0x430 [ 7572.625096][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7572.625375][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7572.625652][ C1] __run_timers.part.0+0x52d/0x890 [ 7572.625926][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7572.626220][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7572.626525][ C1] ? __pfx___schedule+0x10/0x10 [ 7572.626784][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7572.627107][ C1] run_timer_softirq+0x72/0x100 [ 7572.627370][ C1] __do_softirq+0x1bc/0x7ff [ 7572.627621][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7572.627897][ C1] run_ksoftirqd+0x2e/0x60 [ 7572.628135][ C1] smpboot_thread_fn+0x30e/0x840 [ 7572.628404][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7572.628694][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7572.628988][ C1] kthread+0x292/0x360 [ 7572.629208][ C1] ? __pfx_kthread+0x10/0x10 [ 7572.629457][ C1] ret_from_fork+0x34/0x70 [ 7572.629695][ C1] ? __pfx_kthread+0x10/0x10 [ 7572.629947][ C1] ret_from_fork_asm+0x1b/0x30 [ 7572.630210][ C1] [ 7600.527459][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 5972s! [swapper/0:0] [ 7600.527919][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7600.529086][ C0] irq event stamp: 27567077 [ 7600.529323][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7600.529862][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7600.530343][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7600.530850][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7600.531346][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7600.531813][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7600.532434][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 7600.532762][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 7600.533787][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7600.534105][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7600.534515][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7600.534930][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7600.535339][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7600.535768][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7600.536192][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7600.536666][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7600.537012][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7600.537435][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7600.537842][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7600.538251][ C0] Call Trace: [ 7600.538426][ C0] [ 7600.538577][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7600.538849][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7600.539097][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7600.539383][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7600.539661][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7600.539979][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7600.540261][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7600.540586][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7600.540857][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7600.541143][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7600.541457][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7600.541757][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7600.542084][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7600.542381][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 7600.542659][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7600.542982][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7600.543304][ C0] ? get_stack_info+0x36/0xc0 [ 7600.543562][ C0] ? lock_acquire+0x1c1/0x220 [ 7600.543816][ C0] ? lock_release+0x1d5/0x250 [ 7600.544069][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7600.544356][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7600.544637][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7600.544931][ C0] ? lock_acquire+0x1c1/0x220 [ 7600.545178][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7600.545427][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7600.545713][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7600.545960][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7600.546221][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7600.546498][ C0] ? __inet_lookup_established+0x341/0x610 [ 7600.546806][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7600.547087][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7600.547371][ C0] ip_local_deliver+0x19d/0x480 [ 7600.547628][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7600.547909][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7600.548170][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7600.548439][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7600.548694][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7600.549022][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7600.549290][ C0] ip_rcv+0x564/0x740 [ 7600.549496][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7600.549747][ C0] ? set_track_prepare+0x8a/0xd0 [ 7600.550019][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7600.550304][ C0] ? rest_init+0x153/0x260 [ 7600.550542][ C0] ? skb_clone+0x10b/0x330 [ 7600.550780][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7600.551116][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7600.551438][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7600.551729][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7600.552045][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7600.552295][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7600.552545][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7600.552856][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7600.553155][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7600.553497][ C0] ? lock_acquire+0x1c1/0x220 [ 7600.553758][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7600.554079][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7600.554376][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7600.554719][ C0] ? __copy_skb_header+0xaf/0x490 [ 7600.555003][ C0] ? __skb_clone+0x57a/0x760 [ 7600.555251][ C0] netif_receive_skb+0x55/0x280 [ 7600.555510][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7600.555825][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7600.556165][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7600.556472][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7600.556750][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7600.557061][ C0] ? hlock_class+0x4e/0x130 [ 7600.557302][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7600.557629][ C0] ? place_entity+0x21/0x2f0 [ 7600.557881][ C0] ? resched_curr+0x219/0x280 [ 7600.558129][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7600.558393][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7600.558669][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7600.558957][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7600.559226][ C0] ? activate_task+0xf5/0x260 [ 7600.559469][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7600.559736][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7600.560029][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7600.560289][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7600.560578][ C0] ? get_stack_info+0x36/0xc0 [ 7600.560824][ C0] ? stack_access_ok+0xda/0x1f0 [ 7600.561089][ C0] ? get_reg+0x119/0x190 [ 7600.561309][ C0] __tcf_classify+0x32c/0x7d0 [ 7600.561555][ C0] tcf_classify+0x283/0x930 [ 7600.561793][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7600.562135][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7600.562399][ C0] ? arch_stack_walk+0x8c/0x100 [ 7600.562659][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7600.562951][ C0] tc_run+0x2e4/0x5d0 [ 7600.563168][ C0] ? __pfx_tc_run+0x10/0x10 [ 7600.563414][ C0] ? lock_acquire+0x1c1/0x220 [ 7600.563667][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7600.563942][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7600.564214][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7600.564512][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7600.564790][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7600.565111][ C0] ? neigh_hh_output+0x348/0x590 [ 7600.565385][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7600.565657][ C0] ip_finish_output2+0x786/0x18e0 [ 7600.565921][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7600.566232][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7600.566581][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7600.566871][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7600.567138][ C0] ? __ip_finish_output+0x10f/0x770 [ 7600.567413][ C0] ip_output+0x16b/0x4f0 [ 7600.567638][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7600.567922][ C0] ? __pfx_ip_output+0x10/0x10 [ 7600.568182][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7600.568475][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7600.568730][ C0] ? ip_local_out+0x114/0x3b0 [ 7600.568975][ C0] __ip_queue_xmit+0x672/0x1910 [ 7600.569251][ C0] ? __skb_clone+0x57a/0x760 [ 7600.569498][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7600.569778][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7600.570080][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7600.570401][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7600.570657][ C0] ? tcp_current_mss+0x40a/0x510 [ 7600.570921][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7600.571199][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7600.571478][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7600.571734][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7600.571998][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7600.572314][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7600.572592][ C0] ? ktime_get+0xb6/0x190 [ 7600.572824][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7600.573101][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7600.573383][ C0] tcp_write_timer+0x82/0x1d0 [ 7600.573627][ C0] call_timer_fn+0x176/0x430 [ 7600.573867][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7600.574151][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7600.574425][ C0] __run_timers.part.0+0x52d/0x890 [ 7600.574695][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7600.574980][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7600.575279][ C0] ? lock_acquire+0x1c1/0x220 [ 7600.575530][ C0] ? clockevents_program_event+0xf6/0x300 [ 7600.575835][ C0] ? lock_release+0x1d5/0x250 [ 7600.576097][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7600.576368][ C0] ? ktime_get+0xb6/0x190 [ 7600.576595][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7600.576885][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7600.577187][ C0] run_timer_softirq+0x72/0x100 [ 7600.577441][ C0] __do_softirq+0x1bc/0x7ff [ 7600.577682][ C0] irq_exit_rcu+0x98/0xc0 [ 7600.577907][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7600.578224][ C0] [ 7600.578380][ C0] [ 7600.578536][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7600.578853][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7600.579124][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7600.580156][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7600.580477][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7600.580898][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7600.581315][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7600.581718][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7600.582172][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7600.582588][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7600.582898][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7600.583168][ C0] default_idle_call+0x69/0xa0 [ 7600.583430][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7600.583683][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7600.583971][ C0] ? lock_release+0x1d5/0x250 [ 7600.584240][ C0] do_idle+0xfb/0x160 [ 7600.584447][ C0] cpu_startup_entry+0x55/0x60 [ 7600.584693][ C0] rest_init+0x153/0x260 [ 7600.584914][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7600.585193][ C0] arch_call_rest_init+0x13/0x40 [ 7600.585450][ C0] start_kernel+0x314/0x3d0 [ 7600.585689][ C0] x86_64_start_reservations+0x18/0x30 [ 7600.585974][ C0] x86_64_start_kernel+0xba/0x110 [ 7600.586234][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7600.586549][ C0] [ 7600.586711][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5972s! [ksoftirqd/1:22] [ 7600.587200][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7600.588401][ C1] irq event stamp: 3886976 [ 7600.588641][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7600.589137][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7600.589630][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7600.590143][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7600.590636][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7600.591133][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7600.591789][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7600.592133][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7600.593159][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7600.593491][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7600.593914][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7600.594338][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7600.594766][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7600.595192][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7600.595613][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7600.596085][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7600.596433][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7600.596859][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7600.597278][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7600.597695][ C1] Call Trace: [ 7600.597874][ C1] [ 7600.598031][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7600.598312][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7600.598570][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7600.598862][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7600.599147][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7600.599447][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7600.599727][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7600.600056][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7600.600331][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7600.600658][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7600.600971][ C1] [ 7600.601129][ C1] [ 7600.601286][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7600.601617][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7600.601922][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7600.602239][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7600.602542][ C1] ? run_ksoftirqd+0xb/0x60 [ 7600.602785][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7600.603113][ C1] ? __orc_find+0x9c/0xf0 [ 7600.603345][ C1] ? lock_acquire+0x1c1/0x220 [ 7600.603601][ C1] ? irqentry_enter+0x2b/0x60 [ 7600.603858][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7600.604124][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7600.604414][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7600.604715][ C1] ? lock_acquire+0x1c1/0x220 [ 7600.604963][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7600.605216][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7600.605489][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7600.605738][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7600.606002][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7600.606276][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7600.606568][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7600.606861][ C1] ip_local_deliver+0x19d/0x480 [ 7600.607120][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7600.607404][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7600.607670][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7600.607953][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7600.608219][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7600.608556][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7600.608834][ C1] ip_rcv+0x564/0x740 [ 7600.609051][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7600.609297][ C1] ? set_track_prepare+0x8a/0xd0 [ 7600.609566][ C1] ? irqentry_enter+0x2b/0x60 [ 7600.609821][ C1] ? irqentry_enter+0x2b/0x60 [ 7600.610078][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7600.610324][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7600.610641][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7600.610986][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7600.611299][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7600.611639][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7600.611937][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7600.612276][ C1] netif_receive_skb+0x55/0x280 [ 7600.612541][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7600.612871][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7600.613224][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7600.613540][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7600.613831][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7600.614137][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7600.614469][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7600.614751][ C1] ? arch_stack_walk+0x68/0x100 [ 7600.615010][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7600.615287][ C1] ? irqentry_enter+0x2b/0x60 [ 7600.615537][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7600.615860][ C1] ? irqentry_enter+0x2b/0x60 [ 7600.616118][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7600.616441][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7600.616725][ C1] ? arch_stack_walk+0x68/0x100 [ 7600.616988][ C1] __tcf_classify+0x32c/0x7d0 [ 7600.617245][ C1] tcf_classify+0x283/0x930 [ 7600.617493][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7600.617768][ C1] tc_run+0x2e4/0x5d0 [ 7600.617987][ C1] ? __pfx_tc_run+0x10/0x10 [ 7600.618238][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7600.618507][ C1] ? irqentry_enter+0x2b/0x60 [ 7600.618759][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7600.619045][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7600.619370][ C1] ip_finish_output2+0x786/0x18e0 [ 7600.619644][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7600.619940][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7600.620208][ C1] ? __ip_finish_output+0x10f/0x770 [ 7600.620485][ C1] ip_output+0x16b/0x4f0 [ 7600.620712][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7600.621036][ C1] ? __pfx_ip_output+0x10/0x10 [ 7600.621295][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7600.621649][ C1] ? __pfx_ip_output+0x10/0x10 [ 7600.621911][ C1] __ip_queue_xmit+0x672/0x1910 [ 7600.622174][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7600.622454][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7600.622750][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7600.623037][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7600.623334][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7600.623624][ C1] tcp_delack_timer+0x84/0x240 [ 7600.623880][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7600.624169][ C1] call_timer_fn+0x176/0x430 [ 7600.624420][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7600.624694][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7600.624975][ C1] __run_timers.part.0+0x52d/0x890 [ 7600.625252][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7600.625539][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7600.625839][ C1] ? __pfx___schedule+0x10/0x10 [ 7600.626102][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7600.626425][ C1] run_timer_softirq+0x72/0x100 [ 7600.626682][ C1] __do_softirq+0x1bc/0x7ff [ 7600.626923][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7600.627198][ C1] run_ksoftirqd+0x2e/0x60 [ 7600.627438][ C1] smpboot_thread_fn+0x30e/0x840 [ 7600.627704][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7600.627997][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7600.628290][ C1] kthread+0x292/0x360 [ 7600.628508][ C1] ? __pfx_kthread+0x10/0x10 [ 7600.628751][ C1] ret_from_fork+0x34/0x70 [ 7600.628992][ C1] ? __pfx_kthread+0x10/0x10 [ 7600.629239][ C1] ret_from_fork_asm+0x1b/0x30 [ 7600.629503][ C1] [ 7623.208024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7623.208410][ C1] rcu: 1-....: (6409797 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1515032 [ 7623.209003][ C1] rcu: (t=6428899 jiffies g=1007429 q=31 ncpus=4) [ 7623.209353][ C1] Sending NMI from CPU 1 to CPUs 0: [ 7623.209638][ C0] NMI backtrace for cpu 0 [ 7623.209648][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7623.209652][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7623.209656][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7623.209666][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7623.209669][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7623.209673][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7623.209675][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7623.209677][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7623.209679][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7623.209680][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7623.209682][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7623.209689][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7623.209693][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7623.209695][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7623.209696][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7623.209698][ C0] Call Trace: [ 7623.209701][ C0] [ 7623.209705][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 7623.209711][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7623.209733][ C0] ? nmi_handle+0x156/0x420 [ 7623.209738][ C0] ? default_do_nmi+0x41/0x100 [ 7623.209743][ C0] ? exc_nmi+0xf3/0x120 [ 7623.209745][ C0] ? end_repeat_nmi+0xf/0x60 [ 7623.209750][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7623.209755][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7623.209758][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7623.209762][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7623.209766][ C0] [ 7623.209766][ C0] [ 7623.209768][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7623.209771][ C0] ? get_stack_info+0x36/0xc0 [ 7623.209776][ C0] ? lock_acquire+0x1c1/0x220 [ 7623.209781][ C0] ? lock_release+0x1d5/0x250 [ 7623.209785][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7623.209789][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7623.209792][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7623.209795][ C0] ? lock_acquire+0x1c1/0x220 [ 7623.209797][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7623.209803][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7623.209806][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7623.209814][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7623.209816][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7623.209821][ C0] ? __inet_lookup_established+0x341/0x610 [ 7623.209827][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7623.209835][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7623.209839][ C0] ip_local_deliver+0x19d/0x480 [ 7623.209842][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7623.209845][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7623.209850][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7623.209854][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7623.209857][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7623.209861][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7623.209872][ C0] ip_rcv+0x564/0x740 [ 7623.209876][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7623.209879][ C0] ? set_track_prepare+0x8a/0xd0 [ 7623.209884][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7623.209887][ C0] ? rest_init+0x153/0x260 [ 7623.209889][ C0] ? skb_clone+0x10b/0x330 [ 7623.209895][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7623.209901][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7623.209907][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7623.209912][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7623.209922][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7623.209925][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7623.209928][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7623.209932][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7623.209935][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7623.209939][ C0] ? lock_acquire+0x1c1/0x220 [ 7623.209941][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7623.209944][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7623.209947][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7623.209950][ C0] ? __copy_skb_header+0xaf/0x490 [ 7623.209953][ C0] ? __skb_clone+0x57a/0x760 [ 7623.209956][ C0] netif_receive_skb+0x55/0x280 [ 7623.209958][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7623.209967][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7623.209974][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7623.209981][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7623.209986][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7623.209995][ C0] ? hlock_class+0x4e/0x130 [ 7623.210000][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7623.210010][ C0] ? place_entity+0x21/0x2f0 [ 7623.210014][ C0] ? resched_curr+0x219/0x280 [ 7623.210018][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7623.210020][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7623.210024][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7623.210029][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7623.210031][ C0] ? activate_task+0xf5/0x260 [ 7623.210034][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7623.210041][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7623.210044][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7623.210048][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7623.210051][ C0] ? get_stack_info+0x36/0xc0 [ 7623.210055][ C0] ? stack_access_ok+0xda/0x1f0 [ 7623.210057][ C0] ? get_reg+0x119/0x190 [ 7623.210061][ C0] __tcf_classify+0x32c/0x7d0 [ 7623.210066][ C0] tcf_classify+0x283/0x930 [ 7623.210069][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7623.210074][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7623.210076][ C0] ? arch_stack_walk+0x8c/0x100 [ 7623.210081][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7623.210084][ C0] tc_run+0x2e4/0x5d0 [ 7623.210089][ C0] ? __pfx_tc_run+0x10/0x10 [ 7623.210092][ C0] ? lock_acquire+0x1c1/0x220 [ 7623.210094][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7623.210099][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7623.210105][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7623.210108][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7623.210111][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7623.210116][ C0] ? neigh_hh_output+0x348/0x590 [ 7623.210121][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7623.210125][ C0] ip_finish_output2+0x786/0x18e0 [ 7623.210128][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7623.210135][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7623.210142][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7623.210145][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7623.210149][ C0] ? __ip_finish_output+0x10f/0x770 [ 7623.210153][ C0] ip_output+0x16b/0x4f0 [ 7623.210156][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7623.210161][ C0] ? __pfx_ip_output+0x10/0x10 [ 7623.210165][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7623.210169][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7623.210172][ C0] ? ip_local_out+0x114/0x3b0 [ 7623.210176][ C0] __ip_queue_xmit+0x672/0x1910 [ 7623.210181][ C0] ? __skb_clone+0x57a/0x760 [ 7623.210184][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7623.210192][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7623.210197][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7623.210200][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7623.210205][ C0] ? tcp_current_mss+0x40a/0x510 [ 7623.210209][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7623.210212][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7623.210214][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7623.210216][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7623.210219][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7623.210223][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7623.210228][ C0] ? ktime_get+0xb6/0x190 [ 7623.210232][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7623.210236][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7623.210239][ C0] tcp_write_timer+0x82/0x1d0 [ 7623.210243][ C0] call_timer_fn+0x176/0x430 [ 7623.210247][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7623.210251][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7623.210256][ C0] __run_timers.part.0+0x52d/0x890 [ 7623.210259][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7623.210264][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7623.210266][ C0] ? lock_acquire+0x1c1/0x220 [ 7623.210269][ C0] ? clockevents_program_event+0xf6/0x300 [ 7623.210275][ C0] ? lock_release+0x1d5/0x250 [ 7623.210278][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7623.210281][ C0] ? ktime_get+0xb6/0x190 [ 7623.210284][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7623.210287][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7623.210292][ C0] run_timer_softirq+0x72/0x100 [ 7623.210295][ C0] __do_softirq+0x1bc/0x7ff [ 7623.210300][ C0] irq_exit_rcu+0x98/0xc0 [ 7623.210303][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7623.210308][ C0] [ 7623.210308][ C0] [ 7623.210310][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7623.210316][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7623.210319][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7623.210322][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7623.210324][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7623.210326][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7623.210328][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7623.210329][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7623.210331][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7623.210335][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7623.210338][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7623.210342][ C0] default_idle_call+0x69/0xa0 [ 7623.210344][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7623.210347][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7623.210352][ C0] ? lock_release+0x1d5/0x250 [ 7623.210356][ C0] do_idle+0xfb/0x160 [ 7623.210359][ C0] cpu_startup_entry+0x55/0x60 [ 7623.210361][ C0] rest_init+0x153/0x260 [ 7623.210364][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7623.210370][ C0] arch_call_rest_init+0x13/0x40 [ 7623.210375][ C0] start_kernel+0x314/0x3d0 [ 7623.210379][ C0] x86_64_start_reservations+0x18/0x30 [ 7623.210384][ C0] x86_64_start_kernel+0xba/0x110 [ 7623.210387][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7623.210396][ C0] [ 7623.210635][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7623.265034][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7623.265683][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7623.266028][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7623.267050][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7623.267372][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7623.267791][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7623.268212][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7623.268631][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7623.269048][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7623.269465][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7623.269945][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7623.270295][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7623.270722][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7623.271145][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7623.271567][ C1] Call Trace: [ 7623.271748][ C1] [ 7623.271906][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7623.272198][ C1] ? print_cpu_stall+0x263/0x6a0 [ 7623.272462][ C1] ? check_cpu_stall+0x284/0x500 [ 7623.272728][ C1] ? rcu_pending+0x92/0x360 [ 7623.272969][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7623.273252][ C1] ? update_process_times+0xb9/0x110 [ 7623.273539][ C1] ? tick_sched_handle+0x67/0x130 [ 7623.273810][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7623.274115][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7623.274374][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7623.274704][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7623.274995][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7623.275302][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7623.275584][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7623.275910][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7623.276185][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7623.276514][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7623.276828][ C1] [ 7623.276985][ C1] [ 7623.277143][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7623.277471][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7623.277781][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7623.278095][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7623.278397][ C1] ? run_ksoftirqd+0xb/0x60 [ 7623.278640][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7623.278965][ C1] ? __orc_find+0x9c/0xf0 [ 7623.279202][ C1] ? lock_acquire+0x1c1/0x220 [ 7623.279457][ C1] ? irqentry_enter+0x2b/0x60 [ 7623.279718][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7623.279980][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7623.280265][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7623.280563][ C1] ? lock_acquire+0x1c1/0x220 [ 7623.280821][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7623.281080][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7623.281359][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7623.281605][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7623.281866][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7623.282138][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7623.282430][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7623.282724][ C1] ip_local_deliver+0x19d/0x480 [ 7623.282987][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7623.283277][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7623.283544][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7623.283821][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7623.284085][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7623.284426][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7623.284701][ C1] ip_rcv+0x564/0x740 [ 7623.284914][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7623.285155][ C1] ? set_track_prepare+0x8a/0xd0 [ 7623.285420][ C1] ? irqentry_enter+0x2b/0x60 [ 7623.285677][ C1] ? irqentry_enter+0x2b/0x60 [ 7623.285934][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7623.286180][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7623.286503][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7623.286847][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7623.287162][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7623.287502][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7623.287801][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7623.288141][ C1] netif_receive_skb+0x55/0x280 [ 7623.288404][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7623.288738][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7623.289092][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7623.289406][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7623.289707][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7623.290017][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7623.290349][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7623.290631][ C1] ? arch_stack_walk+0x68/0x100 [ 7623.290900][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7623.291182][ C1] ? irqentry_enter+0x2b/0x60 [ 7623.291442][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7623.291765][ C1] ? irqentry_enter+0x2b/0x60 [ 7623.292015][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7623.292340][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7623.292625][ C1] ? arch_stack_walk+0x68/0x100 [ 7623.292886][ C1] __tcf_classify+0x32c/0x7d0 [ 7623.293140][ C1] tcf_classify+0x283/0x930 [ 7623.293384][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7623.293653][ C1] tc_run+0x2e4/0x5d0 [ 7623.293867][ C1] ? __pfx_tc_run+0x10/0x10 [ 7623.294110][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7623.294376][ C1] ? irqentry_enter+0x2b/0x60 [ 7623.294632][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7623.294922][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7623.295248][ C1] ip_finish_output2+0x786/0x18e0 [ 7623.295518][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7623.295809][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7623.296078][ C1] ? __ip_finish_output+0x10f/0x770 [ 7623.296355][ C1] ip_output+0x16b/0x4f0 [ 7623.296581][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7623.296903][ C1] ? __pfx_ip_output+0x10/0x10 [ 7623.297161][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7623.297522][ C1] ? __pfx_ip_output+0x10/0x10 [ 7623.297782][ C1] __ip_queue_xmit+0x672/0x1910 [ 7623.298045][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7623.298325][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7623.298632][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7623.298916][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7623.299210][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7623.299493][ C1] tcp_delack_timer+0x84/0x240 [ 7623.299754][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7623.300037][ C1] call_timer_fn+0x176/0x430 [ 7623.300283][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7623.300561][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7623.300839][ C1] __run_timers.part.0+0x52d/0x890 [ 7623.301112][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7623.301402][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7623.301706][ C1] ? __pfx___schedule+0x10/0x10 [ 7623.301967][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7623.302287][ C1] run_timer_softirq+0x72/0x100 [ 7623.302553][ C1] __do_softirq+0x1bc/0x7ff [ 7623.302803][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7623.303081][ C1] run_ksoftirqd+0x2e/0x60 [ 7623.303320][ C1] smpboot_thread_fn+0x30e/0x840 [ 7623.303587][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7623.303876][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7623.304168][ C1] kthread+0x292/0x360 [ 7623.304386][ C1] ? __pfx_kthread+0x10/0x10 [ 7623.304637][ C1] ret_from_fork+0x34/0x70 [ 7623.304874][ C1] ? __pfx_kthread+0x10/0x10 [ 7623.305123][ C1] ret_from_fork_asm+0x1b/0x30 [ 7623.305381][ C1] [ 7648.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6017s! [swapper/0:0] [ 7648.527922][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7648.529119][ C0] irq event stamp: 27567077 [ 7648.529359][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7648.529896][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7648.530367][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7648.530876][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7648.531371][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7648.531850][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7648.532502][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7648.532847][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7648.533874][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7648.534206][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7648.534632][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7648.535062][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7648.535485][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7648.535905][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7648.536329][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7648.536803][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7648.537150][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7648.537573][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7648.537991][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7648.538412][ C0] Call Trace: [ 7648.538591][ C0] [ 7648.538748][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7648.539026][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7648.539280][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7648.539585][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7648.539875][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7648.540183][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7648.540466][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7648.540788][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7648.541064][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7648.541344][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7648.541666][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7648.541977][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7648.542313][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7648.542617][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7648.542926][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7648.543233][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7648.543564][ C0] ? get_stack_info+0x36/0xc0 [ 7648.543817][ C0] ? lock_acquire+0x1c1/0x220 [ 7648.544071][ C0] ? lock_release+0x1d5/0x250 [ 7648.544322][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7648.544582][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7648.544865][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7648.545163][ C0] ? lock_acquire+0x1c1/0x220 [ 7648.545417][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7648.545678][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7648.545955][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7648.546200][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7648.546459][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7648.546728][ C0] ? __inet_lookup_established+0x341/0x610 [ 7648.547041][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7648.547334][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7648.547627][ C0] ip_local_deliver+0x19d/0x480 [ 7648.547882][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7648.548165][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7648.548431][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7648.548711][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7648.548983][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7648.549319][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7648.549602][ C0] ip_rcv+0x564/0x740 [ 7648.549814][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7648.550055][ C0] ? set_track_prepare+0x8a/0xd0 [ 7648.550320][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7648.550611][ C0] ? rest_init+0x153/0x260 [ 7648.550848][ C0] ? skb_clone+0x10b/0x330 [ 7648.551092][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7648.551425][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7648.551747][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7648.552045][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7648.552356][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7648.552621][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7648.552867][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7648.553185][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7648.553485][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7648.553822][ C0] ? lock_acquire+0x1c1/0x220 [ 7648.554073][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7648.554382][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7648.554681][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7648.555009][ C0] ? __copy_skb_header+0xaf/0x490 [ 7648.555277][ C0] ? __skb_clone+0x57a/0x760 [ 7648.555524][ C0] netif_receive_skb+0x55/0x280 [ 7648.555787][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7648.556121][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7648.556470][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7648.556782][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7648.557075][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7648.557380][ C0] ? hlock_class+0x4e/0x130 [ 7648.557632][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7648.557965][ C0] ? place_entity+0x21/0x2f0 [ 7648.558215][ C0] ? resched_curr+0x219/0x280 [ 7648.558465][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7648.558732][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7648.559013][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7648.559296][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7648.559557][ C0] ? activate_task+0xf5/0x260 [ 7648.559814][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7648.560089][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7648.560365][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7648.560624][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7648.560915][ C0] ? get_stack_info+0x36/0xc0 [ 7648.561170][ C0] ? stack_access_ok+0xda/0x1f0 [ 7648.561430][ C0] ? get_reg+0x119/0x190 [ 7648.561661][ C0] __tcf_classify+0x32c/0x7d0 [ 7648.561913][ C0] tcf_classify+0x283/0x930 [ 7648.562156][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7648.562485][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7648.562756][ C0] ? arch_stack_walk+0x8c/0x100 [ 7648.563019][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7648.563311][ C0] tc_run+0x2e4/0x5d0 [ 7648.563526][ C0] ? __pfx_tc_run+0x10/0x10 [ 7648.563766][ C0] ? lock_acquire+0x1c1/0x220 [ 7648.564013][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7648.564286][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7648.564558][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7648.564840][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7648.565117][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7648.565441][ C0] ? neigh_hh_output+0x348/0x590 [ 7648.565709][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7648.565985][ C0] ip_finish_output2+0x786/0x18e0 [ 7648.566253][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7648.566544][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7648.566900][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7648.567194][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7648.567457][ C0] ? __ip_finish_output+0x10f/0x770 [ 7648.567738][ C0] ip_output+0x16b/0x4f0 [ 7648.567969][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7648.568254][ C0] ? __pfx_ip_output+0x10/0x10 [ 7648.568513][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7648.568812][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7648.569080][ C0] ? ip_local_out+0x114/0x3b0 [ 7648.569332][ C0] __ip_queue_xmit+0x672/0x1910 [ 7648.569600][ C0] ? __skb_clone+0x57a/0x760 [ 7648.569850][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7648.570131][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7648.570425][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7648.570742][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7648.571001][ C0] ? tcp_current_mss+0x40a/0x510 [ 7648.571266][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7648.571550][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7648.571830][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7648.572084][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7648.572356][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7648.572679][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7648.572954][ C0] ? ktime_get+0xb6/0x190 [ 7648.573186][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7648.573459][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7648.573746][ C0] tcp_write_timer+0x82/0x1d0 [ 7648.573997][ C0] call_timer_fn+0x176/0x430 [ 7648.574245][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7648.574523][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7648.574799][ C0] __run_timers.part.0+0x52d/0x890 [ 7648.575075][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7648.575360][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7648.575666][ C0] ? lock_acquire+0x1c1/0x220 [ 7648.575916][ C0] ? clockevents_program_event+0xf6/0x300 [ 7648.576222][ C0] ? lock_release+0x1d5/0x250 [ 7648.576469][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7648.576744][ C0] ? ktime_get+0xb6/0x190 [ 7648.576974][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7648.577273][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7648.577586][ C0] run_timer_softirq+0x72/0x100 [ 7648.577848][ C0] __do_softirq+0x1bc/0x7ff [ 7648.578092][ C0] irq_exit_rcu+0x98/0xc0 [ 7648.578326][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7648.578625][ C0] [ 7648.578786][ C0] [ 7648.578946][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7648.579270][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7648.579538][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7648.580570][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7648.580894][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7648.581319][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7648.581742][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7648.582162][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7648.582581][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7648.583006][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7648.583314][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7648.583591][ C0] default_idle_call+0x69/0xa0 [ 7648.583845][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7648.584111][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7648.584400][ C0] ? lock_release+0x1d5/0x250 [ 7648.584653][ C0] do_idle+0xfb/0x160 [ 7648.584870][ C0] cpu_startup_entry+0x55/0x60 [ 7648.585129][ C0] rest_init+0x153/0x260 [ 7648.585355][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7648.585644][ C0] arch_call_rest_init+0x13/0x40 [ 7648.585913][ C0] start_kernel+0x314/0x3d0 [ 7648.586154][ C0] x86_64_start_reservations+0x18/0x30 [ 7648.586443][ C0] x86_64_start_kernel+0xba/0x110 [ 7648.586714][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7648.587046][ C0] [ 7648.587213][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6017s! [ksoftirqd/1:22] [ 7648.587687][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7648.588878][ C1] irq event stamp: 3886976 [ 7648.589118][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7648.589630][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7648.590128][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7648.590627][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7648.591126][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7648.591617][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7648.592249][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7648.592590][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7648.593602][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7648.593923][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7648.594339][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7648.594763][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7648.595176][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7648.595593][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7648.596012][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7648.596479][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7648.596828][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7648.597246][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7648.597666][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7648.598088][ C1] Call Trace: [ 7648.598265][ C1] [ 7648.598424][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7648.598698][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7648.598954][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7648.599242][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7648.599527][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7648.599833][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7648.600110][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7648.600430][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7648.600704][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7648.601029][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7648.601341][ C1] [ 7648.601500][ C1] [ 7648.601660][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7648.601989][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7648.602295][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7648.602609][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7648.602912][ C1] ? run_ksoftirqd+0xb/0x60 [ 7648.603163][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7648.603495][ C1] ? __orc_find+0x9c/0xf0 [ 7648.603722][ C1] ? lock_acquire+0x1c1/0x220 [ 7648.603972][ C1] ? irqentry_enter+0x2b/0x60 [ 7648.604221][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7648.604477][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7648.604766][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7648.605066][ C1] ? lock_acquire+0x1c1/0x220 [ 7648.605319][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7648.605581][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7648.605860][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7648.606102][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7648.606359][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7648.606632][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7648.606920][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7648.607208][ C1] ip_local_deliver+0x19d/0x480 [ 7648.607471][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7648.607755][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7648.608022][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7648.608300][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7648.608566][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7648.608903][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7648.609181][ C1] ip_rcv+0x564/0x740 [ 7648.609399][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7648.609644][ C1] ? set_track_prepare+0x8a/0xd0 [ 7648.609922][ C1] ? irqentry_enter+0x2b/0x60 [ 7648.610170][ C1] ? irqentry_enter+0x2b/0x60 [ 7648.610427][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7648.610664][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7648.610974][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7648.611318][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7648.611626][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7648.611968][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7648.612266][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7648.612596][ C1] netif_receive_skb+0x55/0x280 [ 7648.612851][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7648.613180][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7648.613538][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7648.613851][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7648.614138][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7648.614437][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7648.614762][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7648.615041][ C1] ? arch_stack_walk+0x68/0x100 [ 7648.615301][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7648.615577][ C1] ? irqentry_enter+0x2b/0x60 [ 7648.615829][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7648.616146][ C1] ? irqentry_enter+0x2b/0x60 [ 7648.616391][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7648.616707][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7648.616987][ C1] ? arch_stack_walk+0x68/0x100 [ 7648.617244][ C1] __tcf_classify+0x32c/0x7d0 [ 7648.617495][ C1] tcf_classify+0x283/0x930 [ 7648.617741][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7648.618006][ C1] tc_run+0x2e4/0x5d0 [ 7648.618220][ C1] ? __pfx_tc_run+0x10/0x10 [ 7648.618459][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7648.618724][ C1] ? irqentry_enter+0x2b/0x60 [ 7648.618982][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7648.619272][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7648.619599][ C1] ip_finish_output2+0x786/0x18e0 [ 7648.619877][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7648.620167][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7648.620434][ C1] ? __ip_finish_output+0x10f/0x770 [ 7648.620715][ C1] ip_output+0x16b/0x4f0 [ 7648.620942][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7648.621262][ C1] ? __pfx_ip_output+0x10/0x10 [ 7648.621517][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7648.621864][ C1] ? __pfx_ip_output+0x10/0x10 [ 7648.622124][ C1] __ip_queue_xmit+0x672/0x1910 [ 7648.622388][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7648.622671][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7648.622966][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7648.623258][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7648.623558][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7648.623852][ C1] tcp_delack_timer+0x84/0x240 [ 7648.624111][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7648.624393][ C1] call_timer_fn+0x176/0x430 [ 7648.624638][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7648.624916][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7648.625190][ C1] __run_timers.part.0+0x52d/0x890 [ 7648.625466][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7648.625758][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7648.626061][ C1] ? __pfx___schedule+0x10/0x10 [ 7648.626317][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7648.626638][ C1] run_timer_softirq+0x72/0x100 [ 7648.626902][ C1] __do_softirq+0x1bc/0x7ff [ 7648.627156][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7648.627429][ C1] run_ksoftirqd+0x2e/0x60 [ 7648.627662][ C1] smpboot_thread_fn+0x30e/0x840 [ 7648.627925][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7648.628211][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7648.628513][ C1] kthread+0x292/0x360 [ 7648.628730][ C1] ? __pfx_kthread+0x10/0x10 [ 7648.628979][ C1] ret_from_fork+0x34/0x70 [ 7648.629216][ C1] ? __pfx_kthread+0x10/0x10 [ 7648.629467][ C1] ret_from_fork_asm+0x1b/0x30 [ 7648.629732][ C1] [ 7676.527464][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6043s! [swapper/0:0] [ 7676.528233][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7676.530160][ C0] irq event stamp: 27567077 [ 7676.530540][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7676.531371][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7676.532133][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7676.532937][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7676.533761][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7676.534518][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7676.535534][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7676.536098][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7676.537684][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7676.538209][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7676.538887][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7676.539550][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7676.540242][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7676.540898][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7676.541514][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7676.542308][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7676.542839][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7676.543492][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7676.544153][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7676.544826][ C0] Call Trace: [ 7676.545114][ C0] [ 7676.545360][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7676.545822][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7676.546232][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7676.546699][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7676.547162][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7676.547649][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7676.548103][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7676.548600][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7676.549031][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7676.549502][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7676.550000][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7676.550490][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7676.551006][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7676.551487][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7676.551972][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7676.552444][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7676.552957][ C0] ? get_stack_info+0x36/0xc0 [ 7676.553343][ C0] ? lock_acquire+0x1c1/0x220 [ 7676.553726][ C0] ? lock_release+0x1d5/0x250 [ 7676.554119][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7676.554537][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7676.554981][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7676.555445][ C0] ? lock_acquire+0x1c1/0x220 [ 7676.555839][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7676.556244][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7676.556669][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7676.557057][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7676.557460][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7676.557878][ C0] ? __inet_lookup_established+0x341/0x610 [ 7676.558380][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7676.558838][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7676.559302][ C0] ip_local_deliver+0x19d/0x480 [ 7676.559727][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7676.560178][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7676.560594][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7676.561035][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7676.561455][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7676.561991][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7676.562413][ C0] ip_rcv+0x564/0x740 [ 7676.562748][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7676.563121][ C0] ? set_track_prepare+0x8a/0xd0 [ 7676.563522][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7676.563982][ C0] ? rest_init+0x153/0x260 [ 7676.564356][ C0] ? skb_clone+0x10b/0x330 [ 7676.564732][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7676.565253][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7676.565752][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7676.566222][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7676.566710][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7676.567129][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7676.567511][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7676.568007][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7676.568472][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7676.569007][ C0] ? lock_acquire+0x1c1/0x220 [ 7676.569398][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7676.569889][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7676.570358][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7676.570883][ C0] ? __copy_skb_header+0xaf/0x490 [ 7676.571314][ C0] ? __skb_clone+0x57a/0x760 [ 7676.571714][ C0] netif_receive_skb+0x55/0x280 [ 7676.572108][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7676.572607][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7676.573143][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7676.573620][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7676.574088][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7676.574560][ C0] ? hlock_class+0x4e/0x130 [ 7676.574944][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7676.575471][ C0] ? place_entity+0x21/0x2f0 [ 7676.575861][ C0] ? resched_curr+0x219/0x280 [ 7676.576261][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7676.576685][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7676.577133][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7676.577578][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7676.577986][ C0] ? activate_task+0xf5/0x260 [ 7676.578382][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7676.578819][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7676.579246][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7676.579667][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7676.580137][ C0] ? get_stack_info+0x36/0xc0 [ 7676.580537][ C0] ? stack_access_ok+0xda/0x1f0 [ 7676.580961][ C0] ? get_reg+0x119/0x190 [ 7676.581314][ C0] __tcf_classify+0x32c/0x7d0 [ 7676.581720][ C0] tcf_classify+0x283/0x930 [ 7676.582100][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7676.582609][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7676.583031][ C0] ? arch_stack_walk+0x8c/0x100 [ 7676.583444][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7676.583900][ C0] tc_run+0x2e4/0x5d0 [ 7676.584234][ C0] ? __pfx_tc_run+0x10/0x10 [ 7676.584585][ C0] ? lock_acquire+0x1c1/0x220 [ 7676.584979][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7676.585410][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7676.585832][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7676.586278][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7676.586710][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7676.587209][ C0] ? neigh_hh_output+0x348/0x590 [ 7676.587625][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7676.588065][ C0] ip_finish_output2+0x786/0x18e0 [ 7676.588474][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7676.588930][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7676.589543][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7676.590021][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7676.590443][ C0] ? __ip_finish_output+0x10f/0x770 [ 7676.590870][ C0] ip_output+0x16b/0x4f0 [ 7676.591221][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7676.591645][ C0] ? __pfx_ip_output+0x10/0x10 [ 7676.592063][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7676.592529][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7676.592947][ C0] ? ip_local_out+0x114/0x3b0 [ 7676.593344][ C0] __ip_queue_xmit+0x672/0x1910 [ 7676.593761][ C0] ? __skb_clone+0x57a/0x760 [ 7676.594155][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7676.594593][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7676.595065][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7676.595573][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7676.595983][ C0] ? tcp_current_mss+0x40a/0x510 [ 7676.596394][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7676.596838][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7676.597272][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7676.597668][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7676.598089][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7676.598594][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7676.599028][ C0] ? ktime_get+0xb6/0x190 [ 7676.599392][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7676.599842][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7676.600280][ C0] tcp_write_timer+0x82/0x1d0 [ 7676.600677][ C0] call_timer_fn+0x176/0x430 [ 7676.601067][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7676.601491][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7676.601914][ C0] __run_timers.part.0+0x52d/0x890 [ 7676.602344][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7676.602775][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7676.603229][ C0] ? lock_acquire+0x1c1/0x220 [ 7676.603605][ C0] ? clockevents_program_event+0xf6/0x300 [ 7676.604079][ C0] ? lock_release+0x1d5/0x250 [ 7676.604472][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7676.604915][ C0] ? ktime_get+0xb6/0x190 [ 7676.605282][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7676.605764][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7676.606250][ C0] run_timer_softirq+0x72/0x100 [ 7676.606661][ C0] __do_softirq+0x1bc/0x7ff [ 7676.607050][ C0] irq_exit_rcu+0x98/0xc0 [ 7676.607416][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7676.607887][ C0] [ 7676.608133][ C0] [ 7676.608381][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7676.608891][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7676.609316][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7676.610917][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7676.611433][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7676.612066][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7676.612693][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7676.613339][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7676.613996][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7676.614651][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7676.615140][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7676.615569][ C0] default_idle_call+0x69/0xa0 [ 7676.615972][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7676.616384][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7676.616839][ C0] ? lock_release+0x1d5/0x250 [ 7676.617235][ C0] do_idle+0xfb/0x160 [ 7676.617570][ C0] cpu_startup_entry+0x55/0x60 [ 7676.617966][ C0] rest_init+0x153/0x260 [ 7676.618336][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7676.618781][ C0] arch_call_rest_init+0x13/0x40 [ 7676.619188][ C0] start_kernel+0x314/0x3d0 [ 7676.619583][ C0] x86_64_start_reservations+0x18/0x30 [ 7676.620025][ C0] x86_64_start_kernel+0xba/0x110 [ 7676.620451][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7676.620942][ C0] [ 7676.621202][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6043s! [ksoftirqd/1:22] [ 7676.621921][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7676.623751][ C1] irq event stamp: 3886976 [ 7676.624115][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7676.624862][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7676.625632][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7676.626392][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7676.627163][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7676.627933][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7676.628912][ C1] RIP: 0010:kasan_check_range+0x66/0x1c0 [ 7676.629372][ C1] Code: 5b 5d 41 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df <4d> 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d [ 7676.630930][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000212 [ 7676.631424][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7676.632064][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7676.632703][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7676.633324][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7676.633963][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7676.634600][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7676.635288][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7676.635795][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7676.636411][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7676.637034][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7676.637690][ C1] Call Trace: [ 7676.637960][ C1] [ 7676.638198][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7676.638633][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7676.639014][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7676.639472][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7676.639898][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7676.640347][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7676.640750][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7676.641229][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7676.641636][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7676.642110][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7676.642567][ C1] [ 7676.642800][ C1] [ 7676.643036][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7676.643524][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7676.643976][ C1] ? kasan_check_range+0x66/0x1c0 [ 7676.644374][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 7676.644809][ C1] ? run_ksoftirqd+0xb/0x60 [ 7676.645170][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7676.645650][ C1] ? __orc_find+0x9c/0xf0 [ 7676.645996][ C1] ? lock_acquire+0x1c1/0x220 [ 7676.646371][ C1] ? irqentry_enter+0x2b/0x60 [ 7676.646755][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7676.647146][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7676.647564][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7676.648006][ C1] ? lock_acquire+0x1c1/0x220 [ 7676.648375][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7676.648769][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7676.649184][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7676.649586][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7676.649964][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7676.650364][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7676.650791][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7676.651221][ C1] ip_local_deliver+0x19d/0x480 [ 7676.651604][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7676.652028][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7676.652417][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7676.652833][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7676.653219][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7676.653747][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7676.654171][ C1] ip_rcv+0x564/0x740 [ 7676.654499][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7676.654864][ C1] ? set_track_prepare+0x8a/0xd0 [ 7676.655269][ C1] ? irqentry_enter+0x2b/0x60 [ 7676.655668][ C1] ? irqentry_enter+0x2b/0x60 [ 7676.656047][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7676.656410][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7676.656873][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7676.657375][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7676.657831][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7676.658327][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7676.658766][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7676.659263][ C1] netif_receive_skb+0x55/0x280 [ 7676.659660][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7676.660152][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7676.660658][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7676.661116][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7676.661517][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7676.661929][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7676.662375][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7676.662760][ C1] ? arch_stack_walk+0x68/0x100 [ 7676.663123][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7676.663504][ C1] ? irqentry_enter+0x2b/0x60 [ 7676.663849][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7676.664288][ C1] ? irqentry_enter+0x2b/0x60 [ 7676.664627][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7676.665065][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7676.665457][ C1] ? arch_stack_walk+0x68/0x100 [ 7676.665814][ C1] __tcf_classify+0x32c/0x7d0 [ 7676.666166][ C1] tcf_classify+0x283/0x930 [ 7676.666499][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7676.666865][ C1] tc_run+0x2e4/0x5d0 [ 7676.667160][ C1] ? __pfx_tc_run+0x10/0x10 [ 7676.667494][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7676.667866][ C1] ? irqentry_enter+0x2b/0x60 [ 7676.668223][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7676.668626][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7676.669085][ C1] ip_finish_output2+0x786/0x18e0 [ 7676.669476][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7676.669886][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7676.670260][ C1] ? __ip_finish_output+0x10f/0x770 [ 7676.670657][ C1] ip_output+0x16b/0x4f0 [ 7676.670975][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7676.671412][ C1] ? __pfx_ip_output+0x10/0x10 [ 7676.671774][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7676.672271][ C1] ? __pfx_ip_output+0x10/0x10 [ 7676.672627][ C1] __ip_queue_xmit+0x672/0x1910 [ 7676.672999][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7676.673395][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7676.673812][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7676.674212][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7676.674619][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7676.675018][ C1] tcp_delack_timer+0x84/0x240 [ 7676.675373][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7676.675754][ C1] call_timer_fn+0x176/0x430 [ 7676.676103][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7676.676502][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7676.676908][ C1] __run_timers.part.0+0x52d/0x890 [ 7676.677315][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7676.677747][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7676.678200][ C1] ? __pfx___schedule+0x10/0x10 [ 7676.678586][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7676.679061][ C1] run_timer_softirq+0x72/0x100 [ 7676.679480][ C1] __do_softirq+0x1bc/0x7ff [ 7676.679859][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7676.680257][ C1] run_ksoftirqd+0x2e/0x60 [ 7676.680577][ C1] smpboot_thread_fn+0x30e/0x840 [ 7676.680966][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7676.681392][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7676.681809][ C1] kthread+0x292/0x360 [ 7676.682153][ C1] ? __pfx_kthread+0x10/0x10 [ 7676.682540][ C1] ret_from_fork+0x34/0x70 [ 7676.682897][ C1] ? __pfx_kthread+0x10/0x10 [ 7676.683268][ C1] ret_from_fork_asm+0x1b/0x30 [ 7676.683657][ C1] [ 7701.306025][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7701.306432][ C0] rcu: 0-....: (6496575 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1533952 [ 7701.306959][ C0] rcu: (t=6506997 jiffies g=1007429 q=31 ncpus=4) [ 7701.307318][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7701.307808][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7701.308460][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7701.308811][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7701.309850][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7701.310179][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7701.310607][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7701.311040][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7701.311462][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7701.311895][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7701.312312][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7701.312776][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7701.313115][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7701.313531][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7701.313963][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7701.314381][ C0] Call Trace: [ 7701.314559][ C0] [ 7701.314717][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7701.315007][ C0] ? print_cpu_stall+0x263/0x6a0 [ 7701.315282][ C0] ? check_cpu_stall+0x284/0x500 [ 7701.315542][ C0] ? rcu_pending+0x92/0x360 [ 7701.315775][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7701.316069][ C0] ? update_process_times+0xb9/0x110 [ 7701.316356][ C0] ? tick_sched_handle+0x67/0x130 [ 7701.316625][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7701.316924][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7701.317181][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7701.317509][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7701.317797][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7701.318103][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7701.318387][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7701.318713][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7701.318987][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7701.319276][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7701.319609][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7701.319922][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7701.320261][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7701.320564][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7701.320874][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7701.321188][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7701.321510][ C0] ? get_stack_info+0x36/0xc0 [ 7701.321756][ C0] ? lock_acquire+0x1c1/0x220 [ 7701.322002][ C0] ? lock_release+0x1d5/0x250 [ 7701.322266][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7701.322525][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7701.322808][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7701.323108][ C0] ? lock_acquire+0x1c1/0x220 [ 7701.323372][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7701.323624][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7701.323891][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7701.324129][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7701.324401][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7701.324674][ C0] ? __inet_lookup_established+0x341/0x610 [ 7701.324984][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7701.325279][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7701.325582][ C0] ip_local_deliver+0x19d/0x480 [ 7701.325836][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7701.326132][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7701.326398][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7701.326679][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7701.326944][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7701.327280][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7701.327559][ C0] ip_rcv+0x564/0x740 [ 7701.327775][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7701.328020][ C0] ? set_track_prepare+0x8a/0xd0 [ 7701.328288][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7701.328574][ C0] ? rest_init+0x153/0x260 [ 7701.328813][ C0] ? skb_clone+0x10b/0x330 [ 7701.329055][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7701.329395][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7701.329712][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7701.330011][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7701.330325][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7701.330588][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7701.330833][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7701.331148][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7701.331448][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7701.331791][ C0] ? lock_acquire+0x1c1/0x220 [ 7701.332038][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7701.332338][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7701.332630][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7701.332951][ C0] ? __copy_skb_header+0xaf/0x490 [ 7701.333211][ C0] ? __skb_clone+0x57a/0x760 [ 7701.333448][ C0] netif_receive_skb+0x55/0x280 [ 7701.333701][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7701.334040][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7701.334395][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7701.334707][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7701.334999][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7701.335302][ C0] ? hlock_class+0x4e/0x130 [ 7701.335552][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7701.335885][ C0] ? place_entity+0x21/0x2f0 [ 7701.336130][ C0] ? resched_curr+0x219/0x280 [ 7701.336392][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7701.336659][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7701.336943][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7701.337225][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7701.337489][ C0] ? activate_task+0xf5/0x260 [ 7701.337746][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7701.338024][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7701.338295][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7701.338556][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7701.338850][ C0] ? get_stack_info+0x36/0xc0 [ 7701.339101][ C0] ? stack_access_ok+0xda/0x1f0 [ 7701.339363][ C0] ? get_reg+0x119/0x190 [ 7701.339594][ C0] __tcf_classify+0x32c/0x7d0 [ 7701.339847][ C0] tcf_classify+0x283/0x930 [ 7701.340091][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7701.340421][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7701.340689][ C0] ? arch_stack_walk+0x8c/0x100 [ 7701.340953][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7701.341248][ C0] tc_run+0x2e4/0x5d0 [ 7701.341475][ C0] ? __pfx_tc_run+0x10/0x10 [ 7701.341711][ C0] ? lock_acquire+0x1c1/0x220 [ 7701.341958][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7701.342247][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7701.342516][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7701.342801][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7701.343076][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7701.343402][ C0] ? neigh_hh_output+0x348/0x590 [ 7701.343660][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7701.343928][ C0] ip_finish_output2+0x786/0x18e0 [ 7701.344206][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7701.344506][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7701.344860][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7701.345153][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7701.345418][ C0] ? __ip_finish_output+0x10f/0x770 [ 7701.345706][ C0] ip_output+0x16b/0x4f0 [ 7701.345931][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7701.346225][ C0] ? __pfx_ip_output+0x10/0x10 [ 7701.346483][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7701.346782][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7701.347051][ C0] ? ip_local_out+0x114/0x3b0 [ 7701.347302][ C0] __ip_queue_xmit+0x672/0x1910 [ 7701.347562][ C0] ? __skb_clone+0x57a/0x760 [ 7701.347811][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7701.348098][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7701.348395][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7701.348719][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7701.348976][ C0] ? tcp_current_mss+0x40a/0x510 [ 7701.349242][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7701.349537][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7701.349815][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7701.350075][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7701.350345][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7701.350669][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7701.350945][ C0] ? ktime_get+0xb6/0x190 [ 7701.351177][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7701.351448][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7701.351739][ C0] tcp_write_timer+0x82/0x1d0 [ 7701.351985][ C0] call_timer_fn+0x176/0x430 [ 7701.352229][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7701.352500][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7701.352765][ C0] __run_timers.part.0+0x52d/0x890 [ 7701.353034][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7701.353310][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7701.353604][ C0] ? lock_acquire+0x1c1/0x220 [ 7701.353848][ C0] ? clockevents_program_event+0xf6/0x300 [ 7701.354163][ C0] ? lock_release+0x1d5/0x250 [ 7701.354411][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7701.354686][ C0] ? ktime_get+0xb6/0x190 [ 7701.354916][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7701.355214][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7701.355530][ C0] run_timer_softirq+0x72/0x100 [ 7701.355794][ C0] __do_softirq+0x1bc/0x7ff [ 7701.356040][ C0] irq_exit_rcu+0x98/0xc0 [ 7701.356272][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7701.356572][ C0] [ 7701.356732][ C0] [ 7701.356891][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7701.357215][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7701.357483][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7701.358506][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7701.358830][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7701.359249][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7701.359677][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7701.360099][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7701.360529][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7701.360955][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7701.361262][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7701.361539][ C0] default_idle_call+0x69/0xa0 [ 7701.361793][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7701.362058][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7701.362348][ C0] ? lock_release+0x1d5/0x250 [ 7701.362603][ C0] do_idle+0xfb/0x160 [ 7701.362823][ C0] cpu_startup_entry+0x55/0x60 [ 7701.363081][ C0] rest_init+0x153/0x260 [ 7701.363316][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7701.363620][ C0] arch_call_rest_init+0x13/0x40 [ 7701.363891][ C0] start_kernel+0x314/0x3d0 [ 7701.364136][ C0] x86_64_start_reservations+0x18/0x30 [ 7701.364429][ C0] x86_64_start_kernel+0xba/0x110 [ 7701.364700][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7701.365033][ C0] [ 7701.365206][ C0] Sending NMI from CPU 0 to CPUs 1: [ 7701.365505][ C1] NMI backtrace for cpu 1 [ 7701.365515][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7701.365520][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7701.365522][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7701.365531][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7701.365535][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7701.365539][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7701.365541][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7701.365542][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7701.365544][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7701.365546][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7701.365548][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7701.365550][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7701.365553][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7701.365555][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7701.365556][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7701.365558][ C1] Call Trace: [ 7701.365562][ C1] [ 7701.365567][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 7701.365574][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7701.365580][ C1] ? nmi_handle+0x156/0x420 [ 7701.365586][ C1] ? default_do_nmi+0x41/0x100 [ 7701.365590][ C1] ? exc_nmi+0xf3/0x120 [ 7701.365592][ C1] ? end_repeat_nmi+0xf/0x60 [ 7701.365597][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7701.365601][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7701.365604][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7701.365608][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7701.365611][ C1] [ 7701.365612][ C1] [ 7701.365613][ C1] ? run_ksoftirqd+0xb/0x60 [ 7701.365618][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7701.365621][ C1] ? __orc_find+0x9c/0xf0 [ 7701.365624][ C1] ? lock_acquire+0x1c1/0x220 [ 7701.365628][ C1] ? irqentry_enter+0x2b/0x60 [ 7701.365634][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7701.365638][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7701.365641][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7701.365644][ C1] ? lock_acquire+0x1c1/0x220 [ 7701.365646][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7701.365652][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7701.365655][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7701.365663][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7701.365665][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7701.365671][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7701.365679][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7701.365683][ C1] ip_local_deliver+0x19d/0x480 [ 7701.365686][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7701.365688][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7701.365693][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7701.365697][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7701.365700][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7701.365703][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7701.365713][ C1] ip_rcv+0x564/0x740 [ 7701.365716][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7701.365719][ C1] ? set_track_prepare+0x8a/0xd0 [ 7701.365724][ C1] ? irqentry_enter+0x2b/0x60 [ 7701.365727][ C1] ? irqentry_enter+0x2b/0x60 [ 7701.365731][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7701.365733][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7701.365738][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7701.365741][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7701.365744][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7701.365747][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7701.365750][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7701.365755][ C1] netif_receive_skb+0x55/0x280 [ 7701.365759][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7701.365768][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7701.365775][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7701.365782][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7701.365790][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7701.365801][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7701.365811][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7701.365814][ C1] ? arch_stack_walk+0x68/0x100 [ 7701.365819][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7701.365822][ C1] ? irqentry_enter+0x2b/0x60 [ 7701.365825][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7701.365830][ C1] ? irqentry_enter+0x2b/0x60 [ 7701.365833][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7701.365841][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7701.365844][ C1] ? arch_stack_walk+0x68/0x100 [ 7701.365848][ C1] __tcf_classify+0x32c/0x7d0 [ 7701.365853][ C1] tcf_classify+0x283/0x930 [ 7701.365857][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7701.365861][ C1] tc_run+0x2e4/0x5d0 [ 7701.365865][ C1] ? __pfx_tc_run+0x10/0x10 [ 7701.365870][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7701.365876][ C1] ? irqentry_enter+0x2b/0x60 [ 7701.365879][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7701.365882][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7701.365889][ C1] ip_finish_output2+0x786/0x18e0 [ 7701.365895][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7701.365898][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7701.365902][ C1] ? __ip_finish_output+0x10f/0x770 [ 7701.365906][ C1] ip_output+0x16b/0x4f0 [ 7701.365909][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7701.365912][ C1] ? __pfx_ip_output+0x10/0x10 [ 7701.365917][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7701.365924][ C1] ? __pfx_ip_output+0x10/0x10 [ 7701.365928][ C1] __ip_queue_xmit+0x672/0x1910 [ 7701.365933][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7701.365940][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7701.365945][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7701.365948][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7701.365953][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7701.365956][ C1] tcp_delack_timer+0x84/0x240 [ 7701.365960][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7701.365962][ C1] call_timer_fn+0x176/0x430 [ 7701.365967][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7701.365972][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7701.365976][ C1] __run_timers.part.0+0x52d/0x890 [ 7701.365980][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7701.365984][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7701.365989][ C1] ? __pfx___schedule+0x10/0x10 [ 7701.365993][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7701.365998][ C1] run_timer_softirq+0x72/0x100 [ 7701.366002][ C1] __do_softirq+0x1bc/0x7ff [ 7701.366005][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7701.366009][ C1] run_ksoftirqd+0x2e/0x60 [ 7701.366013][ C1] smpboot_thread_fn+0x30e/0x840 [ 7701.366017][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7701.366021][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7701.366024][ C1] kthread+0x292/0x360 [ 7701.366027][ C1] ? __pfx_kthread+0x10/0x10 [ 7701.366030][ C1] ret_from_fork+0x34/0x70 [ 7701.366033][ C1] ? __pfx_kthread+0x10/0x10 [ 7701.366035][ C1] ret_from_fork_asm+0x1b/0x30 [ 7701.366043][ C1] [ 7728.527464][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6091s! [swapper/0:0] [ 7728.528182][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7728.530023][ C0] irq event stamp: 27567077 [ 7728.530399][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7728.531221][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7728.531962][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7728.532740][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7728.533504][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7728.534244][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7728.535229][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7728.535755][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7728.537310][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7728.537818][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7728.538509][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7728.539165][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7728.539808][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7728.540475][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7728.541135][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7728.541870][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7728.542415][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7728.543082][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7728.543745][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7728.544399][ C0] Call Trace: [ 7728.544688][ C0] [ 7728.544935][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7728.545384][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7728.545790][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7728.546258][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7728.546708][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7728.547185][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7728.547626][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7728.548143][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7728.548573][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7728.549006][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7728.549957][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7728.550443][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7728.550975][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7728.551464][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7728.551959][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7728.552452][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7728.552979][ C0] ? get_stack_info+0x36/0xc0 [ 7728.553388][ C0] ? lock_acquire+0x1c1/0x220 [ 7728.553790][ C0] ? lock_release+0x1d5/0x250 [ 7728.554193][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7728.554613][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7728.555054][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7728.555527][ C0] ? lock_acquire+0x1c1/0x220 [ 7728.555926][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7728.556320][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7728.556758][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7728.557164][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7728.557579][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7728.558014][ C0] ? __inet_lookup_established+0x341/0x610 [ 7728.558513][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7728.558972][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7728.559437][ C0] ip_local_deliver+0x19d/0x480 [ 7728.559819][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7728.560248][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7728.560641][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7728.561065][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7728.561478][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7728.562007][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7728.562450][ C0] ip_rcv+0x564/0x740 [ 7728.562794][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7728.563180][ C0] ? set_track_prepare+0x8a/0xd0 [ 7728.563604][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7728.564069][ C0] ? rest_init+0x153/0x260 [ 7728.564442][ C0] ? skb_clone+0x10b/0x330 [ 7728.564823][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7728.565355][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7728.565866][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7728.566362][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7728.566851][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7728.567278][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7728.567661][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7728.568137][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7728.568601][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7728.569134][ C0] ? lock_acquire+0x1c1/0x220 [ 7728.589643][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7728.590161][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7728.590639][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7728.591161][ C0] ? __copy_skb_header+0xaf/0x490 [ 7728.591588][ C0] ? __skb_clone+0x57a/0x760 [ 7728.591996][ C0] netif_receive_skb+0x55/0x280 [ 7728.592418][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7728.592948][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7728.593509][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7728.594017][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7728.594492][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7728.594978][ C0] ? hlock_class+0x4e/0x130 [ 7728.595374][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7728.595904][ C0] ? place_entity+0x21/0x2f0 [ 7728.596297][ C0] ? resched_curr+0x219/0x280 [ 7728.596703][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7728.597134][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7728.597585][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7728.598034][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7728.598445][ C0] ? activate_task+0xf5/0x260 [ 7728.598843][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7728.599254][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7728.599655][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7728.600054][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7728.600518][ C0] ? get_stack_info+0x36/0xc0 [ 7728.600909][ C0] ? stack_access_ok+0xda/0x1f0 [ 7728.601321][ C0] ? get_reg+0x119/0x190 [ 7728.601678][ C0] __tcf_classify+0x32c/0x7d0 [ 7728.602064][ C0] tcf_classify+0x283/0x930 [ 7728.602430][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7728.602935][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7728.603348][ C0] ? arch_stack_walk+0x8c/0x100 [ 7728.603760][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7728.604224][ C0] tc_run+0x2e4/0x5d0 [ 7728.604570][ C0] ? __pfx_tc_run+0x10/0x10 [ 7728.604960][ C0] ? lock_acquire+0x1c1/0x220 [ 7728.605365][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7728.605803][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7728.606220][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7728.606671][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7728.607109][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7728.607619][ C0] ? neigh_hh_output+0x348/0x590 [ 7728.608041][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7728.608462][ C0] ip_finish_output2+0x786/0x18e0 [ 7728.608885][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7728.629453][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7728.630021][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7728.630491][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7728.630922][ C0] ? __ip_finish_output+0x10f/0x770 [ 7728.631372][ C0] ip_output+0x16b/0x4f0 [ 7728.631737][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7728.632188][ C0] ? __pfx_ip_output+0x10/0x10 [ 7728.632606][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7728.633089][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7728.633531][ C0] ? ip_local_out+0x114/0x3b0 [ 7728.633934][ C0] __ip_queue_xmit+0x672/0x1910 [ 7728.634371][ C0] ? __skb_clone+0x57a/0x760 [ 7728.634760][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7728.635215][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7728.635690][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7728.636210][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7728.636626][ C0] ? tcp_current_mss+0x40a/0x510 [ 7728.637036][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7728.637478][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7728.637920][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7728.638329][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7728.638749][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7728.639259][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7728.639666][ C0] ? ktime_get+0xb6/0x190 [ 7728.640035][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7728.640468][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7728.640910][ C0] tcp_write_timer+0x82/0x1d0 [ 7728.641308][ C0] call_timer_fn+0x176/0x430 [ 7728.641712][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7728.642152][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7728.642579][ C0] __run_timers.part.0+0x52d/0x890 [ 7728.643023][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7728.643463][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7728.643927][ C0] ? lock_acquire+0x1c1/0x220 [ 7728.644306][ C0] ? clockevents_program_event+0xf6/0x300 [ 7728.644784][ C0] ? lock_release+0x1d5/0x250 [ 7728.645164][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7728.645594][ C0] ? ktime_get+0xb6/0x190 [ 7728.645962][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7728.646423][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7728.646938][ C0] run_timer_softirq+0x72/0x100 [ 7728.647365][ C0] __do_softirq+0x1bc/0x7ff [ 7728.647763][ C0] irq_exit_rcu+0x98/0xc0 [ 7728.648136][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7728.648639][ C0] [ 7728.648887][ C0] [ 7728.649138][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7728.669774][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7728.670236][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7728.671860][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7728.672369][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7728.673033][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7728.673723][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7728.674407][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7728.675062][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7728.675737][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7728.676236][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7728.676677][ C0] default_idle_call+0x69/0xa0 [ 7728.677090][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7728.677509][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7728.677965][ C0] ? lock_release+0x1d5/0x250 [ 7728.678364][ C0] do_idle+0xfb/0x160 [ 7728.678715][ C0] cpu_startup_entry+0x55/0x60 [ 7728.679128][ C0] rest_init+0x153/0x260 [ 7728.679499][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7728.679980][ C0] arch_call_rest_init+0x13/0x40 [ 7728.680427][ C0] start_kernel+0x314/0x3d0 [ 7728.680841][ C0] x86_64_start_reservations+0x18/0x30 [ 7728.681314][ C0] x86_64_start_kernel+0xba/0x110 [ 7728.681750][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7728.682293][ C0] [ 7728.682570][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6091s! [ksoftirqd/1:22] [ 7728.683305][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7728.685173][ C1] irq event stamp: 3886976 [ 7728.685553][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7728.686314][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7728.687013][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7728.687748][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7728.688451][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7728.689164][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7728.710183][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7728.710691][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7728.712130][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7728.712593][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7728.713193][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7728.713784][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7728.714438][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7728.715112][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7728.715791][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7728.716527][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7728.717032][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7728.717687][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7728.718340][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7728.718957][ C1] Call Trace: [ 7728.729283][ C1] [ 7728.729556][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7728.730020][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7728.730435][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7728.730913][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7728.731376][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7728.731874][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7728.732328][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7728.732863][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7728.733320][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7728.733852][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7728.734360][ C1] [ 7728.734622][ C1] [ 7728.734886][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7728.735434][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7728.735934][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7728.736445][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7728.736944][ C1] ? run_ksoftirqd+0xb/0x60 [ 7728.737346][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7728.737888][ C1] ? __orc_find+0x9c/0xf0 [ 7728.738270][ C1] ? lock_acquire+0x1c1/0x220 [ 7728.738687][ C1] ? irqentry_enter+0x2b/0x60 [ 7728.739104][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7728.769618][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7728.770099][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7728.770584][ C1] ? lock_acquire+0x1c1/0x220 [ 7728.770994][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7728.771407][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7728.771860][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7728.772266][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7728.772690][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7728.773136][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7728.773601][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7728.774067][ C1] ip_local_deliver+0x19d/0x480 [ 7728.774488][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7728.774950][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7728.775380][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7728.775821][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7728.776244][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7728.776786][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7728.777226][ C1] ip_rcv+0x564/0x740 [ 7728.777568][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7728.777957][ C1] ? set_track_prepare+0x8a/0xd0 [ 7728.778384][ C1] ? irqentry_enter+0x2b/0x60 [ 7728.778791][ C1] ? irqentry_enter+0x2b/0x60 [ 7728.779213][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7728.779589][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7728.780092][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7728.780626][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7728.781094][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7728.781612][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7728.782089][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7728.782613][ C1] netif_receive_skb+0x55/0x280 [ 7728.783031][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7728.783565][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7728.784118][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7728.784631][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7728.785099][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7728.785579][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7728.786093][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7728.786573][ C1] ? arch_stack_walk+0x68/0x100 [ 7728.787018][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7728.787460][ C1] ? irqentry_enter+0x2b/0x60 [ 7728.787863][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7728.788363][ C1] ? irqentry_enter+0x2b/0x60 [ 7728.788752][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7728.799486][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7728.799950][ C1] ? arch_stack_walk+0x68/0x100 [ 7728.800372][ C1] __tcf_classify+0x32c/0x7d0 [ 7728.800785][ C1] tcf_classify+0x283/0x930 [ 7728.801178][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7728.801611][ C1] tc_run+0x2e4/0x5d0 [ 7728.801957][ C1] ? __pfx_tc_run+0x10/0x10 [ 7728.802349][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7728.802775][ C1] ? irqentry_enter+0x2b/0x60 [ 7728.803185][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7728.803647][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7728.804172][ C1] ip_finish_output2+0x786/0x18e0 [ 7728.804605][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7728.805071][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7728.805502][ C1] ? __ip_finish_output+0x10f/0x770 [ 7728.805948][ C1] ip_output+0x16b/0x4f0 [ 7728.806316][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7728.806831][ C1] ? __pfx_ip_output+0x10/0x10 [ 7728.807255][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7728.807825][ C1] ? __pfx_ip_output+0x10/0x10 [ 7728.808253][ C1] __ip_queue_xmit+0x672/0x1910 [ 7728.808669][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7728.809111][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7728.835558][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7728.836049][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7728.836539][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7728.837009][ C1] tcp_delack_timer+0x84/0x240 [ 7728.837428][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7728.837853][ C1] call_timer_fn+0x176/0x430 [ 7728.838228][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7728.838661][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7728.839103][ C1] __run_timers.part.0+0x52d/0x890 [ 7728.839555][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7728.840018][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7728.840493][ C1] ? __pfx___schedule+0x10/0x10 [ 7728.840909][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7728.841427][ C1] run_timer_softirq+0x72/0x100 [ 7728.841834][ C1] __do_softirq+0x1bc/0x7ff [ 7728.842223][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7728.842664][ C1] run_ksoftirqd+0x2e/0x60 [ 7728.843047][ C1] smpboot_thread_fn+0x30e/0x840 [ 7728.843472][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7728.843944][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7728.844405][ C1] kthread+0x292/0x360 [ 7728.844754][ C1] ? __pfx_kthread+0x10/0x10 [ 7728.845146][ C1] ret_from_fork+0x34/0x70 [ 7728.845528][ C1] ? __pfx_kthread+0x10/0x10 [ 7728.845925][ C1] ret_from_fork_asm+0x1b/0x30 [ 7728.846345][ C1] [ 7756.539116][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6117s! [swapper/0:0] [ 7756.539873][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7756.541718][ C0] irq event stamp: 27567077 [ 7756.542104][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7756.542954][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7756.543708][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7756.544513][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7756.545307][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7756.546060][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7756.547124][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7756.547678][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7756.569404][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7756.569935][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7756.570617][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7756.571297][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7756.571981][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7756.572664][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7756.573343][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7756.574097][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7756.574651][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7756.575323][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7756.575989][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7756.576653][ C0] Call Trace: [ 7756.576940][ C0] [ 7756.577185][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7756.577628][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7756.578036][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7756.578515][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7756.578993][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7756.599627][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7756.600093][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7756.600619][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7756.601066][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7756.601513][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7756.602043][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7756.602545][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7756.603084][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7756.603576][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7756.604103][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7756.604609][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7756.605161][ C0] ? get_stack_info+0x36/0xc0 [ 7756.605593][ C0] ? lock_acquire+0x1c1/0x220 [ 7756.606001][ C0] ? lock_release+0x1d5/0x250 [ 7756.606401][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7756.606825][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7756.607284][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7756.607766][ C0] ? lock_acquire+0x1c1/0x220 [ 7756.608173][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7756.608583][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7756.609031][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7756.620550][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7756.620994][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7756.621437][ C0] ? __inet_lookup_established+0x341/0x610 [ 7756.621947][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7756.622430][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7756.622898][ C0] ip_local_deliver+0x19d/0x480 [ 7756.623320][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7756.623781][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7756.624211][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7756.624674][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7756.625116][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7756.625669][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7756.626124][ C0] ip_rcv+0x564/0x740 [ 7756.626509][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7756.626909][ C0] ? set_track_prepare+0x8a/0xd0 [ 7756.627360][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7756.627823][ C0] ? rest_init+0x153/0x260 [ 7756.628211][ C0] ? skb_clone+0x10b/0x330 [ 7756.628596][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7756.629146][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7756.629645][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7756.630106][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7756.630589][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7756.630998][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7756.631379][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7756.631873][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7756.632344][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7756.632874][ C0] ? lock_acquire+0x1c1/0x220 [ 7756.633275][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7756.633762][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7756.634238][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7756.634760][ C0] ? __copy_skb_header+0xaf/0x490 [ 7756.635187][ C0] ? __skb_clone+0x57a/0x760 [ 7756.635614][ C0] netif_receive_skb+0x55/0x280 [ 7756.636035][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7756.636567][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7756.637133][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7756.637632][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7756.638087][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7756.638556][ C0] ? hlock_class+0x4e/0x130 [ 7756.638942][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7756.659583][ C0] ? place_entity+0x21/0x2f0 [ 7756.659981][ C0] ? resched_curr+0x219/0x280 [ 7756.660370][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7756.660792][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7756.661234][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7756.661673][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7756.662084][ C0] ? activate_task+0xf5/0x260 [ 7756.662482][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7756.662916][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7756.663344][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7756.663756][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7756.664212][ C0] ? get_stack_info+0x36/0xc0 [ 7756.664604][ C0] ? stack_access_ok+0xda/0x1f0 [ 7756.665016][ C0] ? get_reg+0x119/0x190 [ 7756.665372][ C0] __tcf_classify+0x32c/0x7d0 [ 7756.665758][ C0] tcf_classify+0x283/0x930 [ 7756.666142][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7756.666672][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7756.667087][ C0] ? arch_stack_walk+0x8c/0x100 [ 7756.667493][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7756.667957][ C0] tc_run+0x2e4/0x5d0 [ 7756.668298][ C0] ? __pfx_tc_run+0x10/0x10 [ 7756.668669][ C0] ? lock_acquire+0x1c1/0x220 [ 7756.669056][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7756.669477][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7756.669893][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7756.670344][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7756.670785][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7756.671293][ C0] ? neigh_hh_output+0x348/0x590 [ 7756.671711][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7756.672149][ C0] ip_finish_output2+0x786/0x18e0 [ 7756.672574][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7756.673039][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7756.673604][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7756.674055][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7756.674475][ C0] ? __ip_finish_output+0x10f/0x770 [ 7756.674919][ C0] ip_output+0x16b/0x4f0 [ 7756.675276][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7756.675716][ C0] ? __pfx_ip_output+0x10/0x10 [ 7756.676116][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7756.676593][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7756.677014][ C0] ? ip_local_out+0x114/0x3b0 [ 7756.677424][ C0] __ip_queue_xmit+0x672/0x1910 [ 7756.677836][ C0] ? __skb_clone+0x57a/0x760 [ 7756.678226][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7756.678680][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7756.699234][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7756.699759][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7756.700165][ C0] ? tcp_current_mss+0x40a/0x510 [ 7756.700583][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7756.701033][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7756.701481][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7756.701891][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7756.702325][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7756.702838][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7756.703288][ C0] ? ktime_get+0xb6/0x190 [ 7756.703667][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7756.704115][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7756.704565][ C0] tcp_write_timer+0x82/0x1d0 [ 7756.704970][ C0] call_timer_fn+0x176/0x430 [ 7756.705378][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7756.705810][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7756.706245][ C0] __run_timers.part.0+0x52d/0x890 [ 7756.706678][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7756.707148][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7756.707684][ C0] ? lock_acquire+0x1c1/0x220 [ 7756.708122][ C0] ? clockevents_program_event+0xf6/0x300 [ 7756.708634][ C0] ? lock_release+0x1d5/0x250 [ 7756.709029][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7756.729568][ C0] ? ktime_get+0xb6/0x190 [ 7756.729950][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7756.730425][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7756.730929][ C0] run_timer_softirq+0x72/0x100 [ 7756.731353][ C0] __do_softirq+0x1bc/0x7ff [ 7756.731746][ C0] irq_exit_rcu+0x98/0xc0 [ 7756.732115][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7756.732595][ C0] [ 7756.732847][ C0] [ 7756.733102][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7756.733623][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7756.734049][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7756.735655][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7756.736166][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7756.736826][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7756.737500][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7756.738173][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7756.738871][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7756.759699][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7756.760227][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7756.760681][ C0] default_idle_call+0x69/0xa0 [ 7756.761102][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7756.761545][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7756.762027][ C0] ? lock_release+0x1d5/0x250 [ 7756.762441][ C0] do_idle+0xfb/0x160 [ 7756.762800][ C0] cpu_startup_entry+0x55/0x60 [ 7756.763222][ C0] rest_init+0x153/0x260 [ 7756.763600][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7756.764075][ C0] arch_call_rest_init+0x13/0x40 [ 7756.764509][ C0] start_kernel+0x314/0x3d0 [ 7756.764917][ C0] x86_64_start_reservations+0x18/0x30 [ 7756.765426][ C0] x86_64_start_kernel+0xba/0x110 [ 7756.765881][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7756.766453][ C0] [ 7756.779094][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6117s! [ksoftirqd/1:22] [ 7756.779888][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7756.781791][ C1] irq event stamp: 3886976 [ 7756.782164][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7756.782948][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7756.783749][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7756.784551][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7756.785343][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7756.786117][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7756.787128][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7756.787678][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7756.805818][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7756.806341][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7756.807013][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7756.807660][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7756.821536][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7756.822215][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7756.822893][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7756.823651][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7756.824205][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7756.824893][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7756.825516][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7756.839377][ C1] Call Trace: [ 7756.839675][ C1] [ 7756.839923][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7756.840379][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7756.840788][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7756.842900][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7756.843370][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7756.843844][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7756.844293][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7756.844809][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7756.845255][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7756.845772][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7756.846271][ C1] [ 7756.846528][ C1] [ 7756.846781][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7756.847294][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7756.847761][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7756.848243][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7756.848720][ C1] ? run_ksoftirqd+0xb/0x60 [ 7756.859209][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7756.859722][ C1] ? __orc_find+0x9c/0xf0 [ 7756.860084][ C1] ? lock_acquire+0x1c1/0x220 [ 7756.860481][ C1] ? irqentry_enter+0x2b/0x60 [ 7756.860866][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7756.861263][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7756.861706][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7756.862178][ C1] ? lock_acquire+0x1c1/0x220 [ 7756.862571][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7756.862979][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7756.863421][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7756.863806][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7756.864210][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7756.864633][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7756.865092][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7756.865574][ C1] ip_local_deliver+0x19d/0x480 [ 7756.865990][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7756.866449][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7756.866892][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7756.867315][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7756.867716][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7756.868230][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7756.868665][ C1] ip_rcv+0x564/0x740 [ 7756.869003][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7756.899477][ C1] ? set_track_prepare+0x8a/0xd0 [ 7756.899896][ C1] ? irqentry_enter+0x2b/0x60 [ 7756.900285][ C1] ? irqentry_enter+0x2b/0x60 [ 7756.900672][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7756.901051][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7756.901539][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7756.902071][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7756.902549][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7756.903055][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7756.903520][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7756.904038][ C1] netif_receive_skb+0x55/0x280 [ 7756.904441][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7756.904945][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7756.905489][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7756.905981][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7756.906430][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7756.906902][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7756.907411][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7756.907843][ C1] ? arch_stack_walk+0x68/0x100 [ 7756.908254][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7756.908726][ C1] ? irqentry_enter+0x2b/0x60 [ 7756.929246][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7756.929799][ C1] ? irqentry_enter+0x2b/0x60 [ 7756.930196][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7756.930697][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7756.931150][ C1] ? arch_stack_walk+0x68/0x100 [ 7756.931568][ C1] __tcf_classify+0x32c/0x7d0 [ 7756.931978][ C1] tcf_classify+0x283/0x930 [ 7756.932362][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7756.932785][ C1] tc_run+0x2e4/0x5d0 [ 7756.933130][ C1] ? __pfx_tc_run+0x10/0x10 [ 7756.933516][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7756.933940][ C1] ? irqentry_enter+0x2b/0x60 [ 7756.934345][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7756.934807][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7756.935332][ C1] ip_finish_output2+0x786/0x18e0 [ 7756.935769][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7756.936227][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7756.936651][ C1] ? __ip_finish_output+0x10f/0x770 [ 7756.937091][ C1] ip_output+0x16b/0x4f0 [ 7756.937456][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7756.937968][ C1] ? __pfx_ip_output+0x10/0x10 [ 7756.938382][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7756.938959][ C1] ? __pfx_ip_output+0x10/0x10 [ 7756.969460][ C1] __ip_queue_xmit+0x672/0x1910 [ 7756.969886][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7756.970326][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7756.970794][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7756.971246][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7756.971715][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7756.972167][ C1] tcp_delack_timer+0x84/0x240 [ 7756.972576][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7756.973030][ C1] call_timer_fn+0x176/0x430 [ 7756.973425][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7756.973855][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7756.974287][ C1] __run_timers.part.0+0x52d/0x890 [ 7756.974714][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7756.975162][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7756.975634][ C1] ? __pfx___schedule+0x10/0x10 [ 7756.976044][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7756.976549][ C1] run_timer_softirq+0x72/0x100 [ 7756.976972][ C1] __do_softirq+0x1bc/0x7ff [ 7756.977368][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7756.977824][ C1] run_ksoftirqd+0x2e/0x60 [ 7756.978202][ C1] smpboot_thread_fn+0x30e/0x840 [ 7756.978618][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7756.999179][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7756.999670][ C1] kthread+0x292/0x360 [ 7757.000017][ C1] ? __pfx_kthread+0x10/0x10 [ 7757.000416][ C1] ret_from_fork+0x34/0x70 [ 7757.000785][ C1] ? __pfx_kthread+0x10/0x10 [ 7757.001171][ C1] ret_from_fork_asm+0x1b/0x30 [ 7757.001577][ C1] [ 7779.369026][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7779.369637][ C0] rcu: 0-....: (6541976 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1550557 [ 7779.370506][ C0] rcu: (t=6585061 jiffies g=1007429 q=31 ncpus=4) [ 7779.371048][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7779.371803][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7779.372826][ C0] RIP: 0010:kasan_check_range+0x161/0x1c0 [ 7779.373318][ C0] Code: 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 48 83 c0 01 48 39 d0 74 a5 <80> 38 00 74 f2 e9 74 ff ff ff b8 01 00 00 00 c3 cc cc cc cc 48 29 [ 7779.374934][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000286 [ 7779.375470][ C0] RAX: ffffed100141336b RBX: ffffed100141336c RCX: ffffffff90c7aaa0 [ 7779.376163][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7779.376850][ C0] RBP: ffffed100141336b R08: 0000000000000000 R09: ffffed100141336b [ 7779.377521][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7779.378178][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7779.378839][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7779.419688][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7779.420251][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7779.420909][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7779.421564][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7779.422209][ C0] Call Trace: [ 7779.422498][ C0] [ 7779.422755][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7779.423241][ C0] ? print_cpu_stall+0x263/0x6a0 [ 7779.423705][ C0] ? check_cpu_stall+0x284/0x500 [ 7779.424122][ C0] ? rcu_pending+0x92/0x360 [ 7779.424509][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7779.424954][ C0] ? update_process_times+0xb9/0x110 [ 7779.425397][ C0] ? tick_sched_handle+0x67/0x130 [ 7779.425830][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7779.426306][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7779.426711][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7779.427238][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7779.427702][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7779.428186][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7779.428651][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7779.449280][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7779.449736][ C0] ? hrtimer_interrupt+0x31a/0x770 [ 7779.450186][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7779.450638][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7779.451193][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7779.451736][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7779.452270][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7779.452764][ C0] ? kasan_check_range+0x161/0x1c0 [ 7779.453211][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 7779.453694][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7779.454220][ C0] ? get_stack_info+0x36/0xc0 [ 7779.454635][ C0] ? lock_acquire+0x1c1/0x220 [ 7779.455085][ C0] ? lock_release+0x1d5/0x250 [ 7779.455525][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7779.455960][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7779.456430][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7779.456909][ C0] ? lock_acquire+0x1c1/0x220 [ 7779.457310][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7779.457724][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7779.458172][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7779.458584][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7779.479124][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7779.479563][ C0] ? __inet_lookup_established+0x341/0x610 [ 7779.480075][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7779.480553][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7779.481027][ C0] ip_local_deliver+0x19d/0x480 [ 7779.481441][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7779.481897][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7779.482322][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7779.482796][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7779.483224][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7779.483772][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7779.484229][ C0] ip_rcv+0x564/0x740 [ 7779.484569][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7779.484950][ C0] ? set_track_prepare+0x8a/0xd0 [ 7779.485364][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7779.485818][ C0] ? rest_init+0x153/0x260 [ 7779.486194][ C0] ? skb_clone+0x10b/0x330 [ 7779.486577][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7779.487112][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7779.487629][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7779.488104][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7779.488596][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7779.519146][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7779.519551][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7779.520065][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7779.520546][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7779.521093][ C0] ? lock_acquire+0x1c1/0x220 [ 7779.521491][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7779.521993][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7779.522474][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7779.523014][ C0] ? __copy_skb_header+0xaf/0x490 [ 7779.523444][ C0] ? __skb_clone+0x57a/0x760 [ 7779.523860][ C0] netif_receive_skb+0x55/0x280 [ 7779.524288][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7779.524859][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7779.525416][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7779.525925][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7779.526400][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7779.526889][ C0] ? hlock_class+0x4e/0x130 [ 7779.527294][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7779.527833][ C0] ? place_entity+0x21/0x2f0 [ 7779.528238][ C0] ? resched_curr+0x219/0x280 [ 7779.528639][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7779.559174][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7779.559672][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7779.560120][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7779.560541][ C0] ? activate_task+0xf5/0x260 [ 7779.560953][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7779.561403][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7779.561844][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7779.562266][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7779.562735][ C0] ? get_stack_info+0x36/0xc0 [ 7779.563147][ C0] ? stack_access_ok+0xda/0x1f0 [ 7779.563562][ C0] ? get_reg+0x119/0x190 [ 7779.563931][ C0] __tcf_classify+0x32c/0x7d0 [ 7779.564373][ C0] tcf_classify+0x283/0x930 [ 7779.564782][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7779.565365][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7779.565804][ C0] ? arch_stack_walk+0x8c/0x100 [ 7779.566226][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7779.566694][ C0] tc_run+0x2e4/0x5d0 [ 7779.567051][ C0] ? __pfx_tc_run+0x10/0x10 [ 7779.567439][ C0] ? lock_acquire+0x1c1/0x220 [ 7779.567842][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7779.568291][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7779.568713][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7779.589281][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7779.589754][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7779.590275][ C0] ? neigh_hh_output+0x348/0x590 [ 7779.590697][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7779.591151][ C0] ip_finish_output2+0x786/0x18e0 [ 7779.591583][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7779.592059][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7779.592628][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7779.593094][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7779.593532][ C0] ? __ip_finish_output+0x10f/0x770 [ 7779.593981][ C0] ip_output+0x16b/0x4f0 [ 7779.594357][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7779.594824][ C0] ? __pfx_ip_output+0x10/0x10 [ 7779.595240][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7779.595726][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7779.596151][ C0] ? ip_local_out+0x114/0x3b0 [ 7779.596565][ C0] __ip_queue_xmit+0x672/0x1910 [ 7779.596984][ C0] ? __skb_clone+0x57a/0x760 [ 7779.597399][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7779.597876][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7779.598380][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7779.598900][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7779.599371][ C0] ? tcp_current_mss+0x40a/0x510 [ 7779.599791][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7779.600239][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7779.600681][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7779.601093][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7779.601520][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7779.602036][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7779.602477][ C0] ? ktime_get+0xb6/0x190 [ 7779.602844][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7779.603301][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7779.603774][ C0] tcp_write_timer+0x82/0x1d0 [ 7779.604198][ C0] call_timer_fn+0x176/0x430 [ 7779.604599][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7779.605039][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7779.605472][ C0] __run_timers.part.0+0x52d/0x890 [ 7779.605916][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7779.606358][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7779.606837][ C0] ? lock_acquire+0x1c1/0x220 [ 7779.607251][ C0] ? clockevents_program_event+0xf6/0x300 [ 7779.607744][ C0] ? lock_release+0x1d5/0x250 [ 7779.608143][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7779.608623][ C0] ? ktime_get+0xb6/0x190 [ 7779.639115][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7779.639610][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7779.640114][ C0] run_timer_softirq+0x72/0x100 [ 7779.640542][ C0] __do_softirq+0x1bc/0x7ff [ 7779.640942][ C0] irq_exit_rcu+0x98/0xc0 [ 7779.641314][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7779.641808][ C0] [ 7779.642067][ C0] [ 7779.642325][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7779.642852][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7779.643299][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7779.645034][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7779.645553][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7779.646235][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7779.646905][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7779.647574][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7779.648240][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7779.648927][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7779.669548][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7779.670009][ C0] default_idle_call+0x69/0xa0 [ 7779.670433][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7779.670872][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7779.671350][ C0] ? lock_release+0x1d5/0x250 [ 7779.671757][ C0] do_idle+0xfb/0x160 [ 7779.672102][ C0] cpu_startup_entry+0x55/0x60 [ 7779.672506][ C0] rest_init+0x153/0x260 [ 7779.672880][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7779.673348][ C0] arch_call_rest_init+0x13/0x40 [ 7779.673785][ C0] start_kernel+0x314/0x3d0 [ 7779.674181][ C0] x86_64_start_reservations+0x18/0x30 [ 7779.674633][ C0] x86_64_start_kernel+0xba/0x110 [ 7779.675068][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7779.675647][ C0] [ 7779.675925][ C0] Sending NMI from CPU 0 to CPUs 1: [ 7779.676367][ C1] NMI backtrace for cpu 1 [ 7779.676377][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7779.676384][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7779.676389][ C1] RIP: 0010:kasan_check_range+0x10f/0x1c0 [ 7779.676403][ C1] Code: 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff 5b b8 01 00 00 00 5d 41 5c cc cc cc cc 41 bc 08 00 00 00 45 29 dc 49 8d 14 2c eb 0c 48 83 [ 7779.676409][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000246 [ 7779.676415][ C1] RAX: 0000000000000001 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7779.676419][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7779.676422][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7779.676426][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7779.676429][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7779.676433][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7779.676437][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7779.676443][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7779.676446][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7779.676449][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7779.676452][ C1] Call Trace: [ 7779.676458][ C1] [ 7779.676461][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 7779.676471][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7779.676479][ C1] ? nmi_handle+0x156/0x420 [ 7779.676489][ C1] ? default_do_nmi+0x41/0x100 [ 7779.676497][ C1] ? exc_nmi+0xf3/0x120 [ 7779.676502][ C1] ? end_repeat_nmi+0xf/0x60 [ 7779.676512][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7779.676522][ C1] ? kasan_check_range+0x10f/0x1c0 [ 7779.676529][ C1] ? kasan_check_range+0x10f/0x1c0 [ 7779.676536][ C1] ? kasan_check_range+0x10f/0x1c0 [ 7779.676542][ C1] [ 7779.676543][ C1] [ 7779.676545][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 7779.676551][ C1] ? run_ksoftirqd+0xb/0x60 [ 7779.676560][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7779.676566][ C1] ? __orc_find+0x9c/0xf0 [ 7779.676573][ C1] ? lock_acquire+0x1c1/0x220 [ 7779.676581][ C1] ? irqentry_enter+0x2b/0x60 [ 7779.676590][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7779.676598][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7779.676603][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7779.676609][ C1] ? lock_acquire+0x1c1/0x220 [ 7779.676613][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7779.676624][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7779.676630][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7779.676644][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7779.676650][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7779.676662][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7779.676675][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7779.676683][ C1] ip_local_deliver+0x19d/0x480 [ 7779.676688][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7779.676693][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7779.676701][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7779.676708][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7779.676712][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7779.676720][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7779.676741][ C1] ip_rcv+0x564/0x740 [ 7779.676746][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7779.676751][ C1] ? set_track_prepare+0x8a/0xd0 [ 7779.676759][ C1] ? irqentry_enter+0x2b/0x60 [ 7779.676766][ C1] ? irqentry_enter+0x2b/0x60 [ 7779.676773][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7779.676777][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7779.676786][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7779.676793][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7779.676798][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7779.676804][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7779.676810][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7779.676820][ C1] netif_receive_skb+0x55/0x280 [ 7779.676827][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7779.676844][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7779.676858][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7779.676872][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7779.676885][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7779.676911][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7779.676929][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7779.676934][ C1] ? arch_stack_walk+0x68/0x100 [ 7779.676942][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7779.676948][ C1] ? irqentry_enter+0x2b/0x60 [ 7779.676954][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7779.676962][ C1] ? irqentry_enter+0x2b/0x60 [ 7779.676968][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7779.676982][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7779.676987][ C1] ? arch_stack_walk+0x68/0x100 [ 7779.676996][ C1] __tcf_classify+0x32c/0x7d0 [ 7779.677005][ C1] tcf_classify+0x283/0x930 [ 7779.677012][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7779.677023][ C1] tc_run+0x2e4/0x5d0 [ 7779.677032][ C1] ? __pfx_tc_run+0x10/0x10 [ 7779.677040][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7779.677049][ C1] ? irqentry_enter+0x2b/0x60 [ 7779.677054][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7779.677059][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7779.677072][ C1] ip_finish_output2+0x786/0x18e0 [ 7779.677083][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7779.677088][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7779.677095][ C1] ? __ip_finish_output+0x10f/0x770 [ 7779.677103][ C1] ip_output+0x16b/0x4f0 [ 7779.677109][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7779.677115][ C1] ? __pfx_ip_output+0x10/0x10 [ 7779.677123][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7779.677136][ C1] ? __pfx_ip_output+0x10/0x10 [ 7779.677143][ C1] __ip_queue_xmit+0x672/0x1910 [ 7779.677152][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7779.677164][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7779.677173][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7779.677180][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7779.677187][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7779.677192][ C1] tcp_delack_timer+0x84/0x240 [ 7779.677199][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7779.677204][ C1] call_timer_fn+0x176/0x430 [ 7779.677214][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7779.677224][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7779.677231][ C1] __run_timers.part.0+0x52d/0x890 [ 7779.677236][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7779.677245][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7779.677254][ C1] ? __pfx___schedule+0x10/0x10 [ 7779.677261][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7779.677271][ C1] run_timer_softirq+0x72/0x100 [ 7779.677277][ C1] __do_softirq+0x1bc/0x7ff [ 7779.677284][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7779.677293][ C1] run_ksoftirqd+0x2e/0x60 [ 7779.677298][ C1] smpboot_thread_fn+0x30e/0x840 [ 7779.677306][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7779.677312][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7779.677317][ C1] kthread+0x292/0x360 [ 7779.677323][ C1] ? __pfx_kthread+0x10/0x10 [ 7779.677328][ C1] ret_from_fork+0x34/0x70 [ 7779.677333][ C1] ? __pfx_kthread+0x10/0x10 [ 7779.677337][ C1] ret_from_fork_asm+0x1b/0x30 [ 7779.677349][ C1] [ 7804.527464][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6162s! [swapper/0:0] [ 7804.528247][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7804.530274][ C0] irq event stamp: 27567077 [ 7804.530671][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7804.531524][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7804.532304][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7804.533144][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7804.533956][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7804.534754][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7804.535760][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7804.536306][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7804.537921][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7804.538455][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7804.539171][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7804.539828][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7804.540481][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7804.541141][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7804.541817][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7804.542598][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7804.543140][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7804.543811][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7804.544475][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7804.545140][ C0] Call Trace: [ 7804.545425][ C0] [ 7804.545676][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7804.546141][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7804.546582][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7804.547083][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7804.547544][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7804.548028][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7804.548469][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7804.549011][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7804.549440][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7804.549890][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7804.550407][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7804.550906][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7804.551473][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7804.551995][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7804.552490][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7804.552975][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7804.553499][ C0] ? get_stack_info+0x36/0xc0 [ 7804.553901][ C0] ? lock_acquire+0x1c1/0x220 [ 7804.554340][ C0] ? lock_release+0x1d5/0x250 [ 7804.554750][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7804.555192][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7804.555648][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7804.556109][ C0] ? lock_acquire+0x1c1/0x220 [ 7804.556512][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7804.556919][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7804.557361][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7804.557753][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7804.558162][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7804.558586][ C0] ? __inet_lookup_established+0x341/0x610 [ 7804.559098][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7804.559557][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7804.560018][ C0] ip_local_deliver+0x19d/0x480 [ 7804.560462][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7804.560939][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7804.561375][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7804.561846][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7804.562271][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7804.562805][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7804.563257][ C0] ip_rcv+0x564/0x740 [ 7804.563603][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7804.563993][ C0] ? set_track_prepare+0x8a/0xd0 [ 7804.564420][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7804.564881][ C0] ? rest_init+0x153/0x260 [ 7804.565284][ C0] ? skb_clone+0x10b/0x330 [ 7804.565695][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7804.566262][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7804.566795][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7804.567263][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7804.567757][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7804.568171][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7804.568559][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7804.569069][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7804.569543][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7804.570104][ C0] ? lock_acquire+0x1c1/0x220 [ 7804.570514][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7804.571020][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7804.571522][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7804.572048][ C0] ? __copy_skb_header+0xaf/0x490 [ 7804.572467][ C0] ? __skb_clone+0x57a/0x760 [ 7804.572861][ C0] netif_receive_skb+0x55/0x280 [ 7804.573282][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7804.573807][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7804.574392][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7804.574929][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7804.575412][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7804.575901][ C0] ? hlock_class+0x4e/0x130 [ 7804.576302][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7804.576836][ C0] ? place_entity+0x21/0x2f0 [ 7804.577240][ C0] ? resched_curr+0x219/0x280 [ 7804.577636][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7804.578062][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7804.578537][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7804.579008][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7804.579434][ C0] ? activate_task+0xf5/0x260 [ 7804.579854][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7804.580294][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7804.580735][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7804.581152][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7804.581613][ C0] ? get_stack_info+0x36/0xc0 [ 7804.582018][ C0] ? stack_access_ok+0xda/0x1f0 [ 7804.582443][ C0] ? get_reg+0x119/0x190 [ 7804.582815][ C0] __tcf_classify+0x32c/0x7d0 [ 7804.583225][ C0] tcf_classify+0x283/0x930 [ 7804.583599][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7804.584129][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7804.584585][ C0] ? arch_stack_walk+0x8c/0x100 [ 7804.584994][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7804.585461][ C0] tc_run+0x2e4/0x5d0 [ 7804.585810][ C0] ? __pfx_tc_run+0x10/0x10 [ 7804.586198][ C0] ? lock_acquire+0x1c1/0x220 [ 7804.586597][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7804.587032][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7804.587462][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7804.587916][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7804.588364][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7804.588885][ C0] ? neigh_hh_output+0x348/0x590 [ 7804.589314][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7804.589793][ C0] ip_finish_output2+0x786/0x18e0 [ 7804.590245][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7804.590731][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7804.591299][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7804.591756][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7804.592184][ C0] ? __ip_finish_output+0x10f/0x770 [ 7804.592618][ C0] ip_output+0x16b/0x4f0 [ 7804.592966][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7804.593452][ C0] ? __pfx_ip_output+0x10/0x10 [ 7804.593868][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7804.594355][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7804.594794][ C0] ? ip_local_out+0x114/0x3b0 [ 7804.595204][ C0] __ip_queue_xmit+0x672/0x1910 [ 7804.595657][ C0] ? __skb_clone+0x57a/0x760 [ 7804.596050][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7804.596504][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7804.596980][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7804.597494][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7804.597907][ C0] ? tcp_current_mss+0x40a/0x510 [ 7804.598331][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7804.598762][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7804.599220][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7804.599627][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7804.600057][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7804.600574][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7804.601017][ C0] ? ktime_get+0xb6/0x190 [ 7804.601430][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7804.601883][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7804.602350][ C0] tcp_write_timer+0x82/0x1d0 [ 7804.602774][ C0] call_timer_fn+0x176/0x430 [ 7804.603179][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7804.603618][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7804.604052][ C0] __run_timers.part.0+0x52d/0x890 [ 7804.604493][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7804.604950][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7804.605434][ C0] ? lock_acquire+0x1c1/0x220 [ 7804.605839][ C0] ? clockevents_program_event+0xf6/0x300 [ 7804.606346][ C0] ? lock_release+0x1d5/0x250 [ 7804.606775][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7804.607248][ C0] ? ktime_get+0xb6/0x190 [ 7804.607635][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7804.608113][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7804.608619][ C0] run_timer_softirq+0x72/0x100 [ 7804.609051][ C0] __do_softirq+0x1bc/0x7ff [ 7804.609448][ C0] irq_exit_rcu+0x98/0xc0 [ 7804.609818][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7804.610307][ C0] [ 7804.610557][ C0] [ 7804.610810][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7804.611325][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7804.611791][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7804.613486][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7804.614011][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7804.614678][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7804.615349][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7804.616007][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7804.616667][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7804.617356][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7804.617861][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7804.618310][ C0] default_idle_call+0x69/0xa0 [ 7804.618748][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7804.619180][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7804.619644][ C0] ? lock_release+0x1d5/0x250 [ 7804.620052][ C0] do_idle+0xfb/0x160 [ 7804.620394][ C0] cpu_startup_entry+0x55/0x60 [ 7804.620798][ C0] rest_init+0x153/0x260 [ 7804.621188][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7804.621665][ C0] arch_call_rest_init+0x13/0x40 [ 7804.622105][ C0] start_kernel+0x314/0x3d0 [ 7804.622518][ C0] x86_64_start_reservations+0x18/0x30 [ 7804.622970][ C0] x86_64_start_kernel+0xba/0x110 [ 7804.623403][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7804.623922][ C0] [ 7804.624193][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6162s! [ksoftirqd/1:22] [ 7804.624960][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7804.626883][ C1] irq event stamp: 3886976 [ 7804.627272][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7804.628120][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7804.628946][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7804.629783][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7804.630575][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7804.631368][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7804.632422][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 7804.632907][ C1] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 7804.634638][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [ 7804.635160][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7804.635833][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7804.636505][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7804.637177][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7804.637896][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7804.638610][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7804.639380][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7804.639937][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7804.640620][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7804.641299][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7804.641975][ C1] Call Trace: [ 7804.642249][ C1] [ 7804.642497][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7804.642933][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7804.643350][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7804.643854][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7804.644359][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7804.644846][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7804.645297][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7804.645823][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7804.646268][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7804.646787][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7804.647291][ C1] [ 7804.647551][ C1] [ 7804.647810][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7804.648349][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7804.648864][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 7804.649349][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 7804.649832][ C1] ? run_ksoftirqd+0xb/0x60 [ 7804.650230][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7804.650797][ C1] ? __orc_find+0x9c/0xf0 [ 7804.651187][ C1] ? lock_acquire+0x1c1/0x220 [ 7804.651630][ C1] ? irqentry_enter+0x2b/0x60 [ 7804.652041][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7804.652464][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7804.652908][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7804.653387][ C1] ? lock_acquire+0x1c1/0x220 [ 7804.653789][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7804.654196][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7804.654640][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7804.655045][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7804.655459][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7804.655888][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7804.656363][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7804.656859][ C1] ip_local_deliver+0x19d/0x480 [ 7804.657293][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7804.657778][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7804.658207][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7804.658652][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7804.659043][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7804.659565][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7804.660014][ C1] ip_rcv+0x564/0x740 [ 7804.660356][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7804.660739][ C1] ? set_track_prepare+0x8a/0xd0 [ 7804.661163][ C1] ? irqentry_enter+0x2b/0x60 [ 7804.661559][ C1] ? irqentry_enter+0x2b/0x60 [ 7804.661949][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7804.662329][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7804.662814][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7804.663335][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7804.663837][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7804.664385][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7804.664879][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7804.665461][ C1] netif_receive_skb+0x55/0x280 [ 7804.665869][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7804.666388][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7804.666926][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7804.667427][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7804.667881][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7804.668345][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7804.668811][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7804.669229][ C1] ? arch_stack_walk+0x68/0x100 [ 7804.669600][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7804.670010][ C1] ? irqentry_enter+0x2b/0x60 [ 7804.670378][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7804.670835][ C1] ? irqentry_enter+0x2b/0x60 [ 7804.671203][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7804.671688][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7804.672116][ C1] ? arch_stack_walk+0x68/0x100 [ 7804.672523][ C1] __tcf_classify+0x32c/0x7d0 [ 7804.672924][ C1] tcf_classify+0x283/0x930 [ 7804.673305][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7804.673698][ C1] tc_run+0x2e4/0x5d0 [ 7804.674016][ C1] ? __pfx_tc_run+0x10/0x10 [ 7804.674378][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7804.674774][ C1] ? irqentry_enter+0x2b/0x60 [ 7804.675145][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7804.675606][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7804.676142][ C1] ip_finish_output2+0x786/0x18e0 [ 7804.676595][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7804.677045][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7804.677453][ C1] ? __ip_finish_output+0x10f/0x770 [ 7804.677884][ C1] ip_output+0x16b/0x4f0 [ 7804.678229][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7804.678724][ C1] ? __pfx_ip_output+0x10/0x10 [ 7804.679142][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7804.679689][ C1] ? __pfx_ip_output+0x10/0x10 [ 7804.680098][ C1] __ip_queue_xmit+0x672/0x1910 [ 7804.680506][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7804.680946][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7804.681402][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7804.681850][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7804.682340][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7804.682811][ C1] tcp_delack_timer+0x84/0x240 [ 7804.683242][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7804.683709][ C1] call_timer_fn+0x176/0x430 [ 7804.684104][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7804.684541][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7804.684988][ C1] __run_timers.part.0+0x52d/0x890 [ 7804.685407][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7804.685856][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7804.686306][ C1] ? __pfx___schedule+0x10/0x10 [ 7804.686749][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7804.687260][ C1] run_timer_softirq+0x72/0x100 [ 7804.687662][ C1] __do_softirq+0x1bc/0x7ff [ 7804.688022][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7804.688396][ C1] run_ksoftirqd+0x2e/0x60 [ 7804.688722][ C1] smpboot_thread_fn+0x30e/0x840 [ 7804.689103][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7804.689497][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7804.689894][ C1] kthread+0x292/0x360 [ 7804.690196][ C1] ? __pfx_kthread+0x10/0x10 [ 7804.690561][ C1] ret_from_fork+0x34/0x70 [ 7804.690911][ C1] ? __pfx_kthread+0x10/0x10 [ 7804.691275][ C1] ret_from_fork_asm+0x1b/0x30 [ 7804.691653][ C1] [ 7832.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6188s! [swapper/0:0] [ 7832.527927][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7832.529130][ C0] irq event stamp: 27567077 [ 7832.529369][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7832.529895][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7832.530372][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7832.530882][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7832.531381][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7832.531863][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7832.532504][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7832.532843][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7832.533862][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7832.534185][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7832.534603][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7832.535023][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7832.535443][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7832.535860][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7832.536281][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7832.536749][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7832.537101][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7832.537525][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7832.537952][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7832.538379][ C0] Call Trace: [ 7832.538560][ C0] [ 7832.538725][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7832.539002][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7832.539260][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7832.539555][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7832.539840][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7832.540143][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7832.540419][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7832.540737][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7832.541015][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7832.541293][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7832.541618][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7832.541930][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7832.542262][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7832.542567][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7832.542882][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7832.543184][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7832.543509][ C0] ? get_stack_info+0x36/0xc0 [ 7832.543766][ C0] ? lock_acquire+0x1c1/0x220 [ 7832.544018][ C0] ? lock_release+0x1d5/0x250 [ 7832.544272][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7832.544533][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7832.544819][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7832.545182][ C0] ? lock_acquire+0x1c1/0x220 [ 7832.545575][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7832.545990][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7832.546441][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7832.546854][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7832.547285][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7832.547735][ C0] ? __inet_lookup_established+0x341/0x610 [ 7832.548255][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7832.548742][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7832.549176][ C0] ip_local_deliver+0x19d/0x480 [ 7832.549542][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7832.549976][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7832.550420][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7832.550881][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7832.551326][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7832.551881][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7832.552340][ C0] ip_rcv+0x564/0x740 [ 7832.552701][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7832.553108][ C0] ? set_track_prepare+0x8a/0xd0 [ 7832.553497][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7832.553902][ C0] ? rest_init+0x153/0x260 [ 7832.554284][ C0] ? skb_clone+0x10b/0x330 [ 7832.554666][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7832.555210][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7832.555735][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7832.556219][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7832.556717][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7832.557136][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7832.557474][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7832.557945][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7832.558421][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7832.558971][ C0] ? lock_acquire+0x1c1/0x220 [ 7832.559367][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7832.559860][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7832.560347][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7832.560883][ C0] ? __copy_skb_header+0xaf/0x490 [ 7832.561299][ C0] ? __skb_clone+0x57a/0x760 [ 7832.561715][ C0] netif_receive_skb+0x55/0x280 [ 7832.562155][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7832.562703][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7832.563283][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7832.563802][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7832.564286][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7832.564757][ C0] ? hlock_class+0x4e/0x130 [ 7832.565119][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7832.565727][ C0] ? place_entity+0x21/0x2f0 [ 7832.566118][ C0] ? resched_curr+0x219/0x280 [ 7832.566485][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7832.566920][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7832.567381][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7832.567848][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7832.568273][ C0] ? activate_task+0xf5/0x260 [ 7832.568684][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7832.569144][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7832.569590][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7832.570015][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7832.570525][ C0] ? get_stack_info+0x36/0xc0 [ 7832.570996][ C0] ? stack_access_ok+0xda/0x1f0 [ 7832.571448][ C0] ? get_reg+0x119/0x190 [ 7832.571823][ C0] __tcf_classify+0x32c/0x7d0 [ 7832.572234][ C0] tcf_classify+0x283/0x930 [ 7832.572630][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7832.573182][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7832.573635][ C0] ? arch_stack_walk+0x8c/0x100 [ 7832.574080][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7832.574574][ C0] tc_run+0x2e4/0x5d0 [ 7832.574917][ C0] ? __pfx_tc_run+0x10/0x10 [ 7832.575345][ C0] ? lock_acquire+0x1c1/0x220 [ 7832.575750][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7832.576144][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7832.576552][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7832.577007][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7832.577454][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7832.577975][ C0] ? neigh_hh_output+0x348/0x590 [ 7832.578405][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7832.578865][ C0] ip_finish_output2+0x786/0x18e0 [ 7832.579300][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7832.579758][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7832.580327][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7832.580792][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7832.581226][ C0] ? __ip_finish_output+0x10f/0x770 [ 7832.581679][ C0] ip_output+0x16b/0x4f0 [ 7832.582059][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7832.582531][ C0] ? __pfx_ip_output+0x10/0x10 [ 7832.582865][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7832.583365][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7832.583833][ C0] ? ip_local_out+0x114/0x3b0 [ 7832.584237][ C0] __ip_queue_xmit+0x672/0x1910 [ 7832.584733][ C0] ? __skb_clone+0x57a/0x760 [ 7832.585132][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7832.585587][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7832.586060][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7832.586570][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7832.586983][ C0] ? tcp_current_mss+0x40a/0x510 [ 7832.587406][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7832.587875][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7832.588325][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7832.588775][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7832.589246][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7832.589815][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7832.590317][ C0] ? ktime_get+0xb6/0x190 [ 7832.590725][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7832.591198][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7832.591713][ C0] tcp_write_timer+0x82/0x1d0 [ 7832.592171][ C0] call_timer_fn+0x176/0x430 [ 7832.592623][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7832.593104][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7832.593596][ C0] __run_timers.part.0+0x52d/0x890 [ 7832.594085][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7832.594603][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7832.595157][ C0] ? lock_acquire+0x1c1/0x220 [ 7832.595622][ C0] ? clockevents_program_event+0xf6/0x300 [ 7832.596195][ C0] ? lock_release+0x1d5/0x250 [ 7832.596673][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7832.597177][ C0] ? ktime_get+0xb6/0x190 [ 7832.597591][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7832.598133][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7832.598692][ C0] run_timer_softirq+0x72/0x100 [ 7832.599176][ C0] __do_softirq+0x1bc/0x7ff [ 7832.599620][ C0] irq_exit_rcu+0x98/0xc0 [ 7832.600031][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7832.600579][ C0] [ 7832.600864][ C0] [ 7832.601165][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7832.601753][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7832.602246][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7832.603878][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7832.604400][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7832.605071][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7832.605743][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7832.606417][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7832.607076][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7832.607745][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7832.608236][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7832.608690][ C0] default_idle_call+0x69/0xa0 [ 7832.609133][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7832.609576][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7832.610072][ C0] ? lock_release+0x1d5/0x250 [ 7832.610490][ C0] do_idle+0xfb/0x160 [ 7832.610840][ C0] cpu_startup_entry+0x55/0x60 [ 7832.611268][ C0] rest_init+0x153/0x260 [ 7832.611597][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7832.612032][ C0] arch_call_rest_init+0x13/0x40 [ 7832.612462][ C0] start_kernel+0x314/0x3d0 [ 7832.612850][ C0] x86_64_start_reservations+0x18/0x30 [ 7832.613326][ C0] x86_64_start_kernel+0xba/0x110 [ 7832.613764][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7832.614297][ C0] [ 7832.614568][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6188s! [ksoftirqd/1:22] [ 7832.615058][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7832.616264][ C1] irq event stamp: 3886976 [ 7832.616503][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7832.617010][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7832.617515][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7832.618025][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7832.618518][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7832.619024][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7832.619668][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7832.620009][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7832.621028][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7832.621350][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7832.621769][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7832.622191][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7832.622611][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7832.623030][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7832.623454][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7832.623925][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7832.624280][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7832.624703][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7832.625131][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7832.625560][ C1] Call Trace: [ 7832.625742][ C1] [ 7832.625901][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7832.626180][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7832.626442][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7832.626736][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7832.627029][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7832.627335][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7832.627617][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7832.627945][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7832.628221][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7832.628551][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7832.628868][ C1] [ 7832.629030][ C1] [ 7832.629192][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7832.629528][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7832.629833][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7832.630146][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7832.630452][ C1] ? run_ksoftirqd+0xb/0x60 [ 7832.630700][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7832.631033][ C1] ? __orc_find+0x9c/0xf0 [ 7832.631264][ C1] ? lock_acquire+0x1c1/0x220 [ 7832.631518][ C1] ? irqentry_enter+0x2b/0x60 [ 7832.631772][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7832.632034][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7832.632319][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7832.632618][ C1] ? lock_acquire+0x1c1/0x220 [ 7832.632873][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7832.633132][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7832.633410][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7832.633655][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7832.633916][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7832.634189][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7832.634481][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7832.634775][ C1] ip_local_deliver+0x19d/0x480 [ 7832.635040][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7832.635329][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7832.635597][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7832.635875][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7832.636139][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7832.636480][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7832.636755][ C1] ip_rcv+0x564/0x740 [ 7832.636969][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7832.637211][ C1] ? set_track_prepare+0x8a/0xd0 [ 7832.637477][ C1] ? irqentry_enter+0x2b/0x60 [ 7832.637732][ C1] ? irqentry_enter+0x2b/0x60 [ 7832.637989][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7832.638235][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7832.638559][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7832.638915][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7832.639225][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7832.639571][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7832.639875][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7832.640209][ C1] netif_receive_skb+0x55/0x280 [ 7832.640469][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7832.640803][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7832.641151][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7832.641478][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7832.641766][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7832.642071][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7832.642399][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7832.642679][ C1] ? arch_stack_walk+0x68/0x100 [ 7832.642946][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7832.643228][ C1] ? irqentry_enter+0x2b/0x60 [ 7832.643482][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7832.643805][ C1] ? irqentry_enter+0x2b/0x60 [ 7832.644054][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7832.644378][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7832.644661][ C1] ? arch_stack_walk+0x68/0x100 [ 7832.644922][ C1] __tcf_classify+0x32c/0x7d0 [ 7832.645176][ C1] tcf_classify+0x283/0x930 [ 7832.645418][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7832.645687][ C1] tc_run+0x2e4/0x5d0 [ 7832.645901][ C1] ? __pfx_tc_run+0x10/0x10 [ 7832.646148][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7832.646415][ C1] ? irqentry_enter+0x2b/0x60 [ 7832.646670][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7832.646960][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7832.647286][ C1] ip_finish_output2+0x786/0x18e0 [ 7832.647557][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7832.647853][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7832.648122][ C1] ? __ip_finish_output+0x10f/0x770 [ 7832.648399][ C1] ip_output+0x16b/0x4f0 [ 7832.648625][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7832.648951][ C1] ? __pfx_ip_output+0x10/0x10 [ 7832.649212][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7832.649566][ C1] ? __pfx_ip_output+0x10/0x10 [ 7832.649824][ C1] __ip_queue_xmit+0x672/0x1910 [ 7832.650092][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7832.650377][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7832.650676][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7832.650966][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7832.651266][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7832.651555][ C1] tcp_delack_timer+0x84/0x240 [ 7832.651812][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7832.652097][ C1] call_timer_fn+0x176/0x430 [ 7832.652344][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7832.652621][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7832.652901][ C1] __run_timers.part.0+0x52d/0x890 [ 7832.653174][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7832.653463][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7832.653767][ C1] ? __pfx___schedule+0x10/0x10 [ 7832.654028][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7832.654347][ C1] run_timer_softirq+0x72/0x100 [ 7832.654614][ C1] __do_softirq+0x1bc/0x7ff [ 7832.654861][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7832.655140][ C1] run_ksoftirqd+0x2e/0x60 [ 7832.655379][ C1] smpboot_thread_fn+0x30e/0x840 [ 7832.655648][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7832.655937][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7832.656229][ C1] kthread+0x292/0x360 [ 7832.656449][ C1] ? __pfx_kthread+0x10/0x10 [ 7832.656700][ C1] ret_from_fork+0x34/0x70 [ 7832.656937][ C1] ? __pfx_kthread+0x10/0x10 [ 7832.657186][ C1] ret_from_fork_asm+0x1b/0x30 [ 7832.657445][ C1] [ 7857.680026][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7857.680422][ C1] rcu: 1-....: (6599915 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1568585 [ 7857.681017][ C1] rcu: (t=6663371 jiffies g=1007429 q=31 ncpus=4) [ 7857.681368][ C1] Sending NMI from CPU 1 to CPUs 0: [ 7857.681657][ C0] NMI backtrace for cpu 0 [ 7857.681665][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7857.681670][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7857.681673][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7857.681682][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7857.681685][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7857.681688][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7857.681690][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7857.681692][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7857.681693][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7857.681695][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7857.681697][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7857.681699][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7857.681703][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7857.681705][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7857.681706][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7857.681708][ C0] Call Trace: [ 7857.681711][ C0] [ 7857.681716][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 7857.681723][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7857.681729][ C0] ? nmi_handle+0x156/0x420 [ 7857.681734][ C0] ? default_do_nmi+0x41/0x100 [ 7857.681737][ C0] ? exc_nmi+0xf3/0x120 [ 7857.681740][ C0] ? end_repeat_nmi+0xf/0x60 [ 7857.681745][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7857.681748][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7857.681752][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7857.681755][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7857.681758][ C0] [ 7857.681759][ C0] [ 7857.681761][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7857.681763][ C0] ? get_stack_info+0x36/0xc0 [ 7857.681768][ C0] ? lock_acquire+0x1c1/0x220 [ 7857.681772][ C0] ? lock_release+0x1d5/0x250 [ 7857.681776][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7857.681780][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7857.681783][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7857.681786][ C0] ? lock_acquire+0x1c1/0x220 [ 7857.681788][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7857.681793][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7857.681797][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7857.681804][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7857.681807][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7857.681811][ C0] ? __inet_lookup_established+0x341/0x610 [ 7857.681817][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7857.681824][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7857.681828][ C0] ip_local_deliver+0x19d/0x480 [ 7857.681831][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7857.681834][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7857.681838][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7857.681842][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7857.681845][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7857.681848][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7857.681858][ C0] ip_rcv+0x564/0x740 [ 7857.681861][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7857.681864][ C0] ? set_track_prepare+0x8a/0xd0 [ 7857.681869][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7857.681871][ C0] ? rest_init+0x153/0x260 [ 7857.681874][ C0] ? skb_clone+0x10b/0x330 [ 7857.681878][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7857.681884][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7857.681889][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7857.681894][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7857.681903][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7857.681906][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7857.681909][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7857.681912][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7857.681915][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7857.681918][ C0] ? lock_acquire+0x1c1/0x220 [ 7857.681921][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7857.681924][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7857.681927][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7857.681930][ C0] ? __copy_skb_header+0xaf/0x490 [ 7857.681933][ C0] ? __skb_clone+0x57a/0x760 [ 7857.681936][ C0] netif_receive_skb+0x55/0x280 [ 7857.681938][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7857.681946][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7857.681953][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7857.681960][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7857.681965][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7857.681973][ C0] ? hlock_class+0x4e/0x130 [ 7857.681979][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7857.681989][ C0] ? place_entity+0x21/0x2f0 [ 7857.681992][ C0] ? resched_curr+0x219/0x280 [ 7857.681996][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7857.681998][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7857.682001][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7857.682006][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7857.682008][ C0] ? activate_task+0xf5/0x260 [ 7857.682011][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7857.682016][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7857.682019][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7857.682024][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7857.682027][ C0] ? get_stack_info+0x36/0xc0 [ 7857.682031][ C0] ? stack_access_ok+0xda/0x1f0 [ 7857.682033][ C0] ? get_reg+0x119/0x190 [ 7857.682036][ C0] __tcf_classify+0x32c/0x7d0 [ 7857.682041][ C0] tcf_classify+0x283/0x930 [ 7857.682044][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7857.682049][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7857.682050][ C0] ? arch_stack_walk+0x8c/0x100 [ 7857.682056][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7857.682059][ C0] tc_run+0x2e4/0x5d0 [ 7857.682063][ C0] ? __pfx_tc_run+0x10/0x10 [ 7857.682067][ C0] ? lock_acquire+0x1c1/0x220 [ 7857.682069][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7857.682074][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7857.682079][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7857.682082][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7857.682086][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7857.682091][ C0] ? neigh_hh_output+0x348/0x590 [ 7857.682095][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7857.682099][ C0] ip_finish_output2+0x786/0x18e0 [ 7857.682103][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7857.682108][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7857.682115][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7857.682118][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7857.682122][ C0] ? __ip_finish_output+0x10f/0x770 [ 7857.682126][ C0] ip_output+0x16b/0x4f0 [ 7857.682129][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7857.682135][ C0] ? __pfx_ip_output+0x10/0x10 [ 7857.682138][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7857.682143][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7857.682146][ C0] ? ip_local_out+0x114/0x3b0 [ 7857.682150][ C0] __ip_queue_xmit+0x672/0x1910 [ 7857.682154][ C0] ? __skb_clone+0x57a/0x760 [ 7857.682157][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7857.682164][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7857.682168][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7857.682172][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7857.682177][ C0] ? tcp_current_mss+0x40a/0x510 [ 7857.682179][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7857.682182][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7857.682185][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7857.682187][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7857.682190][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7857.682194][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7857.682198][ C0] ? ktime_get+0xb6/0x190 [ 7857.682202][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7857.682206][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7857.682209][ C0] tcp_write_timer+0x82/0x1d0 [ 7857.682212][ C0] call_timer_fn+0x176/0x430 [ 7857.682216][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7857.682221][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7857.682225][ C0] __run_timers.part.0+0x52d/0x890 [ 7857.682228][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7857.682233][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7857.682236][ C0] ? lock_acquire+0x1c1/0x220 [ 7857.682238][ C0] ? clockevents_program_event+0xf6/0x300 [ 7857.682242][ C0] ? lock_release+0x1d5/0x250 [ 7857.682245][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7857.682247][ C0] ? ktime_get+0xb6/0x190 [ 7857.682250][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7857.682253][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7857.682258][ C0] run_timer_softirq+0x72/0x100 [ 7857.682261][ C0] __do_softirq+0x1bc/0x7ff [ 7857.682266][ C0] irq_exit_rcu+0x98/0xc0 [ 7857.682268][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7857.682272][ C0] [ 7857.682273][ C0] [ 7857.682274][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7857.682280][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7857.682283][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7857.682285][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7857.682287][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7857.682289][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7857.682291][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7857.682292][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7857.682293][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7857.682297][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7857.682300][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7857.682304][ C0] default_idle_call+0x69/0xa0 [ 7857.682306][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7857.682309][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7857.682313][ C0] ? lock_release+0x1d5/0x250 [ 7857.682317][ C0] do_idle+0xfb/0x160 [ 7857.682320][ C0] cpu_startup_entry+0x55/0x60 [ 7857.682322][ C0] rest_init+0x153/0x260 [ 7857.682324][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7857.682330][ C0] arch_call_rest_init+0x13/0x40 [ 7857.682335][ C0] start_kernel+0x314/0x3d0 [ 7857.682339][ C0] x86_64_start_reservations+0x18/0x30 [ 7857.682344][ C0] x86_64_start_kernel+0xba/0x110 [ 7857.682348][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7857.682355][ C0] [ 7857.682652][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7857.737109][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7857.737758][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7857.738107][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7857.739138][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7857.739467][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7857.739897][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7857.740320][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7857.740743][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7857.741169][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7857.741596][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7857.742073][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7857.742424][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7857.742852][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7857.743275][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7857.743696][ C1] Call Trace: [ 7857.743875][ C1] [ 7857.744033][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7857.744325][ C1] ? print_cpu_stall+0x263/0x6a0 [ 7857.744590][ C1] ? check_cpu_stall+0x284/0x500 [ 7857.744863][ C1] ? rcu_pending+0x92/0x360 [ 7857.745107][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7857.745390][ C1] ? update_process_times+0xb9/0x110 [ 7857.745678][ C1] ? tick_sched_handle+0x67/0x130 [ 7857.745948][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7857.746247][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7857.746503][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7857.746830][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7857.747119][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7857.747427][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7857.747711][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7857.748037][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7857.748315][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7857.748648][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7857.748962][ C1] [ 7857.749123][ C1] [ 7857.749283][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7857.749618][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7857.749921][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7857.750233][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7857.750541][ C1] ? run_ksoftirqd+0xb/0x60 [ 7857.750791][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7857.751125][ C1] ? __orc_find+0x9c/0xf0 [ 7857.751355][ C1] ? lock_acquire+0x1c1/0x220 [ 7857.751606][ C1] ? irqentry_enter+0x2b/0x60 [ 7857.751857][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7857.752118][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7857.752411][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7857.752711][ C1] ? lock_acquire+0x1c1/0x220 [ 7857.752964][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7857.753222][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7857.753498][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7857.753743][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7857.754003][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7857.754274][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7857.754564][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7857.754853][ C1] ip_local_deliver+0x19d/0x480 [ 7857.755121][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7857.755413][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7857.755683][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7857.755965][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7857.756230][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7857.756570][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7857.756845][ C1] ip_rcv+0x564/0x740 [ 7857.757062][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7857.757306][ C1] ? set_track_prepare+0x8a/0xd0 [ 7857.757573][ C1] ? irqentry_enter+0x2b/0x60 [ 7857.757827][ C1] ? irqentry_enter+0x2b/0x60 [ 7857.758083][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7857.758329][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7857.758658][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7857.758998][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7857.759308][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7857.759651][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7857.759953][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7857.760286][ C1] netif_receive_skb+0x55/0x280 [ 7857.760546][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7857.760875][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7857.761225][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7857.761542][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7857.761832][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7857.762136][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7857.762463][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7857.762743][ C1] ? arch_stack_walk+0x68/0x100 [ 7857.763007][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7857.763288][ C1] ? irqentry_enter+0x2b/0x60 [ 7857.763542][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7857.763867][ C1] ? irqentry_enter+0x2b/0x60 [ 7857.764119][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7857.764440][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7857.764724][ C1] ? arch_stack_walk+0x68/0x100 [ 7857.764984][ C1] __tcf_classify+0x32c/0x7d0 [ 7857.765235][ C1] tcf_classify+0x283/0x930 [ 7857.765477][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7857.765747][ C1] tc_run+0x2e4/0x5d0 [ 7857.765964][ C1] ? __pfx_tc_run+0x10/0x10 [ 7857.766210][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7857.766477][ C1] ? irqentry_enter+0x2b/0x60 [ 7857.766731][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7857.767020][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7857.767348][ C1] ip_finish_output2+0x786/0x18e0 [ 7857.767620][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7857.767909][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7857.768178][ C1] ? __ip_finish_output+0x10f/0x770 [ 7857.768456][ C1] ip_output+0x16b/0x4f0 [ 7857.768690][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7857.769009][ C1] ? __pfx_ip_output+0x10/0x10 [ 7857.769272][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7857.769625][ C1] ? __pfx_ip_output+0x10/0x10 [ 7857.769879][ C1] __ip_queue_xmit+0x672/0x1910 [ 7857.770145][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7857.770431][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7857.770730][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7857.771024][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7857.771327][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7857.771618][ C1] tcp_delack_timer+0x84/0x240 [ 7857.771878][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7857.772166][ C1] call_timer_fn+0x176/0x430 [ 7857.772416][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7857.772693][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7857.772971][ C1] __run_timers.part.0+0x52d/0x890 [ 7857.773245][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7857.773538][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7857.773843][ C1] ? __pfx___schedule+0x10/0x10 [ 7857.774103][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7857.774423][ C1] run_timer_softirq+0x72/0x100 [ 7857.774686][ C1] __do_softirq+0x1bc/0x7ff [ 7857.774933][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7857.775211][ C1] run_ksoftirqd+0x2e/0x60 [ 7857.775448][ C1] smpboot_thread_fn+0x30e/0x840 [ 7857.775718][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7857.776011][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7857.776305][ C1] kthread+0x292/0x360 [ 7857.776521][ C1] ? __pfx_kthread+0x10/0x10 [ 7857.776771][ C1] ret_from_fork+0x34/0x70 [ 7857.777010][ C1] ? __pfx_kthread+0x10/0x10 [ 7857.777260][ C1] ret_from_fork_asm+0x1b/0x30 [ 7857.777523][ C1] [ 7884.527469][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6237s! [swapper/0:0] [ 7884.527933][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7884.529139][ C0] irq event stamp: 27567077 [ 7884.529385][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7884.529918][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7884.530395][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7884.530897][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7884.531391][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7884.531869][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7884.532517][ C0] RIP: 0010:kasan_check_range+0x10f/0x1c0 [ 7884.532827][ C0] Code: 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff 5b b8 01 00 00 00 5d 41 5c cc cc cc cc 41 bc 08 00 00 00 45 29 dc 49 8d 14 2c eb 0c 48 83 [ 7884.533851][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000246 [ 7884.534180][ C0] RAX: 0000000000000001 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7884.534600][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7884.535019][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7884.535443][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7884.535867][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7884.536288][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7884.536757][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7884.537105][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7884.537526][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7884.537943][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7884.538361][ C0] Call Trace: [ 7884.538543][ C0] [ 7884.538703][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7884.538976][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7884.539234][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7884.539521][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7884.539808][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7884.540116][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7884.540400][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7884.540726][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7884.541000][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7884.541279][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7884.541600][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7884.541911][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7884.542243][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7884.542546][ C0] ? kasan_check_range+0x10f/0x1c0 [ 7884.542821][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 7884.543123][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7884.543451][ C0] ? get_stack_info+0x36/0xc0 [ 7884.543703][ C0] ? lock_acquire+0x1c1/0x220 [ 7884.543953][ C0] ? lock_release+0x1d5/0x250 [ 7884.544205][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7884.544464][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7884.544749][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7884.545048][ C0] ? lock_acquire+0x1c1/0x220 [ 7884.545300][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7884.545554][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7884.545830][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7884.546078][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7884.546335][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7884.546602][ C0] ? __inet_lookup_established+0x341/0x610 [ 7884.546913][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7884.547216][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7884.547506][ C0] ip_local_deliver+0x19d/0x480 [ 7884.547771][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7884.548061][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7884.548328][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7884.548614][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7884.548881][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7884.549216][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7884.549495][ C0] ip_rcv+0x564/0x740 [ 7884.549708][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7884.549950][ C0] ? set_track_prepare+0x8a/0xd0 [ 7884.550215][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7884.550506][ C0] ? rest_init+0x153/0x260 [ 7884.550743][ C0] ? skb_clone+0x10b/0x330 [ 7884.550984][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7884.551315][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7884.551633][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7884.551930][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7884.552243][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7884.552506][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7884.552751][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7884.553067][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7884.553369][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7884.553708][ C0] ? lock_acquire+0x1c1/0x220 [ 7884.553957][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7884.554264][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7884.554566][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7884.554900][ C0] ? __copy_skb_header+0xaf/0x490 [ 7884.555167][ C0] ? __skb_clone+0x57a/0x760 [ 7884.555410][ C0] netif_receive_skb+0x55/0x280 [ 7884.555670][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7884.556001][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7884.556351][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7884.556665][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7884.556956][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7884.557260][ C0] ? hlock_class+0x4e/0x130 [ 7884.557512][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7884.557843][ C0] ? place_entity+0x21/0x2f0 [ 7884.558093][ C0] ? resched_curr+0x219/0x280 [ 7884.558341][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7884.558616][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7884.558903][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7884.559181][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7884.559438][ C0] ? activate_task+0xf5/0x260 [ 7884.559688][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7884.559961][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7884.560237][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7884.560496][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7884.560789][ C0] ? get_stack_info+0x36/0xc0 [ 7884.561043][ C0] ? stack_access_ok+0xda/0x1f0 [ 7884.561305][ C0] ? get_reg+0x119/0x190 [ 7884.561536][ C0] __tcf_classify+0x32c/0x7d0 [ 7884.561786][ C0] tcf_classify+0x283/0x930 [ 7884.562026][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7884.562354][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7884.562623][ C0] ? arch_stack_walk+0x8c/0x100 [ 7884.562887][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7884.563181][ C0] tc_run+0x2e4/0x5d0 [ 7884.563399][ C0] ? __pfx_tc_run+0x10/0x10 [ 7884.563645][ C0] ? lock_acquire+0x1c1/0x220 [ 7884.563895][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7884.564167][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7884.564437][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7884.564722][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7884.564998][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7884.565316][ C0] ? neigh_hh_output+0x348/0x590 [ 7884.565582][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7884.565857][ C0] ip_finish_output2+0x786/0x18e0 [ 7884.566125][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7884.566418][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7884.566772][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7884.567064][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7884.567327][ C0] ? __ip_finish_output+0x10f/0x770 [ 7884.567608][ C0] ip_output+0x16b/0x4f0 [ 7884.567838][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7884.568119][ C0] ? __pfx_ip_output+0x10/0x10 [ 7884.568375][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7884.568683][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7884.568947][ C0] ? ip_local_out+0x114/0x3b0 [ 7884.569205][ C0] __ip_queue_xmit+0x672/0x1910 [ 7884.569468][ C0] ? __skb_clone+0x57a/0x760 [ 7884.569717][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7884.569998][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7884.570294][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7884.570611][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7884.570872][ C0] ? tcp_current_mss+0x40a/0x510 [ 7884.571136][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7884.571418][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7884.571694][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7884.571948][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7884.572221][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7884.572545][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7884.572821][ C0] ? ktime_get+0xb6/0x190 [ 7884.573052][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7884.573323][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7884.573607][ C0] tcp_write_timer+0x82/0x1d0 [ 7884.573858][ C0] call_timer_fn+0x176/0x430 [ 7884.574107][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7884.574382][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7884.574653][ C0] __run_timers.part.0+0x52d/0x890 [ 7884.574928][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7884.575211][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7884.575513][ C0] ? lock_acquire+0x1c1/0x220 [ 7884.575765][ C0] ? clockevents_program_event+0xf6/0x300 [ 7884.576068][ C0] ? lock_release+0x1d5/0x250 [ 7884.576314][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7884.576589][ C0] ? ktime_get+0xb6/0x190 [ 7884.576819][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7884.577116][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7884.577431][ C0] run_timer_softirq+0x72/0x100 [ 7884.577690][ C0] __do_softirq+0x1bc/0x7ff [ 7884.577934][ C0] irq_exit_rcu+0x98/0xc0 [ 7884.578164][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7884.578462][ C0] [ 7884.578626][ C0] [ 7884.578782][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7884.579099][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7884.579373][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7884.580395][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7884.580719][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7884.581144][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7884.581561][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7884.581983][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7884.582405][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7884.582829][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7884.583133][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7884.583408][ C0] default_idle_call+0x69/0xa0 [ 7884.583664][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7884.583928][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7884.584219][ C0] ? lock_release+0x1d5/0x250 [ 7884.584474][ C0] do_idle+0xfb/0x160 [ 7884.584697][ C0] cpu_startup_entry+0x55/0x60 [ 7884.584954][ C0] rest_init+0x153/0x260 [ 7884.585179][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7884.585471][ C0] arch_call_rest_init+0x13/0x40 [ 7884.585739][ C0] start_kernel+0x314/0x3d0 [ 7884.585981][ C0] x86_64_start_reservations+0x18/0x30 [ 7884.586272][ C0] x86_64_start_kernel+0xba/0x110 [ 7884.586541][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7884.586869][ C0] [ 7884.587036][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6237s! [ksoftirqd/1:22] [ 7884.587519][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7884.588733][ C1] irq event stamp: 3886976 [ 7884.588975][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7884.589478][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7884.589977][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7884.590482][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7884.590980][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7884.591479][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7884.592124][ C1] RIP: 0010:kasan_check_range+0x84/0x1c0 [ 7884.592429][ C1] Code: 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 89 da 48 29 ea <48> 83 fa 10 0f 8e c0 00 00 00 41 89 eb 41 83 e3 07 75 7d 48 85 d2 [ 7884.593463][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000202 [ 7884.593790][ C1] RAX: ffffed10014131c3 RBX: ffffed10014131c4 RCX: ffffffff90c7aaa0 [ 7884.594220][ C1] RDX: 0000000000000001 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7884.594643][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: ffffed10014131c3 [ 7884.595068][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7884.595501][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7884.595928][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7884.596408][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7884.596758][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7884.597188][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7884.597609][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7884.598028][ C1] Call Trace: [ 7884.598206][ C1] [ 7884.598363][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7884.598653][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7884.598912][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7884.599210][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7884.599500][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7884.599812][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7884.600102][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7884.600429][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7884.600706][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7884.601035][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7884.601351][ C1] [ 7884.601508][ C1] [ 7884.601666][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7884.602001][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7884.602311][ C1] ? kasan_check_range+0x84/0x1c0 [ 7884.602585][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 7884.602887][ C1] ? run_ksoftirqd+0xb/0x60 [ 7884.603136][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7884.603466][ C1] ? __orc_find+0x9c/0xf0 [ 7884.603698][ C1] ? lock_acquire+0x1c1/0x220 [ 7884.603950][ C1] ? irqentry_enter+0x2b/0x60 [ 7884.604202][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7884.604462][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7884.604746][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7884.605048][ C1] ? lock_acquire+0x1c1/0x220 [ 7884.605305][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7884.605565][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7884.605842][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7884.606088][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7884.606346][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7884.606617][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7884.606910][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7884.607203][ C1] ip_local_deliver+0x19d/0x480 [ 7884.607465][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7884.607754][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7884.608025][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7884.608303][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7884.608577][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7884.608917][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7884.609199][ C1] ip_rcv+0x564/0x740 [ 7884.609418][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7884.609666][ C1] ? set_track_prepare+0x8a/0xd0 [ 7884.609936][ C1] ? irqentry_enter+0x2b/0x60 [ 7884.610191][ C1] ? irqentry_enter+0x2b/0x60 [ 7884.610444][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7884.610686][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7884.611001][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7884.611343][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7884.611654][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7884.612001][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7884.612306][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7884.612641][ C1] netif_receive_skb+0x55/0x280 [ 7884.612900][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7884.613230][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7884.613581][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7884.613900][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7884.614193][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7884.614499][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7884.614830][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7884.615116][ C1] ? arch_stack_walk+0x68/0x100 [ 7884.615382][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7884.615664][ C1] ? irqentry_enter+0x2b/0x60 [ 7884.615921][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7884.616245][ C1] ? irqentry_enter+0x2b/0x60 [ 7884.616494][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7884.616816][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7884.617101][ C1] ? arch_stack_walk+0x68/0x100 [ 7884.617365][ C1] __tcf_classify+0x32c/0x7d0 [ 7884.617616][ C1] tcf_classify+0x283/0x930 [ 7884.617859][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7884.618130][ C1] tc_run+0x2e4/0x5d0 [ 7884.618347][ C1] ? __pfx_tc_run+0x10/0x10 [ 7884.618599][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7884.618873][ C1] ? irqentry_enter+0x2b/0x60 [ 7884.619131][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7884.619419][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7884.619742][ C1] ip_finish_output2+0x786/0x18e0 [ 7884.620019][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7884.620315][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7884.620581][ C1] ? __ip_finish_output+0x10f/0x770 [ 7884.620864][ C1] ip_output+0x16b/0x4f0 [ 7884.621096][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7884.621414][ C1] ? __pfx_ip_output+0x10/0x10 [ 7884.621673][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7884.622031][ C1] ? __pfx_ip_output+0x10/0x10 [ 7884.622289][ C1] __ip_queue_xmit+0x672/0x1910 [ 7884.622555][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7884.622841][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7884.623146][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7884.623435][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7884.623735][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7884.624026][ C1] tcp_delack_timer+0x84/0x240 [ 7884.624288][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7884.624576][ C1] call_timer_fn+0x176/0x430 [ 7884.624826][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7884.625107][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7884.625388][ C1] __run_timers.part.0+0x52d/0x890 [ 7884.625661][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7884.625954][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7884.626262][ C1] ? __pfx___schedule+0x10/0x10 [ 7884.626524][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7884.626847][ C1] run_timer_softirq+0x72/0x100 [ 7884.627113][ C1] __do_softirq+0x1bc/0x7ff [ 7884.627362][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7884.627642][ C1] run_ksoftirqd+0x2e/0x60 [ 7884.627880][ C1] smpboot_thread_fn+0x30e/0x840 [ 7884.628151][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7884.628442][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7884.628742][ C1] kthread+0x292/0x360 [ 7884.628967][ C1] ? __pfx_kthread+0x10/0x10 [ 7884.629218][ C1] ret_from_fork+0x34/0x70 [ 7884.629461][ C1] ? __pfx_kthread+0x10/0x10 [ 7884.629705][ C1] ret_from_fork_asm+0x1b/0x30 [ 7884.629967][ C1] [ 7912.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6263s! [swapper/0:0] [ 7912.527919][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7912.529125][ C0] irq event stamp: 27567077 [ 7912.529369][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7912.529900][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7912.530374][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7912.530873][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7912.531363][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7912.531842][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7912.532493][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7912.532835][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7912.533857][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7912.534186][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7912.534607][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7912.535030][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7912.535455][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7912.535881][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7912.536304][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7912.536776][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7912.537122][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7912.537542][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7912.537956][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7912.538379][ C0] Call Trace: [ 7912.538561][ C0] [ 7912.538718][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7912.538990][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7912.539244][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7912.539530][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7912.539816][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7912.540121][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7912.540400][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7912.540721][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7912.540993][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7912.541271][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7912.541589][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7912.541898][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7912.542228][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7912.542529][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7912.542834][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7912.543140][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7912.543466][ C0] ? get_stack_info+0x36/0xc0 [ 7912.543718][ C0] ? lock_acquire+0x1c1/0x220 [ 7912.543968][ C0] ? lock_release+0x1d5/0x250 [ 7912.544222][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7912.544480][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7912.544764][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7912.545061][ C0] ? lock_acquire+0x1c1/0x220 [ 7912.545311][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7912.545563][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7912.545837][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7912.546082][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7912.546338][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7912.546604][ C0] ? __inet_lookup_established+0x341/0x610 [ 7912.546915][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7912.547211][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7912.547503][ C0] ip_local_deliver+0x19d/0x480 [ 7912.547761][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7912.548043][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7912.548306][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7912.548587][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7912.548847][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7912.549185][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7912.549458][ C0] ip_rcv+0x564/0x740 [ 7912.549669][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7912.549907][ C0] ? set_track_prepare+0x8a/0xd0 [ 7912.550169][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7912.550460][ C0] ? rest_init+0x153/0x260 [ 7912.550694][ C0] ? skb_clone+0x10b/0x330 [ 7912.550935][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7912.551269][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7912.551587][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7912.551886][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7912.552197][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7912.552458][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7912.552706][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7912.553027][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7912.553333][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7912.553671][ C0] ? lock_acquire+0x1c1/0x220 [ 7912.553918][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7912.554228][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7912.554528][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7912.554858][ C0] ? __copy_skb_header+0xaf/0x490 [ 7912.555125][ C0] ? __skb_clone+0x57a/0x760 [ 7912.555369][ C0] netif_receive_skb+0x55/0x280 [ 7912.555633][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7912.555964][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7912.556316][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7912.556625][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7912.556915][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7912.557217][ C0] ? hlock_class+0x4e/0x130 [ 7912.557465][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7912.557797][ C0] ? place_entity+0x21/0x2f0 [ 7912.558047][ C0] ? resched_curr+0x219/0x280 [ 7912.558297][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7912.558574][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7912.558857][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7912.559135][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7912.559392][ C0] ? activate_task+0xf5/0x260 [ 7912.559639][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7912.559913][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7912.560187][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7912.560444][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7912.560735][ C0] ? get_stack_info+0x36/0xc0 [ 7912.560992][ C0] ? stack_access_ok+0xda/0x1f0 [ 7912.561253][ C0] ? get_reg+0x119/0x190 [ 7912.561481][ C0] __tcf_classify+0x32c/0x7d0 [ 7912.561732][ C0] tcf_classify+0x283/0x930 [ 7912.561972][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7912.562297][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7912.562569][ C0] ? arch_stack_walk+0x8c/0x100 [ 7912.562832][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7912.563123][ C0] tc_run+0x2e4/0x5d0 [ 7912.563336][ C0] ? __pfx_tc_run+0x10/0x10 [ 7912.563575][ C0] ? lock_acquire+0x1c1/0x220 [ 7912.563822][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7912.564097][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7912.564365][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7912.564647][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7912.564921][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7912.565239][ C0] ? neigh_hh_output+0x348/0x590 [ 7912.565507][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7912.565784][ C0] ip_finish_output2+0x786/0x18e0 [ 7912.566051][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7912.566337][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7912.566695][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7912.566990][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7912.567254][ C0] ? __ip_finish_output+0x10f/0x770 [ 7912.567533][ C0] ip_output+0x16b/0x4f0 [ 7912.567760][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7912.568042][ C0] ? __pfx_ip_output+0x10/0x10 [ 7912.568300][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7912.568609][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7912.568871][ C0] ? ip_local_out+0x114/0x3b0 [ 7912.569124][ C0] __ip_queue_xmit+0x672/0x1910 [ 7912.569388][ C0] ? __skb_clone+0x57a/0x760 [ 7912.569636][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7912.569914][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7912.570206][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7912.570522][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7912.570780][ C0] ? tcp_current_mss+0x40a/0x510 [ 7912.571042][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7912.571326][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7912.571600][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7912.571851][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7912.572123][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7912.572441][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7912.572716][ C0] ? ktime_get+0xb6/0x190 [ 7912.572946][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7912.573219][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7912.573504][ C0] tcp_write_timer+0x82/0x1d0 [ 7912.573752][ C0] call_timer_fn+0x176/0x430 [ 7912.573995][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7912.574272][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7912.574545][ C0] __run_timers.part.0+0x52d/0x890 [ 7912.574819][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7912.575100][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7912.575398][ C0] ? lock_acquire+0x1c1/0x220 [ 7912.575645][ C0] ? clockevents_program_event+0xf6/0x300 [ 7912.575947][ C0] ? lock_release+0x1d5/0x250 [ 7912.576197][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7912.576472][ C0] ? ktime_get+0xb6/0x190 [ 7912.576700][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7912.576997][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7912.577313][ C0] run_timer_softirq+0x72/0x100 [ 7912.577568][ C0] __do_softirq+0x1bc/0x7ff [ 7912.577813][ C0] irq_exit_rcu+0x98/0xc0 [ 7912.578042][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7912.578344][ C0] [ 7912.578504][ C0] [ 7912.578660][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7912.578981][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7912.579252][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7912.580278][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7912.580605][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7912.581024][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7912.581446][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7912.581869][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7912.582289][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7912.582712][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7912.583017][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7912.583292][ C0] default_idle_call+0x69/0xa0 [ 7912.583543][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7912.583808][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7912.584099][ C0] ? lock_release+0x1d5/0x250 [ 7912.584350][ C0] do_idle+0xfb/0x160 [ 7912.584563][ C0] cpu_startup_entry+0x55/0x60 [ 7912.584817][ C0] rest_init+0x153/0x260 [ 7912.585043][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7912.585331][ C0] arch_call_rest_init+0x13/0x40 [ 7912.585596][ C0] start_kernel+0x314/0x3d0 [ 7912.585835][ C0] x86_64_start_reservations+0x18/0x30 [ 7912.586124][ C0] x86_64_start_kernel+0xba/0x110 [ 7912.586395][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7912.586722][ C0] [ 7912.586892][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6263s! [ksoftirqd/1:22] [ 7912.587395][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7912.588656][ C1] irq event stamp: 3886976 [ 7912.588907][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7912.589432][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7912.589945][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7912.590462][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7912.590979][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7912.591482][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7912.592135][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7912.592482][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7912.593524][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7912.593850][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7912.594283][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7912.594709][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7912.595136][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7912.595561][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7912.595989][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7912.596470][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7912.596829][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7912.597263][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7912.597697][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7912.598130][ C1] Call Trace: [ 7912.598315][ C1] [ 7912.598485][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7912.598770][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7912.599036][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7912.599338][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7912.599632][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7912.599940][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7912.600227][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7912.600557][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7912.600841][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7912.601172][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7912.601489][ C1] [ 7912.601655][ C1] [ 7912.601820][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7912.602165][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7912.602475][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7912.602791][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7912.603106][ C1] ? run_ksoftirqd+0xb/0x60 [ 7912.603360][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7912.603698][ C1] ? __orc_find+0x9c/0xf0 [ 7912.603934][ C1] ? lock_acquire+0x1c1/0x220 [ 7912.604192][ C1] ? irqentry_enter+0x2b/0x60 [ 7912.604449][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7912.604714][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7912.605004][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7912.605322][ C1] ? lock_acquire+0x1c1/0x220 [ 7912.605584][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7912.605849][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7912.606132][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7912.606384][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7912.606647][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7912.606925][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7912.607224][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7912.607522][ C1] ip_local_deliver+0x19d/0x480 [ 7912.607790][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7912.608084][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7912.608370][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7912.608658][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7912.608930][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7912.609277][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7912.609565][ C1] ip_rcv+0x564/0x740 [ 7912.609787][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7912.610038][ C1] ? set_track_prepare+0x8a/0xd0 [ 7912.610312][ C1] ? irqentry_enter+0x2b/0x60 [ 7912.610567][ C1] ? irqentry_enter+0x2b/0x60 [ 7912.610824][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7912.611070][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7912.611390][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7912.611736][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7912.612056][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7912.612422][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7912.612730][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7912.613070][ C1] netif_receive_skb+0x55/0x280 [ 7912.613333][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7912.613668][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7912.614024][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7912.614348][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7912.614645][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7912.614955][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7912.615294][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7912.615583][ C1] ? arch_stack_walk+0x68/0x100 [ 7912.615857][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7912.616145][ C1] ? irqentry_enter+0x2b/0x60 [ 7912.616408][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7912.616736][ C1] ? irqentry_enter+0x2b/0x60 [ 7912.617004][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7912.617334][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7912.617624][ C1] ? arch_stack_walk+0x68/0x100 [ 7912.617894][ C1] __tcf_classify+0x32c/0x7d0 [ 7912.618155][ C1] tcf_classify+0x283/0x930 [ 7912.618412][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7912.618692][ C1] tc_run+0x2e4/0x5d0 [ 7912.618920][ C1] ? __pfx_tc_run+0x10/0x10 [ 7912.619188][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7912.619464][ C1] ? irqentry_enter+0x2b/0x60 [ 7912.619721][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7912.620013][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7912.620340][ C1] ip_finish_output2+0x786/0x18e0 [ 7912.620621][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7912.620919][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7912.621188][ C1] ? __ip_finish_output+0x10f/0x770 [ 7912.621473][ C1] ip_output+0x16b/0x4f0 [ 7912.621706][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7912.622029][ C1] ? __pfx_ip_output+0x10/0x10 [ 7912.622292][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7912.622650][ C1] ? __pfx_ip_output+0x10/0x10 [ 7912.622912][ C1] __ip_queue_xmit+0x672/0x1910 [ 7912.623180][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7912.623469][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7912.623772][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7912.624065][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7912.624371][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7912.624665][ C1] tcp_delack_timer+0x84/0x240 [ 7912.624929][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7912.625220][ C1] call_timer_fn+0x176/0x430 [ 7912.625472][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7912.625755][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7912.626038][ C1] __run_timers.part.0+0x52d/0x890 [ 7912.626315][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7912.626610][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7912.626921][ C1] ? __pfx___schedule+0x10/0x10 [ 7912.627187][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7912.627513][ C1] run_timer_softirq+0x72/0x100 [ 7912.627780][ C1] __do_softirq+0x1bc/0x7ff [ 7912.628033][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7912.628316][ C1] run_ksoftirqd+0x2e/0x60 [ 7912.628568][ C1] smpboot_thread_fn+0x30e/0x840 [ 7912.628839][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7912.629139][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7912.629433][ C1] kthread+0x292/0x360 [ 7912.629661][ C1] ? __pfx_kthread+0x10/0x10 [ 7912.629912][ C1] ret_from_fork+0x34/0x70 [ 7912.630158][ C1] ? __pfx_kthread+0x10/0x10 [ 7912.630406][ C1] ret_from_fork_asm+0x1b/0x30 [ 7912.630673][ C1] [ 7935.778023][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7935.778431][ C0] rcu: 0-....: (6686123 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1587561 [ 7935.778958][ C0] rcu: (t=6741469 jiffies g=1007429 q=31 ncpus=4) [ 7935.779311][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7935.779789][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7935.780442][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7935.780793][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7935.781810][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7935.782132][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7935.782551][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7935.782969][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7935.783388][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7935.783805][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7935.784225][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7935.784697][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7935.785051][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7935.785475][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7935.785902][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7935.786325][ C0] Call Trace: [ 7935.786504][ C0] [ 7935.786670][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7935.786961][ C0] ? print_cpu_stall+0x263/0x6a0 [ 7935.787230][ C0] ? check_cpu_stall+0x284/0x500 [ 7935.787496][ C0] ? rcu_pending+0x92/0x360 [ 7935.787737][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7935.788023][ C0] ? update_process_times+0xb9/0x110 [ 7935.788326][ C0] ? tick_sched_handle+0x67/0x130 [ 7935.788601][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7935.788899][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7935.789152][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7935.789480][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7935.789762][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7935.790063][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7935.790340][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7935.790659][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7935.790934][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7935.791208][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7935.791534][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7935.791849][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7935.792178][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7935.792485][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7935.792797][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7935.793098][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7935.793425][ C0] ? get_stack_info+0x36/0xc0 [ 7935.793684][ C0] ? lock_acquire+0x1c1/0x220 [ 7935.793942][ C0] ? lock_release+0x1d5/0x250 [ 7935.794197][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7935.794463][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7935.794750][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7935.795049][ C0] ? lock_acquire+0x1c1/0x220 [ 7935.795295][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7935.795545][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7935.795816][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7935.796066][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7935.796327][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7935.796598][ C0] ? __inet_lookup_established+0x341/0x610 [ 7935.796913][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7935.797203][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7935.797493][ C0] ip_local_deliver+0x19d/0x480 [ 7935.797756][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7935.798042][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7935.798316][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7935.798597][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7935.798866][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7935.799203][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7935.799480][ C0] ip_rcv+0x564/0x740 [ 7935.799697][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7935.799943][ C0] ? set_track_prepare+0x8a/0xd0 [ 7935.800213][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7935.800503][ C0] ? rest_init+0x153/0x260 [ 7935.800745][ C0] ? skb_clone+0x10b/0x330 [ 7935.800984][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7935.801323][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7935.801648][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7935.801943][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7935.802250][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7935.802509][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7935.802749][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7935.803062][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7935.803359][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7935.803703][ C0] ? lock_acquire+0x1c1/0x220 [ 7935.803956][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7935.804268][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7935.804565][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7935.804899][ C0] ? __copy_skb_header+0xaf/0x490 [ 7935.805171][ C0] ? __skb_clone+0x57a/0x760 [ 7935.805424][ C0] netif_receive_skb+0x55/0x280 [ 7935.805682][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7935.806009][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7935.806357][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7935.806672][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7935.806958][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7935.807256][ C0] ? hlock_class+0x4e/0x130 [ 7935.807500][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7935.807826][ C0] ? place_entity+0x21/0x2f0 [ 7935.808072][ C0] ? resched_curr+0x219/0x280 [ 7935.808334][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7935.808600][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7935.808880][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7935.809160][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7935.809420][ C0] ? activate_task+0xf5/0x260 [ 7935.809671][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7935.809949][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7935.810221][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7935.810487][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7935.810779][ C0] ? get_stack_info+0x36/0xc0 [ 7935.811030][ C0] ? stack_access_ok+0xda/0x1f0 [ 7935.811287][ C0] ? get_reg+0x119/0x190 [ 7935.811515][ C0] __tcf_classify+0x32c/0x7d0 [ 7935.811771][ C0] tcf_classify+0x283/0x930 [ 7935.812016][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7935.812346][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7935.812611][ C0] ? arch_stack_walk+0x8c/0x100 [ 7935.812871][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7935.813159][ C0] tc_run+0x2e4/0x5d0 [ 7935.813377][ C0] ? __pfx_tc_run+0x10/0x10 [ 7935.813622][ C0] ? lock_acquire+0x1c1/0x220 [ 7935.813873][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7935.814150][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7935.814415][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7935.814702][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7935.814982][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7935.815307][ C0] ? neigh_hh_output+0x348/0x590 [ 7935.815571][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7935.815853][ C0] ip_finish_output2+0x786/0x18e0 [ 7935.816123][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7935.816415][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7935.816765][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7935.817054][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7935.817319][ C0] ? __ip_finish_output+0x10f/0x770 [ 7935.817595][ C0] ip_output+0x16b/0x4f0 [ 7935.817823][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7935.818109][ C0] ? __pfx_ip_output+0x10/0x10 [ 7935.818372][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7935.818672][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7935.818936][ C0] ? ip_local_out+0x114/0x3b0 [ 7935.819184][ C0] __ip_queue_xmit+0x672/0x1910 [ 7935.819442][ C0] ? __skb_clone+0x57a/0x760 [ 7935.819687][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7935.819971][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7935.820268][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7935.820587][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7935.820841][ C0] ? tcp_current_mss+0x40a/0x510 [ 7935.821107][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7935.821386][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7935.821665][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7935.821919][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7935.822184][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7935.822503][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7935.822783][ C0] ? ktime_get+0xb6/0x190 [ 7935.823017][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7935.823292][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7935.823571][ C0] tcp_write_timer+0x82/0x1d0 [ 7935.823825][ C0] call_timer_fn+0x176/0x430 [ 7935.824074][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7935.824347][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7935.824623][ C0] __run_timers.part.0+0x52d/0x890 [ 7935.824893][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7935.825178][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7935.825472][ C0] ? lock_acquire+0x1c1/0x220 [ 7935.825725][ C0] ? clockevents_program_event+0xf6/0x300 [ 7935.826032][ C0] ? lock_release+0x1d5/0x250 [ 7935.826283][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7935.826563][ C0] ? ktime_get+0xb6/0x190 [ 7935.826794][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7935.827097][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7935.827404][ C0] run_timer_softirq+0x72/0x100 [ 7935.827666][ C0] __do_softirq+0x1bc/0x7ff [ 7935.827913][ C0] irq_exit_rcu+0x98/0xc0 [ 7935.828147][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7935.828455][ C0] [ 7935.828616][ C0] [ 7935.828776][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7935.829100][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7935.829367][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7935.830383][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7935.830705][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7935.831124][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7935.831544][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7935.831963][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7935.832381][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7935.832801][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7935.833102][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7935.833374][ C0] default_idle_call+0x69/0xa0 [ 7935.833633][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7935.833894][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7935.834186][ C0] ? lock_release+0x1d5/0x250 [ 7935.834434][ C0] do_idle+0xfb/0x160 [ 7935.834645][ C0] cpu_startup_entry+0x55/0x60 [ 7935.834897][ C0] rest_init+0x153/0x260 [ 7935.835127][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7935.835413][ C0] arch_call_rest_init+0x13/0x40 [ 7935.835676][ C0] start_kernel+0x314/0x3d0 [ 7935.835921][ C0] x86_64_start_reservations+0x18/0x30 [ 7935.836213][ C0] x86_64_start_kernel+0xba/0x110 [ 7935.836480][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7935.836810][ C0] [ 7935.836975][ C0] Sending NMI from CPU 0 to CPUs 1: [ 7935.837263][ C1] NMI backtrace for cpu 1 [ 7935.837270][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7935.837275][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7935.837277][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7935.837285][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7935.837287][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7935.837291][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7935.837293][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7935.837295][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7935.837296][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7935.837298][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7935.837300][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7935.837302][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7935.837306][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7935.837307][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7935.837309][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7935.837310][ C1] Call Trace: [ 7935.837313][ C1] [ 7935.837317][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 7935.837322][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7935.837326][ C1] ? nmi_handle+0x156/0x420 [ 7935.837331][ C1] ? default_do_nmi+0x41/0x100 [ 7935.837334][ C1] ? exc_nmi+0xf3/0x120 [ 7935.837336][ C1] ? end_repeat_nmi+0xf/0x60 [ 7935.837340][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7935.837344][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7935.837348][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7935.837351][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7935.837354][ C1] [ 7935.837355][ C1] [ 7935.837356][ C1] ? run_ksoftirqd+0xb/0x60 [ 7935.837363][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7935.837365][ C1] ? __orc_find+0x9c/0xf0 [ 7935.837368][ C1] ? lock_acquire+0x1c1/0x220 [ 7935.837372][ C1] ? irqentry_enter+0x2b/0x60 [ 7935.837377][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7935.837380][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7935.837383][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7935.837386][ C1] ? lock_acquire+0x1c1/0x220 [ 7935.837389][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7935.837394][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7935.837397][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7935.837404][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7935.837407][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7935.837412][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7935.837419][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7935.837422][ C1] ip_local_deliver+0x19d/0x480 [ 7935.837425][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7935.837428][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7935.837432][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7935.837436][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7935.837439][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7935.837442][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7935.837452][ C1] ip_rcv+0x564/0x740 [ 7935.837455][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7935.837458][ C1] ? set_track_prepare+0x8a/0xd0 [ 7935.837462][ C1] ? irqentry_enter+0x2b/0x60 [ 7935.837465][ C1] ? irqentry_enter+0x2b/0x60 [ 7935.837469][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7935.837471][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7935.837475][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7935.837479][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7935.837481][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7935.837484][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7935.837488][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7935.837492][ C1] netif_receive_skb+0x55/0x280 [ 7935.837496][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7935.837504][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7935.837510][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7935.837517][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7935.837523][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7935.837535][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7935.837544][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7935.837547][ C1] ? arch_stack_walk+0x68/0x100 [ 7935.837551][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7935.837554][ C1] ? irqentry_enter+0x2b/0x60 [ 7935.837558][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7935.837562][ C1] ? irqentry_enter+0x2b/0x60 [ 7935.837565][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7935.837572][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7935.837575][ C1] ? arch_stack_walk+0x68/0x100 [ 7935.837579][ C1] __tcf_classify+0x32c/0x7d0 [ 7935.837584][ C1] tcf_classify+0x283/0x930 [ 7935.837588][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7935.837592][ C1] tc_run+0x2e4/0x5d0 [ 7935.837596][ C1] ? __pfx_tc_run+0x10/0x10 [ 7935.837601][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7935.837607][ C1] ? irqentry_enter+0x2b/0x60 [ 7935.837610][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7935.837613][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7935.837620][ C1] ip_finish_output2+0x786/0x18e0 [ 7935.837625][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7935.837628][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7935.837632][ C1] ? __ip_finish_output+0x10f/0x770 [ 7935.837636][ C1] ip_output+0x16b/0x4f0 [ 7935.837639][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7935.837643][ C1] ? __pfx_ip_output+0x10/0x10 [ 7935.837647][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7935.837655][ C1] ? __pfx_ip_output+0x10/0x10 [ 7935.837659][ C1] __ip_queue_xmit+0x672/0x1910 [ 7935.837664][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7935.837670][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7935.837675][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7935.837678][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7935.837683][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7935.837685][ C1] tcp_delack_timer+0x84/0x240 [ 7935.837689][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7935.837692][ C1] call_timer_fn+0x176/0x430 [ 7935.837696][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7935.837701][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7935.837705][ C1] __run_timers.part.0+0x52d/0x890 [ 7935.837708][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7935.837713][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7935.837718][ C1] ? __pfx___schedule+0x10/0x10 [ 7935.837722][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7935.837726][ C1] run_timer_softirq+0x72/0x100 [ 7935.837730][ C1] __do_softirq+0x1bc/0x7ff [ 7935.837733][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7935.837737][ C1] run_ksoftirqd+0x2e/0x60 [ 7935.837741][ C1] smpboot_thread_fn+0x30e/0x840 [ 7935.837745][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7935.837749][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7935.837752][ C1] kthread+0x292/0x360 [ 7935.837755][ C1] ? __pfx_kthread+0x10/0x10 [ 7935.837758][ C1] ret_from_fork+0x34/0x70 [ 7935.837762][ C1] ? __pfx_kthread+0x10/0x10 [ 7935.837764][ C1] ret_from_fork_asm+0x1b/0x30 [ 7935.837771][ C1] [ 7960.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6307s! [swapper/0:0] [ 7960.527917][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7960.529122][ C0] irq event stamp: 27567077 [ 7960.529362][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7960.529891][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7960.530369][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7960.530881][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7960.531385][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7960.531867][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7960.532507][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7960.532846][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7960.533863][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7960.534184][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7960.534602][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7960.535020][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7960.535442][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7960.535858][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7960.536278][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7960.536748][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7960.537099][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7960.537521][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7960.537946][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7960.538378][ C0] Call Trace: [ 7960.538558][ C0] [ 7960.538714][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7960.538992][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7960.539245][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7960.539541][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7960.539827][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7960.540130][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7960.540409][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7960.540728][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7960.541006][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7960.541284][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7960.541612][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7960.541926][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7960.542257][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7960.542564][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7960.542879][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7960.543182][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7960.543508][ C0] ? get_stack_info+0x36/0xc0 [ 7960.543765][ C0] ? lock_acquire+0x1c1/0x220 [ 7960.544020][ C0] ? lock_release+0x1d5/0x250 [ 7960.544273][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7960.544536][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7960.544824][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7960.545126][ C0] ? lock_acquire+0x1c1/0x220 [ 7960.545376][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7960.545629][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7960.545901][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7960.546150][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7960.546411][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7960.546685][ C0] ? __inet_lookup_established+0x341/0x610 [ 7960.547003][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7960.547290][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7960.547578][ C0] ip_local_deliver+0x19d/0x480 [ 7960.547840][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7960.548133][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7960.548398][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7960.548679][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7960.548947][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7960.549283][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7960.549561][ C0] ip_rcv+0x564/0x740 [ 7960.549782][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7960.550028][ C0] ? set_track_prepare+0x8a/0xd0 [ 7960.550298][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7960.550589][ C0] ? rest_init+0x153/0x260 [ 7960.550829][ C0] ? skb_clone+0x10b/0x330 [ 7960.551067][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7960.551410][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7960.551735][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7960.552031][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7960.552338][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7960.552598][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7960.552840][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7960.553153][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7960.553452][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7960.553797][ C0] ? lock_acquire+0x1c1/0x220 [ 7960.554052][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7960.554366][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7960.554663][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7960.554997][ C0] ? __copy_skb_header+0xaf/0x490 [ 7960.555269][ C0] ? __skb_clone+0x57a/0x760 [ 7960.555519][ C0] netif_receive_skb+0x55/0x280 [ 7960.555780][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7960.556108][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7960.556455][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7960.556772][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7960.557060][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7960.557360][ C0] ? hlock_class+0x4e/0x130 [ 7960.557607][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7960.557933][ C0] ? place_entity+0x21/0x2f0 [ 7960.558182][ C0] ? resched_curr+0x219/0x280 [ 7960.558431][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7960.558698][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7960.558979][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7960.559261][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7960.559521][ C0] ? activate_task+0xf5/0x260 [ 7960.559776][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7960.560055][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7960.560327][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7960.560589][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7960.560882][ C0] ? get_stack_info+0x36/0xc0 [ 7960.561131][ C0] ? stack_access_ok+0xda/0x1f0 [ 7960.561386][ C0] ? get_reg+0x119/0x190 [ 7960.561613][ C0] __tcf_classify+0x32c/0x7d0 [ 7960.561868][ C0] tcf_classify+0x283/0x930 [ 7960.562114][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7960.562445][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7960.562712][ C0] ? arch_stack_walk+0x8c/0x100 [ 7960.562970][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7960.563258][ C0] tc_run+0x2e4/0x5d0 [ 7960.563479][ C0] ? __pfx_tc_run+0x10/0x10 [ 7960.563725][ C0] ? lock_acquire+0x1c1/0x220 [ 7960.563980][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7960.564257][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7960.564521][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7960.564810][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7960.565092][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7960.565416][ C0] ? neigh_hh_output+0x348/0x590 [ 7960.565680][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7960.565961][ C0] ip_finish_output2+0x786/0x18e0 [ 7960.566232][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7960.566530][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7960.566882][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7960.567168][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7960.567441][ C0] ? __ip_finish_output+0x10f/0x770 [ 7960.567717][ C0] ip_output+0x16b/0x4f0 [ 7960.567942][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7960.568232][ C0] ? __pfx_ip_output+0x10/0x10 [ 7960.568490][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7960.568787][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7960.569053][ C0] ? ip_local_out+0x114/0x3b0 [ 7960.569305][ C0] __ip_queue_xmit+0x672/0x1910 [ 7960.569565][ C0] ? __skb_clone+0x57a/0x760 [ 7960.569813][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7960.570097][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7960.570398][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7960.570717][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7960.570972][ C0] ? tcp_current_mss+0x40a/0x510 [ 7960.571240][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7960.571522][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7960.571800][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7960.572058][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7960.572324][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7960.572644][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7960.572924][ C0] ? ktime_get+0xb6/0x190 [ 7960.573159][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7960.573434][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7960.573716][ C0] tcp_write_timer+0x82/0x1d0 [ 7960.573971][ C0] call_timer_fn+0x176/0x430 [ 7960.574233][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7960.574505][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7960.574781][ C0] __run_timers.part.0+0x52d/0x890 [ 7960.575053][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7960.575338][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7960.575636][ C0] ? lock_acquire+0x1c1/0x220 [ 7960.575890][ C0] ? clockevents_program_event+0xf6/0x300 [ 7960.576197][ C0] ? lock_release+0x1d5/0x250 [ 7960.576448][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7960.576727][ C0] ? ktime_get+0xb6/0x190 [ 7960.576960][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7960.577261][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7960.577575][ C0] run_timer_softirq+0x72/0x100 [ 7960.577840][ C0] __do_softirq+0x1bc/0x7ff [ 7960.578088][ C0] irq_exit_rcu+0x98/0xc0 [ 7960.578330][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7960.578629][ C0] [ 7960.578789][ C0] [ 7960.578949][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7960.579271][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7960.579538][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7960.580555][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7960.580875][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7960.581296][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7960.581715][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7960.582132][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7960.582550][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7960.582978][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7960.583280][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7960.583553][ C0] default_idle_call+0x69/0xa0 [ 7960.583810][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7960.584072][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7960.584365][ C0] ? lock_release+0x1d5/0x250 [ 7960.584613][ C0] do_idle+0xfb/0x160 [ 7960.584826][ C0] cpu_startup_entry+0x55/0x60 [ 7960.585081][ C0] rest_init+0x153/0x260 [ 7960.585307][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7960.585591][ C0] arch_call_rest_init+0x13/0x40 [ 7960.585857][ C0] start_kernel+0x314/0x3d0 [ 7960.586104][ C0] x86_64_start_reservations+0x18/0x30 [ 7960.586400][ C0] x86_64_start_kernel+0xba/0x110 [ 7960.586670][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7960.586995][ C0] [ 7960.587160][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6307s! [ksoftirqd/1:22] [ 7960.587615][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7960.588822][ C1] irq event stamp: 3886976 [ 7960.589057][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7960.589562][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7960.590063][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7960.590569][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7960.591060][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7960.591559][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7960.592209][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 7960.592550][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 7960.593569][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 7960.593892][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7960.594310][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7960.594726][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7960.595146][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7960.595564][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7960.595981][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7960.596452][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7960.596807][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7960.597228][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7960.597651][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7960.598077][ C1] Call Trace: [ 7960.598265][ C1] [ 7960.598420][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7960.598701][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7960.598958][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7960.599255][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7960.599541][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7960.599844][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7960.600124][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7960.600444][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7960.600725][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7960.601049][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7960.601360][ C1] [ 7960.601521][ C1] [ 7960.601681][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7960.602020][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7960.602324][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 7960.602628][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7960.602930][ C1] ? run_ksoftirqd+0xb/0x60 [ 7960.603173][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7960.603503][ C1] ? __orc_find+0x9c/0xf0 [ 7960.603740][ C1] ? lock_acquire+0x1c1/0x220 [ 7960.604002][ C1] ? irqentry_enter+0x2b/0x60 [ 7960.604261][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7960.604527][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7960.604817][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7960.605119][ C1] ? lock_acquire+0x1c1/0x220 [ 7960.605367][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7960.605618][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7960.605890][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7960.606143][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7960.606405][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7960.606679][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7960.606972][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7960.607269][ C1] ip_local_deliver+0x19d/0x480 [ 7960.607530][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7960.607816][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7960.608086][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7960.608375][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7960.608642][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7960.608985][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7960.609259][ C1] ip_rcv+0x564/0x740 [ 7960.609472][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7960.609714][ C1] ? set_track_prepare+0x8a/0xd0 [ 7960.609979][ C1] ? irqentry_enter+0x2b/0x60 [ 7960.610234][ C1] ? irqentry_enter+0x2b/0x60 [ 7960.610490][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7960.610736][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7960.611057][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7960.611404][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7960.611717][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7960.612058][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7960.612359][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7960.612698][ C1] netif_receive_skb+0x55/0x280 [ 7960.612963][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7960.613299][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7960.613651][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7960.613966][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7960.614261][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7960.614571][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7960.614903][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7960.615190][ C1] ? arch_stack_walk+0x68/0x100 [ 7960.615451][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7960.615727][ C1] ? irqentry_enter+0x2b/0x60 [ 7960.615977][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7960.616295][ C1] ? irqentry_enter+0x2b/0x60 [ 7960.616550][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7960.616887][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7960.617168][ C1] ? arch_stack_walk+0x68/0x100 [ 7960.617434][ C1] __tcf_classify+0x32c/0x7d0 [ 7960.617693][ C1] tcf_classify+0x283/0x930 [ 7960.617940][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7960.618228][ C1] tc_run+0x2e4/0x5d0 [ 7960.618443][ C1] ? __pfx_tc_run+0x10/0x10 [ 7960.618686][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7960.618951][ C1] ? irqentry_enter+0x2b/0x60 [ 7960.619204][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7960.619490][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7960.619816][ C1] ip_finish_output2+0x786/0x18e0 [ 7960.620085][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7960.620373][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7960.620642][ C1] ? __ip_finish_output+0x10f/0x770 [ 7960.620919][ C1] ip_output+0x16b/0x4f0 [ 7960.621145][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7960.621469][ C1] ? __pfx_ip_output+0x10/0x10 [ 7960.621726][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7960.622084][ C1] ? __pfx_ip_output+0x10/0x10 [ 7960.622344][ C1] __ip_queue_xmit+0x672/0x1910 [ 7960.622606][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7960.622886][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7960.623181][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7960.623466][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7960.623761][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7960.624043][ C1] tcp_delack_timer+0x84/0x240 [ 7960.624295][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7960.624582][ C1] call_timer_fn+0x176/0x430 [ 7960.624831][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7960.625105][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7960.625387][ C1] __run_timers.part.0+0x52d/0x890 [ 7960.625665][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7960.625949][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7960.626249][ C1] ? __pfx___schedule+0x10/0x10 [ 7960.626513][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7960.626834][ C1] run_timer_softirq+0x72/0x100 [ 7960.627093][ C1] __do_softirq+0x1bc/0x7ff [ 7960.627334][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7960.627605][ C1] run_ksoftirqd+0x2e/0x60 [ 7960.627845][ C1] smpboot_thread_fn+0x30e/0x840 [ 7960.628119][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7960.628412][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7960.628702][ C1] kthread+0x292/0x360 [ 7960.628918][ C1] ? __pfx_kthread+0x10/0x10 [ 7960.629166][ C1] ret_from_fork+0x34/0x70 [ 7960.629401][ C1] ? __pfx_kthread+0x10/0x10 [ 7960.629648][ C1] ret_from_fork_asm+0x1b/0x30 [ 7960.629906][ C1] [ 7988.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6333s! [swapper/0:0] [ 7988.527907][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7988.529115][ C0] irq event stamp: 27567077 [ 7988.529359][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 7988.529891][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 7988.530362][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 7988.530865][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 7988.531360][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 7988.531842][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7988.532491][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7988.532835][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7988.533863][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 7988.534190][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7988.534613][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 7988.535038][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 7988.535464][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 7988.535885][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 7988.536309][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 7988.536784][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7988.537132][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 7988.537557][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7988.537983][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7988.538408][ C0] Call Trace: [ 7988.538594][ C0] [ 7988.538751][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7988.539026][ C0] ? __run_hrtimer+0x1c3/0x710 [ 7988.539282][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7988.539571][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 7988.539860][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7988.540166][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7988.540448][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7988.540769][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 7988.541043][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 7988.541320][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7988.541646][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7988.541956][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7988.542290][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7988.542594][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7988.542904][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7988.543214][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7988.543545][ C0] ? get_stack_info+0x36/0xc0 [ 7988.543799][ C0] ? lock_acquire+0x1c1/0x220 [ 7988.544051][ C0] ? lock_release+0x1d5/0x250 [ 7988.544303][ C0] do_raw_spin_lock+0x1ec/0x270 [ 7988.544562][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7988.544846][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7988.545144][ C0] ? lock_acquire+0x1c1/0x220 [ 7988.545398][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 7988.545655][ C0] _raw_spin_lock_nested+0x65/0x80 [ 7988.545931][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 7988.546178][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7988.546437][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 7988.546704][ C0] ? __inet_lookup_established+0x341/0x610 [ 7988.547016][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 7988.547307][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 7988.547598][ C0] ip_local_deliver+0x19d/0x480 [ 7988.547853][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 7988.548141][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7988.548409][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 7988.548685][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7988.548948][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7988.549286][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7988.549559][ C0] ip_rcv+0x564/0x740 [ 7988.549772][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7988.550012][ C0] ? set_track_prepare+0x8a/0xd0 [ 7988.550278][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 7988.550570][ C0] ? rest_init+0x153/0x260 [ 7988.550807][ C0] ? skb_clone+0x10b/0x330 [ 7988.551049][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7988.551382][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7988.551703][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 7988.552004][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7988.552315][ C0] ? __tcf_classify+0x32c/0x7d0 [ 7988.552581][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 7988.552826][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 7988.553144][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7988.553444][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7988.553780][ C0] ? lock_acquire+0x1c1/0x220 [ 7988.554030][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 7988.554337][ C0] netif_receive_skb_internal+0xb0/0x300 [ 7988.554636][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7988.554962][ C0] ? __copy_skb_header+0xaf/0x490 [ 7988.555228][ C0] ? __skb_clone+0x57a/0x760 [ 7988.555476][ C0] netif_receive_skb+0x55/0x280 [ 7988.555738][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7988.556071][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7988.556422][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7988.556735][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 7988.557030][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 7988.557334][ C0] ? hlock_class+0x4e/0x130 [ 7988.557582][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7988.557912][ C0] ? place_entity+0x21/0x2f0 [ 7988.558168][ C0] ? resched_curr+0x219/0x280 [ 7988.558421][ C0] ? __pfx_resched_curr+0x10/0x10 [ 7988.558690][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 7988.558973][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 7988.559249][ C0] ? wakeup_preempt+0x161/0x2c0 [ 7988.559503][ C0] ? activate_task+0xf5/0x260 [ 7988.559750][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 7988.560022][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 7988.560297][ C0] ? _raw_spin_unlock+0x23/0x40 [ 7988.560555][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7988.560844][ C0] ? get_stack_info+0x36/0xc0 [ 7988.561098][ C0] ? stack_access_ok+0xda/0x1f0 [ 7988.561356][ C0] ? get_reg+0x119/0x190 [ 7988.561586][ C0] __tcf_classify+0x32c/0x7d0 [ 7988.561837][ C0] tcf_classify+0x283/0x930 [ 7988.562080][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7988.562404][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 7988.562675][ C0] ? arch_stack_walk+0x8c/0x100 [ 7988.562940][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 7988.563232][ C0] tc_run+0x2e4/0x5d0 [ 7988.563451][ C0] ? __pfx_tc_run+0x10/0x10 [ 7988.563691][ C0] ? lock_acquire+0x1c1/0x220 [ 7988.563937][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 7988.564210][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 7988.564477][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7988.564759][ C0] ? ip_finish_output2+0x786/0x18e0 [ 7988.565034][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7988.565356][ C0] ? neigh_hh_output+0x348/0x590 [ 7988.565625][ C0] ? ip_finish_output2+0x262/0x18e0 [ 7988.565900][ C0] ip_finish_output2+0x786/0x18e0 [ 7988.566167][ C0] ? stack_depot_save_flags+0x45/0x550 [ 7988.566458][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7988.566813][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 7988.567105][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7988.567368][ C0] ? __ip_finish_output+0x10f/0x770 [ 7988.567651][ C0] ip_output+0x16b/0x4f0 [ 7988.567881][ C0] ? __run_timers.part.0+0x52d/0x890 [ 7988.568172][ C0] ? __pfx_ip_output+0x10/0x10 [ 7988.568427][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7988.568729][ C0] ? rcu_read_lock_held+0xe/0x50 [ 7988.568990][ C0] ? ip_local_out+0x114/0x3b0 [ 7988.569246][ C0] __ip_queue_xmit+0x672/0x1910 [ 7988.569512][ C0] ? __skb_clone+0x57a/0x760 [ 7988.569764][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 7988.570042][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7988.570335][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 7988.570650][ C0] tcp_write_xmit+0xe42/0x24c0 [ 7988.570907][ C0] ? tcp_current_mss+0x40a/0x510 [ 7988.571170][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 7988.571454][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 7988.571728][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 7988.571980][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 7988.572251][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7988.572573][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7988.572847][ C0] ? ktime_get+0xb6/0x190 [ 7988.573079][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 7988.573351][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7988.573633][ C0] tcp_write_timer+0x82/0x1d0 [ 7988.573883][ C0] call_timer_fn+0x176/0x430 [ 7988.574130][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 7988.574406][ C0] ? next_expiry_recalc+0xcd/0x220 [ 7988.574679][ C0] __run_timers.part.0+0x52d/0x890 [ 7988.574952][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 7988.575232][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 7988.575535][ C0] ? lock_acquire+0x1c1/0x220 [ 7988.575784][ C0] ? clockevents_program_event+0xf6/0x300 [ 7988.576087][ C0] ? lock_release+0x1d5/0x250 [ 7988.576333][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 7988.576607][ C0] ? ktime_get+0xb6/0x190 [ 7988.576836][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 7988.577134][ C0] ? clockevents_program_event+0x1ed/0x300 [ 7988.577446][ C0] run_timer_softirq+0x72/0x100 [ 7988.577706][ C0] __do_softirq+0x1bc/0x7ff [ 7988.577952][ C0] irq_exit_rcu+0x98/0xc0 [ 7988.578189][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 7988.578489][ C0] [ 7988.578644][ C0] [ 7988.578799][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7988.579118][ C0] RIP: 0010:default_idle+0xf/0x20 [ 7988.579389][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7988.580418][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 7988.580742][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 7988.581169][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 7988.581592][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 7988.582012][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 7988.582432][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 7988.582857][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7988.583166][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 7988.583442][ C0] default_idle_call+0x69/0xa0 [ 7988.583696][ C0] cpuidle_idle_call+0x1f6/0x280 [ 7988.583961][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7988.584251][ C0] ? lock_release+0x1d5/0x250 [ 7988.584507][ C0] do_idle+0xfb/0x160 [ 7988.584724][ C0] cpu_startup_entry+0x55/0x60 [ 7988.584982][ C0] rest_init+0x153/0x260 [ 7988.585209][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 7988.585497][ C0] arch_call_rest_init+0x13/0x40 [ 7988.585765][ C0] start_kernel+0x314/0x3d0 [ 7988.586006][ C0] x86_64_start_reservations+0x18/0x30 [ 7988.586295][ C0] x86_64_start_kernel+0xba/0x110 [ 7988.586568][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 7988.586900][ C0] [ 7988.587069][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6333s! [ksoftirqd/1:22] [ 7988.587526][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 7988.588731][ C1] irq event stamp: 3886976 [ 7988.588969][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 7988.589465][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 7988.589957][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 7988.590453][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 7988.590946][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 7988.591438][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7988.592082][ C1] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 7988.592383][ C1] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 7988.593414][ C1] RSP: 0018:ffffc9000019e9d0 EFLAGS: 00000282 [ 7988.593739][ C1] RAX: ffff88800a098e1c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 7988.594166][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 7988.594592][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 7988.595014][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 7988.595438][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 7988.595863][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7988.596341][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7988.596689][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 7988.597118][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7988.597541][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7988.597972][ C1] Call Trace: [ 7988.598153][ C1] [ 7988.598310][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7988.598586][ C1] ? __run_hrtimer+0x1c3/0x710 [ 7988.598846][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7988.599139][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7988.599429][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7988.599735][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7988.600015][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 7988.600341][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7988.600614][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 7988.600941][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 7988.601255][ C1] [ 7988.601412][ C1] [ 7988.601568][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7988.601894][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7988.602203][ C1] ? kasan_check_range+0x1a/0x1c0 [ 7988.602473][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 7988.602769][ C1] ? run_ksoftirqd+0xb/0x60 [ 7988.603019][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7988.603349][ C1] ? __orc_find+0x9c/0xf0 [ 7988.603581][ C1] ? lock_acquire+0x1c1/0x220 [ 7988.603833][ C1] ? irqentry_enter+0x2b/0x60 [ 7988.604086][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7988.604347][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7988.604630][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7988.604927][ C1] ? lock_acquire+0x1c1/0x220 [ 7988.605183][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 7988.605440][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7988.605717][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 7988.605963][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7988.606223][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7988.606493][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7988.606781][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 7988.607076][ C1] ip_local_deliver+0x19d/0x480 [ 7988.607339][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7988.607627][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7988.607892][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 7988.608177][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7988.608444][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7988.608780][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7988.609060][ C1] ip_rcv+0x564/0x740 [ 7988.609275][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7988.609520][ C1] ? set_track_prepare+0x8a/0xd0 [ 7988.609786][ C1] ? irqentry_enter+0x2b/0x60 [ 7988.610035][ C1] ? irqentry_enter+0x2b/0x60 [ 7988.610284][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7988.610524][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7988.610840][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7988.611181][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7988.611488][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7988.611831][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7988.612137][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7988.612470][ C1] netif_receive_skb+0x55/0x280 [ 7988.612728][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7988.613057][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7988.613403][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7988.613723][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 7988.614017][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7988.614320][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7988.614649][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7988.614930][ C1] ? arch_stack_walk+0x68/0x100 [ 7988.615201][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 7988.615481][ C1] ? irqentry_enter+0x2b/0x60 [ 7988.615736][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7988.616059][ C1] ? irqentry_enter+0x2b/0x60 [ 7988.616308][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7988.616631][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 7988.616916][ C1] ? arch_stack_walk+0x68/0x100 [ 7988.617176][ C1] __tcf_classify+0x32c/0x7d0 [ 7988.617430][ C1] tcf_classify+0x283/0x930 [ 7988.617673][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7988.617953][ C1] tc_run+0x2e4/0x5d0 [ 7988.618170][ C1] ? __pfx_tc_run+0x10/0x10 [ 7988.618416][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 7988.618682][ C1] ? irqentry_enter+0x2b/0x60 [ 7988.618928][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7988.619211][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7988.619535][ C1] ip_finish_output2+0x786/0x18e0 [ 7988.619807][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7988.620103][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7988.620368][ C1] ? __ip_finish_output+0x10f/0x770 [ 7988.620650][ C1] ip_output+0x16b/0x4f0 [ 7988.620877][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7988.621193][ C1] ? __pfx_ip_output+0x10/0x10 [ 7988.621451][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 7988.621803][ C1] ? __pfx_ip_output+0x10/0x10 [ 7988.622061][ C1] __ip_queue_xmit+0x672/0x1910 [ 7988.622326][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7988.622609][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7988.622907][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7988.623196][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7988.623492][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7988.623778][ C1] tcp_delack_timer+0x84/0x240 [ 7988.624036][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7988.624318][ C1] call_timer_fn+0x176/0x430 [ 7988.624562][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7988.624839][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 7988.625117][ C1] __run_timers.part.0+0x52d/0x890 [ 7988.625388][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7988.625677][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7988.625979][ C1] ? __pfx___schedule+0x10/0x10 [ 7988.626240][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7988.626559][ C1] run_timer_softirq+0x72/0x100 [ 7988.626825][ C1] __do_softirq+0x1bc/0x7ff [ 7988.627072][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 7988.627349][ C1] run_ksoftirqd+0x2e/0x60 [ 7988.627586][ C1] smpboot_thread_fn+0x30e/0x840 [ 7988.627854][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7988.628155][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 7988.628442][ C1] kthread+0x292/0x360 [ 7988.628663][ C1] ? __pfx_kthread+0x10/0x10 [ 7988.628906][ C1] ret_from_fork+0x34/0x70 [ 7988.629147][ C1] ? __pfx_kthread+0x10/0x10 [ 7988.629389][ C1] ret_from_fork_asm+0x1b/0x30 [ 7988.629647][ C1] [ 8013.841023][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8013.841415][ C0] rcu: 0-....: (6764009 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1606975 [ 8013.841935][ C0] rcu: (t=6819532 jiffies g=1007429 q=31 ncpus=4) [ 8013.842281][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8013.842770][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8013.843412][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8013.843758][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8013.844781][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8013.845106][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8013.845526][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8013.845944][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8013.846364][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8013.846782][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8013.847201][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8013.847670][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8013.848028][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8013.848449][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8013.848865][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8013.849283][ C0] Call Trace: [ 8013.849461][ C0] [ 8013.849615][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8013.849906][ C0] ? print_cpu_stall+0x263/0x6a0 [ 8013.850171][ C0] ? check_cpu_stall+0x284/0x500 [ 8013.850438][ C0] ? rcu_pending+0x92/0x360 [ 8013.850678][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8013.850960][ C0] ? update_process_times+0xb9/0x110 [ 8013.851247][ C0] ? tick_sched_handle+0x67/0x130 [ 8013.851515][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8013.851812][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8013.852071][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8013.852398][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8013.852688][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8013.852995][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8013.853280][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8013.853606][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8013.853878][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8013.854156][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8013.854478][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8013.854787][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8013.855123][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8013.855426][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8013.855735][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8013.856042][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8013.856373][ C0] ? get_stack_info+0x36/0xc0 [ 8013.856627][ C0] ? lock_acquire+0x1c1/0x220 [ 8013.856880][ C0] ? lock_release+0x1d5/0x250 [ 8013.857132][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8013.857392][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8013.857675][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8013.857981][ C0] ? lock_acquire+0x1c1/0x220 [ 8013.858228][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8013.858478][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8013.858751][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8013.859002][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8013.859265][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8013.859539][ C0] ? __inet_lookup_established+0x341/0x610 [ 8013.859856][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8013.860146][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8013.860441][ C0] ip_local_deliver+0x19d/0x480 [ 8013.860702][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8013.860989][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8013.861257][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8013.861533][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8013.861796][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8013.862136][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8013.862410][ C0] ip_rcv+0x564/0x740 [ 8013.862624][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8013.862865][ C0] ? set_track_prepare+0x8a/0xd0 [ 8013.863131][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8013.863424][ C0] ? rest_init+0x153/0x260 [ 8013.863662][ C0] ? skb_clone+0x10b/0x330 [ 8013.863907][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8013.864243][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8013.864565][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8013.864865][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8013.865177][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8013.865442][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8013.865688][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8013.866005][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8013.866305][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8013.866643][ C0] ? lock_acquire+0x1c1/0x220 [ 8013.866894][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8013.867205][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8013.867505][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8013.867843][ C0] ? __copy_skb_header+0xaf/0x490 [ 8013.868117][ C0] ? __skb_clone+0x57a/0x760 [ 8013.868369][ C0] netif_receive_skb+0x55/0x280 [ 8013.868629][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8013.868957][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8013.869307][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8013.869624][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8013.869911][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8013.870211][ C0] ? hlock_class+0x4e/0x130 [ 8013.870455][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8013.870783][ C0] ? place_entity+0x21/0x2f0 [ 8013.871029][ C0] ? resched_curr+0x219/0x280 [ 8013.871284][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8013.871555][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8013.871841][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8013.872118][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8013.872375][ C0] ? activate_task+0xf5/0x260 [ 8013.872622][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8013.872895][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8013.873172][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8013.873432][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8013.873722][ C0] ? get_stack_info+0x36/0xc0 [ 8013.873977][ C0] ? stack_access_ok+0xda/0x1f0 [ 8013.874242][ C0] ? get_reg+0x119/0x190 [ 8013.874473][ C0] __tcf_classify+0x32c/0x7d0 [ 8013.874730][ C0] tcf_classify+0x283/0x930 [ 8013.874974][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8013.875302][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8013.875575][ C0] ? arch_stack_walk+0x8c/0x100 [ 8013.875839][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8013.876132][ C0] tc_run+0x2e4/0x5d0 [ 8013.876347][ C0] ? __pfx_tc_run+0x10/0x10 [ 8013.876588][ C0] ? lock_acquire+0x1c1/0x220 [ 8013.876836][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8013.877110][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8013.877378][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8013.877662][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8013.877948][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8013.878276][ C0] ? neigh_hh_output+0x348/0x590 [ 8013.878541][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8013.878824][ C0] ip_finish_output2+0x786/0x18e0 [ 8013.879097][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8013.879392][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8013.879744][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8013.880036][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8013.880302][ C0] ? __ip_finish_output+0x10f/0x770 [ 8013.880579][ C0] ip_output+0x16b/0x4f0 [ 8013.880808][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8013.881096][ C0] ? __pfx_ip_output+0x10/0x10 [ 8013.881354][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8013.881659][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8013.881923][ C0] ? ip_local_out+0x114/0x3b0 [ 8013.882179][ C0] __ip_queue_xmit+0x672/0x1910 [ 8013.882450][ C0] ? __skb_clone+0x57a/0x760 [ 8013.882701][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8013.882980][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8013.883275][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8013.883593][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8013.883852][ C0] ? tcp_current_mss+0x40a/0x510 [ 8013.884119][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8013.884406][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8013.884681][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8013.884933][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8013.885210][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8013.885534][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8013.885809][ C0] ? ktime_get+0xb6/0x190 [ 8013.886042][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8013.886315][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8013.886601][ C0] tcp_write_timer+0x82/0x1d0 [ 8013.886853][ C0] call_timer_fn+0x176/0x430 [ 8013.887103][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8013.887383][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8013.887657][ C0] __run_timers.part.0+0x52d/0x890 [ 8013.887936][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8013.888223][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8013.888521][ C0] ? lock_acquire+0x1c1/0x220 [ 8013.888778][ C0] ? clockevents_program_event+0xf6/0x300 [ 8013.889088][ C0] ? lock_release+0x1d5/0x250 [ 8013.889346][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8013.889627][ C0] ? ktime_get+0xb6/0x190 [ 8013.889859][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8013.890163][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8013.890471][ C0] run_timer_softirq+0x72/0x100 [ 8013.890734][ C0] __do_softirq+0x1bc/0x7ff [ 8013.890981][ C0] irq_exit_rcu+0x98/0xc0 [ 8013.891218][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8013.891520][ C0] [ 8013.891675][ C0] [ 8013.891831][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8013.892149][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8013.892421][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8013.893449][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8013.893776][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8013.894202][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8013.894627][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8013.895049][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8013.895470][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8013.895902][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8013.896212][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8013.896490][ C0] default_idle_call+0x69/0xa0 [ 8013.896746][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8013.897013][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8013.897304][ C0] ? lock_release+0x1d5/0x250 [ 8013.897558][ C0] do_idle+0xfb/0x160 [ 8013.897776][ C0] cpu_startup_entry+0x55/0x60 [ 8013.898040][ C0] rest_init+0x153/0x260 [ 8013.898272][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8013.898559][ C0] arch_call_rest_init+0x13/0x40 [ 8013.898824][ C0] start_kernel+0x314/0x3d0 [ 8013.899072][ C0] x86_64_start_reservations+0x18/0x30 [ 8013.899367][ C0] x86_64_start_kernel+0xba/0x110 [ 8013.899634][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8013.899960][ C0] [ 8013.900128][ C0] Sending NMI from CPU 0 to CPUs 1: [ 8013.900418][ C1] NMI backtrace for cpu 1 [ 8013.900424][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8013.900429][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8013.900431][ C1] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 8013.900440][ C1] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 8013.900443][ C1] RSP: 0018:ffffc9000019e9d8 EFLAGS: 00000202 [ 8013.900446][ C1] RAX: ffff88800a098e18 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8013.900448][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8013.900450][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8013.900452][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8013.900454][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8013.900455][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8013.900457][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8013.900461][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8013.900463][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8013.900464][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8013.900466][ C1] Call Trace: [ 8013.900468][ C1] [ 8013.900471][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 8013.900477][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8013.900481][ C1] ? nmi_handle+0x156/0x420 [ 8013.900486][ C1] ? default_do_nmi+0x41/0x100 [ 8013.900489][ C1] ? exc_nmi+0xf3/0x120 [ 8013.900491][ C1] ? end_repeat_nmi+0xf/0x60 [ 8013.900496][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8013.900500][ C1] ? kasan_check_range+0x12/0x1c0 [ 8013.900504][ C1] ? kasan_check_range+0x12/0x1c0 [ 8013.900508][ C1] ? kasan_check_range+0x12/0x1c0 [ 8013.900511][ C1] [ 8013.900512][ C1] [ 8013.900513][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 8013.900516][ C1] ? run_ksoftirqd+0xb/0x60 [ 8013.900521][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8013.900524][ C1] ? __orc_find+0x9c/0xf0 [ 8013.900527][ C1] ? lock_acquire+0x1c1/0x220 [ 8013.900531][ C1] ? irqentry_enter+0x2b/0x60 [ 8013.900535][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8013.900539][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8013.900542][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8013.900546][ C1] ? lock_acquire+0x1c1/0x220 [ 8013.900548][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8013.900553][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8013.900556][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8013.900564][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8013.900567][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8013.900572][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8013.900579][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8013.900583][ C1] ip_local_deliver+0x19d/0x480 [ 8013.900586][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8013.900588][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8013.900592][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8013.900596][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8013.900599][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8013.900603][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8013.900612][ C1] ip_rcv+0x564/0x740 [ 8013.900615][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8013.900618][ C1] ? set_track_prepare+0x8a/0xd0 [ 8013.900622][ C1] ? irqentry_enter+0x2b/0x60 [ 8013.900625][ C1] ? irqentry_enter+0x2b/0x60 [ 8013.900629][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8013.900632][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8013.900635][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8013.900639][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8013.900642][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8013.900645][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8013.900648][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8013.900653][ C1] netif_receive_skb+0x55/0x280 [ 8013.900656][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8013.900664][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8013.900671][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8013.900678][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8013.900684][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8013.900695][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8013.900705][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8013.900707][ C1] ? arch_stack_walk+0x68/0x100 [ 8013.900712][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8013.900715][ C1] ? irqentry_enter+0x2b/0x60 [ 8013.900719][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8013.900723][ C1] ? irqentry_enter+0x2b/0x60 [ 8013.900726][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8013.900734][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8013.900736][ C1] ? arch_stack_walk+0x68/0x100 [ 8013.900740][ C1] __tcf_classify+0x32c/0x7d0 [ 8013.900745][ C1] tcf_classify+0x283/0x930 [ 8013.900749][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8013.900754][ C1] tc_run+0x2e4/0x5d0 [ 8013.900758][ C1] ? __pfx_tc_run+0x10/0x10 [ 8013.900763][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8013.900769][ C1] ? irqentry_enter+0x2b/0x60 [ 8013.900772][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8013.900775][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8013.900782][ C1] ip_finish_output2+0x786/0x18e0 [ 8013.900787][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8013.900790][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8013.900794][ C1] ? __ip_finish_output+0x10f/0x770 [ 8013.900798][ C1] ip_output+0x16b/0x4f0 [ 8013.900801][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8013.900804][ C1] ? __pfx_ip_output+0x10/0x10 [ 8013.900808][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8013.900815][ C1] ? __pfx_ip_output+0x10/0x10 [ 8013.900819][ C1] __ip_queue_xmit+0x672/0x1910 [ 8013.900824][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8013.900831][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8013.900835][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8013.900839][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8013.900843][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8013.900846][ C1] tcp_delack_timer+0x84/0x240 [ 8013.900849][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8013.900852][ C1] call_timer_fn+0x176/0x430 [ 8013.900856][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8013.900861][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8013.900865][ C1] __run_timers.part.0+0x52d/0x890 [ 8013.900868][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8013.900873][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8013.900877][ C1] ? __pfx___schedule+0x10/0x10 [ 8013.900881][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8013.900886][ C1] run_timer_softirq+0x72/0x100 [ 8013.900889][ C1] __do_softirq+0x1bc/0x7ff [ 8013.900893][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8013.900897][ C1] run_ksoftirqd+0x2e/0x60 [ 8013.900900][ C1] smpboot_thread_fn+0x30e/0x840 [ 8013.900905][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8013.900908][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8013.900911][ C1] kthread+0x292/0x360 [ 8013.900914][ C1] ? __pfx_kthread+0x10/0x10 [ 8013.900917][ C1] ret_from_fork+0x34/0x70 [ 8013.900920][ C1] ? __pfx_kthread+0x10/0x10 [ 8013.900922][ C1] ret_from_fork_asm+0x1b/0x30 [ 8013.900929][ C1] [ 8040.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6382s! [swapper/0:0] [ 8040.527922][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8040.529132][ C0] irq event stamp: 27567077 [ 8040.529378][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8040.529911][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8040.530389][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8040.530892][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8040.531388][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8040.531871][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8040.532524][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8040.532871][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8040.533902][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8040.534230][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8040.534658][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8040.535083][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8040.535502][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8040.535923][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8040.536344][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8040.536814][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8040.537171][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8040.537595][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8040.538020][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8040.538440][ C0] Call Trace: [ 8040.538616][ C0] [ 8040.538771][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8040.539051][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8040.539310][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8040.539603][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8040.539889][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8040.540193][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8040.540471][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8040.540792][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8040.541069][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8040.541345][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8040.541673][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8040.541987][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8040.542316][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8040.542626][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8040.542938][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8040.543242][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8040.543569][ C0] ? get_stack_info+0x36/0xc0 [ 8040.543826][ C0] ? lock_acquire+0x1c1/0x220 [ 8040.544083][ C0] ? lock_release+0x1d5/0x250 [ 8040.544338][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8040.544605][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8040.544895][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8040.545198][ C0] ? lock_acquire+0x1c1/0x220 [ 8040.545447][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8040.545699][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8040.545973][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8040.546225][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8040.546494][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8040.546766][ C0] ? __inet_lookup_established+0x341/0x610 [ 8040.547084][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8040.547375][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8040.547676][ C0] ip_local_deliver+0x19d/0x480 [ 8040.547941][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8040.548229][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8040.548498][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8040.548779][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8040.549046][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8040.549380][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8040.549659][ C0] ip_rcv+0x564/0x740 [ 8040.549875][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8040.550121][ C0] ? set_track_prepare+0x8a/0xd0 [ 8040.550389][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8040.550677][ C0] ? rest_init+0x153/0x260 [ 8040.550918][ C0] ? skb_clone+0x10b/0x330 [ 8040.551160][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8040.551498][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8040.551820][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8040.552116][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8040.552425][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8040.552682][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8040.552923][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8040.553239][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8040.553537][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8040.553883][ C0] ? lock_acquire+0x1c1/0x220 [ 8040.554139][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8040.554456][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8040.554756][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8040.555094][ C0] ? __copy_skb_header+0xaf/0x490 [ 8040.555366][ C0] ? __skb_clone+0x57a/0x760 [ 8040.555616][ C0] netif_receive_skb+0x55/0x280 [ 8040.555873][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8040.556199][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8040.556548][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8040.556863][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8040.557155][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8040.557453][ C0] ? hlock_class+0x4e/0x130 [ 8040.557709][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8040.558047][ C0] ? place_entity+0x21/0x2f0 [ 8040.558298][ C0] ? resched_curr+0x219/0x280 [ 8040.558549][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8040.558817][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8040.559098][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8040.559380][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8040.559643][ C0] ? activate_task+0xf5/0x260 [ 8040.559899][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8040.560177][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8040.560449][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8040.560713][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8040.561008][ C0] ? get_stack_info+0x36/0xc0 [ 8040.561260][ C0] ? stack_access_ok+0xda/0x1f0 [ 8040.561518][ C0] ? get_reg+0x119/0x190 [ 8040.561745][ C0] __tcf_classify+0x32c/0x7d0 [ 8040.562002][ C0] tcf_classify+0x283/0x930 [ 8040.562249][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8040.562586][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8040.562851][ C0] ? arch_stack_walk+0x8c/0x100 [ 8040.563113][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8040.563403][ C0] tc_run+0x2e4/0x5d0 [ 8040.563620][ C0] ? __pfx_tc_run+0x10/0x10 [ 8040.563867][ C0] ? lock_acquire+0x1c1/0x220 [ 8040.564121][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8040.564402][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8040.564669][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8040.564957][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8040.565240][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8040.565561][ C0] ? neigh_hh_output+0x348/0x590 [ 8040.565826][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8040.566109][ C0] ip_finish_output2+0x786/0x18e0 [ 8040.566381][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8040.566674][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8040.567029][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8040.567321][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8040.567589][ C0] ? __ip_finish_output+0x10f/0x770 [ 8040.567875][ C0] ip_output+0x16b/0x4f0 [ 8040.568103][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8040.568384][ C0] ? __pfx_ip_output+0x10/0x10 [ 8040.568640][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8040.568940][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8040.569207][ C0] ? ip_local_out+0x114/0x3b0 [ 8040.569457][ C0] __ip_queue_xmit+0x672/0x1910 [ 8040.569715][ C0] ? __skb_clone+0x57a/0x760 [ 8040.569959][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8040.570248][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8040.570546][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8040.570870][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8040.571128][ C0] ? tcp_current_mss+0x40a/0x510 [ 8040.571394][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8040.571673][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8040.571952][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8040.572210][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8040.572477][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8040.572795][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8040.573077][ C0] ? ktime_get+0xb6/0x190 [ 8040.573311][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8040.573588][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8040.573868][ C0] tcp_write_timer+0x82/0x1d0 [ 8040.574124][ C0] call_timer_fn+0x176/0x430 [ 8040.574373][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8040.574649][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8040.574925][ C0] __run_timers.part.0+0x52d/0x890 [ 8040.575198][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8040.575486][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8040.575784][ C0] ? lock_acquire+0x1c1/0x220 [ 8040.576036][ C0] ? clockevents_program_event+0xf6/0x300 [ 8040.576348][ C0] ? lock_release+0x1d5/0x250 [ 8040.576604][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8040.576885][ C0] ? ktime_get+0xb6/0x190 [ 8040.577122][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8040.577426][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8040.577745][ C0] run_timer_softirq+0x72/0x100 [ 8040.578006][ C0] __do_softirq+0x1bc/0x7ff [ 8040.578254][ C0] irq_exit_rcu+0x98/0xc0 [ 8040.578484][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8040.578785][ C0] [ 8040.578945][ C0] [ 8040.579110][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8040.579440][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8040.579712][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8040.580738][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8040.581064][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8040.581485][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8040.581902][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8040.582329][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8040.582750][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8040.583175][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8040.583483][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8040.583759][ C0] default_idle_call+0x69/0xa0 [ 8040.584011][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8040.584281][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8040.584574][ C0] ? lock_release+0x1d5/0x250 [ 8040.584832][ C0] do_idle+0xfb/0x160 [ 8040.585049][ C0] cpu_startup_entry+0x55/0x60 [ 8040.585306][ C0] rest_init+0x153/0x260 [ 8040.585533][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8040.585825][ C0] arch_call_rest_init+0x13/0x40 [ 8040.586095][ C0] start_kernel+0x314/0x3d0 [ 8040.586338][ C0] x86_64_start_reservations+0x18/0x30 [ 8040.586627][ C0] x86_64_start_kernel+0xba/0x110 [ 8040.586901][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8040.587232][ C0] [ 8040.587401][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6382s! [ksoftirqd/1:22] [ 8040.587884][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8040.589077][ C1] irq event stamp: 3886976 [ 8040.589313][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8040.589816][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8040.590321][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8040.590825][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8040.591317][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8040.591829][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8040.592558][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8040.593013][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8040.594041][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8040.594366][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8040.594795][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8040.595216][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8040.595648][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8040.596072][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8040.596494][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8040.596969][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8040.597319][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8040.597759][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8040.598184][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8040.598609][ C1] Call Trace: [ 8040.598787][ C1] [ 8040.598946][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8040.599223][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8040.599481][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8040.599781][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8040.600069][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8040.600374][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8040.600663][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8040.600989][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8040.601269][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8040.601602][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8040.601918][ C1] [ 8040.602075][ C1] [ 8040.602232][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8040.602560][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8040.602878][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8040.603190][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8040.603493][ C1] ? run_ksoftirqd+0xb/0x60 [ 8040.603749][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8040.604073][ C1] ? __orc_find+0x9c/0xf0 [ 8040.604307][ C1] ? lock_acquire+0x1c1/0x220 [ 8040.604559][ C1] ? irqentry_enter+0x2b/0x60 [ 8040.604819][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8040.605084][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8040.605373][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8040.605682][ C1] ? lock_acquire+0x1c1/0x220 [ 8040.605932][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8040.606185][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8040.606457][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8040.606712][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8040.606973][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8040.607249][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8040.607539][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8040.607852][ C1] ip_local_deliver+0x19d/0x480 [ 8040.608114][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8040.608403][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8040.608679][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8040.608956][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8040.609219][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8040.609556][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8040.609827][ C1] ip_rcv+0x564/0x740 [ 8040.610040][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8040.610281][ C1] ? set_track_prepare+0x8a/0xd0 [ 8040.610544][ C1] ? irqentry_enter+0x2b/0x60 [ 8040.610797][ C1] ? irqentry_enter+0x2b/0x60 [ 8040.611053][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8040.611296][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8040.611625][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8040.611968][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8040.612282][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8040.612618][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8040.612916][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8040.613252][ C1] netif_receive_skb+0x55/0x280 [ 8040.613517][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8040.613849][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8040.614201][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8040.614514][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8040.614805][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8040.615113][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8040.615445][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8040.615742][ C1] ? arch_stack_walk+0x68/0x100 [ 8040.616003][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8040.616279][ C1] ? irqentry_enter+0x2b/0x60 [ 8040.616531][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8040.616849][ C1] ? irqentry_enter+0x2b/0x60 [ 8040.617105][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8040.617429][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8040.617718][ C1] ? arch_stack_walk+0x68/0x100 [ 8040.617982][ C1] __tcf_classify+0x32c/0x7d0 [ 8040.618234][ C1] tcf_classify+0x283/0x930 [ 8040.618476][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8040.618744][ C1] tc_run+0x2e4/0x5d0 [ 8040.618960][ C1] ? __pfx_tc_run+0x10/0x10 [ 8040.619203][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8040.619471][ C1] ? irqentry_enter+0x2b/0x60 [ 8040.619737][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8040.620028][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8040.620350][ C1] ip_finish_output2+0x786/0x18e0 [ 8040.620620][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8040.620908][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8040.621175][ C1] ? __ip_finish_output+0x10f/0x770 [ 8040.621476][ C1] ip_output+0x16b/0x4f0 [ 8040.621714][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8040.622038][ C1] ? __pfx_ip_output+0x10/0x10 [ 8040.622293][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8040.622650][ C1] ? __pfx_ip_output+0x10/0x10 [ 8040.622991][ C1] __ip_queue_xmit+0x672/0x1910 [ 8040.623359][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8040.623650][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8040.623944][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8040.624227][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8040.624519][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8040.624811][ C1] tcp_delack_timer+0x84/0x240 [ 8040.625067][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8040.625355][ C1] call_timer_fn+0x176/0x430 [ 8040.625613][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8040.625885][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8040.626166][ C1] __run_timers.part.0+0x52d/0x890 [ 8040.626439][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8040.626731][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8040.627030][ C1] ? __pfx___schedule+0x10/0x10 [ 8040.627293][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8040.627630][ C1] run_timer_softirq+0x72/0x100 [ 8040.627903][ C1] __do_softirq+0x1bc/0x7ff [ 8040.628150][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8040.628425][ C1] run_ksoftirqd+0x2e/0x60 [ 8040.628668][ C1] smpboot_thread_fn+0x30e/0x840 [ 8040.628934][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8040.629222][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8040.629515][ C1] kthread+0x292/0x360 [ 8040.629744][ C1] ? __pfx_kthread+0x10/0x10 [ 8040.629990][ C1] ret_from_fork+0x34/0x70 [ 8040.630227][ C1] ? __pfx_kthread+0x10/0x10 [ 8040.630472][ C1] ret_from_fork_asm+0x1b/0x30 [ 8040.630735][ C1] [ 8068.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6408s! [swapper/0:0] [ 8068.527927][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8068.529108][ C0] irq event stamp: 27567077 [ 8068.529347][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8068.529870][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8068.530350][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8068.530857][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8068.531353][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8068.531832][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8068.532470][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8068.532806][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8068.533817][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8068.534137][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8068.534554][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8068.534971][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8068.535387][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8068.535802][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8068.536219][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8068.536685][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8068.537037][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8068.537458][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8068.537890][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8068.538307][ C0] Call Trace: [ 8068.538484][ C0] [ 8068.538639][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8068.538916][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8068.539171][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8068.539467][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8068.539752][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8068.540051][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8068.540330][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8068.540653][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8068.540928][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8068.541203][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8068.541533][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8068.541849][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8068.542185][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8068.542491][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8068.542804][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8068.543105][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8068.543427][ C0] ? get_stack_info+0x36/0xc0 [ 8068.543682][ C0] ? lock_acquire+0x1c1/0x220 [ 8068.543935][ C0] ? lock_release+0x1d5/0x250 [ 8068.544189][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8068.544452][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8068.544741][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8068.545044][ C0] ? lock_acquire+0x1c1/0x220 [ 8068.545294][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8068.545548][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8068.545820][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8068.546070][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8068.546336][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8068.546612][ C0] ? __inet_lookup_established+0x341/0x610 [ 8068.546927][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8068.547215][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8068.547506][ C0] ip_local_deliver+0x19d/0x480 [ 8068.547776][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8068.548062][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8068.548327][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8068.548608][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8068.548873][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8068.549208][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8068.549489][ C0] ip_rcv+0x564/0x740 [ 8068.549704][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8068.549950][ C0] ? set_track_prepare+0x8a/0xd0 [ 8068.550218][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8068.550503][ C0] ? rest_init+0x153/0x260 [ 8068.550742][ C0] ? skb_clone+0x10b/0x330 [ 8068.550983][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8068.551321][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8068.551643][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8068.551933][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8068.552241][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8068.552498][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8068.552737][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8068.553049][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8068.553346][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8068.553689][ C0] ? lock_acquire+0x1c1/0x220 [ 8068.553940][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8068.554253][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8068.554551][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8068.554885][ C0] ? __copy_skb_header+0xaf/0x490 [ 8068.555155][ C0] ? __skb_clone+0x57a/0x760 [ 8068.555405][ C0] netif_receive_skb+0x55/0x280 [ 8068.555660][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8068.555984][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8068.556333][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8068.556649][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8068.556936][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8068.557235][ C0] ? hlock_class+0x4e/0x130 [ 8068.557479][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8068.557817][ C0] ? place_entity+0x21/0x2f0 [ 8068.558067][ C0] ? resched_curr+0x219/0x280 [ 8068.558315][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8068.558581][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8068.558864][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8068.559144][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8068.559409][ C0] ? activate_task+0xf5/0x260 [ 8068.559663][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8068.559939][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8068.560211][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8068.560472][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8068.560762][ C0] ? get_stack_info+0x36/0xc0 [ 8068.561011][ C0] ? stack_access_ok+0xda/0x1f0 [ 8068.561271][ C0] ? get_reg+0x119/0x190 [ 8068.561499][ C0] __tcf_classify+0x32c/0x7d0 [ 8068.561756][ C0] tcf_classify+0x283/0x930 [ 8068.562001][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8068.562335][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8068.562600][ C0] ? arch_stack_walk+0x8c/0x100 [ 8068.562862][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8068.563153][ C0] tc_run+0x2e4/0x5d0 [ 8068.563369][ C0] ? __pfx_tc_run+0x10/0x10 [ 8068.563619][ C0] ? lock_acquire+0x1c1/0x220 [ 8068.563874][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8068.564150][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8068.564416][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8068.564705][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8068.564985][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8068.565306][ C0] ? neigh_hh_output+0x348/0x590 [ 8068.565570][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8068.565850][ C0] ip_finish_output2+0x786/0x18e0 [ 8068.566122][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8068.566417][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8068.566769][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8068.567057][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8068.567326][ C0] ? __ip_finish_output+0x10f/0x770 [ 8068.567611][ C0] ip_output+0x16b/0x4f0 [ 8068.567843][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8068.568125][ C0] ? __pfx_ip_output+0x10/0x10 [ 8068.568382][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8068.568680][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8068.568946][ C0] ? ip_local_out+0x114/0x3b0 [ 8068.569199][ C0] __ip_queue_xmit+0x672/0x1910 [ 8068.569458][ C0] ? __skb_clone+0x57a/0x760 [ 8068.569703][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8068.569986][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8068.570286][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8068.570608][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8068.570867][ C0] ? tcp_current_mss+0x40a/0x510 [ 8068.571134][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8068.571413][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8068.571693][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8068.571950][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8068.572219][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8068.572534][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8068.572814][ C0] ? ktime_get+0xb6/0x190 [ 8068.573049][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8068.573325][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8068.573604][ C0] tcp_write_timer+0x82/0x1d0 [ 8068.573858][ C0] call_timer_fn+0x176/0x430 [ 8068.574109][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8068.574383][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8068.574660][ C0] __run_timers.part.0+0x52d/0x890 [ 8068.574932][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8068.575217][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8068.575515][ C0] ? lock_acquire+0x1c1/0x220 [ 8068.575766][ C0] ? clockevents_program_event+0xf6/0x300 [ 8068.576074][ C0] ? lock_release+0x1d5/0x250 [ 8068.576327][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8068.576606][ C0] ? ktime_get+0xb6/0x190 [ 8068.576840][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8068.577142][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8068.577452][ C0] run_timer_softirq+0x72/0x100 [ 8068.577718][ C0] __do_softirq+0x1bc/0x7ff [ 8068.577962][ C0] irq_exit_rcu+0x98/0xc0 [ 8068.578194][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8068.578494][ C0] [ 8068.578653][ C0] [ 8068.578812][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8068.579132][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8068.579399][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8068.580414][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8068.580736][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8068.581155][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8068.581572][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8068.581987][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8068.582406][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8068.582825][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8068.583127][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8068.583397][ C0] default_idle_call+0x69/0xa0 [ 8068.583652][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8068.583913][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8068.584211][ C0] ? lock_release+0x1d5/0x250 [ 8068.584461][ C0] do_idle+0xfb/0x160 [ 8068.584674][ C0] cpu_startup_entry+0x55/0x60 [ 8068.584927][ C0] rest_init+0x153/0x260 [ 8068.585156][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8068.585443][ C0] arch_call_rest_init+0x13/0x40 [ 8068.585712][ C0] start_kernel+0x314/0x3d0 [ 8068.585958][ C0] x86_64_start_reservations+0x18/0x30 [ 8068.586253][ C0] x86_64_start_kernel+0xba/0x110 [ 8068.586519][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8068.586843][ C0] [ 8068.587007][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6408s! [ksoftirqd/1:22] [ 8068.587483][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8068.588718][ C1] irq event stamp: 3886976 [ 8068.588955][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8068.589471][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8068.589983][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8068.590504][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8068.590995][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8068.591498][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8068.592164][ C1] RIP: 0010:queued_spin_lock_slowpath+0xc2/0xb90 [ 8068.592512][ C1] Code: 41 83 e4 07 49 01 c5 41 83 c4 03 be 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c 08 84 c0 0f 85 42 09 00 00 <8b> 5d 00 85 db 75 62 be 04 00 00 00 48 89 ef e8 da bb 0c fe 89 d8 [ 8068.593547][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000246 [ 8068.593884][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8068.594315][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8068.594748][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8068.595184][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8068.595614][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8068.596037][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8068.596526][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8068.596887][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8068.597311][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8068.597743][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8068.598174][ C1] Call Trace: [ 8068.598352][ C1] [ 8068.598505][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8068.598794][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8068.599063][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8068.599362][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8068.599645][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8068.599957][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8068.600246][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8068.600572][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8068.600860][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8068.601192][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8068.601507][ C1] [ 8068.601667][ C1] [ 8068.601835][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8068.602172][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8068.602483][ C1] ? queued_spin_lock_slowpath+0xc2/0xb90 [ 8068.602786][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8068.603099][ C1] ? run_ksoftirqd+0xb/0x60 [ 8068.603350][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8068.603681][ C1] ? __orc_find+0x9c/0xf0 [ 8068.603925][ C1] ? lock_acquire+0x1c1/0x220 [ 8068.604190][ C1] ? irqentry_enter+0x2b/0x60 [ 8068.604454][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8068.604726][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8068.605023][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8068.605331][ C1] ? lock_acquire+0x1c1/0x220 [ 8068.605588][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8068.605845][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8068.606126][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8068.606381][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8068.606651][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8068.606932][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8068.607235][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8068.607541][ C1] ip_local_deliver+0x19d/0x480 [ 8068.607813][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8068.608102][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8068.608382][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8068.608664][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8068.608925][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8068.609274][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8068.609563][ C1] ip_rcv+0x564/0x740 [ 8068.609779][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8068.610023][ C1] ? set_track_prepare+0x8a/0xd0 [ 8068.610296][ C1] ? irqentry_enter+0x2b/0x60 [ 8068.610557][ C1] ? irqentry_enter+0x2b/0x60 [ 8068.610821][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8068.611070][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8068.611397][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8068.611742][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8068.612057][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8068.612395][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8068.612697][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8068.613044][ C1] netif_receive_skb+0x55/0x280 [ 8068.613305][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8068.613649][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8068.614006][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8068.614319][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8068.614621][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8068.614940][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8068.615286][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8068.615577][ C1] ? arch_stack_walk+0x68/0x100 [ 8068.615844][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8068.616132][ C1] ? irqentry_enter+0x2b/0x60 [ 8068.616387][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8068.616708][ C1] ? irqentry_enter+0x2b/0x60 [ 8068.616970][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8068.617305][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8068.617591][ C1] ? arch_stack_walk+0x68/0x100 [ 8068.617856][ C1] __tcf_classify+0x32c/0x7d0 [ 8068.618115][ C1] tcf_classify+0x283/0x930 [ 8068.618359][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8068.618632][ C1] tc_run+0x2e4/0x5d0 [ 8068.618844][ C1] ? __pfx_tc_run+0x10/0x10 [ 8068.619089][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8068.619353][ C1] ? irqentry_enter+0x2b/0x60 [ 8068.619604][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8068.619905][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8068.620231][ C1] ip_finish_output2+0x786/0x18e0 [ 8068.620503][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8068.620803][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8068.621082][ C1] ? __ip_finish_output+0x10f/0x770 [ 8068.621360][ C1] ip_output+0x16b/0x4f0 [ 8068.621594][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8068.621926][ C1] ? __pfx_ip_output+0x10/0x10 [ 8068.622190][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8068.622554][ C1] ? __pfx_ip_output+0x10/0x10 [ 8068.622814][ C1] __ip_queue_xmit+0x672/0x1910 [ 8068.623087][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8068.623367][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8068.623665][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8068.623951][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8068.624246][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8068.624533][ C1] tcp_delack_timer+0x84/0x240 [ 8068.624792][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8068.625083][ C1] call_timer_fn+0x176/0x430 [ 8068.625341][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8068.625623][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8068.625917][ C1] __run_timers.part.0+0x52d/0x890 [ 8068.626202][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8068.626495][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8068.626804][ C1] ? __pfx___schedule+0x10/0x10 [ 8068.627071][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8068.627406][ C1] run_timer_softirq+0x72/0x100 [ 8068.627724][ C1] __do_softirq+0x1bc/0x7ff [ 8068.627974][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8068.628251][ C1] run_ksoftirqd+0x2e/0x60 [ 8068.628501][ C1] smpboot_thread_fn+0x30e/0x840 [ 8068.628773][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8068.629065][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8068.629356][ C1] kthread+0x292/0x360 [ 8068.629578][ C1] ? __pfx_kthread+0x10/0x10 [ 8068.629822][ C1] ret_from_fork+0x34/0x70 [ 8068.630067][ C1] ? __pfx_kthread+0x10/0x10 [ 8068.630317][ C1] ret_from_fork_asm+0x1b/0x30 [ 8068.630580][ C1] [ 8091.904024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8091.904411][ C0] rcu: 0-....: (6841896 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1626312 [ 8091.904931][ C0] rcu: (t=6897595 jiffies g=1007429 q=31 ncpus=4) [ 8091.905277][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8091.905760][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8091.906398][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8091.906741][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8091.907763][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8091.908088][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8091.908513][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8091.908940][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8091.909363][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8091.909786][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8091.910212][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8091.910690][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8091.911037][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8091.911464][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8091.911885][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8091.912304][ C0] Call Trace: [ 8091.912480][ C0] [ 8091.912636][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8091.912924][ C0] ? print_cpu_stall+0x263/0x6a0 [ 8091.913189][ C0] ? check_cpu_stall+0x284/0x500 [ 8091.913455][ C0] ? rcu_pending+0x92/0x360 [ 8091.913693][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8091.913972][ C0] ? update_process_times+0xb9/0x110 [ 8091.914255][ C0] ? tick_sched_handle+0x67/0x130 [ 8091.914521][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8091.914818][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8091.915073][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8091.915398][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8091.915684][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8091.915987][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8091.916267][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8091.916590][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8091.916861][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8091.917139][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8091.917469][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8091.917779][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8091.918111][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8091.918415][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8091.918729][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8091.919029][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8091.919352][ C0] ? get_stack_info+0x36/0xc0 [ 8091.919606][ C0] ? lock_acquire+0x1c1/0x220 [ 8091.919860][ C0] ? lock_release+0x1d5/0x250 [ 8091.920112][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8091.920375][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8091.920665][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8091.920966][ C0] ? lock_acquire+0x1c1/0x220 [ 8091.921216][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8091.921469][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8091.921741][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8091.921990][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8091.922252][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8091.922525][ C0] ? __inet_lookup_established+0x341/0x610 [ 8091.922839][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8091.923128][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8091.923417][ C0] ip_local_deliver+0x19d/0x480 [ 8091.923683][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8091.923972][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8091.924240][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8091.924517][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8091.924782][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8091.925115][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8091.925395][ C0] ip_rcv+0x564/0x740 [ 8091.925608][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8091.925853][ C0] ? set_track_prepare+0x8a/0xd0 [ 8091.926119][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8091.926406][ C0] ? rest_init+0x153/0x260 [ 8091.926646][ C0] ? skb_clone+0x10b/0x330 [ 8091.926884][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8091.927221][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8091.927549][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8091.927848][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8091.928159][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8091.928420][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8091.928665][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8091.928983][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8091.929285][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8091.929623][ C0] ? lock_acquire+0x1c1/0x220 [ 8091.929870][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8091.930180][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8091.930482][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8091.930812][ C0] ? __copy_skb_header+0xaf/0x490 [ 8091.931079][ C0] ? __skb_clone+0x57a/0x760 [ 8091.931322][ C0] netif_receive_skb+0x55/0x280 [ 8091.931583][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8091.931912][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8091.932266][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8091.932577][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8091.932867][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8091.933168][ C0] ? hlock_class+0x4e/0x130 [ 8091.933415][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8091.933749][ C0] ? place_entity+0x21/0x2f0 [ 8091.933998][ C0] ? resched_curr+0x219/0x280 [ 8091.934249][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8091.934517][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8091.934796][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8091.935076][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8091.935337][ C0] ? activate_task+0xf5/0x260 [ 8091.935589][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8091.935867][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8091.936139][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8091.936401][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8091.936699][ C0] ? get_stack_info+0x36/0xc0 [ 8091.936952][ C0] ? stack_access_ok+0xda/0x1f0 [ 8091.937210][ C0] ? get_reg+0x119/0x190 [ 8091.937439][ C0] __tcf_classify+0x32c/0x7d0 [ 8091.937692][ C0] tcf_classify+0x283/0x930 [ 8091.937931][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8091.938259][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8091.938528][ C0] ? arch_stack_walk+0x8c/0x100 [ 8091.938794][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8091.939088][ C0] tc_run+0x2e4/0x5d0 [ 8091.939301][ C0] ? __pfx_tc_run+0x10/0x10 [ 8091.939541][ C0] ? lock_acquire+0x1c1/0x220 [ 8091.939791][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8091.940065][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8091.940336][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8091.940621][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8091.940900][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8091.941219][ C0] ? neigh_hh_output+0x348/0x590 [ 8091.941487][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8091.941763][ C0] ip_finish_output2+0x786/0x18e0 [ 8091.942030][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8091.942322][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8091.942679][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8091.942973][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8091.943238][ C0] ? __ip_finish_output+0x10f/0x770 [ 8091.943518][ C0] ip_output+0x16b/0x4f0 [ 8091.943746][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8091.944025][ C0] ? __pfx_ip_output+0x10/0x10 [ 8091.944282][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8091.944582][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8091.944849][ C0] ? ip_local_out+0x114/0x3b0 [ 8091.945099][ C0] __ip_queue_xmit+0x672/0x1910 [ 8091.945356][ C0] ? __skb_clone+0x57a/0x760 [ 8091.945599][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8091.945886][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8091.946183][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8091.946505][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8091.946763][ C0] ? tcp_current_mss+0x40a/0x510 [ 8091.947027][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8091.947305][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8091.947590][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8091.947844][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8091.948114][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8091.948436][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8091.948711][ C0] ? ktime_get+0xb6/0x190 [ 8091.948943][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8091.949216][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8091.949503][ C0] tcp_write_timer+0x82/0x1d0 [ 8091.949753][ C0] call_timer_fn+0x176/0x430 [ 8091.949997][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8091.950274][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8091.950546][ C0] __run_timers.part.0+0x52d/0x890 [ 8091.950822][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8091.951107][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8091.951408][ C0] ? lock_acquire+0x1c1/0x220 [ 8091.951660][ C0] ? clockevents_program_event+0xf6/0x300 [ 8091.951965][ C0] ? lock_release+0x1d5/0x250 [ 8091.952217][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8091.952492][ C0] ? ktime_get+0xb6/0x190 [ 8091.952722][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8091.953020][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8091.953333][ C0] run_timer_softirq+0x72/0x100 [ 8091.953595][ C0] __do_softirq+0x1bc/0x7ff [ 8091.953837][ C0] irq_exit_rcu+0x98/0xc0 [ 8091.954069][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8091.954368][ C0] [ 8091.954529][ C0] [ 8091.954688][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8091.955012][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8091.955281][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8091.956296][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8091.956620][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8091.957039][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8091.957461][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8091.957886][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8091.958312][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8091.958735][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8091.959044][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8091.959324][ C0] default_idle_call+0x69/0xa0 [ 8091.959576][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8091.959843][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8091.960137][ C0] ? lock_release+0x1d5/0x250 [ 8091.960392][ C0] do_idle+0xfb/0x160 [ 8091.960607][ C0] cpu_startup_entry+0x55/0x60 [ 8091.960863][ C0] rest_init+0x153/0x260 [ 8091.961090][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8091.961381][ C0] arch_call_rest_init+0x13/0x40 [ 8091.961652][ C0] start_kernel+0x314/0x3d0 [ 8091.961894][ C0] x86_64_start_reservations+0x18/0x30 [ 8091.962186][ C0] x86_64_start_kernel+0xba/0x110 [ 8091.962456][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8091.962785][ C0] [ 8091.962952][ C0] Sending NMI from CPU 0 to CPUs 1: [ 8091.963238][ C1] NMI backtrace for cpu 1 [ 8091.963254][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8091.963259][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8091.963261][ C1] RIP: 0010:kasan_check_range+0x10f/0x1c0 [ 8091.963270][ C1] Code: 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff 5b b8 01 00 00 00 5d 41 5c cc cc cc cc 41 bc 08 00 00 00 45 29 dc 49 8d 14 2c eb 0c 48 83 [ 8091.963272][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000246 [ 8091.963276][ C1] RAX: 0000000000000001 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8091.963278][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8091.963279][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8091.963281][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8091.963283][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8091.963284][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8091.963287][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8091.963290][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8091.963292][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8091.963293][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8091.963295][ C1] Call Trace: [ 8091.963298][ C1] [ 8091.963302][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 8091.963307][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8091.963312][ C1] ? nmi_handle+0x156/0x420 [ 8091.963316][ C1] ? default_do_nmi+0x41/0x100 [ 8091.963320][ C1] ? exc_nmi+0xf3/0x120 [ 8091.963323][ C1] ? end_repeat_nmi+0xf/0x60 [ 8091.963327][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8091.963331][ C1] ? kasan_check_range+0x10f/0x1c0 [ 8091.963335][ C1] ? kasan_check_range+0x10f/0x1c0 [ 8091.963339][ C1] ? kasan_check_range+0x10f/0x1c0 [ 8091.963342][ C1] [ 8091.963343][ C1] [ 8091.963344][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 8091.963347][ C1] ? run_ksoftirqd+0xb/0x60 [ 8091.963353][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8091.963355][ C1] ? __orc_find+0x9c/0xf0 [ 8091.963358][ C1] ? lock_acquire+0x1c1/0x220 [ 8091.963362][ C1] ? irqentry_enter+0x2b/0x60 [ 8091.963367][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8091.963370][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8091.963373][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8091.963376][ C1] ? lock_acquire+0x1c1/0x220 [ 8091.963379][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8091.963383][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8091.963386][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8091.963393][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8091.963396][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8091.963401][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8091.963407][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8091.963411][ C1] ip_local_deliver+0x19d/0x480 [ 8091.963414][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8091.963417][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8091.963421][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8091.963425][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8091.963428][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8091.963431][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8091.963440][ C1] ip_rcv+0x564/0x740 [ 8091.963443][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8091.963446][ C1] ? set_track_prepare+0x8a/0xd0 [ 8091.963450][ C1] ? irqentry_enter+0x2b/0x60 [ 8091.963453][ C1] ? irqentry_enter+0x2b/0x60 [ 8091.963457][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8091.963460][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8091.963464][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8091.963467][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8091.963470][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8091.963473][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8091.963476][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8091.963481][ C1] netif_receive_skb+0x55/0x280 [ 8091.963484][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8091.963492][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8091.963499][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8091.963505][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8091.963511][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8091.963523][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8091.963532][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8091.963535][ C1] ? arch_stack_walk+0x68/0x100 [ 8091.963539][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8091.963542][ C1] ? irqentry_enter+0x2b/0x60 [ 8091.963546][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8091.963550][ C1] ? irqentry_enter+0x2b/0x60 [ 8091.963553][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8091.963560][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8091.963562][ C1] ? arch_stack_walk+0x68/0x100 [ 8091.963567][ C1] __tcf_classify+0x32c/0x7d0 [ 8091.963572][ C1] tcf_classify+0x283/0x930 [ 8091.963576][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8091.963580][ C1] tc_run+0x2e4/0x5d0 [ 8091.963584][ C1] ? __pfx_tc_run+0x10/0x10 [ 8091.963589][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8091.963595][ C1] ? irqentry_enter+0x2b/0x60 [ 8091.963598][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8091.963601][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8091.963608][ C1] ip_finish_output2+0x786/0x18e0 [ 8091.963613][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8091.963616][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8091.963619][ C1] ? __ip_finish_output+0x10f/0x770 [ 8091.963623][ C1] ip_output+0x16b/0x4f0 [ 8091.963626][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8091.963630][ C1] ? __pfx_ip_output+0x10/0x10 [ 8091.963634][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8091.963641][ C1] ? __pfx_ip_output+0x10/0x10 [ 8091.963646][ C1] __ip_queue_xmit+0x672/0x1910 [ 8091.963651][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8091.963657][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8091.963662][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8091.963666][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8091.963670][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8091.963673][ C1] tcp_delack_timer+0x84/0x240 [ 8091.963677][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8091.963680][ C1] call_timer_fn+0x176/0x430 [ 8091.963684][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8091.963689][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8091.963693][ C1] __run_timers.part.0+0x52d/0x890 [ 8091.963696][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8091.963701][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8091.963705][ C1] ? __pfx___schedule+0x10/0x10 [ 8091.963709][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8091.963713][ C1] run_timer_softirq+0x72/0x100 [ 8091.963717][ C1] __do_softirq+0x1bc/0x7ff [ 8091.963720][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8091.963724][ C1] run_ksoftirqd+0x2e/0x60 [ 8091.963727][ C1] smpboot_thread_fn+0x30e/0x840 [ 8091.963732][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8091.963735][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8091.963738][ C1] kthread+0x292/0x360 [ 8091.963741][ C1] ? __pfx_kthread+0x10/0x10 [ 8091.963743][ C1] ret_from_fork+0x34/0x70 [ 8091.963746][ C1] ? __pfx_kthread+0x10/0x10 [ 8091.963748][ C1] ret_from_fork_asm+0x1b/0x30 [ 8091.963756][ C1] [ 8116.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6453s! [swapper/0:0] [ 8116.527919][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8116.529106][ C0] irq event stamp: 27567077 [ 8116.529344][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8116.529870][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8116.530346][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8116.530856][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8116.531355][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8116.531837][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8116.532474][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8116.532821][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8116.533845][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8116.534172][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8116.534593][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8116.535019][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8116.535442][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8116.535861][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8116.536280][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8116.536755][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8116.537101][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8116.537526][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8116.537944][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8116.538365][ C0] Call Trace: [ 8116.538549][ C0] [ 8116.538706][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8116.538980][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8116.539237][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8116.539527][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8116.539816][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8116.540120][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8116.540401][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8116.540721][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8116.540991][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8116.541269][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8116.541589][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8116.541900][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8116.542232][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8116.542535][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8116.542842][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8116.543148][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8116.543478][ C0] ? get_stack_info+0x36/0xc0 [ 8116.543730][ C0] ? lock_acquire+0x1c1/0x220 [ 8116.543981][ C0] ? lock_release+0x1d5/0x250 [ 8116.544231][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8116.544494][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8116.544775][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8116.545071][ C0] ? lock_acquire+0x1c1/0x220 [ 8116.545322][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8116.545577][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8116.545853][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8116.546097][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8116.546356][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8116.546624][ C0] ? __inet_lookup_established+0x341/0x610 [ 8116.546942][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8116.547232][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8116.547529][ C0] ip_local_deliver+0x19d/0x480 [ 8116.547789][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8116.548075][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8116.548341][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8116.548616][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8116.548878][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8116.549215][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8116.549488][ C0] ip_rcv+0x564/0x740 [ 8116.549701][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8116.549943][ C0] ? set_track_prepare+0x8a/0xd0 [ 8116.550206][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8116.550497][ C0] ? rest_init+0x153/0x260 [ 8116.550734][ C0] ? skb_clone+0x10b/0x330 [ 8116.550974][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8116.551307][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8116.551628][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8116.551925][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8116.552235][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8116.552498][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8116.552742][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8116.553058][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8116.553357][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8116.553693][ C0] ? lock_acquire+0x1c1/0x220 [ 8116.553942][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8116.554250][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8116.554547][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8116.554873][ C0] ? __copy_skb_header+0xaf/0x490 [ 8116.555139][ C0] ? __skb_clone+0x57a/0x760 [ 8116.555386][ C0] netif_receive_skb+0x55/0x280 [ 8116.555646][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8116.555977][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8116.556325][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8116.556637][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8116.556927][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8116.557230][ C0] ? hlock_class+0x4e/0x130 [ 8116.557483][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8116.557808][ C0] ? place_entity+0x21/0x2f0 [ 8116.558051][ C0] ? resched_curr+0x219/0x280 [ 8116.558303][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8116.558575][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8116.558858][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8116.559133][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8116.559388][ C0] ? activate_task+0xf5/0x260 [ 8116.559634][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8116.559907][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8116.560181][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8116.560439][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8116.560728][ C0] ? get_stack_info+0x36/0xc0 [ 8116.560980][ C0] ? stack_access_ok+0xda/0x1f0 [ 8116.561239][ C0] ? get_reg+0x119/0x190 [ 8116.561469][ C0] __tcf_classify+0x32c/0x7d0 [ 8116.561719][ C0] tcf_classify+0x283/0x930 [ 8116.561961][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8116.562290][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8116.562560][ C0] ? arch_stack_walk+0x8c/0x100 [ 8116.562821][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8116.563112][ C0] tc_run+0x2e4/0x5d0 [ 8116.563325][ C0] ? __pfx_tc_run+0x10/0x10 [ 8116.563565][ C0] ? lock_acquire+0x1c1/0x220 [ 8116.563811][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8116.564083][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8116.564349][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8116.564630][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8116.564904][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8116.565225][ C0] ? neigh_hh_output+0x348/0x590 [ 8116.565492][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8116.565767][ C0] ip_finish_output2+0x786/0x18e0 [ 8116.566033][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8116.566322][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8116.566678][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8116.566969][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8116.567230][ C0] ? __ip_finish_output+0x10f/0x770 [ 8116.567513][ C0] ip_output+0x16b/0x4f0 [ 8116.567740][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8116.568024][ C0] ? __pfx_ip_output+0x10/0x10 [ 8116.568280][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8116.568581][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8116.568841][ C0] ? ip_local_out+0x114/0x3b0 [ 8116.569095][ C0] __ip_queue_xmit+0x672/0x1910 [ 8116.569360][ C0] ? __skb_clone+0x57a/0x760 [ 8116.569608][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8116.569886][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8116.570179][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8116.570496][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8116.570754][ C0] ? tcp_current_mss+0x40a/0x510 [ 8116.571016][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8116.571300][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8116.571573][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8116.571824][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8116.572095][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8116.572416][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8116.572690][ C0] ? ktime_get+0xb6/0x190 [ 8116.572920][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8116.573192][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8116.573475][ C0] tcp_write_timer+0x82/0x1d0 [ 8116.573726][ C0] call_timer_fn+0x176/0x430 [ 8116.573972][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8116.574252][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8116.574524][ C0] __run_timers.part.0+0x52d/0x890 [ 8116.574797][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8116.575077][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8116.575377][ C0] ? lock_acquire+0x1c1/0x220 [ 8116.575625][ C0] ? clockevents_program_event+0xf6/0x300 [ 8116.575928][ C0] ? lock_release+0x1d5/0x250 [ 8116.576176][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8116.576450][ C0] ? ktime_get+0xb6/0x190 [ 8116.576679][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8116.576976][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8116.577288][ C0] run_timer_softirq+0x72/0x100 [ 8116.577554][ C0] __do_softirq+0x1bc/0x7ff [ 8116.577802][ C0] irq_exit_rcu+0x98/0xc0 [ 8116.578036][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8116.578334][ C0] [ 8116.578489][ C0] [ 8116.578645][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8116.578960][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8116.579231][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8116.580254][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8116.580578][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8116.581002][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8116.581426][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8116.581845][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8116.582266][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8116.582692][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8116.582998][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8116.583274][ C0] default_idle_call+0x69/0xa0 [ 8116.583531][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8116.583796][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8116.584085][ C0] ? lock_release+0x1d5/0x250 [ 8116.584338][ C0] do_idle+0xfb/0x160 [ 8116.584554][ C0] cpu_startup_entry+0x55/0x60 [ 8116.584812][ C0] rest_init+0x153/0x260 [ 8116.585037][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8116.585325][ C0] arch_call_rest_init+0x13/0x40 [ 8116.585592][ C0] start_kernel+0x314/0x3d0 [ 8116.585833][ C0] x86_64_start_reservations+0x18/0x30 [ 8116.586121][ C0] x86_64_start_kernel+0xba/0x110 [ 8116.586394][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8116.586725][ C0] [ 8116.586892][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6453s! [ksoftirqd/1:22] [ 8116.587359][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8116.588545][ C1] irq event stamp: 3886976 [ 8116.588781][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8116.589285][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8116.589797][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8116.590300][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8116.590793][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8116.591293][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8116.591942][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8116.592287][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8116.593326][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8116.593654][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8116.594076][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8116.594499][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8116.594926][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8116.595350][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8116.595771][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8116.596248][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8116.596600][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8116.597023][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8116.597454][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8116.597881][ C1] Call Trace: [ 8116.598067][ C1] [ 8116.598228][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8116.598505][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8116.598762][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8116.599054][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8116.599348][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8116.599660][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8116.599942][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8116.600265][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8116.600540][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8116.600870][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8116.601183][ C1] [ 8116.601341][ C1] [ 8116.601497][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8116.601833][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8116.602141][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8116.602460][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8116.602766][ C1] ? run_ksoftirqd+0xb/0x60 [ 8116.603008][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8116.603337][ C1] ? __orc_find+0x9c/0xf0 [ 8116.603574][ C1] ? lock_acquire+0x1c1/0x220 [ 8116.603831][ C1] ? irqentry_enter+0x2b/0x60 [ 8116.604089][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8116.604353][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8116.604645][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8116.604947][ C1] ? lock_acquire+0x1c1/0x220 [ 8116.605195][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8116.605446][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8116.605718][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8116.605969][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8116.606232][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8116.606508][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8116.606799][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8116.607094][ C1] ip_local_deliver+0x19d/0x480 [ 8116.607367][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8116.607658][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8116.607925][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8116.608203][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8116.608466][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8116.608809][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8116.609085][ C1] ip_rcv+0x564/0x740 [ 8116.609300][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8116.609542][ C1] ? set_track_prepare+0x8a/0xd0 [ 8116.609807][ C1] ? irqentry_enter+0x2b/0x60 [ 8116.610067][ C1] ? irqentry_enter+0x2b/0x60 [ 8116.610321][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8116.610567][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8116.610887][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8116.611237][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8116.611549][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8116.611895][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8116.612194][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8116.612530][ C1] netif_receive_skb+0x55/0x280 [ 8116.612794][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8116.613128][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8116.613482][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8116.613808][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8116.614102][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8116.614412][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8116.614744][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8116.615030][ C1] ? arch_stack_walk+0x68/0x100 [ 8116.615291][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8116.615568][ C1] ? irqentry_enter+0x2b/0x60 [ 8116.615818][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8116.616137][ C1] ? irqentry_enter+0x2b/0x60 [ 8116.616397][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8116.616724][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8116.617004][ C1] ? arch_stack_walk+0x68/0x100 [ 8116.617270][ C1] __tcf_classify+0x32c/0x7d0 [ 8116.617537][ C1] tcf_classify+0x283/0x930 [ 8116.617778][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8116.618047][ C1] tc_run+0x2e4/0x5d0 [ 8116.618261][ C1] ? __pfx_tc_run+0x10/0x10 [ 8116.618503][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8116.618777][ C1] ? irqentry_enter+0x2b/0x60 [ 8116.619030][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8116.619318][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8116.619645][ C1] ip_finish_output2+0x786/0x18e0 [ 8116.619914][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8116.620202][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8116.620472][ C1] ? __ip_finish_output+0x10f/0x770 [ 8116.620751][ C1] ip_output+0x16b/0x4f0 [ 8116.620983][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8116.621307][ C1] ? __pfx_ip_output+0x10/0x10 [ 8116.621564][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8116.621921][ C1] ? __pfx_ip_output+0x10/0x10 [ 8116.622183][ C1] __ip_queue_xmit+0x672/0x1910 [ 8116.622447][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8116.622729][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8116.623025][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8116.623317][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8116.623612][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8116.623896][ C1] tcp_delack_timer+0x84/0x240 [ 8116.624149][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8116.624437][ C1] call_timer_fn+0x176/0x430 [ 8116.624687][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8116.624961][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8116.625243][ C1] __run_timers.part.0+0x52d/0x890 [ 8116.625519][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8116.625815][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8116.626115][ C1] ? __pfx___schedule+0x10/0x10 [ 8116.626382][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8116.626705][ C1] run_timer_softirq+0x72/0x100 [ 8116.626964][ C1] __do_softirq+0x1bc/0x7ff [ 8116.627207][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8116.627489][ C1] run_ksoftirqd+0x2e/0x60 [ 8116.627730][ C1] smpboot_thread_fn+0x30e/0x840 [ 8116.628000][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8116.628290][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8116.628590][ C1] kthread+0x292/0x360 [ 8116.628807][ C1] ? __pfx_kthread+0x10/0x10 [ 8116.629056][ C1] ret_from_fork+0x34/0x70 [ 8116.629293][ C1] ? __pfx_kthread+0x10/0x10 [ 8116.629543][ C1] ret_from_fork_asm+0x1b/0x30 [ 8116.629803][ C1] [ 8144.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6479s! [swapper/0:0] [ 8144.527915][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8144.529110][ C0] irq event stamp: 27567077 [ 8144.529351][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8144.529880][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8144.530350][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8144.530849][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8144.531338][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8144.531815][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8144.532462][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8144.532802][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8144.533822][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8144.534151][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8144.534572][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8144.534992][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8144.535418][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8144.535843][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8144.536264][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8144.536732][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8144.537080][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8144.537503][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8144.537921][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8144.538342][ C0] Call Trace: [ 8144.538524][ C0] [ 8144.538680][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8144.538954][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8144.539211][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8144.539499][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8144.539786][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8144.540096][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8144.540376][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8144.540698][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8144.540970][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8144.541247][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8144.541568][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8144.541878][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8144.542210][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8144.542510][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8144.542817][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8144.543124][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8144.543452][ C0] ? get_stack_info+0x36/0xc0 [ 8144.543704][ C0] ? lock_acquire+0x1c1/0x220 [ 8144.543955][ C0] ? lock_release+0x1d5/0x250 [ 8144.544205][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8144.544465][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8144.544749][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8144.545046][ C0] ? lock_acquire+0x1c1/0x220 [ 8144.545296][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8144.545548][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8144.545822][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8144.546068][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8144.546327][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8144.546594][ C0] ? __inet_lookup_established+0x341/0x610 [ 8144.546904][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8144.547210][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8144.547500][ C0] ip_local_deliver+0x19d/0x480 [ 8144.547761][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8144.548048][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8144.548312][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8144.548586][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8144.548847][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8144.549186][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8144.549459][ C0] ip_rcv+0x564/0x740 [ 8144.549669][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8144.549907][ C0] ? set_track_prepare+0x8a/0xd0 [ 8144.550170][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8144.550462][ C0] ? rest_init+0x153/0x260 [ 8144.550696][ C0] ? skb_clone+0x10b/0x330 [ 8144.550938][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8144.551271][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8144.551588][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8144.551887][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8144.552197][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8144.552458][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8144.552701][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8144.553019][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8144.553320][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8144.553657][ C0] ? lock_acquire+0x1c1/0x220 [ 8144.553903][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8144.554212][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8144.554511][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8144.554840][ C0] ? __copy_skb_header+0xaf/0x490 [ 8144.555106][ C0] ? __skb_clone+0x57a/0x760 [ 8144.555351][ C0] netif_receive_skb+0x55/0x280 [ 8144.555613][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8144.555941][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8144.556291][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8144.556603][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8144.556890][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8144.557203][ C0] ? hlock_class+0x4e/0x130 [ 8144.557444][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8144.557774][ C0] ? place_entity+0x21/0x2f0 [ 8144.558021][ C0] ? resched_curr+0x219/0x280 [ 8144.558276][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8144.558546][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8144.558828][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8144.559103][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8144.559360][ C0] ? activate_task+0xf5/0x260 [ 8144.559608][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8144.559881][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8144.560155][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8144.560413][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8144.560708][ C0] ? get_stack_info+0x36/0xc0 [ 8144.560962][ C0] ? stack_access_ok+0xda/0x1f0 [ 8144.561222][ C0] ? get_reg+0x119/0x190 [ 8144.561450][ C0] __tcf_classify+0x32c/0x7d0 [ 8144.561701][ C0] tcf_classify+0x283/0x930 [ 8144.561940][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8144.562266][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8144.562536][ C0] ? arch_stack_walk+0x8c/0x100 [ 8144.562798][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8144.563089][ C0] tc_run+0x2e4/0x5d0 [ 8144.563302][ C0] ? __pfx_tc_run+0x10/0x10 [ 8144.563540][ C0] ? lock_acquire+0x1c1/0x220 [ 8144.563787][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8144.564061][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8144.564328][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8144.564610][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8144.564884][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8144.565202][ C0] ? neigh_hh_output+0x348/0x590 [ 8144.565469][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8144.565751][ C0] ip_finish_output2+0x786/0x18e0 [ 8144.566017][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8144.566309][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8144.566667][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8144.566958][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8144.567226][ C0] ? __ip_finish_output+0x10f/0x770 [ 8144.567502][ C0] ip_output+0x16b/0x4f0 [ 8144.567726][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8144.568009][ C0] ? __pfx_ip_output+0x10/0x10 [ 8144.568263][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8144.568566][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8144.568827][ C0] ? ip_local_out+0x114/0x3b0 [ 8144.569080][ C0] __ip_queue_xmit+0x672/0x1910 [ 8144.569342][ C0] ? __skb_clone+0x57a/0x760 [ 8144.569590][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8144.569867][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8144.570159][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8144.570473][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8144.570731][ C0] ? tcp_current_mss+0x40a/0x510 [ 8144.570991][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8144.571276][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8144.571548][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8144.571802][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8144.572074][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8144.572392][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8144.572666][ C0] ? ktime_get+0xb6/0x190 [ 8144.572896][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8144.573169][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8144.573452][ C0] tcp_write_timer+0x82/0x1d0 [ 8144.573699][ C0] call_timer_fn+0x176/0x430 [ 8144.573943][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8144.574219][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8144.574491][ C0] __run_timers.part.0+0x52d/0x890 [ 8144.574766][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8144.575047][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8144.575346][ C0] ? lock_acquire+0x1c1/0x220 [ 8144.575591][ C0] ? clockevents_program_event+0xf6/0x300 [ 8144.575893][ C0] ? lock_release+0x1d5/0x250 [ 8144.576145][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8144.576421][ C0] ? ktime_get+0xb6/0x190 [ 8144.576650][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8144.576947][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8144.577264][ C0] run_timer_softirq+0x72/0x100 [ 8144.577525][ C0] __do_softirq+0x1bc/0x7ff [ 8144.577769][ C0] irq_exit_rcu+0x98/0xc0 [ 8144.578001][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8144.578303][ C0] [ 8144.578459][ C0] [ 8144.578615][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8144.578935][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8144.579206][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8144.580227][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8144.580554][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8144.580973][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8144.581397][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8144.581821][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8144.582240][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8144.582661][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8144.582966][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8144.583241][ C0] default_idle_call+0x69/0xa0 [ 8144.583492][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8144.583758][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8144.584048][ C0] ? lock_release+0x1d5/0x250 [ 8144.584300][ C0] do_idle+0xfb/0x160 [ 8144.584513][ C0] cpu_startup_entry+0x55/0x60 [ 8144.584768][ C0] rest_init+0x153/0x260 [ 8144.584991][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8144.585281][ C0] arch_call_rest_init+0x13/0x40 [ 8144.585546][ C0] start_kernel+0x314/0x3d0 [ 8144.585786][ C0] x86_64_start_reservations+0x18/0x30 [ 8144.586078][ C0] x86_64_start_kernel+0xba/0x110 [ 8144.586350][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8144.586677][ C0] [ 8144.586845][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6479s! [ksoftirqd/1:22] [ 8144.587320][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8144.588523][ C1] irq event stamp: 3886976 [ 8144.588764][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8144.589264][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8144.589762][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8144.590263][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8144.590760][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8144.591257][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8144.591905][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8144.592248][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8144.593274][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8144.593601][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8144.594026][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8144.594447][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8144.594865][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8144.595286][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8144.595706][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8144.596174][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8144.596531][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8144.596956][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8144.597383][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8144.597804][ C1] Call Trace: [ 8144.597982][ C1] [ 8144.598138][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8144.598420][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8144.598680][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8144.598976][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8144.599263][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8144.599567][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8144.599846][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8144.600169][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8144.600449][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8144.600773][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8144.601086][ C1] [ 8144.601246][ C1] [ 8144.601407][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8144.601741][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8144.602049][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8144.602361][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8144.602670][ C1] ? run_ksoftirqd+0xb/0x60 [ 8144.602922][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8144.603254][ C1] ? __orc_find+0x9c/0xf0 [ 8144.603485][ C1] ? lock_acquire+0x1c1/0x220 [ 8144.603736][ C1] ? irqentry_enter+0x2b/0x60 [ 8144.603988][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8144.604253][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8144.604541][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8144.604842][ C1] ? lock_acquire+0x1c1/0x220 [ 8144.605097][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8144.605354][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8144.605632][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8144.605878][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8144.606138][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8144.606410][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8144.606698][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8144.606987][ C1] ip_local_deliver+0x19d/0x480 [ 8144.607258][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8144.607543][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8144.607809][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8144.608092][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8144.608365][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8144.608704][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8144.608983][ C1] ip_rcv+0x564/0x740 [ 8144.609206][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8144.609454][ C1] ? set_track_prepare+0x8a/0xd0 [ 8144.609724][ C1] ? irqentry_enter+0x2b/0x60 [ 8144.609977][ C1] ? irqentry_enter+0x2b/0x60 [ 8144.610232][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8144.610476][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8144.610791][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8144.611137][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8144.611449][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8144.611793][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8144.612096][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8144.612428][ C1] netif_receive_skb+0x55/0x280 [ 8144.612689][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8144.613015][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8144.613366][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8144.613682][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8144.613970][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8144.614273][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8144.614601][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8144.614885][ C1] ? arch_stack_walk+0x68/0x100 [ 8144.615150][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8144.615436][ C1] ? irqentry_enter+0x2b/0x60 [ 8144.615692][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8144.616019][ C1] ? irqentry_enter+0x2b/0x60 [ 8144.616278][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8144.616601][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8144.616886][ C1] ? arch_stack_walk+0x68/0x100 [ 8144.617145][ C1] __tcf_classify+0x32c/0x7d0 [ 8144.617413][ C1] tcf_classify+0x283/0x930 [ 8144.617660][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8144.617934][ C1] tc_run+0x2e4/0x5d0 [ 8144.618158][ C1] ? __pfx_tc_run+0x10/0x10 [ 8144.618409][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8144.618682][ C1] ? irqentry_enter+0x2b/0x60 [ 8144.618937][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8144.619225][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8144.619554][ C1] ip_finish_output2+0x786/0x18e0 [ 8144.619834][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8144.620129][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8144.620394][ C1] ? __ip_finish_output+0x10f/0x770 [ 8144.620676][ C1] ip_output+0x16b/0x4f0 [ 8144.620907][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8144.621225][ C1] ? __pfx_ip_output+0x10/0x10 [ 8144.621488][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8144.621841][ C1] ? __pfx_ip_output+0x10/0x10 [ 8144.622097][ C1] __ip_queue_xmit+0x672/0x1910 [ 8144.622365][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8144.622650][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8144.622948][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8144.623240][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8144.623542][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8144.623833][ C1] tcp_delack_timer+0x84/0x240 [ 8144.624093][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8144.624382][ C1] call_timer_fn+0x176/0x430 [ 8144.624632][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8144.624909][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8144.625186][ C1] __run_timers.part.0+0x52d/0x890 [ 8144.625459][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8144.625757][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8144.626062][ C1] ? __pfx___schedule+0x10/0x10 [ 8144.626323][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8144.626644][ C1] run_timer_softirq+0x72/0x100 [ 8144.626907][ C1] __do_softirq+0x1bc/0x7ff [ 8144.627154][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8144.627442][ C1] run_ksoftirqd+0x2e/0x60 [ 8144.627687][ C1] smpboot_thread_fn+0x30e/0x840 [ 8144.627952][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8144.628248][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8144.628543][ C1] kthread+0x292/0x360 [ 8144.628763][ C1] ? __pfx_kthread+0x10/0x10 [ 8144.629008][ C1] ret_from_fork+0x34/0x70 [ 8144.629253][ C1] ? __pfx_kthread+0x10/0x10 [ 8144.629501][ C1] ret_from_fork_asm+0x1b/0x30 [ 8144.629765][ C1] [ 8169.967024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8169.967418][ C0] rcu: 0-....: (6919784 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1645664 [ 8169.967936][ C0] rcu: (t=6975658 jiffies g=1007429 q=31 ncpus=4) [ 8169.968282][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8169.968763][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8169.969401][ C0] RIP: 0010:kasan_check_range+0x54/0x1c0 [ 8169.969705][ C0] Code: ff fe 48 39 c7 77 23 44 89 c2 e8 57 e8 ff ff 83 f0 01 5b 5d 41 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd <4c> 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 [ 8169.970729][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000216 [ 8169.971056][ C0] RAX: ffff7fffffffffff RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8169.971481][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8169.971902][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8169.972323][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8169.972747][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8169.973172][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8169.973643][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8169.973992][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8169.974418][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8169.974834][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8169.975250][ C0] Call Trace: [ 8169.975426][ C0] [ 8169.975580][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8169.975868][ C0] ? print_cpu_stall+0x263/0x6a0 [ 8169.976131][ C0] ? check_cpu_stall+0x284/0x500 [ 8169.976398][ C0] ? rcu_pending+0x92/0x360 [ 8169.976640][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8169.976921][ C0] ? update_process_times+0xb9/0x110 [ 8169.977212][ C0] ? tick_sched_handle+0x67/0x130 [ 8169.977485][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8169.977785][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8169.978036][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8169.978365][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8169.978649][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8169.978948][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8169.979225][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8169.979544][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8169.979818][ C0] ? hrtimer_interrupt+0x31a/0x770 [ 8169.980089][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8169.980369][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8169.980692][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8169.981002][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8169.981335][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8169.981638][ C0] ? kasan_check_range+0x54/0x1c0 [ 8169.981906][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 8169.982200][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8169.982525][ C0] ? get_stack_info+0x36/0xc0 [ 8169.982778][ C0] ? lock_acquire+0x1c1/0x220 [ 8169.983031][ C0] ? lock_release+0x1d5/0x250 [ 8169.983285][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8169.983546][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8169.983832][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8169.984134][ C0] ? lock_acquire+0x1c1/0x220 [ 8169.984384][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8169.984636][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8169.984908][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8169.985157][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8169.985417][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8169.985689][ C0] ? __inet_lookup_established+0x341/0x610 [ 8169.986001][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8169.986288][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8169.986577][ C0] ip_local_deliver+0x19d/0x480 [ 8169.986838][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8169.987132][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8169.987395][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8169.987676][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8169.987942][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8169.988278][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8169.988555][ C0] ip_rcv+0x564/0x740 [ 8169.988772][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8169.989018][ C0] ? set_track_prepare+0x8a/0xd0 [ 8169.989287][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8169.989575][ C0] ? rest_init+0x153/0x260 [ 8169.989814][ C0] ? skb_clone+0x10b/0x330 [ 8169.990051][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8169.990388][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8169.990713][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8169.991006][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8169.991313][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8169.991572][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8169.991814][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8169.992125][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8169.992421][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8169.992765][ C0] ? lock_acquire+0x1c1/0x220 [ 8169.993020][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8169.993332][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8169.993628][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8169.993962][ C0] ? __copy_skb_header+0xaf/0x490 [ 8169.994234][ C0] ? __skb_clone+0x57a/0x760 [ 8169.994482][ C0] netif_receive_skb+0x55/0x280 [ 8169.994740][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8169.995067][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8169.995413][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8169.995730][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8169.996019][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8169.996318][ C0] ? hlock_class+0x4e/0x130 [ 8169.996563][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8169.996888][ C0] ? place_entity+0x21/0x2f0 [ 8169.997140][ C0] ? resched_curr+0x219/0x280 [ 8169.997388][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8169.997655][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8169.997935][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8169.998215][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8169.998475][ C0] ? activate_task+0xf5/0x260 [ 8169.998728][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8169.999006][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8169.999279][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8169.999541][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8169.999834][ C0] ? get_stack_info+0x36/0xc0 [ 8170.000083][ C0] ? stack_access_ok+0xda/0x1f0 [ 8170.000338][ C0] ? get_reg+0x119/0x190 [ 8170.000564][ C0] __tcf_classify+0x32c/0x7d0 [ 8170.000818][ C0] tcf_classify+0x283/0x930 [ 8170.001063][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8170.001393][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8170.001658][ C0] ? arch_stack_walk+0x8c/0x100 [ 8170.001916][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8170.002204][ C0] tc_run+0x2e4/0x5d0 [ 8170.002427][ C0] ? __pfx_tc_run+0x10/0x10 [ 8170.002673][ C0] ? lock_acquire+0x1c1/0x220 [ 8170.002926][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8170.003205][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8170.003470][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8170.003759][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8170.004040][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8170.004364][ C0] ? neigh_hh_output+0x348/0x590 [ 8170.004628][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8170.004911][ C0] ip_finish_output2+0x786/0x18e0 [ 8170.005183][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8170.005479][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8170.005830][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8170.006116][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8170.006384][ C0] ? __ip_finish_output+0x10f/0x770 [ 8170.006659][ C0] ip_output+0x16b/0x4f0 [ 8170.006885][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8170.007179][ C0] ? __pfx_ip_output+0x10/0x10 [ 8170.007438][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8170.007739][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8170.008004][ C0] ? ip_local_out+0x114/0x3b0 [ 8170.008255][ C0] __ip_queue_xmit+0x672/0x1910 [ 8170.008515][ C0] ? __skb_clone+0x57a/0x760 [ 8170.008763][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8170.009051][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8170.009351][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8170.009670][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8170.009925][ C0] ? tcp_current_mss+0x40a/0x510 [ 8170.010194][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8170.010476][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8170.010756][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8170.011013][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8170.011281][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8170.011600][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8170.011880][ C0] ? ktime_get+0xb6/0x190 [ 8170.012117][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8170.012392][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8170.012674][ C0] tcp_write_timer+0x82/0x1d0 [ 8170.012936][ C0] call_timer_fn+0x176/0x430 [ 8170.013190][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8170.013463][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8170.013739][ C0] __run_timers.part.0+0x52d/0x890 [ 8170.014010][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8170.014297][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8170.014598][ C0] ? lock_acquire+0x1c1/0x220 [ 8170.014852][ C0] ? clockevents_program_event+0xf6/0x300 [ 8170.015159][ C0] ? lock_release+0x1d5/0x250 [ 8170.015411][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8170.015689][ C0] ? ktime_get+0xb6/0x190 [ 8170.015922][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8170.016223][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8170.016534][ C0] run_timer_softirq+0x72/0x100 [ 8170.016800][ C0] __do_softirq+0x1bc/0x7ff [ 8170.017054][ C0] irq_exit_rcu+0x98/0xc0 [ 8170.017287][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8170.017586][ C0] [ 8170.017746][ C0] [ 8170.017906][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8170.018229][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8170.018497][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8170.019516][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8170.019836][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8170.020257][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8170.020674][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8170.021091][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8170.021508][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8170.021929][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8170.022237][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8170.022510][ C0] default_idle_call+0x69/0xa0 [ 8170.022767][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8170.023030][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8170.023324][ C0] ? lock_release+0x1d5/0x250 [ 8170.023572][ C0] do_idle+0xfb/0x160 [ 8170.023785][ C0] cpu_startup_entry+0x55/0x60 [ 8170.024041][ C0] rest_init+0x153/0x260 [ 8170.024268][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8170.024558][ C0] arch_call_rest_init+0x13/0x40 [ 8170.024824][ C0] start_kernel+0x314/0x3d0 [ 8170.025071][ C0] x86_64_start_reservations+0x18/0x30 [ 8170.025367][ C0] x86_64_start_kernel+0xba/0x110 [ 8170.025635][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8170.025967][ C0] [ 8170.026133][ C0] Sending NMI from CPU 0 to CPUs 1: [ 8170.026426][ C1] NMI backtrace for cpu 1 [ 8170.026433][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8170.026438][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8170.026441][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8170.026449][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8170.026452][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8170.026455][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8170.026458][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8170.026460][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8170.026461][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8170.026463][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8170.026465][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8170.026467][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8170.026471][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8170.026473][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8170.026474][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8170.026476][ C1] Call Trace: [ 8170.026479][ C1] [ 8170.026482][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 8170.026488][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8170.026492][ C1] ? nmi_handle+0x156/0x420 [ 8170.026497][ C1] ? default_do_nmi+0x41/0x100 [ 8170.026500][ C1] ? exc_nmi+0xf3/0x120 [ 8170.026503][ C1] ? end_repeat_nmi+0xf/0x60 [ 8170.026507][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8170.026511][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8170.026514][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8170.026518][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8170.026522][ C1] [ 8170.026523][ C1] [ 8170.026524][ C1] ? run_ksoftirqd+0xb/0x60 [ 8170.026529][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8170.026532][ C1] ? __orc_find+0x9c/0xf0 [ 8170.026535][ C1] ? lock_acquire+0x1c1/0x220 [ 8170.026539][ C1] ? irqentry_enter+0x2b/0x60 [ 8170.026544][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8170.026548][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8170.026551][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8170.026554][ C1] ? lock_acquire+0x1c1/0x220 [ 8170.026556][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8170.026561][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8170.026564][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8170.026572][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8170.026575][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8170.026581][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8170.026587][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8170.026592][ C1] ip_local_deliver+0x19d/0x480 [ 8170.026595][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8170.026598][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8170.026602][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8170.026606][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8170.026609][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8170.026613][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8170.026623][ C1] ip_rcv+0x564/0x740 [ 8170.026627][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8170.026630][ C1] ? set_track_prepare+0x8a/0xd0 [ 8170.026633][ C1] ? irqentry_enter+0x2b/0x60 [ 8170.026637][ C1] ? irqentry_enter+0x2b/0x60 [ 8170.026641][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8170.026643][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8170.026648][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8170.026651][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8170.026654][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8170.026657][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8170.026660][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8170.026665][ C1] netif_receive_skb+0x55/0x280 [ 8170.026668][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8170.026677][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8170.026684][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8170.026691][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8170.026697][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8170.026709][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8170.026719][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8170.026722][ C1] ? arch_stack_walk+0x68/0x100 [ 8170.026726][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8170.026729][ C1] ? irqentry_enter+0x2b/0x60 [ 8170.026733][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8170.026737][ C1] ? irqentry_enter+0x2b/0x60 [ 8170.026740][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8170.026748][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8170.026750][ C1] ? arch_stack_walk+0x68/0x100 [ 8170.026755][ C1] __tcf_classify+0x32c/0x7d0 [ 8170.026760][ C1] tcf_classify+0x283/0x930 [ 8170.026763][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8170.026768][ C1] tc_run+0x2e4/0x5d0 [ 8170.026772][ C1] ? __pfx_tc_run+0x10/0x10 [ 8170.026777][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8170.026783][ C1] ? irqentry_enter+0x2b/0x60 [ 8170.026786][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8170.026789][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8170.026796][ C1] ip_finish_output2+0x786/0x18e0 [ 8170.026801][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8170.026804][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8170.026808][ C1] ? __ip_finish_output+0x10f/0x770 [ 8170.026812][ C1] ip_output+0x16b/0x4f0 [ 8170.026815][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8170.026818][ C1] ? __pfx_ip_output+0x10/0x10 [ 8170.026823][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8170.026830][ C1] ? __pfx_ip_output+0x10/0x10 [ 8170.026834][ C1] __ip_queue_xmit+0x672/0x1910 [ 8170.026839][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8170.026845][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8170.026850][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8170.026853][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8170.026858][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8170.026861][ C1] tcp_delack_timer+0x84/0x240 [ 8170.026864][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8170.026867][ C1] call_timer_fn+0x176/0x430 [ 8170.026871][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8170.026876][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8170.026880][ C1] __run_timers.part.0+0x52d/0x890 [ 8170.026883][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8170.026888][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8170.026893][ C1] ? __pfx___schedule+0x10/0x10 [ 8170.026897][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8170.026902][ C1] run_timer_softirq+0x72/0x100 [ 8170.026905][ C1] __do_softirq+0x1bc/0x7ff [ 8170.026909][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8170.026913][ C1] run_ksoftirqd+0x2e/0x60 [ 8170.026917][ C1] smpboot_thread_fn+0x30e/0x840 [ 8170.026921][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8170.026925][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8170.026928][ C1] kthread+0x292/0x360 [ 8170.026931][ C1] ? __pfx_kthread+0x10/0x10 [ 8170.026933][ C1] ret_from_fork+0x34/0x70 [ 8170.026936][ C1] ? __pfx_kthread+0x10/0x10 [ 8170.026938][ C1] ret_from_fork_asm+0x1b/0x30 [ 8170.026946][ C1] [ 8196.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6527s! [swapper/0:0] [ 8196.527937][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8196.529134][ C0] irq event stamp: 27567077 [ 8196.529373][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8196.529901][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8196.530383][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8196.530895][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8196.531395][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8196.531877][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8196.532520][ C0] RIP: 0010:kasan_check_range+0x16/0x1c0 [ 8196.532821][ C0] Code: 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 <48> 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe [ 8196.533847][ C0] RSP: 0018:ffffc900000069c8 EFLAGS: 00000202 [ 8196.534174][ C0] RAX: ffff88800a099b58 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8196.534603][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8196.535030][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8196.535451][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8196.535874][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8196.536299][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8196.536776][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8196.537136][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8196.537557][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8196.537983][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8196.538410][ C0] Call Trace: [ 8196.538591][ C0] [ 8196.538749][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8196.539025][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8196.539285][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8196.539580][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8196.539870][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8196.540176][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8196.540457][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8196.540783][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8196.541056][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8196.541336][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8196.541659][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8196.541969][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8196.542308][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8196.542611][ C0] ? kasan_check_range+0x16/0x1c0 [ 8196.542878][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 8196.543174][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8196.543500][ C0] ? get_stack_info+0x36/0xc0 [ 8196.543759][ C0] ? lock_acquire+0x1c1/0x220 [ 8196.544011][ C0] ? lock_release+0x1d5/0x250 [ 8196.544266][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8196.544526][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8196.544814][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8196.545115][ C0] ? lock_acquire+0x1c1/0x220 [ 8196.545364][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8196.545617][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8196.545888][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8196.546137][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8196.546397][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8196.546669][ C0] ? __inet_lookup_established+0x341/0x610 [ 8196.546990][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8196.547285][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8196.547576][ C0] ip_local_deliver+0x19d/0x480 [ 8196.547831][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8196.548116][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8196.548380][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8196.548659][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8196.548926][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8196.549261][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8196.549539][ C0] ip_rcv+0x564/0x740 [ 8196.549758][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8196.550002][ C0] ? set_track_prepare+0x8a/0xd0 [ 8196.550272][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8196.550559][ C0] ? rest_init+0x153/0x260 [ 8196.550798][ C0] ? skb_clone+0x10b/0x330 [ 8196.551034][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8196.551371][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8196.551694][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8196.551988][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8196.552294][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8196.552553][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8196.552794][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8196.553106][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8196.553402][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8196.553746][ C0] ? lock_acquire+0x1c1/0x220 [ 8196.554006][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8196.554317][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8196.554613][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8196.554945][ C0] ? __copy_skb_header+0xaf/0x490 [ 8196.555217][ C0] ? __skb_clone+0x57a/0x760 [ 8196.555465][ C0] netif_receive_skb+0x55/0x280 [ 8196.555721][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8196.556047][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8196.556391][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8196.556707][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8196.557000][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8196.557306][ C0] ? hlock_class+0x4e/0x130 [ 8196.557554][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8196.557885][ C0] ? place_entity+0x21/0x2f0 [ 8196.558135][ C0] ? resched_curr+0x219/0x280 [ 8196.558383][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8196.558649][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8196.558929][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8196.559211][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8196.559472][ C0] ? activate_task+0xf5/0x260 [ 8196.559726][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8196.560003][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8196.560276][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8196.560539][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8196.560828][ C0] ? get_stack_info+0x36/0xc0 [ 8196.561077][ C0] ? stack_access_ok+0xda/0x1f0 [ 8196.561332][ C0] ? get_reg+0x119/0x190 [ 8196.561558][ C0] __tcf_classify+0x32c/0x7d0 [ 8196.561815][ C0] tcf_classify+0x283/0x930 [ 8196.562061][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8196.562390][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8196.562655][ C0] ? arch_stack_walk+0x8c/0x100 [ 8196.562912][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8196.563200][ C0] tc_run+0x2e4/0x5d0 [ 8196.563421][ C0] ? __pfx_tc_run+0x10/0x10 [ 8196.563666][ C0] ? lock_acquire+0x1c1/0x220 [ 8196.563918][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8196.564195][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8196.564458][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8196.564746][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8196.565026][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8196.565349][ C0] ? neigh_hh_output+0x348/0x590 [ 8196.565612][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8196.565892][ C0] ip_finish_output2+0x786/0x18e0 [ 8196.566162][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8196.566457][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8196.566809][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8196.567109][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8196.567371][ C0] ? __ip_finish_output+0x10f/0x770 [ 8196.567650][ C0] ip_output+0x16b/0x4f0 [ 8196.567880][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8196.568163][ C0] ? __pfx_ip_output+0x10/0x10 [ 8196.568420][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8196.568719][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8196.568985][ C0] ? ip_local_out+0x114/0x3b0 [ 8196.569237][ C0] __ip_queue_xmit+0x672/0x1910 [ 8196.569496][ C0] ? __skb_clone+0x57a/0x760 [ 8196.569744][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8196.570027][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8196.570327][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8196.570646][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8196.570900][ C0] ? tcp_current_mss+0x40a/0x510 [ 8196.571167][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8196.571449][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8196.571728][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8196.571986][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8196.572253][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8196.572572][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8196.572851][ C0] ? ktime_get+0xb6/0x190 [ 8196.573089][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8196.573363][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8196.573645][ C0] tcp_write_timer+0x82/0x1d0 [ 8196.573900][ C0] call_timer_fn+0x176/0x430 [ 8196.574151][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8196.574423][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8196.574697][ C0] __run_timers.part.0+0x52d/0x890 [ 8196.574968][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8196.575254][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8196.575554][ C0] ? lock_acquire+0x1c1/0x220 [ 8196.575808][ C0] ? clockevents_program_event+0xf6/0x300 [ 8196.576116][ C0] ? lock_release+0x1d5/0x250 [ 8196.576368][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8196.576646][ C0] ? ktime_get+0xb6/0x190 [ 8196.576878][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8196.577187][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8196.577499][ C0] run_timer_softirq+0x72/0x100 [ 8196.577759][ C0] __do_softirq+0x1bc/0x7ff [ 8196.578001][ C0] irq_exit_rcu+0x98/0xc0 [ 8196.578231][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8196.578528][ C0] [ 8196.578689][ C0] [ 8196.578851][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8196.579172][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8196.579440][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8196.580452][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8196.580773][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8196.581194][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8196.581610][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8196.582026][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8196.582442][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8196.582868][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8196.583173][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8196.583446][ C0] default_idle_call+0x69/0xa0 [ 8196.583706][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8196.583967][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8196.584260][ C0] ? lock_release+0x1d5/0x250 [ 8196.584509][ C0] do_idle+0xfb/0x160 [ 8196.584721][ C0] cpu_startup_entry+0x55/0x60 [ 8196.584976][ C0] rest_init+0x153/0x260 [ 8196.585204][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8196.585488][ C0] arch_call_rest_init+0x13/0x40 [ 8196.585753][ C0] start_kernel+0x314/0x3d0 [ 8196.585997][ C0] x86_64_start_reservations+0x18/0x30 [ 8196.586295][ C0] x86_64_start_kernel+0xba/0x110 [ 8196.586564][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8196.586893][ C0] [ 8196.587066][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6527s! [ksoftirqd/1:22] [ 8196.587735][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8196.589471][ C1] irq event stamp: 3886976 [ 8196.589820][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8196.590537][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8196.591250][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8196.591972][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8196.592673][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8196.593373][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8196.594039][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12b/0xb90 [ 8196.594524][ C1] Code: 24 80 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc 90 e9 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 [ 8196.595969][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8196.596423][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8196.597021][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8196.597492][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8196.598070][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8196.598661][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8196.599265][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8196.599953][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8196.600455][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8196.601070][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8196.601676][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8196.602284][ C1] Call Trace: [ 8196.602543][ C1] [ 8196.602769][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8196.603174][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8196.603543][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8196.603969][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8196.604389][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8196.604827][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8196.605231][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8196.605723][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8196.606151][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8196.606630][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8196.607087][ C1] [ 8196.607318][ C1] [ 8196.607544][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8196.608016][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8196.608468][ C1] ? queued_spin_lock_slowpath+0x12b/0xb90 [ 8196.608928][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8196.609381][ C1] ? run_ksoftirqd+0xb/0x60 [ 8196.609736][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8196.610214][ C1] ? __orc_find+0x9c/0xf0 [ 8196.610558][ C1] ? lock_acquire+0x1c1/0x220 [ 8196.610930][ C1] ? irqentry_enter+0x2b/0x60 [ 8196.611305][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8196.611689][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8196.612107][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8196.612552][ C1] ? lock_acquire+0x1c1/0x220 [ 8196.612919][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8196.613290][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8196.613691][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8196.614059][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8196.614444][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8196.614846][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8196.615274][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8196.615703][ C1] ip_local_deliver+0x19d/0x480 [ 8196.616081][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8196.616495][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8196.616881][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8196.617303][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8196.617689][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8196.618184][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8196.618587][ C1] ip_rcv+0x564/0x740 [ 8196.618902][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8196.619256][ C1] ? set_track_prepare+0x8a/0xd0 [ 8196.619642][ C1] ? irqentry_enter+0x2b/0x60 [ 8196.620011][ C1] ? irqentry_enter+0x2b/0x60 [ 8196.620384][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8196.620740][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8196.621207][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8196.621706][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8196.622164][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8196.622658][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8196.623095][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8196.623585][ C1] netif_receive_skb+0x55/0x280 [ 8196.623955][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8196.624428][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8196.624959][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8196.625416][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8196.625840][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8196.626285][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8196.626772][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8196.627187][ C1] ? arch_stack_walk+0x68/0x100 [ 8196.627566][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8196.627968][ C1] ? irqentry_enter+0x2b/0x60 [ 8196.628336][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8196.628788][ C1] ? irqentry_enter+0x2b/0x60 [ 8196.629145][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8196.629520][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8196.629801][ C1] ? arch_stack_walk+0x68/0x100 [ 8196.630069][ C1] __tcf_classify+0x32c/0x7d0 [ 8196.630406][ C1] tcf_classify+0x283/0x930 [ 8196.630752][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8196.631135][ C1] tc_run+0x2e4/0x5d0 [ 8196.631440][ C1] ? __pfx_tc_run+0x10/0x10 [ 8196.631786][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8196.632165][ C1] ? irqentry_enter+0x2b/0x60 [ 8196.632526][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8196.632930][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8196.633383][ C1] ip_finish_output2+0x786/0x18e0 [ 8196.633757][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8196.634177][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8196.634563][ C1] ? __ip_finish_output+0x10f/0x770 [ 8196.634968][ C1] ip_output+0x16b/0x4f0 [ 8196.635298][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8196.635753][ C1] ? __pfx_ip_output+0x10/0x10 [ 8196.636130][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8196.636647][ C1] ? __pfx_ip_output+0x10/0x10 [ 8196.637027][ C1] __ip_queue_xmit+0x672/0x1910 [ 8196.637407][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8196.637817][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8196.638246][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8196.638658][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8196.639082][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8196.639497][ C1] tcp_delack_timer+0x84/0x240 [ 8196.639869][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8196.640294][ C1] call_timer_fn+0x176/0x430 [ 8196.640558][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8196.640830][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8196.641118][ C1] __run_timers.part.0+0x52d/0x890 [ 8196.641392][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8196.641675][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8196.641980][ C1] ? __pfx___schedule+0x10/0x10 [ 8196.642244][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8196.642569][ C1] run_timer_softirq+0x72/0x100 [ 8196.642844][ C1] __do_softirq+0x1bc/0x7ff [ 8196.643104][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8196.643376][ C1] run_ksoftirqd+0x2e/0x60 [ 8196.643616][ C1] smpboot_thread_fn+0x30e/0x840 [ 8196.643882][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8196.644177][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8196.644464][ C1] kthread+0x292/0x360 [ 8196.644684][ C1] ? __pfx_kthread+0x10/0x10 [ 8196.644939][ C1] ret_from_fork+0x34/0x70 [ 8196.645179][ C1] ? __pfx_kthread+0x10/0x10 [ 8196.645422][ C1] ret_from_fork_asm+0x1b/0x30 [ 8196.645682][ C1] [ 8224.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6553s! [swapper/0:0] [ 8224.527925][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8224.529123][ C0] irq event stamp: 27567077 [ 8224.529365][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8224.529897][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8224.530372][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8224.530873][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8224.531365][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8224.531843][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8224.532492][ C0] RIP: 0010:kasan_check_range+0x1b/0x1c0 [ 8224.532795][ C0] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 53 <72> 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 23 [ 8224.533811][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000286 [ 8224.534135][ C0] RAX: ffff88800a099b5c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8224.534549][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8224.534964][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8224.535384][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8224.535799][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8224.536215][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8224.536681][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8224.537042][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8224.537462][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8224.537878][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8224.538296][ C0] Call Trace: [ 8224.538474][ C0] [ 8224.538629][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8224.538908][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8224.539161][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8224.539453][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8224.539735][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8224.540037][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8224.540315][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8224.540633][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8224.540907][ C0] ? hrtimer_interrupt+0x31a/0x770 [ 8224.541180][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8224.541457][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8224.541782][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8224.542091][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8224.542424][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8224.542725][ C0] ? kasan_check_range+0x1b/0x1c0 [ 8224.542992][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 8224.543286][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8224.543609][ C0] ? get_stack_info+0x36/0xc0 [ 8224.543866][ C0] ? lock_acquire+0x1c1/0x220 [ 8224.544119][ C0] ? lock_release+0x1d5/0x250 [ 8224.544371][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8224.544633][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8224.544922][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8224.545225][ C0] ? lock_acquire+0x1c1/0x220 [ 8224.545474][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8224.545727][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8224.545998][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8224.546248][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8224.546510][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8224.546794][ C0] ? __inet_lookup_established+0x341/0x610 [ 8224.547107][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8224.547396][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8224.547687][ C0] ip_local_deliver+0x19d/0x480 [ 8224.547943][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8224.548232][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8224.548498][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8224.548779][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8224.549046][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8224.549380][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8224.549658][ C0] ip_rcv+0x564/0x740 [ 8224.549873][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8224.550120][ C0] ? set_track_prepare+0x8a/0xd0 [ 8224.550386][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8224.550671][ C0] ? rest_init+0x153/0x260 [ 8224.550911][ C0] ? skb_clone+0x10b/0x330 [ 8224.551150][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8224.551486][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8224.551809][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8224.552101][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8224.552407][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8224.552665][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8224.552904][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8224.553215][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8224.553513][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8224.553853][ C0] ? lock_acquire+0x1c1/0x220 [ 8224.554107][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8224.554418][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8224.554716][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8224.555050][ C0] ? __copy_skb_header+0xaf/0x490 [ 8224.555320][ C0] ? __skb_clone+0x57a/0x760 [ 8224.555567][ C0] netif_receive_skb+0x55/0x280 [ 8224.555823][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8224.556148][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8224.556494][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8224.556818][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8224.557112][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8224.557413][ C0] ? hlock_class+0x4e/0x130 [ 8224.557661][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8224.557992][ C0] ? place_entity+0x21/0x2f0 [ 8224.558242][ C0] ? resched_curr+0x219/0x280 [ 8224.558490][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8224.558756][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8224.559038][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8224.559317][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8224.559581][ C0] ? activate_task+0xf5/0x260 [ 8224.559835][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8224.560110][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8224.560380][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8224.560640][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8224.560936][ C0] ? get_stack_info+0x36/0xc0 [ 8224.561185][ C0] ? stack_access_ok+0xda/0x1f0 [ 8224.561441][ C0] ? get_reg+0x119/0x190 [ 8224.561667][ C0] __tcf_classify+0x32c/0x7d0 [ 8224.561925][ C0] tcf_classify+0x283/0x930 [ 8224.562171][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8224.562503][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8224.562768][ C0] ? arch_stack_walk+0x8c/0x100 [ 8224.563026][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8224.563317][ C0] tc_run+0x2e4/0x5d0 [ 8224.563534][ C0] ? __pfx_tc_run+0x10/0x10 [ 8224.563781][ C0] ? lock_acquire+0x1c1/0x220 [ 8224.564038][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8224.564314][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8224.564579][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8224.564868][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8224.565149][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8224.565471][ C0] ? neigh_hh_output+0x348/0x590 [ 8224.565735][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8224.566014][ C0] ip_finish_output2+0x786/0x18e0 [ 8224.566286][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8224.566579][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8224.566937][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8224.567231][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8224.567495][ C0] ? __ip_finish_output+0x10f/0x770 [ 8224.567774][ C0] ip_output+0x16b/0x4f0 [ 8224.568004][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8224.568285][ C0] ? __pfx_ip_output+0x10/0x10 [ 8224.568541][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8224.568838][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8224.569106][ C0] ? ip_local_out+0x114/0x3b0 [ 8224.569356][ C0] __ip_queue_xmit+0x672/0x1910 [ 8224.569619][ C0] ? __skb_clone+0x57a/0x760 [ 8224.569862][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8224.570147][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8224.570444][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8224.570768][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8224.571026][ C0] ? tcp_current_mss+0x40a/0x510 [ 8224.571293][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8224.571572][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8224.571852][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8224.572109][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8224.572374][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8224.572689][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8224.572969][ C0] ? ktime_get+0xb6/0x190 [ 8224.573203][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8224.573478][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8224.573756][ C0] tcp_write_timer+0x82/0x1d0 [ 8224.574008][ C0] call_timer_fn+0x176/0x430 [ 8224.574259][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8224.574533][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8224.574808][ C0] __run_timers.part.0+0x52d/0x890 [ 8224.575081][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8224.575367][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8224.575665][ C0] ? lock_acquire+0x1c1/0x220 [ 8224.575917][ C0] ? clockevents_program_event+0xf6/0x300 [ 8224.576225][ C0] ? lock_release+0x1d5/0x250 [ 8224.576478][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8224.576757][ C0] ? ktime_get+0xb6/0x190 [ 8224.576998][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8224.577295][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8224.577611][ C0] run_timer_softirq+0x72/0x100 [ 8224.577870][ C0] __do_softirq+0x1bc/0x7ff [ 8224.578115][ C0] irq_exit_rcu+0x98/0xc0 [ 8224.578344][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8224.578642][ C0] [ 8224.578801][ C0] [ 8224.578960][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8224.579281][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8224.579552][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8224.580569][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8224.580891][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8224.581309][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8224.581724][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8224.582139][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8224.582559][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8224.582977][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8224.583278][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8224.583549][ C0] default_idle_call+0x69/0xa0 [ 8224.583808][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8224.584070][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8224.584364][ C0] ? lock_release+0x1d5/0x250 [ 8224.584616][ C0] do_idle+0xfb/0x160 [ 8224.584829][ C0] cpu_startup_entry+0x55/0x60 [ 8224.585082][ C0] rest_init+0x153/0x260 [ 8224.585308][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8224.585594][ C0] arch_call_rest_init+0x13/0x40 [ 8224.585858][ C0] start_kernel+0x314/0x3d0 [ 8224.586105][ C0] x86_64_start_reservations+0x18/0x30 [ 8224.586398][ C0] x86_64_start_kernel+0xba/0x110 [ 8224.586665][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8224.587001][ C0] [ 8224.587170][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6553s! [ksoftirqd/1:22] [ 8224.587656][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8224.588856][ C1] irq event stamp: 3886976 [ 8224.589094][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8224.589603][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8224.590109][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8224.590619][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8224.591115][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8224.591616][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8224.592265][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8224.592612][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8224.593648][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8224.593975][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8224.594404][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8224.594830][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8224.595251][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8224.595673][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8224.596100][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8224.596578][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8224.596934][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8224.597368][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8224.597794][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8224.598220][ C1] Call Trace: [ 8224.598401][ C1] [ 8224.598561][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8224.598839][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8224.599102][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8224.599394][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8224.599686][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8224.599991][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8224.600275][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8224.600603][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8224.600877][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8224.601207][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8224.601520][ C1] [ 8224.601677][ C1] [ 8224.601833][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8224.602162][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8224.602470][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8224.602781][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8224.603084][ C1] ? run_ksoftirqd+0xb/0x60 [ 8224.603325][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8224.603654][ C1] ? __orc_find+0x9c/0xf0 [ 8224.603889][ C1] ? lock_acquire+0x1c1/0x220 [ 8224.604146][ C1] ? irqentry_enter+0x2b/0x60 [ 8224.604400][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8224.604664][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8224.604952][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8224.605255][ C1] ? lock_acquire+0x1c1/0x220 [ 8224.605512][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8224.605766][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8224.606039][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8224.606289][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8224.606552][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8224.606831][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8224.607123][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8224.607415][ C1] ip_local_deliver+0x19d/0x480 [ 8224.607680][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8224.607967][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8224.608235][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8224.608513][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8224.608776][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8224.609117][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8224.609393][ C1] ip_rcv+0x564/0x740 [ 8224.609607][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8224.609852][ C1] ? set_track_prepare+0x8a/0xd0 [ 8224.610121][ C1] ? irqentry_enter+0x2b/0x60 [ 8224.610377][ C1] ? irqentry_enter+0x2b/0x60 [ 8224.610633][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8224.610879][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8224.611201][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8224.611545][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8224.611859][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8224.612199][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8224.612499][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8224.612838][ C1] netif_receive_skb+0x55/0x280 [ 8224.613102][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8224.613436][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8224.613788][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8224.614103][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8224.614398][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8224.614706][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8224.615041][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8224.615328][ C1] ? arch_stack_walk+0x68/0x100 [ 8224.615591][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8224.615869][ C1] ? irqentry_enter+0x2b/0x60 [ 8224.616122][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8224.616441][ C1] ? irqentry_enter+0x2b/0x60 [ 8224.616694][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8224.617026][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8224.617309][ C1] ? arch_stack_walk+0x68/0x100 [ 8224.617574][ C1] __tcf_classify+0x32c/0x7d0 [ 8224.617834][ C1] tcf_classify+0x283/0x930 [ 8224.618082][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8224.618354][ C1] tc_run+0x2e4/0x5d0 [ 8224.618575][ C1] ? __pfx_tc_run+0x10/0x10 [ 8224.618823][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8224.619095][ C1] ? irqentry_enter+0x2b/0x60 [ 8224.619346][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8224.619633][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8224.619958][ C1] ip_finish_output2+0x786/0x18e0 [ 8224.620236][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8224.620530][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8224.620795][ C1] ? __ip_finish_output+0x10f/0x770 [ 8224.621077][ C1] ip_output+0x16b/0x4f0 [ 8224.621306][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8224.621624][ C1] ? __pfx_ip_output+0x10/0x10 [ 8224.621884][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8224.622236][ C1] ? __pfx_ip_output+0x10/0x10 [ 8224.622493][ C1] __ip_queue_xmit+0x672/0x1910 [ 8224.622763][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8224.623049][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8224.623346][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8224.623636][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8224.623935][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8224.624226][ C1] tcp_delack_timer+0x84/0x240 [ 8224.624487][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8224.624773][ C1] call_timer_fn+0x176/0x430 [ 8224.625021][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8224.625300][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8224.625577][ C1] __run_timers.part.0+0x52d/0x890 [ 8224.625850][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8224.626143][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8224.626449][ C1] ? __pfx___schedule+0x10/0x10 [ 8224.626711][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8224.627043][ C1] run_timer_softirq+0x72/0x100 [ 8224.627304][ C1] __do_softirq+0x1bc/0x7ff [ 8224.627559][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8224.627832][ C1] run_ksoftirqd+0x2e/0x60 [ 8224.628074][ C1] smpboot_thread_fn+0x30e/0x840 [ 8224.628340][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8224.628632][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8224.628922][ C1] kthread+0x292/0x360 [ 8224.629146][ C1] ? __pfx_kthread+0x10/0x10 [ 8224.629394][ C1] ret_from_fork+0x34/0x70 [ 8224.629634][ C1] ? __pfx_kthread+0x10/0x10 [ 8224.629878][ C1] ret_from_fork_asm+0x1b/0x30 [ 8224.630141][ C1] [ 8248.030026][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8248.030434][ C1] rcu: 1-....: (6989083 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1665026 [ 8248.031037][ C1] rcu: (t=7053721 jiffies g=1007429 q=31 ncpus=4) [ 8248.031388][ C1] Sending NMI from CPU 1 to CPUs 0: [ 8248.031674][ C0] NMI backtrace for cpu 0 [ 8248.031683][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8248.031688][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8248.031691][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8248.031701][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8248.031705][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8248.031709][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8248.031711][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8248.031713][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8248.031715][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8248.031717][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8248.031719][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8248.031721][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8248.031725][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8248.031727][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8248.031728][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8248.031730][ C0] Call Trace: [ 8248.031733][ C0] [ 8248.031737][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 8248.031743][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8248.031748][ C0] ? nmi_handle+0x156/0x420 [ 8248.031753][ C0] ? default_do_nmi+0x41/0x100 [ 8248.031757][ C0] ? exc_nmi+0xf3/0x120 [ 8248.031759][ C0] ? end_repeat_nmi+0xf/0x60 [ 8248.031763][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8248.031767][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8248.031771][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8248.031775][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8248.031778][ C0] [ 8248.031780][ C0] [ 8248.031782][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8248.031785][ C0] ? get_stack_info+0x36/0xc0 [ 8248.031789][ C0] ? lock_acquire+0x1c1/0x220 [ 8248.031794][ C0] ? lock_release+0x1d5/0x250 [ 8248.031797][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8248.031801][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8248.031804][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8248.031808][ C0] ? lock_acquire+0x1c1/0x220 [ 8248.031810][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8248.031816][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8248.031820][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8248.031827][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8248.031830][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8248.031834][ C0] ? __inet_lookup_established+0x341/0x610 [ 8248.031840][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8248.031847][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8248.031851][ C0] ip_local_deliver+0x19d/0x480 [ 8248.031854][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8248.031857][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8248.031862][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8248.031866][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8248.031869][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8248.031873][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8248.031883][ C0] ip_rcv+0x564/0x740 [ 8248.031886][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8248.031889][ C0] ? set_track_prepare+0x8a/0xd0 [ 8248.031893][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8248.031895][ C0] ? rest_init+0x153/0x260 [ 8248.031898][ C0] ? skb_clone+0x10b/0x330 [ 8248.031902][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8248.031909][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8248.031914][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8248.031919][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8248.031928][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8248.031931][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8248.031934][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8248.031938][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8248.031942][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8248.031945][ C0] ? lock_acquire+0x1c1/0x220 [ 8248.031947][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8248.031951][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8248.031953][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8248.031957][ C0] ? __copy_skb_header+0xaf/0x490 [ 8248.031960][ C0] ? __skb_clone+0x57a/0x760 [ 8248.031962][ C0] netif_receive_skb+0x55/0x280 [ 8248.031965][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8248.031973][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8248.031979][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8248.031986][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8248.031991][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8248.032000][ C0] ? hlock_class+0x4e/0x130 [ 8248.032005][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8248.032015][ C0] ? place_entity+0x21/0x2f0 [ 8248.032018][ C0] ? resched_curr+0x219/0x280 [ 8248.032023][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8248.032025][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8248.032030][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8248.032034][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8248.032037][ C0] ? activate_task+0xf5/0x260 [ 8248.032040][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8248.032044][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8248.032048][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8248.032051][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8248.032054][ C0] ? get_stack_info+0x36/0xc0 [ 8248.032058][ C0] ? stack_access_ok+0xda/0x1f0 [ 8248.032060][ C0] ? get_reg+0x119/0x190 [ 8248.032064][ C0] __tcf_classify+0x32c/0x7d0 [ 8248.032069][ C0] tcf_classify+0x283/0x930 [ 8248.032072][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8248.032076][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8248.032078][ C0] ? arch_stack_walk+0x8c/0x100 [ 8248.032083][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8248.032086][ C0] tc_run+0x2e4/0x5d0 [ 8248.032091][ C0] ? __pfx_tc_run+0x10/0x10 [ 8248.032094][ C0] ? lock_acquire+0x1c1/0x220 [ 8248.032096][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8248.032101][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8248.032107][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8248.032110][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8248.032113][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8248.032118][ C0] ? neigh_hh_output+0x348/0x590 [ 8248.032123][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8248.032126][ C0] ip_finish_output2+0x786/0x18e0 [ 8248.032130][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8248.032135][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8248.032143][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8248.032146][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8248.032150][ C0] ? __ip_finish_output+0x10f/0x770 [ 8248.032154][ C0] ip_output+0x16b/0x4f0 [ 8248.032157][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8248.032162][ C0] ? __pfx_ip_output+0x10/0x10 [ 8248.032166][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8248.032171][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8248.032174][ C0] ? ip_local_out+0x114/0x3b0 [ 8248.032178][ C0] __ip_queue_xmit+0x672/0x1910 [ 8248.032182][ C0] ? __skb_clone+0x57a/0x760 [ 8248.032185][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8248.032192][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8248.032197][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8248.032201][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8248.032206][ C0] ? tcp_current_mss+0x40a/0x510 [ 8248.032209][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8248.032212][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8248.032215][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8248.032218][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8248.032221][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8248.032224][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8248.032229][ C0] ? ktime_get+0xb6/0x190 [ 8248.032233][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8248.032237][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8248.032240][ C0] tcp_write_timer+0x82/0x1d0 [ 8248.032244][ C0] call_timer_fn+0x176/0x430 [ 8248.032248][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8248.032252][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8248.032256][ C0] __run_timers.part.0+0x52d/0x890 [ 8248.032260][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8248.032264][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8248.032267][ C0] ? lock_acquire+0x1c1/0x220 [ 8248.032269][ C0] ? clockevents_program_event+0xf6/0x300 [ 8248.032274][ C0] ? lock_release+0x1d5/0x250 [ 8248.032276][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8248.032279][ C0] ? ktime_get+0xb6/0x190 [ 8248.032282][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8248.032285][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8248.032290][ C0] run_timer_softirq+0x72/0x100 [ 8248.032293][ C0] __do_softirq+0x1bc/0x7ff [ 8248.032298][ C0] irq_exit_rcu+0x98/0xc0 [ 8248.032301][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8248.032305][ C0] [ 8248.032306][ C0] [ 8248.032307][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8248.032312][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8248.032316][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8248.032318][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8248.032320][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8248.032322][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8248.032323][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8248.032325][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8248.032327][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8248.032330][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8248.032334][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8248.032337][ C0] default_idle_call+0x69/0xa0 [ 8248.032340][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8248.032342][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8248.032347][ C0] ? lock_release+0x1d5/0x250 [ 8248.032351][ C0] do_idle+0xfb/0x160 [ 8248.032354][ C0] cpu_startup_entry+0x55/0x60 [ 8248.032356][ C0] rest_init+0x153/0x260 [ 8248.032359][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8248.032364][ C0] arch_call_rest_init+0x13/0x40 [ 8248.032369][ C0] start_kernel+0x314/0x3d0 [ 8248.032373][ C0] x86_64_start_reservations+0x18/0x30 [ 8248.032377][ C0] x86_64_start_kernel+0xba/0x110 [ 8248.032381][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8248.032389][ C0] [ 8248.032670][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8248.087587][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8248.088241][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8248.088587][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8248.089603][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8248.089934][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8248.090355][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8248.090779][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8248.091208][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8248.091626][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8248.092048][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8248.092513][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8248.092871][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8248.093322][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8248.093741][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8248.094167][ C1] Call Trace: [ 8248.094354][ C1] [ 8248.094514][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8248.094800][ C1] ? print_cpu_stall+0x263/0x6a0 [ 8248.095078][ C1] ? check_cpu_stall+0x284/0x500 [ 8248.095341][ C1] ? rcu_pending+0x92/0x360 [ 8248.095587][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8248.095872][ C1] ? update_process_times+0xb9/0x110 [ 8248.096164][ C1] ? tick_sched_handle+0x67/0x130 [ 8248.096437][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8248.096744][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8248.096999][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8248.097324][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8248.097611][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8248.097916][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8248.098199][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8248.098522][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8248.098795][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8248.099132][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8248.099446][ C1] [ 8248.099603][ C1] [ 8248.099759][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8248.100093][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8248.100401][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8248.100714][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8248.101024][ C1] ? run_ksoftirqd+0xb/0x60 [ 8248.101268][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8248.101596][ C1] ? __orc_find+0x9c/0xf0 [ 8248.101828][ C1] ? lock_acquire+0x1c1/0x220 [ 8248.102085][ C1] ? irqentry_enter+0x2b/0x60 [ 8248.102340][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8248.102606][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8248.102903][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8248.103205][ C1] ? lock_acquire+0x1c1/0x220 [ 8248.103453][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8248.103704][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8248.103977][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8248.104229][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8248.104497][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8248.104770][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8248.105076][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8248.105369][ C1] ip_local_deliver+0x19d/0x480 [ 8248.105627][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8248.105912][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8248.106177][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8248.106457][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8248.106735][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8248.107072][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8248.107346][ C1] ip_rcv+0x564/0x740 [ 8248.107560][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8248.107802][ C1] ? set_track_prepare+0x8a/0xd0 [ 8248.108067][ C1] ? irqentry_enter+0x2b/0x60 [ 8248.108318][ C1] ? irqentry_enter+0x2b/0x60 [ 8248.108572][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8248.108816][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8248.109169][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8248.109611][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8248.110039][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8248.110378][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8248.110680][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8248.111029][ C1] netif_receive_skb+0x55/0x280 [ 8248.111294][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8248.111623][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8248.111987][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8248.112298][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8248.112591][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8248.112896][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8248.113231][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8248.113513][ C1] ? arch_stack_walk+0x68/0x100 [ 8248.113771][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8248.114051][ C1] ? irqentry_enter+0x2b/0x60 [ 8248.114300][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8248.114619][ C1] ? irqentry_enter+0x2b/0x60 [ 8248.114873][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8248.115205][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8248.115481][ C1] ? arch_stack_walk+0x68/0x100 [ 8248.115743][ C1] __tcf_classify+0x32c/0x7d0 [ 8248.116014][ C1] tcf_classify+0x283/0x930 [ 8248.116260][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8248.116533][ C1] tc_run+0x2e4/0x5d0 [ 8248.116763][ C1] ? __pfx_tc_run+0x10/0x10 [ 8248.117014][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8248.117280][ C1] ? irqentry_enter+0x2b/0x60 [ 8248.117532][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8248.117819][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8248.118151][ C1] ip_finish_output2+0x786/0x18e0 [ 8248.118420][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8248.118705][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8248.118997][ C1] ? __ip_finish_output+0x10f/0x770 [ 8248.119274][ C1] ip_output+0x16b/0x4f0 [ 8248.119499][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8248.119820][ C1] ? __pfx_ip_output+0x10/0x10 [ 8248.120107][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8248.120461][ C1] ? __pfx_ip_output+0x10/0x10 [ 8248.120717][ C1] __ip_queue_xmit+0x672/0x1910 [ 8248.120983][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8248.121264][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8248.121559][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8248.121843][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8248.122151][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8248.122434][ C1] tcp_delack_timer+0x84/0x240 [ 8248.122689][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8248.122980][ C1] call_timer_fn+0x176/0x430 [ 8248.123234][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8248.123508][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8248.123789][ C1] __run_timers.part.0+0x52d/0x890 [ 8248.124080][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8248.124368][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8248.124666][ C1] ? __pfx___schedule+0x10/0x10 [ 8248.124939][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8248.125261][ C1] run_timer_softirq+0x72/0x100 [ 8248.125517][ C1] __do_softirq+0x1bc/0x7ff [ 8248.125758][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8248.126037][ C1] run_ksoftirqd+0x2e/0x60 [ 8248.126284][ C1] smpboot_thread_fn+0x30e/0x840 [ 8248.126553][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8248.126855][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8248.127147][ C1] kthread+0x292/0x360 [ 8248.127362][ C1] ? __pfx_kthread+0x10/0x10 [ 8248.127609][ C1] ret_from_fork+0x34/0x70 [ 8248.127848][ C1] ? __pfx_kthread+0x10/0x10 [ 8248.128110][ C1] ret_from_fork_asm+0x1b/0x30 [ 8248.128371][ C1] [ 8272.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6598s! [swapper/0:0] [ 8272.527923][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8272.529117][ C0] irq event stamp: 27567077 [ 8272.529359][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8272.529889][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8272.530368][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8272.530878][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8272.531379][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8272.531865][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8272.532509][ C0] RIP: 0010:__kasan_check_read+0x0/0x20 [ 8272.532806][ C0] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 8272.533827][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000202 [ 8272.534153][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8272.534576][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8272.535004][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8272.535431][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8272.535853][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8272.536276][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8272.536759][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8272.537113][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8272.537532][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8272.537954][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8272.538380][ C0] Call Trace: [ 8272.538568][ C0] [ 8272.538726][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8272.539001][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8272.539258][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8272.539546][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8272.539836][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8272.540144][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8272.540427][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8272.540749][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8272.541022][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8272.541302][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8272.541624][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8272.541933][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8272.542268][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8272.542571][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 8272.542863][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 8272.543158][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8272.543484][ C0] ? get_stack_info+0x36/0xc0 [ 8272.543742][ C0] ? lock_acquire+0x1c1/0x220 [ 8272.544002][ C0] ? lock_release+0x1d5/0x250 [ 8272.544259][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8272.544526][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8272.544816][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8272.545120][ C0] ? lock_acquire+0x1c1/0x220 [ 8272.545368][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8272.545620][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8272.545892][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8272.546145][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8272.546413][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8272.546688][ C0] ? __inet_lookup_established+0x341/0x610 [ 8272.547001][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8272.547301][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8272.547596][ C0] ip_local_deliver+0x19d/0x480 [ 8272.547855][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8272.548140][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8272.548403][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8272.548683][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8272.548947][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8272.549280][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8272.549559][ C0] ip_rcv+0x564/0x740 [ 8272.549773][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8272.550019][ C0] ? set_track_prepare+0x8a/0xd0 [ 8272.550286][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8272.550573][ C0] ? rest_init+0x153/0x260 [ 8272.550815][ C0] ? skb_clone+0x10b/0x330 [ 8272.551054][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8272.551394][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8272.551716][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8272.552012][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8272.552322][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8272.552578][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8272.552818][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8272.553134][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8272.553433][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8272.553777][ C0] ? lock_acquire+0x1c1/0x220 [ 8272.554029][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8272.554344][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8272.554643][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8272.554977][ C0] ? __copy_skb_header+0xaf/0x490 [ 8272.555248][ C0] ? __skb_clone+0x57a/0x760 [ 8272.555498][ C0] netif_receive_skb+0x55/0x280 [ 8272.555756][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8272.556082][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8272.556430][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8272.556756][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8272.557047][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8272.557349][ C0] ? hlock_class+0x4e/0x130 [ 8272.557598][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8272.557937][ C0] ? place_entity+0x21/0x2f0 [ 8272.558190][ C0] ? resched_curr+0x219/0x280 [ 8272.558442][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8272.558710][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8272.558990][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8272.559273][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8272.559535][ C0] ? activate_task+0xf5/0x260 [ 8272.559788][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8272.560068][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8272.560340][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8272.560602][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8272.560897][ C0] ? get_stack_info+0x36/0xc0 [ 8272.561150][ C0] ? stack_access_ok+0xda/0x1f0 [ 8272.561409][ C0] ? get_reg+0x119/0x190 [ 8272.561636][ C0] __tcf_classify+0x32c/0x7d0 [ 8272.561892][ C0] tcf_classify+0x283/0x930 [ 8272.562140][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8272.562472][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8272.562739][ C0] ? arch_stack_walk+0x8c/0x100 [ 8272.563000][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8272.563292][ C0] tc_run+0x2e4/0x5d0 [ 8272.563508][ C0] ? __pfx_tc_run+0x10/0x10 [ 8272.563753][ C0] ? lock_acquire+0x1c1/0x220 [ 8272.564006][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8272.564284][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8272.564550][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8272.564838][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8272.565121][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8272.565443][ C0] ? neigh_hh_output+0x348/0x590 [ 8272.565709][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8272.565990][ C0] ip_finish_output2+0x786/0x18e0 [ 8272.566264][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8272.566571][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8272.566929][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8272.567225][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8272.567490][ C0] ? __ip_finish_output+0x10f/0x770 [ 8272.567772][ C0] ip_output+0x16b/0x4f0 [ 8272.567999][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8272.568280][ C0] ? __pfx_ip_output+0x10/0x10 [ 8272.568537][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8272.568842][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8272.569108][ C0] ? ip_local_out+0x114/0x3b0 [ 8272.569357][ C0] __ip_queue_xmit+0x672/0x1910 [ 8272.569614][ C0] ? __skb_clone+0x57a/0x760 [ 8272.569858][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8272.570141][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8272.570437][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8272.570760][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8272.571021][ C0] ? tcp_current_mss+0x40a/0x510 [ 8272.571285][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8272.571564][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8272.571842][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8272.572098][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8272.572367][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8272.572683][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8272.572961][ C0] ? ktime_get+0xb6/0x190 [ 8272.573196][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8272.573470][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8272.573748][ C0] tcp_write_timer+0x82/0x1d0 [ 8272.574001][ C0] call_timer_fn+0x176/0x430 [ 8272.574250][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8272.574523][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8272.574799][ C0] __run_timers.part.0+0x52d/0x890 [ 8272.575071][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8272.575356][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8272.575653][ C0] ? lock_acquire+0x1c1/0x220 [ 8272.575903][ C0] ? clockevents_program_event+0xf6/0x300 [ 8272.576214][ C0] ? lock_release+0x1d5/0x250 [ 8272.576468][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8272.576750][ C0] ? ktime_get+0xb6/0x190 [ 8272.576982][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8272.577280][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8272.577594][ C0] run_timer_softirq+0x72/0x100 [ 8272.577852][ C0] __do_softirq+0x1bc/0x7ff [ 8272.578095][ C0] irq_exit_rcu+0x98/0xc0 [ 8272.578324][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8272.578623][ C0] [ 8272.578782][ C0] [ 8272.578941][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8272.579265][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8272.579538][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8272.580552][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8272.580876][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8272.581293][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8272.581710][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8272.582129][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8272.582545][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8272.582962][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8272.583265][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8272.583536][ C0] default_idle_call+0x69/0xa0 [ 8272.583792][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8272.584057][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8272.584352][ C0] ? lock_release+0x1d5/0x250 [ 8272.584604][ C0] do_idle+0xfb/0x160 [ 8272.584820][ C0] cpu_startup_entry+0x55/0x60 [ 8272.585074][ C0] rest_init+0x153/0x260 [ 8272.585304][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8272.585592][ C0] arch_call_rest_init+0x13/0x40 [ 8272.585858][ C0] start_kernel+0x314/0x3d0 [ 8272.586103][ C0] x86_64_start_reservations+0x18/0x30 [ 8272.586399][ C0] x86_64_start_kernel+0xba/0x110 [ 8272.586676][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8272.587005][ C0] [ 8272.587175][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6598s! [ksoftirqd/1:22] [ 8272.587639][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8272.588837][ C1] irq event stamp: 3886976 [ 8272.589079][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8272.589578][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8272.590075][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8272.590576][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8272.591073][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8272.591570][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8272.592220][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8272.592569][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8272.593594][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8272.593917][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8272.594336][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8272.594753][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8272.595171][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8272.595589][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8272.596016][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8272.596485][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8272.596848][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8272.597276][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8272.597696][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8272.598129][ C1] Call Trace: [ 8272.598305][ C1] [ 8272.598459][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8272.598745][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8272.599009][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8272.599306][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8272.599594][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8272.599894][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8272.600176][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8272.600498][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8272.600775][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8272.601099][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8272.601408][ C1] [ 8272.601568][ C1] [ 8272.601727][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8272.602070][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8272.602374][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8272.602686][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8272.603002][ C1] ? run_ksoftirqd+0xb/0x60 [ 8272.603258][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8272.603588][ C1] ? __orc_find+0x9c/0xf0 [ 8272.603817][ C1] ? lock_acquire+0x1c1/0x220 [ 8272.604071][ C1] ? irqentry_enter+0x2b/0x60 [ 8272.604321][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8272.604581][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8272.604870][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8272.605174][ C1] ? lock_acquire+0x1c1/0x220 [ 8272.605422][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8272.605671][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8272.605945][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8272.606196][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8272.606459][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8272.606753][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8272.607042][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8272.607329][ C1] ip_local_deliver+0x19d/0x480 [ 8272.607591][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8272.607879][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8272.608149][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8272.608426][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8272.608688][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8272.609027][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8272.609307][ C1] ip_rcv+0x564/0x740 [ 8272.609520][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8272.609761][ C1] ? set_track_prepare+0x8a/0xd0 [ 8272.610029][ C1] ? irqentry_enter+0x2b/0x60 [ 8272.610282][ C1] ? irqentry_enter+0x2b/0x60 [ 8272.610540][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8272.610788][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8272.611104][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8272.611456][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8272.611766][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8272.612107][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8272.612409][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8272.612745][ C1] netif_receive_skb+0x55/0x280 [ 8272.613010][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8272.613345][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8272.613695][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8272.614010][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8272.614305][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8272.614610][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8272.614939][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8272.615228][ C1] ? arch_stack_walk+0x68/0x100 [ 8272.615493][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8272.615770][ C1] ? irqentry_enter+0x2b/0x60 [ 8272.616024][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8272.616353][ C1] ? irqentry_enter+0x2b/0x60 [ 8272.616618][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8272.616941][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8272.617231][ C1] ? arch_stack_walk+0x68/0x100 [ 8272.617494][ C1] __tcf_classify+0x32c/0x7d0 [ 8272.617743][ C1] tcf_classify+0x283/0x930 [ 8272.617993][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8272.618266][ C1] tc_run+0x2e4/0x5d0 [ 8272.618487][ C1] ? __pfx_tc_run+0x10/0x10 [ 8272.618731][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8272.618995][ C1] ? irqentry_enter+0x2b/0x60 [ 8272.619253][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8272.619552][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8272.619877][ C1] ip_finish_output2+0x786/0x18e0 [ 8272.620173][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8272.620459][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8272.620728][ C1] ? __ip_finish_output+0x10f/0x770 [ 8272.621010][ C1] ip_output+0x16b/0x4f0 [ 8272.621237][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8272.621563][ C1] ? __pfx_ip_output+0x10/0x10 [ 8272.621820][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8272.622180][ C1] ? __pfx_ip_output+0x10/0x10 [ 8272.622436][ C1] __ip_queue_xmit+0x672/0x1910 [ 8272.622696][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8272.622985][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8272.623283][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8272.623568][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8272.623862][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8272.624154][ C1] tcp_delack_timer+0x84/0x240 [ 8272.624409][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8272.624696][ C1] call_timer_fn+0x176/0x430 [ 8272.624959][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8272.625237][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8272.625517][ C1] __run_timers.part.0+0x52d/0x890 [ 8272.625798][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8272.626092][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8272.626394][ C1] ? __pfx___schedule+0x10/0x10 [ 8272.626666][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8272.626993][ C1] run_timer_softirq+0x72/0x100 [ 8272.627256][ C1] __do_softirq+0x1bc/0x7ff [ 8272.627504][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8272.627783][ C1] run_ksoftirqd+0x2e/0x60 [ 8272.628029][ C1] smpboot_thread_fn+0x30e/0x840 [ 8272.628304][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8272.628595][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8272.628889][ C1] kthread+0x292/0x360 [ 8272.629113][ C1] ? __pfx_kthread+0x10/0x10 [ 8272.629359][ C1] ret_from_fork+0x34/0x70 [ 8272.629596][ C1] ? __pfx_kthread+0x10/0x10 [ 8272.629849][ C1] ret_from_fork_asm+0x1b/0x30 [ 8272.630115][ C1] [ 8300.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6624s! [swapper/0:0] [ 8300.527929][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8300.529129][ C0] irq event stamp: 27567077 [ 8300.529374][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8300.529908][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8300.530384][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8300.530886][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8300.531380][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8300.531860][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8300.532512][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 8300.532852][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 8300.533869][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8300.534194][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8300.534612][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8300.535029][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8300.535447][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8300.535865][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8300.536284][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8300.536765][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8300.537113][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8300.537540][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8300.537960][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8300.538378][ C0] Call Trace: [ 8300.538559][ C0] [ 8300.538716][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8300.538994][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8300.539251][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8300.539544][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8300.539830][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8300.540131][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8300.540407][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8300.540731][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8300.541006][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8300.541281][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8300.541610][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8300.541921][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8300.542250][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8300.542555][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 8300.542863][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8300.543169][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8300.543497][ C0] ? get_stack_info+0x36/0xc0 [ 8300.543747][ C0] ? lock_acquire+0x1c1/0x220 [ 8300.543995][ C0] ? lock_release+0x1d5/0x250 [ 8300.544247][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8300.544505][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8300.544790][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8300.545090][ C0] ? lock_acquire+0x1c1/0x220 [ 8300.545345][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8300.545600][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8300.545874][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8300.546119][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8300.546375][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8300.546651][ C0] ? __inet_lookup_established+0x341/0x610 [ 8300.546967][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8300.547255][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8300.547543][ C0] ip_local_deliver+0x19d/0x480 [ 8300.547811][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8300.548101][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8300.548371][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8300.548647][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8300.548909][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8300.549248][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8300.549524][ C0] ip_rcv+0x564/0x740 [ 8300.549736][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8300.549976][ C0] ? set_track_prepare+0x8a/0xd0 [ 8300.550240][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8300.550529][ C0] ? rest_init+0x153/0x260 [ 8300.550763][ C0] ? skb_clone+0x10b/0x330 [ 8300.551004][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8300.551339][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8300.551655][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8300.551953][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8300.552266][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8300.552526][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8300.552769][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8300.553088][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8300.553389][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8300.553726][ C0] ? lock_acquire+0x1c1/0x220 [ 8300.553973][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8300.554282][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8300.554584][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8300.554914][ C0] ? __copy_skb_header+0xaf/0x490 [ 8300.555181][ C0] ? __skb_clone+0x57a/0x760 [ 8300.555427][ C0] netif_receive_skb+0x55/0x280 [ 8300.555691][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8300.556019][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8300.556376][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8300.556696][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8300.556984][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8300.557284][ C0] ? hlock_class+0x4e/0x130 [ 8300.557527][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8300.557857][ C0] ? place_entity+0x21/0x2f0 [ 8300.558103][ C0] ? resched_curr+0x219/0x280 [ 8300.558359][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8300.558629][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8300.558912][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8300.559190][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8300.559448][ C0] ? activate_task+0xf5/0x260 [ 8300.559698][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8300.559971][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8300.560248][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8300.560504][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8300.560792][ C0] ? get_stack_info+0x36/0xc0 [ 8300.561047][ C0] ? stack_access_ok+0xda/0x1f0 [ 8300.561311][ C0] ? get_reg+0x119/0x190 [ 8300.561539][ C0] __tcf_classify+0x32c/0x7d0 [ 8300.561788][ C0] tcf_classify+0x283/0x930 [ 8300.562027][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8300.562357][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8300.562627][ C0] ? arch_stack_walk+0x8c/0x100 [ 8300.562893][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8300.563188][ C0] tc_run+0x2e4/0x5d0 [ 8300.563402][ C0] ? __pfx_tc_run+0x10/0x10 [ 8300.563644][ C0] ? lock_acquire+0x1c1/0x220 [ 8300.563894][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8300.564170][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8300.564441][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8300.564727][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8300.565004][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8300.565323][ C0] ? neigh_hh_output+0x348/0x590 [ 8300.565591][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8300.565867][ C0] ip_finish_output2+0x786/0x18e0 [ 8300.566135][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8300.566437][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8300.566790][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8300.567078][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8300.567349][ C0] ? __ip_finish_output+0x10f/0x770 [ 8300.567627][ C0] ip_output+0x16b/0x4f0 [ 8300.567852][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8300.568138][ C0] ? __pfx_ip_output+0x10/0x10 [ 8300.568390][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8300.568693][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8300.568956][ C0] ? ip_local_out+0x114/0x3b0 [ 8300.569211][ C0] __ip_queue_xmit+0x672/0x1910 [ 8300.569473][ C0] ? __skb_clone+0x57a/0x760 [ 8300.569720][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8300.570000][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8300.570295][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8300.570616][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8300.570876][ C0] ? tcp_current_mss+0x40a/0x510 [ 8300.571140][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8300.571423][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8300.571699][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8300.571955][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8300.572227][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8300.572549][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8300.572824][ C0] ? ktime_get+0xb6/0x190 [ 8300.573056][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8300.573329][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8300.573611][ C0] tcp_write_timer+0x82/0x1d0 [ 8300.573860][ C0] call_timer_fn+0x176/0x430 [ 8300.574105][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8300.574381][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8300.574654][ C0] __run_timers.part.0+0x52d/0x890 [ 8300.574928][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8300.575213][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8300.575513][ C0] ? lock_acquire+0x1c1/0x220 [ 8300.575760][ C0] ? clockevents_program_event+0xf6/0x300 [ 8300.576065][ C0] ? lock_release+0x1d5/0x250 [ 8300.576315][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8300.576599][ C0] ? ktime_get+0xb6/0x190 [ 8300.576832][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8300.577133][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8300.577442][ C0] run_timer_softirq+0x72/0x100 [ 8300.577705][ C0] __do_softirq+0x1bc/0x7ff [ 8300.577952][ C0] irq_exit_rcu+0x98/0xc0 [ 8300.578185][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8300.578490][ C0] [ 8300.578646][ C0] [ 8300.578803][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8300.579122][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8300.579396][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8300.580419][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8300.580746][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8300.581167][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8300.581588][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8300.582010][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8300.582435][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8300.582855][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8300.583161][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8300.583440][ C0] default_idle_call+0x69/0xa0 [ 8300.583690][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8300.583955][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8300.584248][ C0] ? lock_release+0x1d5/0x250 [ 8300.584504][ C0] do_idle+0xfb/0x160 [ 8300.584718][ C0] cpu_startup_entry+0x55/0x60 [ 8300.584975][ C0] rest_init+0x153/0x260 [ 8300.585202][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8300.585495][ C0] arch_call_rest_init+0x13/0x40 [ 8300.585762][ C0] start_kernel+0x314/0x3d0 [ 8300.586005][ C0] x86_64_start_reservations+0x18/0x30 [ 8300.586297][ C0] x86_64_start_kernel+0xba/0x110 [ 8300.586577][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8300.586899][ C0] [ 8300.587064][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6624s! [ksoftirqd/1:22] [ 8300.587531][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8300.588727][ C1] irq event stamp: 3886976 [ 8300.588966][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8300.589472][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8300.589975][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8300.590480][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8300.590972][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8300.591472][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8300.592123][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8300.592470][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8300.593494][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8300.593818][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8300.594247][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8300.594668][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8300.595092][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8300.595517][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8300.595943][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8300.596426][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8300.596780][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8300.597209][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8300.597636][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8300.598057][ C1] Call Trace: [ 8300.598236][ C1] [ 8300.598396][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8300.598672][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8300.598930][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8300.599221][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8300.599509][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8300.599815][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8300.600097][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8300.600426][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8300.600700][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8300.601026][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8300.601344][ C1] [ 8300.601500][ C1] [ 8300.601658][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8300.601986][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8300.602295][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8300.602608][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8300.602910][ C1] ? run_ksoftirqd+0xb/0x60 [ 8300.603156][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8300.603481][ C1] ? __orc_find+0x9c/0xf0 [ 8300.603717][ C1] ? lock_acquire+0x1c1/0x220 [ 8300.603969][ C1] ? irqentry_enter+0x2b/0x60 [ 8300.604224][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8300.604487][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8300.604776][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8300.605081][ C1] ? lock_acquire+0x1c1/0x220 [ 8300.605331][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8300.605584][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8300.605857][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8300.606107][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8300.606369][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8300.606650][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8300.606940][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8300.607231][ C1] ip_local_deliver+0x19d/0x480 [ 8300.607493][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8300.607780][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8300.608048][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8300.608325][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8300.608590][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8300.608932][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8300.609205][ C1] ip_rcv+0x564/0x740 [ 8300.609419][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8300.609658][ C1] ? set_track_prepare+0x8a/0xd0 [ 8300.609923][ C1] ? irqentry_enter+0x2b/0x60 [ 8300.610180][ C1] ? irqentry_enter+0x2b/0x60 [ 8300.610437][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8300.610682][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8300.610999][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8300.611342][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8300.611657][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8300.611996][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8300.612295][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8300.612632][ C1] netif_receive_skb+0x55/0x280 [ 8300.612895][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8300.613227][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8300.613580][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8300.613892][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8300.614185][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8300.614490][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8300.614823][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8300.615111][ C1] ? arch_stack_walk+0x68/0x100 [ 8300.615372][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8300.615651][ C1] ? irqentry_enter+0x2b/0x60 [ 8300.615902][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8300.616224][ C1] ? irqentry_enter+0x2b/0x60 [ 8300.616487][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8300.616811][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8300.617091][ C1] ? arch_stack_walk+0x68/0x100 [ 8300.617352][ C1] __tcf_classify+0x32c/0x7d0 [ 8300.617607][ C1] tcf_classify+0x283/0x930 [ 8300.617852][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8300.618124][ C1] tc_run+0x2e4/0x5d0 [ 8300.618345][ C1] ? __pfx_tc_run+0x10/0x10 [ 8300.618591][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8300.618861][ C1] ? irqentry_enter+0x2b/0x60 [ 8300.619111][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8300.619395][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8300.619716][ C1] ip_finish_output2+0x786/0x18e0 [ 8300.619990][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8300.620283][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8300.620546][ C1] ? __ip_finish_output+0x10f/0x770 [ 8300.620827][ C1] ip_output+0x16b/0x4f0 [ 8300.621058][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8300.621375][ C1] ? __pfx_ip_output+0x10/0x10 [ 8300.621635][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8300.621985][ C1] ? __pfx_ip_output+0x10/0x10 [ 8300.622239][ C1] __ip_queue_xmit+0x672/0x1910 [ 8300.622502][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8300.622785][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8300.623083][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8300.623377][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8300.623677][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8300.623966][ C1] tcp_delack_timer+0x84/0x240 [ 8300.624226][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8300.624511][ C1] call_timer_fn+0x176/0x430 [ 8300.624759][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8300.625034][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8300.625310][ C1] __run_timers.part.0+0x52d/0x890 [ 8300.625582][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8300.625873][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8300.626176][ C1] ? __pfx___schedule+0x10/0x10 [ 8300.626441][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8300.626767][ C1] run_timer_softirq+0x72/0x100 [ 8300.627026][ C1] __do_softirq+0x1bc/0x7ff [ 8300.627269][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8300.627541][ C1] run_ksoftirqd+0x2e/0x60 [ 8300.627782][ C1] smpboot_thread_fn+0x30e/0x840 [ 8300.628047][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8300.628343][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8300.628633][ C1] kthread+0x292/0x360 [ 8300.628851][ C1] ? __pfx_kthread+0x10/0x10 [ 8300.629095][ C1] ret_from_fork+0x34/0x70 [ 8300.629336][ C1] ? __pfx_kthread+0x10/0x10 [ 8300.629580][ C1] ret_from_fork_asm+0x1b/0x30 [ 8300.629843][ C1] [ 8326.128023][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8326.128410][ C0] rcu: 0-....: (7075650 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1684415 [ 8326.128931][ C0] rcu: (t=7131819 jiffies g=1007429 q=31 ncpus=4) [ 8326.129278][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8326.129763][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8326.130408][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 8326.130747][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 8326.131776][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8326.132104][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8326.132531][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8326.132957][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8326.133380][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8326.133802][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8326.134228][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8326.134704][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8326.135051][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8326.135477][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8326.135902][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8326.136332][ C0] Call Trace: [ 8326.136514][ C0] [ 8326.136672][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8326.136961][ C0] ? print_cpu_stall+0x263/0x6a0 [ 8326.137231][ C0] ? check_cpu_stall+0x284/0x500 [ 8326.137495][ C0] ? rcu_pending+0x92/0x360 [ 8326.137741][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8326.138027][ C0] ? update_process_times+0xb9/0x110 [ 8326.138310][ C0] ? tick_sched_handle+0x67/0x130 [ 8326.138582][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8326.138881][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8326.139138][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8326.139465][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8326.139753][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8326.140060][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8326.140343][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8326.140668][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8326.140944][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8326.141224][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8326.141548][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8326.141856][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8326.142191][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8326.142494][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 8326.142795][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8326.143097][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8326.143423][ C0] ? get_stack_info+0x36/0xc0 [ 8326.143681][ C0] ? lock_acquire+0x1c1/0x220 [ 8326.143937][ C0] ? lock_release+0x1d5/0x250 [ 8326.144193][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8326.144460][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8326.144752][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8326.145057][ C0] ? lock_acquire+0x1c1/0x220 [ 8326.145308][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8326.145558][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8326.145831][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8326.146081][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8326.146351][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8326.146619][ C0] ? __inet_lookup_established+0x341/0x610 [ 8326.146930][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8326.147224][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8326.147518][ C0] ip_local_deliver+0x19d/0x480 [ 8326.147791][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8326.148075][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8326.148339][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8326.148619][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8326.148882][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8326.149216][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8326.149495][ C0] ip_rcv+0x564/0x740 [ 8326.149709][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8326.149952][ C0] ? set_track_prepare+0x8a/0xd0 [ 8326.150218][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8326.150503][ C0] ? rest_init+0x153/0x260 [ 8326.150744][ C0] ? skb_clone+0x10b/0x330 [ 8326.150985][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8326.151324][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8326.151643][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8326.151938][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8326.152247][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8326.152503][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8326.152743][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8326.153058][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8326.153355][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8326.153697][ C0] ? lock_acquire+0x1c1/0x220 [ 8326.153948][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8326.154266][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8326.154563][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8326.154897][ C0] ? __copy_skb_header+0xaf/0x490 [ 8326.155168][ C0] ? __skb_clone+0x57a/0x760 [ 8326.155416][ C0] netif_receive_skb+0x55/0x280 [ 8326.155673][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8326.155997][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8326.156353][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8326.156663][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8326.156953][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8326.157255][ C0] ? hlock_class+0x4e/0x130 [ 8326.157503][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8326.157838][ C0] ? place_entity+0x21/0x2f0 [ 8326.158090][ C0] ? resched_curr+0x219/0x280 [ 8326.158341][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8326.158607][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8326.158887][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8326.159169][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8326.159431][ C0] ? activate_task+0xf5/0x260 [ 8326.159683][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8326.159961][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8326.160233][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8326.160497][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8326.160791][ C0] ? get_stack_info+0x36/0xc0 [ 8326.161044][ C0] ? stack_access_ok+0xda/0x1f0 [ 8326.161303][ C0] ? get_reg+0x119/0x190 [ 8326.161529][ C0] __tcf_classify+0x32c/0x7d0 [ 8326.161785][ C0] tcf_classify+0x283/0x930 [ 8326.162030][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8326.162362][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8326.162627][ C0] ? arch_stack_walk+0x8c/0x100 [ 8326.162888][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8326.163178][ C0] tc_run+0x2e4/0x5d0 [ 8326.163394][ C0] ? __pfx_tc_run+0x10/0x10 [ 8326.163638][ C0] ? lock_acquire+0x1c1/0x220 [ 8326.163891][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8326.164170][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8326.164437][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8326.164725][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8326.165006][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8326.165328][ C0] ? neigh_hh_output+0x348/0x590 [ 8326.165592][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8326.165876][ C0] ip_finish_output2+0x786/0x18e0 [ 8326.166149][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8326.166452][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8326.166810][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8326.167105][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8326.167369][ C0] ? __ip_finish_output+0x10f/0x770 [ 8326.167651][ C0] ip_output+0x16b/0x4f0 [ 8326.167878][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8326.168158][ C0] ? __pfx_ip_output+0x10/0x10 [ 8326.168414][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8326.168714][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8326.168980][ C0] ? ip_local_out+0x114/0x3b0 [ 8326.169231][ C0] __ip_queue_xmit+0x672/0x1910 [ 8326.169488][ C0] ? __skb_clone+0x57a/0x760 [ 8326.169732][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8326.170015][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8326.170313][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8326.170636][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8326.170892][ C0] ? tcp_current_mss+0x40a/0x510 [ 8326.171157][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8326.171436][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8326.171714][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8326.171970][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8326.172237][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8326.172554][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8326.172833][ C0] ? ktime_get+0xb6/0x190 [ 8326.173068][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8326.173343][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8326.173622][ C0] tcp_write_timer+0x82/0x1d0 [ 8326.173874][ C0] call_timer_fn+0x176/0x430 [ 8326.174125][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8326.174399][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8326.174673][ C0] __run_timers.part.0+0x52d/0x890 [ 8326.174946][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8326.175233][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8326.175530][ C0] ? lock_acquire+0x1c1/0x220 [ 8326.175784][ C0] ? clockevents_program_event+0xf6/0x300 [ 8326.176092][ C0] ? lock_release+0x1d5/0x250 [ 8326.176352][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8326.176628][ C0] ? ktime_get+0xb6/0x190 [ 8326.176858][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8326.177156][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8326.177471][ C0] run_timer_softirq+0x72/0x100 [ 8326.177729][ C0] __do_softirq+0x1bc/0x7ff [ 8326.177972][ C0] irq_exit_rcu+0x98/0xc0 [ 8326.178203][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8326.178502][ C0] [ 8326.178660][ C0] [ 8326.178818][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8326.179144][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8326.179411][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8326.180424][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8326.180750][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8326.181170][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8326.181587][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8326.182006][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8326.182426][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8326.182846][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8326.183148][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8326.183421][ C0] default_idle_call+0x69/0xa0 [ 8326.183676][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8326.183939][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8326.184234][ C0] ? lock_release+0x1d5/0x250 [ 8326.184486][ C0] do_idle+0xfb/0x160 [ 8326.184699][ C0] cpu_startup_entry+0x55/0x60 [ 8326.184950][ C0] rest_init+0x153/0x260 [ 8326.185180][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8326.185468][ C0] arch_call_rest_init+0x13/0x40 [ 8326.185732][ C0] start_kernel+0x314/0x3d0 [ 8326.185976][ C0] x86_64_start_reservations+0x18/0x30 [ 8326.186279][ C0] x86_64_start_kernel+0xba/0x110 [ 8326.186550][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8326.186878][ C0] [ 8326.187048][ C0] Sending NMI from CPU 0 to CPUs 1: [ 8326.187332][ C1] NMI backtrace for cpu 1 [ 8326.187339][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8326.187344][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8326.187346][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8326.187354][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8326.187358][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8326.187361][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8326.187364][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8326.187365][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8326.187367][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8326.187370][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8326.187371][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8326.187373][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8326.187377][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8326.187379][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8326.187380][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8326.187382][ C1] Call Trace: [ 8326.187385][ C1] [ 8326.187389][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 8326.187394][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8326.187399][ C1] ? nmi_handle+0x156/0x420 [ 8326.187404][ C1] ? default_do_nmi+0x41/0x100 [ 8326.187407][ C1] ? exc_nmi+0xf3/0x120 [ 8326.187410][ C1] ? end_repeat_nmi+0xf/0x60 [ 8326.187414][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8326.187418][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8326.187422][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8326.187426][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8326.187429][ C1] [ 8326.187430][ C1] [ 8326.187431][ C1] ? run_ksoftirqd+0xb/0x60 [ 8326.187436][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8326.187439][ C1] ? __orc_find+0x9c/0xf0 [ 8326.187443][ C1] ? lock_acquire+0x1c1/0x220 [ 8326.187447][ C1] ? irqentry_enter+0x2b/0x60 [ 8326.187451][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8326.187456][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8326.187459][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8326.187462][ C1] ? lock_acquire+0x1c1/0x220 [ 8326.187464][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8326.187469][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8326.187472][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8326.187480][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8326.187482][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8326.187488][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8326.187494][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8326.187498][ C1] ip_local_deliver+0x19d/0x480 [ 8326.187502][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8326.187504][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8326.187508][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8326.187513][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8326.187516][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8326.187520][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8326.187530][ C1] ip_rcv+0x564/0x740 [ 8326.187533][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8326.187536][ C1] ? set_track_prepare+0x8a/0xd0 [ 8326.187540][ C1] ? irqentry_enter+0x2b/0x60 [ 8326.187543][ C1] ? irqentry_enter+0x2b/0x60 [ 8326.187547][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8326.187549][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8326.187553][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8326.187557][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8326.187560][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8326.187563][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8326.187565][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8326.187570][ C1] netif_receive_skb+0x55/0x280 [ 8326.187574][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8326.187582][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8326.187589][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8326.187596][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8326.187603][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8326.187614][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8326.187624][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8326.187627][ C1] ? arch_stack_walk+0x68/0x100 [ 8326.187631][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8326.187635][ C1] ? irqentry_enter+0x2b/0x60 [ 8326.187638][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8326.187643][ C1] ? irqentry_enter+0x2b/0x60 [ 8326.187646][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8326.187654][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8326.187656][ C1] ? arch_stack_walk+0x68/0x100 [ 8326.187660][ C1] __tcf_classify+0x32c/0x7d0 [ 8326.187665][ C1] tcf_classify+0x283/0x930 [ 8326.187669][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8326.187674][ C1] tc_run+0x2e4/0x5d0 [ 8326.187677][ C1] ? __pfx_tc_run+0x10/0x10 [ 8326.187682][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8326.187688][ C1] ? irqentry_enter+0x2b/0x60 [ 8326.187691][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8326.187694][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8326.187701][ C1] ip_finish_output2+0x786/0x18e0 [ 8326.187707][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8326.187710][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8326.187713][ C1] ? __ip_finish_output+0x10f/0x770 [ 8326.187718][ C1] ip_output+0x16b/0x4f0 [ 8326.187721][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8326.187724][ C1] ? __pfx_ip_output+0x10/0x10 [ 8326.187729][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8326.187736][ C1] ? __pfx_ip_output+0x10/0x10 [ 8326.187741][ C1] __ip_queue_xmit+0x672/0x1910 [ 8326.187746][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8326.187753][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8326.187757][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8326.187761][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8326.187766][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8326.187768][ C1] tcp_delack_timer+0x84/0x240 [ 8326.187772][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8326.187775][ C1] call_timer_fn+0x176/0x430 [ 8326.187779][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8326.187784][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8326.187788][ C1] __run_timers.part.0+0x52d/0x890 [ 8326.187792][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8326.187797][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8326.187801][ C1] ? __pfx___schedule+0x10/0x10 [ 8326.187805][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8326.187809][ C1] run_timer_softirq+0x72/0x100 [ 8326.187813][ C1] __do_softirq+0x1bc/0x7ff [ 8326.187816][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8326.187820][ C1] run_ksoftirqd+0x2e/0x60 [ 8326.187823][ C1] smpboot_thread_fn+0x30e/0x840 [ 8326.187827][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8326.187831][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8326.187834][ C1] kthread+0x292/0x360 [ 8326.187837][ C1] ? __pfx_kthread+0x10/0x10 [ 8326.187839][ C1] ret_from_fork+0x34/0x70 [ 8326.187842][ C1] ? __pfx_kthread+0x10/0x10 [ 8326.187844][ C1] ret_from_fork_asm+0x1b/0x30 [ 8326.187851][ C1] [ 8352.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6672s! [swapper/0:0] [ 8352.527929][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8352.529134][ C0] irq event stamp: 27567077 [ 8352.529380][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8352.529918][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8352.530394][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8352.530901][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8352.531401][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8352.531883][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8352.532537][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8352.532883][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8352.533919][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8352.534250][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8352.534677][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8352.535103][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8352.535531][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8352.535954][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8352.536387][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8352.536856][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8352.537210][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8352.537631][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8352.538056][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8352.538482][ C0] Call Trace: [ 8352.538669][ C0] [ 8352.538826][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8352.539101][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8352.539359][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8352.539649][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8352.539940][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8352.540248][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8352.540531][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8352.540853][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8352.541127][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8352.541406][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8352.541729][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8352.542042][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8352.542375][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8352.542680][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8352.542990][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8352.543298][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8352.543631][ C0] ? get_stack_info+0x36/0xc0 [ 8352.543884][ C0] ? lock_acquire+0x1c1/0x220 [ 8352.544136][ C0] ? lock_release+0x1d5/0x250 [ 8352.544388][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8352.544649][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8352.544933][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8352.545230][ C0] ? lock_acquire+0x1c1/0x220 [ 8352.545484][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8352.545742][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8352.546019][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8352.546276][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8352.546540][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8352.546812][ C0] ? __inet_lookup_established+0x341/0x610 [ 8352.547129][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8352.547418][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8352.547709][ C0] ip_local_deliver+0x19d/0x480 [ 8352.547971][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8352.548258][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8352.548528][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8352.548804][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8352.549068][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8352.549408][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8352.549681][ C0] ip_rcv+0x564/0x740 [ 8352.549894][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8352.550134][ C0] ? set_track_prepare+0x8a/0xd0 [ 8352.550399][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8352.550690][ C0] ? rest_init+0x153/0x260 [ 8352.550928][ C0] ? skb_clone+0x10b/0x330 [ 8352.551170][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8352.551501][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8352.551822][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8352.552119][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8352.552429][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8352.552693][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8352.552938][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8352.553254][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8352.553553][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8352.553891][ C0] ? lock_acquire+0x1c1/0x220 [ 8352.554140][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8352.554449][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8352.554748][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8352.555075][ C0] ? __copy_skb_header+0xaf/0x490 [ 8352.555341][ C0] ? __skb_clone+0x57a/0x760 [ 8352.555587][ C0] netif_receive_skb+0x55/0x280 [ 8352.555849][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8352.556183][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8352.556529][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8352.556844][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8352.557129][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8352.557427][ C0] ? hlock_class+0x4e/0x130 [ 8352.557670][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8352.557995][ C0] ? place_entity+0x21/0x2f0 [ 8352.558239][ C0] ? resched_curr+0x219/0x280 [ 8352.558493][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8352.558763][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8352.559047][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8352.559322][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8352.559577][ C0] ? activate_task+0xf5/0x260 [ 8352.559824][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8352.560096][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8352.560372][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8352.560631][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8352.560920][ C0] ? get_stack_info+0x36/0xc0 [ 8352.561174][ C0] ? stack_access_ok+0xda/0x1f0 [ 8352.561434][ C0] ? get_reg+0x119/0x190 [ 8352.561667][ C0] __tcf_classify+0x32c/0x7d0 [ 8352.561919][ C0] tcf_classify+0x283/0x930 [ 8352.562162][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8352.562488][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8352.562758][ C0] ? arch_stack_walk+0x8c/0x100 [ 8352.563021][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8352.563312][ C0] tc_run+0x2e4/0x5d0 [ 8352.563526][ C0] ? __pfx_tc_run+0x10/0x10 [ 8352.563766][ C0] ? lock_acquire+0x1c1/0x220 [ 8352.564013][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8352.564286][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8352.564554][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8352.564838][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8352.565117][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8352.565436][ C0] ? neigh_hh_output+0x348/0x590 [ 8352.565703][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8352.565980][ C0] ip_finish_output2+0x786/0x18e0 [ 8352.566254][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8352.566547][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8352.566898][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8352.567187][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8352.567452][ C0] ? __ip_finish_output+0x10f/0x770 [ 8352.567728][ C0] ip_output+0x16b/0x4f0 [ 8352.567955][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8352.568241][ C0] ? __pfx_ip_output+0x10/0x10 [ 8352.568496][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8352.568802][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8352.569066][ C0] ? ip_local_out+0x114/0x3b0 [ 8352.569327][ C0] __ip_queue_xmit+0x672/0x1910 [ 8352.569593][ C0] ? __skb_clone+0x57a/0x760 [ 8352.569843][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8352.570122][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8352.570416][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8352.570733][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8352.570991][ C0] ? tcp_current_mss+0x40a/0x510 [ 8352.571254][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8352.571540][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8352.571814][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8352.572066][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8352.572339][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8352.572662][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8352.572938][ C0] ? ktime_get+0xb6/0x190 [ 8352.573170][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8352.573446][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8352.573734][ C0] tcp_write_timer+0x82/0x1d0 [ 8352.573985][ C0] call_timer_fn+0x176/0x430 [ 8352.574232][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8352.574511][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8352.574784][ C0] __run_timers.part.0+0x52d/0x890 [ 8352.575059][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8352.575340][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8352.575642][ C0] ? lock_acquire+0x1c1/0x220 [ 8352.575892][ C0] ? clockevents_program_event+0xf6/0x300 [ 8352.576203][ C0] ? lock_release+0x1d5/0x250 [ 8352.576456][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8352.576736][ C0] ? ktime_get+0xb6/0x190 [ 8352.576969][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8352.577272][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8352.577582][ C0] run_timer_softirq+0x72/0x100 [ 8352.577844][ C0] __do_softirq+0x1bc/0x7ff [ 8352.578093][ C0] irq_exit_rcu+0x98/0xc0 [ 8352.578328][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8352.578629][ C0] [ 8352.578785][ C0] [ 8352.578941][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8352.579259][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8352.579530][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8352.580563][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8352.580888][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8352.581314][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8352.581741][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8352.582161][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8352.582582][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8352.583009][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8352.583318][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8352.583594][ C0] default_idle_call+0x69/0xa0 [ 8352.583850][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8352.584119][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8352.584407][ C0] ? lock_release+0x1d5/0x250 [ 8352.584660][ C0] do_idle+0xfb/0x160 [ 8352.584877][ C0] cpu_startup_entry+0x55/0x60 [ 8352.585137][ C0] rest_init+0x153/0x260 [ 8352.585363][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8352.585652][ C0] arch_call_rest_init+0x13/0x40 [ 8352.585920][ C0] start_kernel+0x314/0x3d0 [ 8352.586171][ C0] x86_64_start_reservations+0x18/0x30 [ 8352.586465][ C0] x86_64_start_kernel+0xba/0x110 [ 8352.586732][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8352.587059][ C0] [ 8352.587225][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6672s! [ksoftirqd/1:22] [ 8352.587682][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8352.588868][ C1] irq event stamp: 3886976 [ 8352.589102][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8352.589601][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8352.590100][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8352.590604][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8352.591094][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8352.591594][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8352.592241][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8352.592587][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8352.593618][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8352.593946][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8352.594368][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8352.594791][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8352.595217][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8352.595639][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8352.596059][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8352.596539][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8352.596893][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8352.597315][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8352.597740][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8352.598165][ C1] Call Trace: [ 8352.598351][ C1] [ 8352.598507][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8352.598783][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8352.599038][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8352.599327][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8352.599618][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8352.599925][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8352.600207][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8352.600527][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8352.600800][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8352.601129][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8352.601440][ C1] [ 8352.601597][ C1] [ 8352.601753][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8352.602082][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8352.602390][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8352.602701][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8352.603002][ C1] ? run_ksoftirqd+0xb/0x60 [ 8352.603243][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8352.603569][ C1] ? __orc_find+0x9c/0xf0 [ 8352.603802][ C1] ? lock_acquire+0x1c1/0x220 [ 8352.604060][ C1] ? irqentry_enter+0x2b/0x60 [ 8352.604317][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8352.604580][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8352.604867][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8352.605166][ C1] ? lock_acquire+0x1c1/0x220 [ 8352.605413][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8352.605662][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8352.605932][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8352.606190][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8352.606449][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8352.606718][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8352.607004][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8352.607295][ C1] ip_local_deliver+0x19d/0x480 [ 8352.607560][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8352.607849][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8352.608117][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8352.608393][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8352.608656][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8352.608997][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8352.609272][ C1] ip_rcv+0x564/0x740 [ 8352.609483][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8352.609724][ C1] ? set_track_prepare+0x8a/0xd0 [ 8352.609987][ C1] ? irqentry_enter+0x2b/0x60 [ 8352.610240][ C1] ? irqentry_enter+0x2b/0x60 [ 8352.610493][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8352.610738][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8352.611056][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8352.611400][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8352.611711][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8352.612049][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8352.612348][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8352.612684][ C1] netif_receive_skb+0x55/0x280 [ 8352.612946][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8352.613279][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8352.613630][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8352.613949][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8352.614244][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8352.614552][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8352.614884][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8352.615170][ C1] ? arch_stack_walk+0x68/0x100 [ 8352.615429][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8352.615704][ C1] ? irqentry_enter+0x2b/0x60 [ 8352.615956][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8352.616282][ C1] ? irqentry_enter+0x2b/0x60 [ 8352.616532][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8352.616853][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8352.617136][ C1] ? arch_stack_walk+0x68/0x100 [ 8352.617396][ C1] __tcf_classify+0x32c/0x7d0 [ 8352.617648][ C1] tcf_classify+0x283/0x930 [ 8352.617888][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8352.618156][ C1] tc_run+0x2e4/0x5d0 [ 8352.618368][ C1] ? __pfx_tc_run+0x10/0x10 [ 8352.618611][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8352.618876][ C1] ? irqentry_enter+0x2b/0x60 [ 8352.619127][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8352.619413][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8352.619740][ C1] ip_finish_output2+0x786/0x18e0 [ 8352.620009][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8352.620298][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8352.620567][ C1] ? __ip_finish_output+0x10f/0x770 [ 8352.620845][ C1] ip_output+0x16b/0x4f0 [ 8352.621071][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8352.621393][ C1] ? __pfx_ip_output+0x10/0x10 [ 8352.621649][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8352.622006][ C1] ? __pfx_ip_output+0x10/0x10 [ 8352.622267][ C1] __ip_queue_xmit+0x672/0x1910 [ 8352.622528][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8352.622808][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8352.623107][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8352.623393][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8352.623687][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8352.623972][ C1] tcp_delack_timer+0x84/0x240 [ 8352.624224][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8352.624511][ C1] call_timer_fn+0x176/0x430 [ 8352.624760][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8352.625034][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8352.625313][ C1] __run_timers.part.0+0x52d/0x890 [ 8352.625589][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8352.625873][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8352.626179][ C1] ? __pfx___schedule+0x10/0x10 [ 8352.626437][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8352.626756][ C1] run_timer_softirq+0x72/0x100 [ 8352.627021][ C1] __do_softirq+0x1bc/0x7ff [ 8352.627266][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8352.627541][ C1] run_ksoftirqd+0x2e/0x60 [ 8352.627780][ C1] smpboot_thread_fn+0x30e/0x840 [ 8352.628050][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8352.628340][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8352.628631][ C1] kthread+0x292/0x360 [ 8352.628848][ C1] ? __pfx_kthread+0x10/0x10 [ 8352.629096][ C1] ret_from_fork+0x34/0x70 [ 8352.629331][ C1] ? __pfx_kthread+0x10/0x10 [ 8352.629579][ C1] ret_from_fork_asm+0x1b/0x30 [ 8352.629838][ C1] [ 8380.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6698s! [swapper/0:0] [ 8380.527933][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8380.529120][ C0] irq event stamp: 27567077 [ 8380.529361][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8380.529885][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8380.530364][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8380.530867][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8380.531363][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8380.531847][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8380.532489][ C0] RIP: 0010:__kasan_check_read+0x0/0x20 [ 8380.532783][ C0] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 8380.533802][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000202 [ 8380.534123][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8380.534545][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8380.534961][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8380.535378][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8380.535796][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8380.536225][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8380.536704][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8380.537051][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8380.537480][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8380.537902][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8380.538324][ C0] Call Trace: [ 8380.538501][ C0] [ 8380.538657][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8380.538935][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8380.539192][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8380.539486][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8380.539770][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8380.540073][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8380.540349][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8380.540670][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8380.540945][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8380.541220][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8380.541548][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8380.541861][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8380.542191][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8380.542498][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 8380.542797][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 8380.543093][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8380.543422][ C0] ? get_stack_info+0x36/0xc0 [ 8380.543674][ C0] ? lock_acquire+0x1c1/0x220 [ 8380.543926][ C0] ? lock_release+0x1d5/0x250 [ 8380.544177][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8380.544435][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8380.544717][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8380.545013][ C0] ? lock_acquire+0x1c1/0x220 [ 8380.545266][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8380.545523][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8380.545799][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8380.546059][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8380.546321][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8380.546590][ C0] ? __inet_lookup_established+0x341/0x610 [ 8380.546904][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8380.547197][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8380.547486][ C0] ip_local_deliver+0x19d/0x480 [ 8380.547745][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8380.548030][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8380.548298][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8380.548572][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8380.548834][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8380.549171][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8380.549443][ C0] ip_rcv+0x564/0x740 [ 8380.549656][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8380.549895][ C0] ? set_track_prepare+0x8a/0xd0 [ 8380.550159][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8380.550451][ C0] ? rest_init+0x153/0x260 [ 8380.550690][ C0] ? skb_clone+0x10b/0x330 [ 8380.550931][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8380.551264][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8380.551584][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8380.551881][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8380.552193][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8380.552456][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8380.552700][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8380.553015][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8380.553314][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8380.553650][ C0] ? lock_acquire+0x1c1/0x220 [ 8380.553898][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8380.554206][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8380.554503][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8380.554829][ C0] ? __copy_skb_header+0xaf/0x490 [ 8380.555095][ C0] ? __skb_clone+0x57a/0x760 [ 8380.555342][ C0] netif_receive_skb+0x55/0x280 [ 8380.555602][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8380.555933][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8380.556293][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8380.556607][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8380.556891][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8380.557190][ C0] ? hlock_class+0x4e/0x130 [ 8380.557433][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8380.557758][ C0] ? place_entity+0x21/0x2f0 [ 8380.558002][ C0] ? resched_curr+0x219/0x280 [ 8380.558255][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8380.558524][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8380.558807][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8380.559083][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8380.559340][ C0] ? activate_task+0xf5/0x260 [ 8380.559586][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8380.559857][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8380.560133][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8380.560391][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8380.560679][ C0] ? get_stack_info+0x36/0xc0 [ 8380.560931][ C0] ? stack_access_ok+0xda/0x1f0 [ 8380.561190][ C0] ? get_reg+0x119/0x190 [ 8380.561420][ C0] __tcf_classify+0x32c/0x7d0 [ 8380.561671][ C0] tcf_classify+0x283/0x930 [ 8380.561912][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8380.562238][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8380.562508][ C0] ? arch_stack_walk+0x8c/0x100 [ 8380.562769][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8380.563060][ C0] tc_run+0x2e4/0x5d0 [ 8380.563274][ C0] ? __pfx_tc_run+0x10/0x10 [ 8380.563513][ C0] ? lock_acquire+0x1c1/0x220 [ 8380.563758][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8380.564029][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8380.564296][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8380.564577][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8380.564850][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8380.565171][ C0] ? neigh_hh_output+0x348/0x590 [ 8380.565436][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8380.565716][ C0] ip_finish_output2+0x786/0x18e0 [ 8380.565987][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8380.566282][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8380.566632][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8380.566921][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8380.567186][ C0] ? __ip_finish_output+0x10f/0x770 [ 8380.567460][ C0] ip_output+0x16b/0x4f0 [ 8380.567686][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8380.567970][ C0] ? __pfx_ip_output+0x10/0x10 [ 8380.568225][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8380.568526][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8380.568786][ C0] ? ip_local_out+0x114/0x3b0 [ 8380.569041][ C0] __ip_queue_xmit+0x672/0x1910 [ 8380.569306][ C0] ? __skb_clone+0x57a/0x760 [ 8380.569554][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8380.569831][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8380.570124][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8380.570440][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8380.570696][ C0] ? tcp_current_mss+0x40a/0x510 [ 8380.570958][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8380.571241][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8380.571514][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8380.571765][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8380.572036][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8380.572358][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8380.572631][ C0] ? ktime_get+0xb6/0x190 [ 8380.572862][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8380.573136][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8380.573418][ C0] tcp_write_timer+0x82/0x1d0 [ 8380.573669][ C0] call_timer_fn+0x176/0x430 [ 8380.573914][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8380.574190][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8380.574462][ C0] __run_timers.part.0+0x52d/0x890 [ 8380.574735][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8380.575014][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8380.575315][ C0] ? lock_acquire+0x1c1/0x220 [ 8380.575564][ C0] ? clockevents_program_event+0xf6/0x300 [ 8380.575866][ C0] ? lock_release+0x1d5/0x250 [ 8380.576126][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8380.576405][ C0] ? ktime_get+0xb6/0x190 [ 8380.576636][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8380.576937][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8380.577244][ C0] run_timer_softirq+0x72/0x100 [ 8380.577505][ C0] __do_softirq+0x1bc/0x7ff [ 8380.577750][ C0] irq_exit_rcu+0x98/0xc0 [ 8380.577984][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8380.578285][ C0] [ 8380.578440][ C0] [ 8380.578595][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8380.578912][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8380.579183][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8380.580205][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8380.580529][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8380.580951][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8380.581378][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8380.581795][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8380.582214][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8380.582637][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8380.582943][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8380.583219][ C0] default_idle_call+0x69/0xa0 [ 8380.583473][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8380.583738][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8380.584026][ C0] ? lock_release+0x1d5/0x250 [ 8380.584278][ C0] do_idle+0xfb/0x160 [ 8380.584494][ C0] cpu_startup_entry+0x55/0x60 [ 8380.584751][ C0] rest_init+0x153/0x260 [ 8380.584976][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8380.585265][ C0] arch_call_rest_init+0x13/0x40 [ 8380.585530][ C0] start_kernel+0x314/0x3d0 [ 8380.585770][ C0] x86_64_start_reservations+0x18/0x30 [ 8380.586065][ C0] x86_64_start_kernel+0xba/0x110 [ 8380.586331][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8380.586656][ C0] [ 8380.586820][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6698s! [ksoftirqd/1:22] [ 8380.587284][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8380.588498][ C1] irq event stamp: 3886976 [ 8380.588740][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8380.589244][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8380.589744][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8380.590250][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8380.590754][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8380.591256][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8380.591914][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8380.592261][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8380.593291][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8380.593619][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8380.594042][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8380.594463][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8380.594886][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8380.595309][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8380.595729][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8380.596210][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8380.596559][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8380.596983][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8380.597404][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8380.597823][ C1] Call Trace: [ 8380.598003][ C1] [ 8380.598160][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8380.598441][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8380.598695][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8380.598990][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8380.599276][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8380.599581][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8380.599861][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8380.600184][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8380.600464][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8380.600790][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8380.601109][ C1] [ 8380.601272][ C1] [ 8380.601432][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8380.601770][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8380.602079][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8380.602391][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8380.602698][ C1] ? run_ksoftirqd+0xb/0x60 [ 8380.602947][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8380.603286][ C1] ? __orc_find+0x9c/0xf0 [ 8380.603518][ C1] ? lock_acquire+0x1c1/0x220 [ 8380.603771][ C1] ? irqentry_enter+0x2b/0x60 [ 8380.604026][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8380.604289][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8380.604576][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8380.604877][ C1] ? lock_acquire+0x1c1/0x220 [ 8380.605136][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8380.605392][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8380.605671][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8380.605919][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8380.606193][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8380.606468][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8380.606760][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8380.607055][ C1] ip_local_deliver+0x19d/0x480 [ 8380.607316][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8380.607603][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8380.607868][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8380.608152][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8380.608420][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8380.608757][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8380.609037][ C1] ip_rcv+0x564/0x740 [ 8380.609254][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8380.609502][ C1] ? set_track_prepare+0x8a/0xd0 [ 8380.609770][ C1] ? irqentry_enter+0x2b/0x60 [ 8380.610020][ C1] ? irqentry_enter+0x2b/0x60 [ 8380.610273][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8380.610515][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8380.610829][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8380.611171][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8380.611480][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8380.611829][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8380.612134][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8380.612469][ C1] netif_receive_skb+0x55/0x280 [ 8380.612731][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8380.613062][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8380.613411][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8380.613730][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8380.614019][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8380.614324][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8380.614653][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8380.614936][ C1] ? arch_stack_walk+0x68/0x100 [ 8380.615203][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8380.615485][ C1] ? irqentry_enter+0x2b/0x60 [ 8380.615741][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8380.616081][ C1] ? irqentry_enter+0x2b/0x60 [ 8380.616338][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8380.616664][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8380.616947][ C1] ? arch_stack_walk+0x68/0x100 [ 8380.617212][ C1] __tcf_classify+0x32c/0x7d0 [ 8380.617470][ C1] tcf_classify+0x283/0x930 [ 8380.617717][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8380.617990][ C1] tc_run+0x2e4/0x5d0 [ 8380.618208][ C1] ? __pfx_tc_run+0x10/0x10 [ 8380.618457][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8380.618730][ C1] ? irqentry_enter+0x2b/0x60 [ 8380.618980][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8380.619266][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8380.619590][ C1] ip_finish_output2+0x786/0x18e0 [ 8380.619864][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8380.620161][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8380.620428][ C1] ? __ip_finish_output+0x10f/0x770 [ 8380.620710][ C1] ip_output+0x16b/0x4f0 [ 8380.620945][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8380.621268][ C1] ? __pfx_ip_output+0x10/0x10 [ 8380.621530][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8380.621883][ C1] ? __pfx_ip_output+0x10/0x10 [ 8380.622139][ C1] __ip_queue_xmit+0x672/0x1910 [ 8380.622407][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8380.622691][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8380.622994][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8380.623287][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8380.623587][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8380.623877][ C1] tcp_delack_timer+0x84/0x240 [ 8380.624137][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8380.624424][ C1] call_timer_fn+0x176/0x430 [ 8380.624672][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8380.624952][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8380.625236][ C1] __run_timers.part.0+0x52d/0x890 [ 8380.625509][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8380.625799][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8380.626111][ C1] ? __pfx___schedule+0x10/0x10 [ 8380.626376][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8380.626701][ C1] run_timer_softirq+0x72/0x100 [ 8380.626960][ C1] __do_softirq+0x1bc/0x7ff [ 8380.627203][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8380.627478][ C1] run_ksoftirqd+0x2e/0x60 [ 8380.627718][ C1] smpboot_thread_fn+0x30e/0x840 [ 8380.627986][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8380.628282][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8380.628574][ C1] kthread+0x292/0x360 [ 8380.628793][ C1] ? __pfx_kthread+0x10/0x10 [ 8380.629038][ C1] ret_from_fork+0x34/0x70 [ 8380.629281][ C1] ? __pfx_kthread+0x10/0x10 [ 8380.629530][ C1] ret_from_fork_asm+0x1b/0x30 [ 8380.629794][ C1] [ 8404.191023][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8404.191406][ C0] rcu: 0-....: (7153537 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1703792 [ 8404.191923][ C0] rcu: (t=7209882 jiffies g=1007429 q=31 ncpus=4) [ 8404.192267][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8404.192750][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8404.193387][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8404.193729][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8404.194740][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8404.195060][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8404.195477][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8404.195902][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8404.196320][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8404.196740][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8404.197163][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8404.197636][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8404.197983][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8404.198409][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8404.198828][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8404.199246][ C0] Call Trace: [ 8404.199423][ C0] [ 8404.199578][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8404.199865][ C0] ? print_cpu_stall+0x263/0x6a0 [ 8404.200128][ C0] ? check_cpu_stall+0x284/0x500 [ 8404.200394][ C0] ? rcu_pending+0x92/0x360 [ 8404.200633][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8404.200912][ C0] ? update_process_times+0xb9/0x110 [ 8404.201197][ C0] ? tick_sched_handle+0x67/0x130 [ 8404.201464][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8404.201761][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8404.202016][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8404.202344][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8404.202631][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8404.202934][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8404.203215][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8404.203539][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8404.203811][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8404.204089][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8404.204412][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8404.204720][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8404.205050][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8404.205352][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8404.205659][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8404.205970][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8404.206293][ C0] ? get_stack_info+0x36/0xc0 [ 8404.206547][ C0] ? lock_acquire+0x1c1/0x220 [ 8404.206799][ C0] ? lock_release+0x1d5/0x250 [ 8404.207050][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8404.207313][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8404.207601][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8404.207902][ C0] ? lock_acquire+0x1c1/0x220 [ 8404.208150][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8404.208402][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8404.208673][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8404.208921][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8404.209181][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8404.209453][ C0] ? __inet_lookup_established+0x341/0x610 [ 8404.209765][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8404.210051][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8404.210339][ C0] ip_local_deliver+0x19d/0x480 [ 8404.210603][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8404.210891][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8404.211157][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8404.211433][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8404.211694][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8404.212031][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8404.212304][ C0] ip_rcv+0x564/0x740 [ 8404.212515][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8404.212754][ C0] ? set_track_prepare+0x8a/0xd0 [ 8404.213016][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8404.213304][ C0] ? rest_init+0x153/0x260 [ 8404.213539][ C0] ? skb_clone+0x10b/0x330 [ 8404.213779][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8404.214111][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8404.214427][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8404.214724][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8404.215035][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8404.215294][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8404.215538][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8404.215860][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8404.216159][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8404.216502][ C0] ? lock_acquire+0x1c1/0x220 [ 8404.216753][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8404.217065][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8404.217362][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8404.217695][ C0] ? __copy_skb_header+0xaf/0x490 [ 8404.217964][ C0] ? __skb_clone+0x57a/0x760 [ 8404.218214][ C0] netif_receive_skb+0x55/0x280 [ 8404.218470][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8404.218792][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8404.219139][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8404.219454][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8404.219740][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8404.220038][ C0] ? hlock_class+0x4e/0x130 [ 8404.220281][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8404.220608][ C0] ? place_entity+0x21/0x2f0 [ 8404.220854][ C0] ? resched_curr+0x219/0x280 [ 8404.221107][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8404.221377][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8404.221661][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8404.221937][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8404.222195][ C0] ? activate_task+0xf5/0x260 [ 8404.222445][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8404.222717][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8404.222996][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8404.223250][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8404.223537][ C0] ? get_stack_info+0x36/0xc0 [ 8404.223792][ C0] ? stack_access_ok+0xda/0x1f0 [ 8404.224055][ C0] ? get_reg+0x119/0x190 [ 8404.224282][ C0] __tcf_classify+0x32c/0x7d0 [ 8404.224530][ C0] tcf_classify+0x283/0x930 [ 8404.224768][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8404.225094][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8404.225362][ C0] ? arch_stack_walk+0x8c/0x100 [ 8404.225627][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8404.225929][ C0] tc_run+0x2e4/0x5d0 [ 8404.226149][ C0] ? __pfx_tc_run+0x10/0x10 [ 8404.226394][ C0] ? lock_acquire+0x1c1/0x220 [ 8404.226647][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8404.226922][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8404.227187][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8404.227475][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8404.227753][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8404.228074][ C0] ? neigh_hh_output+0x348/0x590 [ 8404.228335][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8404.228614][ C0] ip_finish_output2+0x786/0x18e0 [ 8404.228885][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8404.229179][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8404.229527][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8404.229813][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8404.230082][ C0] ? __ip_finish_output+0x10f/0x770 [ 8404.230358][ C0] ip_output+0x16b/0x4f0 [ 8404.230583][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8404.230865][ C0] ? __pfx_ip_output+0x10/0x10 [ 8404.231116][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8404.231417][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8404.231678][ C0] ? ip_local_out+0x114/0x3b0 [ 8404.231931][ C0] __ip_queue_xmit+0x672/0x1910 [ 8404.232192][ C0] ? __skb_clone+0x57a/0x760 [ 8404.232439][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8404.232717][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8404.233010][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8404.233333][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8404.233594][ C0] ? tcp_current_mss+0x40a/0x510 [ 8404.233856][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8404.234137][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8404.234410][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8404.234663][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8404.234931][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8404.235251][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8404.235525][ C0] ? ktime_get+0xb6/0x190 [ 8404.235754][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8404.236031][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8404.236310][ C0] tcp_write_timer+0x82/0x1d0 [ 8404.236561][ C0] call_timer_fn+0x176/0x430 [ 8404.236809][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8404.237082][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8404.237356][ C0] __run_timers.part.0+0x52d/0x890 [ 8404.237628][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8404.237913][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8404.238209][ C0] ? lock_acquire+0x1c1/0x220 [ 8404.238459][ C0] ? clockevents_program_event+0xf6/0x300 [ 8404.238765][ C0] ? lock_release+0x1d5/0x250 [ 8404.239019][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8404.239297][ C0] ? ktime_get+0xb6/0x190 [ 8404.239530][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8404.239831][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8404.240141][ C0] run_timer_softirq+0x72/0x100 [ 8404.240403][ C0] __do_softirq+0x1bc/0x7ff [ 8404.240650][ C0] irq_exit_rcu+0x98/0xc0 [ 8404.240881][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8404.241187][ C0] [ 8404.241343][ C0] [ 8404.241499][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8404.241818][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8404.242090][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8404.243111][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8404.243438][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8404.243857][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8404.244278][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8404.244701][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8404.245128][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8404.245549][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8404.245862][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8404.246135][ C0] default_idle_call+0x69/0xa0 [ 8404.246390][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8404.246651][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8404.246951][ C0] ? lock_release+0x1d5/0x250 [ 8404.247202][ C0] do_idle+0xfb/0x160 [ 8404.247420][ C0] cpu_startup_entry+0x55/0x60 [ 8404.247674][ C0] rest_init+0x153/0x260 [ 8404.247900][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8404.248187][ C0] arch_call_rest_init+0x13/0x40 [ 8404.248451][ C0] start_kernel+0x314/0x3d0 [ 8404.248697][ C0] x86_64_start_reservations+0x18/0x30 [ 8404.248989][ C0] x86_64_start_kernel+0xba/0x110 [ 8404.249255][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8404.249577][ C0] [ 8404.249740][ C0] Sending NMI from CPU 0 to CPUs 1: [ 8404.250027][ C1] NMI backtrace for cpu 1 [ 8404.250033][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8404.250039][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8404.250041][ C1] RIP: 0010:rcu_is_watching+0xc/0x70 [ 8404.250050][ C1] Code: 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 53 65 ff 05 cc 95 a9 71 <48> c7 c3 20 75 1f 00 48 b8 00 00 00 00 00 fc ff df 65 48 03 1d 0b [ 8404.250053][ C1] RSP: 0018:ffffc900001c8cc0 EFLAGS: 00000003 [ 8404.250056][ C1] RAX: 0000000000000001 RBX: 0000000000000001 RCX: ffffffff8e6e3a4e [ 8404.250058][ C1] RDX: fffffbfff251bf93 RSI: 0000000000000008 RDI: ffffffff928dfc90 [ 8404.250060][ C1] RBP: ffffffff91f80018 R08: 0000000000000000 R09: fffffbfff251bf92 [ 8404.250062][ C1] R10: ffffffff928dfc97 R11: ffffc900001c8ff8 R12: ffffffff8e7cd6be [ 8404.250064][ C1] R13: 0000000000000000 R14: 00000000000f4240 R15: 001dcd6500000000 [ 8404.250066][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8404.250069][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8404.250073][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8404.250074][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8404.250076][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8404.250077][ C1] Call Trace: [ 8404.250080][ C1] [ 8404.250083][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 8404.250089][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8404.250094][ C1] ? nmi_handle+0x156/0x420 [ 8404.250098][ C1] ? default_do_nmi+0x41/0x100 [ 8404.250102][ C1] ? exc_nmi+0xf3/0x120 [ 8404.250104][ C1] ? end_repeat_nmi+0xf/0x60 [ 8404.250108][ C1] ? timekeeping_advance+0x40e/0x5c0 [ 8404.250112][ C1] ? lock_release+0x3e/0x250 [ 8404.250116][ C1] ? rcu_is_watching+0xc/0x70 [ 8404.250120][ C1] ? rcu_is_watching+0xc/0x70 [ 8404.250123][ C1] ? rcu_is_watching+0xc/0x70 [ 8404.250126][ C1] [ 8404.250127][ C1] [ 8404.250128][ C1] lock_release+0x1d5/0x250 [ 8404.250132][ C1] _raw_spin_unlock_irqrestore+0x1f/0x70 [ 8404.250136][ C1] timekeeping_advance+0x40e/0x5c0 [ 8404.250140][ C1] ? __pfx_timekeeping_advance+0x10/0x10 [ 8404.250143][ C1] ? lock_acquire+0x1c1/0x220 [ 8404.250146][ C1] ? do_raw_spin_unlock+0x58/0x220 [ 8404.250150][ C1] update_wall_time+0x10/0x20 [ 8404.250154][ C1] tick_sched_do_timer+0x1f2/0x270 [ 8404.250158][ C1] tick_nohz_highres_handler+0x32/0xd0 [ 8404.250162][ C1] __run_hrtimer+0x1c3/0x710 [ 8404.250165][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8404.250168][ C1] __hrtimer_run_queues+0x197/0x270 [ 8404.250172][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8404.250175][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8404.250179][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8404.250184][ C1] hrtimer_interrupt+0x2c3/0x770 [ 8404.250189][ C1] __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8404.250194][ C1] sysvec_apic_timer_interrupt+0x70/0x80 [ 8404.250197][ C1] [ 8404.250198][ C1] [ 8404.250199][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8404.250204][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8404.250208][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8404.250211][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8404.250213][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8404.250215][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8404.250216][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8404.250218][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8404.250220][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8404.250223][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8404.250227][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8404.250230][ C1] ? run_ksoftirqd+0xb/0x60 [ 8404.250235][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8404.250238][ C1] ? __orc_find+0x9c/0xf0 [ 8404.250240][ C1] ? lock_acquire+0x1c1/0x220 [ 8404.250243][ C1] ? irqentry_enter+0x2b/0x60 [ 8404.250248][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8404.250251][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8404.250254][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8404.250257][ C1] ? lock_acquire+0x1c1/0x220 [ 8404.250260][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8404.250264][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8404.250267][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8404.250275][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8404.250277][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8404.250283][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8404.250289][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8404.250293][ C1] ip_local_deliver+0x19d/0x480 [ 8404.250296][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8404.250299][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8404.250302][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8404.250306][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8404.250309][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8404.250313][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8404.250323][ C1] ip_rcv+0x564/0x740 [ 8404.250326][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8404.250329][ C1] ? set_track_prepare+0x8a/0xd0 [ 8404.250333][ C1] ? irqentry_enter+0x2b/0x60 [ 8404.250336][ C1] ? irqentry_enter+0x2b/0x60 [ 8404.250340][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8404.250342][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8404.250346][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8404.250350][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8404.250352][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8404.250355][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8404.250358][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8404.250363][ C1] netif_receive_skb+0x55/0x280 [ 8404.250366][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8404.250374][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8404.250381][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8404.250388][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8404.250394][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8404.250405][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8404.250415][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8404.250418][ C1] ? arch_stack_walk+0x68/0x100 [ 8404.250422][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8404.250425][ C1] ? irqentry_enter+0x2b/0x60 [ 8404.250429][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8404.250433][ C1] ? irqentry_enter+0x2b/0x60 [ 8404.250437][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8404.250444][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8404.250447][ C1] ? arch_stack_walk+0x68/0x100 [ 8404.250451][ C1] __tcf_classify+0x32c/0x7d0 [ 8404.250456][ C1] tcf_classify+0x283/0x930 [ 8404.250459][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8404.250464][ C1] tc_run+0x2e4/0x5d0 [ 8404.250468][ C1] ? __pfx_tc_run+0x10/0x10 [ 8404.250473][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8404.250479][ C1] ? irqentry_enter+0x2b/0x60 [ 8404.250482][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8404.250485][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8404.250492][ C1] ip_finish_output2+0x786/0x18e0 [ 8404.250497][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8404.250500][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8404.250504][ C1] ? __ip_finish_output+0x10f/0x770 [ 8404.250508][ C1] ip_output+0x16b/0x4f0 [ 8404.250511][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8404.250515][ C1] ? __pfx_ip_output+0x10/0x10 [ 8404.250519][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8404.250526][ C1] ? __pfx_ip_output+0x10/0x10 [ 8404.250531][ C1] __ip_queue_xmit+0x672/0x1910 [ 8404.250536][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8404.250543][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8404.250548][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8404.250552][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8404.250556][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8404.250559][ C1] tcp_delack_timer+0x84/0x240 [ 8404.250562][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8404.250565][ C1] call_timer_fn+0x176/0x430 [ 8404.250570][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8404.250575][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8404.250579][ C1] __run_timers.part.0+0x52d/0x890 [ 8404.250582][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8404.250587][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8404.250592][ C1] ? __pfx___schedule+0x10/0x10 [ 8404.250596][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8404.250601][ C1] run_timer_softirq+0x72/0x100 [ 8404.250605][ C1] __do_softirq+0x1bc/0x7ff [ 8404.250609][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8404.250613][ C1] run_ksoftirqd+0x2e/0x60 [ 8404.250616][ C1] smpboot_thread_fn+0x30e/0x840 [ 8404.250621][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8404.250624][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8404.250627][ C1] kthread+0x292/0x360 [ 8404.250630][ C1] ? __pfx_kthread+0x10/0x10 [ 8404.250633][ C1] ret_from_fork+0x34/0x70 [ 8404.250636][ C1] ? __pfx_kthread+0x10/0x10 [ 8404.250638][ C1] ret_from_fork_asm+0x1b/0x30 [ 8404.250645][ C1] [ 8428.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6743s! [swapper/0:0] [ 8428.527916][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8428.529124][ C0] irq event stamp: 27567077 [ 8428.529367][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8428.529901][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8428.530370][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8428.530875][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8428.531368][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8428.531847][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8428.532494][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8428.532839][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8428.533862][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8428.534188][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8428.534608][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8428.535031][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8428.535454][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8428.535881][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8428.536296][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8428.536760][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8428.537110][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8428.537528][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8428.537946][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8428.538369][ C0] Call Trace: [ 8428.538555][ C0] [ 8428.538710][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8428.538985][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8428.539240][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8428.539527][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8428.539817][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8428.540125][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8428.540406][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8428.540726][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8428.541001][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8428.541279][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8428.541598][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8428.541906][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8428.542237][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8428.542539][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8428.542847][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8428.543152][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8428.543481][ C0] ? get_stack_info+0x36/0xc0 [ 8428.543733][ C0] ? lock_acquire+0x1c1/0x220 [ 8428.543985][ C0] ? lock_release+0x1d5/0x250 [ 8428.544235][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8428.544494][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8428.544776][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8428.545073][ C0] ? lock_acquire+0x1c1/0x220 [ 8428.545327][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8428.545583][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8428.545872][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8428.546122][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8428.546384][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8428.546653][ C0] ? __inet_lookup_established+0x341/0x610 [ 8428.546977][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8428.547265][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8428.547554][ C0] ip_local_deliver+0x19d/0x480 [ 8428.547813][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8428.548098][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8428.548364][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8428.548638][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8428.548900][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8428.549237][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8428.549509][ C0] ip_rcv+0x564/0x740 [ 8428.549721][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8428.549960][ C0] ? set_track_prepare+0x8a/0xd0 [ 8428.550223][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8428.550525][ C0] ? rest_init+0x153/0x260 [ 8428.550764][ C0] ? skb_clone+0x10b/0x330 [ 8428.551006][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8428.551339][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8428.551660][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8428.551958][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8428.552267][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8428.552532][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8428.552775][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8428.553091][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8428.553390][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8428.553729][ C0] ? lock_acquire+0x1c1/0x220 [ 8428.553977][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8428.554285][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8428.554584][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8428.554911][ C0] ? __copy_skb_header+0xaf/0x490 [ 8428.555181][ C0] ? __skb_clone+0x57a/0x760 [ 8428.555427][ C0] netif_receive_skb+0x55/0x280 [ 8428.555688][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8428.556035][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8428.556386][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8428.556696][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8428.556984][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8428.557288][ C0] ? hlock_class+0x4e/0x130 [ 8428.557536][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8428.557868][ C0] ? place_entity+0x21/0x2f0 [ 8428.558117][ C0] ? resched_curr+0x219/0x280 [ 8428.558367][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8428.558633][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8428.558910][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8428.559188][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8428.559446][ C0] ? activate_task+0xf5/0x260 [ 8428.559697][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8428.559973][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8428.560244][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8428.560509][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8428.560801][ C0] ? get_stack_info+0x36/0xc0 [ 8428.561052][ C0] ? stack_access_ok+0xda/0x1f0 [ 8428.561308][ C0] ? get_reg+0x119/0x190 [ 8428.561535][ C0] __tcf_classify+0x32c/0x7d0 [ 8428.561791][ C0] tcf_classify+0x283/0x930 [ 8428.562035][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8428.562366][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8428.562630][ C0] ? arch_stack_walk+0x8c/0x100 [ 8428.562889][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8428.563176][ C0] tc_run+0x2e4/0x5d0 [ 8428.563394][ C0] ? __pfx_tc_run+0x10/0x10 [ 8428.563638][ C0] ? lock_acquire+0x1c1/0x220 [ 8428.563888][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8428.564164][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8428.564428][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8428.564714][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8428.564992][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8428.565314][ C0] ? neigh_hh_output+0x348/0x590 [ 8428.565577][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8428.565873][ C0] ip_finish_output2+0x786/0x18e0 [ 8428.566139][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8428.566428][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8428.566786][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8428.567077][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8428.567339][ C0] ? __ip_finish_output+0x10f/0x770 [ 8428.567618][ C0] ip_output+0x16b/0x4f0 [ 8428.567845][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8428.568126][ C0] ? __pfx_ip_output+0x10/0x10 [ 8428.568386][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8428.568685][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8428.568949][ C0] ? ip_local_out+0x114/0x3b0 [ 8428.569196][ C0] __ip_queue_xmit+0x672/0x1910 [ 8428.569454][ C0] ? __skb_clone+0x57a/0x760 [ 8428.569699][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8428.569982][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8428.570280][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8428.570599][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8428.570852][ C0] ? tcp_current_mss+0x40a/0x510 [ 8428.571118][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8428.571397][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8428.571676][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8428.571931][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8428.572195][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8428.572514][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8428.572793][ C0] ? ktime_get+0xb6/0x190 [ 8428.573027][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8428.573302][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8428.573581][ C0] tcp_write_timer+0x82/0x1d0 [ 8428.573836][ C0] call_timer_fn+0x176/0x430 [ 8428.574085][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8428.574356][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8428.574632][ C0] __run_timers.part.0+0x52d/0x890 [ 8428.574902][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8428.575186][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8428.575481][ C0] ? lock_acquire+0x1c1/0x220 [ 8428.575738][ C0] ? clockevents_program_event+0xf6/0x300 [ 8428.576044][ C0] ? lock_release+0x1d5/0x250 [ 8428.576293][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8428.576569][ C0] ? ktime_get+0xb6/0x190 [ 8428.576799][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8428.577096][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8428.577407][ C0] run_timer_softirq+0x72/0x100 [ 8428.577662][ C0] __do_softirq+0x1bc/0x7ff [ 8428.577902][ C0] irq_exit_rcu+0x98/0xc0 [ 8428.578134][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8428.578431][ C0] [ 8428.578590][ C0] [ 8428.578750][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8428.579074][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8428.579343][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8428.580354][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8428.580685][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8428.581099][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8428.581513][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8428.581927][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8428.582340][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8428.582754][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8428.583054][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8428.583325][ C0] default_idle_call+0x69/0xa0 [ 8428.583581][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8428.583842][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8428.584134][ C0] ? lock_release+0x1d5/0x250 [ 8428.584381][ C0] do_idle+0xfb/0x160 [ 8428.584593][ C0] cpu_startup_entry+0x55/0x60 [ 8428.584844][ C0] rest_init+0x153/0x260 [ 8428.585073][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8428.585356][ C0] arch_call_rest_init+0x13/0x40 [ 8428.585619][ C0] start_kernel+0x314/0x3d0 [ 8428.585869][ C0] x86_64_start_reservations+0x18/0x30 [ 8428.586158][ C0] x86_64_start_kernel+0xba/0x110 [ 8428.586429][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8428.586755][ C0] [ 8428.586925][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6743s! [ksoftirqd/1:22] [ 8428.587391][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8428.588601][ C1] irq event stamp: 3886976 [ 8428.588843][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8428.589343][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8428.589841][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8428.590343][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8428.590844][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8428.591341][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8428.591990][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8428.592340][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8428.593374][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8428.593702][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8428.594134][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8428.594559][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8428.594981][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8428.595410][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8428.595843][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8428.596316][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8428.596670][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8428.597096][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8428.597524][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8428.597947][ C1] Call Trace: [ 8428.598127][ C1] [ 8428.598287][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8428.598565][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8428.598824][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8428.599116][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8428.599406][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8428.599714][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8428.599999][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8428.600325][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8428.600602][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8428.600929][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8428.601246][ C1] [ 8428.601403][ C1] [ 8428.601561][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8428.601891][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8428.602200][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8428.602514][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8428.602816][ C1] ? run_ksoftirqd+0xb/0x60 [ 8428.603061][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8428.603386][ C1] ? __orc_find+0x9c/0xf0 [ 8428.603621][ C1] ? lock_acquire+0x1c1/0x220 [ 8428.603875][ C1] ? irqentry_enter+0x2b/0x60 [ 8428.604129][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8428.604393][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8428.604682][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8428.604985][ C1] ? lock_acquire+0x1c1/0x220 [ 8428.605235][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8428.605488][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8428.605770][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8428.606017][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8428.606276][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8428.606546][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8428.606836][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8428.607128][ C1] ip_local_deliver+0x19d/0x480 [ 8428.607390][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8428.607677][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8428.607945][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8428.608223][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8428.608488][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8428.608828][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8428.609103][ C1] ip_rcv+0x564/0x740 [ 8428.609321][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8428.609563][ C1] ? set_track_prepare+0x8a/0xd0 [ 8428.609831][ C1] ? irqentry_enter+0x2b/0x60 [ 8428.610090][ C1] ? irqentry_enter+0x2b/0x60 [ 8428.610348][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8428.610595][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8428.610913][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8428.611258][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8428.611573][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8428.611913][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8428.612213][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8428.612555][ C1] netif_receive_skb+0x55/0x280 [ 8428.612818][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8428.613152][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8428.613507][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8428.613821][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8428.614114][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8428.614420][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8428.614755][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8428.615040][ C1] ? arch_stack_walk+0x68/0x100 [ 8428.615300][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8428.615579][ C1] ? irqentry_enter+0x2b/0x60 [ 8428.615845][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8428.616167][ C1] ? irqentry_enter+0x2b/0x60 [ 8428.616415][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8428.616735][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8428.617018][ C1] ? arch_stack_walk+0x68/0x100 [ 8428.617279][ C1] __tcf_classify+0x32c/0x7d0 [ 8428.617530][ C1] tcf_classify+0x283/0x930 [ 8428.617772][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8428.618040][ C1] tc_run+0x2e4/0x5d0 [ 8428.618255][ C1] ? __pfx_tc_run+0x10/0x10 [ 8428.618496][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8428.618762][ C1] ? irqentry_enter+0x2b/0x60 [ 8428.619017][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8428.619306][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8428.619631][ C1] ip_finish_output2+0x786/0x18e0 [ 8428.619900][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8428.620190][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8428.620456][ C1] ? __ip_finish_output+0x10f/0x770 [ 8428.620733][ C1] ip_output+0x16b/0x4f0 [ 8428.620960][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8428.621280][ C1] ? __pfx_ip_output+0x10/0x10 [ 8428.621535][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8428.621892][ C1] ? __pfx_ip_output+0x10/0x10 [ 8428.622150][ C1] __ip_queue_xmit+0x672/0x1910 [ 8428.622408][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8428.622686][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8428.622983][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8428.623268][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8428.623563][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8428.623850][ C1] tcp_delack_timer+0x84/0x240 [ 8428.624106][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8428.624396][ C1] call_timer_fn+0x176/0x430 [ 8428.624648][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8428.624921][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8428.625202][ C1] __run_timers.part.0+0x52d/0x890 [ 8428.625477][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8428.625772][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8428.626077][ C1] ? __pfx___schedule+0x10/0x10 [ 8428.626337][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8428.626660][ C1] run_timer_softirq+0x72/0x100 [ 8428.626923][ C1] __do_softirq+0x1bc/0x7ff [ 8428.627171][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8428.627447][ C1] run_ksoftirqd+0x2e/0x60 [ 8428.627684][ C1] smpboot_thread_fn+0x30e/0x840 [ 8428.627950][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8428.628239][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8428.628537][ C1] kthread+0x292/0x360 [ 8428.628755][ C1] ? __pfx_kthread+0x10/0x10 [ 8428.629004][ C1] ret_from_fork+0x34/0x70 [ 8428.629243][ C1] ? __pfx_kthread+0x10/0x10 [ 8428.629490][ C1] ret_from_fork_asm+0x1b/0x30 [ 8428.629748][ C1] [ 8456.527459][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6769s! [swapper/0:0] [ 8456.527930][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8456.529136][ C0] irq event stamp: 27567077 [ 8456.529379][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8456.529911][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8456.530389][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8456.530890][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8456.531382][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8456.531860][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8456.532511][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8456.532856][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8456.533885][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8456.534210][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8456.534635][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8456.535061][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8456.535480][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8456.535913][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8456.536328][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8456.536797][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8456.537148][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8456.537568][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8456.537992][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8456.538421][ C0] Call Trace: [ 8456.538602][ C0] [ 8456.538760][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8456.539034][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8456.539294][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8456.539585][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8456.539876][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8456.540179][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8456.540460][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8456.540788][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8456.541060][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8456.541337][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8456.541660][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8456.541969][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8456.542302][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8456.542608][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8456.542916][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8456.543220][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8456.543550][ C0] ? get_stack_info+0x36/0xc0 [ 8456.543800][ C0] ? lock_acquire+0x1c1/0x220 [ 8456.544049][ C0] ? lock_release+0x1d5/0x250 [ 8456.544297][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8456.544555][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8456.544838][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8456.545137][ C0] ? lock_acquire+0x1c1/0x220 [ 8456.545391][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8456.545650][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8456.545921][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8456.546169][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8456.546429][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8456.546700][ C0] ? __inet_lookup_established+0x341/0x610 [ 8456.547013][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8456.547300][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8456.547587][ C0] ip_local_deliver+0x19d/0x480 [ 8456.547848][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8456.548137][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8456.548405][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8456.548681][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8456.548947][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8456.549285][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8456.549559][ C0] ip_rcv+0x564/0x740 [ 8456.549774][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8456.550015][ C0] ? set_track_prepare+0x8a/0xd0 [ 8456.550283][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8456.550573][ C0] ? rest_init+0x153/0x260 [ 8456.550810][ C0] ? skb_clone+0x10b/0x330 [ 8456.551050][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8456.551380][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8456.551697][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8456.551992][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8456.552305][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8456.552567][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8456.552812][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8456.553127][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8456.553428][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8456.553770][ C0] ? lock_acquire+0x1c1/0x220 [ 8456.554020][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8456.554327][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8456.554628][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8456.554958][ C0] ? __copy_skb_header+0xaf/0x490 [ 8456.555225][ C0] ? __skb_clone+0x57a/0x760 [ 8456.555468][ C0] netif_receive_skb+0x55/0x280 [ 8456.555733][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8456.556059][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8456.556404][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8456.556722][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8456.557009][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8456.557308][ C0] ? hlock_class+0x4e/0x130 [ 8456.557554][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8456.557881][ C0] ? place_entity+0x21/0x2f0 [ 8456.558125][ C0] ? resched_curr+0x219/0x280 [ 8456.558377][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8456.558649][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8456.558933][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8456.559209][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8456.559465][ C0] ? activate_task+0xf5/0x260 [ 8456.559716][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8456.559989][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8456.560264][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8456.560524][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8456.560811][ C0] ? get_stack_info+0x36/0xc0 [ 8456.561063][ C0] ? stack_access_ok+0xda/0x1f0 [ 8456.561323][ C0] ? get_reg+0x119/0x190 [ 8456.561555][ C0] __tcf_classify+0x32c/0x7d0 [ 8456.561804][ C0] tcf_classify+0x283/0x930 [ 8456.562045][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8456.562372][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8456.562640][ C0] ? arch_stack_walk+0x8c/0x100 [ 8456.562903][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8456.563196][ C0] tc_run+0x2e4/0x5d0 [ 8456.563412][ C0] ? __pfx_tc_run+0x10/0x10 [ 8456.563655][ C0] ? lock_acquire+0x1c1/0x220 [ 8456.563903][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8456.564177][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8456.564446][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8456.564731][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8456.565007][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8456.565324][ C0] ? neigh_hh_output+0x348/0x590 [ 8456.565589][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8456.565876][ C0] ip_finish_output2+0x786/0x18e0 [ 8456.566146][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8456.566441][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8456.566792][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8456.567079][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8456.567346][ C0] ? __ip_finish_output+0x10f/0x770 [ 8456.567622][ C0] ip_output+0x16b/0x4f0 [ 8456.567847][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8456.568134][ C0] ? __pfx_ip_output+0x10/0x10 [ 8456.568388][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8456.568689][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8456.568953][ C0] ? ip_local_out+0x114/0x3b0 [ 8456.569213][ C0] __ip_queue_xmit+0x672/0x1910 [ 8456.569476][ C0] ? __skb_clone+0x57a/0x760 [ 8456.569724][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8456.570005][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8456.570301][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8456.570618][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8456.570879][ C0] ? tcp_current_mss+0x40a/0x510 [ 8456.571142][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8456.571424][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8456.571703][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8456.571958][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8456.572228][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8456.572550][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8456.572827][ C0] ? ktime_get+0xb6/0x190 [ 8456.573057][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8456.573328][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8456.573610][ C0] tcp_write_timer+0x82/0x1d0 [ 8456.573861][ C0] call_timer_fn+0x176/0x430 [ 8456.574109][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8456.574385][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8456.574656][ C0] __run_timers.part.0+0x52d/0x890 [ 8456.574930][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8456.575211][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8456.575514][ C0] ? lock_acquire+0x1c1/0x220 [ 8456.575774][ C0] ? clockevents_program_event+0xf6/0x300 [ 8456.576081][ C0] ? lock_release+0x1d5/0x250 [ 8456.576333][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8456.576611][ C0] ? ktime_get+0xb6/0x190 [ 8456.576843][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8456.577145][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8456.577455][ C0] run_timer_softirq+0x72/0x100 [ 8456.577719][ C0] __do_softirq+0x1bc/0x7ff [ 8456.577966][ C0] irq_exit_rcu+0x98/0xc0 [ 8456.578201][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8456.578503][ C0] [ 8456.578659][ C0] [ 8456.578816][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8456.579134][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8456.579407][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8456.580427][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8456.580752][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8456.581177][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8456.581597][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8456.582018][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8456.582446][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8456.582873][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8456.583177][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8456.583452][ C0] default_idle_call+0x69/0xa0 [ 8456.583707][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8456.583971][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8456.584261][ C0] ? lock_release+0x1d5/0x250 [ 8456.584516][ C0] do_idle+0xfb/0x160 [ 8456.584735][ C0] cpu_startup_entry+0x55/0x60 [ 8456.584997][ C0] rest_init+0x153/0x260 [ 8456.585222][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8456.585513][ C0] arch_call_rest_init+0x13/0x40 [ 8456.585797][ C0] start_kernel+0x314/0x3d0 [ 8456.586042][ C0] x86_64_start_reservations+0x18/0x30 [ 8456.586338][ C0] x86_64_start_kernel+0xba/0x110 [ 8456.586605][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8456.586931][ C0] [ 8456.587097][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6769s! [ksoftirqd/1:22] [ 8456.587560][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8456.588758][ C1] irq event stamp: 3886976 [ 8456.588996][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8456.589500][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8456.590002][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8456.590507][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8456.590998][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8456.591500][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8456.592157][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 8456.592465][ C1] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 8456.593652][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [ 8456.594087][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8456.594696][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8456.595314][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8456.595943][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8456.596555][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8456.597165][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8456.597847][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8456.598358][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8456.598969][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8456.599582][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8456.600195][ C1] Call Trace: [ 8456.600464][ C1] [ 8456.600690][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8456.601093][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8456.601465][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8456.601892][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8456.602319][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8456.602766][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8456.603163][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8456.603627][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8456.603948][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8456.604277][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8456.604587][ C1] [ 8456.604744][ C1] [ 8456.604900][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8456.605234][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8456.605539][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 8456.605845][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 8456.606145][ C1] ? run_ksoftirqd+0xb/0x60 [ 8456.606390][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8456.606714][ C1] ? __orc_find+0x9c/0xf0 [ 8456.606953][ C1] ? lock_acquire+0x1c1/0x220 [ 8456.607205][ C1] ? irqentry_enter+0x2b/0x60 [ 8456.607458][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8456.607720][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8456.608012][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8456.608319][ C1] ? lock_acquire+0x1c1/0x220 [ 8456.608567][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8456.608819][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8456.609114][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8456.609362][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8456.609622][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8456.609896][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8456.610191][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8456.610483][ C1] ip_local_deliver+0x19d/0x480 [ 8456.610740][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8456.611027][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8456.611291][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8456.611571][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8456.611843][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8456.612181][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8456.612457][ C1] ip_rcv+0x564/0x740 [ 8456.612677][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8456.612926][ C1] ? set_track_prepare+0x8a/0xd0 [ 8456.613193][ C1] ? irqentry_enter+0x2b/0x60 [ 8456.613443][ C1] ? irqentry_enter+0x2b/0x60 [ 8456.613693][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8456.613940][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8456.614251][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8456.614588][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8456.614894][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8456.615242][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8456.615542][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8456.615884][ C1] netif_receive_skb+0x55/0x280 [ 8456.616150][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8456.616478][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8456.616828][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8456.617144][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8456.617435][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8456.617737][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8456.618084][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8456.618367][ C1] ? arch_stack_walk+0x68/0x100 [ 8456.618626][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8456.618901][ C1] ? irqentry_enter+0x2b/0x60 [ 8456.619157][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8456.619474][ C1] ? irqentry_enter+0x2b/0x60 [ 8456.619728][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8456.620063][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8456.620342][ C1] ? arch_stack_walk+0x68/0x100 [ 8456.620606][ C1] __tcf_classify+0x32c/0x7d0 [ 8456.620860][ C1] tcf_classify+0x283/0x930 [ 8456.621111][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8456.621381][ C1] tc_run+0x2e4/0x5d0 [ 8456.621602][ C1] ? __pfx_tc_run+0x10/0x10 [ 8456.621850][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8456.622126][ C1] ? irqentry_enter+0x2b/0x60 [ 8456.622376][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8456.622664][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8456.622988][ C1] ip_finish_output2+0x786/0x18e0 [ 8456.623263][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8456.623554][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8456.623818][ C1] ? __ip_finish_output+0x10f/0x770 [ 8456.624104][ C1] ip_output+0x16b/0x4f0 [ 8456.624334][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8456.624650][ C1] ? __pfx_ip_output+0x10/0x10 [ 8456.624916][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8456.625266][ C1] ? __pfx_ip_output+0x10/0x10 [ 8456.625519][ C1] __ip_queue_xmit+0x672/0x1910 [ 8456.625787][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8456.626073][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8456.626364][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8456.626646][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8456.626952][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8456.627299][ C1] tcp_delack_timer+0x84/0x240 [ 8456.627638][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8456.628049][ C1] call_timer_fn+0x176/0x430 [ 8456.628402][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8456.628799][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8456.629206][ C1] __run_timers.part.0+0x52d/0x890 [ 8456.629605][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8456.630026][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8456.630466][ C1] ? __pfx___schedule+0x10/0x10 [ 8456.630844][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8456.631308][ C1] run_timer_softirq+0x72/0x100 [ 8456.631688][ C1] __do_softirq+0x1bc/0x7ff [ 8456.632042][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8456.632443][ C1] run_ksoftirqd+0x2e/0x60 [ 8456.632787][ C1] smpboot_thread_fn+0x30e/0x840 [ 8456.633172][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8456.633596][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8456.634021][ C1] kthread+0x292/0x360 [ 8456.634338][ C1] ? __pfx_kthread+0x10/0x10 [ 8456.634697][ C1] ret_from_fork+0x34/0x70 [ 8456.635047][ C1] ? __pfx_kthread+0x10/0x10 [ 8456.635407][ C1] ret_from_fork_asm+0x1b/0x30 [ 8456.635791][ C1] [ 8482.253024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8482.253504][ C1] rcu: 1-....: (7222567 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1723098 [ 8482.254252][ C1] rcu: (t=7287944 jiffies g=1007429 q=31 ncpus=4) [ 8482.254717][ C1] Sending NMI from CPU 1 to CPUs 0: [ 8482.255104][ C0] NMI backtrace for cpu 0 [ 8482.255111][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8482.255116][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8482.255119][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8482.255129][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8482.255132][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8482.255136][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8482.255138][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8482.255140][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8482.255142][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8482.255144][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8482.255146][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8482.255148][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8482.255152][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8482.255153][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8482.255155][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8482.255156][ C0] Call Trace: [ 8482.255160][ C0] [ 8482.255165][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 8482.255171][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8482.255176][ C0] ? nmi_handle+0x156/0x420 [ 8482.255181][ C0] ? default_do_nmi+0x41/0x100 [ 8482.255185][ C0] ? exc_nmi+0xf3/0x120 [ 8482.255187][ C0] ? end_repeat_nmi+0xf/0x60 [ 8482.255192][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8482.255196][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8482.255199][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8482.255203][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8482.255206][ C0] [ 8482.255207][ C0] [ 8482.255208][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8482.255211][ C0] ? get_stack_info+0x36/0xc0 [ 8482.255215][ C0] ? lock_acquire+0x1c1/0x220 [ 8482.255220][ C0] ? lock_release+0x1d5/0x250 [ 8482.255224][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8482.255228][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8482.255232][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8482.255235][ C0] ? lock_acquire+0x1c1/0x220 [ 8482.255237][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8482.255242][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8482.255245][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8482.255252][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8482.255255][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8482.255259][ C0] ? __inet_lookup_established+0x341/0x610 [ 8482.255264][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8482.255271][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8482.255275][ C0] ip_local_deliver+0x19d/0x480 [ 8482.255279][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8482.255281][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8482.255286][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8482.255290][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8482.255293][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8482.255297][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8482.255307][ C0] ip_rcv+0x564/0x740 [ 8482.255310][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8482.255313][ C0] ? set_track_prepare+0x8a/0xd0 [ 8482.255317][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8482.255320][ C0] ? rest_init+0x153/0x260 [ 8482.255322][ C0] ? skb_clone+0x10b/0x330 [ 8482.255327][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8482.255333][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8482.255338][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8482.255343][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8482.255352][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8482.255356][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8482.255358][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8482.255363][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8482.255366][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8482.255370][ C0] ? lock_acquire+0x1c1/0x220 [ 8482.255372][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8482.255376][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8482.255378][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8482.255382][ C0] ? __copy_skb_header+0xaf/0x490 [ 8482.255385][ C0] ? __skb_clone+0x57a/0x760 [ 8482.255388][ C0] netif_receive_skb+0x55/0x280 [ 8482.255390][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8482.255398][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8482.255405][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8482.255412][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8482.255417][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8482.255426][ C0] ? hlock_class+0x4e/0x130 [ 8482.255431][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8482.255441][ C0] ? place_entity+0x21/0x2f0 [ 8482.255444][ C0] ? resched_curr+0x219/0x280 [ 8482.255447][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8482.255450][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8482.255454][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8482.255458][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8482.255461][ C0] ? activate_task+0xf5/0x260 [ 8482.255464][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8482.255469][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8482.255472][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8482.255485][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8482.255489][ C0] ? get_stack_info+0x36/0xc0 [ 8482.255493][ C0] ? stack_access_ok+0xda/0x1f0 [ 8482.255496][ C0] ? get_reg+0x119/0x190 [ 8482.255500][ C0] __tcf_classify+0x32c/0x7d0 [ 8482.255505][ C0] tcf_classify+0x283/0x930 [ 8482.255508][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8482.255513][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8482.255515][ C0] ? arch_stack_walk+0x8c/0x100 [ 8482.255520][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8482.255524][ C0] tc_run+0x2e4/0x5d0 [ 8482.255528][ C0] ? __pfx_tc_run+0x10/0x10 [ 8482.255532][ C0] ? lock_acquire+0x1c1/0x220 [ 8482.255534][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8482.255539][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8482.255545][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8482.255548][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8482.255551][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8482.255557][ C0] ? neigh_hh_output+0x348/0x590 [ 8482.255562][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8482.255566][ C0] ip_finish_output2+0x786/0x18e0 [ 8482.255570][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8482.255575][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8482.255583][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8482.255586][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8482.255590][ C0] ? __ip_finish_output+0x10f/0x770 [ 8482.255594][ C0] ip_output+0x16b/0x4f0 [ 8482.255597][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8482.255603][ C0] ? __pfx_ip_output+0x10/0x10 [ 8482.255606][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8482.255610][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8482.255613][ C0] ? ip_local_out+0x114/0x3b0 [ 8482.255617][ C0] __ip_queue_xmit+0x672/0x1910 [ 8482.255621][ C0] ? __skb_clone+0x57a/0x760 [ 8482.255624][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8482.255631][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8482.255636][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8482.255640][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8482.255644][ C0] ? tcp_current_mss+0x40a/0x510 [ 8482.255648][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8482.255651][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8482.255653][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8482.255655][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8482.255658][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8482.255662][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8482.255666][ C0] ? ktime_get+0xb6/0x190 [ 8482.255670][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8482.255674][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8482.255677][ C0] tcp_write_timer+0x82/0x1d0 [ 8482.255681][ C0] call_timer_fn+0x176/0x430 [ 8482.255685][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8482.255690][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8482.255694][ C0] __run_timers.part.0+0x52d/0x890 [ 8482.255697][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8482.255702][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8482.255705][ C0] ? lock_acquire+0x1c1/0x220 [ 8482.255707][ C0] ? clockevents_program_event+0xf6/0x300 [ 8482.255712][ C0] ? lock_release+0x1d5/0x250 [ 8482.255715][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8482.255717][ C0] ? ktime_get+0xb6/0x190 [ 8482.255720][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8482.255724][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8482.255728][ C0] run_timer_softirq+0x72/0x100 [ 8482.255732][ C0] __do_softirq+0x1bc/0x7ff [ 8482.255737][ C0] irq_exit_rcu+0x98/0xc0 [ 8482.255739][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8482.255743][ C0] [ 8482.255744][ C0] [ 8482.255745][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8482.255750][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8482.255754][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8482.255756][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8482.255759][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8482.255761][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8482.255762][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8482.255764][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8482.255766][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8482.255769][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8482.255773][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8482.255777][ C0] default_idle_call+0x69/0xa0 [ 8482.255779][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8482.255782][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8482.255787][ C0] ? lock_release+0x1d5/0x250 [ 8482.255790][ C0] do_idle+0xfb/0x160 [ 8482.255793][ C0] cpu_startup_entry+0x55/0x60 [ 8482.255796][ C0] rest_init+0x153/0x260 [ 8482.255798][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8482.255804][ C0] arch_call_rest_init+0x13/0x40 [ 8482.255808][ C0] start_kernel+0x314/0x3d0 [ 8482.255812][ C0] x86_64_start_reservations+0x18/0x30 [ 8482.255817][ C0] x86_64_start_kernel+0xba/0x110 [ 8482.255820][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8482.255828][ C0] [ 8482.256100][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8482.319959][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8482.320610][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8482.320955][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8482.321974][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8482.322298][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8482.322715][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8482.323132][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8482.323548][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8482.323965][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8482.324386][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8482.324855][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8482.325209][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8482.325641][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8482.326060][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8482.326478][ C1] Call Trace: [ 8482.326653][ C1] [ 8482.326809][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8482.327148][ C1] ? print_cpu_stall+0x263/0x6a0 [ 8482.327413][ C1] ? check_cpu_stall+0x284/0x500 [ 8482.327754][ C1] ? rcu_pending+0x92/0x360 [ 8482.328029][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8482.328363][ C1] ? update_process_times+0xb9/0x110 [ 8482.328701][ C1] ? tick_sched_handle+0x67/0x130 [ 8482.329045][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8482.329447][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8482.329789][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8482.330227][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8482.330604][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8482.331018][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8482.331391][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8482.331818][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8482.332190][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8482.332610][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8482.333009][ C1] [ 8482.333220][ C1] [ 8482.333431][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8482.333851][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8482.334220][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8482.334534][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8482.334836][ C1] ? run_ksoftirqd+0xb/0x60 [ 8482.335079][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8482.335489][ C1] ? __orc_find+0x9c/0xf0 [ 8482.335722][ C1] ? lock_acquire+0x1c1/0x220 [ 8482.335971][ C1] ? irqentry_enter+0x2b/0x60 [ 8482.336233][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8482.336550][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8482.336922][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8482.337229][ C1] ? lock_acquire+0x1c1/0x220 [ 8482.337538][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8482.337856][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8482.338220][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8482.338552][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8482.338899][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8482.339264][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8482.339654][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8482.340048][ C1] ip_local_deliver+0x19d/0x480 [ 8482.340405][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8482.340797][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8482.341125][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8482.341483][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8482.341839][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8482.342286][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8482.342636][ C1] ip_rcv+0x564/0x740 [ 8482.342916][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8482.343226][ C1] ? set_track_prepare+0x8a/0xd0 [ 8482.343576][ C1] ? irqentry_enter+0x2b/0x60 [ 8482.343914][ C1] ? irqentry_enter+0x2b/0x60 [ 8482.344208][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8482.344454][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8482.344786][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8482.345147][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8482.345461][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8482.345817][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8482.346121][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8482.346455][ C1] netif_receive_skb+0x55/0x280 [ 8482.346716][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8482.347044][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8482.347393][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8482.347710][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8482.347998][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8482.348302][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8482.348630][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8482.348911][ C1] ? arch_stack_walk+0x68/0x100 [ 8482.349175][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8482.349455][ C1] ? irqentry_enter+0x2b/0x60 [ 8482.349709][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8482.350034][ C1] ? irqentry_enter+0x2b/0x60 [ 8482.350288][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8482.350615][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8482.350897][ C1] ? arch_stack_walk+0x68/0x100 [ 8482.351164][ C1] __tcf_classify+0x32c/0x7d0 [ 8482.351423][ C1] tcf_classify+0x283/0x930 [ 8482.351670][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8482.351944][ C1] tc_run+0x2e4/0x5d0 [ 8482.352162][ C1] ? __pfx_tc_run+0x10/0x10 [ 8482.352409][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8482.352678][ C1] ? irqentry_enter+0x2b/0x60 [ 8482.352926][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8482.353210][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8482.353530][ C1] ip_finish_output2+0x786/0x18e0 [ 8482.353804][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8482.354116][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8482.354448][ C1] ? __ip_finish_output+0x10f/0x770 [ 8482.354826][ C1] ip_output+0x16b/0x4f0 [ 8482.355054][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8482.355455][ C1] ? __pfx_ip_output+0x10/0x10 [ 8482.355792][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8482.356258][ C1] ? __pfx_ip_output+0x10/0x10 [ 8482.356609][ C1] __ip_queue_xmit+0x672/0x1910 [ 8482.356958][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8482.357340][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8482.357736][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8482.358126][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8482.358517][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8482.358902][ C1] tcp_delack_timer+0x84/0x240 [ 8482.359237][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8482.359614][ C1] call_timer_fn+0x176/0x430 [ 8482.359924][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8482.360297][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8482.360645][ C1] __run_timers.part.0+0x52d/0x890 [ 8482.360989][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8482.361280][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8482.361582][ C1] ? __pfx___schedule+0x10/0x10 [ 8482.361842][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8482.362226][ C1] run_timer_softirq+0x72/0x100 [ 8482.362492][ C1] __do_softirq+0x1bc/0x7ff [ 8482.362738][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8482.363016][ C1] run_ksoftirqd+0x2e/0x60 [ 8482.363303][ C1] smpboot_thread_fn+0x30e/0x840 [ 8482.363649][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8482.363972][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8482.364263][ C1] kthread+0x292/0x360 [ 8482.364535][ C1] ? __pfx_kthread+0x10/0x10 [ 8482.364840][ C1] ret_from_fork+0x34/0x70 [ 8482.365152][ C1] ? __pfx_kthread+0x10/0x10 [ 8482.365493][ C1] ret_from_fork_asm+0x1b/0x30 [ 8482.365786][ C1] [ 8508.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6818s! [swapper/0:0] [ 8508.527934][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8508.529142][ C0] irq event stamp: 27567077 [ 8508.529389][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8508.529926][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8508.530409][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8508.530915][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8508.531418][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8508.531906][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8508.532562][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8508.532914][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8508.533964][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8508.534294][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8508.534725][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8508.535156][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8508.535586][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8508.536008][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8508.536424][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8508.536893][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8508.537245][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8508.537668][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8508.538096][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8508.538518][ C0] Call Trace: [ 8508.538695][ C0] [ 8508.538855][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8508.539139][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8508.539396][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8508.539692][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8508.539985][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8508.540297][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8508.540582][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8508.540911][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8508.541189][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8508.541473][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8508.541805][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8508.542120][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8508.542461][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8508.542766][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8508.543085][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8508.543395][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8508.543733][ C0] ? get_stack_info+0x36/0xc0 [ 8508.543992][ C0] ? lock_acquire+0x1c1/0x220 [ 8508.544241][ C0] ? lock_release+0x1d5/0x250 [ 8508.544492][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8508.544758][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8508.545047][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8508.545346][ C0] ? lock_acquire+0x1c1/0x220 [ 8508.545612][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8508.545865][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8508.546139][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8508.546389][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8508.546658][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8508.546932][ C0] ? __inet_lookup_established+0x341/0x610 [ 8508.547254][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8508.547540][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8508.547828][ C0] ip_local_deliver+0x19d/0x480 [ 8508.548094][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8508.548387][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8508.548656][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8508.548935][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8508.549200][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8508.549540][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8508.549822][ C0] ip_rcv+0x564/0x740 [ 8508.550033][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8508.550274][ C0] ? set_track_prepare+0x8a/0xd0 [ 8508.550547][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8508.550841][ C0] ? rest_init+0x153/0x260 [ 8508.551085][ C0] ? skb_clone+0x10b/0x330 [ 8508.551333][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8508.551676][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8508.552005][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8508.552311][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8508.552635][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8508.552907][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8508.553158][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8508.553492][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8508.553800][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8508.554151][ C0] ? lock_acquire+0x1c1/0x220 [ 8508.554402][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8508.554717][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8508.555023][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8508.555363][ C0] ? __copy_skb_header+0xaf/0x490 [ 8508.555636][ C0] ? __skb_clone+0x57a/0x760 [ 8508.555885][ C0] netif_receive_skb+0x55/0x280 [ 8508.556147][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8508.556470][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8508.556819][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8508.557140][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8508.557429][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8508.557728][ C0] ? hlock_class+0x4e/0x130 [ 8508.557971][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8508.558304][ C0] ? place_entity+0x21/0x2f0 [ 8508.558550][ C0] ? resched_curr+0x219/0x280 [ 8508.558810][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8508.559080][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8508.559362][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8508.559647][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8508.559913][ C0] ? activate_task+0xf5/0x260 [ 8508.560164][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8508.560440][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8508.560730][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8508.560992][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8508.561282][ C0] ? get_stack_info+0x36/0xc0 [ 8508.561540][ C0] ? stack_access_ok+0xda/0x1f0 [ 8508.561810][ C0] ? get_reg+0x119/0x190 [ 8508.562044][ C0] __tcf_classify+0x32c/0x7d0 [ 8508.562297][ C0] tcf_classify+0x283/0x930 [ 8508.562539][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8508.562872][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8508.563149][ C0] ? arch_stack_walk+0x8c/0x100 [ 8508.563421][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8508.563718][ C0] tc_run+0x2e4/0x5d0 [ 8508.563940][ C0] ? __pfx_tc_run+0x10/0x10 [ 8508.564186][ C0] ? lock_acquire+0x1c1/0x220 [ 8508.564443][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8508.564720][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8508.565000][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8508.565291][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8508.565610][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8508.565932][ C0] ? neigh_hh_output+0x348/0x590 [ 8508.566201][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8508.566482][ C0] ip_finish_output2+0x786/0x18e0 [ 8508.566760][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8508.567056][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8508.567405][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8508.567697][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8508.567968][ C0] ? __ip_finish_output+0x10f/0x770 [ 8508.568246][ C0] ip_output+0x16b/0x4f0 [ 8508.568473][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8508.568760][ C0] ? __pfx_ip_output+0x10/0x10 [ 8508.569011][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8508.569316][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8508.569578][ C0] ? ip_local_out+0x114/0x3b0 [ 8508.569840][ C0] __ip_queue_xmit+0x672/0x1910 [ 8508.570107][ C0] ? __skb_clone+0x57a/0x760 [ 8508.570361][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8508.570639][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8508.570939][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8508.571264][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8508.571528][ C0] ? tcp_current_mss+0x40a/0x510 [ 8508.571800][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8508.572087][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8508.572365][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8508.572626][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8508.572901][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8508.573228][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8508.573513][ C0] ? ktime_get+0xb6/0x190 [ 8508.573744][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8508.574027][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8508.574316][ C0] tcp_write_timer+0x82/0x1d0 [ 8508.574567][ C0] call_timer_fn+0x176/0x430 [ 8508.574817][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8508.575101][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8508.575392][ C0] __run_timers.part.0+0x52d/0x890 [ 8508.575680][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8508.575966][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8508.576271][ C0] ? lock_acquire+0x1c1/0x220 [ 8508.576522][ C0] ? clockevents_program_event+0xf6/0x300 [ 8508.576828][ C0] ? lock_release+0x1d5/0x250 [ 8508.577082][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8508.577366][ C0] ? ktime_get+0xb6/0x190 [ 8508.577598][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8508.577897][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8508.578205][ C0] run_timer_softirq+0x72/0x100 [ 8508.578465][ C0] __do_softirq+0x1bc/0x7ff [ 8508.578716][ C0] irq_exit_rcu+0x98/0xc0 [ 8508.578957][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8508.579262][ C0] [ 8508.579418][ C0] [ 8508.579575][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8508.579900][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8508.580173][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8508.581208][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8508.581538][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8508.581968][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8508.582394][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8508.582826][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8508.583256][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8508.583683][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8508.583995][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8508.584277][ C0] default_idle_call+0x69/0xa0 [ 8508.584537][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8508.584807][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8508.585110][ C0] ? lock_release+0x1d5/0x250 [ 8508.585379][ C0] do_idle+0xfb/0x160 [ 8508.585600][ C0] cpu_startup_entry+0x55/0x60 [ 8508.585853][ C0] rest_init+0x153/0x260 [ 8508.586090][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8508.586375][ C0] arch_call_rest_init+0x13/0x40 [ 8508.586639][ C0] start_kernel+0x314/0x3d0 [ 8508.586884][ C0] x86_64_start_reservations+0x18/0x30 [ 8508.587183][ C0] x86_64_start_kernel+0xba/0x110 [ 8508.587457][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8508.587780][ C0] [ 8508.587952][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6818s! [ksoftirqd/1:22] [ 8508.588421][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8508.589634][ C1] irq event stamp: 3886976 [ 8508.589878][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8508.590386][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8508.590885][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8508.591390][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8508.591887][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8508.592383][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8508.593027][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8508.593371][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8508.594400][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8508.594723][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8508.595145][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8508.595578][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8508.596000][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8508.596425][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8508.596852][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8508.597330][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8508.597707][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8508.598139][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8508.598564][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8508.598983][ C1] Call Trace: [ 8508.599161][ C1] [ 8508.599316][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8508.599602][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8508.599860][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8508.600158][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8508.600447][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8508.600750][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8508.601028][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8508.601353][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8508.601631][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8508.601953][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8508.602266][ C1] [ 8508.602427][ C1] [ 8508.602590][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8508.602923][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8508.603230][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8508.603540][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8508.603849][ C1] ? run_ksoftirqd+0xb/0x60 [ 8508.604099][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8508.604429][ C1] ? __orc_find+0x9c/0xf0 [ 8508.604660][ C1] ? lock_acquire+0x1c1/0x220 [ 8508.604911][ C1] ? irqentry_enter+0x2b/0x60 [ 8508.605165][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8508.605438][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8508.605728][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8508.606036][ C1] ? lock_acquire+0x1c1/0x220 [ 8508.606288][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8508.606543][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8508.606819][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8508.607069][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8508.607332][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8508.607610][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8508.607905][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8508.608202][ C1] ip_local_deliver+0x19d/0x480 [ 8508.608463][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8508.608752][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8508.609017][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8508.609303][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8508.609572][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8508.609911][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8508.610192][ C1] ip_rcv+0x564/0x740 [ 8508.610411][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8508.610659][ C1] ? set_track_prepare+0x8a/0xd0 [ 8508.610931][ C1] ? irqentry_enter+0x2b/0x60 [ 8508.611185][ C1] ? irqentry_enter+0x2b/0x60 [ 8508.611439][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8508.611681][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8508.611997][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8508.612340][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8508.612652][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8508.613003][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8508.613309][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8508.613645][ C1] netif_receive_skb+0x55/0x280 [ 8508.613903][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8508.614233][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8508.614586][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8508.614907][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8508.615209][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8508.615540][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8508.615878][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8508.616164][ C1] ? arch_stack_walk+0x68/0x100 [ 8508.616426][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8508.616703][ C1] ? irqentry_enter+0x2b/0x60 [ 8508.616955][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8508.617275][ C1] ? irqentry_enter+0x2b/0x60 [ 8508.617529][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8508.617857][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8508.618140][ C1] ? arch_stack_walk+0x68/0x100 [ 8508.618404][ C1] __tcf_classify+0x32c/0x7d0 [ 8508.618659][ C1] tcf_classify+0x283/0x930 [ 8508.618908][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8508.619185][ C1] tc_run+0x2e4/0x5d0 [ 8508.619408][ C1] ? __pfx_tc_run+0x10/0x10 [ 8508.619657][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8508.619928][ C1] ? irqentry_enter+0x2b/0x60 [ 8508.620181][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8508.620468][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8508.620790][ C1] ip_finish_output2+0x786/0x18e0 [ 8508.621068][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8508.621363][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8508.621628][ C1] ? __ip_finish_output+0x10f/0x770 [ 8508.621910][ C1] ip_output+0x16b/0x4f0 [ 8508.622141][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8508.622459][ C1] ? __pfx_ip_output+0x10/0x10 [ 8508.622718][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8508.623073][ C1] ? __pfx_ip_output+0x10/0x10 [ 8508.623330][ C1] __ip_queue_xmit+0x672/0x1910 [ 8508.623595][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8508.623882][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8508.624180][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8508.624469][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8508.624770][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8508.625062][ C1] tcp_delack_timer+0x84/0x240 [ 8508.625323][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8508.625619][ C1] call_timer_fn+0x176/0x430 [ 8508.625871][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8508.626145][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8508.626428][ C1] __run_timers.part.0+0x52d/0x890 [ 8508.626704][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8508.626990][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8508.627293][ C1] ? __pfx___schedule+0x10/0x10 [ 8508.627557][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8508.627883][ C1] run_timer_softirq+0x72/0x100 [ 8508.628144][ C1] __do_softirq+0x1bc/0x7ff [ 8508.628389][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8508.628663][ C1] run_ksoftirqd+0x2e/0x60 [ 8508.628905][ C1] smpboot_thread_fn+0x30e/0x840 [ 8508.629172][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8508.629466][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8508.629755][ C1] kthread+0x292/0x360 [ 8508.629979][ C1] ? __pfx_kthread+0x10/0x10 [ 8508.630232][ C1] ret_from_fork+0x34/0x70 [ 8508.630473][ C1] ? __pfx_kthread+0x10/0x10 [ 8508.630717][ C1] ret_from_fork_asm+0x1b/0x30 [ 8508.630999][ C1] [ 8536.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6844s! [swapper/0:0] [ 8536.527944][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8536.529207][ C0] irq event stamp: 27567077 [ 8536.529454][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8536.529978][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8536.530460][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8536.530969][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8536.531465][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8536.531965][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8536.532631][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8536.532969][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8536.534035][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8536.534374][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8536.534810][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8536.535257][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8536.535699][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8536.536142][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8536.536587][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8536.537086][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8536.537449][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8536.537897][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8536.538340][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8536.538787][ C0] Call Trace: [ 8536.538974][ C0] [ 8536.539144][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8536.539434][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8536.539694][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8536.540008][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8536.540310][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8536.540633][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8536.540908][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8536.541226][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8536.541508][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8536.541782][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8536.542108][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8536.542424][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8536.542753][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8536.543058][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8536.543371][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8536.543672][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8536.543995][ C0] ? get_stack_info+0x36/0xc0 [ 8536.544254][ C0] ? lock_acquire+0x1c1/0x220 [ 8536.544507][ C0] ? lock_release+0x1d5/0x250 [ 8536.544762][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8536.545022][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8536.545324][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8536.545618][ C0] ? lock_acquire+0x1c1/0x220 [ 8536.545868][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8536.546122][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8536.546395][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8536.546638][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8536.546896][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8536.547161][ C0] ? __inet_lookup_established+0x341/0x610 [ 8536.547468][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8536.547756][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8536.548046][ C0] ip_local_deliver+0x19d/0x480 [ 8536.548300][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8536.548580][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8536.548844][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8536.549121][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8536.549387][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8536.549718][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8536.550013][ C0] ip_rcv+0x564/0x740 [ 8536.550240][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8536.550507][ C0] ? set_track_prepare+0x8a/0xd0 [ 8536.550777][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8536.551075][ C0] ? rest_init+0x153/0x260 [ 8536.551321][ C0] ? skb_clone+0x10b/0x330 [ 8536.551574][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8536.551928][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8536.552277][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8536.552587][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8536.552913][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8536.553195][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8536.553457][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8536.553789][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8536.554108][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8536.554470][ C0] ? lock_acquire+0x1c1/0x220 [ 8536.554730][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8536.555059][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8536.555382][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8536.555766][ C0] ? __copy_skb_header+0xaf/0x490 [ 8536.556047][ C0] ? __skb_clone+0x57a/0x760 [ 8536.556304][ C0] netif_receive_skb+0x55/0x280 [ 8536.556559][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8536.556899][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8536.557253][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8536.557570][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8536.557854][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8536.558159][ C0] ? hlock_class+0x4e/0x130 [ 8536.558406][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8536.558730][ C0] ? place_entity+0x21/0x2f0 [ 8536.558972][ C0] ? resched_curr+0x219/0x280 [ 8536.559239][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8536.559520][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8536.559827][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8536.560106][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8536.560370][ C0] ? activate_task+0xf5/0x260 [ 8536.560635][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8536.560925][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8536.561217][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8536.561489][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8536.561796][ C0] ? get_stack_info+0x36/0xc0 [ 8536.562055][ C0] ? stack_access_ok+0xda/0x1f0 [ 8536.562332][ C0] ? get_reg+0x119/0x190 [ 8536.562566][ C0] __tcf_classify+0x32c/0x7d0 [ 8536.562838][ C0] tcf_classify+0x283/0x930 [ 8536.563095][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8536.563444][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8536.563722][ C0] ? arch_stack_walk+0x8c/0x100 [ 8536.564003][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8536.564304][ C0] tc_run+0x2e4/0x5d0 [ 8536.564535][ C0] ? __pfx_tc_run+0x10/0x10 [ 8536.564794][ C0] ? lock_acquire+0x1c1/0x220 [ 8536.565063][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8536.565367][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8536.565642][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8536.565939][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8536.566231][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8536.566565][ C0] ? neigh_hh_output+0x348/0x590 [ 8536.566832][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8536.567107][ C0] ip_finish_output2+0x786/0x18e0 [ 8536.567385][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8536.567690][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8536.568067][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8536.568371][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8536.568662][ C0] ? __ip_finish_output+0x10f/0x770 [ 8536.568951][ C0] ip_output+0x16b/0x4f0 [ 8536.569178][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8536.569463][ C0] ? __pfx_ip_output+0x10/0x10 [ 8536.569715][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8536.570020][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8536.570283][ C0] ? ip_local_out+0x114/0x3b0 [ 8536.570535][ C0] __ip_queue_xmit+0x672/0x1910 [ 8536.570795][ C0] ? __skb_clone+0x57a/0x760 [ 8536.571043][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8536.571321][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8536.571615][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8536.571933][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8536.572193][ C0] ? tcp_current_mss+0x40a/0x510 [ 8536.572453][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8536.572736][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8536.573008][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8536.573262][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8536.573532][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8536.573851][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8536.574127][ C0] ? ktime_get+0xb6/0x190 [ 8536.574356][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8536.574628][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8536.574910][ C0] tcp_write_timer+0x82/0x1d0 [ 8536.575159][ C0] call_timer_fn+0x176/0x430 [ 8536.575421][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8536.575693][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8536.575968][ C0] __run_timers.part.0+0x52d/0x890 [ 8536.576239][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8536.576524][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8536.576820][ C0] ? lock_acquire+0x1c1/0x220 [ 8536.577071][ C0] ? clockevents_program_event+0xf6/0x300 [ 8536.577376][ C0] ? lock_release+0x1d5/0x250 [ 8536.577628][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8536.577907][ C0] ? ktime_get+0xb6/0x190 [ 8536.578141][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8536.578439][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8536.578747][ C0] run_timer_softirq+0x72/0x100 [ 8536.579035][ C0] __do_softirq+0x1bc/0x7ff [ 8536.579300][ C0] irq_exit_rcu+0x98/0xc0 [ 8536.579548][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8536.579853][ C0] [ 8536.580024][ C0] [ 8536.580191][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8536.580525][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8536.580816][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8536.581908][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8536.582256][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8536.582701][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8536.583146][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8536.583595][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8536.584038][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8536.584487][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8536.584811][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8536.585111][ C0] default_idle_call+0x69/0xa0 [ 8536.585393][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8536.585679][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8536.585997][ C0] ? lock_release+0x1d5/0x250 [ 8536.586274][ C0] do_idle+0xfb/0x160 [ 8536.586496][ C0] cpu_startup_entry+0x55/0x60 [ 8536.586750][ C0] rest_init+0x153/0x260 [ 8536.586977][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8536.587266][ C0] arch_call_rest_init+0x13/0x40 [ 8536.587531][ C0] start_kernel+0x314/0x3d0 [ 8536.587777][ C0] x86_64_start_reservations+0x18/0x30 [ 8536.588072][ C0] x86_64_start_kernel+0xba/0x110 [ 8536.588337][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8536.588659][ C0] [ 8536.588822][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6844s! [ksoftirqd/1:22] [ 8536.589289][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8536.590493][ C1] irq event stamp: 3886976 [ 8536.590735][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8536.591233][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8536.591728][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8536.592228][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8536.592728][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8536.593227][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8536.593875][ C1] RIP: 0010:kasan_check_range+0x74/0x1c0 [ 8536.594180][ C1] Code: ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 <49> 01 c1 48 89 e8 49 8d 59 01 48 89 da 48 29 ea 48 83 fa 10 0f 8e [ 8536.595220][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000286 [ 8536.595552][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8536.595975][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8536.596395][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: 1ffff110014131c3 [ 8536.596814][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8536.597236][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8536.597657][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8536.598127][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8536.598484][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8536.598906][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8536.599328][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8536.599749][ C1] Call Trace: [ 8536.599931][ C1] [ 8536.600090][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8536.600365][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8536.600623][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8536.600911][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8536.601201][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8536.601507][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8536.601789][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8536.602114][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8536.602390][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8536.602716][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8536.603032][ C1] [ 8536.603189][ C1] [ 8536.603345][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8536.603677][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8536.603984][ C1] ? kasan_check_range+0x74/0x1c0 [ 8536.604259][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 8536.604557][ C1] ? run_ksoftirqd+0xb/0x60 [ 8536.604810][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8536.605144][ C1] ? __orc_find+0x9c/0xf0 [ 8536.605384][ C1] ? lock_acquire+0x1c1/0x220 [ 8536.605639][ C1] ? irqentry_enter+0x2b/0x60 [ 8536.605894][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8536.606159][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8536.606450][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8536.606753][ C1] ? lock_acquire+0x1c1/0x220 [ 8536.607004][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8536.607262][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8536.607540][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8536.607791][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8536.608054][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8536.608332][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8536.608625][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8536.608918][ C1] ip_local_deliver+0x19d/0x480 [ 8536.609176][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8536.609458][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8536.609727][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8536.610009][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8536.610279][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8536.610617][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8536.610896][ C1] ip_rcv+0x564/0x740 [ 8536.611120][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8536.611365][ C1] ? set_track_prepare+0x8a/0xd0 [ 8536.611636][ C1] ? irqentry_enter+0x2b/0x60 [ 8536.611888][ C1] ? irqentry_enter+0x2b/0x60 [ 8536.612142][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8536.612384][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8536.612697][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8536.613041][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8536.613351][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8536.613693][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8536.613993][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8536.614323][ C1] netif_receive_skb+0x55/0x280 [ 8536.614585][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8536.614913][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8536.615270][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8536.615581][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8536.615872][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8536.616179][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8536.616514][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8536.616798][ C1] ? arch_stack_walk+0x68/0x100 [ 8536.617060][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8536.617337][ C1] ? irqentry_enter+0x2b/0x60 [ 8536.617589][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8536.617908][ C1] ? irqentry_enter+0x2b/0x60 [ 8536.618164][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8536.618490][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8536.618770][ C1] ? arch_stack_walk+0x68/0x100 [ 8536.619035][ C1] __tcf_classify+0x32c/0x7d0 [ 8536.619290][ C1] tcf_classify+0x283/0x930 [ 8536.619536][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8536.619808][ C1] tc_run+0x2e4/0x5d0 [ 8536.620030][ C1] ? __pfx_tc_run+0x10/0x10 [ 8536.620280][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8536.620550][ C1] ? irqentry_enter+0x2b/0x60 [ 8536.620802][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8536.621088][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8536.621411][ C1] ip_finish_output2+0x786/0x18e0 [ 8536.621686][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8536.621978][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8536.622244][ C1] ? __ip_finish_output+0x10f/0x770 [ 8536.622525][ C1] ip_output+0x16b/0x4f0 [ 8536.622757][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8536.623076][ C1] ? __pfx_ip_output+0x10/0x10 [ 8536.623338][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8536.623691][ C1] ? __pfx_ip_output+0x10/0x10 [ 8536.623945][ C1] __ip_queue_xmit+0x672/0x1910 [ 8536.624211][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8536.624496][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8536.624796][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8536.625087][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8536.625393][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8536.625678][ C1] tcp_delack_timer+0x84/0x240 [ 8536.625935][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8536.626227][ C1] call_timer_fn+0x176/0x430 [ 8536.626480][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8536.626754][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8536.627035][ C1] __run_timers.part.0+0x52d/0x890 [ 8536.627311][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8536.627598][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8536.627899][ C1] ? __pfx___schedule+0x10/0x10 [ 8536.628161][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8536.628490][ C1] run_timer_softirq+0x72/0x100 [ 8536.628751][ C1] __do_softirq+0x1bc/0x7ff [ 8536.628993][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8536.629268][ C1] run_ksoftirqd+0x2e/0x60 [ 8536.629510][ C1] smpboot_thread_fn+0x30e/0x840 [ 8536.629774][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8536.630071][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8536.630363][ C1] kthread+0x292/0x360 [ 8536.630583][ C1] ? __pfx_kthread+0x10/0x10 [ 8536.630828][ C1] ret_from_fork+0x34/0x70 [ 8536.631070][ C1] ? __pfx_kthread+0x10/0x10 [ 8536.631317][ C1] ret_from_fork_asm+0x1b/0x30 [ 8536.631582][ C1] [ 8560.366024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8560.366418][ C1] rcu: 1-....: (7300380 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1742525 [ 8560.367007][ C1] rcu: (t=7366057 jiffies g=1007429 q=31 ncpus=4) [ 8560.367352][ C1] Sending NMI from CPU 1 to CPUs 0: [ 8560.367638][ C0] NMI backtrace for cpu 0 [ 8560.367644][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8560.367649][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8560.367652][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8560.367662][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8560.367665][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8560.367668][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8560.367670][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8560.367672][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8560.367674][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8560.367676][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8560.367678][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8560.367680][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8560.367684][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8560.367686][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8560.367687][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8560.367688][ C0] Call Trace: [ 8560.367691][ C0] [ 8560.367705][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 8560.367711][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8560.367716][ C0] ? nmi_handle+0x156/0x420 [ 8560.367721][ C0] ? default_do_nmi+0x41/0x100 [ 8560.367724][ C0] ? exc_nmi+0xf3/0x120 [ 8560.367727][ C0] ? end_repeat_nmi+0xf/0x60 [ 8560.367731][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8560.367735][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8560.367739][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8560.367742][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8560.367746][ C0] [ 8560.367747][ C0] [ 8560.367748][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8560.367751][ C0] ? get_stack_info+0x36/0xc0 [ 8560.367756][ C0] ? lock_acquire+0x1c1/0x220 [ 8560.367761][ C0] ? lock_release+0x1d5/0x250 [ 8560.367764][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8560.367768][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8560.367771][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8560.367774][ C0] ? lock_acquire+0x1c1/0x220 [ 8560.367776][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8560.367781][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8560.367784][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8560.367791][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8560.367794][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8560.367797][ C0] ? __inet_lookup_established+0x341/0x610 [ 8560.367803][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8560.367810][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8560.367813][ C0] ip_local_deliver+0x19d/0x480 [ 8560.367816][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8560.367819][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8560.367824][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8560.367828][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8560.367831][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8560.367835][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8560.367845][ C0] ip_rcv+0x564/0x740 [ 8560.367848][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8560.367851][ C0] ? set_track_prepare+0x8a/0xd0 [ 8560.367855][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8560.367857][ C0] ? rest_init+0x153/0x260 [ 8560.367860][ C0] ? skb_clone+0x10b/0x330 [ 8560.367864][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8560.367870][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8560.367875][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8560.367880][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8560.367888][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8560.367891][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8560.367894][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8560.367897][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8560.367901][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8560.367904][ C0] ? lock_acquire+0x1c1/0x220 [ 8560.367906][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8560.367910][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8560.367913][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8560.367916][ C0] ? __copy_skb_header+0xaf/0x490 [ 8560.367919][ C0] ? __skb_clone+0x57a/0x760 [ 8560.367922][ C0] netif_receive_skb+0x55/0x280 [ 8560.367924][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8560.367933][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8560.367940][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8560.367947][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8560.367952][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8560.367960][ C0] ? hlock_class+0x4e/0x130 [ 8560.367966][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8560.367976][ C0] ? place_entity+0x21/0x2f0 [ 8560.367980][ C0] ? resched_curr+0x219/0x280 [ 8560.367983][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8560.367987][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8560.367990][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8560.367994][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8560.367997][ C0] ? activate_task+0xf5/0x260 [ 8560.368000][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8560.368004][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8560.368008][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8560.368011][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8560.368014][ C0] ? get_stack_info+0x36/0xc0 [ 8560.368017][ C0] ? stack_access_ok+0xda/0x1f0 [ 8560.368021][ C0] ? get_reg+0x119/0x190 [ 8560.368025][ C0] __tcf_classify+0x32c/0x7d0 [ 8560.368029][ C0] tcf_classify+0x283/0x930 [ 8560.368032][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8560.368037][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8560.368039][ C0] ? arch_stack_walk+0x8c/0x100 [ 8560.368045][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8560.368048][ C0] tc_run+0x2e4/0x5d0 [ 8560.368052][ C0] ? __pfx_tc_run+0x10/0x10 [ 8560.368055][ C0] ? lock_acquire+0x1c1/0x220 [ 8560.368058][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8560.368062][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8560.368068][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8560.368071][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8560.368075][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8560.368080][ C0] ? neigh_hh_output+0x348/0x590 [ 8560.368084][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8560.368088][ C0] ip_finish_output2+0x786/0x18e0 [ 8560.368091][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8560.368097][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8560.368105][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8560.368108][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8560.368112][ C0] ? __ip_finish_output+0x10f/0x770 [ 8560.368116][ C0] ip_output+0x16b/0x4f0 [ 8560.368119][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8560.368124][ C0] ? __pfx_ip_output+0x10/0x10 [ 8560.368127][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8560.368131][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8560.368135][ C0] ? ip_local_out+0x114/0x3b0 [ 8560.368139][ C0] __ip_queue_xmit+0x672/0x1910 [ 8560.368143][ C0] ? __skb_clone+0x57a/0x760 [ 8560.368146][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8560.368153][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8560.368158][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8560.368162][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8560.368167][ C0] ? tcp_current_mss+0x40a/0x510 [ 8560.368170][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8560.368173][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8560.368176][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8560.368178][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8560.368181][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8560.368184][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8560.368188][ C0] ? ktime_get+0xb6/0x190 [ 8560.368192][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8560.368196][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8560.368199][ C0] tcp_write_timer+0x82/0x1d0 [ 8560.368203][ C0] call_timer_fn+0x176/0x430 [ 8560.368207][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8560.368212][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8560.368216][ C0] __run_timers.part.0+0x52d/0x890 [ 8560.368219][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8560.368224][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8560.368227][ C0] ? lock_acquire+0x1c1/0x220 [ 8560.368230][ C0] ? clockevents_program_event+0xf6/0x300 [ 8560.368234][ C0] ? lock_release+0x1d5/0x250 [ 8560.368236][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8560.368239][ C0] ? ktime_get+0xb6/0x190 [ 8560.368242][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8560.368245][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8560.368250][ C0] run_timer_softirq+0x72/0x100 [ 8560.368253][ C0] __do_softirq+0x1bc/0x7ff [ 8560.368258][ C0] irq_exit_rcu+0x98/0xc0 [ 8560.368261][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8560.368265][ C0] [ 8560.368265][ C0] [ 8560.368267][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8560.368272][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8560.368275][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8560.368278][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8560.368280][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8560.368282][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8560.368283][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8560.368284][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8560.368286][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8560.368290][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8560.368293][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8560.368298][ C0] default_idle_call+0x69/0xa0 [ 8560.368300][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8560.368303][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8560.368308][ C0] ? lock_release+0x1d5/0x250 [ 8560.368311][ C0] do_idle+0xfb/0x160 [ 8560.368314][ C0] cpu_startup_entry+0x55/0x60 [ 8560.368317][ C0] rest_init+0x153/0x260 [ 8560.368319][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8560.368325][ C0] arch_call_rest_init+0x13/0x40 [ 8560.368330][ C0] start_kernel+0x314/0x3d0 [ 8560.368334][ C0] x86_64_start_reservations+0x18/0x30 [ 8560.368338][ C0] x86_64_start_kernel+0xba/0x110 [ 8560.368341][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8560.368350][ C0] [ 8560.368633][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8560.422528][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8560.423174][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8560.423523][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8560.424544][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8560.424869][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8560.425304][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8560.425719][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8560.426134][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8560.426547][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8560.426962][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8560.427429][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8560.427779][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8560.428199][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8560.428621][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8560.429040][ C1] Call Trace: [ 8560.429217][ C1] [ 8560.429375][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8560.429659][ C1] ? print_cpu_stall+0x263/0x6a0 [ 8560.429925][ C1] ? check_cpu_stall+0x284/0x500 [ 8560.430188][ C1] ? rcu_pending+0x92/0x360 [ 8560.430432][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8560.430715][ C1] ? update_process_times+0xb9/0x110 [ 8560.430994][ C1] ? tick_sched_handle+0x67/0x130 [ 8560.431265][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8560.431565][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8560.431816][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8560.432146][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8560.432428][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8560.432727][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8560.433002][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8560.433322][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8560.433599][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8560.433918][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8560.434226][ C1] [ 8560.434384][ C1] [ 8560.434542][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8560.434874][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8560.435186][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8560.435497][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8560.435797][ C1] ? run_ksoftirqd+0xb/0x60 [ 8560.436041][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8560.436364][ C1] ? __orc_find+0x9c/0xf0 [ 8560.436598][ C1] ? lock_acquire+0x1c1/0x220 [ 8560.436850][ C1] ? irqentry_enter+0x2b/0x60 [ 8560.437106][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8560.437368][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8560.437656][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8560.437957][ C1] ? lock_acquire+0x1c1/0x220 [ 8560.438207][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8560.438458][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8560.438731][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8560.438979][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8560.439239][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8560.439513][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8560.439802][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8560.440093][ C1] ip_local_deliver+0x19d/0x480 [ 8560.440348][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8560.440628][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8560.440891][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8560.441170][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8560.441437][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8560.441769][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8560.442045][ C1] ip_rcv+0x564/0x740 [ 8560.442264][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8560.442509][ C1] ? set_track_prepare+0x8a/0xd0 [ 8560.442775][ C1] ? irqentry_enter+0x2b/0x60 [ 8560.443026][ C1] ? irqentry_enter+0x2b/0x60 [ 8560.443275][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8560.443521][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8560.443832][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8560.444169][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8560.444476][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8560.444816][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8560.445123][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8560.445456][ C1] netif_receive_skb+0x55/0x280 [ 8560.445716][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8560.446044][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8560.446393][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8560.446703][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8560.446992][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8560.447294][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8560.447625][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8560.447909][ C1] ? arch_stack_walk+0x68/0x100 [ 8560.448167][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8560.448441][ C1] ? irqentry_enter+0x2b/0x60 [ 8560.448690][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8560.449006][ C1] ? irqentry_enter+0x2b/0x60 [ 8560.449259][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8560.449581][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8560.449858][ C1] ? arch_stack_walk+0x68/0x100 [ 8560.450118][ C1] __tcf_classify+0x32c/0x7d0 [ 8560.450371][ C1] tcf_classify+0x283/0x930 [ 8560.450614][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8560.450883][ C1] tc_run+0x2e4/0x5d0 [ 8560.451103][ C1] ? __pfx_tc_run+0x10/0x10 [ 8560.451348][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8560.451615][ C1] ? irqentry_enter+0x2b/0x60 [ 8560.451865][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8560.452148][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8560.452465][ C1] ip_finish_output2+0x786/0x18e0 [ 8560.452738][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8560.453028][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8560.453290][ C1] ? __ip_finish_output+0x10f/0x770 [ 8560.453569][ C1] ip_output+0x16b/0x4f0 [ 8560.453797][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8560.454113][ C1] ? __pfx_ip_output+0x10/0x10 [ 8560.454372][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8560.454722][ C1] ? __pfx_ip_output+0x10/0x10 [ 8560.454975][ C1] __ip_queue_xmit+0x672/0x1910 [ 8560.455244][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8560.455522][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8560.455812][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8560.456093][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8560.456385][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8560.456668][ C1] tcp_delack_timer+0x84/0x240 [ 8560.456922][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8560.457210][ C1] call_timer_fn+0x176/0x430 [ 8560.457460][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8560.457731][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8560.458009][ C1] __run_timers.part.0+0x52d/0x890 [ 8560.458283][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8560.458571][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8560.458869][ C1] ? __pfx___schedule+0x10/0x10 [ 8560.459129][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8560.459452][ C1] run_timer_softirq+0x72/0x100 [ 8560.459709][ C1] __do_softirq+0x1bc/0x7ff [ 8560.459949][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8560.460222][ C1] run_ksoftirqd+0x2e/0x60 [ 8560.460463][ C1] smpboot_thread_fn+0x30e/0x840 [ 8560.460724][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8560.461016][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8560.461304][ C1] kthread+0x292/0x360 [ 8560.461524][ C1] ? __pfx_kthread+0x10/0x10 [ 8560.461766][ C1] ret_from_fork+0x34/0x70 [ 8560.462005][ C1] ? __pfx_kthread+0x10/0x10 [ 8560.462248][ C1] ret_from_fork_asm+0x1b/0x30 [ 8560.462510][ C1] [ 8584.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6888s! [swapper/0:0] [ 8584.527925][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8584.529113][ C0] irq event stamp: 27567077 [ 8584.529351][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8584.529889][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8584.530367][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8584.530879][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8584.531390][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8584.531882][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8584.532544][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8584.532889][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8584.533929][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8584.534253][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8584.534680][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8584.535118][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8584.535550][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8584.535973][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8584.536399][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8584.536880][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8584.537238][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8584.537659][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8584.538084][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8584.538509][ C0] Call Trace: [ 8584.538696][ C0] [ 8584.538854][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8584.539130][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8584.539394][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8584.539687][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8584.539977][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8584.540285][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8584.540568][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8584.540893][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8584.541169][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8584.541455][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8584.541776][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8584.542091][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8584.542428][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8584.542744][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8584.543055][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8584.543371][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8584.543707][ C0] ? get_stack_info+0x36/0xc0 [ 8584.543966][ C0] ? lock_acquire+0x1c1/0x220 [ 8584.544225][ C0] ? lock_release+0x1d5/0x250 [ 8584.544481][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8584.544746][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8584.545062][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8584.545376][ C0] ? lock_acquire+0x1c1/0x220 [ 8584.545631][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8584.545880][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8584.546157][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8584.546413][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8584.546681][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8584.546961][ C0] ? __inet_lookup_established+0x341/0x610 [ 8584.547282][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8584.547578][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8584.547870][ C0] ip_local_deliver+0x19d/0x480 [ 8584.548137][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8584.548433][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8584.548704][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8584.548987][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8584.549252][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8584.549591][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8584.549873][ C0] ip_rcv+0x564/0x740 [ 8584.550087][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8584.550328][ C0] ? set_track_prepare+0x8a/0xd0 [ 8584.550594][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8584.550887][ C0] ? rest_init+0x153/0x260 [ 8584.551135][ C0] ? skb_clone+0x10b/0x330 [ 8584.551372][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8584.551709][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8584.552034][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8584.552328][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8584.552645][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8584.552906][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8584.553152][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8584.553470][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8584.553767][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8584.554112][ C0] ? lock_acquire+0x1c1/0x220 [ 8584.554377][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8584.554697][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8584.555008][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8584.555345][ C0] ? __copy_skb_header+0xaf/0x490 [ 8584.555616][ C0] ? __skb_clone+0x57a/0x760 [ 8584.555869][ C0] netif_receive_skb+0x55/0x280 [ 8584.556137][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8584.556475][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8584.556838][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8584.557160][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8584.557455][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8584.557766][ C0] ? hlock_class+0x4e/0x130 [ 8584.558016][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8584.558355][ C0] ? place_entity+0x21/0x2f0 [ 8584.558606][ C0] ? resched_curr+0x219/0x280 [ 8584.558861][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8584.559135][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8584.559422][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8584.559710][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8584.559979][ C0] ? activate_task+0xf5/0x260 [ 8584.560241][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8584.560526][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8584.560798][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8584.561062][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8584.561355][ C0] ? get_stack_info+0x36/0xc0 [ 8584.561606][ C0] ? stack_access_ok+0xda/0x1f0 [ 8584.561863][ C0] ? get_reg+0x119/0x190 [ 8584.562092][ C0] __tcf_classify+0x32c/0x7d0 [ 8584.562347][ C0] tcf_classify+0x283/0x930 [ 8584.562598][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8584.562933][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8584.563202][ C0] ? arch_stack_walk+0x8c/0x100 [ 8584.563460][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8584.563748][ C0] tc_run+0x2e4/0x5d0 [ 8584.563975][ C0] ? __pfx_tc_run+0x10/0x10 [ 8584.564225][ C0] ? lock_acquire+0x1c1/0x220 [ 8584.564484][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8584.564765][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8584.565045][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8584.565328][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8584.565604][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8584.565934][ C0] ? neigh_hh_output+0x348/0x590 [ 8584.566205][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8584.566486][ C0] ip_finish_output2+0x786/0x18e0 [ 8584.566758][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8584.567054][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8584.567422][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8584.567718][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8584.567984][ C0] ? __ip_finish_output+0x10f/0x770 [ 8584.568275][ C0] ip_output+0x16b/0x4f0 [ 8584.568506][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8584.568795][ C0] ? __pfx_ip_output+0x10/0x10 [ 8584.569056][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8584.569361][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8584.569630][ C0] ? ip_local_out+0x114/0x3b0 [ 8584.569887][ C0] __ip_queue_xmit+0x672/0x1910 [ 8584.570151][ C0] ? __skb_clone+0x57a/0x760 [ 8584.570404][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8584.570692][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8584.570998][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8584.571323][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8584.571585][ C0] ? tcp_current_mss+0x40a/0x510 [ 8584.571861][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8584.572152][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8584.572431][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8584.572688][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8584.572954][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8584.573274][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8584.573554][ C0] ? ktime_get+0xb6/0x190 [ 8584.573789][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8584.574069][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8584.574357][ C0] tcp_write_timer+0x82/0x1d0 [ 8584.574614][ C0] call_timer_fn+0x176/0x430 [ 8584.574864][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8584.575145][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8584.575418][ C0] __run_timers.part.0+0x52d/0x890 [ 8584.575697][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8584.575983][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8584.576286][ C0] ? lock_acquire+0x1c1/0x220 [ 8584.576538][ C0] ? clockevents_program_event+0xf6/0x300 [ 8584.576848][ C0] ? lock_release+0x1d5/0x250 [ 8584.577106][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8584.577380][ C0] ? ktime_get+0xb6/0x190 [ 8584.577610][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8584.577916][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8584.578234][ C0] run_timer_softirq+0x72/0x100 [ 8584.578499][ C0] __do_softirq+0x1bc/0x7ff [ 8584.578747][ C0] irq_exit_rcu+0x98/0xc0 [ 8584.578985][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8584.579289][ C0] [ 8584.579455][ C0] [ 8584.579616][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8584.579947][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8584.580223][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8584.581264][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8584.581598][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8584.582034][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8584.582461][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8584.582888][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8584.583317][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8584.583754][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8584.584060][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8584.584336][ C0] default_idle_call+0x69/0xa0 [ 8584.584597][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8584.584861][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8584.585161][ C0] ? lock_release+0x1d5/0x250 [ 8584.585416][ C0] do_idle+0xfb/0x160 [ 8584.585635][ C0] cpu_startup_entry+0x55/0x60 [ 8584.585890][ C0] rest_init+0x153/0x260 [ 8584.586118][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8584.586402][ C0] arch_call_rest_init+0x13/0x40 [ 8584.586671][ C0] start_kernel+0x314/0x3d0 [ 8584.586921][ C0] x86_64_start_reservations+0x18/0x30 [ 8584.587219][ C0] x86_64_start_kernel+0xba/0x110 [ 8584.587495][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8584.587823][ C0] [ 8584.587988][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6888s! [ksoftirqd/1:22] [ 8584.588448][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8584.589648][ C1] irq event stamp: 3886976 [ 8584.589883][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8584.590387][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8584.590890][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8584.591393][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8584.591883][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8584.592381][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8584.593035][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8584.593382][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8584.594414][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8584.594741][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8584.595174][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8584.595592][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8584.596012][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8584.596434][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8584.596852][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8584.597322][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8584.597673][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8584.598097][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8584.598516][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8584.598935][ C1] Call Trace: [ 8584.599116][ C1] [ 8584.599275][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8584.599553][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8584.599807][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8584.600104][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8584.600390][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8584.600806][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8584.601157][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8584.601569][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8584.601964][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8584.602408][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8584.602851][ C1] [ 8584.603081][ C1] [ 8584.603311][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8584.603785][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8584.604219][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8584.604659][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8584.605106][ C1] ? run_ksoftirqd+0xb/0x60 [ 8584.605456][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8584.605918][ C1] ? __orc_find+0x9c/0xf0 [ 8584.606252][ C1] ? lock_acquire+0x1c1/0x220 [ 8584.606615][ C1] ? irqentry_enter+0x2b/0x60 [ 8584.606985][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8584.607362][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8584.607773][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8584.608204][ C1] ? lock_acquire+0x1c1/0x220 [ 8584.608561][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8584.608921][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8584.609310][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8584.609669][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8584.610046][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8584.610437][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8584.610854][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8584.611273][ C1] ip_local_deliver+0x19d/0x480 [ 8584.611639][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8584.612033][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8584.612406][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8584.612803][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8584.613177][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8584.613533][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8584.613810][ C1] ip_rcv+0x564/0x740 [ 8584.614032][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8584.614274][ C1] ? set_track_prepare+0x8a/0xd0 [ 8584.614539][ C1] ? irqentry_enter+0x2b/0x60 [ 8584.614786][ C1] ? irqentry_enter+0x2b/0x60 [ 8584.615059][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8584.615301][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8584.615617][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8584.615958][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8584.616279][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8584.616614][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8584.616914][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8584.617253][ C1] netif_receive_skb+0x55/0x280 [ 8584.617514][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8584.617845][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8584.618200][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8584.618511][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8584.618802][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8584.619116][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8584.619445][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8584.619726][ C1] ? arch_stack_walk+0x68/0x100 [ 8584.619983][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8584.620290][ C1] ? irqentry_enter+0x2b/0x60 [ 8584.620537][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8584.620850][ C1] ? irqentry_enter+0x2b/0x60 [ 8584.621110][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8584.621435][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8584.621711][ C1] ? arch_stack_walk+0x68/0x100 [ 8584.621975][ C1] __tcf_classify+0x32c/0x7d0 [ 8584.622238][ C1] tcf_classify+0x283/0x930 [ 8584.622483][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8584.622753][ C1] tc_run+0x2e4/0x5d0 [ 8584.622967][ C1] ? __pfx_tc_run+0x10/0x10 [ 8584.623218][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8584.623485][ C1] ? irqentry_enter+0x2b/0x60 [ 8584.623732][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8584.624019][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8584.624360][ C1] ip_finish_output2+0x786/0x18e0 [ 8584.624631][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8584.624921][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8584.625198][ C1] ? __ip_finish_output+0x10f/0x770 [ 8584.625474][ C1] ip_output+0x16b/0x4f0 [ 8584.625700][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8584.626020][ C1] ? __pfx_ip_output+0x10/0x10 [ 8584.626277][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8584.626632][ C1] ? __pfx_ip_output+0x10/0x10 [ 8584.626891][ C1] __ip_queue_xmit+0x672/0x1910 [ 8584.627152][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8584.627432][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8584.627726][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8584.628010][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8584.628303][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8584.628585][ C1] tcp_delack_timer+0x84/0x240 [ 8584.628836][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8584.629123][ C1] call_timer_fn+0x176/0x430 [ 8584.629371][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8584.629645][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8584.629927][ C1] __run_timers.part.0+0x52d/0x890 [ 8584.630203][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8584.630486][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8584.630782][ C1] ? __pfx___schedule+0x10/0x10 [ 8584.631046][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8584.631365][ C1] run_timer_softirq+0x72/0x100 [ 8584.631622][ C1] __do_softirq+0x1bc/0x7ff [ 8584.631955][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8584.632342][ C1] run_ksoftirqd+0x2e/0x60 [ 8584.632682][ C1] smpboot_thread_fn+0x30e/0x840 [ 8584.633059][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8584.633474][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8584.633886][ C1] kthread+0x292/0x360 [ 8584.634199][ C1] ? __pfx_kthread+0x10/0x10 [ 8584.634552][ C1] ret_from_fork+0x34/0x70 [ 8584.634799][ C1] ? __pfx_kthread+0x10/0x10 [ 8584.635054][ C1] ret_from_fork_asm+0x1b/0x30 [ 8584.635313][ C1] [ 8612.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6915s! [swapper/0:0] [ 8612.527923][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8612.529124][ C0] irq event stamp: 27567077 [ 8612.529369][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8612.529903][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8612.530376][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8612.530880][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8612.531374][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8612.531852][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8612.532500][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8612.532844][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8612.533872][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8612.534200][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8612.534623][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8612.535049][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8612.535469][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8612.535889][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8612.536309][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8612.536779][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8612.537133][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8612.537556][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8612.537979][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8612.538407][ C0] Call Trace: [ 8612.538595][ C0] [ 8612.538752][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8612.539026][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8612.539283][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8612.539572][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8612.539863][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8612.540172][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8612.540455][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8612.540777][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8612.541050][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8612.541330][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8612.541651][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8612.541962][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8612.542296][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8612.542599][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8612.542910][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8612.543218][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8612.543549][ C0] ? get_stack_info+0x36/0xc0 [ 8612.543801][ C0] ? lock_acquire+0x1c1/0x220 [ 8612.544053][ C0] ? lock_release+0x1d5/0x250 [ 8612.544305][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8612.544564][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8612.544861][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8612.545162][ C0] ? lock_acquire+0x1c1/0x220 [ 8612.545408][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8612.545657][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8612.545928][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8612.546180][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8612.546442][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8612.546717][ C0] ? __inet_lookup_established+0x341/0x610 [ 8612.547033][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8612.547322][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8612.547613][ C0] ip_local_deliver+0x19d/0x480 [ 8612.547875][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8612.548162][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8612.548430][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8612.548704][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8612.548967][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8612.549306][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8612.549579][ C0] ip_rcv+0x564/0x740 [ 8612.549793][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8612.550037][ C0] ? set_track_prepare+0x8a/0xd0 [ 8612.550302][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8612.550594][ C0] ? rest_init+0x153/0x260 [ 8612.550831][ C0] ? skb_clone+0x10b/0x330 [ 8612.551074][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8612.551407][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8612.551728][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8612.552025][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8612.552336][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8612.552601][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8612.552845][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8612.553163][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8612.553461][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8612.553800][ C0] ? lock_acquire+0x1c1/0x220 [ 8612.554050][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8612.554358][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8612.554659][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8612.554995][ C0] ? __copy_skb_header+0xaf/0x490 [ 8612.555270][ C0] ? __skb_clone+0x57a/0x760 [ 8612.555519][ C0] netif_receive_skb+0x55/0x280 [ 8612.555778][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8612.556104][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8612.556453][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8612.556770][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8612.557056][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8612.557355][ C0] ? hlock_class+0x4e/0x130 [ 8612.557598][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8612.557923][ C0] ? place_entity+0x21/0x2f0 [ 8612.558169][ C0] ? resched_curr+0x219/0x280 [ 8612.558423][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8612.558693][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8612.558977][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8612.559253][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8612.559508][ C0] ? activate_task+0xf5/0x260 [ 8612.559756][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8612.560030][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8612.560306][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8612.560565][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8612.560855][ C0] ? get_stack_info+0x36/0xc0 [ 8612.561110][ C0] ? stack_access_ok+0xda/0x1f0 [ 8612.561374][ C0] ? get_reg+0x119/0x190 [ 8612.561605][ C0] __tcf_classify+0x32c/0x7d0 [ 8612.561857][ C0] tcf_classify+0x283/0x930 [ 8612.562101][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8612.562428][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8612.562699][ C0] ? arch_stack_walk+0x8c/0x100 [ 8612.562961][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8612.563254][ C0] tc_run+0x2e4/0x5d0 [ 8612.563473][ C0] ? __pfx_tc_run+0x10/0x10 [ 8612.563713][ C0] ? lock_acquire+0x1c1/0x220 [ 8612.563960][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8612.564235][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8612.564503][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8612.564786][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8612.565069][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8612.565394][ C0] ? neigh_hh_output+0x348/0x590 [ 8612.565659][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8612.565940][ C0] ip_finish_output2+0x786/0x18e0 [ 8612.566211][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8612.566504][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8612.566855][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8612.567144][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8612.567410][ C0] ? __ip_finish_output+0x10f/0x770 [ 8612.567685][ C0] ip_output+0x16b/0x4f0 [ 8612.567912][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8612.568199][ C0] ? __pfx_ip_output+0x10/0x10 [ 8612.568455][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8612.568758][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8612.569019][ C0] ? ip_local_out+0x114/0x3b0 [ 8612.569275][ C0] __ip_queue_xmit+0x672/0x1910 [ 8612.569541][ C0] ? __skb_clone+0x57a/0x760 [ 8612.569791][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8612.570071][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8612.570365][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8612.570680][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8612.570938][ C0] ? tcp_current_mss+0x40a/0x510 [ 8612.571203][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8612.571487][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8612.571765][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8612.572018][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8612.572291][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8612.572613][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8612.572889][ C0] ? ktime_get+0xb6/0x190 [ 8612.573120][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8612.573392][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8612.573676][ C0] tcp_write_timer+0x82/0x1d0 [ 8612.573927][ C0] call_timer_fn+0x176/0x430 [ 8612.574177][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8612.574459][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8612.574735][ C0] __run_timers.part.0+0x52d/0x890 [ 8612.575016][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8612.575304][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8612.575600][ C0] ? lock_acquire+0x1c1/0x220 [ 8612.575857][ C0] ? clockevents_program_event+0xf6/0x300 [ 8612.576165][ C0] ? lock_release+0x1d5/0x250 [ 8612.576418][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8612.576699][ C0] ? ktime_get+0xb6/0x190 [ 8612.576930][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8612.577233][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8612.577540][ C0] run_timer_softirq+0x72/0x100 [ 8612.577802][ C0] __do_softirq+0x1bc/0x7ff [ 8612.578050][ C0] irq_exit_rcu+0x98/0xc0 [ 8612.578285][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8612.578584][ C0] [ 8612.578740][ C0] [ 8612.578896][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8612.579214][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8612.579485][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8612.580511][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8612.580837][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8612.581263][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8612.581689][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8612.582111][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8612.582533][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8612.582959][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8612.583269][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8612.583547][ C0] default_idle_call+0x69/0xa0 [ 8612.583803][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8612.584069][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8612.584359][ C0] ? lock_release+0x1d5/0x250 [ 8612.584615][ C0] do_idle+0xfb/0x160 [ 8612.584837][ C0] cpu_startup_entry+0x55/0x60 [ 8612.585092][ C0] rest_init+0x153/0x260 [ 8612.585324][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8612.585610][ C0] arch_call_rest_init+0x13/0x40 [ 8612.585872][ C0] start_kernel+0x314/0x3d0 [ 8612.586117][ C0] x86_64_start_reservations+0x18/0x30 [ 8612.586410][ C0] x86_64_start_kernel+0xba/0x110 [ 8612.586680][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8612.587006][ C0] [ 8612.587172][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6915s! [ksoftirqd/1:22] [ 8612.587633][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8612.588831][ C1] irq event stamp: 3886976 [ 8612.589070][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8612.589575][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8612.590079][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8612.590587][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8612.591080][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8612.591583][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8612.592234][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8612.592580][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8612.593615][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8612.593942][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8612.594373][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8612.594800][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8612.595227][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8612.595649][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8612.596070][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8612.596541][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8612.596894][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8612.597320][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8612.597748][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8612.598175][ C1] Call Trace: [ 8612.598356][ C1] [ 8612.598513][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8612.598791][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8612.599056][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8612.599351][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8612.599641][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8612.599946][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8612.600227][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8612.600552][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8612.600825][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8612.601153][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8612.601465][ C1] [ 8612.601622][ C1] [ 8612.601779][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8612.602107][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8612.602415][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8612.602728][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8612.603031][ C1] ? run_ksoftirqd+0xb/0x60 [ 8612.603274][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8612.603598][ C1] ? __orc_find+0x9c/0xf0 [ 8612.603833][ C1] ? lock_acquire+0x1c1/0x220 [ 8612.604087][ C1] ? irqentry_enter+0x2b/0x60 [ 8612.604342][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8612.604606][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8612.604905][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8612.605205][ C1] ? lock_acquire+0x1c1/0x220 [ 8612.605460][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8612.605719][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8612.605997][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8612.606244][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8612.606504][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8612.606775][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8612.607066][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8612.607359][ C1] ip_local_deliver+0x19d/0x480 [ 8612.607622][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8612.607910][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8612.608178][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8612.608454][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8612.608719][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8612.609061][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8612.609336][ C1] ip_rcv+0x564/0x740 [ 8612.609550][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8612.609791][ C1] ? set_track_prepare+0x8a/0xd0 [ 8612.610057][ C1] ? irqentry_enter+0x2b/0x60 [ 8612.610314][ C1] ? irqentry_enter+0x2b/0x60 [ 8612.610569][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8612.610815][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8612.611137][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8612.611479][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8612.611792][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8612.612131][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8612.612430][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8612.612769][ C1] netif_receive_skb+0x55/0x280 [ 8612.613031][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8612.613364][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8612.613716][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8612.614030][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8612.614326][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8612.614633][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8612.614971][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8612.615254][ C1] ? arch_stack_walk+0x68/0x100 [ 8612.615523][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8612.615803][ C1] ? irqentry_enter+0x2b/0x60 [ 8612.616060][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8612.616382][ C1] ? irqentry_enter+0x2b/0x60 [ 8612.616632][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8612.616957][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8612.617242][ C1] ? arch_stack_walk+0x68/0x100 [ 8612.617503][ C1] __tcf_classify+0x32c/0x7d0 [ 8612.617756][ C1] tcf_classify+0x283/0x930 [ 8612.618001][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8612.618271][ C1] tc_run+0x2e4/0x5d0 [ 8612.618484][ C1] ? __pfx_tc_run+0x10/0x10 [ 8612.618727][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8612.618992][ C1] ? irqentry_enter+0x2b/0x60 [ 8612.619249][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8612.619539][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8612.619865][ C1] ip_finish_output2+0x786/0x18e0 [ 8612.620137][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8612.620428][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8612.620697][ C1] ? __ip_finish_output+0x10f/0x770 [ 8612.620974][ C1] ip_output+0x16b/0x4f0 [ 8612.621201][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8612.621524][ C1] ? __pfx_ip_output+0x10/0x10 [ 8612.621778][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8612.622138][ C1] ? __pfx_ip_output+0x10/0x10 [ 8612.622397][ C1] __ip_queue_xmit+0x672/0x1910 [ 8612.622661][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8612.622940][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8612.623240][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8612.623525][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8612.623819][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8612.624103][ C1] tcp_delack_timer+0x84/0x240 [ 8612.624357][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8612.624646][ C1] call_timer_fn+0x176/0x430 [ 8612.624907][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8612.625187][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8612.625466][ C1] __run_timers.part.0+0x52d/0x890 [ 8612.625737][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8612.626027][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8612.626331][ C1] ? __pfx___schedule+0x10/0x10 [ 8612.626591][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8612.626911][ C1] run_timer_softirq+0x72/0x100 [ 8612.627178][ C1] __do_softirq+0x1bc/0x7ff [ 8612.627425][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8612.627703][ C1] run_ksoftirqd+0x2e/0x60 [ 8612.627942][ C1] smpboot_thread_fn+0x30e/0x840 [ 8612.628210][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8612.628499][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8612.628790][ C1] kthread+0x292/0x360 [ 8612.629009][ C1] ? __pfx_kthread+0x10/0x10 [ 8612.629259][ C1] ret_from_fork+0x34/0x70 [ 8612.629496][ C1] ? __pfx_kthread+0x10/0x10 [ 8612.629742][ C1] ret_from_fork_asm+0x1b/0x30 [ 8612.629999][ C1] [ 8638.464024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8638.464419][ C1] rcu: 1-....: (7378192 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1761808 [ 8638.465025][ C1] rcu: (t=7444155 jiffies g=1007429 q=31 ncpus=4) [ 8638.465378][ C1] Sending NMI from CPU 1 to CPUs 0: [ 8638.465665][ C0] NMI backtrace for cpu 0 [ 8638.465671][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8638.465675][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8638.465678][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8638.465687][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8638.465691][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8638.465694][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8638.465696][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8638.465698][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8638.465700][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8638.465702][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8638.465704][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8638.465706][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8638.465710][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8638.465712][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8638.465713][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8638.465715][ C0] Call Trace: [ 8638.465718][ C0] [ 8638.465722][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 8638.465727][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8638.465732][ C0] ? nmi_handle+0x156/0x420 [ 8638.465736][ C0] ? default_do_nmi+0x41/0x100 [ 8638.465740][ C0] ? exc_nmi+0xf3/0x120 [ 8638.465743][ C0] ? end_repeat_nmi+0xf/0x60 [ 8638.465748][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8638.465752][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8638.465755][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8638.465759][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8638.465763][ C0] [ 8638.465764][ C0] [ 8638.465766][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8638.465769][ C0] ? get_stack_info+0x36/0xc0 [ 8638.465773][ C0] ? lock_acquire+0x1c1/0x220 [ 8638.465778][ C0] ? lock_release+0x1d5/0x250 [ 8638.465781][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8638.465785][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8638.465789][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8638.465792][ C0] ? lock_acquire+0x1c1/0x220 [ 8638.465794][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8638.465799][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8638.465803][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8638.465810][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8638.465813][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8638.465816][ C0] ? __inet_lookup_established+0x341/0x610 [ 8638.465822][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8638.465829][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8638.465833][ C0] ip_local_deliver+0x19d/0x480 [ 8638.465836][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8638.465839][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8638.465844][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8638.465848][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8638.465851][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8638.465854][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8638.465865][ C0] ip_rcv+0x564/0x740 [ 8638.465868][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8638.465871][ C0] ? set_track_prepare+0x8a/0xd0 [ 8638.465875][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8638.465877][ C0] ? rest_init+0x153/0x260 [ 8638.465880][ C0] ? skb_clone+0x10b/0x330 [ 8638.465885][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8638.465891][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8638.465896][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8638.465901][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8638.465910][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8638.465913][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8638.465916][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8638.465920][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8638.465923][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8638.465927][ C0] ? lock_acquire+0x1c1/0x220 [ 8638.465929][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8638.465934][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8638.465936][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8638.465940][ C0] ? __copy_skb_header+0xaf/0x490 [ 8638.465943][ C0] ? __skb_clone+0x57a/0x760 [ 8638.465945][ C0] netif_receive_skb+0x55/0x280 [ 8638.465948][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8638.465956][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8638.465963][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8638.465969][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8638.465974][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8638.465983][ C0] ? hlock_class+0x4e/0x130 [ 8638.465988][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8638.465998][ C0] ? place_entity+0x21/0x2f0 [ 8638.466002][ C0] ? resched_curr+0x219/0x280 [ 8638.466005][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8638.466008][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8638.466011][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8638.466016][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8638.466018][ C0] ? activate_task+0xf5/0x260 [ 8638.466022][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8638.466028][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8638.466031][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8638.466034][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8638.466037][ C0] ? get_stack_info+0x36/0xc0 [ 8638.466041][ C0] ? stack_access_ok+0xda/0x1f0 [ 8638.466043][ C0] ? get_reg+0x119/0x190 [ 8638.466047][ C0] __tcf_classify+0x32c/0x7d0 [ 8638.466052][ C0] tcf_classify+0x283/0x930 [ 8638.466054][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8638.466058][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8638.466060][ C0] ? arch_stack_walk+0x8c/0x100 [ 8638.466064][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8638.466068][ C0] tc_run+0x2e4/0x5d0 [ 8638.466072][ C0] ? __pfx_tc_run+0x10/0x10 [ 8638.466075][ C0] ? lock_acquire+0x1c1/0x220 [ 8638.466077][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8638.466082][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8638.466087][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8638.466090][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8638.466094][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8638.466099][ C0] ? neigh_hh_output+0x348/0x590 [ 8638.466104][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8638.466108][ C0] ip_finish_output2+0x786/0x18e0 [ 8638.466111][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8638.466116][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8638.466124][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8638.466128][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8638.466132][ C0] ? __ip_finish_output+0x10f/0x770 [ 8638.466136][ C0] ip_output+0x16b/0x4f0 [ 8638.466139][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8638.466144][ C0] ? __pfx_ip_output+0x10/0x10 [ 8638.466147][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8638.466152][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8638.466155][ C0] ? ip_local_out+0x114/0x3b0 [ 8638.466159][ C0] __ip_queue_xmit+0x672/0x1910 [ 8638.466163][ C0] ? __skb_clone+0x57a/0x760 [ 8638.466166][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8638.466173][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8638.466177][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8638.466181][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8638.466187][ C0] ? tcp_current_mss+0x40a/0x510 [ 8638.466190][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8638.466193][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8638.466196][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8638.466198][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8638.466201][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8638.466204][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8638.466208][ C0] ? ktime_get+0xb6/0x190 [ 8638.466212][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8638.466216][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8638.466219][ C0] tcp_write_timer+0x82/0x1d0 [ 8638.466224][ C0] call_timer_fn+0x176/0x430 [ 8638.466227][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8638.466232][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8638.466236][ C0] __run_timers.part.0+0x52d/0x890 [ 8638.466239][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8638.466243][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8638.466246][ C0] ? lock_acquire+0x1c1/0x220 [ 8638.466249][ C0] ? clockevents_program_event+0xf6/0x300 [ 8638.466255][ C0] ? lock_release+0x1d5/0x250 [ 8638.466257][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8638.466260][ C0] ? ktime_get+0xb6/0x190 [ 8638.466263][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8638.466267][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8638.466271][ C0] run_timer_softirq+0x72/0x100 [ 8638.466274][ C0] __do_softirq+0x1bc/0x7ff [ 8638.466279][ C0] irq_exit_rcu+0x98/0xc0 [ 8638.466282][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8638.466285][ C0] [ 8638.466286][ C0] [ 8638.466287][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8638.466292][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8638.466295][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8638.466297][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8638.466299][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8638.466301][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8638.466303][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8638.466304][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8638.466305][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8638.466309][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8638.466312][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8638.466316][ C0] default_idle_call+0x69/0xa0 [ 8638.466318][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8638.466320][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8638.466325][ C0] ? lock_release+0x1d5/0x250 [ 8638.466329][ C0] do_idle+0xfb/0x160 [ 8638.466332][ C0] cpu_startup_entry+0x55/0x60 [ 8638.466334][ C0] rest_init+0x153/0x260 [ 8638.466337][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8638.466342][ C0] arch_call_rest_init+0x13/0x40 [ 8638.466347][ C0] start_kernel+0x314/0x3d0 [ 8638.466351][ C0] x86_64_start_reservations+0x18/0x30 [ 8638.466357][ C0] x86_64_start_kernel+0xba/0x110 [ 8638.466360][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8638.466368][ C0] [ 8638.466661][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8638.520950][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8638.521596][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8638.521940][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8638.522960][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8638.523283][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8638.523702][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8638.524120][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8638.524537][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8638.524963][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8638.525388][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8638.525864][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8638.526211][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8638.526640][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8638.527063][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8638.527485][ C1] Call Trace: [ 8638.527662][ C1] [ 8638.527818][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8638.528108][ C1] ? print_cpu_stall+0x263/0x6a0 [ 8638.528372][ C1] ? check_cpu_stall+0x284/0x500 [ 8638.528640][ C1] ? rcu_pending+0x92/0x360 [ 8638.528880][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8638.529160][ C1] ? update_process_times+0xb9/0x110 [ 8638.529445][ C1] ? tick_sched_handle+0x67/0x130 [ 8638.529712][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8638.530010][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8638.530266][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8638.530595][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8638.530885][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8638.531190][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8638.531471][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8638.531800][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8638.532075][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8638.532402][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8638.532717][ C1] [ 8638.532874][ C1] [ 8638.533031][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8638.533359][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8638.533669][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8638.533983][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8638.534289][ C1] ? run_ksoftirqd+0xb/0x60 [ 8638.534534][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8638.534869][ C1] ? __orc_find+0x9c/0xf0 [ 8638.535100][ C1] ? lock_acquire+0x1c1/0x220 [ 8638.535350][ C1] ? irqentry_enter+0x2b/0x60 [ 8638.535600][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8638.535859][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8638.536142][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8638.536441][ C1] ? lock_acquire+0x1c1/0x220 [ 8638.536696][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8638.536953][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8638.537229][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8638.537475][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8638.537731][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8638.538001][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8638.538292][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8638.538586][ C1] ip_local_deliver+0x19d/0x480 [ 8638.538848][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8638.539136][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8638.539404][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8638.539681][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8638.539945][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8638.540286][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8638.540560][ C1] ip_rcv+0x564/0x740 [ 8638.540774][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8638.541015][ C1] ? set_track_prepare+0x8a/0xd0 [ 8638.541281][ C1] ? irqentry_enter+0x2b/0x60 [ 8638.541537][ C1] ? irqentry_enter+0x2b/0x60 [ 8638.541795][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8638.542045][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8638.542364][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8638.542709][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8638.543027][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8638.543366][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8638.543665][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8638.544003][ C1] netif_receive_skb+0x55/0x280 [ 8638.544267][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8638.544597][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8638.544959][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8638.545277][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8638.545568][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8638.545870][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8638.546200][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8638.546483][ C1] ? arch_stack_walk+0x68/0x100 [ 8638.546748][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8638.547030][ C1] ? irqentry_enter+0x2b/0x60 [ 8638.547289][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8638.547610][ C1] ? irqentry_enter+0x2b/0x60 [ 8638.547859][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8638.548180][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8638.548464][ C1] ? arch_stack_walk+0x68/0x100 [ 8638.548730][ C1] __tcf_classify+0x32c/0x7d0 [ 8638.548982][ C1] tcf_classify+0x283/0x930 [ 8638.549227][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8638.549496][ C1] tc_run+0x2e4/0x5d0 [ 8638.549711][ C1] ? __pfx_tc_run+0x10/0x10 [ 8638.549953][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8638.550221][ C1] ? irqentry_enter+0x2b/0x60 [ 8638.550477][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8638.550768][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8638.551095][ C1] ip_finish_output2+0x786/0x18e0 [ 8638.551367][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8638.551657][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8638.551924][ C1] ? __ip_finish_output+0x10f/0x770 [ 8638.552200][ C1] ip_output+0x16b/0x4f0 [ 8638.552429][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8638.552750][ C1] ? __pfx_ip_output+0x10/0x10 [ 8638.553006][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8638.553366][ C1] ? __pfx_ip_output+0x10/0x10 [ 8638.553625][ C1] __ip_queue_xmit+0x672/0x1910 [ 8638.553886][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8638.554168][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8638.554462][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8638.554753][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8638.555053][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8638.555345][ C1] tcp_delack_timer+0x84/0x240 [ 8638.555605][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8638.555891][ C1] call_timer_fn+0x176/0x430 [ 8638.556140][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8638.556419][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8638.556697][ C1] __run_timers.part.0+0x52d/0x890 [ 8638.556970][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8638.557262][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8638.557568][ C1] ? __pfx___schedule+0x10/0x10 [ 8638.557829][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8638.558151][ C1] run_timer_softirq+0x72/0x100 [ 8638.558415][ C1] __do_softirq+0x1bc/0x7ff [ 8638.558662][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8638.558938][ C1] run_ksoftirqd+0x2e/0x60 [ 8638.559175][ C1] smpboot_thread_fn+0x30e/0x840 [ 8638.559442][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8638.559733][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8638.560029][ C1] kthread+0x292/0x360 [ 8638.560248][ C1] ? __pfx_kthread+0x10/0x10 [ 8638.560497][ C1] ret_from_fork+0x34/0x70 [ 8638.560735][ C1] ? __pfx_kthread+0x10/0x10 [ 8638.560984][ C1] ret_from_fork_asm+0x1b/0x30 [ 8638.561245][ C1] [ 8664.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6963s! [swapper/0:0] [ 8664.527920][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8664.529114][ C0] irq event stamp: 27567077 [ 8664.529355][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8664.529886][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8664.530368][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8664.530875][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8664.531370][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8664.531851][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8664.532491][ C0] RIP: 0010:kasan_check_range+0x158/0x1c0 [ 8664.532795][ C0] Code: 11 80 38 00 74 ef 4d 8d 1c 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 <48> 83 c0 01 48 39 d0 74 a5 80 38 00 74 f2 e9 74 ff ff ff b8 01 00 [ 8664.533813][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000246 [ 8664.534137][ C0] RAX: ffffed100141336b RBX: ffffed100141336c RCX: ffffffff90c7aaa0 [ 8664.534565][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8664.534983][ C0] RBP: ffffed100141336b R08: 0000000000000000 R09: ffffed100141336b [ 8664.535409][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8664.535834][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8664.536261][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8664.536733][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8664.537082][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8664.537512][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8664.537932][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8664.538350][ C0] Call Trace: [ 8664.538527][ C0] [ 8664.538681][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8664.538962][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8664.539218][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8664.539512][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8664.539796][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8664.540099][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8664.540377][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8664.540697][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8664.540972][ C0] ? hrtimer_interrupt+0x31a/0x770 [ 8664.541245][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8664.541524][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8664.541847][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8664.542157][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8664.542494][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8664.542796][ C0] ? kasan_check_range+0x158/0x1c0 [ 8664.543070][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 8664.543368][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8664.543698][ C0] ? get_stack_info+0x36/0xc0 [ 8664.543949][ C0] ? lock_acquire+0x1c1/0x220 [ 8664.544201][ C0] ? lock_release+0x1d5/0x250 [ 8664.544451][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8664.544719][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8664.545008][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8664.545313][ C0] ? lock_acquire+0x1c1/0x220 [ 8664.545564][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8664.545816][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8664.546090][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8664.546340][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8664.546601][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8664.546876][ C0] ? __inet_lookup_established+0x341/0x610 [ 8664.547191][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8664.547480][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8664.547769][ C0] ip_local_deliver+0x19d/0x480 [ 8664.548032][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8664.548321][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8664.548590][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8664.548867][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8664.549132][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8664.549471][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8664.549744][ C0] ip_rcv+0x564/0x740 [ 8664.549960][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8664.550205][ C0] ? set_track_prepare+0x8a/0xd0 [ 8664.550469][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8664.550760][ C0] ? rest_init+0x153/0x260 [ 8664.551001][ C0] ? skb_clone+0x10b/0x330 [ 8664.551242][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8664.551573][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8664.551891][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8664.552190][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8664.552503][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8664.552765][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8664.553011][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8664.553330][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8664.553632][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8664.553972][ C0] ? lock_acquire+0x1c1/0x220 [ 8664.554223][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8664.554532][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8664.554839][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8664.555175][ C0] ? __copy_skb_header+0xaf/0x490 [ 8664.555447][ C0] ? __skb_clone+0x57a/0x760 [ 8664.555696][ C0] netif_receive_skb+0x55/0x280 [ 8664.555954][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8664.556283][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8664.556633][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8664.556951][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8664.557239][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8664.557537][ C0] ? hlock_class+0x4e/0x130 [ 8664.557782][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8664.558109][ C0] ? place_entity+0x21/0x2f0 [ 8664.558352][ C0] ? resched_curr+0x219/0x280 [ 8664.558603][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8664.558875][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8664.559160][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8664.559436][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8664.559693][ C0] ? activate_task+0xf5/0x260 [ 8664.559943][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8664.560217][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8664.560493][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8664.560753][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8664.561042][ C0] ? get_stack_info+0x36/0xc0 [ 8664.561296][ C0] ? stack_access_ok+0xda/0x1f0 [ 8664.561558][ C0] ? get_reg+0x119/0x190 [ 8664.561789][ C0] __tcf_classify+0x32c/0x7d0 [ 8664.562039][ C0] tcf_classify+0x283/0x930 [ 8664.562281][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8664.562609][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8664.562878][ C0] ? arch_stack_walk+0x8c/0x100 [ 8664.563142][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8664.563437][ C0] tc_run+0x2e4/0x5d0 [ 8664.563653][ C0] ? __pfx_tc_run+0x10/0x10 [ 8664.563896][ C0] ? lock_acquire+0x1c1/0x220 [ 8664.564146][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8664.564421][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8664.564700][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8664.564990][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8664.565273][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8664.565596][ C0] ? neigh_hh_output+0x348/0x590 [ 8664.565860][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8664.566142][ C0] ip_finish_output2+0x786/0x18e0 [ 8664.566413][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8664.566710][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8664.567063][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8664.567350][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8664.567619][ C0] ? __ip_finish_output+0x10f/0x770 [ 8664.567896][ C0] ip_output+0x16b/0x4f0 [ 8664.568122][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8664.568407][ C0] ? __pfx_ip_output+0x10/0x10 [ 8664.568663][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8664.568963][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8664.569228][ C0] ? ip_local_out+0x114/0x3b0 [ 8664.569485][ C0] __ip_queue_xmit+0x672/0x1910 [ 8664.569749][ C0] ? __skb_clone+0x57a/0x760 [ 8664.569998][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8664.570285][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8664.570581][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8664.570898][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8664.571165][ C0] ? tcp_current_mss+0x40a/0x510 [ 8664.571427][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8664.571710][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8664.571986][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8664.572242][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8664.572515][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8664.572837][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8664.573114][ C0] ? ktime_get+0xb6/0x190 [ 8664.573344][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8664.573616][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8664.573899][ C0] tcp_write_timer+0x82/0x1d0 [ 8664.574151][ C0] call_timer_fn+0x176/0x430 [ 8664.574399][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8664.574678][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8664.574955][ C0] __run_timers.part.0+0x52d/0x890 [ 8664.575227][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8664.575511][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8664.575810][ C0] ? lock_acquire+0x1c1/0x220 [ 8664.576065][ C0] ? clockevents_program_event+0xf6/0x300 [ 8664.576372][ C0] ? lock_release+0x1d5/0x250 [ 8664.576623][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8664.576902][ C0] ? ktime_get+0xb6/0x190 [ 8664.577137][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8664.577438][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8664.577749][ C0] run_timer_softirq+0x72/0x100 [ 8664.578013][ C0] __do_softirq+0x1bc/0x7ff [ 8664.578261][ C0] irq_exit_rcu+0x98/0xc0 [ 8664.578495][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8664.578798][ C0] [ 8664.578954][ C0] [ 8664.579112][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8664.579430][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8664.579704][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8664.580729][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8664.581055][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8664.581481][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8664.581901][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8664.582325][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8664.582747][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8664.583174][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8664.583480][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8664.583756][ C0] default_idle_call+0x69/0xa0 [ 8664.584010][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8664.584274][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8664.584568][ C0] ? lock_release+0x1d5/0x250 [ 8664.584818][ C0] do_idle+0xfb/0x160 [ 8664.585032][ C0] cpu_startup_entry+0x55/0x60 [ 8664.585287][ C0] rest_init+0x153/0x260 [ 8664.585513][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8664.585796][ C0] arch_call_rest_init+0x13/0x40 [ 8664.586062][ C0] start_kernel+0x314/0x3d0 [ 8664.586308][ C0] x86_64_start_reservations+0x18/0x30 [ 8664.586602][ C0] x86_64_start_kernel+0xba/0x110 [ 8664.586870][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8664.587197][ C0] [ 8664.587362][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6963s! [ksoftirqd/1:22] [ 8664.587824][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8664.589030][ C1] irq event stamp: 3886976 [ 8664.589273][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8664.589776][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8664.590276][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8664.590782][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8664.591283][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8664.591781][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8664.592428][ C1] RIP: 0010:kasan_check_range+0x16/0x1c0 [ 8664.592733][ C1] Code: 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 <48> 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe [ 8664.593769][ C1] RSP: 0018:ffffc9000019e9d8 EFLAGS: 00000202 [ 8664.594099][ C1] RAX: ffff88800a098e18 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8664.594528][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8664.594963][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8664.595382][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8664.595798][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8664.596218][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8664.596687][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8664.597041][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8664.597464][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8664.597891][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8664.598317][ C1] Call Trace: [ 8664.598496][ C1] [ 8664.598656][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8664.598932][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8664.599192][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8664.599485][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8664.599775][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8664.600083][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8664.600366][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8664.600692][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8664.600967][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8664.601297][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8664.601614][ C1] [ 8664.601771][ C1] [ 8664.601929][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8664.602259][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8664.602570][ C1] ? kasan_check_range+0x16/0x1c0 [ 8664.602843][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 8664.603146][ C1] ? run_ksoftirqd+0xb/0x60 [ 8664.603395][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8664.603726][ C1] ? __orc_find+0x9c/0xf0 [ 8664.603958][ C1] ? lock_acquire+0x1c1/0x220 [ 8664.604209][ C1] ? irqentry_enter+0x2b/0x60 [ 8664.604462][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8664.604733][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8664.605023][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8664.605326][ C1] ? lock_acquire+0x1c1/0x220 [ 8664.605579][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8664.605832][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8664.606104][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8664.606354][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8664.606615][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8664.606891][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8664.607185][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8664.607480][ C1] ip_local_deliver+0x19d/0x480 [ 8664.607740][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8664.608024][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8664.608287][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8664.608569][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8664.608835][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8664.609173][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8664.609449][ C1] ip_rcv+0x564/0x740 [ 8664.609666][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8664.609913][ C1] ? set_track_prepare+0x8a/0xd0 [ 8664.610181][ C1] ? irqentry_enter+0x2b/0x60 [ 8664.610433][ C1] ? irqentry_enter+0x2b/0x60 [ 8664.610686][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8664.610926][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8664.611241][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8664.611581][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8664.611891][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8664.612237][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8664.612539][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8664.612874][ C1] netif_receive_skb+0x55/0x280 [ 8664.613133][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8664.613459][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8664.613808][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8664.614127][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8664.614416][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8664.614765][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8664.615103][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8664.615389][ C1] ? arch_stack_walk+0x68/0x100 [ 8664.615651][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8664.615929][ C1] ? irqentry_enter+0x2b/0x60 [ 8664.616182][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8664.616501][ C1] ? irqentry_enter+0x2b/0x60 [ 8664.616755][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8664.617085][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8664.617368][ C1] ? arch_stack_walk+0x68/0x100 [ 8664.617633][ C1] __tcf_classify+0x32c/0x7d0 [ 8664.617888][ C1] tcf_classify+0x283/0x930 [ 8664.618137][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8664.618410][ C1] tc_run+0x2e4/0x5d0 [ 8664.618628][ C1] ? __pfx_tc_run+0x10/0x10 [ 8664.618880][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8664.619152][ C1] ? irqentry_enter+0x2b/0x60 [ 8664.619404][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8664.619690][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8664.620011][ C1] ip_finish_output2+0x786/0x18e0 [ 8664.620288][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8664.620582][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8664.620848][ C1] ? __ip_finish_output+0x10f/0x770 [ 8664.621131][ C1] ip_output+0x16b/0x4f0 [ 8664.621360][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8664.621677][ C1] ? __pfx_ip_output+0x10/0x10 [ 8664.621936][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8664.622289][ C1] ? __pfx_ip_output+0x10/0x10 [ 8664.622545][ C1] __ip_queue_xmit+0x672/0x1910 [ 8664.622809][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8664.623094][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8664.623392][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8664.623680][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8664.623979][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8664.624271][ C1] tcp_delack_timer+0x84/0x240 [ 8664.624532][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8664.624829][ C1] call_timer_fn+0x176/0x430 [ 8664.625081][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8664.625353][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8664.625638][ C1] __run_timers.part.0+0x52d/0x890 [ 8664.625912][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8664.626198][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8664.626498][ C1] ? __pfx___schedule+0x10/0x10 [ 8664.626759][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8664.627085][ C1] run_timer_softirq+0x72/0x100 [ 8664.627344][ C1] __do_softirq+0x1bc/0x7ff [ 8664.627587][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8664.627858][ C1] run_ksoftirqd+0x2e/0x60 [ 8664.628100][ C1] smpboot_thread_fn+0x30e/0x840 [ 8664.628363][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8664.628654][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8664.628943][ C1] kthread+0x292/0x360 [ 8664.629166][ C1] ? __pfx_kthread+0x10/0x10 [ 8664.629412][ C1] ret_from_fork+0x34/0x70 [ 8664.629651][ C1] ? __pfx_kthread+0x10/0x10 [ 8664.629899][ C1] ret_from_fork_asm+0x1b/0x30 [ 8664.630161][ C1] [ 8692.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 6989s! [swapper/0:0] [ 8692.527923][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8692.529127][ C0] irq event stamp: 27567077 [ 8692.529373][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8692.529904][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8692.530378][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8692.530880][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8692.531382][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8692.531864][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8692.532508][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8692.532851][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8692.533874][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8692.534197][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8692.534627][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8692.535049][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8692.535471][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8692.535894][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8692.536320][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8692.536792][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8692.537142][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8692.537570][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8692.537988][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8692.538407][ C0] Call Trace: [ 8692.538584][ C0] [ 8692.538739][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8692.539019][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8692.539275][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8692.539569][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8692.539854][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8692.540157][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8692.540435][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8692.540754][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8692.541032][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8692.541307][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8692.541636][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8692.541951][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8692.542281][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8692.542590][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8692.542905][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8692.543209][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8692.543536][ C0] ? get_stack_info+0x36/0xc0 [ 8692.543794][ C0] ? lock_acquire+0x1c1/0x220 [ 8692.544051][ C0] ? lock_release+0x1d5/0x250 [ 8692.544306][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8692.544576][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8692.544862][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8692.545162][ C0] ? lock_acquire+0x1c1/0x220 [ 8692.545414][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8692.545671][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8692.545947][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8692.546192][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8692.546449][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8692.546716][ C0] ? __inet_lookup_established+0x341/0x610 [ 8692.547029][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8692.547323][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8692.547620][ C0] ip_local_deliver+0x19d/0x480 [ 8692.547880][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8692.548166][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8692.548431][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8692.548712][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8692.548977][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8692.549312][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8692.549590][ C0] ip_rcv+0x564/0x740 [ 8692.549805][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8692.550051][ C0] ? set_track_prepare+0x8a/0xd0 [ 8692.550317][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8692.550606][ C0] ? rest_init+0x153/0x260 [ 8692.550847][ C0] ? skb_clone+0x10b/0x330 [ 8692.551091][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8692.551430][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8692.551751][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8692.552046][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8692.552353][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8692.552611][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8692.552852][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8692.553168][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8692.553466][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8692.553809][ C0] ? lock_acquire+0x1c1/0x220 [ 8692.554061][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8692.554377][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8692.554689][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8692.555020][ C0] ? __copy_skb_header+0xaf/0x490 [ 8692.555288][ C0] ? __skb_clone+0x57a/0x760 [ 8692.555531][ C0] netif_receive_skb+0x55/0x280 [ 8692.555794][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8692.556123][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8692.556476][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8692.556788][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8692.557080][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8692.557381][ C0] ? hlock_class+0x4e/0x130 [ 8692.557629][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8692.557963][ C0] ? place_entity+0x21/0x2f0 [ 8692.558214][ C0] ? resched_curr+0x219/0x280 [ 8692.558465][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8692.558733][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8692.559013][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8692.559296][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8692.559559][ C0] ? activate_task+0xf5/0x260 [ 8692.559813][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8692.560092][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8692.560363][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8692.560626][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8692.560926][ C0] ? get_stack_info+0x36/0xc0 [ 8692.561178][ C0] ? stack_access_ok+0xda/0x1f0 [ 8692.561437][ C0] ? get_reg+0x119/0x190 [ 8692.561662][ C0] __tcf_classify+0x32c/0x7d0 [ 8692.561918][ C0] tcf_classify+0x283/0x930 [ 8692.562165][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8692.562497][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8692.562763][ C0] ? arch_stack_walk+0x8c/0x100 [ 8692.563025][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8692.563316][ C0] tc_run+0x2e4/0x5d0 [ 8692.563532][ C0] ? __pfx_tc_run+0x10/0x10 [ 8692.563776][ C0] ? lock_acquire+0x1c1/0x220 [ 8692.564028][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8692.564307][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8692.564580][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8692.564865][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8692.565143][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8692.565462][ C0] ? neigh_hh_output+0x348/0x590 [ 8692.565731][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8692.566007][ C0] ip_finish_output2+0x786/0x18e0 [ 8692.566275][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8692.566567][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8692.566925][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8692.567222][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8692.567486][ C0] ? __ip_finish_output+0x10f/0x770 [ 8692.567768][ C0] ip_output+0x16b/0x4f0 [ 8692.567996][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8692.568278][ C0] ? __pfx_ip_output+0x10/0x10 [ 8692.568535][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8692.568836][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8692.569103][ C0] ? ip_local_out+0x114/0x3b0 [ 8692.569353][ C0] __ip_queue_xmit+0x672/0x1910 [ 8692.569610][ C0] ? __skb_clone+0x57a/0x760 [ 8692.569854][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8692.570139][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8692.570436][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8692.570759][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8692.571017][ C0] ? tcp_current_mss+0x40a/0x510 [ 8692.571282][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8692.571561][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8692.571840][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8692.572097][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8692.572364][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8692.572680][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8692.572959][ C0] ? ktime_get+0xb6/0x190 [ 8692.573195][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8692.573471][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8692.573751][ C0] tcp_write_timer+0x82/0x1d0 [ 8692.574005][ C0] call_timer_fn+0x176/0x430 [ 8692.574256][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8692.574537][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8692.574810][ C0] __run_timers.part.0+0x52d/0x890 [ 8692.575089][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8692.575375][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8692.575676][ C0] ? lock_acquire+0x1c1/0x220 [ 8692.575925][ C0] ? clockevents_program_event+0xf6/0x300 [ 8692.576230][ C0] ? lock_release+0x1d5/0x250 [ 8692.576482][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8692.576757][ C0] ? ktime_get+0xb6/0x190 [ 8692.576987][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8692.577285][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8692.577601][ C0] run_timer_softirq+0x72/0x100 [ 8692.577861][ C0] __do_softirq+0x1bc/0x7ff [ 8692.578105][ C0] irq_exit_rcu+0x98/0xc0 [ 8692.578335][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8692.578635][ C0] [ 8692.578794][ C0] [ 8692.578954][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8692.579280][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8692.579548][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8692.580570][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8692.580894][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8692.581315][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8692.581735][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8692.582155][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8692.582576][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8692.582994][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8692.583298][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8692.583570][ C0] default_idle_call+0x69/0xa0 [ 8692.583826][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8692.584091][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8692.584386][ C0] ? lock_release+0x1d5/0x250 [ 8692.584651][ C0] do_idle+0xfb/0x160 [ 8692.584866][ C0] cpu_startup_entry+0x55/0x60 [ 8692.585123][ C0] rest_init+0x153/0x260 [ 8692.585350][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8692.585643][ C0] arch_call_rest_init+0x13/0x40 [ 8692.585912][ C0] start_kernel+0x314/0x3d0 [ 8692.586159][ C0] x86_64_start_reservations+0x18/0x30 [ 8692.586451][ C0] x86_64_start_kernel+0xba/0x110 [ 8692.586722][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8692.587054][ C0] [ 8692.587223][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6989s! [ksoftirqd/1:22] [ 8692.587703][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8692.588894][ C1] irq event stamp: 3886976 [ 8692.589130][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8692.589634][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8692.590134][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8692.590637][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8692.591126][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8692.591625][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8692.592276][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8692.592620][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8692.593650][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8692.593979][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8692.594403][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8692.594833][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8692.595254][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8692.595672][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8692.596091][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8692.596558][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8692.596909][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8692.597327][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8692.597747][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8692.598171][ C1] Call Trace: [ 8692.598359][ C1] [ 8692.598517][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8692.598793][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8692.599050][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8692.599340][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8692.599630][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8692.599937][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8692.600221][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8692.600544][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8692.600818][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8692.601150][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8692.601462][ C1] [ 8692.601620][ C1] [ 8692.601776][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8692.602106][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8692.602412][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8692.602726][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8692.603026][ C1] ? run_ksoftirqd+0xb/0x60 [ 8692.603269][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8692.603594][ C1] ? __orc_find+0x9c/0xf0 [ 8692.603827][ C1] ? lock_acquire+0x1c1/0x220 [ 8692.604085][ C1] ? irqentry_enter+0x2b/0x60 [ 8692.604342][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8692.604610][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8692.604896][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8692.605193][ C1] ? lock_acquire+0x1c1/0x220 [ 8692.605443][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8692.605698][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8692.605974][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8692.606222][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8692.606481][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8692.606751][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8692.607040][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8692.607330][ C1] ip_local_deliver+0x19d/0x480 [ 8692.607596][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8692.607892][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8692.608161][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8692.608437][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8692.608699][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8692.609040][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8692.609316][ C1] ip_rcv+0x564/0x740 [ 8692.609530][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8692.609770][ C1] ? set_track_prepare+0x8a/0xd0 [ 8692.610036][ C1] ? irqentry_enter+0x2b/0x60 [ 8692.610290][ C1] ? irqentry_enter+0x2b/0x60 [ 8692.610544][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8692.610788][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8692.611109][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8692.611454][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8692.611766][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8692.612106][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8692.612406][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8692.612743][ C1] netif_receive_skb+0x55/0x280 [ 8692.613007][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8692.613343][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8692.613692][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8692.614007][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8692.614303][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8692.614616][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8692.614943][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8692.615221][ C1] ? arch_stack_walk+0x68/0x100 [ 8692.615485][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8692.615764][ C1] ? irqentry_enter+0x2b/0x60 [ 8692.616017][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8692.616341][ C1] ? irqentry_enter+0x2b/0x60 [ 8692.616592][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8692.616913][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8692.617197][ C1] ? arch_stack_walk+0x68/0x100 [ 8692.617455][ C1] __tcf_classify+0x32c/0x7d0 [ 8692.617708][ C1] tcf_classify+0x283/0x930 [ 8692.617949][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8692.618217][ C1] tc_run+0x2e4/0x5d0 [ 8692.618430][ C1] ? __pfx_tc_run+0x10/0x10 [ 8692.618673][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8692.618939][ C1] ? irqentry_enter+0x2b/0x60 [ 8692.619198][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8692.619485][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8692.619811][ C1] ip_finish_output2+0x786/0x18e0 [ 8692.620082][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8692.620371][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8692.620640][ C1] ? __ip_finish_output+0x10f/0x770 [ 8692.620917][ C1] ip_output+0x16b/0x4f0 [ 8692.621145][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8692.621469][ C1] ? __pfx_ip_output+0x10/0x10 [ 8692.621726][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8692.622088][ C1] ? __pfx_ip_output+0x10/0x10 [ 8692.622350][ C1] __ip_queue_xmit+0x672/0x1910 [ 8692.622612][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8692.622894][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8692.623194][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8692.623480][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8692.623780][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8692.624064][ C1] tcp_delack_timer+0x84/0x240 [ 8692.624318][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8692.624614][ C1] call_timer_fn+0x176/0x430 [ 8692.624862][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8692.625142][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8692.625419][ C1] __run_timers.part.0+0x52d/0x890 [ 8692.625691][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8692.625982][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8692.626286][ C1] ? __pfx___schedule+0x10/0x10 [ 8692.626546][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8692.626869][ C1] run_timer_softirq+0x72/0x100 [ 8692.627133][ C1] __do_softirq+0x1bc/0x7ff [ 8692.627380][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8692.627658][ C1] run_ksoftirqd+0x2e/0x60 [ 8692.627897][ C1] smpboot_thread_fn+0x30e/0x840 [ 8692.628169][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8692.628460][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8692.628756][ C1] kthread+0x292/0x360 [ 8692.628974][ C1] ? __pfx_kthread+0x10/0x10 [ 8692.629224][ C1] ret_from_fork+0x34/0x70 [ 8692.629462][ C1] ? __pfx_kthread+0x10/0x10 [ 8692.629711][ C1] ret_from_fork_asm+0x1b/0x30 [ 8692.629973][ C1] [ 8716.562023][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8716.562409][ C0] rcu: 0-....: (7465377 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1781113 [ 8716.562933][ C0] rcu: (t=7522253 jiffies g=1007429 q=31 ncpus=4) [ 8716.563281][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8716.563761][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8716.564420][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8716.564763][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8716.565777][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8716.566099][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8716.566517][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8716.566934][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8716.567354][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8716.567771][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8716.568190][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8716.568659][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8716.569010][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8716.569433][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8716.569859][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8716.570286][ C0] Call Trace: [ 8716.570464][ C0] [ 8716.570623][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8716.570906][ C0] ? print_cpu_stall+0x263/0x6a0 [ 8716.571172][ C0] ? check_cpu_stall+0x284/0x500 [ 8716.571435][ C0] ? rcu_pending+0x92/0x360 [ 8716.571679][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8716.571962][ C0] ? update_process_times+0xb9/0x110 [ 8716.572243][ C0] ? tick_sched_handle+0x67/0x130 [ 8716.572516][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8716.572816][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8716.573068][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8716.573400][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8716.573684][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8716.573984][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8716.574262][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8716.574589][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8716.574863][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8716.575143][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8716.575467][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8716.575775][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8716.576110][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8716.576412][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8716.576720][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8716.577025][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8716.577352][ C0] ? get_stack_info+0x36/0xc0 [ 8716.577601][ C0] ? lock_acquire+0x1c1/0x220 [ 8716.577848][ C0] ? lock_release+0x1d5/0x250 [ 8716.578096][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8716.578356][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8716.578640][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8716.578942][ C0] ? lock_acquire+0x1c1/0x220 [ 8716.579195][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8716.579449][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8716.579724][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8716.579967][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8716.580226][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8716.580493][ C0] ? __inet_lookup_established+0x341/0x610 [ 8716.580806][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8716.581099][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8716.581395][ C0] ip_local_deliver+0x19d/0x480 [ 8716.581658][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8716.581942][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8716.582206][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8716.582486][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8716.582751][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8716.583084][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8716.583366][ C0] ip_rcv+0x564/0x740 [ 8716.583579][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8716.583824][ C0] ? set_track_prepare+0x8a/0xd0 [ 8716.584091][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8716.584385][ C0] ? rest_init+0x153/0x260 [ 8716.584620][ C0] ? skb_clone+0x10b/0x330 [ 8716.584861][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8716.585194][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8716.585511][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8716.585808][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8716.586122][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8716.586383][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8716.586627][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8716.586944][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8716.587248][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8716.587585][ C0] ? lock_acquire+0x1c1/0x220 [ 8716.587832][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8716.588142][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8716.588444][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8716.588773][ C0] ? __copy_skb_header+0xaf/0x490 [ 8716.589040][ C0] ? __skb_clone+0x57a/0x760 [ 8716.589284][ C0] netif_receive_skb+0x55/0x280 [ 8716.589546][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8716.589876][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8716.590230][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8716.590541][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8716.590831][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8716.591135][ C0] ? hlock_class+0x4e/0x130 [ 8716.591381][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8716.591716][ C0] ? place_entity+0x21/0x2f0 [ 8716.591966][ C0] ? resched_curr+0x219/0x280 [ 8716.592218][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8716.592484][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8716.592763][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8716.593046][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8716.593308][ C0] ? activate_task+0xf5/0x260 [ 8716.593560][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8716.593836][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8716.594108][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8716.594377][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8716.594666][ C0] ? get_stack_info+0x36/0xc0 [ 8716.594921][ C0] ? stack_access_ok+0xda/0x1f0 [ 8716.595187][ C0] ? get_reg+0x119/0x190 [ 8716.595415][ C0] __tcf_classify+0x32c/0x7d0 [ 8716.595663][ C0] tcf_classify+0x283/0x930 [ 8716.595903][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8716.596235][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8716.596505][ C0] ? arch_stack_walk+0x8c/0x100 [ 8716.596772][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8716.597067][ C0] tc_run+0x2e4/0x5d0 [ 8716.597280][ C0] ? __pfx_tc_run+0x10/0x10 [ 8716.597521][ C0] ? lock_acquire+0x1c1/0x220 [ 8716.597771][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8716.598046][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8716.598316][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8716.598600][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8716.598876][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8716.599195][ C0] ? neigh_hh_output+0x348/0x590 [ 8716.599463][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8716.599739][ C0] ip_finish_output2+0x786/0x18e0 [ 8716.600005][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8716.600298][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8716.600654][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8716.600947][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8716.601212][ C0] ? __ip_finish_output+0x10f/0x770 [ 8716.601494][ C0] ip_output+0x16b/0x4f0 [ 8716.601720][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8716.601999][ C0] ? __pfx_ip_output+0x10/0x10 [ 8716.602256][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8716.602556][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8716.602822][ C0] ? ip_local_out+0x114/0x3b0 [ 8716.603072][ C0] __ip_queue_xmit+0x672/0x1910 [ 8716.603330][ C0] ? __skb_clone+0x57a/0x760 [ 8716.603573][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8716.603857][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8716.604156][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8716.604489][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8716.604749][ C0] ? tcp_current_mss+0x40a/0x510 [ 8716.605011][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8716.605296][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8716.605571][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8716.605824][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8716.606097][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8716.606418][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8716.606693][ C0] ? ktime_get+0xb6/0x190 [ 8716.606923][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8716.607196][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8716.607479][ C0] tcp_write_timer+0x82/0x1d0 [ 8716.607728][ C0] call_timer_fn+0x176/0x430 [ 8716.607973][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8716.608250][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8716.608521][ C0] __run_timers.part.0+0x52d/0x890 [ 8716.608796][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8716.609081][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8716.609382][ C0] ? lock_acquire+0x1c1/0x220 [ 8716.609629][ C0] ? clockevents_program_event+0xf6/0x300 [ 8716.609931][ C0] ? lock_release+0x1d5/0x250 [ 8716.610182][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8716.610457][ C0] ? ktime_get+0xb6/0x190 [ 8716.610686][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8716.610983][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8716.611298][ C0] run_timer_softirq+0x72/0x100 [ 8716.611557][ C0] __do_softirq+0x1bc/0x7ff [ 8716.611799][ C0] irq_exit_rcu+0x98/0xc0 [ 8716.612028][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8716.612327][ C0] [ 8716.612486][ C0] [ 8716.612645][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8716.612967][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8716.613235][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8716.614252][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8716.614585][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8716.615006][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8716.615429][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8716.615852][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8716.616278][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8716.616700][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8716.617007][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8716.617285][ C0] default_idle_call+0x69/0xa0 [ 8716.617536][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8716.617801][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8716.618094][ C0] ? lock_release+0x1d5/0x250 [ 8716.618351][ C0] do_idle+0xfb/0x160 [ 8716.618566][ C0] cpu_startup_entry+0x55/0x60 [ 8716.618822][ C0] rest_init+0x153/0x260 [ 8716.619049][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8716.619339][ C0] arch_call_rest_init+0x13/0x40 [ 8716.619607][ C0] start_kernel+0x314/0x3d0 [ 8716.619848][ C0] x86_64_start_reservations+0x18/0x30 [ 8716.620139][ C0] x86_64_start_kernel+0xba/0x110 [ 8716.620412][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8716.620741][ C0] [ 8716.620919][ C0] Sending NMI from CPU 0 to CPUs 1: [ 8716.621225][ C1] NMI backtrace for cpu 1 [ 8716.621235][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8716.621241][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8716.621244][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8716.621254][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8716.621258][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8716.621262][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8716.621264][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8716.621266][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8716.621268][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8716.621270][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8716.621272][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8716.621275][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8716.621278][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8716.621280][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8716.621282][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8716.621283][ C1] Call Trace: [ 8716.621288][ C1] [ 8716.621292][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 8716.621299][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8716.621305][ C1] ? nmi_handle+0x156/0x420 [ 8716.621310][ C1] ? default_do_nmi+0x41/0x100 [ 8716.621315][ C1] ? exc_nmi+0xf3/0x120 [ 8716.621317][ C1] ? end_repeat_nmi+0xf/0x60 [ 8716.621322][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8716.621326][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8716.621330][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8716.621333][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8716.621336][ C1] [ 8716.621337][ C1] [ 8716.621338][ C1] ? run_ksoftirqd+0xb/0x60 [ 8716.621344][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8716.621348][ C1] ? __orc_find+0x9c/0xf0 [ 8716.621351][ C1] ? lock_acquire+0x1c1/0x220 [ 8716.621356][ C1] ? irqentry_enter+0x2b/0x60 [ 8716.621362][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8716.621366][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8716.621369][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8716.621373][ C1] ? lock_acquire+0x1c1/0x220 [ 8716.621375][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8716.621380][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8716.621384][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8716.621392][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8716.621395][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8716.621401][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8716.621409][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8716.621413][ C1] ip_local_deliver+0x19d/0x480 [ 8716.621416][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8716.621419][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8716.621424][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8716.621429][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8716.621431][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8716.621435][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8716.621445][ C1] ip_rcv+0x564/0x740 [ 8716.621449][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8716.621452][ C1] ? set_track_prepare+0x8a/0xd0 [ 8716.621457][ C1] ? irqentry_enter+0x2b/0x60 [ 8716.621460][ C1] ? irqentry_enter+0x2b/0x60 [ 8716.621464][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8716.621467][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8716.621471][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8716.621475][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8716.621478][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8716.621481][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8716.621484][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8716.621489][ C1] netif_receive_skb+0x55/0x280 [ 8716.621493][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8716.621501][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8716.621508][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8716.621515][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8716.621522][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8716.621534][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8716.621544][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8716.621546][ C1] ? arch_stack_walk+0x68/0x100 [ 8716.621552][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8716.621555][ C1] ? irqentry_enter+0x2b/0x60 [ 8716.621559][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8716.621564][ C1] ? irqentry_enter+0x2b/0x60 [ 8716.621568][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8716.621575][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8716.621578][ C1] ? arch_stack_walk+0x68/0x100 [ 8716.621582][ C1] __tcf_classify+0x32c/0x7d0 [ 8716.621588][ C1] tcf_classify+0x283/0x930 [ 8716.621592][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8716.621596][ C1] tc_run+0x2e4/0x5d0 [ 8716.621602][ C1] ? __pfx_tc_run+0x10/0x10 [ 8716.621607][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8716.621613][ C1] ? irqentry_enter+0x2b/0x60 [ 8716.621616][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8716.621619][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8716.621626][ C1] ip_finish_output2+0x786/0x18e0 [ 8716.621632][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8716.621635][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8716.621639][ C1] ? __ip_finish_output+0x10f/0x770 [ 8716.621643][ C1] ip_output+0x16b/0x4f0 [ 8716.621646][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8716.621649][ C1] ? __pfx_ip_output+0x10/0x10 [ 8716.621654][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8716.621661][ C1] ? __pfx_ip_output+0x10/0x10 [ 8716.621665][ C1] __ip_queue_xmit+0x672/0x1910 [ 8716.621671][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8716.621678][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8716.621682][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8716.621686][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8716.621690][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8716.621693][ C1] tcp_delack_timer+0x84/0x240 [ 8716.621697][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8716.621700][ C1] call_timer_fn+0x176/0x430 [ 8716.621706][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8716.621711][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8716.621715][ C1] __run_timers.part.0+0x52d/0x890 [ 8716.621718][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8716.621723][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8716.621728][ C1] ? __pfx___schedule+0x10/0x10 [ 8716.621732][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8716.621737][ C1] run_timer_softirq+0x72/0x100 [ 8716.621740][ C1] __do_softirq+0x1bc/0x7ff [ 8716.621744][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8716.621748][ C1] run_ksoftirqd+0x2e/0x60 [ 8716.621751][ C1] smpboot_thread_fn+0x30e/0x840 [ 8716.621756][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8716.621759][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8716.621762][ C1] kthread+0x292/0x360 [ 8716.621766][ C1] ? __pfx_kthread+0x10/0x10 [ 8716.621768][ C1] ret_from_fork+0x34/0x70 [ 8716.621772][ C1] ? __pfx_kthread+0x10/0x10 [ 8716.621774][ C1] ret_from_fork_asm+0x1b/0x30 [ 8716.621783][ C1] [ 8744.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7037s! [swapper/0:0] [ 8744.527925][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8744.529116][ C0] irq event stamp: 27567077 [ 8744.529355][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8744.529893][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8744.530367][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8744.530869][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8744.531365][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8744.531845][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8744.532496][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8744.532844][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8744.533866][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8744.534200][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8744.534619][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8744.535042][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8744.535463][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8744.535886][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8744.536309][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8744.536778][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8744.537124][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8744.537547][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8744.537964][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8744.538385][ C0] Call Trace: [ 8744.538566][ C0] [ 8744.538721][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8744.539001][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8744.539255][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8744.539546][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8744.539830][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8744.540131][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8744.540410][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8744.540728][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8744.541004][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8744.541280][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8744.541606][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8744.541922][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8744.542251][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8744.542560][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8744.542871][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8744.543174][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8744.543500][ C0] ? get_stack_info+0x36/0xc0 [ 8744.543758][ C0] ? lock_acquire+0x1c1/0x220 [ 8744.544015][ C0] ? lock_release+0x1d5/0x250 [ 8744.544277][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8744.544537][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8744.544822][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8744.545120][ C0] ? lock_acquire+0x1c1/0x220 [ 8744.545373][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8744.545627][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8744.545903][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8744.546151][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8744.546409][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8744.546675][ C0] ? __inet_lookup_established+0x341/0x610 [ 8744.546988][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8744.547285][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8744.547577][ C0] ip_local_deliver+0x19d/0x480 [ 8744.547835][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8744.548117][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8744.548380][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8744.548661][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8744.548927][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8744.549264][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8744.549544][ C0] ip_rcv+0x564/0x740 [ 8744.549756][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8744.549995][ C0] ? set_track_prepare+0x8a/0xd0 [ 8744.550258][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8744.550550][ C0] ? rest_init+0x153/0x260 [ 8744.550788][ C0] ? skb_clone+0x10b/0x330 [ 8744.551029][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8744.551362][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8744.551679][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8744.551979][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8744.552290][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8744.552552][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8744.552795][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8744.553115][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8744.553416][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8744.553752][ C0] ? lock_acquire+0x1c1/0x220 [ 8744.553998][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8744.554312][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8744.554612][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8744.554945][ C0] ? __copy_skb_header+0xaf/0x490 [ 8744.555215][ C0] ? __skb_clone+0x57a/0x760 [ 8744.555463][ C0] netif_receive_skb+0x55/0x280 [ 8744.555720][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8744.556044][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8744.556391][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8744.556704][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8744.556989][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8744.557286][ C0] ? hlock_class+0x4e/0x130 [ 8744.557529][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8744.557858][ C0] ? place_entity+0x21/0x2f0 [ 8744.558109][ C0] ? resched_curr+0x219/0x280 [ 8744.558365][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8744.558635][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8744.558917][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8744.559193][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8744.559451][ C0] ? activate_task+0xf5/0x260 [ 8744.559699][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8744.559973][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8744.560249][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8744.560507][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8744.560797][ C0] ? get_stack_info+0x36/0xc0 [ 8744.561054][ C0] ? stack_access_ok+0xda/0x1f0 [ 8744.561314][ C0] ? get_reg+0x119/0x190 [ 8744.561543][ C0] __tcf_classify+0x32c/0x7d0 [ 8744.561794][ C0] tcf_classify+0x283/0x930 [ 8744.562036][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8744.562361][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8744.562633][ C0] ? arch_stack_walk+0x8c/0x100 [ 8744.562900][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8744.563193][ C0] tc_run+0x2e4/0x5d0 [ 8744.563406][ C0] ? __pfx_tc_run+0x10/0x10 [ 8744.563646][ C0] ? lock_acquire+0x1c1/0x220 [ 8744.563893][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8744.564172][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8744.564438][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8744.564725][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8744.565006][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8744.565327][ C0] ? neigh_hh_output+0x348/0x590 [ 8744.565591][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8744.565872][ C0] ip_finish_output2+0x786/0x18e0 [ 8744.566145][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8744.566439][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8744.566793][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8744.567084][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8744.567354][ C0] ? __ip_finish_output+0x10f/0x770 [ 8744.567630][ C0] ip_output+0x16b/0x4f0 [ 8744.567854][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8744.568141][ C0] ? __pfx_ip_output+0x10/0x10 [ 8744.568396][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8744.568701][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8744.568963][ C0] ? ip_local_out+0x114/0x3b0 [ 8744.569216][ C0] __ip_queue_xmit+0x672/0x1910 [ 8744.569480][ C0] ? __skb_clone+0x57a/0x760 [ 8744.569729][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8744.570007][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8744.570301][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8744.570617][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8744.570876][ C0] ? tcp_current_mss+0x40a/0x510 [ 8744.571139][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8744.571422][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8744.571696][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8744.571946][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8744.572219][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8744.572538][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8744.572813][ C0] ? ktime_get+0xb6/0x190 [ 8744.573045][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8744.573317][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8744.573600][ C0] tcp_write_timer+0x82/0x1d0 [ 8744.573848][ C0] call_timer_fn+0x176/0x430 [ 8744.574094][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8744.574376][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8744.574652][ C0] __run_timers.part.0+0x52d/0x890 [ 8744.574924][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8744.575210][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8744.575509][ C0] ? lock_acquire+0x1c1/0x220 [ 8744.575760][ C0] ? clockevents_program_event+0xf6/0x300 [ 8744.576074][ C0] ? lock_release+0x1d5/0x250 [ 8744.576328][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8744.576611][ C0] ? ktime_get+0xb6/0x190 [ 8744.576846][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8744.577149][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8744.577458][ C0] run_timer_softirq+0x72/0x100 [ 8744.577720][ C0] __do_softirq+0x1bc/0x7ff [ 8744.577966][ C0] irq_exit_rcu+0x98/0xc0 [ 8744.578200][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8744.578502][ C0] [ 8744.578658][ C0] [ 8744.578814][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8744.579135][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8744.579406][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8744.580430][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8744.580755][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8744.581176][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8744.581598][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8744.582021][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8744.582439][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8744.582859][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8744.583167][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8744.583441][ C0] default_idle_call+0x69/0xa0 [ 8744.583694][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8744.583962][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8744.584259][ C0] ? lock_release+0x1d5/0x250 [ 8744.584511][ C0] do_idle+0xfb/0x160 [ 8744.584721][ C0] cpu_startup_entry+0x55/0x60 [ 8744.584972][ C0] rest_init+0x153/0x260 [ 8744.585202][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8744.585490][ C0] arch_call_rest_init+0x13/0x40 [ 8744.585753][ C0] start_kernel+0x314/0x3d0 [ 8744.585998][ C0] x86_64_start_reservations+0x18/0x30 [ 8744.586291][ C0] x86_64_start_kernel+0xba/0x110 [ 8744.586558][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8744.586880][ C0] [ 8744.587044][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7037s! [ksoftirqd/1:22] [ 8744.587519][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8744.588711][ C1] irq event stamp: 3886976 [ 8744.588949][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8744.589453][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8744.589956][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8744.590460][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8744.590951][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8744.591451][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8744.592099][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8744.592445][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8744.593472][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8744.593797][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8744.594230][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8744.594649][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8744.595066][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8744.595483][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8744.595903][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8744.596373][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8744.596726][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8744.597156][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8744.597584][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8744.598006][ C1] Call Trace: [ 8744.598187][ C1] [ 8744.598348][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8744.598626][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8744.598884][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8744.599176][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8744.599466][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8744.599771][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8744.600056][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8744.600382][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8744.600657][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8744.600985][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8744.601301][ C1] [ 8744.601458][ C1] [ 8744.601615][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8744.601945][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8744.602255][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8744.602568][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8744.602872][ C1] ? run_ksoftirqd+0xb/0x60 [ 8744.603118][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8744.603444][ C1] ? __orc_find+0x9c/0xf0 [ 8744.603680][ C1] ? lock_acquire+0x1c1/0x220 [ 8744.603934][ C1] ? irqentry_enter+0x2b/0x60 [ 8744.604194][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8744.604453][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8744.604742][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8744.605042][ C1] ? lock_acquire+0x1c1/0x220 [ 8744.605298][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8744.605558][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8744.605833][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8744.606080][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8744.606338][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8744.606608][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8744.606899][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8744.607193][ C1] ip_local_deliver+0x19d/0x480 [ 8744.607455][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8744.607743][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8744.608013][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8744.608291][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8744.608555][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8744.608895][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8744.609172][ C1] ip_rcv+0x564/0x740 [ 8744.609387][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8744.609628][ C1] ? set_track_prepare+0x8a/0xd0 [ 8744.609899][ C1] ? irqentry_enter+0x2b/0x60 [ 8744.610156][ C1] ? irqentry_enter+0x2b/0x60 [ 8744.610413][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8744.610659][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8744.610984][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8744.611329][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8744.611644][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8744.611983][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8744.612282][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8744.612624][ C1] netif_receive_skb+0x55/0x280 [ 8744.612889][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8744.613222][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8744.613577][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8744.613891][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8744.614190][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8744.614495][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8744.614825][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8744.615109][ C1] ? arch_stack_walk+0x68/0x100 [ 8744.615374][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8744.615655][ C1] ? irqentry_enter+0x2b/0x60 [ 8744.615911][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8744.616232][ C1] ? irqentry_enter+0x2b/0x60 [ 8744.616480][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8744.616802][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8744.617086][ C1] ? arch_stack_walk+0x68/0x100 [ 8744.617348][ C1] __tcf_classify+0x32c/0x7d0 [ 8744.617599][ C1] tcf_classify+0x283/0x930 [ 8744.617841][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8744.618110][ C1] tc_run+0x2e4/0x5d0 [ 8744.618325][ C1] ? __pfx_tc_run+0x10/0x10 [ 8744.618569][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8744.618836][ C1] ? irqentry_enter+0x2b/0x60 [ 8744.619093][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8744.619384][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8744.619707][ C1] ip_finish_output2+0x786/0x18e0 [ 8744.619978][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8744.620272][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8744.620539][ C1] ? __ip_finish_output+0x10f/0x770 [ 8744.620816][ C1] ip_output+0x16b/0x4f0 [ 8744.621044][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8744.621363][ C1] ? __pfx_ip_output+0x10/0x10 [ 8744.621619][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8744.621977][ C1] ? __pfx_ip_output+0x10/0x10 [ 8744.622238][ C1] __ip_queue_xmit+0x672/0x1910 [ 8744.622499][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8744.622784][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8744.623080][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8744.623366][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8744.623664][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8744.623952][ C1] tcp_delack_timer+0x84/0x240 [ 8744.624215][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8744.624502][ C1] call_timer_fn+0x176/0x430 [ 8744.624753][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8744.625032][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8744.625310][ C1] __run_timers.part.0+0x52d/0x890 [ 8744.625588][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8744.625881][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8744.626188][ C1] ? __pfx___schedule+0x10/0x10 [ 8744.626449][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8744.626772][ C1] run_timer_softirq+0x72/0x100 [ 8744.627036][ C1] __do_softirq+0x1bc/0x7ff [ 8744.627284][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8744.627559][ C1] run_ksoftirqd+0x2e/0x60 [ 8744.627797][ C1] smpboot_thread_fn+0x30e/0x840 [ 8744.628066][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8744.628356][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8744.628651][ C1] kthread+0x292/0x360 [ 8744.628872][ C1] ? __pfx_kthread+0x10/0x10 [ 8744.629122][ C1] ret_from_fork+0x34/0x70 [ 8744.629367][ C1] ? __pfx_kthread+0x10/0x10 [ 8744.629617][ C1] ret_from_fork_asm+0x1b/0x30 [ 8744.629877][ C1] [ 8772.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7064s! [swapper/0:0] [ 8772.527916][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8772.529107][ C0] irq event stamp: 27567077 [ 8772.529347][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8772.529873][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8772.530356][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8772.530860][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8772.531356][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8772.531837][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8772.532477][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8772.532814][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8772.533832][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8772.534160][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8772.534583][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8772.535008][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8772.535430][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8772.535849][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8772.536274][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8772.536750][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8772.537098][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8772.537526][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8772.537945][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8772.538363][ C0] Call Trace: [ 8772.538540][ C0] [ 8772.538696][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8772.538973][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8772.539231][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8772.539524][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8772.539809][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8772.540110][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8772.540385][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8772.540705][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8772.540980][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8772.541255][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8772.541584][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8772.541895][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8772.542226][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8772.542533][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8772.542846][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8772.543148][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8772.543471][ C0] ? get_stack_info+0x36/0xc0 [ 8772.543725][ C0] ? lock_acquire+0x1c1/0x220 [ 8772.543978][ C0] ? lock_release+0x1d5/0x250 [ 8772.544239][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8772.544499][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8772.544781][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8772.545080][ C0] ? lock_acquire+0x1c1/0x220 [ 8772.545334][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8772.545591][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8772.545865][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8772.546109][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8772.546363][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8772.546629][ C0] ? __inet_lookup_established+0x341/0x610 [ 8772.546939][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8772.547230][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8772.547521][ C0] ip_local_deliver+0x19d/0x480 [ 8772.547779][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8772.548068][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8772.548332][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8772.548614][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8772.548879][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8772.549214][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8772.549493][ C0] ip_rcv+0x564/0x740 [ 8772.549709][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8772.549955][ C0] ? set_track_prepare+0x8a/0xd0 [ 8772.550224][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8772.550511][ C0] ? rest_init+0x153/0x260 [ 8772.550751][ C0] ? skb_clone+0x10b/0x330 [ 8772.550989][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8772.551332][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8772.551655][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8772.551948][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8772.552255][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8772.552514][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8772.552754][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8772.553066][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8772.553366][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8772.553708][ C0] ? lock_acquire+0x1c1/0x220 [ 8772.553960][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8772.554278][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8772.554580][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8772.554910][ C0] ? __copy_skb_header+0xaf/0x490 [ 8772.555179][ C0] ? __skb_clone+0x57a/0x760 [ 8772.555423][ C0] netif_receive_skb+0x55/0x280 [ 8772.555683][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8772.556015][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8772.556367][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8772.556681][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8772.556973][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8772.557277][ C0] ? hlock_class+0x4e/0x130 [ 8772.557526][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8772.557858][ C0] ? place_entity+0x21/0x2f0 [ 8772.558110][ C0] ? resched_curr+0x219/0x280 [ 8772.558357][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8772.558624][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8772.558907][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8772.559188][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8772.559455][ C0] ? activate_task+0xf5/0x260 [ 8772.559710][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8772.559986][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8772.560258][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8772.560519][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8772.560815][ C0] ? get_stack_info+0x36/0xc0 [ 8772.561064][ C0] ? stack_access_ok+0xda/0x1f0 [ 8772.561321][ C0] ? get_reg+0x119/0x190 [ 8772.561547][ C0] __tcf_classify+0x32c/0x7d0 [ 8772.561801][ C0] tcf_classify+0x283/0x930 [ 8772.562048][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8772.562381][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8772.562646][ C0] ? arch_stack_walk+0x8c/0x100 [ 8772.562906][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8772.563198][ C0] tc_run+0x2e4/0x5d0 [ 8772.563415][ C0] ? __pfx_tc_run+0x10/0x10 [ 8772.563662][ C0] ? lock_acquire+0x1c1/0x220 [ 8772.563919][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8772.564206][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8772.564476][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8772.564761][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8772.565039][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8772.565356][ C0] ? neigh_hh_output+0x348/0x590 [ 8772.565622][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8772.565898][ C0] ip_finish_output2+0x786/0x18e0 [ 8772.566166][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8772.566460][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8772.566817][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8772.567109][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8772.567373][ C0] ? __ip_finish_output+0x10f/0x770 [ 8772.567653][ C0] ip_output+0x16b/0x4f0 [ 8772.567885][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8772.568167][ C0] ? __pfx_ip_output+0x10/0x10 [ 8772.568425][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8772.568722][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8772.568991][ C0] ? ip_local_out+0x114/0x3b0 [ 8772.569243][ C0] __ip_queue_xmit+0x672/0x1910 [ 8772.569503][ C0] ? __skb_clone+0x57a/0x760 [ 8772.569748][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8772.570034][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8772.570333][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8772.570657][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8772.570915][ C0] ? tcp_current_mss+0x40a/0x510 [ 8772.571183][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8772.571462][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8772.571742][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8772.571999][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8772.572266][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8772.572582][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8772.572863][ C0] ? ktime_get+0xb6/0x190 [ 8772.573098][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8772.573374][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8772.573653][ C0] tcp_write_timer+0x82/0x1d0 [ 8772.573908][ C0] call_timer_fn+0x176/0x430 [ 8772.574167][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8772.574443][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8772.574715][ C0] __run_timers.part.0+0x52d/0x890 [ 8772.574990][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8772.575272][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8772.575576][ C0] ? lock_acquire+0x1c1/0x220 [ 8772.575825][ C0] ? clockevents_program_event+0xf6/0x300 [ 8772.576129][ C0] ? lock_release+0x1d5/0x250 [ 8772.576376][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8772.576651][ C0] ? ktime_get+0xb6/0x190 [ 8772.576881][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8772.577179][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8772.577495][ C0] run_timer_softirq+0x72/0x100 [ 8772.577754][ C0] __do_softirq+0x1bc/0x7ff [ 8772.577999][ C0] irq_exit_rcu+0x98/0xc0 [ 8772.578230][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8772.578528][ C0] [ 8772.578687][ C0] [ 8772.578850][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8772.579171][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8772.579438][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8772.580456][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8772.580779][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8772.581200][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8772.581618][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8772.582037][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8772.582456][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8772.582876][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8772.583179][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8772.583451][ C0] default_idle_call+0x69/0xa0 [ 8772.583707][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8772.583969][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8772.584272][ C0] ? lock_release+0x1d5/0x250 [ 8772.584528][ C0] do_idle+0xfb/0x160 [ 8772.584748][ C0] cpu_startup_entry+0x55/0x60 [ 8772.585006][ C0] rest_init+0x153/0x260 [ 8772.585231][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8772.585522][ C0] arch_call_rest_init+0x13/0x40 [ 8772.585795][ C0] start_kernel+0x314/0x3d0 [ 8772.586039][ C0] x86_64_start_reservations+0x18/0x30 [ 8772.586330][ C0] x86_64_start_kernel+0xba/0x110 [ 8772.586600][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8772.586931][ C0] [ 8772.587098][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7064s! [ksoftirqd/1:22] [ 8772.587579][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8772.588764][ C1] irq event stamp: 3886976 [ 8772.589002][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8772.589506][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8772.590007][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8772.590512][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8772.591003][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8772.591500][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8772.592149][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8772.592495][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8772.593521][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8772.593848][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8772.594278][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8772.594696][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8772.595113][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8772.595529][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8772.595946][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8772.596415][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8772.596768][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8772.597192][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8772.597621][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8772.598041][ C1] Call Trace: [ 8772.598221][ C1] [ 8772.598381][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8772.598657][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8772.598915][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8772.599206][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8772.599494][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8772.599798][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8772.600082][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8772.600413][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8772.600688][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8772.601014][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8772.601332][ C1] [ 8772.601489][ C1] [ 8772.601650][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8772.601979][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8772.602289][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8772.602603][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8772.602905][ C1] ? run_ksoftirqd+0xb/0x60 [ 8772.603156][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8772.603481][ C1] ? __orc_find+0x9c/0xf0 [ 8772.603717][ C1] ? lock_acquire+0x1c1/0x220 [ 8772.603970][ C1] ? irqentry_enter+0x2b/0x60 [ 8772.604232][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8772.604490][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8772.604774][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8772.605074][ C1] ? lock_acquire+0x1c1/0x220 [ 8772.605328][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8772.605587][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8772.605863][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8772.606108][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8772.606366][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8772.606637][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8772.606927][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8772.607220][ C1] ip_local_deliver+0x19d/0x480 [ 8772.607481][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8772.607769][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8772.608039][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8772.608317][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8772.608581][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8772.608920][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8772.609196][ C1] ip_rcv+0x564/0x740 [ 8772.609411][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8772.609651][ C1] ? set_track_prepare+0x8a/0xd0 [ 8772.609918][ C1] ? irqentry_enter+0x2b/0x60 [ 8772.610174][ C1] ? irqentry_enter+0x2b/0x60 [ 8772.610430][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8772.610676][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8772.610995][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8772.611339][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8772.611654][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8772.611993][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8772.612292][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8772.612628][ C1] netif_receive_skb+0x55/0x280 [ 8772.612891][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8772.613224][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8772.613579][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8772.613893][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8772.614195][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8772.614498][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8772.614828][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8772.615111][ C1] ? arch_stack_walk+0x68/0x100 [ 8772.615377][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8772.615658][ C1] ? irqentry_enter+0x2b/0x60 [ 8772.615913][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8772.616239][ C1] ? irqentry_enter+0x2b/0x60 [ 8772.616488][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8772.616809][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8772.617093][ C1] ? arch_stack_walk+0x68/0x100 [ 8772.617355][ C1] __tcf_classify+0x32c/0x7d0 [ 8772.617607][ C1] tcf_classify+0x283/0x930 [ 8772.617849][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8772.618119][ C1] tc_run+0x2e4/0x5d0 [ 8772.618335][ C1] ? __pfx_tc_run+0x10/0x10 [ 8772.618578][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8772.618845][ C1] ? irqentry_enter+0x2b/0x60 [ 8772.619107][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8772.619397][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8772.619720][ C1] ip_finish_output2+0x786/0x18e0 [ 8772.619991][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8772.620283][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8772.620549][ C1] ? __ip_finish_output+0x10f/0x770 [ 8772.620825][ C1] ip_output+0x16b/0x4f0 [ 8772.621054][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8772.621372][ C1] ? __pfx_ip_output+0x10/0x10 [ 8772.621627][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8772.621983][ C1] ? __pfx_ip_output+0x10/0x10 [ 8772.622242][ C1] __ip_queue_xmit+0x672/0x1910 [ 8772.622502][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8772.622782][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8772.623076][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8772.623360][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8772.623655][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8772.623941][ C1] tcp_delack_timer+0x84/0x240 [ 8772.624208][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8772.624494][ C1] call_timer_fn+0x176/0x430 [ 8772.624742][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8772.625020][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8772.625298][ C1] __run_timers.part.0+0x52d/0x890 [ 8772.625571][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8772.625862][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8772.626166][ C1] ? __pfx___schedule+0x10/0x10 [ 8772.626427][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8772.626749][ C1] run_timer_softirq+0x72/0x100 [ 8772.627011][ C1] __do_softirq+0x1bc/0x7ff [ 8772.627259][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8772.627533][ C1] run_ksoftirqd+0x2e/0x60 [ 8772.627769][ C1] smpboot_thread_fn+0x30e/0x840 [ 8772.628037][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8772.628326][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8772.628623][ C1] kthread+0x292/0x360 [ 8772.628842][ C1] ? __pfx_kthread+0x10/0x10 [ 8772.629092][ C1] ret_from_fork+0x34/0x70 [ 8772.629332][ C1] ? __pfx_kthread+0x10/0x10 [ 8772.629580][ C1] ret_from_fork_asm+0x1b/0x30 [ 8772.629839][ C1] [ 8794.625026][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8794.625424][ C1] rcu: 1-....: (7533850 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1800499 [ 8794.626016][ C1] rcu: (t=7600316 jiffies g=1007429 q=31 ncpus=4) [ 8794.626373][ C1] Sending NMI from CPU 1 to CPUs 0: [ 8794.626679][ C0] NMI backtrace for cpu 0 [ 8794.626687][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8794.626692][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8794.626695][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8794.626705][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8794.626708][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8794.626712][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8794.626714][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8794.626716][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8794.626718][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8794.626720][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8794.626722][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8794.626724][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8794.626728][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8794.626730][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8794.626731][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8794.626733][ C0] Call Trace: [ 8794.626736][ C0] [ 8794.626741][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 8794.626748][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8794.626754][ C0] ? nmi_handle+0x156/0x420 [ 8794.626759][ C0] ? default_do_nmi+0x41/0x100 [ 8794.626762][ C0] ? exc_nmi+0xf3/0x120 [ 8794.626765][ C0] ? end_repeat_nmi+0xf/0x60 [ 8794.626770][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8794.626774][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8794.626777][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8794.626781][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8794.626785][ C0] [ 8794.626785][ C0] [ 8794.626787][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8794.626790][ C0] ? get_stack_info+0x36/0xc0 [ 8794.626794][ C0] ? lock_acquire+0x1c1/0x220 [ 8794.626799][ C0] ? lock_release+0x1d5/0x250 [ 8794.626802][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8794.626806][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8794.626809][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8794.626812][ C0] ? lock_acquire+0x1c1/0x220 [ 8794.626815][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8794.626820][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8794.626823][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8794.626830][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8794.626833][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8794.626837][ C0] ? __inet_lookup_established+0x341/0x610 [ 8794.626843][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8794.626851][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8794.626855][ C0] ip_local_deliver+0x19d/0x480 [ 8794.626859][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8794.626861][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8794.626866][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8794.626870][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8794.626873][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8794.626877][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8794.626887][ C0] ip_rcv+0x564/0x740 [ 8794.626890][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8794.626894][ C0] ? set_track_prepare+0x8a/0xd0 [ 8794.626898][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8794.626900][ C0] ? rest_init+0x153/0x260 [ 8794.626903][ C0] ? skb_clone+0x10b/0x330 [ 8794.626907][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8794.626914][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8794.626920][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8794.626924][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8794.626933][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8794.626936][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8794.626939][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8794.626943][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8794.626946][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8794.626950][ C0] ? lock_acquire+0x1c1/0x220 [ 8794.626952][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8794.626956][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8794.626958][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8794.626962][ C0] ? __copy_skb_header+0xaf/0x490 [ 8794.626965][ C0] ? __skb_clone+0x57a/0x760 [ 8794.626967][ C0] netif_receive_skb+0x55/0x280 [ 8794.626970][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8794.626978][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8794.626985][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8794.626992][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8794.626997][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8794.627005][ C0] ? hlock_class+0x4e/0x130 [ 8794.627011][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8794.627022][ C0] ? place_entity+0x21/0x2f0 [ 8794.627026][ C0] ? resched_curr+0x219/0x280 [ 8794.627029][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8794.627032][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8794.627035][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8794.627039][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8794.627042][ C0] ? activate_task+0xf5/0x260 [ 8794.627045][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8794.627050][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8794.627054][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8794.627058][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8794.627061][ C0] ? get_stack_info+0x36/0xc0 [ 8794.627064][ C0] ? stack_access_ok+0xda/0x1f0 [ 8794.627067][ C0] ? get_reg+0x119/0x190 [ 8794.627070][ C0] __tcf_classify+0x32c/0x7d0 [ 8794.627075][ C0] tcf_classify+0x283/0x930 [ 8794.627078][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8794.627082][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8794.627084][ C0] ? arch_stack_walk+0x8c/0x100 [ 8794.627089][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8794.627093][ C0] tc_run+0x2e4/0x5d0 [ 8794.627097][ C0] ? __pfx_tc_run+0x10/0x10 [ 8794.627101][ C0] ? lock_acquire+0x1c1/0x220 [ 8794.627103][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8794.627108][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8794.627113][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8794.627117][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8794.627120][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8794.627125][ C0] ? neigh_hh_output+0x348/0x590 [ 8794.627130][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8794.627134][ C0] ip_finish_output2+0x786/0x18e0 [ 8794.627137][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8794.627142][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8794.627150][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8794.627153][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8794.627157][ C0] ? __ip_finish_output+0x10f/0x770 [ 8794.627161][ C0] ip_output+0x16b/0x4f0 [ 8794.627164][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8794.627169][ C0] ? __pfx_ip_output+0x10/0x10 [ 8794.627172][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8794.627177][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8794.627179][ C0] ? ip_local_out+0x114/0x3b0 [ 8794.627184][ C0] __ip_queue_xmit+0x672/0x1910 [ 8794.627188][ C0] ? __skb_clone+0x57a/0x760 [ 8794.627192][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8794.627199][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8794.627204][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8794.627208][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8794.627213][ C0] ? tcp_current_mss+0x40a/0x510 [ 8794.627216][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8794.627219][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8794.627222][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8794.627224][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8794.627227][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8794.627231][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8794.627235][ C0] ? ktime_get+0xb6/0x190 [ 8794.627239][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8794.627243][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8794.627246][ C0] tcp_write_timer+0x82/0x1d0 [ 8794.627250][ C0] call_timer_fn+0x176/0x430 [ 8794.627253][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8794.627258][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8794.627262][ C0] __run_timers.part.0+0x52d/0x890 [ 8794.627265][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8794.627270][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8794.627273][ C0] ? lock_acquire+0x1c1/0x220 [ 8794.627275][ C0] ? clockevents_program_event+0xf6/0x300 [ 8794.627279][ C0] ? lock_release+0x1d5/0x250 [ 8794.627282][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8794.627285][ C0] ? ktime_get+0xb6/0x190 [ 8794.627287][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8794.627291][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8794.627296][ C0] run_timer_softirq+0x72/0x100 [ 8794.627299][ C0] __do_softirq+0x1bc/0x7ff [ 8794.627303][ C0] irq_exit_rcu+0x98/0xc0 [ 8794.627306][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8794.627310][ C0] [ 8794.627311][ C0] [ 8794.627312][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8794.627318][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8794.627321][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8794.627324][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8794.627326][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8794.627328][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8794.627329][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8794.627331][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8794.627332][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8794.627336][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8794.627339][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8794.627343][ C0] default_idle_call+0x69/0xa0 [ 8794.627346][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8794.627348][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8794.627353][ C0] ? lock_release+0x1d5/0x250 [ 8794.627357][ C0] do_idle+0xfb/0x160 [ 8794.627360][ C0] cpu_startup_entry+0x55/0x60 [ 8794.627363][ C0] rest_init+0x153/0x260 [ 8794.627365][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8794.627371][ C0] arch_call_rest_init+0x13/0x40 [ 8794.627376][ C0] start_kernel+0x314/0x3d0 [ 8794.627380][ C0] x86_64_start_reservations+0x18/0x30 [ 8794.627385][ C0] x86_64_start_kernel+0xba/0x110 [ 8794.627388][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8794.627396][ C0] [ 8794.627669][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8794.681737][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8794.682389][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8794.682742][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8794.683772][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8794.684103][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8794.684521][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8794.684939][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8794.685356][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8794.685772][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8794.686188][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8794.686660][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8794.687010][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8794.687430][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8794.687854][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8794.688280][ C1] Call Trace: [ 8794.688465][ C1] [ 8794.688624][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8794.688916][ C1] ? print_cpu_stall+0x263/0x6a0 [ 8794.689185][ C1] ? check_cpu_stall+0x284/0x500 [ 8794.689447][ C1] ? rcu_pending+0x92/0x360 [ 8794.689691][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8794.689977][ C1] ? update_process_times+0xb9/0x110 [ 8794.690261][ C1] ? tick_sched_handle+0x67/0x130 [ 8794.690534][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8794.690837][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8794.691092][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8794.691423][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8794.691709][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8794.692010][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8794.692287][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8794.692609][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8794.692885][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8794.693207][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8794.693518][ C1] [ 8794.693678][ C1] [ 8794.693838][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8794.694173][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8794.694481][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8794.694790][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8794.695092][ C1] ? run_ksoftirqd+0xb/0x60 [ 8794.695335][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8794.695658][ C1] ? __orc_find+0x9c/0xf0 [ 8794.695892][ C1] ? lock_acquire+0x1c1/0x220 [ 8794.696148][ C1] ? irqentry_enter+0x2b/0x60 [ 8794.696402][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8794.696665][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8794.696956][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8794.697259][ C1] ? lock_acquire+0x1c1/0x220 [ 8794.697509][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8794.697763][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8794.698036][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8794.698285][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8794.698546][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8794.698823][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8794.699122][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8794.699417][ C1] ip_local_deliver+0x19d/0x480 [ 8794.699676][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8794.699959][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8794.700224][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8794.700505][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8794.700773][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8794.701110][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8794.701387][ C1] ip_rcv+0x564/0x740 [ 8794.701605][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8794.701850][ C1] ? set_track_prepare+0x8a/0xd0 [ 8794.702119][ C1] ? irqentry_enter+0x2b/0x60 [ 8794.702369][ C1] ? irqentry_enter+0x2b/0x60 [ 8794.702620][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8794.702859][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8794.703174][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8794.703514][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8794.703824][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8794.704179][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8794.704479][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8794.704817][ C1] netif_receive_skb+0x55/0x280 [ 8794.705080][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8794.705412][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8794.705763][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8794.706077][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8794.706372][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8794.706679][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8794.707014][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8794.707299][ C1] ? arch_stack_walk+0x68/0x100 [ 8794.707561][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8794.707839][ C1] ? irqentry_enter+0x2b/0x60 [ 8794.708092][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8794.708410][ C1] ? irqentry_enter+0x2b/0x60 [ 8794.708662][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8794.708995][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8794.709277][ C1] ? arch_stack_walk+0x68/0x100 [ 8794.709541][ C1] __tcf_classify+0x32c/0x7d0 [ 8794.709796][ C1] tcf_classify+0x283/0x930 [ 8794.710045][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8794.710316][ C1] tc_run+0x2e4/0x5d0 [ 8794.710535][ C1] ? __pfx_tc_run+0x10/0x10 [ 8794.710782][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8794.711053][ C1] ? irqentry_enter+0x2b/0x60 [ 8794.711304][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8794.711590][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8794.711911][ C1] ip_finish_output2+0x786/0x18e0 [ 8794.712187][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8794.712479][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8794.712742][ C1] ? __ip_finish_output+0x10f/0x770 [ 8794.713022][ C1] ip_output+0x16b/0x4f0 [ 8794.713252][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8794.713569][ C1] ? __pfx_ip_output+0x10/0x10 [ 8794.713826][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8794.714189][ C1] ? __pfx_ip_output+0x10/0x10 [ 8794.714450][ C1] __ip_queue_xmit+0x672/0x1910 [ 8794.714713][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8794.714994][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8794.715291][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8794.715575][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8794.715869][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8794.716153][ C1] tcp_delack_timer+0x84/0x240 [ 8794.716407][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8794.716699][ C1] call_timer_fn+0x176/0x430 [ 8794.716950][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8794.717224][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8794.717510][ C1] __run_timers.part.0+0x52d/0x890 [ 8794.717784][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8794.718073][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8794.718374][ C1] ? __pfx___schedule+0x10/0x10 [ 8794.718642][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8794.718967][ C1] run_timer_softirq+0x72/0x100 [ 8794.719227][ C1] __do_softirq+0x1bc/0x7ff [ 8794.719470][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8794.719743][ C1] run_ksoftirqd+0x2e/0x60 [ 8794.719983][ C1] smpboot_thread_fn+0x30e/0x840 [ 8794.720249][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8794.720540][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8794.720828][ C1] kthread+0x292/0x360 [ 8794.721051][ C1] ? __pfx_kthread+0x10/0x10 [ 8794.721299][ C1] ret_from_fork+0x34/0x70 [ 8794.721539][ C1] ? __pfx_kthread+0x10/0x10 [ 8794.721782][ C1] ret_from_fork_asm+0x1b/0x30 [ 8794.722044][ C1] [ 8820.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7108s! [swapper/0:0] [ 8820.527924][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8820.529128][ C0] irq event stamp: 27567077 [ 8820.529372][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8820.529904][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8820.530375][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8820.530877][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8820.531373][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8820.531852][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8820.532503][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8820.532847][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8820.533882][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8820.534207][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8820.534629][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8820.535050][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8820.535468][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8820.535886][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8820.536304][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8820.536771][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8820.537124][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8820.537544][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8820.537965][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8820.538390][ C0] Call Trace: [ 8820.538575][ C0] [ 8820.538731][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8820.539006][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8820.539265][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8820.539556][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8820.539846][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8820.540153][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8820.540436][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8820.540757][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8820.541030][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8820.541309][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8820.541630][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8820.541939][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8820.542272][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8820.542574][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8820.542885][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8820.543194][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8820.543525][ C0] ? get_stack_info+0x36/0xc0 [ 8820.543783][ C0] ? lock_acquire+0x1c1/0x220 [ 8820.544041][ C0] ? lock_release+0x1d5/0x250 [ 8820.544297][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8820.544561][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8820.544849][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8820.545150][ C0] ? lock_acquire+0x1c1/0x220 [ 8820.545397][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8820.545647][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8820.545917][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8820.546168][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8820.546429][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8820.546700][ C0] ? __inet_lookup_established+0x341/0x610 [ 8820.547017][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8820.547308][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8820.547598][ C0] ip_local_deliver+0x19d/0x480 [ 8820.547858][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8820.548146][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8820.548416][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8820.548697][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8820.548965][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8820.549301][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8820.549579][ C0] ip_rcv+0x564/0x740 [ 8820.549799][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8820.550044][ C0] ? set_track_prepare+0x8a/0xd0 [ 8820.550313][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8820.550600][ C0] ? rest_init+0x153/0x260 [ 8820.550840][ C0] ? skb_clone+0x10b/0x330 [ 8820.551079][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8820.551416][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8820.551740][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8820.552034][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8820.552341][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8820.552600][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8820.552841][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8820.553155][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8820.553452][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8820.553803][ C0] ? lock_acquire+0x1c1/0x220 [ 8820.554053][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8820.554362][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8820.554661][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8820.554988][ C0] ? __copy_skb_header+0xaf/0x490 [ 8820.555254][ C0] ? __skb_clone+0x57a/0x760 [ 8820.555502][ C0] netif_receive_skb+0x55/0x280 [ 8820.555769][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8820.556102][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8820.556451][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8820.556763][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8820.557056][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8820.557361][ C0] ? hlock_class+0x4e/0x130 [ 8820.557610][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8820.557941][ C0] ? place_entity+0x21/0x2f0 [ 8820.558193][ C0] ? resched_curr+0x219/0x280 [ 8820.558442][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8820.558709][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8820.558989][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8820.559270][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8820.559531][ C0] ? activate_task+0xf5/0x260 [ 8820.559785][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8820.560064][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8820.560337][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8820.560599][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8820.560891][ C0] ? get_stack_info+0x36/0xc0 [ 8820.561142][ C0] ? stack_access_ok+0xda/0x1f0 [ 8820.561397][ C0] ? get_reg+0x119/0x190 [ 8820.561623][ C0] __tcf_classify+0x32c/0x7d0 [ 8820.561877][ C0] tcf_classify+0x283/0x930 [ 8820.562124][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8820.562454][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8820.562720][ C0] ? arch_stack_walk+0x8c/0x100 [ 8820.562977][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8820.563267][ C0] tc_run+0x2e4/0x5d0 [ 8820.563489][ C0] ? __pfx_tc_run+0x10/0x10 [ 8820.563734][ C0] ? lock_acquire+0x1c1/0x220 [ 8820.563988][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8820.564262][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8820.564529][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8820.564810][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8820.565084][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8820.565404][ C0] ? neigh_hh_output+0x348/0x590 [ 8820.565670][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8820.565946][ C0] ip_finish_output2+0x786/0x18e0 [ 8820.566212][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8820.566502][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8820.566857][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8820.567147][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8820.567409][ C0] ? __ip_finish_output+0x10f/0x770 [ 8820.567689][ C0] ip_output+0x16b/0x4f0 [ 8820.567919][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8820.568203][ C0] ? __pfx_ip_output+0x10/0x10 [ 8820.568462][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8820.568760][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8820.569027][ C0] ? ip_local_out+0x114/0x3b0 [ 8820.569279][ C0] __ip_queue_xmit+0x672/0x1910 [ 8820.569538][ C0] ? __skb_clone+0x57a/0x760 [ 8820.569787][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8820.570070][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8820.570370][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8820.570690][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8820.570946][ C0] ? tcp_current_mss+0x40a/0x510 [ 8820.571214][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8820.571495][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8820.571774][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8820.572032][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8820.572299][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8820.572618][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8820.572897][ C0] ? ktime_get+0xb6/0x190 [ 8820.573133][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8820.573412][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8820.573694][ C0] tcp_write_timer+0x82/0x1d0 [ 8820.573951][ C0] call_timer_fn+0x176/0x430 [ 8820.574198][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8820.574476][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8820.574749][ C0] __run_timers.part.0+0x52d/0x890 [ 8820.575021][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8820.575304][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8820.575605][ C0] ? lock_acquire+0x1c1/0x220 [ 8820.575853][ C0] ? clockevents_program_event+0xf6/0x300 [ 8820.576158][ C0] ? lock_release+0x1d5/0x250 [ 8820.576406][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8820.576680][ C0] ? ktime_get+0xb6/0x190 [ 8820.576909][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8820.577208][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8820.577521][ C0] run_timer_softirq+0x72/0x100 [ 8820.577780][ C0] __do_softirq+0x1bc/0x7ff [ 8820.578021][ C0] irq_exit_rcu+0x98/0xc0 [ 8820.578252][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8820.578547][ C0] [ 8820.578707][ C0] [ 8820.578867][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8820.579189][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8820.579457][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8820.580470][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8820.580788][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8820.581206][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8820.581621][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8820.582037][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8820.582451][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8820.582872][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8820.583175][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8820.583446][ C0] default_idle_call+0x69/0xa0 [ 8820.583703][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8820.583975][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8820.584263][ C0] ? lock_release+0x1d5/0x250 [ 8820.584514][ C0] do_idle+0xfb/0x160 [ 8820.584731][ C0] cpu_startup_entry+0x55/0x60 [ 8820.584988][ C0] rest_init+0x153/0x260 [ 8820.585215][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8820.585503][ C0] arch_call_rest_init+0x13/0x40 [ 8820.585770][ C0] start_kernel+0x314/0x3d0 [ 8820.586010][ C0] x86_64_start_reservations+0x18/0x30 [ 8820.586300][ C0] x86_64_start_kernel+0xba/0x110 [ 8820.586572][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8820.586903][ C0] [ 8820.587072][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7108s! [ksoftirqd/1:22] [ 8820.587535][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8820.588735][ C1] irq event stamp: 3886976 [ 8820.588975][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8820.589471][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8820.589962][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8820.590456][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8820.590947][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8820.591440][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8820.592085][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8820.592425][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8820.593447][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8820.593783][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8820.594206][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8820.594628][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8820.595054][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8820.595482][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8820.595905][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8820.596376][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8820.596724][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8820.597146][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8820.597563][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8820.597979][ C1] Call Trace: [ 8820.598158][ C1] [ 8820.598312][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8820.598592][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8820.598847][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8820.599139][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8820.599422][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8820.599723][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8820.600001][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8820.600320][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8820.600603][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8820.600927][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8820.601243][ C1] [ 8820.601402][ C1] [ 8820.601561][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8820.601896][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8820.602200][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8820.602511][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8820.602815][ C1] ? run_ksoftirqd+0xb/0x60 [ 8820.603062][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8820.603399][ C1] ? __orc_find+0x9c/0xf0 [ 8820.603628][ C1] ? lock_acquire+0x1c1/0x220 [ 8820.603890][ C1] ? irqentry_enter+0x2b/0x60 [ 8820.604148][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8820.604414][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8820.604705][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8820.605009][ C1] ? lock_acquire+0x1c1/0x220 [ 8820.605257][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8820.605509][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8820.605783][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8820.606034][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8820.606299][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8820.606574][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8820.606866][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8820.607160][ C1] ip_local_deliver+0x19d/0x480 [ 8820.607419][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8820.607708][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8820.607974][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8820.608257][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8820.608523][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8820.608860][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8820.609140][ C1] ip_rcv+0x564/0x740 [ 8820.609357][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8820.609603][ C1] ? set_track_prepare+0x8a/0xd0 [ 8820.609871][ C1] ? irqentry_enter+0x2b/0x60 [ 8820.610120][ C1] ? irqentry_enter+0x2b/0x60 [ 8820.610370][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8820.610611][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8820.610924][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8820.611264][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8820.611572][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8820.611915][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8820.612218][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8820.612551][ C1] netif_receive_skb+0x55/0x280 [ 8820.612811][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8820.613139][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8820.613488][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8820.613817][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8820.614111][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8820.614418][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8820.614750][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8820.615034][ C1] ? arch_stack_walk+0x68/0x100 [ 8820.615293][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8820.615568][ C1] ? irqentry_enter+0x2b/0x60 [ 8820.615818][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8820.616140][ C1] ? irqentry_enter+0x2b/0x60 [ 8820.616399][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8820.616723][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8820.617001][ C1] ? arch_stack_walk+0x68/0x100 [ 8820.617265][ C1] __tcf_classify+0x32c/0x7d0 [ 8820.617523][ C1] tcf_classify+0x283/0x930 [ 8820.617769][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8820.618043][ C1] tc_run+0x2e4/0x5d0 [ 8820.618261][ C1] ? __pfx_tc_run+0x10/0x10 [ 8820.618510][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8820.618780][ C1] ? irqentry_enter+0x2b/0x60 [ 8820.619030][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8820.619313][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8820.619639][ C1] ip_finish_output2+0x786/0x18e0 [ 8820.619911][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8820.620203][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8820.620468][ C1] ? __ip_finish_output+0x10f/0x770 [ 8820.620749][ C1] ip_output+0x16b/0x4f0 [ 8820.620982][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8820.621303][ C1] ? __pfx_ip_output+0x10/0x10 [ 8820.621563][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8820.621915][ C1] ? __pfx_ip_output+0x10/0x10 [ 8820.622171][ C1] __ip_queue_xmit+0x672/0x1910 [ 8820.622443][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8820.622727][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8820.623030][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8820.623324][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8820.623623][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8820.623924][ C1] tcp_delack_timer+0x84/0x240 [ 8820.624181][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8820.624470][ C1] call_timer_fn+0x176/0x430 [ 8820.624719][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8820.624996][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8820.625278][ C1] __run_timers.part.0+0x52d/0x890 [ 8820.625554][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8820.625842][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8820.626143][ C1] ? __pfx___schedule+0x10/0x10 [ 8820.626405][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8820.626731][ C1] run_timer_softirq+0x72/0x100 [ 8820.626989][ C1] __do_softirq+0x1bc/0x7ff [ 8820.627231][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8820.627504][ C1] run_ksoftirqd+0x2e/0x60 [ 8820.627744][ C1] smpboot_thread_fn+0x30e/0x840 [ 8820.628011][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8820.628305][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8820.628595][ C1] kthread+0x292/0x360 [ 8820.628814][ C1] ? __pfx_kthread+0x10/0x10 [ 8820.629058][ C1] ret_from_fork+0x34/0x70 [ 8820.629301][ C1] ? __pfx_kthread+0x10/0x10 [ 8820.629549][ C1] ret_from_fork_asm+0x1b/0x30 [ 8820.629813][ C1] [ 8848.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7134s! [swapper/0:0] [ 8848.527921][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8848.529115][ C0] irq event stamp: 27567077 [ 8848.529353][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8848.529881][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8848.530359][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8848.530870][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8848.531370][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8848.531855][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8848.532498][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8848.532838][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8848.533863][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8848.534190][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8848.534609][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8848.535032][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8848.535457][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8848.535877][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8848.536298][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8848.536772][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8848.537120][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8848.537543][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8848.537960][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8848.538378][ C0] Call Trace: [ 8848.538560][ C0] [ 8848.538717][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8848.538994][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8848.539248][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8848.539543][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8848.539828][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8848.540131][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8848.540407][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8848.540725][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8848.541001][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8848.541279][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8848.541604][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8848.541918][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8848.542251][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8848.542556][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8848.542870][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8848.543176][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8848.543502][ C0] ? get_stack_info+0x36/0xc0 [ 8848.543766][ C0] ? lock_acquire+0x1c1/0x220 [ 8848.544016][ C0] ? lock_release+0x1d5/0x250 [ 8848.544267][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8848.544527][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8848.544809][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8848.545106][ C0] ? lock_acquire+0x1c1/0x220 [ 8848.545358][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8848.545620][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8848.545895][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8848.546141][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8848.546398][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8848.546664][ C0] ? __inet_lookup_established+0x341/0x610 [ 8848.546974][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8848.547266][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8848.547557][ C0] ip_local_deliver+0x19d/0x480 [ 8848.547812][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8848.548095][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8848.548360][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8848.548639][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8848.548906][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8848.549242][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8848.549518][ C0] ip_rcv+0x564/0x740 [ 8848.549737][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8848.549981][ C0] ? set_track_prepare+0x8a/0xd0 [ 8848.550252][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8848.550539][ C0] ? rest_init+0x153/0x260 [ 8848.550778][ C0] ? skb_clone+0x10b/0x330 [ 8848.551014][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8848.551352][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8848.551676][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8848.551975][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8848.552283][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8848.552546][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8848.552788][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8848.553102][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8848.553398][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8848.553749][ C0] ? lock_acquire+0x1c1/0x220 [ 8848.553998][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8848.554307][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8848.554606][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8848.554931][ C0] ? __copy_skb_header+0xaf/0x490 [ 8848.555197][ C0] ? __skb_clone+0x57a/0x760 [ 8848.555444][ C0] netif_receive_skb+0x55/0x280 [ 8848.555704][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8848.556036][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8848.556385][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8848.556696][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8848.556987][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8848.557292][ C0] ? hlock_class+0x4e/0x130 [ 8848.557539][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8848.557869][ C0] ? place_entity+0x21/0x2f0 [ 8848.558118][ C0] ? resched_curr+0x219/0x280 [ 8848.558366][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8848.558631][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8848.558913][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8848.559197][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8848.559458][ C0] ? activate_task+0xf5/0x260 [ 8848.559715][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8848.559991][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8848.560264][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8848.560527][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8848.560818][ C0] ? get_stack_info+0x36/0xc0 [ 8848.561068][ C0] ? stack_access_ok+0xda/0x1f0 [ 8848.561322][ C0] ? get_reg+0x119/0x190 [ 8848.561548][ C0] __tcf_classify+0x32c/0x7d0 [ 8848.561801][ C0] tcf_classify+0x283/0x930 [ 8848.562046][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8848.562376][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8848.562641][ C0] ? arch_stack_walk+0x8c/0x100 [ 8848.562898][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8848.563186][ C0] tc_run+0x2e4/0x5d0 [ 8848.563407][ C0] ? __pfx_tc_run+0x10/0x10 [ 8848.563652][ C0] ? lock_acquire+0x1c1/0x220 [ 8848.563897][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8848.564170][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8848.564436][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8848.564722][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8848.564996][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8848.565316][ C0] ? neigh_hh_output+0x348/0x590 [ 8848.565583][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8848.565858][ C0] ip_finish_output2+0x786/0x18e0 [ 8848.566124][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8848.566413][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8848.566768][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8848.567059][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8848.567320][ C0] ? __ip_finish_output+0x10f/0x770 [ 8848.567599][ C0] ip_output+0x16b/0x4f0 [ 8848.567828][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8848.568111][ C0] ? __pfx_ip_output+0x10/0x10 [ 8848.568369][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8848.568666][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8848.568931][ C0] ? ip_local_out+0x114/0x3b0 [ 8848.569182][ C0] __ip_queue_xmit+0x672/0x1910 [ 8848.569441][ C0] ? __skb_clone+0x57a/0x760 [ 8848.569688][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8848.569969][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8848.570272][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8848.570590][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8848.570844][ C0] ? tcp_current_mss+0x40a/0x510 [ 8848.571112][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8848.571393][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8848.571671][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8848.571928][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8848.572196][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8848.572514][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8848.572794][ C0] ? ktime_get+0xb6/0x190 [ 8848.573029][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8848.573304][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8848.573585][ C0] tcp_write_timer+0x82/0x1d0 [ 8848.573846][ C0] call_timer_fn+0x176/0x430 [ 8848.574092][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8848.574368][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8848.574640][ C0] __run_timers.part.0+0x52d/0x890 [ 8848.574913][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8848.575193][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8848.575494][ C0] ? lock_acquire+0x1c1/0x220 [ 8848.575744][ C0] ? clockevents_program_event+0xf6/0x300 [ 8848.576047][ C0] ? lock_release+0x1d5/0x250 [ 8848.576294][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8848.576567][ C0] ? ktime_get+0xb6/0x190 [ 8848.576796][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8848.577094][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8848.577407][ C0] run_timer_softirq+0x72/0x100 [ 8848.577665][ C0] __do_softirq+0x1bc/0x7ff [ 8848.577906][ C0] irq_exit_rcu+0x98/0xc0 [ 8848.578138][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8848.578434][ C0] [ 8848.578595][ C0] [ 8848.578755][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8848.579076][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8848.579342][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8848.580354][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8848.580673][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8848.581090][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8848.581505][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8848.581920][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8848.582337][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8848.582755][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8848.583058][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8848.583330][ C0] default_idle_call+0x69/0xa0 [ 8848.583585][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8848.583859][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8848.584149][ C0] ? lock_release+0x1d5/0x250 [ 8848.584401][ C0] do_idle+0xfb/0x160 [ 8848.584617][ C0] cpu_startup_entry+0x55/0x60 [ 8848.584875][ C0] rest_init+0x153/0x260 [ 8848.585101][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8848.585389][ C0] arch_call_rest_init+0x13/0x40 [ 8848.585657][ C0] start_kernel+0x314/0x3d0 [ 8848.585898][ C0] x86_64_start_reservations+0x18/0x30 [ 8848.586189][ C0] x86_64_start_kernel+0xba/0x110 [ 8848.586460][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8848.586793][ C0] [ 8848.586961][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7134s! [ksoftirqd/1:22] [ 8848.587440][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8848.588642][ C1] irq event stamp: 3886976 [ 8848.588883][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8848.589381][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8848.589877][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8848.590379][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8848.590874][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8848.591369][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8848.592009][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 8848.592345][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 8848.593373][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8848.593709][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8848.594127][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8848.594545][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8848.594962][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8848.595380][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8848.595796][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8848.596264][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8848.596615][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8848.597035][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8848.597459][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8848.597885][ C1] Call Trace: [ 8848.598066][ C1] [ 8848.598224][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8848.598501][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8848.598760][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8848.599053][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8848.599343][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8848.599648][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8848.599931][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8848.600257][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8848.600529][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8848.600857][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8848.601169][ C1] [ 8848.601326][ C1] [ 8848.601482][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8848.601808][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8848.602116][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 8848.602420][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8848.602725][ C1] ? run_ksoftirqd+0xb/0x60 [ 8848.602972][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8848.603301][ C1] ? __orc_find+0x9c/0xf0 [ 8848.603529][ C1] ? lock_acquire+0x1c1/0x220 [ 8848.603793][ C1] ? irqentry_enter+0x2b/0x60 [ 8848.604047][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8848.604309][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8848.604598][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8848.604899][ C1] ? lock_acquire+0x1c1/0x220 [ 8848.605148][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8848.605402][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8848.605674][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8848.605926][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8848.606187][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8848.606463][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8848.606758][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8848.607053][ C1] ip_local_deliver+0x19d/0x480 [ 8848.607312][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8848.607594][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8848.607857][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8848.608139][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8848.608406][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8848.608745][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8848.609022][ C1] ip_rcv+0x564/0x740 [ 8848.609241][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8848.609485][ C1] ? set_track_prepare+0x8a/0xd0 [ 8848.609758][ C1] ? irqentry_enter+0x2b/0x60 [ 8848.610008][ C1] ? irqentry_enter+0x2b/0x60 [ 8848.610261][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8848.610500][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8848.610813][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8848.611153][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8848.611463][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8848.611806][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8848.612107][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8848.612439][ C1] netif_receive_skb+0x55/0x280 [ 8848.612696][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8848.613021][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8848.613369][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8848.613695][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8848.613988][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8848.614295][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8848.614629][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8848.614912][ C1] ? arch_stack_walk+0x68/0x100 [ 8848.615175][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8848.615452][ C1] ? irqentry_enter+0x2b/0x60 [ 8848.615703][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8848.616021][ C1] ? irqentry_enter+0x2b/0x60 [ 8848.616274][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8848.616606][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8848.616887][ C1] ? arch_stack_walk+0x68/0x100 [ 8848.617154][ C1] __tcf_classify+0x32c/0x7d0 [ 8848.617409][ C1] tcf_classify+0x283/0x930 [ 8848.617655][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8848.617927][ C1] tc_run+0x2e4/0x5d0 [ 8848.618145][ C1] ? __pfx_tc_run+0x10/0x10 [ 8848.618392][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8848.618662][ C1] ? irqentry_enter+0x2b/0x60 [ 8848.618913][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8848.619198][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8848.619519][ C1] ip_finish_output2+0x786/0x18e0 [ 8848.619794][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8848.620086][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8848.620349][ C1] ? __ip_finish_output+0x10f/0x770 [ 8848.620628][ C1] ip_output+0x16b/0x4f0 [ 8848.620856][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8848.621173][ C1] ? __pfx_ip_output+0x10/0x10 [ 8848.621429][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8848.621782][ C1] ? __pfx_ip_output+0x10/0x10 [ 8848.622038][ C1] __ip_queue_xmit+0x672/0x1910 [ 8848.622301][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8848.622584][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8848.622880][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8848.623168][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8848.623466][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8848.623760][ C1] tcp_delack_timer+0x84/0x240 [ 8848.624014][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8848.624303][ C1] call_timer_fn+0x176/0x430 [ 8848.624553][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8848.624826][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8848.625108][ C1] __run_timers.part.0+0x52d/0x890 [ 8848.625382][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8848.625666][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8848.625967][ C1] ? __pfx___schedule+0x10/0x10 [ 8848.626230][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8848.626558][ C1] run_timer_softirq+0x72/0x100 [ 8848.626817][ C1] __do_softirq+0x1bc/0x7ff [ 8848.627061][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8848.627334][ C1] run_ksoftirqd+0x2e/0x60 [ 8848.627575][ C1] smpboot_thread_fn+0x30e/0x840 [ 8848.627839][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8848.628131][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8848.628418][ C1] kthread+0x292/0x360 [ 8848.628642][ C1] ? __pfx_kthread+0x10/0x10 [ 8848.628890][ C1] ret_from_fork+0x34/0x70 [ 8848.629131][ C1] ? __pfx_kthread+0x10/0x10 [ 8848.629374][ C1] ret_from_fork_asm+0x1b/0x30 [ 8848.629636][ C1] [ 8872.723037][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8872.723452][ C1] rcu: 1-....: (7611668 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1819797 [ 8872.724063][ C1] rcu: (t=7678414 jiffies g=1007429 q=31 ncpus=4) [ 8872.724410][ C1] Sending NMI from CPU 1 to CPUs 0: [ 8872.724704][ C0] NMI backtrace for cpu 0 [ 8872.724713][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8872.724717][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8872.724720][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8872.724730][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8872.724733][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8872.724737][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8872.724739][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8872.724741][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8872.724743][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8872.724745][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8872.724747][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8872.724749][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8872.724753][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8872.724754][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8872.724756][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8872.724757][ C0] Call Trace: [ 8872.724761][ C0] [ 8872.724767][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 8872.724772][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8872.724777][ C0] ? nmi_handle+0x156/0x420 [ 8872.724782][ C0] ? default_do_nmi+0x41/0x100 [ 8872.724786][ C0] ? exc_nmi+0xf3/0x120 [ 8872.724789][ C0] ? end_repeat_nmi+0xf/0x60 [ 8872.724793][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8872.724797][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8872.724800][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8872.724804][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8872.724807][ C0] [ 8872.724809][ C0] [ 8872.724810][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8872.724813][ C0] ? get_stack_info+0x36/0xc0 [ 8872.724818][ C0] ? lock_acquire+0x1c1/0x220 [ 8872.724823][ C0] ? lock_release+0x1d5/0x250 [ 8872.724826][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8872.724830][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8872.724833][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8872.724836][ C0] ? lock_acquire+0x1c1/0x220 [ 8872.724838][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8872.724844][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8872.724848][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8872.724855][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8872.724858][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8872.724862][ C0] ? __inet_lookup_established+0x341/0x610 [ 8872.724868][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8872.724878][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8872.724883][ C0] ip_local_deliver+0x19d/0x480 [ 8872.724886][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8872.724889][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8872.724893][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8872.724898][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8872.724900][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8872.724904][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8872.724916][ C0] ip_rcv+0x564/0x740 [ 8872.724919][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8872.724922][ C0] ? set_track_prepare+0x8a/0xd0 [ 8872.724926][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8872.724928][ C0] ? rest_init+0x153/0x260 [ 8872.724931][ C0] ? skb_clone+0x10b/0x330 [ 8872.724936][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8872.724943][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8872.724948][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8872.724953][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8872.724962][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8872.724965][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8872.724968][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8872.724972][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8872.724975][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8872.724978][ C0] ? lock_acquire+0x1c1/0x220 [ 8872.724981][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8872.724984][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8872.724987][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8872.724990][ C0] ? __copy_skb_header+0xaf/0x490 [ 8872.724993][ C0] ? __skb_clone+0x57a/0x760 [ 8872.724996][ C0] netif_receive_skb+0x55/0x280 [ 8872.724998][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8872.725006][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8872.725013][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8872.725021][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8872.725026][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8872.725034][ C0] ? hlock_class+0x4e/0x130 [ 8872.725040][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8872.725050][ C0] ? place_entity+0x21/0x2f0 [ 8872.725054][ C0] ? resched_curr+0x219/0x280 [ 8872.725057][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8872.725060][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8872.725063][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8872.725067][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8872.725070][ C0] ? activate_task+0xf5/0x260 [ 8872.725073][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8872.725078][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8872.725081][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8872.725085][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8872.725088][ C0] ? get_stack_info+0x36/0xc0 [ 8872.725092][ C0] ? stack_access_ok+0xda/0x1f0 [ 8872.725094][ C0] ? get_reg+0x119/0x190 [ 8872.725098][ C0] __tcf_classify+0x32c/0x7d0 [ 8872.725103][ C0] tcf_classify+0x283/0x930 [ 8872.725106][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8872.725110][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8872.725112][ C0] ? arch_stack_walk+0x8c/0x100 [ 8872.725117][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8872.725120][ C0] tc_run+0x2e4/0x5d0 [ 8872.725124][ C0] ? __pfx_tc_run+0x10/0x10 [ 8872.725128][ C0] ? lock_acquire+0x1c1/0x220 [ 8872.725130][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8872.725135][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8872.725141][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8872.725144][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8872.725147][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8872.725152][ C0] ? neigh_hh_output+0x348/0x590 [ 8872.725156][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8872.725160][ C0] ip_finish_output2+0x786/0x18e0 [ 8872.725163][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8872.725169][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8872.725177][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8872.725180][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8872.725184][ C0] ? __ip_finish_output+0x10f/0x770 [ 8872.725188][ C0] ip_output+0x16b/0x4f0 [ 8872.725191][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8872.725196][ C0] ? __pfx_ip_output+0x10/0x10 [ 8872.725200][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8872.725204][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8872.725207][ C0] ? ip_local_out+0x114/0x3b0 [ 8872.725212][ C0] __ip_queue_xmit+0x672/0x1910 [ 8872.725216][ C0] ? __skb_clone+0x57a/0x760 [ 8872.725219][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8872.725226][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8872.725231][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8872.725235][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8872.725240][ C0] ? tcp_current_mss+0x40a/0x510 [ 8872.725243][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8872.725246][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8872.725249][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8872.725251][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8872.725254][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8872.725258][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8872.725262][ C0] ? ktime_get+0xb6/0x190 [ 8872.725266][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8872.725271][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8872.725274][ C0] tcp_write_timer+0x82/0x1d0 [ 8872.725278][ C0] call_timer_fn+0x176/0x430 [ 8872.725281][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8872.725286][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8872.725290][ C0] __run_timers.part.0+0x52d/0x890 [ 8872.725293][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8872.725298][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8872.725301][ C0] ? lock_acquire+0x1c1/0x220 [ 8872.725303][ C0] ? clockevents_program_event+0xf6/0x300 [ 8872.725307][ C0] ? lock_release+0x1d5/0x250 [ 8872.725310][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8872.725313][ C0] ? ktime_get+0xb6/0x190 [ 8872.725315][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8872.725319][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8872.725323][ C0] run_timer_softirq+0x72/0x100 [ 8872.725326][ C0] __do_softirq+0x1bc/0x7ff [ 8872.725331][ C0] irq_exit_rcu+0x98/0xc0 [ 8872.725334][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8872.725338][ C0] [ 8872.725339][ C0] [ 8872.725340][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8872.725345][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8872.725349][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8872.725352][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8872.725354][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8872.725356][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8872.725357][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8872.725358][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8872.725360][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8872.725364][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8872.725367][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8872.725371][ C0] default_idle_call+0x69/0xa0 [ 8872.725373][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8872.725376][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8872.725381][ C0] ? lock_release+0x1d5/0x250 [ 8872.725385][ C0] do_idle+0xfb/0x160 [ 8872.725388][ C0] cpu_startup_entry+0x55/0x60 [ 8872.725390][ C0] rest_init+0x153/0x260 [ 8872.725393][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8872.725398][ C0] arch_call_rest_init+0x13/0x40 [ 8872.725403][ C0] start_kernel+0x314/0x3d0 [ 8872.725407][ C0] x86_64_start_reservations+0x18/0x30 [ 8872.725411][ C0] x86_64_start_kernel+0xba/0x110 [ 8872.725415][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8872.725423][ C0] [ 8872.725697][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8872.779792][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8872.780444][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8872.780796][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8872.781829][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8872.782158][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8872.782585][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8872.783014][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8872.783436][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8872.783871][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8872.784289][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8872.784760][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8872.785113][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8872.785535][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8872.785960][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8872.786386][ C1] Call Trace: [ 8872.786568][ C1] [ 8872.786728][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8872.787018][ C1] ? print_cpu_stall+0x263/0x6a0 [ 8872.787286][ C1] ? check_cpu_stall+0x284/0x500 [ 8872.787549][ C1] ? rcu_pending+0x92/0x360 [ 8872.787795][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8872.788081][ C1] ? update_process_times+0xb9/0x110 [ 8872.788365][ C1] ? tick_sched_handle+0x67/0x130 [ 8872.788638][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8872.788943][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8872.789198][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8872.789531][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8872.789818][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8872.790120][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8872.790398][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8872.790722][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8872.791000][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8872.791322][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8872.791640][ C1] [ 8872.791800][ C1] [ 8872.791961][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8872.792295][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8872.792597][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8872.792905][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8872.793211][ C1] ? run_ksoftirqd+0xb/0x60 [ 8872.793460][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8872.793795][ C1] ? __orc_find+0x9c/0xf0 [ 8872.794029][ C1] ? lock_acquire+0x1c1/0x220 [ 8872.794289][ C1] ? irqentry_enter+0x2b/0x60 [ 8872.794548][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8872.794811][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8872.795098][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8872.795399][ C1] ? lock_acquire+0x1c1/0x220 [ 8872.795649][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8872.795905][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8872.796177][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8872.796427][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8872.796688][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8872.796965][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8872.797261][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8872.797556][ C1] ip_local_deliver+0x19d/0x480 [ 8872.797815][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8872.798099][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8872.798362][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8872.798643][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8872.798909][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8872.799246][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8872.799524][ C1] ip_rcv+0x564/0x740 [ 8872.799740][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8872.799985][ C1] ? set_track_prepare+0x8a/0xd0 [ 8872.800258][ C1] ? irqentry_enter+0x2b/0x60 [ 8872.800509][ C1] ? irqentry_enter+0x2b/0x60 [ 8872.800760][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8872.801000][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8872.801315][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8872.801655][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8872.801964][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8872.802310][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8872.802611][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8872.802944][ C1] netif_receive_skb+0x55/0x280 [ 8872.803202][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8872.803540][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8872.803891][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8872.804205][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8872.804500][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8872.804808][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8872.805143][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8872.805427][ C1] ? arch_stack_walk+0x68/0x100 [ 8872.805688][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8872.805965][ C1] ? irqentry_enter+0x2b/0x60 [ 8872.806221][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8872.806539][ C1] ? irqentry_enter+0x2b/0x60 [ 8872.806791][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8872.807117][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8872.807399][ C1] ? arch_stack_walk+0x68/0x100 [ 8872.807663][ C1] __tcf_classify+0x32c/0x7d0 [ 8872.807919][ C1] tcf_classify+0x283/0x930 [ 8872.808166][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8872.808438][ C1] tc_run+0x2e4/0x5d0 [ 8872.808657][ C1] ? __pfx_tc_run+0x10/0x10 [ 8872.808904][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8872.809175][ C1] ? irqentry_enter+0x2b/0x60 [ 8872.809426][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8872.809711][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8872.810031][ C1] ip_finish_output2+0x786/0x18e0 [ 8872.810306][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8872.810604][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8872.810867][ C1] ? __ip_finish_output+0x10f/0x770 [ 8872.811148][ C1] ip_output+0x16b/0x4f0 [ 8872.811382][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8872.811699][ C1] ? __pfx_ip_output+0x10/0x10 [ 8872.811958][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8872.812314][ C1] ? __pfx_ip_output+0x10/0x10 [ 8872.812572][ C1] __ip_queue_xmit+0x672/0x1910 [ 8872.812836][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8872.813122][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8872.813420][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8872.813716][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8872.814010][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8872.814294][ C1] tcp_delack_timer+0x84/0x240 [ 8872.814549][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8872.814840][ C1] call_timer_fn+0x176/0x430 [ 8872.815093][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8872.815366][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8872.815648][ C1] __run_timers.part.0+0x52d/0x890 [ 8872.815924][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8872.816209][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8872.816511][ C1] ? __pfx___schedule+0x10/0x10 [ 8872.816777][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8872.817103][ C1] run_timer_softirq+0x72/0x100 [ 8872.817364][ C1] __do_softirq+0x1bc/0x7ff [ 8872.817609][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8872.817883][ C1] run_ksoftirqd+0x2e/0x60 [ 8872.818126][ C1] smpboot_thread_fn+0x30e/0x840 [ 8872.818393][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8872.818687][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8872.818982][ C1] kthread+0x292/0x360 [ 8872.819207][ C1] ? __pfx_kthread+0x10/0x10 [ 8872.819456][ C1] ret_from_fork+0x34/0x70 [ 8872.819698][ C1] ? __pfx_kthread+0x10/0x10 [ 8872.819947][ C1] ret_from_fork_asm+0x1b/0x30 [ 8872.820211][ C1] [ 8900.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7183s! [swapper/0:0] [ 8900.527924][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8900.529124][ C0] irq event stamp: 27567077 [ 8900.529369][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8900.529901][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8900.530375][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8900.530875][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8900.531367][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8900.531846][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8900.532499][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8900.532842][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8900.533872][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8900.534196][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8900.534614][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8900.535032][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8900.535450][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8900.535870][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8900.536291][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8900.536755][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8900.537108][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8900.537527][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8900.537945][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8900.538365][ C0] Call Trace: [ 8900.538547][ C0] [ 8900.538705][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8900.538978][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8900.539234][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8900.539522][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8900.539809][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8900.540115][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8900.540400][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8900.540723][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8900.540996][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8900.541272][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8900.541593][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8900.541905][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8900.542237][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8900.542540][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8900.542847][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8900.543155][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8900.543487][ C0] ? get_stack_info+0x36/0xc0 [ 8900.543744][ C0] ? lock_acquire+0x1c1/0x220 [ 8900.544002][ C0] ? lock_release+0x1d5/0x250 [ 8900.544260][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8900.544526][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8900.544815][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8900.545116][ C0] ? lock_acquire+0x1c1/0x220 [ 8900.545363][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8900.545614][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8900.545886][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8900.546135][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8900.546399][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8900.546670][ C0] ? __inet_lookup_established+0x341/0x610 [ 8900.546987][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8900.547278][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8900.547569][ C0] ip_local_deliver+0x19d/0x480 [ 8900.547832][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8900.548119][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8900.548385][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8900.548659][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8900.548920][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8900.549259][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8900.549536][ C0] ip_rcv+0x564/0x740 [ 8900.549748][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8900.549988][ C0] ? set_track_prepare+0x8a/0xd0 [ 8900.550252][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8900.550547][ C0] ? rest_init+0x153/0x260 [ 8900.550783][ C0] ? skb_clone+0x10b/0x330 [ 8900.551025][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8900.551359][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8900.551678][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8900.551979][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8900.552290][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8900.552552][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8900.552796][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8900.553118][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8900.553428][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8900.553772][ C0] ? lock_acquire+0x1c1/0x220 [ 8900.554024][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8900.554339][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8900.554637][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8900.554976][ C0] ? __copy_skb_header+0xaf/0x490 [ 8900.555246][ C0] ? __skb_clone+0x57a/0x760 [ 8900.555494][ C0] netif_receive_skb+0x55/0x280 [ 8900.555752][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8900.556076][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8900.556422][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8900.556736][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8900.557021][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8900.557319][ C0] ? hlock_class+0x4e/0x130 [ 8900.557561][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8900.557892][ C0] ? place_entity+0x21/0x2f0 [ 8900.558139][ C0] ? resched_curr+0x219/0x280 [ 8900.558395][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8900.558663][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8900.558946][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8900.559221][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8900.559478][ C0] ? activate_task+0xf5/0x260 [ 8900.559726][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8900.559999][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8900.560273][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8900.560531][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8900.560822][ C0] ? get_stack_info+0x36/0xc0 [ 8900.561078][ C0] ? stack_access_ok+0xda/0x1f0 [ 8900.561338][ C0] ? get_reg+0x119/0x190 [ 8900.561566][ C0] __tcf_classify+0x32c/0x7d0 [ 8900.561818][ C0] tcf_classify+0x283/0x930 [ 8900.562058][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8900.562381][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8900.562651][ C0] ? arch_stack_walk+0x8c/0x100 [ 8900.562914][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8900.563205][ C0] tc_run+0x2e4/0x5d0 [ 8900.563423][ C0] ? __pfx_tc_run+0x10/0x10 [ 8900.563666][ C0] ? lock_acquire+0x1c1/0x220 [ 8900.563917][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8900.564193][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8900.564457][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8900.564744][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8900.565025][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8900.565344][ C0] ? neigh_hh_output+0x348/0x590 [ 8900.565611][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8900.565891][ C0] ip_finish_output2+0x786/0x18e0 [ 8900.566162][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8900.566455][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8900.566807][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8900.567098][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8900.567365][ C0] ? __ip_finish_output+0x10f/0x770 [ 8900.567641][ C0] ip_output+0x16b/0x4f0 [ 8900.567864][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8900.568149][ C0] ? __pfx_ip_output+0x10/0x10 [ 8900.568401][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8900.568707][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8900.568968][ C0] ? ip_local_out+0x114/0x3b0 [ 8900.569221][ C0] __ip_queue_xmit+0x672/0x1910 [ 8900.569482][ C0] ? __skb_clone+0x57a/0x760 [ 8900.569730][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8900.570008][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8900.570300][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8900.570614][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8900.570872][ C0] ? tcp_current_mss+0x40a/0x510 [ 8900.571133][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8900.571416][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8900.571689][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8900.571940][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8900.572211][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8900.572529][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8900.572805][ C0] ? ktime_get+0xb6/0x190 [ 8900.573037][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8900.573309][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8900.573601][ C0] tcp_write_timer+0x82/0x1d0 [ 8900.573852][ C0] call_timer_fn+0x176/0x430 [ 8900.574101][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8900.574373][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8900.574647][ C0] __run_timers.part.0+0x52d/0x890 [ 8900.574917][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8900.575200][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8900.575496][ C0] ? lock_acquire+0x1c1/0x220 [ 8900.575746][ C0] ? clockevents_program_event+0xf6/0x300 [ 8900.576053][ C0] ? lock_release+0x1d5/0x250 [ 8900.576308][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8900.576587][ C0] ? ktime_get+0xb6/0x190 [ 8900.576821][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8900.577121][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8900.577429][ C0] run_timer_softirq+0x72/0x100 [ 8900.577690][ C0] __do_softirq+0x1bc/0x7ff [ 8900.577935][ C0] irq_exit_rcu+0x98/0xc0 [ 8900.578167][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8900.578467][ C0] [ 8900.578623][ C0] [ 8900.578779][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8900.579099][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8900.579368][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8900.580390][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8900.580716][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8900.581137][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8900.581560][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8900.581983][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8900.582403][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8900.582824][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8900.583130][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8900.583411][ C0] default_idle_call+0x69/0xa0 [ 8900.583664][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8900.583926][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8900.584218][ C0] ? lock_release+0x1d5/0x250 [ 8900.584467][ C0] do_idle+0xfb/0x160 [ 8900.584677][ C0] cpu_startup_entry+0x55/0x60 [ 8900.584927][ C0] rest_init+0x153/0x260 [ 8900.585155][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8900.585441][ C0] arch_call_rest_init+0x13/0x40 [ 8900.585704][ C0] start_kernel+0x314/0x3d0 [ 8900.585948][ C0] x86_64_start_reservations+0x18/0x30 [ 8900.586239][ C0] x86_64_start_kernel+0xba/0x110 [ 8900.586505][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8900.586826][ C0] [ 8900.586989][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7183s! [ksoftirqd/1:22] [ 8900.587470][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8900.588661][ C1] irq event stamp: 3886976 [ 8900.588896][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8900.589400][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8900.589899][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8900.590402][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8900.590890][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8900.591390][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8900.592043][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8900.592387][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8900.593426][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8900.593749][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8900.594169][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8900.594586][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8900.595005][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8900.595424][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8900.595842][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8900.596313][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8900.596666][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8900.597086][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8900.597509][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8900.597933][ C1] Call Trace: [ 8900.598122][ C1] [ 8900.598280][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8900.598556][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8900.598812][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8900.599102][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8900.599397][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8900.599704][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8900.599988][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8900.600311][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8900.600583][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8900.600914][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8900.601227][ C1] [ 8900.601384][ C1] [ 8900.601541][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8900.601872][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8900.602178][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8900.602497][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8900.602798][ C1] ? run_ksoftirqd+0xb/0x60 [ 8900.603043][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8900.603380][ C1] ? __orc_find+0x9c/0xf0 [ 8900.603610][ C1] ? lock_acquire+0x1c1/0x220 [ 8900.603861][ C1] ? irqentry_enter+0x2b/0x60 [ 8900.604115][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8900.604375][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8900.604661][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8900.604960][ C1] ? lock_acquire+0x1c1/0x220 [ 8900.605213][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8900.605468][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8900.605744][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8900.605991][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8900.606252][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8900.606523][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8900.606814][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8900.607105][ C1] ip_local_deliver+0x19d/0x480 [ 8900.607370][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8900.607659][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8900.607927][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8900.608204][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8900.608467][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8900.608806][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8900.609082][ C1] ip_rcv+0x564/0x740 [ 8900.609294][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8900.609536][ C1] ? set_track_prepare+0x8a/0xd0 [ 8900.609800][ C1] ? irqentry_enter+0x2b/0x60 [ 8900.610053][ C1] ? irqentry_enter+0x2b/0x60 [ 8900.610311][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8900.610555][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8900.610875][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8900.611222][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8900.611534][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8900.611874][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8900.612173][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8900.612510][ C1] netif_receive_skb+0x55/0x280 [ 8900.612777][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8900.613114][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8900.613471][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8900.613787][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8900.614077][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8900.614380][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8900.614707][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8900.614986][ C1] ? arch_stack_walk+0x68/0x100 [ 8900.615250][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8900.615531][ C1] ? irqentry_enter+0x2b/0x60 [ 8900.615784][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8900.616110][ C1] ? irqentry_enter+0x2b/0x60 [ 8900.616362][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8900.616683][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8900.616966][ C1] ? arch_stack_walk+0x68/0x100 [ 8900.617228][ C1] __tcf_classify+0x32c/0x7d0 [ 8900.617482][ C1] tcf_classify+0x283/0x930 [ 8900.617725][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8900.617994][ C1] tc_run+0x2e4/0x5d0 [ 8900.618211][ C1] ? __pfx_tc_run+0x10/0x10 [ 8900.618454][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8900.618720][ C1] ? irqentry_enter+0x2b/0x60 [ 8900.618973][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8900.619264][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8900.619592][ C1] ip_finish_output2+0x786/0x18e0 [ 8900.619862][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8900.620152][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8900.620421][ C1] ? __ip_finish_output+0x10f/0x770 [ 8900.620700][ C1] ip_output+0x16b/0x4f0 [ 8900.620927][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8900.621251][ C1] ? __pfx_ip_output+0x10/0x10 [ 8900.621508][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8900.621865][ C1] ? __pfx_ip_output+0x10/0x10 [ 8900.622127][ C1] __ip_queue_xmit+0x672/0x1910 [ 8900.622389][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8900.622675][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8900.622971][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8900.623262][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8900.623571][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8900.623859][ C1] tcp_delack_timer+0x84/0x240 [ 8900.624119][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8900.624404][ C1] call_timer_fn+0x176/0x430 [ 8900.624654][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8900.624932][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8900.625210][ C1] __run_timers.part.0+0x52d/0x890 [ 8900.625481][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8900.625771][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8900.626074][ C1] ? __pfx___schedule+0x10/0x10 [ 8900.626334][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8900.626652][ C1] run_timer_softirq+0x72/0x100 [ 8900.626916][ C1] __do_softirq+0x1bc/0x7ff [ 8900.627164][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8900.627442][ C1] run_ksoftirqd+0x2e/0x60 [ 8900.627681][ C1] smpboot_thread_fn+0x30e/0x840 [ 8900.627951][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8900.628243][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8900.628535][ C1] kthread+0x292/0x360 [ 8900.628752][ C1] ? __pfx_kthread+0x10/0x10 [ 8900.629001][ C1] ret_from_fork+0x34/0x70 [ 8900.629239][ C1] ? __pfx_kthread+0x10/0x10 [ 8900.629487][ C1] ret_from_fork_asm+0x1b/0x30 [ 8900.629748][ C1] [ 8928.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7209s! [swapper/0:0] [ 8928.527921][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8928.529115][ C0] irq event stamp: 27567077 [ 8928.529355][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8928.529905][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8928.530381][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8928.530885][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8928.531381][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8928.531861][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8928.532504][ C0] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 8928.532803][ C0] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 8928.533836][ C0] RSP: 0018:ffffc900000069c0 EFLAGS: 00000286 [ 8928.534159][ C0] RAX: ffff88800a099b5c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8928.534581][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8928.535002][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8928.535425][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8928.535848][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8928.536271][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8928.536745][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8928.537100][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8928.537527][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8928.537955][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8928.538385][ C0] Call Trace: [ 8928.538567][ C0] [ 8928.538733][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8928.539013][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8928.539269][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8928.539563][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8928.539849][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8928.540152][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8928.540430][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8928.540750][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8928.541027][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8928.541304][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8928.541632][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8928.541945][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8928.542275][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8928.542587][ C0] ? kasan_check_range+0x1a/0x1c0 [ 8928.542859][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 8928.543159][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8928.543492][ C0] ? get_stack_info+0x36/0xc0 [ 8928.543748][ C0] ? lock_acquire+0x1c1/0x220 [ 8928.544004][ C0] ? lock_release+0x1d5/0x250 [ 8928.544260][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8928.544523][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8928.544813][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8928.545123][ C0] ? lock_acquire+0x1c1/0x220 [ 8928.545375][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8928.545629][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8928.545902][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8928.546153][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8928.546416][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8928.546689][ C0] ? __inet_lookup_established+0x341/0x610 [ 8928.547005][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8928.547297][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8928.547587][ C0] ip_local_deliver+0x19d/0x480 [ 8928.547854][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8928.548146][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8928.548414][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8928.548694][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8928.548957][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8928.549298][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8928.549572][ C0] ip_rcv+0x564/0x740 [ 8928.549785][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8928.550026][ C0] ? set_track_prepare+0x8a/0xd0 [ 8928.550291][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8928.550582][ C0] ? rest_init+0x153/0x260 [ 8928.550819][ C0] ? skb_clone+0x10b/0x330 [ 8928.551062][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8928.551396][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8928.551717][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8928.552021][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8928.552335][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8928.552598][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8928.552843][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8928.553164][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8928.553476][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8928.553819][ C0] ? lock_acquire+0x1c1/0x220 [ 8928.554074][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8928.554388][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8928.554689][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8928.555025][ C0] ? __copy_skb_header+0xaf/0x490 [ 8928.555297][ C0] ? __skb_clone+0x57a/0x760 [ 8928.555551][ C0] netif_receive_skb+0x55/0x280 [ 8928.555808][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8928.556133][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8928.556481][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8928.556797][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8928.557087][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8928.557386][ C0] ? hlock_class+0x4e/0x130 [ 8928.557631][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8928.557961][ C0] ? place_entity+0x21/0x2f0 [ 8928.558208][ C0] ? resched_curr+0x219/0x280 [ 8928.558464][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8928.558738][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8928.559022][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8928.559302][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8928.559562][ C0] ? activate_task+0xf5/0x260 [ 8928.559813][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8928.560089][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8928.560369][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8928.560626][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8928.560915][ C0] ? get_stack_info+0x36/0xc0 [ 8928.561174][ C0] ? stack_access_ok+0xda/0x1f0 [ 8928.561438][ C0] ? get_reg+0x119/0x190 [ 8928.561667][ C0] __tcf_classify+0x32c/0x7d0 [ 8928.561917][ C0] tcf_classify+0x283/0x930 [ 8928.562158][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8928.562488][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8928.562758][ C0] ? arch_stack_walk+0x8c/0x100 [ 8928.563025][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8928.563330][ C0] tc_run+0x2e4/0x5d0 [ 8928.563547][ C0] ? __pfx_tc_run+0x10/0x10 [ 8928.563794][ C0] ? lock_acquire+0x1c1/0x220 [ 8928.564051][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8928.564328][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8928.564594][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8928.564884][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8928.565165][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8928.565488][ C0] ? neigh_hh_output+0x348/0x590 [ 8928.565751][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8928.566033][ C0] ip_finish_output2+0x786/0x18e0 [ 8928.566306][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8928.566602][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8928.566953][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8928.567243][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8928.567511][ C0] ? __ip_finish_output+0x10f/0x770 [ 8928.567790][ C0] ip_output+0x16b/0x4f0 [ 8928.568017][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8928.568304][ C0] ? __pfx_ip_output+0x10/0x10 [ 8928.568557][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8928.568860][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8928.569125][ C0] ? ip_local_out+0x114/0x3b0 [ 8928.569378][ C0] __ip_queue_xmit+0x672/0x1910 [ 8928.569640][ C0] ? __skb_clone+0x57a/0x760 [ 8928.569888][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8928.570168][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8928.570463][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8928.570783][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8928.571044][ C0] ? tcp_current_mss+0x40a/0x510 [ 8928.571308][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8928.571595][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8928.571871][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8928.572126][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8928.572396][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8928.572717][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8928.572994][ C0] ? ktime_get+0xb6/0x190 [ 8928.573234][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8928.573511][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8928.573791][ C0] tcp_write_timer+0x82/0x1d0 [ 8928.574045][ C0] call_timer_fn+0x176/0x430 [ 8928.574295][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8928.574570][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8928.574848][ C0] __run_timers.part.0+0x52d/0x890 [ 8928.575122][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8928.575408][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8928.575707][ C0] ? lock_acquire+0x1c1/0x220 [ 8928.575959][ C0] ? clockevents_program_event+0xf6/0x300 [ 8928.576270][ C0] ? lock_release+0x1d5/0x250 [ 8928.576524][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8928.576804][ C0] ? ktime_get+0xb6/0x190 [ 8928.577039][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8928.577339][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8928.577649][ C0] run_timer_softirq+0x72/0x100 [ 8928.577912][ C0] __do_softirq+0x1bc/0x7ff [ 8928.578162][ C0] irq_exit_rcu+0x98/0xc0 [ 8928.578393][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8928.578698][ C0] [ 8928.578855][ C0] [ 8928.579012][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8928.579331][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8928.579604][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8928.580628][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8928.580957][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8928.581378][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8928.581798][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8928.582222][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8928.582651][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8928.583074][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8928.583385][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8928.583657][ C0] default_idle_call+0x69/0xa0 [ 8928.583912][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8928.584177][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8928.584474][ C0] ? lock_release+0x1d5/0x250 [ 8928.584726][ C0] do_idle+0xfb/0x160 [ 8928.584940][ C0] cpu_startup_entry+0x55/0x60 [ 8928.585195][ C0] rest_init+0x153/0x260 [ 8928.585422][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8928.585709][ C0] arch_call_rest_init+0x13/0x40 [ 8928.585973][ C0] start_kernel+0x314/0x3d0 [ 8928.586221][ C0] x86_64_start_reservations+0x18/0x30 [ 8928.586515][ C0] x86_64_start_kernel+0xba/0x110 [ 8928.586781][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8928.587104][ C0] [ 8928.587269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7209s! [ksoftirqd/1:22] [ 8928.587738][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8928.588942][ C1] irq event stamp: 3886976 [ 8928.589185][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8928.589680][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8928.590174][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8928.590670][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8928.591164][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8928.591656][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8928.592306][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8928.592647][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8928.593681][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8928.594006][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8928.594434][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8928.594855][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8928.595278][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8928.595703][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8928.596132][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8928.596605][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8928.596954][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8928.597383][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8928.597805][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8928.598224][ C1] Call Trace: [ 8928.598402][ C1] [ 8928.598558][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8928.598837][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8928.599092][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8928.599384][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8928.599668][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8928.599970][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8928.600252][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8928.600572][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8928.600849][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8928.601172][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8928.601481][ C1] [ 8928.601640][ C1] [ 8928.601799][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8928.602135][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8928.602438][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8928.602749][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8928.603056][ C1] ? run_ksoftirqd+0xb/0x60 [ 8928.603314][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8928.603641][ C1] ? __orc_find+0x9c/0xf0 [ 8928.603876][ C1] ? lock_acquire+0x1c1/0x220 [ 8928.604132][ C1] ? irqentry_enter+0x2b/0x60 [ 8928.604386][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8928.604651][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8928.604942][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8928.605247][ C1] ? lock_acquire+0x1c1/0x220 [ 8928.605498][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8928.605754][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8928.606027][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8928.606278][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8928.606540][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8928.606817][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8928.607112][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8928.607407][ C1] ip_local_deliver+0x19d/0x480 [ 8928.607665][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8928.607949][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8928.608217][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8928.608499][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8928.608767][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8928.609106][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8928.609385][ C1] ip_rcv+0x564/0x740 [ 8928.609607][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8928.609853][ C1] ? set_track_prepare+0x8a/0xd0 [ 8928.610125][ C1] ? irqentry_enter+0x2b/0x60 [ 8928.610376][ C1] ? irqentry_enter+0x2b/0x60 [ 8928.610629][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8928.610872][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8928.611189][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8928.611530][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8928.611841][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8928.612185][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8928.612487][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8928.612817][ C1] netif_receive_skb+0x55/0x280 [ 8928.613078][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8928.613412][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8928.613766][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8928.614079][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8928.614372][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8928.614677][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8928.615013][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8928.615300][ C1] ? arch_stack_walk+0x68/0x100 [ 8928.615563][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8928.615841][ C1] ? irqentry_enter+0x2b/0x60 [ 8928.616095][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8928.616416][ C1] ? irqentry_enter+0x2b/0x60 [ 8928.616671][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8928.616998][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8928.617279][ C1] ? arch_stack_walk+0x68/0x100 [ 8928.617541][ C1] __tcf_classify+0x32c/0x7d0 [ 8928.617797][ C1] tcf_classify+0x283/0x930 [ 8928.618044][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8928.618317][ C1] tc_run+0x2e4/0x5d0 [ 8928.618540][ C1] ? __pfx_tc_run+0x10/0x10 [ 8928.618788][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8928.619064][ C1] ? irqentry_enter+0x2b/0x60 [ 8928.619316][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8928.619602][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8928.619931][ C1] ip_finish_output2+0x786/0x18e0 [ 8928.620204][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8928.620491][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8928.620760][ C1] ? __ip_finish_output+0x10f/0x770 [ 8928.621042][ C1] ip_output+0x16b/0x4f0 [ 8928.621270][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8928.621596][ C1] ? __pfx_ip_output+0x10/0x10 [ 8928.621854][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8928.622210][ C1] ? __pfx_ip_output+0x10/0x10 [ 8928.622469][ C1] __ip_queue_xmit+0x672/0x1910 [ 8928.622731][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8928.623016][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8928.623318][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8928.623610][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8928.623912][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8928.624202][ C1] tcp_delack_timer+0x84/0x240 [ 8928.624462][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8928.624747][ C1] call_timer_fn+0x176/0x430 [ 8928.624999][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8928.625277][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8928.625553][ C1] __run_timers.part.0+0x52d/0x890 [ 8928.625826][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8928.626120][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8928.626424][ C1] ? __pfx___schedule+0x10/0x10 [ 8928.626688][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8928.627011][ C1] run_timer_softirq+0x72/0x100 [ 8928.627269][ C1] __do_softirq+0x1bc/0x7ff [ 8928.627511][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8928.627786][ C1] run_ksoftirqd+0x2e/0x60 [ 8928.628028][ C1] smpboot_thread_fn+0x30e/0x840 [ 8928.628297][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8928.628591][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8928.628882][ C1] kthread+0x292/0x360 [ 8928.629103][ C1] ? __pfx_kthread+0x10/0x10 [ 8928.629347][ C1] ret_from_fork+0x34/0x70 [ 8928.629590][ C1] ? __pfx_kthread+0x10/0x10 [ 8928.629841][ C1] ret_from_fork_asm+0x1b/0x30 [ 8928.630108][ C1] [ 8950.821023][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8950.821406][ C0] rcu: 0-....: (7699225 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1839030 [ 8950.821932][ C0] rcu: (t=7756512 jiffies g=1007429 q=31 ncpus=4) [ 8950.822282][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8950.822765][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8950.823421][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8950.823763][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8950.824776][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8950.825098][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8950.825512][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8950.825926][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8950.826340][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8950.826755][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8950.827171][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8950.827632][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8950.827983][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8950.828402][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8950.828817][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8950.829235][ C0] Call Trace: [ 8950.829416][ C0] [ 8950.829573][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8950.829858][ C0] ? print_cpu_stall+0x263/0x6a0 [ 8950.830127][ C0] ? check_cpu_stall+0x284/0x500 [ 8950.830390][ C0] ? rcu_pending+0x92/0x360 [ 8950.830634][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8950.830920][ C0] ? update_process_times+0xb9/0x110 [ 8950.831203][ C0] ? tick_sched_handle+0x67/0x130 [ 8950.831477][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8950.831775][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8950.832027][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8950.832355][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8950.832638][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8950.832938][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8950.833224][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8950.833545][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8950.833816][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8950.834092][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8950.834412][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8950.834722][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8950.835051][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8950.835356][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8950.835662][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8950.835968][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8950.836296][ C0] ? get_stack_info+0x36/0xc0 [ 8950.836547][ C0] ? lock_acquire+0x1c1/0x220 [ 8950.836797][ C0] ? lock_release+0x1d5/0x250 [ 8950.837047][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8950.837305][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8950.837589][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8950.837885][ C0] ? lock_acquire+0x1c1/0x220 [ 8950.838136][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8950.838390][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8950.838664][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8950.838909][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8950.839168][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8950.839434][ C0] ? __inet_lookup_established+0x341/0x610 [ 8950.839743][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8950.840035][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8950.840327][ C0] ip_local_deliver+0x19d/0x480 [ 8950.840588][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8950.840869][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8950.841133][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8950.841414][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8950.841679][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8950.842012][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8950.842287][ C0] ip_rcv+0x564/0x740 [ 8950.842502][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8950.842744][ C0] ? set_track_prepare+0x8a/0xd0 [ 8950.843009][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8950.843309][ C0] ? rest_init+0x153/0x260 [ 8950.843543][ C0] ? skb_clone+0x10b/0x330 [ 8950.843783][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8950.844115][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8950.844433][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8950.844731][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8950.845040][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8950.845300][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8950.845543][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8950.845860][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8950.846159][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8950.846495][ C0] ? lock_acquire+0x1c1/0x220 [ 8950.846740][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8950.847048][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8950.847348][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8950.847675][ C0] ? __copy_skb_header+0xaf/0x490 [ 8950.847939][ C0] ? __skb_clone+0x57a/0x760 [ 8950.848187][ C0] netif_receive_skb+0x55/0x280 [ 8950.848450][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8950.848777][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8950.849127][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8950.849436][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8950.849723][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8950.850024][ C0] ? hlock_class+0x4e/0x130 [ 8950.850270][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8950.850601][ C0] ? place_entity+0x21/0x2f0 [ 8950.850849][ C0] ? resched_curr+0x219/0x280 [ 8950.851099][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8950.851364][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8950.851641][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8950.851920][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8950.852178][ C0] ? activate_task+0xf5/0x260 [ 8950.852429][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8950.852705][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8950.852976][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8950.853246][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8950.853535][ C0] ? get_stack_info+0x36/0xc0 [ 8950.853789][ C0] ? stack_access_ok+0xda/0x1f0 [ 8950.854050][ C0] ? get_reg+0x119/0x190 [ 8950.854276][ C0] __tcf_classify+0x32c/0x7d0 [ 8950.854527][ C0] tcf_classify+0x283/0x930 [ 8950.854765][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8950.855092][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8950.855360][ C0] ? arch_stack_walk+0x8c/0x100 [ 8950.855621][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8950.855911][ C0] tc_run+0x2e4/0x5d0 [ 8950.856124][ C0] ? __pfx_tc_run+0x10/0x10 [ 8950.856363][ C0] ? lock_acquire+0x1c1/0x220 [ 8950.856609][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8950.856881][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8950.857150][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8950.857432][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8950.857707][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8950.858024][ C0] ? neigh_hh_output+0x348/0x590 [ 8950.858290][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8950.858567][ C0] ip_finish_output2+0x786/0x18e0 [ 8950.858833][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8950.859121][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8950.859476][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8950.859767][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8950.860032][ C0] ? __ip_finish_output+0x10f/0x770 [ 8950.860311][ C0] ip_output+0x16b/0x4f0 [ 8950.860537][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8950.860816][ C0] ? __pfx_ip_output+0x10/0x10 [ 8950.861074][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8950.861372][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8950.861634][ C0] ? ip_local_out+0x114/0x3b0 [ 8950.861881][ C0] __ip_queue_xmit+0x672/0x1910 [ 8950.862140][ C0] ? __skb_clone+0x57a/0x760 [ 8950.862384][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8950.862666][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8950.862961][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8950.863290][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8950.863547][ C0] ? tcp_current_mss+0x40a/0x510 [ 8950.863808][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8950.864091][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8950.864364][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8950.864613][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8950.864884][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8950.865203][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8950.865476][ C0] ? ktime_get+0xb6/0x190 [ 8950.865706][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8950.865977][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8950.866260][ C0] tcp_write_timer+0x82/0x1d0 [ 8950.866508][ C0] call_timer_fn+0x176/0x430 [ 8950.866751][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8950.867027][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8950.867300][ C0] __run_timers.part.0+0x52d/0x890 [ 8950.867573][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8950.867853][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8950.868153][ C0] ? lock_acquire+0x1c1/0x220 [ 8950.868398][ C0] ? clockevents_program_event+0xf6/0x300 [ 8950.868700][ C0] ? lock_release+0x1d5/0x250 [ 8950.868949][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8950.869225][ C0] ? ktime_get+0xb6/0x190 [ 8950.869455][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8950.869751][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8950.870063][ C0] run_timer_softirq+0x72/0x100 [ 8950.870323][ C0] __do_softirq+0x1bc/0x7ff [ 8950.870563][ C0] irq_exit_rcu+0x98/0xc0 [ 8950.870793][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8950.871091][ C0] [ 8950.871250][ C0] [ 8950.871410][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8950.871732][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8950.871998][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8950.873010][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8950.873342][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8950.873759][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8950.874181][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8950.874601][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8950.875016][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8950.875437][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8950.875741][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8950.876016][ C0] default_idle_call+0x69/0xa0 [ 8950.876268][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8950.876533][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8950.876823][ C0] ? lock_release+0x1d5/0x250 [ 8950.877075][ C0] do_idle+0xfb/0x160 [ 8950.877287][ C0] cpu_startup_entry+0x55/0x60 [ 8950.877540][ C0] rest_init+0x153/0x260 [ 8950.877763][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8950.878052][ C0] arch_call_rest_init+0x13/0x40 [ 8950.878317][ C0] start_kernel+0x314/0x3d0 [ 8950.878555][ C0] x86_64_start_reservations+0x18/0x30 [ 8950.878841][ C0] x86_64_start_kernel+0xba/0x110 [ 8950.879113][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8950.879439][ C0] [ 8950.879607][ C0] Sending NMI from CPU 0 to CPUs 1: [ 8950.879891][ C1] NMI backtrace for cpu 1 [ 8950.879899][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8950.879905][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8950.879908][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8950.879920][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8950.879923][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 8950.879927][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8950.879929][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8950.879931][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8950.879933][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8950.879934][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8950.879936][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8950.879938][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8950.879941][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8950.879943][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8950.879945][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8950.879946][ C1] Call Trace: [ 8950.879949][ C1] [ 8950.879954][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 8950.879961][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8950.879966][ C1] ? nmi_handle+0x156/0x420 [ 8950.879972][ C1] ? default_do_nmi+0x41/0x100 [ 8950.879976][ C1] ? exc_nmi+0xf3/0x120 [ 8950.879978][ C1] ? end_repeat_nmi+0xf/0x60 [ 8950.879983][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8950.879987][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8950.879991][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8950.879994][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8950.879997][ C1] [ 8950.879998][ C1] [ 8950.879999][ C1] ? run_ksoftirqd+0xb/0x60 [ 8950.880005][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8950.880008][ C1] ? __orc_find+0x9c/0xf0 [ 8950.880012][ C1] ? lock_acquire+0x1c1/0x220 [ 8950.880016][ C1] ? irqentry_enter+0x2b/0x60 [ 8950.880023][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8950.880027][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8950.880030][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8950.880034][ C1] ? lock_acquire+0x1c1/0x220 [ 8950.880036][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8950.880042][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8950.880046][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8950.880053][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8950.880056][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8950.880062][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8950.880070][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8950.880074][ C1] ip_local_deliver+0x19d/0x480 [ 8950.880077][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8950.880079][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8950.880085][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8950.880089][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8950.880091][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8950.880095][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8950.880106][ C1] ip_rcv+0x564/0x740 [ 8950.880109][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8950.880112][ C1] ? set_track_prepare+0x8a/0xd0 [ 8950.880117][ C1] ? irqentry_enter+0x2b/0x60 [ 8950.880120][ C1] ? irqentry_enter+0x2b/0x60 [ 8950.880124][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8950.880126][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8950.880131][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8950.880134][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8950.880137][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8950.880140][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8950.880143][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8950.880148][ C1] netif_receive_skb+0x55/0x280 [ 8950.880152][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8950.880161][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8950.880168][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8950.880175][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8950.880182][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8950.880194][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8950.880204][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8950.880207][ C1] ? arch_stack_walk+0x68/0x100 [ 8950.880211][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8950.880214][ C1] ? irqentry_enter+0x2b/0x60 [ 8950.880218][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8950.880222][ C1] ? irqentry_enter+0x2b/0x60 [ 8950.880225][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8950.880232][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8950.880235][ C1] ? arch_stack_walk+0x68/0x100 [ 8950.880239][ C1] __tcf_classify+0x32c/0x7d0 [ 8950.880244][ C1] tcf_classify+0x283/0x930 [ 8950.880247][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8950.880251][ C1] tc_run+0x2e4/0x5d0 [ 8950.880257][ C1] ? __pfx_tc_run+0x10/0x10 [ 8950.880262][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8950.880267][ C1] ? irqentry_enter+0x2b/0x60 [ 8950.880270][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8950.880273][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8950.880280][ C1] ip_finish_output2+0x786/0x18e0 [ 8950.880286][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8950.880289][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8950.880293][ C1] ? __ip_finish_output+0x10f/0x770 [ 8950.880297][ C1] ip_output+0x16b/0x4f0 [ 8950.880300][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8950.880303][ C1] ? __pfx_ip_output+0x10/0x10 [ 8950.880307][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8950.880314][ C1] ? __pfx_ip_output+0x10/0x10 [ 8950.880319][ C1] __ip_queue_xmit+0x672/0x1910 [ 8950.880324][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8950.880331][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8950.880335][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8950.880339][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8950.880343][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8950.880346][ C1] tcp_delack_timer+0x84/0x240 [ 8950.880350][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8950.880353][ C1] call_timer_fn+0x176/0x430 [ 8950.880359][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8950.880364][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8950.880368][ C1] __run_timers.part.0+0x52d/0x890 [ 8950.880371][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8950.880376][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8950.880381][ C1] ? __pfx___schedule+0x10/0x10 [ 8950.880385][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8950.880390][ C1] run_timer_softirq+0x72/0x100 [ 8950.880394][ C1] __do_softirq+0x1bc/0x7ff [ 8950.880398][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8950.880402][ C1] run_ksoftirqd+0x2e/0x60 [ 8950.880405][ C1] smpboot_thread_fn+0x30e/0x840 [ 8950.880411][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8950.880414][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8950.880417][ C1] kthread+0x292/0x360 [ 8950.880421][ C1] ? __pfx_kthread+0x10/0x10 [ 8950.880423][ C1] ret_from_fork+0x34/0x70 [ 8950.880427][ C1] ? __pfx_kthread+0x10/0x10 [ 8950.880429][ C1] ret_from_fork_asm+0x1b/0x30 [ 8950.880438][ C1] [ 8976.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7254s! [swapper/0:0] [ 8976.527912][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8976.529106][ C0] irq event stamp: 27567077 [ 8976.529347][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 8976.529874][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 8976.530355][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 8976.530861][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 8976.531359][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 8976.531840][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8976.532480][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8976.532818][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8976.533851][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 8976.534177][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8976.534602][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 8976.535033][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 8976.535455][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 8976.535876][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 8976.536302][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 8976.536781][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8976.537126][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 8976.537554][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8976.537974][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8976.538390][ C0] Call Trace: [ 8976.538567][ C0] [ 8976.538723][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8976.539004][ C0] ? __run_hrtimer+0x1c3/0x710 [ 8976.539260][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8976.539554][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 8976.539843][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8976.540144][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8976.540421][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8976.540743][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 8976.541018][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 8976.541291][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8976.541619][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8976.541932][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8976.542264][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8976.542572][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8976.542884][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8976.543195][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8976.543528][ C0] ? get_stack_info+0x36/0xc0 [ 8976.543780][ C0] ? lock_acquire+0x1c1/0x220 [ 8976.544029][ C0] ? lock_release+0x1d5/0x250 [ 8976.544277][ C0] do_raw_spin_lock+0x1ec/0x270 [ 8976.544534][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8976.544817][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8976.545116][ C0] ? lock_acquire+0x1c1/0x220 [ 8976.545370][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 8976.545628][ C0] _raw_spin_lock_nested+0x65/0x80 [ 8976.545901][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 8976.546145][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8976.546400][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 8976.546670][ C0] ? __inet_lookup_established+0x341/0x610 [ 8976.546980][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 8976.547272][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 8976.547561][ C0] ip_local_deliver+0x19d/0x480 [ 8976.547826][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 8976.548115][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8976.548383][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 8976.548660][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8976.548922][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8976.549260][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8976.549535][ C0] ip_rcv+0x564/0x740 [ 8976.549747][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8976.549988][ C0] ? set_track_prepare+0x8a/0xd0 [ 8976.550250][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 8976.550540][ C0] ? rest_init+0x153/0x260 [ 8976.550774][ C0] ? skb_clone+0x10b/0x330 [ 8976.551016][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8976.551350][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8976.551668][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 8976.551966][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8976.552282][ C0] ? __tcf_classify+0x32c/0x7d0 [ 8976.552543][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 8976.552790][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 8976.553111][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8976.553410][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8976.553753][ C0] ? lock_acquire+0x1c1/0x220 [ 8976.554009][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 8976.554322][ C0] netif_receive_skb_internal+0xb0/0x300 [ 8976.554621][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8976.554956][ C0] ? __copy_skb_header+0xaf/0x490 [ 8976.555225][ C0] ? __skb_clone+0x57a/0x760 [ 8976.555472][ C0] netif_receive_skb+0x55/0x280 [ 8976.555728][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8976.556051][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8976.556397][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8976.556713][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 8976.557000][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 8976.557299][ C0] ? hlock_class+0x4e/0x130 [ 8976.557541][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8976.557869][ C0] ? place_entity+0x21/0x2f0 [ 8976.558115][ C0] ? resched_curr+0x219/0x280 [ 8976.558369][ C0] ? __pfx_resched_curr+0x10/0x10 [ 8976.558640][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 8976.558923][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 8976.559199][ C0] ? wakeup_preempt+0x161/0x2c0 [ 8976.559456][ C0] ? activate_task+0xf5/0x260 [ 8976.559706][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 8976.559979][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 8976.560256][ C0] ? _raw_spin_unlock+0x23/0x40 [ 8976.560514][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8976.560802][ C0] ? get_stack_info+0x36/0xc0 [ 8976.561057][ C0] ? stack_access_ok+0xda/0x1f0 [ 8976.561320][ C0] ? get_reg+0x119/0x190 [ 8976.561548][ C0] __tcf_classify+0x32c/0x7d0 [ 8976.561796][ C0] tcf_classify+0x283/0x930 [ 8976.562035][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8976.562362][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 8976.562630][ C0] ? arch_stack_walk+0x8c/0x100 [ 8976.562896][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 8976.563194][ C0] tc_run+0x2e4/0x5d0 [ 8976.563410][ C0] ? __pfx_tc_run+0x10/0x10 [ 8976.563656][ C0] ? lock_acquire+0x1c1/0x220 [ 8976.563910][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 8976.564185][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 8976.564450][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8976.564739][ C0] ? ip_finish_output2+0x786/0x18e0 [ 8976.565019][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8976.565341][ C0] ? neigh_hh_output+0x348/0x590 [ 8976.565604][ C0] ? ip_finish_output2+0x262/0x18e0 [ 8976.565885][ C0] ip_finish_output2+0x786/0x18e0 [ 8976.566157][ C0] ? stack_depot_save_flags+0x45/0x550 [ 8976.566452][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8976.566803][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 8976.567092][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8976.567360][ C0] ? __ip_finish_output+0x10f/0x770 [ 8976.567639][ C0] ip_output+0x16b/0x4f0 [ 8976.567865][ C0] ? __run_timers.part.0+0x52d/0x890 [ 8976.568150][ C0] ? __pfx_ip_output+0x10/0x10 [ 8976.568402][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8976.568705][ C0] ? rcu_read_lock_held+0xe/0x50 [ 8976.568969][ C0] ? ip_local_out+0x114/0x3b0 [ 8976.569223][ C0] __ip_queue_xmit+0x672/0x1910 [ 8976.569485][ C0] ? __skb_clone+0x57a/0x760 [ 8976.569734][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 8976.570014][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8976.570309][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 8976.570630][ C0] tcp_write_xmit+0xe42/0x24c0 [ 8976.570890][ C0] ? tcp_current_mss+0x40a/0x510 [ 8976.571152][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 8976.571436][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 8976.571712][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 8976.571967][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 8976.572238][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8976.572559][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8976.572837][ C0] ? ktime_get+0xb6/0x190 [ 8976.573076][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 8976.573356][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8976.573635][ C0] tcp_write_timer+0x82/0x1d0 [ 8976.573888][ C0] call_timer_fn+0x176/0x430 [ 8976.574138][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 8976.574414][ C0] ? next_expiry_recalc+0xcd/0x220 [ 8976.574690][ C0] __run_timers.part.0+0x52d/0x890 [ 8976.574962][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 8976.575248][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 8976.575546][ C0] ? lock_acquire+0x1c1/0x220 [ 8976.575797][ C0] ? clockevents_program_event+0xf6/0x300 [ 8976.576105][ C0] ? lock_release+0x1d5/0x250 [ 8976.576359][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 8976.576638][ C0] ? ktime_get+0xb6/0x190 [ 8976.576872][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 8976.577171][ C0] ? clockevents_program_event+0x1ed/0x300 [ 8976.577481][ C0] run_timer_softirq+0x72/0x100 [ 8976.577743][ C0] __do_softirq+0x1bc/0x7ff [ 8976.577991][ C0] irq_exit_rcu+0x98/0xc0 [ 8976.578224][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 8976.578528][ C0] [ 8976.578684][ C0] [ 8976.578841][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8976.579161][ C0] RIP: 0010:default_idle+0xf/0x20 [ 8976.579434][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8976.580465][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 8976.580793][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 8976.581214][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 8976.581635][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 8976.582058][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 8976.582486][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 8976.582907][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8976.583219][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 8976.583490][ C0] default_idle_call+0x69/0xa0 [ 8976.583746][ C0] cpuidle_idle_call+0x1f6/0x280 [ 8976.584005][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8976.584301][ C0] ? lock_release+0x1d5/0x250 [ 8976.584551][ C0] do_idle+0xfb/0x160 [ 8976.584765][ C0] cpu_startup_entry+0x55/0x60 [ 8976.585019][ C0] rest_init+0x153/0x260 [ 8976.585247][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 8976.585534][ C0] arch_call_rest_init+0x13/0x40 [ 8976.585799][ C0] start_kernel+0x314/0x3d0 [ 8976.586044][ C0] x86_64_start_reservations+0x18/0x30 [ 8976.586338][ C0] x86_64_start_kernel+0xba/0x110 [ 8976.586604][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 8976.586925][ C0] [ 8976.587089][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7254s! [ksoftirqd/1:22] [ 8976.587565][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 8976.588754][ C1] irq event stamp: 3886976 [ 8976.588990][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 8976.589495][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 8976.589994][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 8976.590499][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 8976.590989][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 8976.591488][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8976.592138][ C1] RIP: 0010:__kasan_check_read+0x8/0x20 [ 8976.592441][ C1] Code: 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 48 8b 0c 24 <89> f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f [ 8976.593473][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [ 8976.593794][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 8976.594215][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 8976.594632][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 8976.595052][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 8976.595470][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 8976.595890][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8976.596363][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8976.596716][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 8976.597141][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8976.597570][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8976.597992][ C1] Call Trace: [ 8976.598174][ C1] [ 8976.598335][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8976.598612][ C1] ? __run_hrtimer+0x1c3/0x710 [ 8976.598871][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8976.599163][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8976.599451][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8976.599756][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8976.600039][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 8976.600364][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8976.600638][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 8976.600965][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 8976.601280][ C1] [ 8976.601437][ C1] [ 8976.601594][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8976.601923][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8976.602233][ C1] ? __kasan_check_read+0x8/0x20 [ 8976.602498][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 8976.602792][ C1] ? run_ksoftirqd+0xb/0x60 [ 8976.603046][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8976.603379][ C1] ? __orc_find+0x9c/0xf0 [ 8976.603609][ C1] ? lock_acquire+0x1c1/0x220 [ 8976.603862][ C1] ? irqentry_enter+0x2b/0x60 [ 8976.604116][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8976.604376][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8976.604660][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8976.604958][ C1] ? lock_acquire+0x1c1/0x220 [ 8976.605214][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 8976.605472][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8976.605751][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 8976.605997][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8976.606258][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8976.606529][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8976.606822][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 8976.607117][ C1] ip_local_deliver+0x19d/0x480 [ 8976.607381][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8976.607670][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8976.607938][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 8976.608215][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8976.608478][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8976.608819][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8976.609095][ C1] ip_rcv+0x564/0x740 [ 8976.609308][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8976.609548][ C1] ? set_track_prepare+0x8a/0xd0 [ 8976.609813][ C1] ? irqentry_enter+0x2b/0x60 [ 8976.610070][ C1] ? irqentry_enter+0x2b/0x60 [ 8976.610327][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8976.610573][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8976.610897][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8976.611243][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8976.611556][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8976.611894][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8976.612195][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8976.612532][ C1] netif_receive_skb+0x55/0x280 [ 8976.612794][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8976.613138][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8976.613489][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8976.613808][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 8976.614100][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8976.614406][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8976.614735][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8976.615016][ C1] ? arch_stack_walk+0x68/0x100 [ 8976.615284][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 8976.615569][ C1] ? irqentry_enter+0x2b/0x60 [ 8976.615826][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8976.616151][ C1] ? irqentry_enter+0x2b/0x60 [ 8976.616401][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8976.616726][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 8976.617011][ C1] ? arch_stack_walk+0x68/0x100 [ 8976.617277][ C1] __tcf_classify+0x32c/0x7d0 [ 8976.617530][ C1] tcf_classify+0x283/0x930 [ 8976.617774][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8976.618043][ C1] tc_run+0x2e4/0x5d0 [ 8976.618258][ C1] ? __pfx_tc_run+0x10/0x10 [ 8976.618500][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 8976.618765][ C1] ? irqentry_enter+0x2b/0x60 [ 8976.619019][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8976.619310][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8976.619634][ C1] ip_finish_output2+0x786/0x18e0 [ 8976.619904][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8976.620196][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8976.620463][ C1] ? __ip_finish_output+0x10f/0x770 [ 8976.620741][ C1] ip_output+0x16b/0x4f0 [ 8976.620966][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8976.621293][ C1] ? __pfx_ip_output+0x10/0x10 [ 8976.621547][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 8976.621904][ C1] ? __pfx_ip_output+0x10/0x10 [ 8976.622165][ C1] __ip_queue_xmit+0x672/0x1910 [ 8976.622427][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8976.622706][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8976.623010][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8976.623300][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8976.623596][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8976.623883][ C1] tcp_delack_timer+0x84/0x240 [ 8976.624140][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8976.624423][ C1] call_timer_fn+0x176/0x430 [ 8976.624669][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8976.624946][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 8976.625225][ C1] __run_timers.part.0+0x52d/0x890 [ 8976.625496][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8976.625785][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8976.626089][ C1] ? __pfx___schedule+0x10/0x10 [ 8976.626350][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8976.626669][ C1] run_timer_softirq+0x72/0x100 [ 8976.626934][ C1] __do_softirq+0x1bc/0x7ff [ 8976.627183][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 8976.627461][ C1] run_ksoftirqd+0x2e/0x60 [ 8976.627700][ C1] smpboot_thread_fn+0x30e/0x840 [ 8976.627969][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8976.628258][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 8976.628548][ C1] kthread+0x292/0x360 [ 8976.628767][ C1] ? __pfx_kthread+0x10/0x10 [ 8976.629017][ C1] ret_from_fork+0x34/0x70 [ 8976.629256][ C1] ? __pfx_kthread+0x10/0x10 [ 8976.629503][ C1] ret_from_fork_asm+0x1b/0x30 [ 8976.629761][ C1] [ 9004.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7280s! [swapper/0:0] [ 9004.527914][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9004.529121][ C0] irq event stamp: 27567077 [ 9004.529366][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9004.529898][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9004.530374][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9004.530875][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9004.531369][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9004.531850][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9004.532498][ C0] RIP: 0010:__kasan_check_read+0x0/0x20 [ 9004.532807][ C0] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 9004.533827][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000202 [ 9004.534149][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9004.534571][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9004.534991][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9004.535411][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9004.535831][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9004.536257][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9004.536728][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9004.537081][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9004.537503][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9004.537928][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9004.538349][ C0] Call Trace: [ 9004.538528][ C0] [ 9004.538689][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9004.538963][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9004.539221][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9004.539512][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9004.539800][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9004.540105][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9004.540388][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9004.540718][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9004.540992][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9004.541273][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9004.541598][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9004.541909][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9004.542245][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9004.542549][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 9004.542855][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 9004.543154][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9004.543486][ C0] ? get_stack_info+0x36/0xc0 [ 9004.543742][ C0] ? lock_acquire+0x1c1/0x220 [ 9004.543994][ C0] ? lock_release+0x1d5/0x250 [ 9004.544247][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9004.544507][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9004.544791][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9004.545088][ C0] ? lock_acquire+0x1c1/0x220 [ 9004.545342][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9004.545600][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9004.545876][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9004.546122][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9004.546381][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9004.546648][ C0] ? __inet_lookup_established+0x341/0x610 [ 9004.546959][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9004.547254][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9004.547547][ C0] ip_local_deliver+0x19d/0x480 [ 9004.547803][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9004.548086][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9004.548352][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9004.548633][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9004.548902][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9004.549238][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9004.549517][ C0] ip_rcv+0x564/0x740 [ 9004.549738][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9004.549983][ C0] ? set_track_prepare+0x8a/0xd0 [ 9004.550253][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9004.550542][ C0] ? rest_init+0x153/0x260 [ 9004.550782][ C0] ? skb_clone+0x10b/0x330 [ 9004.551019][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9004.551358][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9004.551683][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9004.551979][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9004.552288][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9004.552548][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9004.552790][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9004.553117][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9004.553419][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9004.553758][ C0] ? lock_acquire+0x1c1/0x220 [ 9004.554008][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9004.554318][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9004.554619][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9004.554947][ C0] ? __copy_skb_header+0xaf/0x490 [ 9004.555215][ C0] ? __skb_clone+0x57a/0x760 [ 9004.555463][ C0] netif_receive_skb+0x55/0x280 [ 9004.555725][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9004.556059][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9004.556409][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9004.556722][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9004.557015][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9004.557324][ C0] ? hlock_class+0x4e/0x130 [ 9004.557573][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9004.557906][ C0] ? place_entity+0x21/0x2f0 [ 9004.558156][ C0] ? resched_curr+0x219/0x280 [ 9004.558405][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9004.558672][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9004.558953][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9004.559235][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9004.559496][ C0] ? activate_task+0xf5/0x260 [ 9004.559751][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9004.560030][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9004.560304][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9004.560573][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9004.560865][ C0] ? get_stack_info+0x36/0xc0 [ 9004.561115][ C0] ? stack_access_ok+0xda/0x1f0 [ 9004.561375][ C0] ? get_reg+0x119/0x190 [ 9004.561602][ C0] __tcf_classify+0x32c/0x7d0 [ 9004.561857][ C0] tcf_classify+0x283/0x930 [ 9004.562104][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9004.562435][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9004.562701][ C0] ? arch_stack_walk+0x8c/0x100 [ 9004.562969][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9004.563264][ C0] tc_run+0x2e4/0x5d0 [ 9004.563479][ C0] ? __pfx_tc_run+0x10/0x10 [ 9004.563719][ C0] ? lock_acquire+0x1c1/0x220 [ 9004.563966][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9004.564240][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9004.564507][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9004.564789][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9004.565065][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9004.565387][ C0] ? neigh_hh_output+0x348/0x590 [ 9004.565655][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9004.565931][ C0] ip_finish_output2+0x786/0x18e0 [ 9004.566199][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9004.566490][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9004.566846][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9004.567137][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9004.567399][ C0] ? __ip_finish_output+0x10f/0x770 [ 9004.567681][ C0] ip_output+0x16b/0x4f0 [ 9004.567911][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9004.568194][ C0] ? __pfx_ip_output+0x10/0x10 [ 9004.568455][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9004.568754][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9004.569021][ C0] ? ip_local_out+0x114/0x3b0 [ 9004.569273][ C0] __ip_queue_xmit+0x672/0x1910 [ 9004.569534][ C0] ? __skb_clone+0x57a/0x760 [ 9004.569782][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9004.570067][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9004.570372][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9004.570692][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9004.570948][ C0] ? tcp_current_mss+0x40a/0x510 [ 9004.571217][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9004.571500][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9004.571781][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9004.572039][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9004.572306][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9004.572625][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9004.572908][ C0] ? ktime_get+0xb6/0x190 [ 9004.573139][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9004.573412][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9004.573699][ C0] tcp_write_timer+0x82/0x1d0 [ 9004.573949][ C0] call_timer_fn+0x176/0x430 [ 9004.574197][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9004.574474][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9004.574747][ C0] __run_timers.part.0+0x52d/0x890 [ 9004.575021][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9004.575301][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9004.575603][ C0] ? lock_acquire+0x1c1/0x220 [ 9004.575853][ C0] ? clockevents_program_event+0xf6/0x300 [ 9004.576159][ C0] ? lock_release+0x1d5/0x250 [ 9004.576407][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9004.576682][ C0] ? ktime_get+0xb6/0x190 [ 9004.576912][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9004.577210][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9004.577523][ C0] run_timer_softirq+0x72/0x100 [ 9004.577783][ C0] __do_softirq+0x1bc/0x7ff [ 9004.578024][ C0] irq_exit_rcu+0x98/0xc0 [ 9004.578254][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9004.578552][ C0] [ 9004.578716][ C0] [ 9004.578877][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9004.579201][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9004.579468][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9004.580483][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9004.580803][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9004.581222][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9004.581639][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9004.582055][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9004.582471][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9004.582896][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9004.583203][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9004.583479][ C0] default_idle_call+0x69/0xa0 [ 9004.583735][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9004.583999][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9004.584289][ C0] ? lock_release+0x1d5/0x250 [ 9004.584542][ C0] do_idle+0xfb/0x160 [ 9004.584759][ C0] cpu_startup_entry+0x55/0x60 [ 9004.585018][ C0] rest_init+0x153/0x260 [ 9004.585244][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9004.585532][ C0] arch_call_rest_init+0x13/0x40 [ 9004.585802][ C0] start_kernel+0x314/0x3d0 [ 9004.586044][ C0] x86_64_start_reservations+0x18/0x30 [ 9004.586334][ C0] x86_64_start_kernel+0xba/0x110 [ 9004.586607][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9004.586941][ C0] [ 9004.587111][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7280s! [ksoftirqd/1:22] [ 9004.587589][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9004.588775][ C1] irq event stamp: 3886976 [ 9004.589010][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9004.589512][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9004.590010][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9004.590512][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9004.591002][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9004.591499][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9004.592155][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa8/0xb90 [ 9004.592495][ C1] Code: 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 be 04 00 00 00 <48> 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c 08 84 c0 0f 85 [ 9004.593527][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9004.593856][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9004.594282][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9004.594701][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9004.595121][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9004.595545][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9004.595970][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9004.596443][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9004.596792][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9004.597220][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9004.597639][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9004.598059][ C1] Call Trace: [ 9004.598237][ C1] [ 9004.598393][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9004.598674][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9004.598929][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9004.599224][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9004.599508][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9004.599811][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9004.600091][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9004.600411][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9004.600690][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9004.601017][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9004.601329][ C1] [ 9004.601488][ C1] [ 9004.601649][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9004.601983][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9004.602288][ C1] ? queued_spin_lock_slowpath+0xa8/0xb90 [ 9004.602592][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9004.602905][ C1] ? run_ksoftirqd+0xb/0x60 [ 9004.603156][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9004.603485][ C1] ? __orc_find+0x9c/0xf0 [ 9004.603716][ C1] ? lock_acquire+0x1c1/0x220 [ 9004.603965][ C1] ? irqentry_enter+0x2b/0x60 [ 9004.604215][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9004.604475][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9004.604761][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9004.605060][ C1] ? lock_acquire+0x1c1/0x220 [ 9004.605314][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9004.605570][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9004.605848][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9004.606095][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9004.606354][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9004.606626][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9004.606917][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9004.607208][ C1] ip_local_deliver+0x19d/0x480 [ 9004.607471][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9004.607762][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9004.608033][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9004.608313][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9004.608577][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9004.608918][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9004.609198][ C1] ip_rcv+0x564/0x740 [ 9004.609414][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9004.609657][ C1] ? set_track_prepare+0x8a/0xd0 [ 9004.609922][ C1] ? irqentry_enter+0x2b/0x60 [ 9004.610177][ C1] ? irqentry_enter+0x2b/0x60 [ 9004.610430][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9004.610677][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9004.610995][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9004.611341][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9004.611654][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9004.611994][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9004.612299][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9004.612638][ C1] netif_receive_skb+0x55/0x280 [ 9004.612910][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9004.613237][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9004.613586][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9004.613902][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9004.614195][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9004.614497][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9004.614824][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9004.615104][ C1] ? arch_stack_walk+0x68/0x100 [ 9004.615367][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9004.615647][ C1] ? irqentry_enter+0x2b/0x60 [ 9004.615900][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9004.616225][ C1] ? irqentry_enter+0x2b/0x60 [ 9004.616476][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9004.616800][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9004.617084][ C1] ? arch_stack_walk+0x68/0x100 [ 9004.617342][ C1] __tcf_classify+0x32c/0x7d0 [ 9004.617591][ C1] tcf_classify+0x283/0x930 [ 9004.617832][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9004.618102][ C1] tc_run+0x2e4/0x5d0 [ 9004.618318][ C1] ? __pfx_tc_run+0x10/0x10 [ 9004.618564][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9004.618830][ C1] ? irqentry_enter+0x2b/0x60 [ 9004.619084][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9004.619376][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9004.619703][ C1] ip_finish_output2+0x786/0x18e0 [ 9004.619976][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9004.620267][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9004.620533][ C1] ? __ip_finish_output+0x10f/0x770 [ 9004.620817][ C1] ip_output+0x16b/0x4f0 [ 9004.621056][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9004.621377][ C1] ? __pfx_ip_output+0x10/0x10 [ 9004.621639][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9004.621992][ C1] ? __pfx_ip_output+0x10/0x10 [ 9004.622248][ C1] __ip_queue_xmit+0x672/0x1910 [ 9004.622517][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9004.622812][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9004.623111][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9004.623399][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9004.623695][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9004.623982][ C1] tcp_delack_timer+0x84/0x240 [ 9004.624240][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9004.624529][ C1] call_timer_fn+0x176/0x430 [ 9004.624782][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9004.625059][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9004.625340][ C1] __run_timers.part.0+0x52d/0x890 [ 9004.625617][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9004.625906][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9004.626208][ C1] ? __pfx___schedule+0x10/0x10 [ 9004.626472][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9004.626796][ C1] run_timer_softirq+0x72/0x100 [ 9004.627055][ C1] __do_softirq+0x1bc/0x7ff [ 9004.627298][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9004.627574][ C1] run_ksoftirqd+0x2e/0x60 [ 9004.627814][ C1] smpboot_thread_fn+0x30e/0x840 [ 9004.628083][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9004.628378][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9004.628673][ C1] kthread+0x292/0x360 [ 9004.628891][ C1] ? __pfx_kthread+0x10/0x10 [ 9004.629135][ C1] ret_from_fork+0x34/0x70 [ 9004.629377][ C1] ? __pfx_kthread+0x10/0x10 [ 9004.629625][ C1] ret_from_fork_asm+0x1b/0x30 [ 9004.629890][ C1] [ 9028.883023][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9028.883410][ C0] rcu: 0-....: (7777111 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1858384 [ 9028.883937][ C0] rcu: (t=7834574 jiffies g=1007429 q=31 ncpus=4) [ 9028.884286][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9028.884766][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9028.885417][ C0] RIP: 0010:__kasan_check_read+0x0/0x20 [ 9028.885720][ C0] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 9028.886749][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000202 [ 9028.887075][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9028.887503][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9028.887924][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9028.888346][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9028.888771][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9028.889201][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9028.889674][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9028.890026][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9028.890455][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9028.890875][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9028.891294][ C0] Call Trace: [ 9028.891471][ C0] [ 9028.891626][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9028.891915][ C0] ? print_cpu_stall+0x263/0x6a0 [ 9028.892179][ C0] ? check_cpu_stall+0x284/0x500 [ 9028.892450][ C0] ? rcu_pending+0x92/0x360 [ 9028.892701][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9028.892985][ C0] ? update_process_times+0xb9/0x110 [ 9028.893266][ C0] ? tick_sched_handle+0x67/0x130 [ 9028.893539][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9028.893839][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9028.894090][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9028.894420][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9028.894707][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9028.895009][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9028.895286][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9028.895604][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9028.895879][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9028.896154][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9028.896481][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9028.896795][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9028.897123][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9028.897430][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 9028.897726][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 9028.898021][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9028.898351][ C0] ? get_stack_info+0x36/0xc0 [ 9028.898602][ C0] ? lock_acquire+0x1c1/0x220 [ 9028.898852][ C0] ? lock_release+0x1d5/0x250 [ 9028.899101][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9028.899358][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9028.899640][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9028.899938][ C0] ? lock_acquire+0x1c1/0x220 [ 9028.900192][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9028.900449][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9028.900723][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9028.900966][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9028.901223][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9028.901489][ C0] ? __inet_lookup_established+0x341/0x610 [ 9028.901802][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9028.902093][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9028.902383][ C0] ip_local_deliver+0x19d/0x480 [ 9028.902645][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9028.902940][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9028.903210][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9028.903487][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9028.903750][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9028.904088][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9028.904361][ C0] ip_rcv+0x564/0x740 [ 9028.904575][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9028.904818][ C0] ? set_track_prepare+0x8a/0xd0 [ 9028.905083][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9028.905373][ C0] ? rest_init+0x153/0x260 [ 9028.905610][ C0] ? skb_clone+0x10b/0x330 [ 9028.905850][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9028.906182][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9028.906500][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9028.906797][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9028.907109][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9028.907372][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9028.907621][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9028.907940][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9028.908243][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9028.908583][ C0] ? lock_acquire+0x1c1/0x220 [ 9028.908832][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9028.909141][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9028.909443][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9028.909774][ C0] ? __copy_skb_header+0xaf/0x490 [ 9028.910041][ C0] ? __skb_clone+0x57a/0x760 [ 9028.910285][ C0] netif_receive_skb+0x55/0x280 [ 9028.910545][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9028.910876][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9028.911231][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9028.911544][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9028.911836][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9028.912142][ C0] ? hlock_class+0x4e/0x130 [ 9028.912391][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9028.912732][ C0] ? place_entity+0x21/0x2f0 [ 9028.912977][ C0] ? resched_curr+0x219/0x280 [ 9028.913229][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9028.913501][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9028.913785][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9028.914061][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9028.914318][ C0] ? activate_task+0xf5/0x260 [ 9028.914567][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9028.914843][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9028.915120][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9028.915377][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9028.915665][ C0] ? get_stack_info+0x36/0xc0 [ 9028.915918][ C0] ? stack_access_ok+0xda/0x1f0 [ 9028.916179][ C0] ? get_reg+0x119/0x190 [ 9028.916411][ C0] __tcf_classify+0x32c/0x7d0 [ 9028.916661][ C0] tcf_classify+0x283/0x930 [ 9028.916902][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9028.917231][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9028.917500][ C0] ? arch_stack_walk+0x8c/0x100 [ 9028.917763][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9028.918059][ C0] tc_run+0x2e4/0x5d0 [ 9028.918276][ C0] ? __pfx_tc_run+0x10/0x10 [ 9028.918518][ C0] ? lock_acquire+0x1c1/0x220 [ 9028.918768][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9028.919040][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9028.919310][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9028.919594][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9028.919870][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9028.920188][ C0] ? neigh_hh_output+0x348/0x590 [ 9028.920454][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9028.920733][ C0] ip_finish_output2+0x786/0x18e0 [ 9028.920999][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9028.921293][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9028.921649][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9028.921940][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9028.922205][ C0] ? __ip_finish_output+0x10f/0x770 [ 9028.922486][ C0] ip_output+0x16b/0x4f0 [ 9028.922727][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9028.923012][ C0] ? __pfx_ip_output+0x10/0x10 [ 9028.923267][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9028.923567][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9028.923830][ C0] ? ip_local_out+0x114/0x3b0 [ 9028.924086][ C0] __ip_queue_xmit+0x672/0x1910 [ 9028.924349][ C0] ? __skb_clone+0x57a/0x760 [ 9028.924602][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9028.924883][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9028.925179][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9028.925496][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9028.925757][ C0] ? tcp_current_mss+0x40a/0x510 [ 9028.926020][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9028.926303][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9028.926580][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9028.926834][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9028.927105][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9028.927428][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9028.927705][ C0] ? ktime_get+0xb6/0x190 [ 9028.927936][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9028.928208][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9028.928492][ C0] tcp_write_timer+0x82/0x1d0 [ 9028.928743][ C0] call_timer_fn+0x176/0x430 [ 9028.928991][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9028.929267][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9028.929540][ C0] __run_timers.part.0+0x52d/0x890 [ 9028.929815][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9028.930098][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9028.930401][ C0] ? lock_acquire+0x1c1/0x220 [ 9028.930650][ C0] ? clockevents_program_event+0xf6/0x300 [ 9028.930952][ C0] ? lock_release+0x1d5/0x250 [ 9028.931200][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9028.931474][ C0] ? ktime_get+0xb6/0x190 [ 9028.931703][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9028.932001][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9028.932317][ C0] run_timer_softirq+0x72/0x100 [ 9028.932576][ C0] __do_softirq+0x1bc/0x7ff [ 9028.932830][ C0] irq_exit_rcu+0x98/0xc0 [ 9028.933066][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9028.933369][ C0] [ 9028.933524][ C0] [ 9028.933681][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9028.933997][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9028.934270][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9028.935289][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9028.935614][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9028.936038][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9028.936458][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9028.936879][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9028.937303][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9028.937728][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9028.938035][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9028.938312][ C0] default_idle_call+0x69/0xa0 [ 9028.938565][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9028.938828][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9028.939118][ C0] ? lock_release+0x1d5/0x250 [ 9028.939373][ C0] do_idle+0xfb/0x160 [ 9028.939597][ C0] cpu_startup_entry+0x55/0x60 [ 9028.939855][ C0] rest_init+0x153/0x260 [ 9028.940080][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9028.940372][ C0] arch_call_rest_init+0x13/0x40 [ 9028.940642][ C0] start_kernel+0x314/0x3d0 [ 9028.940886][ C0] x86_64_start_reservations+0x18/0x30 [ 9028.941178][ C0] x86_64_start_kernel+0xba/0x110 [ 9028.941448][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9028.941781][ C0] [ 9028.941946][ C0] Sending NMI from CPU 0 to CPUs 1: [ 9028.942234][ C1] NMI backtrace for cpu 1 [ 9028.942245][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9028.942250][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9028.942253][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9028.942263][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9028.942267][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9028.942271][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9028.942273][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9028.942275][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9028.942277][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9028.942278][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9028.942280][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9028.942282][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9028.942286][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9028.942288][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9028.942290][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9028.942291][ C1] Call Trace: [ 9028.942295][ C1] [ 9028.942300][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 9028.942306][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9028.942312][ C1] ? nmi_handle+0x156/0x420 [ 9028.942318][ C1] ? default_do_nmi+0x41/0x100 [ 9028.942322][ C1] ? exc_nmi+0xf3/0x120 [ 9028.942324][ C1] ? end_repeat_nmi+0xf/0x60 [ 9028.942329][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9028.942334][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9028.942337][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9028.942341][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9028.942344][ C1] [ 9028.942345][ C1] [ 9028.942346][ C1] ? run_ksoftirqd+0xb/0x60 [ 9028.942353][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9028.942355][ C1] ? __orc_find+0x9c/0xf0 [ 9028.942359][ C1] ? lock_acquire+0x1c1/0x220 [ 9028.942364][ C1] ? irqentry_enter+0x2b/0x60 [ 9028.942369][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9028.942373][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9028.942376][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9028.942380][ C1] ? lock_acquire+0x1c1/0x220 [ 9028.942382][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9028.942389][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9028.942393][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9028.942400][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9028.942403][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9028.942409][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9028.942417][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9028.942421][ C1] ip_local_deliver+0x19d/0x480 [ 9028.942424][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9028.942427][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9028.942432][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9028.942436][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9028.942439][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9028.942443][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9028.942454][ C1] ip_rcv+0x564/0x740 [ 9028.942458][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9028.942461][ C1] ? set_track_prepare+0x8a/0xd0 [ 9028.942466][ C1] ? irqentry_enter+0x2b/0x60 [ 9028.942469][ C1] ? irqentry_enter+0x2b/0x60 [ 9028.942473][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9028.942476][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9028.942481][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9028.942484][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9028.942487][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9028.942490][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9028.942494][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9028.942499][ C1] netif_receive_skb+0x55/0x280 [ 9028.942503][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9028.942512][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9028.942519][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9028.942526][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9028.942534][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9028.942547][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9028.942556][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9028.942559][ C1] ? arch_stack_walk+0x68/0x100 [ 9028.942564][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9028.942568][ C1] ? irqentry_enter+0x2b/0x60 [ 9028.942571][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9028.942577][ C1] ? irqentry_enter+0x2b/0x60 [ 9028.942580][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9028.942588][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9028.942590][ C1] ? arch_stack_walk+0x68/0x100 [ 9028.942594][ C1] __tcf_classify+0x32c/0x7d0 [ 9028.942600][ C1] tcf_classify+0x283/0x930 [ 9028.942604][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9028.942609][ C1] tc_run+0x2e4/0x5d0 [ 9028.942613][ C1] ? __pfx_tc_run+0x10/0x10 [ 9028.942618][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9028.942624][ C1] ? irqentry_enter+0x2b/0x60 [ 9028.942627][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9028.942630][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9028.942637][ C1] ip_finish_output2+0x786/0x18e0 [ 9028.942643][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9028.942646][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9028.942650][ C1] ? __ip_finish_output+0x10f/0x770 [ 9028.942654][ C1] ip_output+0x16b/0x4f0 [ 9028.942658][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9028.942661][ C1] ? __pfx_ip_output+0x10/0x10 [ 9028.942666][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9028.942673][ C1] ? __pfx_ip_output+0x10/0x10 [ 9028.942686][ C1] __ip_queue_xmit+0x672/0x1910 [ 9028.942692][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9028.942699][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9028.942703][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9028.942707][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9028.942712][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9028.942715][ C1] tcp_delack_timer+0x84/0x240 [ 9028.942718][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9028.942721][ C1] call_timer_fn+0x176/0x430 [ 9028.942727][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9028.942733][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9028.942737][ C1] __run_timers.part.0+0x52d/0x890 [ 9028.942740][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9028.942745][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9028.942750][ C1] ? __pfx___schedule+0x10/0x10 [ 9028.942754][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9028.942759][ C1] run_timer_softirq+0x72/0x100 [ 9028.942763][ C1] __do_softirq+0x1bc/0x7ff [ 9028.942767][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9028.942771][ C1] run_ksoftirqd+0x2e/0x60 [ 9028.942774][ C1] smpboot_thread_fn+0x30e/0x840 [ 9028.942780][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9028.942783][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9028.942786][ C1] kthread+0x292/0x360 [ 9028.942790][ C1] ? __pfx_kthread+0x10/0x10 [ 9028.942793][ C1] ret_from_fork+0x34/0x70 [ 9028.942796][ C1] ? __pfx_kthread+0x10/0x10 [ 9028.942798][ C1] ret_from_fork_asm+0x1b/0x30 [ 9028.942807][ C1] [ 9056.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7328s! [swapper/0:0] [ 9056.527927][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9056.529122][ C0] irq event stamp: 27567077 [ 9056.529363][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9056.529892][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9056.530371][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9056.530882][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9056.531388][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9056.531875][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9056.532522][ C0] RIP: 0010:kasan_check_range+0x4/0x1c0 [ 9056.532828][ C0] Code: 6a 00 5b 5d 41 5c 41 5d c3 cc cc cc cc 66 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 <48> 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 [ 9056.533858][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000246 [ 9056.534189][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9056.534612][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9056.535035][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9056.535465][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9056.535893][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9056.536318][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9056.536789][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9056.537138][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9056.537561][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9056.537978][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9056.538397][ C0] Call Trace: [ 9056.538577][ C0] [ 9056.538733][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9056.539012][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9056.539265][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9056.539559][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9056.539842][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9056.540144][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9056.540424][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9056.540743][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9056.541021][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9056.541296][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9056.541623][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9056.541940][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9056.542274][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9056.542585][ C0] ? kasan_check_range+0x4/0x1c0 [ 9056.542850][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 9056.543149][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9056.543478][ C0] ? get_stack_info+0x36/0xc0 [ 9056.543728][ C0] ? lock_acquire+0x1c1/0x220 [ 9056.543977][ C0] ? lock_release+0x1d5/0x250 [ 9056.544228][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9056.544487][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9056.544773][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9056.545076][ C0] ? lock_acquire+0x1c1/0x220 [ 9056.545329][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9056.545592][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9056.545872][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9056.546119][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9056.546376][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9056.546646][ C0] ? __inet_lookup_established+0x341/0x610 [ 9056.546959][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9056.547260][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9056.547556][ C0] ip_local_deliver+0x19d/0x480 [ 9056.547815][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9056.548102][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9056.548366][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9056.548648][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9056.548913][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9056.549248][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9056.549528][ C0] ip_rcv+0x564/0x740 [ 9056.549743][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9056.549991][ C0] ? set_track_prepare+0x8a/0xd0 [ 9056.550259][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9056.550547][ C0] ? rest_init+0x153/0x260 [ 9056.550788][ C0] ? skb_clone+0x10b/0x330 [ 9056.551027][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9056.551365][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9056.551686][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9056.551984][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9056.552292][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9056.552558][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9056.552804][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9056.553124][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9056.553427][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9056.553767][ C0] ? lock_acquire+0x1c1/0x220 [ 9056.554023][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9056.554334][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9056.554637][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9056.554967][ C0] ? __copy_skb_header+0xaf/0x490 [ 9056.555234][ C0] ? __skb_clone+0x57a/0x760 [ 9056.555478][ C0] netif_receive_skb+0x55/0x280 [ 9056.555740][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9056.556071][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9056.556423][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9056.556735][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9056.557026][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9056.557329][ C0] ? hlock_class+0x4e/0x130 [ 9056.557576][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9056.557911][ C0] ? place_entity+0x21/0x2f0 [ 9056.558163][ C0] ? resched_curr+0x219/0x280 [ 9056.558414][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9056.558681][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9056.558961][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9056.559242][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9056.559506][ C0] ? activate_task+0xf5/0x260 [ 9056.559759][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9056.560037][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9056.560312][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9056.560576][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9056.560872][ C0] ? get_stack_info+0x36/0xc0 [ 9056.561126][ C0] ? stack_access_ok+0xda/0x1f0 [ 9056.561385][ C0] ? get_reg+0x119/0x190 [ 9056.561612][ C0] __tcf_classify+0x32c/0x7d0 [ 9056.561870][ C0] tcf_classify+0x283/0x930 [ 9056.562116][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9056.562450][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9056.562726][ C0] ? arch_stack_walk+0x8c/0x100 [ 9056.562993][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9056.563288][ C0] tc_run+0x2e4/0x5d0 [ 9056.563503][ C0] ? __pfx_tc_run+0x10/0x10 [ 9056.563744][ C0] ? lock_acquire+0x1c1/0x220 [ 9056.563996][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9056.564272][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9056.564543][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9056.564829][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9056.565109][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9056.565428][ C0] ? neigh_hh_output+0x348/0x590 [ 9056.565697][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9056.565975][ C0] ip_finish_output2+0x786/0x18e0 [ 9056.566245][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9056.566537][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9056.566896][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9056.567192][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9056.567457][ C0] ? __ip_finish_output+0x10f/0x770 [ 9056.567740][ C0] ip_output+0x16b/0x4f0 [ 9056.567968][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9056.568249][ C0] ? __pfx_ip_output+0x10/0x10 [ 9056.568506][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9056.568807][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9056.569077][ C0] ? ip_local_out+0x114/0x3b0 [ 9056.569326][ C0] __ip_queue_xmit+0x672/0x1910 [ 9056.569586][ C0] ? __skb_clone+0x57a/0x760 [ 9056.569830][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9056.570116][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9056.570413][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9056.570737][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9056.570993][ C0] ? tcp_current_mss+0x40a/0x510 [ 9056.571260][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9056.571539][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9056.571822][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9056.572078][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9056.572346][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9056.572671][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9056.572948][ C0] ? ktime_get+0xb6/0x190 [ 9056.573179][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9056.573451][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9056.573738][ C0] tcp_write_timer+0x82/0x1d0 [ 9056.573987][ C0] call_timer_fn+0x176/0x430 [ 9056.574234][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9056.574510][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9056.574782][ C0] __run_timers.part.0+0x52d/0x890 [ 9056.575059][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9056.575343][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9056.575643][ C0] ? lock_acquire+0x1c1/0x220 [ 9056.575890][ C0] ? clockevents_program_event+0xf6/0x300 [ 9056.576195][ C0] ? lock_release+0x1d5/0x250 [ 9056.576448][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9056.576723][ C0] ? ktime_get+0xb6/0x190 [ 9056.576953][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9056.577254][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9056.577569][ C0] run_timer_softirq+0x72/0x100 [ 9056.577828][ C0] __do_softirq+0x1bc/0x7ff [ 9056.578074][ C0] irq_exit_rcu+0x98/0xc0 [ 9056.578303][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9056.578600][ C0] [ 9056.578758][ C0] [ 9056.578917][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9056.579240][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9056.579508][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9056.580524][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9056.580848][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9056.581269][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9056.581688][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9056.582110][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9056.582528][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9056.582958][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9056.583265][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9056.583541][ C0] default_idle_call+0x69/0xa0 [ 9056.583793][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9056.584061][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9056.584354][ C0] ? lock_release+0x1d5/0x250 [ 9056.584610][ C0] do_idle+0xfb/0x160 [ 9056.584826][ C0] cpu_startup_entry+0x55/0x60 [ 9056.585083][ C0] rest_init+0x153/0x260 [ 9056.585310][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9056.585602][ C0] arch_call_rest_init+0x13/0x40 [ 9056.585871][ C0] start_kernel+0x314/0x3d0 [ 9056.586114][ C0] x86_64_start_reservations+0x18/0x30 [ 9056.586406][ C0] x86_64_start_kernel+0xba/0x110 [ 9056.586679][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9056.587009][ C0] [ 9056.587178][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7328s! [ksoftirqd/1:22] [ 9056.587652][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9056.588855][ C1] irq event stamp: 3886976 [ 9056.589096][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9056.589593][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9056.590089][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9056.590588][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9056.591088][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9056.591582][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9056.592234][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 9056.592531][ C1] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 9056.593578][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [ 9056.593908][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9056.594333][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9056.594757][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9056.595184][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9056.595610][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9056.596032][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9056.596502][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9056.596849][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9056.597270][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9056.597687][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9056.598104][ C1] Call Trace: [ 9056.598283][ C1] [ 9056.598439][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9056.598721][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9056.598974][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9056.599268][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9056.599552][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9056.599855][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9056.600137][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9056.600459][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9056.600738][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9056.601067][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9056.601378][ C1] [ 9056.601538][ C1] [ 9056.601698][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9056.602034][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9056.602337][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 9056.602640][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 9056.602942][ C1] ? run_ksoftirqd+0xb/0x60 [ 9056.603192][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9056.603522][ C1] ? __orc_find+0x9c/0xf0 [ 9056.603753][ C1] ? lock_acquire+0x1c1/0x220 [ 9056.604005][ C1] ? irqentry_enter+0x2b/0x60 [ 9056.604257][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9056.604516][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9056.604801][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9056.605102][ C1] ? lock_acquire+0x1c1/0x220 [ 9056.605358][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9056.605618][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9056.605895][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9056.606141][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9056.606399][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9056.606669][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9056.606960][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9056.607252][ C1] ip_local_deliver+0x19d/0x480 [ 9056.607513][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9056.607801][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9056.608071][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9056.608349][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9056.608614][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9056.608953][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9056.609229][ C1] ip_rcv+0x564/0x740 [ 9056.609442][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9056.609683][ C1] ? set_track_prepare+0x8a/0xd0 [ 9056.609949][ C1] ? irqentry_enter+0x2b/0x60 [ 9056.610206][ C1] ? irqentry_enter+0x2b/0x60 [ 9056.610462][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9056.610707][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9056.611028][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9056.611372][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9056.611686][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9056.612026][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9056.612326][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9056.612671][ C1] netif_receive_skb+0x55/0x280 [ 9056.612929][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9056.613254][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9056.613604][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9056.613924][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9056.614216][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9056.614520][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9056.614850][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9056.615134][ C1] ? arch_stack_walk+0x68/0x100 [ 9056.615400][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9056.615682][ C1] ? irqentry_enter+0x2b/0x60 [ 9056.615943][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9056.616271][ C1] ? irqentry_enter+0x2b/0x60 [ 9056.616520][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9056.616842][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9056.617127][ C1] ? arch_stack_walk+0x68/0x100 [ 9056.617388][ C1] __tcf_classify+0x32c/0x7d0 [ 9056.617639][ C1] tcf_classify+0x283/0x930 [ 9056.617882][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9056.618151][ C1] tc_run+0x2e4/0x5d0 [ 9056.618367][ C1] ? __pfx_tc_run+0x10/0x10 [ 9056.618611][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9056.618880][ C1] ? irqentry_enter+0x2b/0x60 [ 9056.619138][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9056.619429][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9056.619754][ C1] ip_finish_output2+0x786/0x18e0 [ 9056.620025][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9056.620317][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9056.620584][ C1] ? __ip_finish_output+0x10f/0x770 [ 9056.620860][ C1] ip_output+0x16b/0x4f0 [ 9056.621090][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9056.621411][ C1] ? __pfx_ip_output+0x10/0x10 [ 9056.621667][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9056.622025][ C1] ? __pfx_ip_output+0x10/0x10 [ 9056.622285][ C1] __ip_queue_xmit+0x672/0x1910 [ 9056.622554][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9056.622840][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9056.623139][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9056.623429][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9056.623727][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9056.624017][ C1] tcp_delack_timer+0x84/0x240 [ 9056.624278][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9056.624565][ C1] call_timer_fn+0x176/0x430 [ 9056.624814][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9056.625094][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9056.625371][ C1] __run_timers.part.0+0x52d/0x890 [ 9056.625647][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9056.625940][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9056.626246][ C1] ? __pfx___schedule+0x10/0x10 [ 9056.626507][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9056.626829][ C1] run_timer_softirq+0x72/0x100 [ 9056.627093][ C1] __do_softirq+0x1bc/0x7ff [ 9056.627341][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9056.627617][ C1] run_ksoftirqd+0x2e/0x60 [ 9056.627855][ C1] smpboot_thread_fn+0x30e/0x840 [ 9056.628122][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9056.628412][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9056.628708][ C1] kthread+0x292/0x360 [ 9056.628928][ C1] ? __pfx_kthread+0x10/0x10 [ 9056.629178][ C1] ret_from_fork+0x34/0x70 [ 9056.629419][ C1] ? __pfx_kthread+0x10/0x10 [ 9056.629668][ C1] ret_from_fork_asm+0x1b/0x30 [ 9056.629928][ C1] [ 9084.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7354s! [swapper/0:0] [ 9084.527924][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9084.529131][ C0] irq event stamp: 27567077 [ 9084.529378][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9084.529911][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9084.530388][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9084.530891][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9084.531386][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9084.531869][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9084.532527][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9084.532867][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9084.533890][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9084.534217][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9084.534638][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9084.535057][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9084.535476][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9084.535894][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9084.536319][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9084.536791][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9084.537146][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9084.537573][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9084.538003][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9084.538429][ C0] Call Trace: [ 9084.538608][ C0] [ 9084.538771][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9084.539049][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9084.539309][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9084.539601][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9084.539890][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9084.540196][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9084.540482][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9084.540808][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9084.541085][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9084.541365][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9084.541691][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9084.542002][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9084.542340][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9084.542652][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9084.542968][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9084.543271][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9084.543596][ C0] ? get_stack_info+0x36/0xc0 [ 9084.543852][ C0] ? lock_acquire+0x1c1/0x220 [ 9084.544108][ C0] ? lock_release+0x1d5/0x250 [ 9084.544362][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9084.544627][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9084.544918][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9084.545224][ C0] ? lock_acquire+0x1c1/0x220 [ 9084.545475][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9084.545730][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9084.546006][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9084.546257][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9084.546520][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9084.546799][ C0] ? __inet_lookup_established+0x341/0x610 [ 9084.547116][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9084.547403][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9084.547694][ C0] ip_local_deliver+0x19d/0x480 [ 9084.547959][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9084.548249][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9084.548518][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9084.548795][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9084.549057][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9084.549397][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9084.549674][ C0] ip_rcv+0x564/0x740 [ 9084.549886][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9084.550129][ C0] ? set_track_prepare+0x8a/0xd0 [ 9084.550394][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9084.550684][ C0] ? rest_init+0x153/0x260 [ 9084.550921][ C0] ? skb_clone+0x10b/0x330 [ 9084.551168][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9084.551502][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9084.551820][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9084.552123][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9084.552443][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9084.552702][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9084.552943][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9084.553257][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9084.553557][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9084.553901][ C0] ? lock_acquire+0x1c1/0x220 [ 9084.554154][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9084.554467][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9084.554767][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9084.555107][ C0] ? __copy_skb_header+0xaf/0x490 [ 9084.555377][ C0] ? __skb_clone+0x57a/0x760 [ 9084.555626][ C0] netif_receive_skb+0x55/0x280 [ 9084.555883][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9084.556210][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9084.556559][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9084.556876][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9084.557165][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9084.557466][ C0] ? hlock_class+0x4e/0x130 [ 9084.557711][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9084.558042][ C0] ? place_entity+0x21/0x2f0 [ 9084.558289][ C0] ? resched_curr+0x219/0x280 [ 9084.558544][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9084.558818][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9084.559104][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9084.559383][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9084.559645][ C0] ? activate_task+0xf5/0x260 [ 9084.559899][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9084.560176][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9084.560455][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9084.560712][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9084.561002][ C0] ? get_stack_info+0x36/0xc0 [ 9084.561259][ C0] ? stack_access_ok+0xda/0x1f0 [ 9084.561523][ C0] ? get_reg+0x119/0x190 [ 9084.561751][ C0] __tcf_classify+0x32c/0x7d0 [ 9084.562001][ C0] tcf_classify+0x283/0x930 [ 9084.562242][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9084.562581][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9084.562848][ C0] ? arch_stack_walk+0x8c/0x100 [ 9084.563109][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9084.563402][ C0] tc_run+0x2e4/0x5d0 [ 9084.563620][ C0] ? __pfx_tc_run+0x10/0x10 [ 9084.563868][ C0] ? lock_acquire+0x1c1/0x220 [ 9084.564124][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9084.564402][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9084.564670][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9084.564960][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9084.565243][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9084.565567][ C0] ? neigh_hh_output+0x348/0x590 [ 9084.565831][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9084.566113][ C0] ip_finish_output2+0x786/0x18e0 [ 9084.566386][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9084.566682][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9084.567037][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9084.567325][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9084.567596][ C0] ? __ip_finish_output+0x10f/0x770 [ 9084.567875][ C0] ip_output+0x16b/0x4f0 [ 9084.568103][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9084.568389][ C0] ? __pfx_ip_output+0x10/0x10 [ 9084.568644][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9084.568949][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9084.569215][ C0] ? ip_local_out+0x114/0x3b0 [ 9084.569469][ C0] __ip_queue_xmit+0x672/0x1910 [ 9084.569733][ C0] ? __skb_clone+0x57a/0x760 [ 9084.569982][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9084.570263][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9084.570560][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9084.570882][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9084.571144][ C0] ? tcp_current_mss+0x40a/0x510 [ 9084.571406][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9084.571690][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9084.571965][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9084.572220][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9084.572496][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9084.572812][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9084.573094][ C0] ? ktime_get+0xb6/0x190 [ 9084.573328][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9084.573606][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9084.573886][ C0] tcp_write_timer+0x82/0x1d0 [ 9084.574141][ C0] call_timer_fn+0x176/0x430 [ 9084.574391][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9084.574665][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9084.574943][ C0] __run_timers.part.0+0x52d/0x890 [ 9084.575218][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9084.575505][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9084.575805][ C0] ? lock_acquire+0x1c1/0x220 [ 9084.576057][ C0] ? clockevents_program_event+0xf6/0x300 [ 9084.576365][ C0] ? lock_release+0x1d5/0x250 [ 9084.576623][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9084.576903][ C0] ? ktime_get+0xb6/0x190 [ 9084.577138][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9084.577437][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9084.577747][ C0] run_timer_softirq+0x72/0x100 [ 9084.578010][ C0] __do_softirq+0x1bc/0x7ff [ 9084.578259][ C0] irq_exit_rcu+0x98/0xc0 [ 9084.578493][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9084.578798][ C0] [ 9084.578954][ C0] [ 9084.579112][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9084.579432][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9084.579706][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9084.580735][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9084.581066][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9084.581490][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9084.581913][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9084.582341][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9084.582774][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9084.583197][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9084.583501][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9084.583777][ C0] default_idle_call+0x69/0xa0 [ 9084.584034][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9084.584297][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9084.584594][ C0] ? lock_release+0x1d5/0x250 [ 9084.584846][ C0] do_idle+0xfb/0x160 [ 9084.585063][ C0] cpu_startup_entry+0x55/0x60 [ 9084.585318][ C0] rest_init+0x153/0x260 [ 9084.585546][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9084.585835][ C0] arch_call_rest_init+0x13/0x40 [ 9084.586102][ C0] start_kernel+0x314/0x3d0 [ 9084.586351][ C0] x86_64_start_reservations+0x18/0x30 [ 9084.586647][ C0] x86_64_start_kernel+0xba/0x110 [ 9084.586915][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9084.587242][ C0] [ 9084.587407][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7354s! [ksoftirqd/1:22] [ 9084.587882][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9084.589076][ C1] irq event stamp: 3886976 [ 9084.589312][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9084.589817][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9084.590321][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9084.590827][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9084.591319][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9084.591818][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9084.592477][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9084.592817][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9084.593839][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9084.594162][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9084.594582][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9084.595002][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9084.595422][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9084.595842][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9084.596262][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9084.596732][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9084.597084][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9084.597504][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9084.597929][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9084.598355][ C1] Call Trace: [ 9084.598535][ C1] [ 9084.598693][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9084.598969][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9084.599231][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9084.599527][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9084.599817][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9084.600123][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9084.600405][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9084.600730][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9084.601003][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9084.601335][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9084.601648][ C1] [ 9084.601804][ C1] [ 9084.601960][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9084.602289][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9084.602605][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9084.602919][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9084.603229][ C1] ? run_ksoftirqd+0xb/0x60 [ 9084.603475][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9084.603805][ C1] ? __orc_find+0x9c/0xf0 [ 9084.604036][ C1] ? lock_acquire+0x1c1/0x220 [ 9084.604289][ C1] ? irqentry_enter+0x2b/0x60 [ 9084.604540][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9084.604801][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9084.605086][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9084.605383][ C1] ? lock_acquire+0x1c1/0x220 [ 9084.605637][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9084.605895][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9084.606175][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9084.606421][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9084.606681][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9084.606952][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9084.607245][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9084.607537][ C1] ip_local_deliver+0x19d/0x480 [ 9084.607800][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9084.608088][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9084.608355][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9084.608631][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9084.608894][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9084.609234][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9084.609509][ C1] ip_rcv+0x564/0x740 [ 9084.609722][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9084.609964][ C1] ? set_track_prepare+0x8a/0xd0 [ 9084.610229][ C1] ? irqentry_enter+0x2b/0x60 [ 9084.610484][ C1] ? irqentry_enter+0x2b/0x60 [ 9084.610740][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9084.610990][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9084.611318][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9084.611661][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9084.611973][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9084.612318][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9084.612628][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9084.612961][ C1] netif_receive_skb+0x55/0x280 [ 9084.613221][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9084.613550][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9084.613898][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9084.614217][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9084.614507][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9084.614816][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9084.615145][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9084.615426][ C1] ? arch_stack_walk+0x68/0x100 [ 9084.615694][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9084.615974][ C1] ? irqentry_enter+0x2b/0x60 [ 9084.616230][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9084.616552][ C1] ? irqentry_enter+0x2b/0x60 [ 9084.616801][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9084.617126][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9084.617411][ C1] ? arch_stack_walk+0x68/0x100 [ 9084.617670][ C1] __tcf_classify+0x32c/0x7d0 [ 9084.617923][ C1] tcf_classify+0x283/0x930 [ 9084.618167][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9084.618435][ C1] tc_run+0x2e4/0x5d0 [ 9084.618648][ C1] ? __pfx_tc_run+0x10/0x10 [ 9084.618890][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9084.619158][ C1] ? irqentry_enter+0x2b/0x60 [ 9084.619413][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9084.619703][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9084.620028][ C1] ip_finish_output2+0x786/0x18e0 [ 9084.620299][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9084.620590][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9084.620858][ C1] ? __ip_finish_output+0x10f/0x770 [ 9084.621135][ C1] ip_output+0x16b/0x4f0 [ 9084.621360][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9084.621682][ C1] ? __pfx_ip_output+0x10/0x10 [ 9084.621941][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9084.622300][ C1] ? __pfx_ip_output+0x10/0x10 [ 9084.622569][ C1] __ip_queue_xmit+0x672/0x1910 [ 9084.622834][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9084.623121][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9084.623419][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9084.623707][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9084.624005][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9084.624294][ C1] tcp_delack_timer+0x84/0x240 [ 9084.624551][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9084.624833][ C1] call_timer_fn+0x176/0x430 [ 9084.625081][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9084.625359][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9084.625637][ C1] __run_timers.part.0+0x52d/0x890 [ 9084.625908][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9084.626198][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9084.626502][ C1] ? __pfx___schedule+0x10/0x10 [ 9084.626762][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9084.627083][ C1] run_timer_softirq+0x72/0x100 [ 9084.627348][ C1] __do_softirq+0x1bc/0x7ff [ 9084.627594][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9084.627871][ C1] run_ksoftirqd+0x2e/0x60 [ 9084.628110][ C1] smpboot_thread_fn+0x30e/0x840 [ 9084.628378][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9084.628666][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9084.628957][ C1] kthread+0x292/0x360 [ 9084.629178][ C1] ? __pfx_kthread+0x10/0x10 [ 9084.629427][ C1] ret_from_fork+0x34/0x70 [ 9084.629664][ C1] ? __pfx_kthread+0x10/0x10 [ 9084.629912][ C1] ret_from_fork_asm+0x1b/0x30 [ 9084.630171][ C1] [ 9106.946025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9106.946418][ C1] rcu: 1-....: (7845167 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1877693 [ 9106.947014][ C1] rcu: (t=7912637 jiffies g=1007429 q=31 ncpus=4) [ 9106.947358][ C1] Sending NMI from CPU 1 to CPUs 0: [ 9106.947654][ C0] NMI backtrace for cpu 0 [ 9106.947669][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9106.947673][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9106.947677][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9106.947688][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9106.947691][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9106.947695][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9106.947697][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9106.947699][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9106.947700][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9106.947702][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9106.947704][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9106.947706][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9106.947710][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9106.947712][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9106.947713][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9106.947714][ C0] Call Trace: [ 9106.947717][ C0] [ 9106.947722][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 9106.947728][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9106.947735][ C0] ? nmi_handle+0x156/0x420 [ 9106.947739][ C0] ? default_do_nmi+0x41/0x100 [ 9106.947743][ C0] ? exc_nmi+0xf3/0x120 [ 9106.947746][ C0] ? end_repeat_nmi+0xf/0x60 [ 9106.947750][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9106.947755][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9106.947758][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9106.947762][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9106.947765][ C0] [ 9106.947766][ C0] [ 9106.947768][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9106.947771][ C0] ? get_stack_info+0x36/0xc0 [ 9106.947775][ C0] ? lock_acquire+0x1c1/0x220 [ 9106.947779][ C0] ? lock_release+0x1d5/0x250 [ 9106.947783][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9106.947786][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9106.947789][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9106.947793][ C0] ? lock_acquire+0x1c1/0x220 [ 9106.947795][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9106.947800][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9106.947803][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9106.947810][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9106.947813][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9106.947817][ C0] ? __inet_lookup_established+0x341/0x610 [ 9106.947823][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9106.947830][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9106.947834][ C0] ip_local_deliver+0x19d/0x480 [ 9106.947837][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9106.947839][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9106.947845][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9106.947849][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9106.947852][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9106.947855][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9106.947865][ C0] ip_rcv+0x564/0x740 [ 9106.947869][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9106.947872][ C0] ? set_track_prepare+0x8a/0xd0 [ 9106.947876][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9106.947878][ C0] ? rest_init+0x153/0x260 [ 9106.947880][ C0] ? skb_clone+0x10b/0x330 [ 9106.947885][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9106.947891][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9106.947897][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9106.947901][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9106.947910][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9106.947913][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9106.947916][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9106.947920][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9106.947923][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9106.947927][ C0] ? lock_acquire+0x1c1/0x220 [ 9106.947929][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9106.947933][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9106.947936][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9106.947939][ C0] ? __copy_skb_header+0xaf/0x490 [ 9106.947942][ C0] ? __skb_clone+0x57a/0x760 [ 9106.947945][ C0] netif_receive_skb+0x55/0x280 [ 9106.947947][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9106.947955][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9106.947961][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9106.947968][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9106.947973][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9106.947982][ C0] ? hlock_class+0x4e/0x130 [ 9106.947988][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9106.947998][ C0] ? place_entity+0x21/0x2f0 [ 9106.948001][ C0] ? resched_curr+0x219/0x280 [ 9106.948004][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9106.948008][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9106.948011][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9106.948016][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9106.948018][ C0] ? activate_task+0xf5/0x260 [ 9106.948022][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9106.948027][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9106.948030][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9106.948034][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9106.948037][ C0] ? get_stack_info+0x36/0xc0 [ 9106.948040][ C0] ? stack_access_ok+0xda/0x1f0 [ 9106.948043][ C0] ? get_reg+0x119/0x190 [ 9106.948047][ C0] __tcf_classify+0x32c/0x7d0 [ 9106.948051][ C0] tcf_classify+0x283/0x930 [ 9106.948055][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9106.948059][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9106.948062][ C0] ? arch_stack_walk+0x8c/0x100 [ 9106.948067][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9106.948070][ C0] tc_run+0x2e4/0x5d0 [ 9106.948075][ C0] ? __pfx_tc_run+0x10/0x10 [ 9106.948078][ C0] ? lock_acquire+0x1c1/0x220 [ 9106.948080][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9106.948085][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9106.948091][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9106.948094][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9106.948097][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9106.948102][ C0] ? neigh_hh_output+0x348/0x590 [ 9106.948106][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9106.948110][ C0] ip_finish_output2+0x786/0x18e0 [ 9106.948114][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9106.948119][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9106.948127][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9106.948130][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9106.948135][ C0] ? __ip_finish_output+0x10f/0x770 [ 9106.948138][ C0] ip_output+0x16b/0x4f0 [ 9106.948142][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9106.948147][ C0] ? __pfx_ip_output+0x10/0x10 [ 9106.948150][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9106.948154][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9106.948157][ C0] ? ip_local_out+0x114/0x3b0 [ 9106.948161][ C0] __ip_queue_xmit+0x672/0x1910 [ 9106.948166][ C0] ? __skb_clone+0x57a/0x760 [ 9106.948169][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9106.948176][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9106.948180][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9106.948184][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9106.948189][ C0] ? tcp_current_mss+0x40a/0x510 [ 9106.948192][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9106.948195][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9106.948197][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9106.948199][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9106.948202][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9106.948206][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9106.948210][ C0] ? ktime_get+0xb6/0x190 [ 9106.948214][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9106.948218][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9106.948222][ C0] tcp_write_timer+0x82/0x1d0 [ 9106.948226][ C0] call_timer_fn+0x176/0x430 [ 9106.948230][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9106.948235][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9106.948239][ C0] __run_timers.part.0+0x52d/0x890 [ 9106.948242][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9106.948247][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9106.948250][ C0] ? lock_acquire+0x1c1/0x220 [ 9106.948253][ C0] ? clockevents_program_event+0xf6/0x300 [ 9106.948257][ C0] ? lock_release+0x1d5/0x250 [ 9106.948260][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9106.948263][ C0] ? ktime_get+0xb6/0x190 [ 9106.948266][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9106.948269][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9106.948274][ C0] run_timer_softirq+0x72/0x100 [ 9106.948277][ C0] __do_softirq+0x1bc/0x7ff [ 9106.948282][ C0] irq_exit_rcu+0x98/0xc0 [ 9106.948285][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9106.948289][ C0] [ 9106.948290][ C0] [ 9106.948291][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9106.948296][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9106.948300][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9106.948302][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9106.948304][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9106.948305][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9106.948308][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9106.948309][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9106.948311][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9106.948314][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9106.948318][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9106.948322][ C0] default_idle_call+0x69/0xa0 [ 9106.948324][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9106.948327][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9106.948332][ C0] ? lock_release+0x1d5/0x250 [ 9106.948336][ C0] do_idle+0xfb/0x160 [ 9106.948339][ C0] cpu_startup_entry+0x55/0x60 [ 9106.948341][ C0] rest_init+0x153/0x260 [ 9106.948344][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9106.948349][ C0] arch_call_rest_init+0x13/0x40 [ 9106.948354][ C0] start_kernel+0x314/0x3d0 [ 9106.948358][ C0] x86_64_start_reservations+0x18/0x30 [ 9106.948362][ C0] x86_64_start_kernel+0xba/0x110 [ 9106.948366][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9106.948373][ C0] [ 9106.948652][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9107.002467][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9107.003111][ C1] RIP: 0010:queued_spin_lock_slowpath+0xc2/0xb90 [ 9107.003455][ C1] Code: 41 83 e4 07 49 01 c5 41 83 c4 03 be 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c 08 84 c0 0f 85 42 09 00 00 <8b> 5d 00 85 db 75 62 be 04 00 00 00 48 89 ef e8 da bb 0c fe 89 d8 [ 9107.004476][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000246 [ 9107.004801][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9107.005225][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9107.005648][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9107.006067][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9107.006493][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9107.006916][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9107.007386][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9107.007733][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9107.008164][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9107.008581][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9107.008998][ C1] Call Trace: [ 9107.009175][ C1] [ 9107.009331][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9107.009627][ C1] ? print_cpu_stall+0x263/0x6a0 [ 9107.009892][ C1] ? check_cpu_stall+0x284/0x500 [ 9107.010158][ C1] ? rcu_pending+0x92/0x360 [ 9107.010398][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9107.010677][ C1] ? update_process_times+0xb9/0x110 [ 9107.010960][ C1] ? tick_sched_handle+0x67/0x130 [ 9107.011228][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9107.011524][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9107.011778][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9107.012100][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9107.012398][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9107.012696][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9107.012973][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9107.013290][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9107.013565][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9107.013885][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9107.014198][ C1] [ 9107.014361][ C1] [ 9107.014520][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9107.014852][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9107.015155][ C1] ? queued_spin_lock_slowpath+0xc2/0xb90 [ 9107.015456][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9107.015757][ C1] ? run_ksoftirqd+0xb/0x60 [ 9107.016000][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9107.016326][ C1] ? __orc_find+0x9c/0xf0 [ 9107.016558][ C1] ? lock_acquire+0x1c1/0x220 [ 9107.016813][ C1] ? irqentry_enter+0x2b/0x60 [ 9107.017068][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9107.017334][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9107.017623][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9107.017922][ C1] ? lock_acquire+0x1c1/0x220 [ 9107.018170][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9107.018419][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9107.018697][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9107.018946][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9107.019209][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9107.019481][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9107.019769][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9107.020060][ C1] ip_local_deliver+0x19d/0x480 [ 9107.020316][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9107.020599][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9107.020862][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9107.021151][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9107.021415][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9107.021747][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9107.022027][ C1] ip_rcv+0x564/0x740 [ 9107.022248][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9107.022505][ C1] ? set_track_prepare+0x8a/0xd0 [ 9107.022769][ C1] ? irqentry_enter+0x2b/0x60 [ 9107.023021][ C1] ? irqentry_enter+0x2b/0x60 [ 9107.023275][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9107.023519][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9107.023834][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9107.024181][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9107.024492][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9107.024830][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9107.025128][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9107.025463][ C1] netif_receive_skb+0x55/0x280 [ 9107.025734][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9107.026063][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9107.026413][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9107.026721][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9107.027013][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9107.027317][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9107.027645][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9107.027925][ C1] ? arch_stack_walk+0x68/0x100 [ 9107.028181][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9107.028454][ C1] ? irqentry_enter+0x2b/0x60 [ 9107.028700][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9107.029024][ C1] ? irqentry_enter+0x2b/0x60 [ 9107.029278][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9107.029599][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9107.029875][ C1] ? arch_stack_walk+0x68/0x100 [ 9107.030137][ C1] __tcf_classify+0x32c/0x7d0 [ 9107.030392][ C1] tcf_classify+0x283/0x930 [ 9107.030636][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9107.030912][ C1] tc_run+0x2e4/0x5d0 [ 9107.031130][ C1] ? __pfx_tc_run+0x10/0x10 [ 9107.031376][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9107.031643][ C1] ? irqentry_enter+0x2b/0x60 [ 9107.031889][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9107.032171][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9107.032502][ C1] ip_finish_output2+0x786/0x18e0 [ 9107.032771][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9107.033062][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9107.033327][ C1] ? __ip_finish_output+0x10f/0x770 [ 9107.033601][ C1] ip_output+0x16b/0x4f0 [ 9107.033827][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9107.034149][ C1] ? __pfx_ip_output+0x10/0x10 [ 9107.034405][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9107.034759][ C1] ? __pfx_ip_output+0x10/0x10 [ 9107.035016][ C1] __ip_queue_xmit+0x672/0x1910 [ 9107.035276][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9107.035555][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9107.035849][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9107.036134][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9107.036434][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9107.036719][ C1] tcp_delack_timer+0x84/0x240 [ 9107.036973][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9107.037261][ C1] call_timer_fn+0x176/0x430 [ 9107.037511][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9107.037784][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9107.038065][ C1] __run_timers.part.0+0x52d/0x890 [ 9107.038340][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9107.038626][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9107.038924][ C1] ? __pfx___schedule+0x10/0x10 [ 9107.039187][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9107.039509][ C1] run_timer_softirq+0x72/0x100 [ 9107.039765][ C1] __do_softirq+0x1bc/0x7ff [ 9107.040005][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9107.040279][ C1] run_ksoftirqd+0x2e/0x60 [ 9107.040518][ C1] smpboot_thread_fn+0x30e/0x840 [ 9107.040783][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9107.041076][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9107.041365][ C1] kthread+0x292/0x360 [ 9107.041582][ C1] ? __pfx_kthread+0x10/0x10 [ 9107.041825][ C1] ret_from_fork+0x34/0x70 [ 9107.042066][ C1] ? __pfx_kthread+0x10/0x10 [ 9107.042323][ C1] ret_from_fork_asm+0x1b/0x30 [ 9107.042585][ C1] [ 9132.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7399s! [swapper/0:0] [ 9132.527925][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9132.529122][ C0] irq event stamp: 27567077 [ 9132.529366][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9132.529900][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9132.530375][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9132.530876][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9132.531368][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9132.531844][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9132.532500][ C0] RIP: 0010:__kasan_check_read+0x8/0x20 [ 9132.532793][ C0] Code: 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 48 8b 0c 24 <89> f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f [ 9132.533811][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000202 [ 9132.534131][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9132.534548][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9132.534964][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9132.535383][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9132.535798][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9132.536216][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9132.536685][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9132.537035][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9132.537458][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9132.537884][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9132.538311][ C0] Call Trace: [ 9132.538494][ C0] [ 9132.538652][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9132.538926][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9132.539186][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9132.539478][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9132.539767][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9132.540072][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9132.540353][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9132.540677][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9132.540949][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9132.541228][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9132.541560][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9132.541866][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9132.542208][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9132.542513][ C0] ? __kasan_check_read+0x8/0x20 [ 9132.542778][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 9132.543072][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9132.543397][ C0] ? get_stack_info+0x36/0xc0 [ 9132.543655][ C0] ? lock_acquire+0x1c1/0x220 [ 9132.543910][ C0] ? lock_release+0x1d5/0x250 [ 9132.544169][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9132.544431][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9132.544716][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9132.545014][ C0] ? lock_acquire+0x1c1/0x220 [ 9132.545260][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9132.545508][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9132.545778][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9132.546027][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9132.546288][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9132.546558][ C0] ? __inet_lookup_established+0x341/0x610 [ 9132.546871][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9132.547158][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9132.547446][ C0] ip_local_deliver+0x19d/0x480 [ 9132.547705][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9132.547991][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9132.548258][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9132.548536][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9132.548797][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9132.549134][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9132.549406][ C0] ip_rcv+0x564/0x740 [ 9132.549618][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9132.549858][ C0] ? set_track_prepare+0x8a/0xd0 [ 9132.550121][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9132.550411][ C0] ? rest_init+0x153/0x260 [ 9132.550648][ C0] ? skb_clone+0x10b/0x330 [ 9132.550887][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9132.551220][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9132.551540][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9132.551837][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9132.552146][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9132.552413][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9132.552651][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9132.552962][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9132.553259][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9132.553600][ C0] ? lock_acquire+0x1c1/0x220 [ 9132.553852][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9132.554165][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9132.554462][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9132.554794][ C0] ? __copy_skb_header+0xaf/0x490 [ 9132.555065][ C0] ? __skb_clone+0x57a/0x760 [ 9132.555314][ C0] netif_receive_skb+0x55/0x280 [ 9132.555571][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9132.555895][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9132.556241][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9132.556554][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9132.556838][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9132.557135][ C0] ? hlock_class+0x4e/0x130 [ 9132.557378][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9132.557702][ C0] ? place_entity+0x21/0x2f0 [ 9132.557946][ C0] ? resched_curr+0x219/0x280 [ 9132.558200][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9132.558468][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9132.558751][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9132.559025][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9132.559280][ C0] ? activate_task+0xf5/0x260 [ 9132.559526][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9132.559798][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9132.560071][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9132.560329][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9132.560618][ C0] ? get_stack_info+0x36/0xc0 [ 9132.560870][ C0] ? stack_access_ok+0xda/0x1f0 [ 9132.561133][ C0] ? get_reg+0x119/0x190 [ 9132.561363][ C0] __tcf_classify+0x32c/0x7d0 [ 9132.561614][ C0] tcf_classify+0x283/0x930 [ 9132.561856][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9132.562184][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9132.562450][ C0] ? arch_stack_walk+0x8c/0x100 [ 9132.562710][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9132.562997][ C0] tc_run+0x2e4/0x5d0 [ 9132.563215][ C0] ? __pfx_tc_run+0x10/0x10 [ 9132.563458][ C0] ? lock_acquire+0x1c1/0x220 [ 9132.563708][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9132.563983][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9132.564248][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9132.564533][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9132.564812][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9132.565135][ C0] ? neigh_hh_output+0x348/0x590 [ 9132.565399][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9132.565679][ C0] ip_finish_output2+0x786/0x18e0 [ 9132.565948][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9132.566242][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9132.566592][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9132.566880][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9132.567147][ C0] ? __ip_finish_output+0x10f/0x770 [ 9132.567421][ C0] ip_output+0x16b/0x4f0 [ 9132.567647][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9132.567930][ C0] ? __pfx_ip_output+0x10/0x10 [ 9132.568187][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9132.568488][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9132.568748][ C0] ? ip_local_out+0x114/0x3b0 [ 9132.569001][ C0] __ip_queue_xmit+0x672/0x1910 [ 9132.569267][ C0] ? __skb_clone+0x57a/0x760 [ 9132.569516][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9132.569794][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9132.570088][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9132.570404][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9132.570661][ C0] ? tcp_current_mss+0x40a/0x510 [ 9132.570923][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9132.571211][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9132.571495][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9132.571749][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9132.572019][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9132.572344][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9132.572622][ C0] ? ktime_get+0xb6/0x190 [ 9132.572857][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9132.573132][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9132.573411][ C0] tcp_write_timer+0x82/0x1d0 [ 9132.573664][ C0] call_timer_fn+0x176/0x430 [ 9132.573913][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9132.574185][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9132.574461][ C0] __run_timers.part.0+0x52d/0x890 [ 9132.574730][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9132.575014][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9132.575310][ C0] ? lock_acquire+0x1c1/0x220 [ 9132.575562][ C0] ? clockevents_program_event+0xf6/0x300 [ 9132.575871][ C0] ? lock_release+0x1d5/0x250 [ 9132.576123][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9132.576401][ C0] ? ktime_get+0xb6/0x190 [ 9132.576632][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9132.576932][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9132.577239][ C0] run_timer_softirq+0x72/0x100 [ 9132.577499][ C0] __do_softirq+0x1bc/0x7ff [ 9132.577743][ C0] irq_exit_rcu+0x98/0xc0 [ 9132.577976][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9132.578275][ C0] [ 9132.578430][ C0] [ 9132.578585][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9132.578901][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9132.579171][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9132.580188][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9132.580512][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9132.580934][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9132.581358][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9132.581779][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9132.582206][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9132.582621][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9132.582922][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9132.583194][ C0] default_idle_call+0x69/0xa0 [ 9132.583451][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9132.583713][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9132.584003][ C0] ? lock_release+0x1d5/0x250 [ 9132.584251][ C0] do_idle+0xfb/0x160 [ 9132.584461][ C0] cpu_startup_entry+0x55/0x60 [ 9132.584713][ C0] rest_init+0x153/0x260 [ 9132.584942][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9132.585227][ C0] arch_call_rest_init+0x13/0x40 [ 9132.585489][ C0] start_kernel+0x314/0x3d0 [ 9132.585733][ C0] x86_64_start_reservations+0x18/0x30 [ 9132.586024][ C0] x86_64_start_kernel+0xba/0x110 [ 9132.586290][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9132.586613][ C0] [ 9132.586778][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7399s! [ksoftirqd/1:22] [ 9132.587255][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9132.588459][ C1] irq event stamp: 3886976 [ 9132.588699][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9132.589201][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9132.589698][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9132.590200][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9132.590695][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9132.591189][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9132.591826][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa8/0xb90 [ 9132.592172][ C1] Code: 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 be 04 00 00 00 <48> 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c 08 84 c0 0f 85 [ 9132.593198][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9132.593516][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9132.593934][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9132.594352][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9132.594769][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9132.595185][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9132.595601][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9132.596077][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9132.596428][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9132.596849][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9132.597275][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9132.597699][ C1] Call Trace: [ 9132.597880][ C1] [ 9132.598039][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9132.598315][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9132.598574][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9132.598866][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9132.599156][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9132.599461][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9132.599741][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9132.600067][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9132.600340][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9132.600668][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9132.600981][ C1] [ 9132.601141][ C1] [ 9132.601297][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9132.601623][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9132.601931][ C1] ? queued_spin_lock_slowpath+0xa8/0xb90 [ 9132.602250][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9132.602550][ C1] ? run_ksoftirqd+0xb/0x60 [ 9132.602792][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9132.603115][ C1] ? __orc_find+0x9c/0xf0 [ 9132.603349][ C1] ? lock_acquire+0x1c1/0x220 [ 9132.603604][ C1] ? irqentry_enter+0x2b/0x60 [ 9132.603857][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9132.604120][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9132.604407][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9132.604708][ C1] ? lock_acquire+0x1c1/0x220 [ 9132.604957][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9132.605211][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9132.605483][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9132.605731][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9132.605998][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9132.606274][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9132.606569][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9132.606867][ C1] ip_local_deliver+0x19d/0x480 [ 9132.607128][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9132.607412][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9132.607677][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9132.607959][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9132.608228][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9132.608565][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9132.608844][ C1] ip_rcv+0x564/0x740 [ 9132.609062][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9132.609308][ C1] ? set_track_prepare+0x8a/0xd0 [ 9132.609577][ C1] ? irqentry_enter+0x2b/0x60 [ 9132.609828][ C1] ? irqentry_enter+0x2b/0x60 [ 9132.610081][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9132.610321][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9132.610635][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9132.610975][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9132.611287][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9132.611633][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9132.611935][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9132.612279][ C1] netif_receive_skb+0x55/0x280 [ 9132.612540][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9132.612872][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9132.613223][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9132.613536][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9132.613831][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9132.614138][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9132.614483][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9132.614767][ C1] ? arch_stack_walk+0x68/0x100 [ 9132.615029][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9132.615310][ C1] ? irqentry_enter+0x2b/0x60 [ 9132.615563][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9132.615882][ C1] ? irqentry_enter+0x2b/0x60 [ 9132.616136][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9132.616462][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9132.616744][ C1] ? arch_stack_walk+0x68/0x100 [ 9132.617013][ C1] __tcf_classify+0x32c/0x7d0 [ 9132.617269][ C1] tcf_classify+0x283/0x930 [ 9132.617516][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9132.617787][ C1] tc_run+0x2e4/0x5d0 [ 9132.618007][ C1] ? __pfx_tc_run+0x10/0x10 [ 9132.618254][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9132.618529][ C1] ? irqentry_enter+0x2b/0x60 [ 9132.618784][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9132.619071][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9132.619391][ C1] ip_finish_output2+0x786/0x18e0 [ 9132.619676][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9132.619968][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9132.620231][ C1] ? __ip_finish_output+0x10f/0x770 [ 9132.620515][ C1] ip_output+0x16b/0x4f0 [ 9132.620743][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9132.621060][ C1] ? __pfx_ip_output+0x10/0x10 [ 9132.621318][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9132.621668][ C1] ? __pfx_ip_output+0x10/0x10 [ 9132.621924][ C1] __ip_queue_xmit+0x672/0x1910 [ 9132.622200][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9132.622480][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9132.622776][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9132.623065][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9132.623358][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9132.623641][ C1] tcp_delack_timer+0x84/0x240 [ 9132.623895][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9132.624189][ C1] call_timer_fn+0x176/0x430 [ 9132.624440][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9132.624718][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9132.624995][ C1] __run_timers.part.0+0x52d/0x890 [ 9132.625268][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9132.625560][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9132.625863][ C1] ? __pfx___schedule+0x10/0x10 [ 9132.626123][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9132.626444][ C1] run_timer_softirq+0x72/0x100 [ 9132.626706][ C1] __do_softirq+0x1bc/0x7ff [ 9132.626952][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9132.627229][ C1] run_ksoftirqd+0x2e/0x60 [ 9132.627465][ C1] smpboot_thread_fn+0x30e/0x840 [ 9132.627731][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9132.628019][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9132.628314][ C1] kthread+0x292/0x360 [ 9132.628532][ C1] ? __pfx_kthread+0x10/0x10 [ 9132.628781][ C1] ret_from_fork+0x34/0x70 [ 9132.629021][ C1] ? __pfx_kthread+0x10/0x10 [ 9132.629269][ C1] ret_from_fork_asm+0x1b/0x30 [ 9132.629527][ C1] [ 9160.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7425s! [swapper/0:0] [ 9160.527937][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9160.529146][ C0] irq event stamp: 27567077 [ 9160.529390][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9160.529925][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9160.530401][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9160.530905][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9160.531401][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9160.531877][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9160.532527][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9160.532867][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9160.533885][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9160.534206][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9160.534624][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9160.535042][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9160.535461][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9160.535876][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9160.536293][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9160.536761][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9160.537113][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9160.537531][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9160.537954][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9160.538383][ C0] Call Trace: [ 9160.538565][ C0] [ 9160.538722][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9160.538997][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9160.539257][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9160.539548][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9160.539840][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9160.540144][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9160.540424][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9160.540748][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9160.541019][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9160.541298][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9160.541620][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9160.541928][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9160.542271][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9160.542576][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9160.542892][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9160.543196][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9160.543521][ C0] ? get_stack_info+0x36/0xc0 [ 9160.543776][ C0] ? lock_acquire+0x1c1/0x220 [ 9160.544030][ C0] ? lock_release+0x1d5/0x250 [ 9160.544283][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9160.544545][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9160.544832][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9160.545134][ C0] ? lock_acquire+0x1c1/0x220 [ 9160.545382][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9160.545634][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9160.545904][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9160.546152][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9160.546412][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9160.546684][ C0] ? __inet_lookup_established+0x341/0x610 [ 9160.546998][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9160.547285][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9160.547573][ C0] ip_local_deliver+0x19d/0x480 [ 9160.547834][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9160.548123][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9160.548391][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9160.548668][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9160.548930][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9160.549271][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9160.549545][ C0] ip_rcv+0x564/0x740 [ 9160.549759][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9160.550000][ C0] ? set_track_prepare+0x8a/0xd0 [ 9160.550263][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9160.550553][ C0] ? rest_init+0x153/0x260 [ 9160.550789][ C0] ? skb_clone+0x10b/0x330 [ 9160.551029][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9160.551359][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9160.551676][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9160.551972][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9160.552287][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9160.552545][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9160.552787][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9160.553100][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9160.553395][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9160.553738][ C0] ? lock_acquire+0x1c1/0x220 [ 9160.553992][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9160.554303][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9160.554598][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9160.554931][ C0] ? __copy_skb_header+0xaf/0x490 [ 9160.555203][ C0] ? __skb_clone+0x57a/0x760 [ 9160.555449][ C0] netif_receive_skb+0x55/0x280 [ 9160.555706][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9160.556033][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9160.556378][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9160.556695][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9160.556983][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9160.557283][ C0] ? hlock_class+0x4e/0x130 [ 9160.557527][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9160.557854][ C0] ? place_entity+0x21/0x2f0 [ 9160.558098][ C0] ? resched_curr+0x219/0x280 [ 9160.558351][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9160.558622][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9160.558907][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9160.559183][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9160.559443][ C0] ? activate_task+0xf5/0x260 [ 9160.559693][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9160.559965][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9160.560241][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9160.560499][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9160.560790][ C0] ? get_stack_info+0x36/0xc0 [ 9160.561044][ C0] ? stack_access_ok+0xda/0x1f0 [ 9160.561305][ C0] ? get_reg+0x119/0x190 [ 9160.561537][ C0] __tcf_classify+0x32c/0x7d0 [ 9160.561787][ C0] tcf_classify+0x283/0x930 [ 9160.562037][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9160.562368][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9160.562637][ C0] ? arch_stack_walk+0x8c/0x100 [ 9160.562895][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9160.563184][ C0] tc_run+0x2e4/0x5d0 [ 9160.563405][ C0] ? __pfx_tc_run+0x10/0x10 [ 9160.563650][ C0] ? lock_acquire+0x1c1/0x220 [ 9160.563903][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9160.564182][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9160.564447][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9160.564736][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9160.565018][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9160.565342][ C0] ? neigh_hh_output+0x348/0x590 [ 9160.565609][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9160.565889][ C0] ip_finish_output2+0x786/0x18e0 [ 9160.566160][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9160.566456][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9160.566808][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9160.567095][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9160.567363][ C0] ? __ip_finish_output+0x10f/0x770 [ 9160.567637][ C0] ip_output+0x16b/0x4f0 [ 9160.567863][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9160.568149][ C0] ? __pfx_ip_output+0x10/0x10 [ 9160.568403][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9160.568704][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9160.568967][ C0] ? ip_local_out+0x114/0x3b0 [ 9160.569223][ C0] __ip_queue_xmit+0x672/0x1910 [ 9160.569485][ C0] ? __skb_clone+0x57a/0x760 [ 9160.569733][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9160.570013][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9160.570309][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9160.570626][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9160.570888][ C0] ? tcp_current_mss+0x40a/0x510 [ 9160.571151][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9160.571434][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9160.571714][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9160.571968][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9160.572244][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9160.572563][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9160.572842][ C0] ? ktime_get+0xb6/0x190 [ 9160.573078][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9160.573353][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9160.573635][ C0] tcp_write_timer+0x82/0x1d0 [ 9160.573891][ C0] call_timer_fn+0x176/0x430 [ 9160.574142][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9160.574414][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9160.574694][ C0] __run_timers.part.0+0x52d/0x890 [ 9160.574968][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9160.575255][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9160.575552][ C0] ? lock_acquire+0x1c1/0x220 [ 9160.575807][ C0] ? clockevents_program_event+0xf6/0x300 [ 9160.576113][ C0] ? lock_release+0x1d5/0x250 [ 9160.576364][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9160.576641][ C0] ? ktime_get+0xb6/0x190 [ 9160.576874][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9160.577176][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9160.577485][ C0] run_timer_softirq+0x72/0x100 [ 9160.577749][ C0] __do_softirq+0x1bc/0x7ff [ 9160.577996][ C0] irq_exit_rcu+0x98/0xc0 [ 9160.578231][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9160.578531][ C0] [ 9160.578687][ C0] [ 9160.578844][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9160.579161][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9160.579434][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9160.580458][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9160.580784][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9160.581213][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9160.581635][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9160.582064][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9160.582482][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9160.582903][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9160.583208][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9160.583480][ C0] default_idle_call+0x69/0xa0 [ 9160.583737][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9160.583998][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9160.584292][ C0] ? lock_release+0x1d5/0x250 [ 9160.584544][ C0] do_idle+0xfb/0x160 [ 9160.584758][ C0] cpu_startup_entry+0x55/0x60 [ 9160.585013][ C0] rest_init+0x153/0x260 [ 9160.585242][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9160.585529][ C0] arch_call_rest_init+0x13/0x40 [ 9160.585795][ C0] start_kernel+0x314/0x3d0 [ 9160.586042][ C0] x86_64_start_reservations+0x18/0x30 [ 9160.586338][ C0] x86_64_start_kernel+0xba/0x110 [ 9160.586606][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9160.586934][ C0] [ 9160.587101][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7425s! [ksoftirqd/1:22] [ 9160.587577][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9160.588780][ C1] irq event stamp: 3886976 [ 9160.589020][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9160.589521][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9160.590015][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9160.590514][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9160.591009][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9160.591506][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9160.592164][ C1] RIP: 0010:kasan_check_range+0x77/0x1c0 [ 9160.592472][ C1] Code: ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 <48> 89 e8 49 8d 59 01 48 89 da 48 29 ea 48 83 fa 10 0f 8e c0 00 00 [ 9160.593494][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000286 [ 9160.593818][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9160.594240][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9160.594660][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: ffffed10014131c3 [ 9160.595086][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9160.595507][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9160.595928][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9160.596397][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9160.596753][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9160.597179][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9160.597602][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9160.598027][ C1] Call Trace: [ 9160.598212][ C1] [ 9160.598372][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9160.598649][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9160.598909][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9160.599200][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9160.599489][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9160.599797][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9160.600082][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9160.600408][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9160.600685][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9160.601013][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9160.601329][ C1] [ 9160.601487][ C1] [ 9160.601646][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9160.601978][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9160.602299][ C1] ? kasan_check_range+0x77/0x1c0 [ 9160.602569][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 9160.602865][ C1] ? run_ksoftirqd+0xb/0x60 [ 9160.603115][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9160.603443][ C1] ? __orc_find+0x9c/0xf0 [ 9160.603680][ C1] ? lock_acquire+0x1c1/0x220 [ 9160.603936][ C1] ? irqentry_enter+0x2b/0x60 [ 9160.604192][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9160.604458][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9160.604749][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9160.605055][ C1] ? lock_acquire+0x1c1/0x220 [ 9160.605307][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9160.605563][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9160.605838][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9160.606091][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9160.606355][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9160.606633][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9160.606929][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9160.607226][ C1] ip_local_deliver+0x19d/0x480 [ 9160.607485][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9160.607768][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9160.608039][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9160.608319][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9160.608589][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9160.608926][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9160.609207][ C1] ip_rcv+0x564/0x740 [ 9160.609429][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9160.609680][ C1] ? set_track_prepare+0x8a/0xd0 [ 9160.609952][ C1] ? irqentry_enter+0x2b/0x60 [ 9160.610206][ C1] ? irqentry_enter+0x2b/0x60 [ 9160.610459][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9160.610703][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9160.611023][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9160.611364][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9160.611675][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9160.612028][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9160.612326][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9160.612661][ C1] netif_receive_skb+0x55/0x280 [ 9160.612924][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9160.613259][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9160.613611][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9160.613923][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9160.614214][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9160.614515][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9160.614840][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9160.615121][ C1] ? arch_stack_walk+0x68/0x100 [ 9160.615384][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9160.615665][ C1] ? irqentry_enter+0x2b/0x60 [ 9160.615919][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9160.616245][ C1] ? irqentry_enter+0x2b/0x60 [ 9160.616496][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9160.616817][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9160.617102][ C1] ? arch_stack_walk+0x68/0x100 [ 9160.617359][ C1] __tcf_classify+0x32c/0x7d0 [ 9160.617609][ C1] tcf_classify+0x283/0x930 [ 9160.617850][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9160.618119][ C1] tc_run+0x2e4/0x5d0 [ 9160.618336][ C1] ? __pfx_tc_run+0x10/0x10 [ 9160.618580][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9160.618848][ C1] ? irqentry_enter+0x2b/0x60 [ 9160.619101][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9160.619390][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9160.619717][ C1] ip_finish_output2+0x786/0x18e0 [ 9160.619988][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9160.620276][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9160.620543][ C1] ? __ip_finish_output+0x10f/0x770 [ 9160.620819][ C1] ip_output+0x16b/0x4f0 [ 9160.621046][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9160.621370][ C1] ? __pfx_ip_output+0x10/0x10 [ 9160.621627][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9160.621982][ C1] ? __pfx_ip_output+0x10/0x10 [ 9160.622248][ C1] __ip_queue_xmit+0x672/0x1910 [ 9160.622520][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9160.622808][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9160.623109][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9160.623401][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9160.623702][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9160.623992][ C1] tcp_delack_timer+0x84/0x240 [ 9160.624252][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9160.624537][ C1] call_timer_fn+0x176/0x430 [ 9160.624792][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9160.625070][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9160.625347][ C1] __run_timers.part.0+0x52d/0x890 [ 9160.625621][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9160.625915][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9160.626220][ C1] ? __pfx___schedule+0x10/0x10 [ 9160.626478][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9160.626803][ C1] run_timer_softirq+0x72/0x100 [ 9160.627067][ C1] __do_softirq+0x1bc/0x7ff [ 9160.627314][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9160.627592][ C1] run_ksoftirqd+0x2e/0x60 [ 9160.627830][ C1] smpboot_thread_fn+0x30e/0x840 [ 9160.628102][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9160.628395][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9160.628689][ C1] kthread+0x292/0x360 [ 9160.628906][ C1] ? __pfx_kthread+0x10/0x10 [ 9160.629156][ C1] ret_from_fork+0x34/0x70 [ 9160.629396][ C1] ? __pfx_kthread+0x10/0x10 [ 9160.629646][ C1] ret_from_fork_asm+0x1b/0x30 [ 9160.629908][ C1] [ 9185.044024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9185.044424][ C0] rcu: 0-....: (7932978 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=1897036 [ 9185.044952][ C0] rcu: (t=7990735 jiffies g=1007429 q=31 ncpus=4) [ 9185.045302][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9185.045781][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9185.046430][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9185.046778][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9185.047808][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9185.048140][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9185.048564][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9185.048992][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9185.049419][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9185.049842][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9185.050266][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9185.050742][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9185.051092][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9185.051521][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9185.051948][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9185.052375][ C0] Call Trace: [ 9185.052562][ C0] [ 9185.052719][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9185.053009][ C0] ? print_cpu_stall+0x263/0x6a0 [ 9185.053280][ C0] ? check_cpu_stall+0x284/0x500 [ 9185.053542][ C0] ? rcu_pending+0x92/0x360 [ 9185.053785][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9185.054069][ C0] ? update_process_times+0xb9/0x110 [ 9185.054353][ C0] ? tick_sched_handle+0x67/0x130 [ 9185.054623][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9185.054925][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9185.055180][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9185.055509][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9185.055795][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9185.056096][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9185.056373][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9185.056691][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9185.056967][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9185.057243][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9185.057567][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9185.057881][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9185.058211][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9185.058515][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9185.058829][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9185.059131][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9185.059455][ C0] ? get_stack_info+0x36/0xc0 [ 9185.059710][ C0] ? lock_acquire+0x1c1/0x220 [ 9185.059964][ C0] ? lock_release+0x1d5/0x250 [ 9185.060216][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9185.060477][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9185.060763][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9185.061064][ C0] ? lock_acquire+0x1c1/0x220 [ 9185.061314][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9185.061566][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9185.061836][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9185.062093][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9185.062352][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9185.062619][ C0] ? __inet_lookup_established+0x341/0x610 [ 9185.062931][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9185.063224][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9185.063518][ C0] ip_local_deliver+0x19d/0x480 [ 9185.063777][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9185.064059][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9185.064322][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9185.064602][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9185.064870][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9185.065205][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9185.065482][ C0] ip_rcv+0x564/0x740 [ 9185.065703][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9185.065947][ C0] ? set_track_prepare+0x8a/0xd0 [ 9185.066216][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9185.066504][ C0] ? rest_init+0x153/0x260 [ 9185.066744][ C0] ? skb_clone+0x10b/0x330 [ 9185.066981][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9185.067317][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9185.067641][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9185.067936][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9185.068244][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9185.068503][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9185.068744][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9185.069056][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9185.069352][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9185.069695][ C0] ? lock_acquire+0x1c1/0x220 [ 9185.069949][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9185.070260][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9185.070555][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9185.070887][ C0] ? __copy_skb_header+0xaf/0x490 [ 9185.071158][ C0] ? __skb_clone+0x57a/0x760 [ 9185.071406][ C0] netif_receive_skb+0x55/0x280 [ 9185.071663][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9185.071998][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9185.072349][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9185.072661][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9185.072952][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9185.073258][ C0] ? hlock_class+0x4e/0x130 [ 9185.073505][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9185.073836][ C0] ? place_entity+0x21/0x2f0 [ 9185.074084][ C0] ? resched_curr+0x219/0x280 [ 9185.074333][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9185.074599][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9185.074879][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9185.075160][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9185.075421][ C0] ? activate_task+0xf5/0x260 [ 9185.075675][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9185.075953][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9185.076225][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9185.076487][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9185.076778][ C0] ? get_stack_info+0x36/0xc0 [ 9185.077026][ C0] ? stack_access_ok+0xda/0x1f0 [ 9185.077281][ C0] ? get_reg+0x119/0x190 [ 9185.077508][ C0] __tcf_classify+0x32c/0x7d0 [ 9185.077762][ C0] tcf_classify+0x283/0x930 [ 9185.078007][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9185.078339][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9185.078604][ C0] ? arch_stack_walk+0x8c/0x100 [ 9185.078861][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9185.079149][ C0] tc_run+0x2e4/0x5d0 [ 9185.079371][ C0] ? __pfx_tc_run+0x10/0x10 [ 9185.079616][ C0] ? lock_acquire+0x1c1/0x220 [ 9185.079869][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9185.080147][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9185.080411][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9185.080699][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9185.080980][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9185.081304][ C0] ? neigh_hh_output+0x348/0x590 [ 9185.081568][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9185.081848][ C0] ip_finish_output2+0x786/0x18e0 [ 9185.082123][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9185.082413][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9185.082769][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9185.083062][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9185.083326][ C0] ? __ip_finish_output+0x10f/0x770 [ 9185.083606][ C0] ip_output+0x16b/0x4f0 [ 9185.083838][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9185.084121][ C0] ? __pfx_ip_output+0x10/0x10 [ 9185.084379][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9185.084677][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9185.084944][ C0] ? ip_local_out+0x114/0x3b0 [ 9185.085196][ C0] __ip_queue_xmit+0x672/0x1910 [ 9185.085456][ C0] ? __skb_clone+0x57a/0x760 [ 9185.085707][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9185.085991][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9185.086295][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9185.086615][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9185.086871][ C0] ? tcp_current_mss+0x40a/0x510 [ 9185.087138][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9185.087421][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9185.087700][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9185.087958][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9185.088226][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9185.088546][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9185.088825][ C0] ? ktime_get+0xb6/0x190 [ 9185.089064][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9185.089340][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9185.089622][ C0] tcp_write_timer+0x82/0x1d0 [ 9185.089878][ C0] call_timer_fn+0x176/0x430 [ 9185.090129][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9185.090402][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9185.090682][ C0] __run_timers.part.0+0x52d/0x890 [ 9185.090954][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9185.091239][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9185.091538][ C0] ? lock_acquire+0x1c1/0x220 [ 9185.091791][ C0] ? clockevents_program_event+0xf6/0x300 [ 9185.092103][ C0] ? lock_release+0x1d5/0x250 [ 9185.092349][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9185.092623][ C0] ? ktime_get+0xb6/0x190 [ 9185.092853][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9185.093152][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9185.093464][ C0] run_timer_softirq+0x72/0x100 [ 9185.093724][ C0] __do_softirq+0x1bc/0x7ff [ 9185.093966][ C0] irq_exit_rcu+0x98/0xc0 [ 9185.094196][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9185.094492][ C0] [ 9185.094652][ C0] [ 9185.094813][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9185.095135][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9185.095403][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9185.096418][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9185.096738][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9185.097156][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9185.097572][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9185.097991][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9185.098406][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9185.098826][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9185.099129][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9185.099402][ C0] default_idle_call+0x69/0xa0 [ 9185.099662][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9185.099923][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9185.100215][ C0] ? lock_release+0x1d5/0x250 [ 9185.100463][ C0] do_idle+0xfb/0x160 [ 9185.100675][ C0] cpu_startup_entry+0x55/0x60 [ 9185.100931][ C0] rest_init+0x153/0x260 [ 9185.101156][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9185.101441][ C0] arch_call_rest_init+0x13/0x40 [ 9185.101706][ C0] start_kernel+0x314/0x3d0 [ 9185.101957][ C0] x86_64_start_reservations+0x18/0x30 [ 9185.102247][ C0] x86_64_start_kernel+0xba/0x110 [ 9185.102518][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9185.102850][ C0] [ 9185.103017][ C0] Sending NMI from CPU 0 to CPUs 1: [ 9185.103304][ C1] NMI backtrace for cpu 1 [ 9185.103315][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9185.103321][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9185.103324][ C1] RIP: 0010:kasan_check_range+0x1b/0x1c0 [ 9185.103335][ C1] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 53 <72> 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 23 [ 9185.103339][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000282 [ 9185.103343][ C1] RAX: ffff88800a098e1c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9185.103345][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9185.103347][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9185.103349][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9185.103351][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9185.103353][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9185.103355][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9185.103359][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9185.103360][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9185.103362][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9185.103363][ C1] Call Trace: [ 9185.103367][ C1] [ 9185.103372][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 9185.103379][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9185.103385][ C1] ? nmi_handle+0x156/0x420 [ 9185.103390][ C1] ? default_do_nmi+0x41/0x100 [ 9185.103395][ C1] ? exc_nmi+0xf3/0x120 [ 9185.103397][ C1] ? end_repeat_nmi+0xf/0x60 [ 9185.103402][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9185.103408][ C1] ? kasan_check_range+0x1b/0x1c0 [ 9185.103412][ C1] ? kasan_check_range+0x1b/0x1c0 [ 9185.103415][ C1] ? kasan_check_range+0x1b/0x1c0 [ 9185.103419][ C1] [ 9185.103420][ C1] [ 9185.103422][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 9185.103425][ C1] ? run_ksoftirqd+0xb/0x60 [ 9185.103431][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9185.103435][ C1] ? __orc_find+0x9c/0xf0 [ 9185.103438][ C1] ? lock_acquire+0x1c1/0x220 [ 9185.103443][ C1] ? irqentry_enter+0x2b/0x60 [ 9185.103449][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9185.103453][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9185.103456][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9185.103460][ C1] ? lock_acquire+0x1c1/0x220 [ 9185.103462][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9185.103468][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9185.103472][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9185.103480][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9185.103483][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9185.103489][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9185.103498][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9185.103502][ C1] ip_local_deliver+0x19d/0x480 [ 9185.103505][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9185.103507][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9185.103513][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9185.103517][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9185.103520][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9185.103524][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9185.103535][ C1] ip_rcv+0x564/0x740 [ 9185.103539][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9185.103542][ C1] ? set_track_prepare+0x8a/0xd0 [ 9185.103547][ C1] ? irqentry_enter+0x2b/0x60 [ 9185.103550][ C1] ? irqentry_enter+0x2b/0x60 [ 9185.103553][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9185.103556][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9185.103561][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9185.103565][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9185.103567][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9185.103570][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9185.103574][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9185.103579][ C1] netif_receive_skb+0x55/0x280 [ 9185.103582][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9185.103592][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9185.103600][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9185.103607][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9185.103614][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9185.103627][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9185.103637][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9185.103640][ C1] ? arch_stack_walk+0x68/0x100 [ 9185.103645][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9185.103649][ C1] ? irqentry_enter+0x2b/0x60 [ 9185.103652][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9185.103657][ C1] ? irqentry_enter+0x2b/0x60 [ 9185.103661][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9185.103668][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9185.103671][ C1] ? arch_stack_walk+0x68/0x100 [ 9185.103676][ C1] __tcf_classify+0x32c/0x7d0 [ 9185.103681][ C1] tcf_classify+0x283/0x930 [ 9185.103685][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9185.103689][ C1] tc_run+0x2e4/0x5d0 [ 9185.103694][ C1] ? __pfx_tc_run+0x10/0x10 [ 9185.103699][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9185.103705][ C1] ? irqentry_enter+0x2b/0x60 [ 9185.103708][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9185.103711][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9185.103718][ C1] ip_finish_output2+0x786/0x18e0 [ 9185.103724][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9185.103727][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9185.103731][ C1] ? __ip_finish_output+0x10f/0x770 [ 9185.103735][ C1] ip_output+0x16b/0x4f0 [ 9185.103739][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9185.103743][ C1] ? __pfx_ip_output+0x10/0x10 [ 9185.103748][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9185.103755][ C1] ? __pfx_ip_output+0x10/0x10 [ 9185.103759][ C1] __ip_queue_xmit+0x672/0x1910 [ 9185.103765][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9185.103772][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9185.103776][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9185.103780][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9185.103784][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9185.103787][ C1] tcp_delack_timer+0x84/0x240 [ 9185.103790][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9185.103793][ C1] call_timer_fn+0x176/0x430 [ 9185.103799][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9185.103804][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9185.103808][ C1] __run_timers.part.0+0x52d/0x890 [ 9185.103811][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9185.103816][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9185.103820][ C1] ? __pfx___schedule+0x10/0x10 [ 9185.103824][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9185.103829][ C1] run_timer_softirq+0x72/0x100 [ 9185.103832][ C1] __do_softirq+0x1bc/0x7ff [ 9185.103836][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9185.103840][ C1] run_ksoftirqd+0x2e/0x60 [ 9185.103843][ C1] smpboot_thread_fn+0x30e/0x840 [ 9185.103848][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9185.103852][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9185.103855][ C1] kthread+0x292/0x360 [ 9185.103858][ C1] ? __pfx_kthread+0x10/0x10 [ 9185.103861][ C1] ret_from_fork+0x34/0x70 [ 9185.103864][ C1] ? __pfx_kthread+0x10/0x10 [ 9185.103867][ C1] ret_from_fork_asm+0x1b/0x30 [ 9185.103876][ C1] [ 9212.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7473s! [swapper/0:0] [ 9212.527923][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9212.529121][ C0] irq event stamp: 27567077 [ 9212.529366][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9212.529894][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9212.530380][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9212.530891][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9212.531390][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9212.531881][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9212.532531][ C0] RIP: 0010:kasan_check_range+0x16/0x1c0 [ 9212.532838][ C0] Code: 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 <48> 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe [ 9212.533856][ C0] RSP: 0018:ffffc900000069c8 EFLAGS: 00000202 [ 9212.534183][ C0] RAX: ffff88800a099b58 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9212.534604][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9212.535024][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9212.535445][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9212.535862][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9212.536288][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9212.536761][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9212.537120][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9212.537544][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9212.537972][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9212.538399][ C0] Call Trace: [ 9212.538580][ C0] [ 9212.538742][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9212.539021][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9212.539282][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9212.539576][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9212.539867][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9212.540174][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9212.540456][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9212.540783][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9212.541057][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9212.541338][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9212.541663][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9212.541983][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9212.542315][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9212.542626][ C0] ? kasan_check_range+0x16/0x1c0 [ 9212.542901][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 9212.543200][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9212.543534][ C0] ? get_stack_info+0x36/0xc0 [ 9212.543788][ C0] ? lock_acquire+0x1c1/0x220 [ 9212.544039][ C0] ? lock_release+0x1d5/0x250 [ 9212.544289][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9212.544547][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9212.544832][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9212.545133][ C0] ? lock_acquire+0x1c1/0x220 [ 9212.545388][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9212.545649][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9212.545924][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9212.546172][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9212.546429][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9212.546698][ C0] ? __inet_lookup_established+0x341/0x610 [ 9212.547009][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9212.547303][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9212.547596][ C0] ip_local_deliver+0x19d/0x480 [ 9212.547854][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9212.548141][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9212.548405][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9212.548688][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9212.548955][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9212.549290][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9212.549569][ C0] ip_rcv+0x564/0x740 [ 9212.549787][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9212.550036][ C0] ? set_track_prepare+0x8a/0xd0 [ 9212.550306][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9212.550593][ C0] ? rest_init+0x153/0x260 [ 9212.550836][ C0] ? skb_clone+0x10b/0x330 [ 9212.551077][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9212.551422][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9212.551756][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9212.552053][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9212.552366][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9212.552629][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9212.552878][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9212.553195][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9212.553498][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9212.553839][ C0] ? lock_acquire+0x1c1/0x220 [ 9212.554089][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9212.554396][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9212.554699][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9212.555030][ C0] ? __copy_skb_header+0xaf/0x490 [ 9212.555300][ C0] ? __skb_clone+0x57a/0x760 [ 9212.555544][ C0] netif_receive_skb+0x55/0x280 [ 9212.555805][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9212.556139][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9212.556491][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9212.556805][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9212.557098][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9212.557402][ C0] ? hlock_class+0x4e/0x130 [ 9212.557654][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9212.557986][ C0] ? place_entity+0x21/0x2f0 [ 9212.558240][ C0] ? resched_curr+0x219/0x280 [ 9212.558488][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9212.558756][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9212.559039][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9212.559324][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9212.559591][ C0] ? activate_task+0xf5/0x260 [ 9212.559848][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9212.560127][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9212.560400][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9212.560664][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9212.560957][ C0] ? get_stack_info+0x36/0xc0 [ 9212.561207][ C0] ? stack_access_ok+0xda/0x1f0 [ 9212.561466][ C0] ? get_reg+0x119/0x190 [ 9212.561694][ C0] __tcf_classify+0x32c/0x7d0 [ 9212.561953][ C0] tcf_classify+0x283/0x930 [ 9212.562195][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9212.562525][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9212.562796][ C0] ? arch_stack_walk+0x8c/0x100 [ 9212.563061][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9212.563356][ C0] tc_run+0x2e4/0x5d0 [ 9212.563573][ C0] ? __pfx_tc_run+0x10/0x10 [ 9212.563817][ C0] ? lock_acquire+0x1c1/0x220 [ 9212.564068][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9212.564340][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9212.564612][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9212.564900][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9212.565180][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9212.565497][ C0] ? neigh_hh_output+0x348/0x590 [ 9212.565767][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9212.566045][ C0] ip_finish_output2+0x786/0x18e0 [ 9212.566312][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9212.566606][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9212.566964][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9212.567260][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9212.567524][ C0] ? __ip_finish_output+0x10f/0x770 [ 9212.567804][ C0] ip_output+0x16b/0x4f0 [ 9212.568037][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9212.568318][ C0] ? __pfx_ip_output+0x10/0x10 [ 9212.568575][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9212.568874][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9212.569144][ C0] ? ip_local_out+0x114/0x3b0 [ 9212.569395][ C0] __ip_queue_xmit+0x672/0x1910 [ 9212.569655][ C0] ? __skb_clone+0x57a/0x760 [ 9212.569902][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9212.570188][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9212.570487][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9212.570810][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9212.571069][ C0] ? tcp_current_mss+0x40a/0x510 [ 9212.571337][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9212.571615][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9212.571904][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9212.572161][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9212.572432][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9212.572757][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9212.573035][ C0] ? ktime_get+0xb6/0x190 [ 9212.573266][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9212.573540][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9212.573824][ C0] tcp_write_timer+0x82/0x1d0 [ 9212.574078][ C0] call_timer_fn+0x176/0x430 [ 9212.574328][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9212.574604][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9212.574877][ C0] __run_timers.part.0+0x52d/0x890 [ 9212.575154][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9212.575438][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9212.575744][ C0] ? lock_acquire+0x1c1/0x220 [ 9212.575994][ C0] ? clockevents_program_event+0xf6/0x300 [ 9212.576300][ C0] ? lock_release+0x1d5/0x250 [ 9212.576548][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9212.576827][ C0] ? ktime_get+0xb6/0x190 [ 9212.577059][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9212.577358][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9212.577673][ C0] run_timer_softirq+0x72/0x100 [ 9212.577932][ C0] __do_softirq+0x1bc/0x7ff [ 9212.578177][ C0] irq_exit_rcu+0x98/0xc0 [ 9212.578409][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9212.578713][ C0] [ 9212.578869][ C0] [ 9212.579027][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9212.579348][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9212.579623][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9212.580649][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9212.580977][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9212.581399][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9212.581826][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9212.582243][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9212.582662][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9212.583082][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9212.583384][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9212.583655][ C0] default_idle_call+0x69/0xa0 [ 9212.583911][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9212.584174][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9212.584470][ C0] ? lock_release+0x1d5/0x250 [ 9212.584722][ C0] do_idle+0xfb/0x160 [ 9212.584936][ C0] cpu_startup_entry+0x55/0x60 [ 9212.585194][ C0] rest_init+0x153/0x260 [ 9212.585422][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9212.585710][ C0] arch_call_rest_init+0x13/0x40 [ 9212.585977][ C0] start_kernel+0x314/0x3d0 [ 9212.586226][ C0] x86_64_start_reservations+0x18/0x30 [ 9212.586520][ C0] x86_64_start_kernel+0xba/0x110 [ 9212.586789][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9212.587115][ C0] [ 9212.587281][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7473s! [ksoftirqd/1:22] [ 9212.587760][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9212.588966][ C1] irq event stamp: 3886976 [ 9212.589206][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9212.589704][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9212.590197][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9212.590692][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9212.591188][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9212.591678][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9212.592332][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 9212.592671][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 9212.593688][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9212.594010][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9212.594427][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9212.594842][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9212.595262][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9212.595678][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9212.596099][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9212.596565][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9212.596916][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9212.597333][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9212.597753][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9212.598177][ C1] Call Trace: [ 9212.598363][ C1] [ 9212.598519][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9212.598794][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9212.599051][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9212.599339][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9212.599629][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9212.599940][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9212.600224][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9212.600548][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9212.600821][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9212.601152][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9212.601462][ C1] [ 9212.601620][ C1] [ 9212.601784][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9212.602121][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9212.602425][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 9212.602728][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9212.603030][ C1] ? run_ksoftirqd+0xb/0x60 [ 9212.603274][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9212.603607][ C1] ? __orc_find+0x9c/0xf0 [ 9212.603840][ C1] ? lock_acquire+0x1c1/0x220 [ 9212.604099][ C1] ? irqentry_enter+0x2b/0x60 [ 9212.604357][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9212.604621][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9212.604909][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9212.605212][ C1] ? lock_acquire+0x1c1/0x220 [ 9212.605460][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9212.605710][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9212.605982][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9212.606235][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9212.606498][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9212.606773][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9212.607070][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9212.607367][ C1] ip_local_deliver+0x19d/0x480 [ 9212.607627][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9212.607913][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9212.608179][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9212.608460][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9212.608730][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9212.609067][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9212.609349][ C1] ip_rcv+0x564/0x740 [ 9212.609564][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9212.609809][ C1] ? set_track_prepare+0x8a/0xd0 [ 9212.610077][ C1] ? irqentry_enter+0x2b/0x60 [ 9212.610326][ C1] ? irqentry_enter+0x2b/0x60 [ 9212.610575][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9212.610815][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9212.611134][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9212.611476][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9212.611792][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9212.612133][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9212.612432][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9212.612770][ C1] netif_receive_skb+0x55/0x280 [ 9212.613033][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9212.613372][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9212.613724][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9212.614038][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9212.614332][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9212.614641][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9212.614972][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9212.615257][ C1] ? arch_stack_walk+0x68/0x100 [ 9212.615518][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9212.615794][ C1] ? irqentry_enter+0x2b/0x60 [ 9212.616044][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9212.616362][ C1] ? irqentry_enter+0x2b/0x60 [ 9212.616617][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9212.616944][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9212.617226][ C1] ? arch_stack_walk+0x68/0x100 [ 9212.617492][ C1] __tcf_classify+0x32c/0x7d0 [ 9212.617750][ C1] tcf_classify+0x283/0x930 [ 9212.617996][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9212.618271][ C1] tc_run+0x2e4/0x5d0 [ 9212.618488][ C1] ? __pfx_tc_run+0x10/0x10 [ 9212.618735][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9212.619005][ C1] ? irqentry_enter+0x2b/0x60 [ 9212.619255][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9212.619538][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9212.619858][ C1] ip_finish_output2+0x786/0x18e0 [ 9212.620132][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9212.620428][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9212.620693][ C1] ? __ip_finish_output+0x10f/0x770 [ 9212.620975][ C1] ip_output+0x16b/0x4f0 [ 9212.621204][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9212.621521][ C1] ? __pfx_ip_output+0x10/0x10 [ 9212.621789][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9212.622148][ C1] ? __pfx_ip_output+0x10/0x10 [ 9212.622409][ C1] __ip_queue_xmit+0x672/0x1910 [ 9212.622671][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9212.622953][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9212.623251][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9212.623538][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9212.623834][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9212.624120][ C1] tcp_delack_timer+0x84/0x240 [ 9212.624373][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9212.624660][ C1] call_timer_fn+0x176/0x430 [ 9212.624909][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9212.625185][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9212.625465][ C1] __run_timers.part.0+0x52d/0x890 [ 9212.625742][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9212.626028][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9212.626327][ C1] ? __pfx___schedule+0x10/0x10 [ 9212.626594][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9212.626919][ C1] run_timer_softirq+0x72/0x100 [ 9212.627179][ C1] __do_softirq+0x1bc/0x7ff [ 9212.627420][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9212.627692][ C1] run_ksoftirqd+0x2e/0x60 [ 9212.627933][ C1] smpboot_thread_fn+0x30e/0x840 [ 9212.628199][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9212.628490][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9212.628777][ C1] kthread+0x292/0x360 [ 9212.628999][ C1] ? __pfx_kthread+0x10/0x10 [ 9212.629245][ C1] ret_from_fork+0x34/0x70 [ 9212.629486][ C1] ? __pfx_kthread+0x10/0x10 [ 9212.629730][ C1] ret_from_fork_asm+0x1b/0x30 [ 9212.629993][ C1] [ 9240.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7499s! [swapper/0:0] [ 9240.527924][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9240.529134][ C0] irq event stamp: 27567077 [ 9240.529379][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9240.529913][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9240.530388][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9240.530892][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9240.531386][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9240.531873][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9240.532513][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9240.532853][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9240.533869][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9240.534191][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9240.534609][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9240.535026][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9240.535442][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9240.535858][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9240.536275][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9240.536743][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9240.537095][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9240.537515][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9240.537939][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9240.538366][ C0] Call Trace: [ 9240.538547][ C0] [ 9240.538705][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9240.538980][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9240.539239][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9240.539530][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9240.539821][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9240.540125][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9240.540406][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9240.540732][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9240.541004][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9240.541283][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9240.541618][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9240.541931][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9240.542261][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9240.542566][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9240.542880][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9240.543183][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9240.543507][ C0] ? get_stack_info+0x36/0xc0 [ 9240.543761][ C0] ? lock_acquire+0x1c1/0x220 [ 9240.544015][ C0] ? lock_release+0x1d5/0x250 [ 9240.544268][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9240.544530][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9240.544815][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9240.545117][ C0] ? lock_acquire+0x1c1/0x220 [ 9240.545365][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9240.545618][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9240.545889][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9240.546137][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9240.546396][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9240.546668][ C0] ? __inet_lookup_established+0x341/0x610 [ 9240.546980][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9240.547265][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9240.547553][ C0] ip_local_deliver+0x19d/0x480 [ 9240.547813][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9240.548100][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9240.548369][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9240.548645][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9240.548907][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9240.549246][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9240.549520][ C0] ip_rcv+0x564/0x740 [ 9240.549733][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9240.549974][ C0] ? set_track_prepare+0x8a/0xd0 [ 9240.550239][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9240.550528][ C0] ? rest_init+0x153/0x260 [ 9240.550764][ C0] ? skb_clone+0x10b/0x330 [ 9240.551003][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9240.551333][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9240.551660][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9240.551956][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9240.552265][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9240.552525][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9240.552766][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9240.553082][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9240.553378][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9240.553722][ C0] ? lock_acquire+0x1c1/0x220 [ 9240.553975][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9240.554287][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9240.554583][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9240.554916][ C0] ? __copy_skb_header+0xaf/0x490 [ 9240.555187][ C0] ? __skb_clone+0x57a/0x760 [ 9240.555434][ C0] netif_receive_skb+0x55/0x280 [ 9240.555692][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9240.556018][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9240.556364][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9240.556680][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9240.556966][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9240.557266][ C0] ? hlock_class+0x4e/0x130 [ 9240.557512][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9240.557839][ C0] ? place_entity+0x21/0x2f0 [ 9240.558083][ C0] ? resched_curr+0x219/0x280 [ 9240.558336][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9240.558608][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9240.558892][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9240.559168][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9240.559425][ C0] ? activate_task+0xf5/0x260 [ 9240.559676][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9240.559949][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9240.560224][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9240.560483][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9240.560770][ C0] ? get_stack_info+0x36/0xc0 [ 9240.561022][ C0] ? stack_access_ok+0xda/0x1f0 [ 9240.561283][ C0] ? get_reg+0x119/0x190 [ 9240.561515][ C0] __tcf_classify+0x32c/0x7d0 [ 9240.561776][ C0] tcf_classify+0x283/0x930 [ 9240.562022][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9240.562355][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9240.562621][ C0] ? arch_stack_walk+0x8c/0x100 [ 9240.562878][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9240.563167][ C0] tc_run+0x2e4/0x5d0 [ 9240.563388][ C0] ? __pfx_tc_run+0x10/0x10 [ 9240.563633][ C0] ? lock_acquire+0x1c1/0x220 [ 9240.563885][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9240.564169][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9240.564432][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9240.564722][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9240.565002][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9240.565327][ C0] ? neigh_hh_output+0x348/0x590 [ 9240.565590][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9240.565871][ C0] ip_finish_output2+0x786/0x18e0 [ 9240.566142][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9240.566437][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9240.566788][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9240.567075][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9240.567344][ C0] ? __ip_finish_output+0x10f/0x770 [ 9240.567619][ C0] ip_output+0x16b/0x4f0 [ 9240.567844][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9240.568128][ C0] ? __pfx_ip_output+0x10/0x10 [ 9240.568382][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9240.568683][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9240.568945][ C0] ? ip_local_out+0x114/0x3b0 [ 9240.569202][ C0] __ip_queue_xmit+0x672/0x1910 [ 9240.569464][ C0] ? __skb_clone+0x57a/0x760 [ 9240.569712][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9240.569992][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9240.570287][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9240.570603][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9240.570863][ C0] ? tcp_current_mss+0x40a/0x510 [ 9240.571127][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9240.571410][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9240.571692][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9240.571950][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9240.572217][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9240.572535][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9240.572818][ C0] ? ktime_get+0xb6/0x190 [ 9240.573053][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9240.573328][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9240.573608][ C0] tcp_write_timer+0x82/0x1d0 [ 9240.573862][ C0] call_timer_fn+0x176/0x430 [ 9240.574112][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9240.574383][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9240.574657][ C0] __run_timers.part.0+0x52d/0x890 [ 9240.574928][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9240.575214][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9240.575511][ C0] ? lock_acquire+0x1c1/0x220 [ 9240.575764][ C0] ? clockevents_program_event+0xf6/0x300 [ 9240.576071][ C0] ? lock_release+0x1d5/0x250 [ 9240.576323][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9240.576600][ C0] ? ktime_get+0xb6/0x190 [ 9240.576834][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9240.577133][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9240.577441][ C0] run_timer_softirq+0x72/0x100 [ 9240.577710][ C0] __do_softirq+0x1bc/0x7ff [ 9240.577956][ C0] irq_exit_rcu+0x98/0xc0 [ 9240.578193][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9240.578494][ C0] [ 9240.578650][ C0] [ 9240.578806][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9240.579123][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9240.579397][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9240.580420][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9240.580746][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9240.581172][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9240.581597][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9240.582013][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9240.582431][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9240.582850][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9240.583153][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9240.583425][ C0] default_idle_call+0x69/0xa0 [ 9240.583681][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9240.583942][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9240.584235][ C0] ? lock_release+0x1d5/0x250 [ 9240.584482][ C0] do_idle+0xfb/0x160 [ 9240.584694][ C0] cpu_startup_entry+0x55/0x60 [ 9240.584949][ C0] rest_init+0x153/0x260 [ 9240.585176][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9240.585459][ C0] arch_call_rest_init+0x13/0x40 [ 9240.585723][ C0] start_kernel+0x314/0x3d0 [ 9240.585968][ C0] x86_64_start_reservations+0x18/0x30 [ 9240.586265][ C0] x86_64_start_kernel+0xba/0x110 [ 9240.586531][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9240.586859][ C0] [ 9240.587024][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7499s! [ksoftirqd/1:22] [ 9240.587499][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9240.588693][ C1] irq event stamp: 3886976 [ 9240.588927][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9240.589426][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9240.589922][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9240.590424][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9240.590913][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9240.591409][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9240.592063][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9240.592403][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9240.593422][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9240.593745][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9240.594163][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9240.594579][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9240.594994][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9240.595412][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9240.595830][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9240.596295][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9240.596647][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9240.597068][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9240.597487][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9240.597906][ C1] Call Trace: [ 9240.598090][ C1] [ 9240.598248][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9240.598522][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9240.598779][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9240.599069][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9240.599357][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9240.599664][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9240.599946][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9240.600272][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9240.600547][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9240.600877][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9240.601193][ C1] [ 9240.601349][ C1] [ 9240.601507][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9240.601848][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9240.602153][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9240.602464][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9240.602771][ C1] ? run_ksoftirqd+0xb/0x60 [ 9240.603020][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9240.603351][ C1] ? __orc_find+0x9c/0xf0 [ 9240.603582][ C1] ? lock_acquire+0x1c1/0x220 [ 9240.603832][ C1] ? irqentry_enter+0x2b/0x60 [ 9240.604081][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9240.604342][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9240.604628][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9240.604928][ C1] ? lock_acquire+0x1c1/0x220 [ 9240.605182][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9240.605438][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9240.605720][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9240.605966][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9240.606226][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9240.606497][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9240.606786][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9240.607076][ C1] ip_local_deliver+0x19d/0x480 [ 9240.607339][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9240.607629][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9240.607900][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9240.608180][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9240.608444][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9240.608785][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9240.609062][ C1] ip_rcv+0x564/0x740 [ 9240.609278][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9240.609521][ C1] ? set_track_prepare+0x8a/0xd0 [ 9240.609787][ C1] ? irqentry_enter+0x2b/0x60 [ 9240.610041][ C1] ? irqentry_enter+0x2b/0x60 [ 9240.610296][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9240.610542][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9240.610860][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9240.611209][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9240.611522][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9240.611871][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9240.612174][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9240.612504][ C1] netif_receive_skb+0x55/0x280 [ 9240.612763][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9240.613091][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9240.613440][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9240.613755][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9240.614043][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9240.614344][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9240.614672][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9240.614956][ C1] ? arch_stack_walk+0x68/0x100 [ 9240.615220][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9240.615501][ C1] ? irqentry_enter+0x2b/0x60 [ 9240.615755][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9240.616081][ C1] ? irqentry_enter+0x2b/0x60 [ 9240.616333][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9240.616657][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9240.616940][ C1] ? arch_stack_walk+0x68/0x100 [ 9240.617199][ C1] __tcf_classify+0x32c/0x7d0 [ 9240.617450][ C1] tcf_classify+0x283/0x930 [ 9240.617691][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9240.617959][ C1] tc_run+0x2e4/0x5d0 [ 9240.618177][ C1] ? __pfx_tc_run+0x10/0x10 [ 9240.618422][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9240.618688][ C1] ? irqentry_enter+0x2b/0x60 [ 9240.618941][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9240.619231][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9240.619558][ C1] ip_finish_output2+0x786/0x18e0 [ 9240.619828][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9240.620117][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9240.620385][ C1] ? __ip_finish_output+0x10f/0x770 [ 9240.620662][ C1] ip_output+0x16b/0x4f0 [ 9240.620889][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9240.621213][ C1] ? __pfx_ip_output+0x10/0x10 [ 9240.621471][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9240.621831][ C1] ? __pfx_ip_output+0x10/0x10 [ 9240.622087][ C1] __ip_queue_xmit+0x672/0x1910 [ 9240.622351][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9240.622637][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9240.622935][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9240.623227][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9240.623528][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9240.623820][ C1] tcp_delack_timer+0x84/0x240 [ 9240.624080][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9240.624366][ C1] call_timer_fn+0x176/0x430 [ 9240.624616][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9240.624893][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9240.625171][ C1] __run_timers.part.0+0x52d/0x890 [ 9240.625443][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9240.625735][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9240.626040][ C1] ? __pfx___schedule+0x10/0x10 [ 9240.626303][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9240.626621][ C1] run_timer_softirq+0x72/0x100 [ 9240.626885][ C1] __do_softirq+0x1bc/0x7ff [ 9240.627132][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9240.627412][ C1] run_ksoftirqd+0x2e/0x60 [ 9240.627649][ C1] smpboot_thread_fn+0x30e/0x840 [ 9240.627919][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9240.628212][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9240.628505][ C1] kthread+0x292/0x360 [ 9240.628722][ C1] ? __pfx_kthread+0x10/0x10 [ 9240.628970][ C1] ret_from_fork+0x34/0x70 [ 9240.629210][ C1] ? __pfx_kthread+0x10/0x10 [ 9240.629460][ C1] ret_from_fork_asm+0x1b/0x30 [ 9240.629722][ C1] [ 9263.107025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9263.107410][ C1] rcu: 1-....: (8000827 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1916103 [ 9263.108000][ C1] rcu: (t=8068798 jiffies g=1007429 q=31 ncpus=4) [ 9263.108348][ C1] Sending NMI from CPU 1 to CPUs 0: [ 9263.108639][ C0] NMI backtrace for cpu 0 [ 9263.108647][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9263.108652][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9263.108654][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9263.108664][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9263.108667][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9263.108671][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9263.108673][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9263.108675][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9263.108677][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9263.108678][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9263.108680][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9263.108682][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9263.108686][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9263.108688][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9263.108689][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9263.108691][ C0] Call Trace: [ 9263.108694][ C0] [ 9263.108699][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 9263.108706][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9263.108712][ C0] ? nmi_handle+0x156/0x420 [ 9263.108717][ C0] ? default_do_nmi+0x41/0x100 [ 9263.108721][ C0] ? exc_nmi+0xf3/0x120 [ 9263.108723][ C0] ? end_repeat_nmi+0xf/0x60 [ 9263.108728][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9263.108732][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9263.108735][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9263.108739][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9263.108742][ C0] [ 9263.108743][ C0] [ 9263.108744][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9263.108747][ C0] ? get_stack_info+0x36/0xc0 [ 9263.108752][ C0] ? lock_acquire+0x1c1/0x220 [ 9263.108756][ C0] ? lock_release+0x1d5/0x250 [ 9263.108760][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9263.108763][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9263.108766][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9263.108769][ C0] ? lock_acquire+0x1c1/0x220 [ 9263.108771][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9263.108777][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9263.108780][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9263.108787][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9263.108790][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9263.108794][ C0] ? __inet_lookup_established+0x341/0x610 [ 9263.108799][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9263.108806][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9263.108810][ C0] ip_local_deliver+0x19d/0x480 [ 9263.108813][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9263.108816][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9263.108821][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9263.108824][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9263.108827][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9263.108831][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9263.108841][ C0] ip_rcv+0x564/0x740 [ 9263.108844][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9263.108848][ C0] ? set_track_prepare+0x8a/0xd0 [ 9263.108851][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9263.108854][ C0] ? rest_init+0x153/0x260 [ 9263.108856][ C0] ? skb_clone+0x10b/0x330 [ 9263.108861][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9263.108867][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9263.108873][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9263.108878][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9263.108887][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9263.108890][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9263.108893][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9263.108897][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9263.108900][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9263.108904][ C0] ? lock_acquire+0x1c1/0x220 [ 9263.108906][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9263.108910][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9263.108913][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9263.108916][ C0] ? __copy_skb_header+0xaf/0x490 [ 9263.108919][ C0] ? __skb_clone+0x57a/0x760 [ 9263.108922][ C0] netif_receive_skb+0x55/0x280 [ 9263.108924][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9263.108932][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9263.108939][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9263.108946][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9263.108951][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9263.108959][ C0] ? hlock_class+0x4e/0x130 [ 9263.108965][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9263.108975][ C0] ? place_entity+0x21/0x2f0 [ 9263.108978][ C0] ? resched_curr+0x219/0x280 [ 9263.108981][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9263.108984][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9263.108988][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9263.108992][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9263.108994][ C0] ? activate_task+0xf5/0x260 [ 9263.108997][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9263.109002][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9263.109005][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9263.109009][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9263.109012][ C0] ? get_stack_info+0x36/0xc0 [ 9263.109015][ C0] ? stack_access_ok+0xda/0x1f0 [ 9263.109018][ C0] ? get_reg+0x119/0x190 [ 9263.109023][ C0] __tcf_classify+0x32c/0x7d0 [ 9263.109028][ C0] tcf_classify+0x283/0x930 [ 9263.109031][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9263.109036][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9263.109038][ C0] ? arch_stack_walk+0x8c/0x100 [ 9263.109043][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9263.109046][ C0] tc_run+0x2e4/0x5d0 [ 9263.109050][ C0] ? __pfx_tc_run+0x10/0x10 [ 9263.109053][ C0] ? lock_acquire+0x1c1/0x220 [ 9263.109056][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9263.109061][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9263.109066][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9263.109070][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9263.109074][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9263.109078][ C0] ? neigh_hh_output+0x348/0x590 [ 9263.109083][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9263.109087][ C0] ip_finish_output2+0x786/0x18e0 [ 9263.109091][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9263.109097][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9263.109105][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9263.109108][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9263.109112][ C0] ? __ip_finish_output+0x10f/0x770 [ 9263.109117][ C0] ip_output+0x16b/0x4f0 [ 9263.109120][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9263.109125][ C0] ? __pfx_ip_output+0x10/0x10 [ 9263.109128][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9263.109133][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9263.109136][ C0] ? ip_local_out+0x114/0x3b0 [ 9263.109140][ C0] __ip_queue_xmit+0x672/0x1910 [ 9263.109144][ C0] ? __skb_clone+0x57a/0x760 [ 9263.109147][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9263.109155][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9263.109159][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9263.109163][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9263.109168][ C0] ? tcp_current_mss+0x40a/0x510 [ 9263.109171][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9263.109174][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9263.109177][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9263.109179][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9263.109182][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9263.109185][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9263.109189][ C0] ? ktime_get+0xb6/0x190 [ 9263.109193][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9263.109198][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9263.109201][ C0] tcp_write_timer+0x82/0x1d0 [ 9263.109204][ C0] call_timer_fn+0x176/0x430 [ 9263.109208][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9263.109212][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9263.109217][ C0] __run_timers.part.0+0x52d/0x890 [ 9263.109220][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9263.109224][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9263.109227][ C0] ? lock_acquire+0x1c1/0x220 [ 9263.109230][ C0] ? clockevents_program_event+0xf6/0x300 [ 9263.109234][ C0] ? lock_release+0x1d5/0x250 [ 9263.109236][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9263.109239][ C0] ? ktime_get+0xb6/0x190 [ 9263.109242][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9263.109246][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9263.109250][ C0] run_timer_softirq+0x72/0x100 [ 9263.109253][ C0] __do_softirq+0x1bc/0x7ff [ 9263.109258][ C0] irq_exit_rcu+0x98/0xc0 [ 9263.109261][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9263.109265][ C0] [ 9263.109265][ C0] [ 9263.109267][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9263.109272][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9263.109276][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9263.109278][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9263.109280][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9263.109282][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9263.109284][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9263.109285][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9263.109287][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9263.109290][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9263.109293][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9263.109297][ C0] default_idle_call+0x69/0xa0 [ 9263.109299][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9263.109302][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9263.109306][ C0] ? lock_release+0x1d5/0x250 [ 9263.109310][ C0] do_idle+0xfb/0x160 [ 9263.109313][ C0] cpu_startup_entry+0x55/0x60 [ 9263.109315][ C0] rest_init+0x153/0x260 [ 9263.109317][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9263.109324][ C0] arch_call_rest_init+0x13/0x40 [ 9263.109329][ C0] start_kernel+0x314/0x3d0 [ 9263.109333][ C0] x86_64_start_reservations+0x18/0x30 [ 9263.109337][ C0] x86_64_start_kernel+0xba/0x110 [ 9263.109340][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9263.109348][ C0] [ 9263.109637][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9263.163734][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9263.164375][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 9263.164714][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 9263.165743][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9263.166069][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9263.166492][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9263.166916][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9263.167335][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9263.167755][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9263.168178][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9263.168653][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9263.168998][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9263.169424][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9263.169844][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9263.170262][ C1] Call Trace: [ 9263.170437][ C1] [ 9263.170593][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9263.170884][ C1] ? print_cpu_stall+0x263/0x6a0 [ 9263.171147][ C1] ? check_cpu_stall+0x284/0x500 [ 9263.171413][ C1] ? rcu_pending+0x92/0x360 [ 9263.171660][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9263.171944][ C1] ? update_process_times+0xb9/0x110 [ 9263.172227][ C1] ? tick_sched_handle+0x67/0x130 [ 9263.172498][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9263.172801][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9263.173055][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9263.173387][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9263.173672][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9263.173973][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9263.174251][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9263.174573][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9263.174856][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9263.175177][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9263.175487][ C1] [ 9263.175647][ C1] [ 9263.175808][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9263.176145][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9263.176447][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 9263.176748][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9263.177049][ C1] ? run_ksoftirqd+0xb/0x60 [ 9263.177294][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9263.177618][ C1] ? __orc_find+0x9c/0xf0 [ 9263.177853][ C1] ? lock_acquire+0x1c1/0x220 [ 9263.178107][ C1] ? irqentry_enter+0x2b/0x60 [ 9263.178361][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9263.178624][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9263.178913][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9263.179217][ C1] ? lock_acquire+0x1c1/0x220 [ 9263.179466][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9263.179719][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9263.179992][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9263.180242][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9263.180508][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9263.180784][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9263.181079][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9263.181370][ C1] ip_local_deliver+0x19d/0x480 [ 9263.181635][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9263.181922][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9263.182190][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9263.182466][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9263.182730][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9263.183069][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9263.183345][ C1] ip_rcv+0x564/0x740 [ 9263.183559][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9263.183800][ C1] ? set_track_prepare+0x8a/0xd0 [ 9263.184066][ C1] ? irqentry_enter+0x2b/0x60 [ 9263.184322][ C1] ? irqentry_enter+0x2b/0x60 [ 9263.184583][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9263.184834][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9263.185154][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9263.185497][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9263.185811][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9263.186151][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9263.186449][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9263.186785][ C1] netif_receive_skb+0x55/0x280 [ 9263.187049][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9263.187380][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9263.187734][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9263.188046][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9263.188339][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9263.188650][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9263.188984][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9263.189269][ C1] ? arch_stack_walk+0x68/0x100 [ 9263.189529][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9263.189805][ C1] ? irqentry_enter+0x2b/0x60 [ 9263.190056][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9263.190375][ C1] ? irqentry_enter+0x2b/0x60 [ 9263.190630][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9263.190955][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9263.191235][ C1] ? arch_stack_walk+0x68/0x100 [ 9263.191513][ C1] __tcf_classify+0x32c/0x7d0 [ 9263.191764][ C1] tcf_classify+0x283/0x930 [ 9263.192006][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9263.192275][ C1] tc_run+0x2e4/0x5d0 [ 9263.192489][ C1] ? __pfx_tc_run+0x10/0x10 [ 9263.192733][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9263.193001][ C1] ? irqentry_enter+0x2b/0x60 [ 9263.193262][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9263.193553][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9263.193876][ C1] ip_finish_output2+0x786/0x18e0 [ 9263.194147][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9263.194437][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9263.194703][ C1] ? __ip_finish_output+0x10f/0x770 [ 9263.194979][ C1] ip_output+0x16b/0x4f0 [ 9263.195208][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9263.195527][ C1] ? __pfx_ip_output+0x10/0x10 [ 9263.195782][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9263.196139][ C1] ? __pfx_ip_output+0x10/0x10 [ 9263.196397][ C1] __ip_queue_xmit+0x672/0x1910 [ 9263.196661][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9263.196941][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9263.197235][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9263.197518][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9263.197813][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9263.198100][ C1] tcp_delack_timer+0x84/0x240 [ 9263.198361][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9263.198650][ C1] call_timer_fn+0x176/0x430 [ 9263.198901][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9263.199175][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9263.199454][ C1] __run_timers.part.0+0x52d/0x890 [ 9263.199729][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9263.200017][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9263.200318][ C1] ? __pfx___schedule+0x10/0x10 [ 9263.200581][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9263.200906][ C1] run_timer_softirq+0x72/0x100 [ 9263.201166][ C1] __do_softirq+0x1bc/0x7ff [ 9263.201408][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9263.201691][ C1] run_ksoftirqd+0x2e/0x60 [ 9263.201929][ C1] smpboot_thread_fn+0x30e/0x840 [ 9263.202198][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9263.202488][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9263.202782][ C1] kthread+0x292/0x360 [ 9263.203002][ C1] ? __pfx_kthread+0x10/0x10 [ 9263.203251][ C1] ret_from_fork+0x34/0x70 [ 9263.203490][ C1] ? __pfx_kthread+0x10/0x10 [ 9263.203737][ C1] ret_from_fork_asm+0x1b/0x30 [ 9263.203995][ C1] [ 9288.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7544s! [swapper/0:0] [ 9288.527920][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9288.529119][ C0] irq event stamp: 27567077 [ 9288.529362][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9288.529896][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9288.530366][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9288.530873][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9288.531374][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9288.531857][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9288.532499][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9288.532838][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9288.533855][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9288.534180][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9288.534599][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9288.535017][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9288.535439][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9288.535859][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9288.536279][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9288.536751][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9288.537105][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9288.537530][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9288.537953][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9288.538379][ C0] Call Trace: [ 9288.538565][ C0] [ 9288.538722][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9288.538996][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9288.539253][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9288.539542][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9288.539831][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9288.540136][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9288.540418][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9288.540739][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9288.541011][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9288.541289][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9288.541619][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9288.541934][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9288.542261][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9288.542569][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9288.542881][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9288.543182][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9288.543509][ C0] ? get_stack_info+0x36/0xc0 [ 9288.543767][ C0] ? lock_acquire+0x1c1/0x220 [ 9288.544023][ C0] ? lock_release+0x1d5/0x250 [ 9288.544279][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9288.544542][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9288.544829][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9288.545129][ C0] ? lock_acquire+0x1c1/0x220 [ 9288.545376][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9288.545625][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9288.545896][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9288.546147][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9288.546407][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9288.546677][ C0] ? __inet_lookup_established+0x341/0x610 [ 9288.546997][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9288.547286][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9288.547575][ C0] ip_local_deliver+0x19d/0x480 [ 9288.547834][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9288.548121][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9288.548388][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9288.548662][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9288.548925][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9288.549264][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9288.549537][ C0] ip_rcv+0x564/0x740 [ 9288.549749][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9288.549989][ C0] ? set_track_prepare+0x8a/0xd0 [ 9288.550254][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9288.550545][ C0] ? rest_init+0x153/0x260 [ 9288.550781][ C0] ? skb_clone+0x10b/0x330 [ 9288.551024][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9288.551361][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9288.551687][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9288.551983][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9288.552290][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9288.552549][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9288.552788][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9288.553100][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9288.553398][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9288.553741][ C0] ? lock_acquire+0x1c1/0x220 [ 9288.553997][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9288.554311][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9288.554608][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9288.554941][ C0] ? __copy_skb_header+0xaf/0x490 [ 9288.555215][ C0] ? __skb_clone+0x57a/0x760 [ 9288.555464][ C0] netif_receive_skb+0x55/0x280 [ 9288.555722][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9288.556049][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9288.556396][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9288.556712][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9288.556999][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9288.557299][ C0] ? hlock_class+0x4e/0x130 [ 9288.557541][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9288.557868][ C0] ? place_entity+0x21/0x2f0 [ 9288.558114][ C0] ? resched_curr+0x219/0x280 [ 9288.558368][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9288.558638][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9288.558921][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9288.559198][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9288.559457][ C0] ? activate_task+0xf5/0x260 [ 9288.559705][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9288.559978][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9288.560255][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9288.560514][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9288.560804][ C0] ? get_stack_info+0x36/0xc0 [ 9288.561058][ C0] ? stack_access_ok+0xda/0x1f0 [ 9288.561317][ C0] ? get_reg+0x119/0x190 [ 9288.561556][ C0] __tcf_classify+0x32c/0x7d0 [ 9288.561813][ C0] tcf_classify+0x283/0x930 [ 9288.562059][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9288.562388][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9288.562654][ C0] ? arch_stack_walk+0x8c/0x100 [ 9288.562914][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9288.563202][ C0] tc_run+0x2e4/0x5d0 [ 9288.563422][ C0] ? __pfx_tc_run+0x10/0x10 [ 9288.563667][ C0] ? lock_acquire+0x1c1/0x220 [ 9288.563918][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9288.564196][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9288.564461][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9288.564749][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9288.565029][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9288.565354][ C0] ? neigh_hh_output+0x348/0x590 [ 9288.565618][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9288.565904][ C0] ip_finish_output2+0x786/0x18e0 [ 9288.566174][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9288.566467][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9288.566819][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9288.567109][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9288.567374][ C0] ? __ip_finish_output+0x10f/0x770 [ 9288.567649][ C0] ip_output+0x16b/0x4f0 [ 9288.567876][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9288.568162][ C0] ? __pfx_ip_output+0x10/0x10 [ 9288.568419][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9288.568721][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9288.568983][ C0] ? ip_local_out+0x114/0x3b0 [ 9288.569239][ C0] __ip_queue_xmit+0x672/0x1910 [ 9288.569505][ C0] ? __skb_clone+0x57a/0x760 [ 9288.569755][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9288.570034][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9288.570328][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9288.570644][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9288.570902][ C0] ? tcp_current_mss+0x40a/0x510 [ 9288.571167][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9288.571454][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9288.571735][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9288.571990][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9288.572257][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9288.572575][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9288.572854][ C0] ? ktime_get+0xb6/0x190 [ 9288.573090][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9288.573368][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9288.573649][ C0] tcp_write_timer+0x82/0x1d0 [ 9288.573903][ C0] call_timer_fn+0x176/0x430 [ 9288.574158][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9288.574430][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9288.574706][ C0] __run_timers.part.0+0x52d/0x890 [ 9288.574978][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9288.575264][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9288.575561][ C0] ? lock_acquire+0x1c1/0x220 [ 9288.575815][ C0] ? clockevents_program_event+0xf6/0x300 [ 9288.576124][ C0] ? lock_release+0x1d5/0x250 [ 9288.576377][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9288.576663][ C0] ? ktime_get+0xb6/0x190 [ 9288.576896][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9288.577198][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9288.577506][ C0] run_timer_softirq+0x72/0x100 [ 9288.577768][ C0] __do_softirq+0x1bc/0x7ff [ 9288.578015][ C0] irq_exit_rcu+0x98/0xc0 [ 9288.578250][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9288.578550][ C0] [ 9288.578706][ C0] [ 9288.578862][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9288.579180][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9288.579451][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9288.580477][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9288.580801][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9288.581226][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9288.581652][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9288.582068][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9288.582485][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9288.582903][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9288.583205][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9288.583478][ C0] default_idle_call+0x69/0xa0 [ 9288.583737][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9288.583999][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9288.584292][ C0] ? lock_release+0x1d5/0x250 [ 9288.584540][ C0] do_idle+0xfb/0x160 [ 9288.584751][ C0] cpu_startup_entry+0x55/0x60 [ 9288.585003][ C0] rest_init+0x153/0x260 [ 9288.585234][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9288.585524][ C0] arch_call_rest_init+0x13/0x40 [ 9288.585788][ C0] start_kernel+0x314/0x3d0 [ 9288.586033][ C0] x86_64_start_reservations+0x18/0x30 [ 9288.586325][ C0] x86_64_start_kernel+0xba/0x110 [ 9288.586592][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9288.586918][ C0] [ 9288.587085][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7544s! [ksoftirqd/1:22] [ 9288.587551][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9288.588737][ C1] irq event stamp: 3886976 [ 9288.588970][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9288.589474][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9288.589976][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9288.590478][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9288.590966][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9288.591472][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9288.592118][ C1] RIP: 0010:kasan_check_range+0x69/0x1c0 [ 9288.592421][ C1] Code: 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 <48> c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 [ 9288.593448][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000212 [ 9288.593775][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9288.594196][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9288.594619][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffff88800a098e1b [ 9288.595048][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9288.595468][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9288.595889][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9288.596366][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9288.596713][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9288.597135][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9288.597554][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9288.597971][ C1] Call Trace: [ 9288.598153][ C1] [ 9288.598310][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9288.598588][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9288.598841][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9288.599138][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9288.599424][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9288.599726][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9288.600004][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9288.600323][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9288.600602][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9288.600925][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9288.601234][ C1] [ 9288.601402][ C1] [ 9288.601560][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9288.601890][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9288.602197][ C1] ? kasan_check_range+0x69/0x1c0 [ 9288.602471][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 9288.602768][ C1] ? run_ksoftirqd+0xb/0x60 [ 9288.603015][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9288.603351][ C1] ? __orc_find+0x9c/0xf0 [ 9288.603582][ C1] ? lock_acquire+0x1c1/0x220 [ 9288.603833][ C1] ? irqentry_enter+0x2b/0x60 [ 9288.604086][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9288.604346][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9288.604632][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9288.604933][ C1] ? lock_acquire+0x1c1/0x220 [ 9288.605186][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9288.605441][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9288.605717][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9288.605965][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9288.606226][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9288.606497][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9288.606784][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9288.607075][ C1] ip_local_deliver+0x19d/0x480 [ 9288.607339][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9288.607628][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9288.607894][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9288.608172][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9288.608435][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9288.608774][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9288.609049][ C1] ip_rcv+0x564/0x740 [ 9288.609262][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9288.609502][ C1] ? set_track_prepare+0x8a/0xd0 [ 9288.609767][ C1] ? irqentry_enter+0x2b/0x60 [ 9288.610019][ C1] ? irqentry_enter+0x2b/0x60 [ 9288.610272][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9288.610516][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9288.610835][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9288.611181][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9288.611496][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9288.611838][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9288.612141][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9288.612472][ C1] netif_receive_skb+0x55/0x280 [ 9288.612732][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9288.613060][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9288.613411][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9288.613726][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9288.614018][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9288.614322][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9288.614649][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9288.614927][ C1] ? arch_stack_walk+0x68/0x100 [ 9288.615191][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9288.615470][ C1] ? irqentry_enter+0x2b/0x60 [ 9288.615724][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9288.616049][ C1] ? irqentry_enter+0x2b/0x60 [ 9288.616300][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9288.616625][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9288.616913][ C1] ? arch_stack_walk+0x68/0x100 [ 9288.617173][ C1] __tcf_classify+0x32c/0x7d0 [ 9288.617425][ C1] tcf_classify+0x283/0x930 [ 9288.617666][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9288.617935][ C1] tc_run+0x2e4/0x5d0 [ 9288.618150][ C1] ? __pfx_tc_run+0x10/0x10 [ 9288.618394][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9288.618664][ C1] ? irqentry_enter+0x2b/0x60 [ 9288.618917][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9288.619206][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9288.619532][ C1] ip_finish_output2+0x786/0x18e0 [ 9288.619805][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9288.620094][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9288.620363][ C1] ? __ip_finish_output+0x10f/0x770 [ 9288.620641][ C1] ip_output+0x16b/0x4f0 [ 9288.620868][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9288.621192][ C1] ? __pfx_ip_output+0x10/0x10 [ 9288.621459][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9288.621810][ C1] ? __pfx_ip_output+0x10/0x10 [ 9288.622070][ C1] __ip_queue_xmit+0x672/0x1910 [ 9288.622338][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9288.622628][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9288.622929][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9288.623219][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9288.623517][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9288.623806][ C1] tcp_delack_timer+0x84/0x240 [ 9288.624065][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9288.624348][ C1] call_timer_fn+0x176/0x430 [ 9288.624596][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9288.624874][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9288.625154][ C1] __run_timers.part.0+0x52d/0x890 [ 9288.625426][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9288.625720][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9288.626022][ C1] ? __pfx___schedule+0x10/0x10 [ 9288.626282][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9288.626602][ C1] run_timer_softirq+0x72/0x100 [ 9288.626865][ C1] __do_softirq+0x1bc/0x7ff [ 9288.627112][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9288.627389][ C1] run_ksoftirqd+0x2e/0x60 [ 9288.627627][ C1] smpboot_thread_fn+0x30e/0x840 [ 9288.627897][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9288.628189][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9288.628481][ C1] kthread+0x292/0x360 [ 9288.628697][ C1] ? __pfx_kthread+0x10/0x10 [ 9288.628946][ C1] ret_from_fork+0x34/0x70 [ 9288.629183][ C1] ? __pfx_kthread+0x10/0x10 [ 9288.629431][ C1] ret_from_fork_asm+0x1b/0x30 [ 9288.629692][ C1] [ 9316.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7570s! [swapper/0:0] [ 9316.527921][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9316.529118][ C0] irq event stamp: 27567077 [ 9316.529363][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9316.529891][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9316.530363][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9316.530861][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9316.531359][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9316.531840][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9316.532477][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9316.532816][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9316.533832][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9316.534153][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9316.534572][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9316.534991][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9316.535408][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9316.535825][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9316.536245][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9316.536715][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9316.537069][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9316.537498][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9316.537926][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9316.538349][ C0] Call Trace: [ 9316.538529][ C0] [ 9316.538689][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9316.538965][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9316.539223][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9316.539513][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9316.539800][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9316.540104][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9316.540387][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9316.540714][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9316.540987][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9316.541271][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9316.541600][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9316.541911][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9316.542241][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9316.542547][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9316.542859][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9316.543160][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9316.543486][ C0] ? get_stack_info+0x36/0xc0 [ 9316.543740][ C0] ? lock_acquire+0x1c1/0x220 [ 9316.543994][ C0] ? lock_release+0x1d5/0x250 [ 9316.544247][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9316.544508][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9316.544796][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9316.545099][ C0] ? lock_acquire+0x1c1/0x220 [ 9316.545350][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9316.545603][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9316.545875][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9316.546125][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9316.546386][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9316.546658][ C0] ? __inet_lookup_established+0x341/0x610 [ 9316.546975][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9316.547263][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9316.547551][ C0] ip_local_deliver+0x19d/0x480 [ 9316.547814][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9316.548102][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9316.548369][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9316.548644][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9316.548905][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9316.549243][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9316.549515][ C0] ip_rcv+0x564/0x740 [ 9316.549726][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9316.549966][ C0] ? set_track_prepare+0x8a/0xd0 [ 9316.550229][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9316.550518][ C0] ? rest_init+0x153/0x260 [ 9316.550756][ C0] ? skb_clone+0x10b/0x330 [ 9316.550998][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9316.551338][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9316.551661][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9316.551954][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9316.552262][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9316.552523][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9316.552762][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9316.553072][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9316.553370][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9316.553711][ C0] ? lock_acquire+0x1c1/0x220 [ 9316.553963][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9316.554274][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9316.554572][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9316.554905][ C0] ? __copy_skb_header+0xaf/0x490 [ 9316.555175][ C0] ? __skb_clone+0x57a/0x760 [ 9316.555422][ C0] netif_receive_skb+0x55/0x280 [ 9316.555676][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9316.556000][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9316.556349][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9316.556664][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9316.556950][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9316.557249][ C0] ? hlock_class+0x4e/0x130 [ 9316.557492][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9316.557820][ C0] ? place_entity+0x21/0x2f0 [ 9316.558066][ C0] ? resched_curr+0x219/0x280 [ 9316.558321][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9316.558593][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9316.558876][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9316.559154][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9316.559411][ C0] ? activate_task+0xf5/0x260 [ 9316.559661][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9316.559934][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9316.560211][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9316.560469][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9316.560757][ C0] ? get_stack_info+0x36/0xc0 [ 9316.561012][ C0] ? stack_access_ok+0xda/0x1f0 [ 9316.561285][ C0] ? get_reg+0x119/0x190 [ 9316.561512][ C0] __tcf_classify+0x32c/0x7d0 [ 9316.561766][ C0] tcf_classify+0x283/0x930 [ 9316.562012][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9316.562345][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9316.562611][ C0] ? arch_stack_walk+0x8c/0x100 [ 9316.562875][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9316.563167][ C0] tc_run+0x2e4/0x5d0 [ 9316.563384][ C0] ? __pfx_tc_run+0x10/0x10 [ 9316.563630][ C0] ? lock_acquire+0x1c1/0x220 [ 9316.563884][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9316.564161][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9316.564427][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9316.564717][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9316.564996][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9316.565320][ C0] ? neigh_hh_output+0x348/0x590 [ 9316.565583][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9316.565865][ C0] ip_finish_output2+0x786/0x18e0 [ 9316.566139][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9316.566435][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9316.566786][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9316.567075][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9316.567344][ C0] ? __ip_finish_output+0x10f/0x770 [ 9316.567621][ C0] ip_output+0x16b/0x4f0 [ 9316.567848][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9316.568133][ C0] ? __pfx_ip_output+0x10/0x10 [ 9316.568385][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9316.568689][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9316.568953][ C0] ? ip_local_out+0x114/0x3b0 [ 9316.569213][ C0] __ip_queue_xmit+0x672/0x1910 [ 9316.569475][ C0] ? __skb_clone+0x57a/0x760 [ 9316.569724][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9316.570003][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9316.570298][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9316.570618][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9316.570878][ C0] ? tcp_current_mss+0x40a/0x510 [ 9316.571140][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9316.571427][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9316.571707][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9316.571964][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9316.572231][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9316.572546][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9316.572826][ C0] ? ktime_get+0xb6/0x190 [ 9316.573060][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9316.573336][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9316.573615][ C0] tcp_write_timer+0x82/0x1d0 [ 9316.573869][ C0] call_timer_fn+0x176/0x430 [ 9316.574119][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9316.574393][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9316.574669][ C0] __run_timers.part.0+0x52d/0x890 [ 9316.574940][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9316.575226][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9316.575527][ C0] ? lock_acquire+0x1c1/0x220 [ 9316.575778][ C0] ? clockevents_program_event+0xf6/0x300 [ 9316.576086][ C0] ? lock_release+0x1d5/0x250 [ 9316.576339][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9316.576618][ C0] ? ktime_get+0xb6/0x190 [ 9316.576852][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9316.577152][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9316.577461][ C0] run_timer_softirq+0x72/0x100 [ 9316.577723][ C0] __do_softirq+0x1bc/0x7ff [ 9316.577971][ C0] irq_exit_rcu+0x98/0xc0 [ 9316.578203][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9316.578507][ C0] [ 9316.578663][ C0] [ 9316.578819][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9316.579138][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9316.579411][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9316.580436][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9316.580765][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9316.581185][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9316.581608][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9316.582023][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9316.582441][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9316.582858][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9316.583160][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9316.583431][ C0] default_idle_call+0x69/0xa0 [ 9316.583686][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9316.583947][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9316.584243][ C0] ? lock_release+0x1d5/0x250 [ 9316.584494][ C0] do_idle+0xfb/0x160 [ 9316.584707][ C0] cpu_startup_entry+0x55/0x60 [ 9316.584960][ C0] rest_init+0x153/0x260 [ 9316.585188][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9316.585475][ C0] arch_call_rest_init+0x13/0x40 [ 9316.585740][ C0] start_kernel+0x314/0x3d0 [ 9316.585987][ C0] x86_64_start_reservations+0x18/0x30 [ 9316.586282][ C0] x86_64_start_kernel+0xba/0x110 [ 9316.586549][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9316.586873][ C0] [ 9316.587038][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7570s! [ksoftirqd/1:22] [ 9316.587508][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9316.588691][ C1] irq event stamp: 3886976 [ 9316.588925][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9316.589426][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9316.589926][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9316.590424][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9316.590912][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9316.591415][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9316.592062][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 9316.592357][ C1] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 9316.593374][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [ 9316.593696][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9316.594113][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9316.594528][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9316.594942][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9316.595360][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9316.595774][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9316.596238][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9316.596591][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9316.597010][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9316.597427][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9316.597846][ C1] Call Trace: [ 9316.598028][ C1] [ 9316.598185][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9316.598459][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9316.598717][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9316.599005][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9316.599297][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9316.599604][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9316.599885][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9316.600209][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9316.600483][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9316.600809][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9316.601124][ C1] [ 9316.601291][ C1] [ 9316.601450][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9316.601783][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9316.602087][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 9316.602379][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 9316.602672][ C1] ? run_ksoftirqd+0xb/0x60 [ 9316.602914][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9316.603240][ C1] ? __orc_find+0x9c/0xf0 [ 9316.603475][ C1] ? lock_acquire+0x1c1/0x220 [ 9316.603729][ C1] ? irqentry_enter+0x2b/0x60 [ 9316.603985][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9316.604248][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9316.604537][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9316.604840][ C1] ? lock_acquire+0x1c1/0x220 [ 9316.605093][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9316.605346][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9316.605618][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9316.605867][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9316.606129][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9316.606406][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9316.606699][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9316.606994][ C1] ip_local_deliver+0x19d/0x480 [ 9316.607254][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9316.607537][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9316.607801][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9316.608083][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9316.608351][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9316.608687][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9316.608965][ C1] ip_rcv+0x564/0x740 [ 9316.609184][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9316.609429][ C1] ? set_track_prepare+0x8a/0xd0 [ 9316.609699][ C1] ? irqentry_enter+0x2b/0x60 [ 9316.609950][ C1] ? irqentry_enter+0x2b/0x60 [ 9316.610202][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9316.610442][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9316.610755][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9316.611096][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9316.611415][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9316.611753][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9316.612052][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9316.612390][ C1] netif_receive_skb+0x55/0x280 [ 9316.612651][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9316.612983][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9316.613341][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9316.613654][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9316.613950][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9316.614257][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9316.614593][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9316.614876][ C1] ? arch_stack_walk+0x68/0x100 [ 9316.615137][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9316.615413][ C1] ? irqentry_enter+0x2b/0x60 [ 9316.615664][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9316.615981][ C1] ? irqentry_enter+0x2b/0x60 [ 9316.616235][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9316.616562][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9316.616844][ C1] ? arch_stack_walk+0x68/0x100 [ 9316.617109][ C1] __tcf_classify+0x32c/0x7d0 [ 9316.617364][ C1] tcf_classify+0x283/0x930 [ 9316.617612][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9316.617883][ C1] tc_run+0x2e4/0x5d0 [ 9316.618105][ C1] ? __pfx_tc_run+0x10/0x10 [ 9316.618351][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9316.618621][ C1] ? irqentry_enter+0x2b/0x60 [ 9316.618872][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9316.619158][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9316.619477][ C1] ip_finish_output2+0x786/0x18e0 [ 9316.619753][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9316.620046][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9316.620310][ C1] ? __ip_finish_output+0x10f/0x770 [ 9316.620593][ C1] ip_output+0x16b/0x4f0 [ 9316.620822][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9316.621139][ C1] ? __pfx_ip_output+0x10/0x10 [ 9316.621402][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9316.621760][ C1] ? __pfx_ip_output+0x10/0x10 [ 9316.622019][ C1] __ip_queue_xmit+0x672/0x1910 [ 9316.622282][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9316.622563][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9316.622859][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9316.623145][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9316.623444][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9316.623726][ C1] tcp_delack_timer+0x84/0x240 [ 9316.623983][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9316.624272][ C1] call_timer_fn+0x176/0x430 [ 9316.624522][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9316.624796][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9316.625082][ C1] __run_timers.part.0+0x52d/0x890 [ 9316.625357][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9316.625643][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9316.625948][ C1] ? __pfx___schedule+0x10/0x10 [ 9316.626212][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9316.626537][ C1] run_timer_softirq+0x72/0x100 [ 9316.626796][ C1] __do_softirq+0x1bc/0x7ff [ 9316.627041][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9316.627314][ C1] run_ksoftirqd+0x2e/0x60 [ 9316.627555][ C1] smpboot_thread_fn+0x30e/0x840 [ 9316.627820][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9316.628113][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9316.628402][ C1] kthread+0x292/0x360 [ 9316.628625][ C1] ? __pfx_kthread+0x10/0x10 [ 9316.628878][ C1] ret_from_fork+0x34/0x70 [ 9316.629119][ C1] ? __pfx_kthread+0x10/0x10 [ 9316.629362][ C1] ret_from_fork_asm+0x1b/0x30 [ 9316.629624][ C1] [ 9341.205025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9341.205407][ C1] rcu: 1-....: (8078645 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1935158 [ 9341.205994][ C1] rcu: (t=8146896 jiffies g=1007429 q=31 ncpus=4) [ 9341.206345][ C1] Sending NMI from CPU 1 to CPUs 0: [ 9341.206629][ C0] NMI backtrace for cpu 0 [ 9341.206637][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9341.206641][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9341.206643][ C0] RIP: 0010:__kasan_check_read+0x0/0x20 [ 9341.206650][ C0] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 9341.206653][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000202 [ 9341.206656][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9341.206658][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9341.206660][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9341.206662][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9341.206664][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9341.206666][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9341.206668][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9341.206673][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9341.206675][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9341.206676][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9341.206678][ C0] Call Trace: [ 9341.206680][ C0] [ 9341.206683][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 9341.206688][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9341.206692][ C0] ? nmi_handle+0x156/0x420 [ 9341.206697][ C0] ? default_do_nmi+0x41/0x100 [ 9341.206701][ C0] ? exc_nmi+0xf3/0x120 [ 9341.206704][ C0] ? end_repeat_nmi+0xf/0x60 [ 9341.206709][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9341.206713][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 9341.206716][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 9341.206719][ C0] ? __pfx___kasan_check_read+0x10/0x10 [ 9341.206722][ C0] [ 9341.206724][ C0] [ 9341.206725][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 9341.206729][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9341.206732][ C0] ? get_stack_info+0x36/0xc0 [ 9341.206736][ C0] ? lock_acquire+0x1c1/0x220 [ 9341.206741][ C0] ? lock_release+0x1d5/0x250 [ 9341.206745][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9341.206748][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9341.206751][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9341.206754][ C0] ? lock_acquire+0x1c1/0x220 [ 9341.206757][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9341.206761][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9341.206765][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9341.206771][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9341.206774][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9341.206778][ C0] ? __inet_lookup_established+0x341/0x610 [ 9341.206784][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9341.206791][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9341.206795][ C0] ip_local_deliver+0x19d/0x480 [ 9341.206798][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9341.206801][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9341.206806][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9341.206810][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9341.206813][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9341.206817][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9341.206826][ C0] ip_rcv+0x564/0x740 [ 9341.206829][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9341.206832][ C0] ? set_track_prepare+0x8a/0xd0 [ 9341.206837][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9341.206839][ C0] ? rest_init+0x153/0x260 [ 9341.206841][ C0] ? skb_clone+0x10b/0x330 [ 9341.206845][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9341.206851][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9341.206857][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9341.206861][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9341.206870][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9341.206873][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9341.206876][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9341.206879][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9341.206882][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9341.206885][ C0] ? lock_acquire+0x1c1/0x220 [ 9341.206888][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9341.206891][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9341.206894][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9341.206897][ C0] ? __copy_skb_header+0xaf/0x490 [ 9341.206900][ C0] ? __skb_clone+0x57a/0x760 [ 9341.206902][ C0] netif_receive_skb+0x55/0x280 [ 9341.206905][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9341.206912][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9341.206919][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9341.206926][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9341.206931][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9341.206939][ C0] ? hlock_class+0x4e/0x130 [ 9341.206945][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9341.206955][ C0] ? place_entity+0x21/0x2f0 [ 9341.206957][ C0] ? resched_curr+0x219/0x280 [ 9341.206960][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9341.206963][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9341.206966][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9341.206970][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9341.206972][ C0] ? activate_task+0xf5/0x260 [ 9341.206975][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9341.206980][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9341.206983][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9341.206987][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9341.206990][ C0] ? get_stack_info+0x36/0xc0 [ 9341.206994][ C0] ? stack_access_ok+0xda/0x1f0 [ 9341.206996][ C0] ? get_reg+0x119/0x190 [ 9341.207000][ C0] __tcf_classify+0x32c/0x7d0 [ 9341.207005][ C0] tcf_classify+0x283/0x930 [ 9341.207007][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9341.207011][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9341.207014][ C0] ? arch_stack_walk+0x8c/0x100 [ 9341.207018][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9341.207023][ C0] tc_run+0x2e4/0x5d0 [ 9341.207027][ C0] ? __pfx_tc_run+0x10/0x10 [ 9341.207030][ C0] ? lock_acquire+0x1c1/0x220 [ 9341.207032][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9341.207037][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9341.207043][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9341.207046][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9341.207050][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9341.207054][ C0] ? neigh_hh_output+0x348/0x590 [ 9341.207058][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9341.207062][ C0] ip_finish_output2+0x786/0x18e0 [ 9341.207065][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9341.207070][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9341.207077][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9341.207080][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9341.207084][ C0] ? __ip_finish_output+0x10f/0x770 [ 9341.207089][ C0] ip_output+0x16b/0x4f0 [ 9341.207092][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9341.207096][ C0] ? __pfx_ip_output+0x10/0x10 [ 9341.207100][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9341.207105][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9341.207108][ C0] ? ip_local_out+0x114/0x3b0 [ 9341.207112][ C0] __ip_queue_xmit+0x672/0x1910 [ 9341.207116][ C0] ? __skb_clone+0x57a/0x760 [ 9341.207119][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9341.207126][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9341.207130][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9341.207134][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9341.207139][ C0] ? tcp_current_mss+0x40a/0x510 [ 9341.207142][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9341.207145][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9341.207148][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9341.207150][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9341.207153][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9341.207156][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9341.207161][ C0] ? ktime_get+0xb6/0x190 [ 9341.207165][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9341.207168][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9341.207171][ C0] tcp_write_timer+0x82/0x1d0 [ 9341.207175][ C0] call_timer_fn+0x176/0x430 [ 9341.207179][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9341.207183][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9341.207187][ C0] __run_timers.part.0+0x52d/0x890 [ 9341.207190][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9341.207195][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9341.207198][ C0] ? lock_acquire+0x1c1/0x220 [ 9341.207201][ C0] ? clockevents_program_event+0xf6/0x300 [ 9341.207205][ C0] ? lock_release+0x1d5/0x250 [ 9341.207207][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9341.207210][ C0] ? ktime_get+0xb6/0x190 [ 9341.207213][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9341.207216][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9341.207221][ C0] run_timer_softirq+0x72/0x100 [ 9341.207224][ C0] __do_softirq+0x1bc/0x7ff [ 9341.207229][ C0] irq_exit_rcu+0x98/0xc0 [ 9341.207231][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9341.207235][ C0] [ 9341.207236][ C0] [ 9341.207237][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9341.207242][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9341.207245][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9341.207247][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9341.207249][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9341.207251][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9341.207252][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9341.207253][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9341.207255][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9341.207258][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9341.207262][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9341.207265][ C0] default_idle_call+0x69/0xa0 [ 9341.207267][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9341.207270][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9341.207274][ C0] ? lock_release+0x1d5/0x250 [ 9341.207278][ C0] do_idle+0xfb/0x160 [ 9341.207281][ C0] cpu_startup_entry+0x55/0x60 [ 9341.207283][ C0] rest_init+0x153/0x260 [ 9341.207285][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9341.207290][ C0] arch_call_rest_init+0x13/0x40 [ 9341.207295][ C0] start_kernel+0x314/0x3d0 [ 9341.207299][ C0] x86_64_start_reservations+0x18/0x30 [ 9341.207303][ C0] x86_64_start_kernel+0xba/0x110 [ 9341.207306][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9341.207314][ C0] [ 9341.207627][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9341.261791][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9341.262439][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9341.262790][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9341.263815][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9341.264141][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9341.264568][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9341.264993][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9341.265415][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9341.265840][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9341.266265][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9341.266738][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9341.267092][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9341.267517][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9341.267933][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9341.268349][ C1] Call Trace: [ 9341.268525][ C1] [ 9341.268680][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9341.268970][ C1] ? print_cpu_stall+0x263/0x6a0 [ 9341.269234][ C1] ? check_cpu_stall+0x284/0x500 [ 9341.269502][ C1] ? rcu_pending+0x92/0x360 [ 9341.269743][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9341.270029][ C1] ? update_process_times+0xb9/0x110 [ 9341.270315][ C1] ? tick_sched_handle+0x67/0x130 [ 9341.270583][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9341.270880][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9341.271145][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9341.271475][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9341.271757][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9341.272061][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9341.272337][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9341.272655][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9341.272934][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9341.273255][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9341.273563][ C1] [ 9341.273722][ C1] [ 9341.273882][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9341.274220][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9341.274521][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9341.274830][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9341.275136][ C1] ? run_ksoftirqd+0xb/0x60 [ 9341.275384][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9341.275711][ C1] ? __orc_find+0x9c/0xf0 [ 9341.275941][ C1] ? lock_acquire+0x1c1/0x220 [ 9341.276189][ C1] ? irqentry_enter+0x2b/0x60 [ 9341.276437][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9341.276695][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9341.276980][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9341.277278][ C1] ? lock_acquire+0x1c1/0x220 [ 9341.277529][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9341.277786][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9341.278061][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9341.278305][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9341.278562][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9341.278831][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9341.279120][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9341.279407][ C1] ip_local_deliver+0x19d/0x480 [ 9341.279668][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9341.279955][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9341.280223][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9341.280500][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9341.280762][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9341.281114][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9341.281390][ C1] ip_rcv+0x564/0x740 [ 9341.281609][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9341.281852][ C1] ? set_track_prepare+0x8a/0xd0 [ 9341.282121][ C1] ? irqentry_enter+0x2b/0x60 [ 9341.282371][ C1] ? irqentry_enter+0x2b/0x60 [ 9341.282620][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9341.282862][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9341.283174][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9341.283510][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9341.283817][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9341.284159][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9341.284457][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9341.284784][ C1] netif_receive_skb+0x55/0x280 [ 9341.285049][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9341.285374][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9341.285724][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9341.286039][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9341.286327][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9341.286627][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9341.286954][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9341.287233][ C1] ? arch_stack_walk+0x68/0x100 [ 9341.287495][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9341.287774][ C1] ? irqentry_enter+0x2b/0x60 [ 9341.288027][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9341.288352][ C1] ? irqentry_enter+0x2b/0x60 [ 9341.288601][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9341.288920][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9341.289203][ C1] ? arch_stack_walk+0x68/0x100 [ 9341.289459][ C1] __tcf_classify+0x32c/0x7d0 [ 9341.289707][ C1] tcf_classify+0x283/0x930 [ 9341.289947][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9341.290214][ C1] tc_run+0x2e4/0x5d0 [ 9341.290431][ C1] ? __pfx_tc_run+0x10/0x10 [ 9341.290674][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9341.290940][ C1] ? irqentry_enter+0x2b/0x60 [ 9341.291198][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9341.291482][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9341.291804][ C1] ip_finish_output2+0x786/0x18e0 [ 9341.292078][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9341.292370][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9341.292632][ C1] ? __ip_finish_output+0x10f/0x770 [ 9341.292913][ C1] ip_output+0x16b/0x4f0 [ 9341.293144][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9341.293461][ C1] ? __pfx_ip_output+0x10/0x10 [ 9341.293722][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9341.294073][ C1] ? __pfx_ip_output+0x10/0x10 [ 9341.294327][ C1] __ip_queue_xmit+0x672/0x1910 [ 9341.294592][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9341.294875][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9341.295173][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9341.295463][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9341.295772][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9341.296061][ C1] tcp_delack_timer+0x84/0x240 [ 9341.296320][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9341.296604][ C1] call_timer_fn+0x176/0x430 [ 9341.296853][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9341.297129][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9341.297404][ C1] __run_timers.part.0+0x52d/0x890 [ 9341.297676][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9341.297967][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9341.298270][ C1] ? __pfx___schedule+0x10/0x10 [ 9341.298526][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9341.298841][ C1] run_timer_softirq+0x72/0x100 [ 9341.299102][ C1] __do_softirq+0x1bc/0x7ff [ 9341.299348][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9341.299624][ C1] run_ksoftirqd+0x2e/0x60 [ 9341.299861][ C1] smpboot_thread_fn+0x30e/0x840 [ 9341.300130][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9341.300425][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9341.300722][ C1] kthread+0x292/0x360 [ 9341.300938][ C1] ? __pfx_kthread+0x10/0x10 [ 9341.301195][ C1] ret_from_fork+0x34/0x70 [ 9341.301435][ C1] ? __pfx_kthread+0x10/0x10 [ 9341.301679][ C1] ret_from_fork_asm+0x1b/0x30 [ 9341.301943][ C1] [ 9368.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7619s! [swapper/0:0] [ 9368.527923][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9368.529127][ C0] irq event stamp: 27567077 [ 9368.529373][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9368.529906][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9368.530377][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9368.530878][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9368.531386][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9368.531871][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9368.532516][ C0] RIP: 0010:kasan_check_range+0x4/0x1c0 [ 9368.532814][ C0] Code: 6a 00 5b 5d 41 5c 41 5d c3 cc cc cc cc 66 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 <48> 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 [ 9368.533837][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000246 [ 9368.534162][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9368.534579][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9368.534996][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9368.535415][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9368.535834][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9368.536251][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9368.536718][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9368.537069][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9368.537487][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9368.537907][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9368.538330][ C0] Call Trace: [ 9368.538515][ C0] [ 9368.538671][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9368.538945][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9368.539202][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9368.539490][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9368.539779][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9368.540085][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9368.540367][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9368.540687][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9368.540965][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9368.541240][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9368.541568][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9368.541884][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9368.542214][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9368.542520][ C0] ? kasan_check_range+0x4/0x1c0 [ 9368.542785][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 9368.543080][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9368.543405][ C0] ? get_stack_info+0x36/0xc0 [ 9368.543663][ C0] ? lock_acquire+0x1c1/0x220 [ 9368.543918][ C0] ? lock_release+0x1d5/0x250 [ 9368.544174][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9368.544439][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9368.544729][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9368.545029][ C0] ? lock_acquire+0x1c1/0x220 [ 9368.545278][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9368.545528][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9368.545801][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9368.546051][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9368.546314][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9368.546584][ C0] ? __inet_lookup_established+0x341/0x610 [ 9368.546899][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9368.547191][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9368.547482][ C0] ip_local_deliver+0x19d/0x480 [ 9368.547743][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9368.548030][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9368.548296][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9368.548571][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9368.548832][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9368.549172][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9368.549450][ C0] ip_rcv+0x564/0x740 [ 9368.549661][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9368.549900][ C0] ? set_track_prepare+0x8a/0xd0 [ 9368.550163][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9368.550456][ C0] ? rest_init+0x153/0x260 [ 9368.550690][ C0] ? skb_clone+0x10b/0x330 [ 9368.550938][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9368.551275][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9368.551595][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9368.551887][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9368.552194][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9368.552449][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9368.552687][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9368.553002][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9368.553299][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9368.553641][ C0] ? lock_acquire+0x1c1/0x220 [ 9368.553892][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9368.554206][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9368.554502][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9368.554835][ C0] ? __copy_skb_header+0xaf/0x490 [ 9368.555104][ C0] ? __skb_clone+0x57a/0x760 [ 9368.555352][ C0] netif_receive_skb+0x55/0x280 [ 9368.555609][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9368.555932][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9368.556278][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9368.556592][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9368.556875][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9368.557172][ C0] ? hlock_class+0x4e/0x130 [ 9368.557414][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9368.557747][ C0] ? place_entity+0x21/0x2f0 [ 9368.557994][ C0] ? resched_curr+0x219/0x280 [ 9368.558251][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9368.558521][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9368.558805][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9368.559080][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9368.559337][ C0] ? activate_task+0xf5/0x260 [ 9368.559589][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9368.559862][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9368.560137][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9368.560396][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9368.560686][ C0] ? get_stack_info+0x36/0xc0 [ 9368.560951][ C0] ? stack_access_ok+0xda/0x1f0 [ 9368.561209][ C0] ? get_reg+0x119/0x190 [ 9368.561435][ C0] __tcf_classify+0x32c/0x7d0 [ 9368.561691][ C0] tcf_classify+0x283/0x930 [ 9368.561935][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9368.562268][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9368.562534][ C0] ? arch_stack_walk+0x8c/0x100 [ 9368.562794][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9368.563085][ C0] tc_run+0x2e4/0x5d0 [ 9368.563301][ C0] ? __pfx_tc_run+0x10/0x10 [ 9368.563551][ C0] ? lock_acquire+0x1c1/0x220 [ 9368.563804][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9368.564081][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9368.564346][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9368.564633][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9368.564913][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9368.565234][ C0] ? neigh_hh_output+0x348/0x590 [ 9368.565498][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9368.565778][ C0] ip_finish_output2+0x786/0x18e0 [ 9368.566050][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9368.566343][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9368.566697][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9368.566988][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9368.567256][ C0] ? __ip_finish_output+0x10f/0x770 [ 9368.567532][ C0] ip_output+0x16b/0x4f0 [ 9368.567757][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9368.568043][ C0] ? __pfx_ip_output+0x10/0x10 [ 9368.568297][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9368.568601][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9368.568863][ C0] ? ip_local_out+0x114/0x3b0 [ 9368.569120][ C0] __ip_queue_xmit+0x672/0x1910 [ 9368.569383][ C0] ? __skb_clone+0x57a/0x760 [ 9368.569632][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9368.569909][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9368.570208][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9368.570524][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9368.570785][ C0] ? tcp_current_mss+0x40a/0x510 [ 9368.571055][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9368.571335][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9368.571614][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9368.571870][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9368.572136][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9368.572451][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9368.572732][ C0] ? ktime_get+0xb6/0x190 [ 9368.572966][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9368.573242][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9368.573521][ C0] tcp_write_timer+0x82/0x1d0 [ 9368.573774][ C0] call_timer_fn+0x176/0x430 [ 9368.574023][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9368.574297][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9368.574572][ C0] __run_timers.part.0+0x52d/0x890 [ 9368.574843][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9368.575129][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9368.575426][ C0] ? lock_acquire+0x1c1/0x220 [ 9368.575677][ C0] ? clockevents_program_event+0xf6/0x300 [ 9368.575985][ C0] ? lock_release+0x1d5/0x250 [ 9368.576241][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9368.576520][ C0] ? ktime_get+0xb6/0x190 [ 9368.576755][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9368.577060][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9368.577370][ C0] run_timer_softirq+0x72/0x100 [ 9368.577631][ C0] __do_softirq+0x1bc/0x7ff [ 9368.577877][ C0] irq_exit_rcu+0x98/0xc0 [ 9368.578112][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9368.578414][ C0] [ 9368.578573][ C0] [ 9368.578730][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9368.579051][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9368.579325][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9368.580351][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9368.580679][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9368.581104][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9368.581519][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9368.581936][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9368.582354][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9368.582771][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9368.583072][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9368.583347][ C0] default_idle_call+0x69/0xa0 [ 9368.583601][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9368.583864][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9368.584158][ C0] ? lock_release+0x1d5/0x250 [ 9368.584409][ C0] do_idle+0xfb/0x160 [ 9368.584620][ C0] cpu_startup_entry+0x55/0x60 [ 9368.584870][ C0] rest_init+0x153/0x260 [ 9368.585100][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9368.585387][ C0] arch_call_rest_init+0x13/0x40 [ 9368.585650][ C0] start_kernel+0x314/0x3d0 [ 9368.585895][ C0] x86_64_start_reservations+0x18/0x30 [ 9368.586187][ C0] x86_64_start_kernel+0xba/0x110 [ 9368.586454][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9368.586777][ C0] [ 9368.586940][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7619s! [ksoftirqd/1:22] [ 9368.587406][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9368.588600][ C1] irq event stamp: 3886976 [ 9368.588837][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9368.589330][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9368.589822][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9368.590315][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9368.590803][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9368.591308][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9368.591951][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 9368.592290][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 9368.593305][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9368.593625][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9368.594045][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9368.594463][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9368.594881][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9368.595298][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9368.595717][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9368.596188][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9368.596540][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9368.596963][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9368.597388][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9368.597807][ C1] Call Trace: [ 9368.597990][ C1] [ 9368.598150][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9368.598426][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9368.598685][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9368.598974][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9368.599263][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9368.599566][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9368.599848][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9368.600173][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9368.600447][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9368.600773][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9368.601094][ C1] [ 9368.601254][ C1] [ 9368.601415][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9368.601748][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9368.602053][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 9368.602357][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9368.602659][ C1] ? run_ksoftirqd+0xb/0x60 [ 9368.602905][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9368.603238][ C1] ? __orc_find+0x9c/0xf0 [ 9368.603472][ C1] ? lock_acquire+0x1c1/0x220 [ 9368.603725][ C1] ? irqentry_enter+0x2b/0x60 [ 9368.603977][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9368.604240][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9368.604529][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9368.604831][ C1] ? lock_acquire+0x1c1/0x220 [ 9368.605082][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9368.605336][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9368.605609][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9368.605858][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9368.606121][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9368.606397][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9368.606689][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9368.606982][ C1] ip_local_deliver+0x19d/0x480 [ 9368.607240][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9368.607525][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9368.607791][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9368.608072][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9368.608338][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9368.608674][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9368.608951][ C1] ip_rcv+0x564/0x740 [ 9368.609172][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9368.609417][ C1] ? set_track_prepare+0x8a/0xd0 [ 9368.609685][ C1] ? irqentry_enter+0x2b/0x60 [ 9368.609936][ C1] ? irqentry_enter+0x2b/0x60 [ 9368.610189][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9368.610431][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9368.610745][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9368.611093][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9368.611406][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9368.611744][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9368.612042][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9368.612378][ C1] netif_receive_skb+0x55/0x280 [ 9368.612641][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9368.612969][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9368.613323][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9368.613634][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9368.613926][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9368.614232][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9368.614564][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9368.614848][ C1] ? arch_stack_walk+0x68/0x100 [ 9368.615108][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9368.615387][ C1] ? irqentry_enter+0x2b/0x60 [ 9368.615638][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9368.615956][ C1] ? irqentry_enter+0x2b/0x60 [ 9368.616212][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9368.616537][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9368.616816][ C1] ? arch_stack_walk+0x68/0x100 [ 9368.617080][ C1] __tcf_classify+0x32c/0x7d0 [ 9368.617333][ C1] tcf_classify+0x283/0x930 [ 9368.617578][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9368.617849][ C1] tc_run+0x2e4/0x5d0 [ 9368.618070][ C1] ? __pfx_tc_run+0x10/0x10 [ 9368.618321][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9368.618591][ C1] ? irqentry_enter+0x2b/0x60 [ 9368.618842][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9368.619129][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9368.619451][ C1] ip_finish_output2+0x786/0x18e0 [ 9368.619725][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9368.620018][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9368.620282][ C1] ? __ip_finish_output+0x10f/0x770 [ 9368.620563][ C1] ip_output+0x16b/0x4f0 [ 9368.620793][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9368.621123][ C1] ? __pfx_ip_output+0x10/0x10 [ 9368.621378][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9368.621733][ C1] ? __pfx_ip_output+0x10/0x10 [ 9368.621991][ C1] __ip_queue_xmit+0x672/0x1910 [ 9368.622252][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9368.622532][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9368.622824][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9368.623109][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9368.623404][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9368.623690][ C1] tcp_delack_timer+0x84/0x240 [ 9368.623947][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9368.624239][ C1] call_timer_fn+0x176/0x430 [ 9368.624490][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9368.624763][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9368.625043][ C1] __run_timers.part.0+0x52d/0x890 [ 9368.625318][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9368.625606][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9368.625906][ C1] ? __pfx___schedule+0x10/0x10 [ 9368.626169][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9368.626492][ C1] run_timer_softirq+0x72/0x100 [ 9368.626751][ C1] __do_softirq+0x1bc/0x7ff [ 9368.626993][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9368.627268][ C1] run_ksoftirqd+0x2e/0x60 [ 9368.627509][ C1] smpboot_thread_fn+0x30e/0x840 [ 9368.627773][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9368.628068][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9368.628359][ C1] kthread+0x292/0x360 [ 9368.628578][ C1] ? __pfx_kthread+0x10/0x10 [ 9368.628823][ C1] ret_from_fork+0x34/0x70 [ 9368.629065][ C1] ? __pfx_kthread+0x10/0x10 [ 9368.629309][ C1] ret_from_fork_asm+0x1b/0x30 [ 9368.629573][ C1] [ 9396.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7645s! [swapper/0:0] [ 9396.527911][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9396.529113][ C0] irq event stamp: 27567077 [ 9396.529357][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9396.529889][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9396.530365][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9396.530869][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9396.531369][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9396.531853][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9396.532494][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9396.532834][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9396.533851][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9396.534174][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9396.534594][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9396.535011][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9396.535429][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9396.535848][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9396.536267][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9396.536734][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9396.537089][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9396.537511][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9396.537931][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9396.538354][ C0] Call Trace: [ 9396.538538][ C0] [ 9396.538696][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9396.538971][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9396.539228][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9396.539516][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9396.539809][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9396.540116][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9396.540398][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9396.540722][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9396.541003][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9396.541278][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9396.541606][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9396.541919][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9396.542248][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9396.542556][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9396.542867][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9396.543169][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9396.543494][ C0] ? get_stack_info+0x36/0xc0 [ 9396.543751][ C0] ? lock_acquire+0x1c1/0x220 [ 9396.544009][ C0] ? lock_release+0x1d5/0x250 [ 9396.544267][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9396.544533][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9396.544823][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9396.545124][ C0] ? lock_acquire+0x1c1/0x220 [ 9396.545373][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9396.545623][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9396.545895][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9396.546146][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9396.546413][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9396.546689][ C0] ? __inet_lookup_established+0x341/0x610 [ 9396.547006][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9396.547296][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9396.547590][ C0] ip_local_deliver+0x19d/0x480 [ 9396.547853][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9396.548140][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9396.548406][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9396.548681][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9396.548942][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9396.549282][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9396.549555][ C0] ip_rcv+0x564/0x740 [ 9396.549768][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9396.550007][ C0] ? set_track_prepare+0x8a/0xd0 [ 9396.550271][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9396.550564][ C0] ? rest_init+0x153/0x260 [ 9396.550805][ C0] ? skb_clone+0x10b/0x330 [ 9396.551044][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9396.551382][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9396.551702][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9396.551996][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9396.552305][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9396.552561][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9396.552800][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9396.553116][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9396.553413][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9396.553756][ C0] ? lock_acquire+0x1c1/0x220 [ 9396.554007][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9396.554322][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9396.554619][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9396.554954][ C0] ? __copy_skb_header+0xaf/0x490 [ 9396.555225][ C0] ? __skb_clone+0x57a/0x760 [ 9396.555473][ C0] netif_receive_skb+0x55/0x280 [ 9396.555731][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9396.556055][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9396.556404][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9396.556721][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9396.557011][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9396.557309][ C0] ? hlock_class+0x4e/0x130 [ 9396.557552][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9396.557880][ C0] ? place_entity+0x21/0x2f0 [ 9396.558132][ C0] ? resched_curr+0x219/0x280 [ 9396.558386][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9396.558655][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9396.558937][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9396.559213][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9396.559470][ C0] ? activate_task+0xf5/0x260 [ 9396.559718][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9396.559991][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9396.560265][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9396.560522][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9396.560816][ C0] ? get_stack_info+0x36/0xc0 [ 9396.561067][ C0] ? stack_access_ok+0xda/0x1f0 [ 9396.561323][ C0] ? get_reg+0x119/0x190 [ 9396.561548][ C0] __tcf_classify+0x32c/0x7d0 [ 9396.561804][ C0] tcf_classify+0x283/0x930 [ 9396.562049][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9396.562382][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9396.562648][ C0] ? arch_stack_walk+0x8c/0x100 [ 9396.562908][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9396.563198][ C0] tc_run+0x2e4/0x5d0 [ 9396.563414][ C0] ? __pfx_tc_run+0x10/0x10 [ 9396.563659][ C0] ? lock_acquire+0x1c1/0x220 [ 9396.563911][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9396.564189][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9396.564455][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9396.564742][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9396.565024][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9396.565344][ C0] ? neigh_hh_output+0x348/0x590 [ 9396.565608][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9396.565888][ C0] ip_finish_output2+0x786/0x18e0 [ 9396.566161][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9396.566455][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9396.566807][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9396.567098][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9396.567364][ C0] ? __ip_finish_output+0x10f/0x770 [ 9396.567639][ C0] ip_output+0x16b/0x4f0 [ 9396.567863][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9396.568147][ C0] ? __pfx_ip_output+0x10/0x10 [ 9396.568400][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9396.568703][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9396.568965][ C0] ? ip_local_out+0x114/0x3b0 [ 9396.569219][ C0] __ip_queue_xmit+0x672/0x1910 [ 9396.569481][ C0] ? __skb_clone+0x57a/0x760 [ 9396.569728][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9396.570006][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9396.570298][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9396.570613][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9396.570877][ C0] ? tcp_current_mss+0x40a/0x510 [ 9396.571142][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9396.571419][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9396.571697][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9396.571951][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9396.572217][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9396.572532][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9396.572810][ C0] ? ktime_get+0xb6/0x190 [ 9396.573044][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9396.573318][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9396.573599][ C0] tcp_write_timer+0x82/0x1d0 [ 9396.573851][ C0] call_timer_fn+0x176/0x430 [ 9396.574101][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9396.574375][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9396.574652][ C0] __run_timers.part.0+0x52d/0x890 [ 9396.574922][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9396.575208][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9396.575506][ C0] ? lock_acquire+0x1c1/0x220 [ 9396.575756][ C0] ? clockevents_program_event+0xf6/0x300 [ 9396.576065][ C0] ? lock_release+0x1d5/0x250 [ 9396.576323][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9396.576602][ C0] ? ktime_get+0xb6/0x190 [ 9396.576838][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9396.577141][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9396.577450][ C0] run_timer_softirq+0x72/0x100 [ 9396.577711][ C0] __do_softirq+0x1bc/0x7ff [ 9396.577957][ C0] irq_exit_rcu+0x98/0xc0 [ 9396.578192][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9396.578493][ C0] [ 9396.578650][ C0] [ 9396.578807][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9396.579129][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9396.579399][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9396.580428][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9396.580756][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9396.581184][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9396.581601][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9396.582020][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9396.582442][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9396.582863][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9396.583166][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9396.583439][ C0] default_idle_call+0x69/0xa0 [ 9396.583694][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9396.583958][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9396.584254][ C0] ? lock_release+0x1d5/0x250 [ 9396.584506][ C0] do_idle+0xfb/0x160 [ 9396.584717][ C0] cpu_startup_entry+0x55/0x60 [ 9396.584969][ C0] rest_init+0x153/0x260 [ 9396.585201][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9396.585490][ C0] arch_call_rest_init+0x13/0x40 [ 9396.585754][ C0] start_kernel+0x314/0x3d0 [ 9396.586000][ C0] x86_64_start_reservations+0x18/0x30 [ 9396.586293][ C0] x86_64_start_kernel+0xba/0x110 [ 9396.586561][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9396.586886][ C0] [ 9396.587049][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7645s! [ksoftirqd/1:22] [ 9396.587510][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9396.588710][ C1] irq event stamp: 3886976 [ 9396.588948][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9396.589442][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9396.589937][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9396.590433][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9396.590933][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9396.591430][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9396.592081][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9396.592424][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9396.593450][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9396.593779][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9396.594200][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9396.594622][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9396.595046][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9396.595472][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9396.595891][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9396.596361][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9396.596709][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9396.597130][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9396.597544][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9396.597959][ C1] Call Trace: [ 9396.598138][ C1] [ 9396.598293][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9396.598572][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9396.598824][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9396.599118][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9396.599399][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9396.599699][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9396.599976][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9396.600295][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9396.600572][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9396.600899][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9396.601213][ C1] [ 9396.601369][ C1] [ 9396.601525][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9396.601855][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9396.602160][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9396.602473][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9396.602775][ C1] ? run_ksoftirqd+0xb/0x60 [ 9396.603016][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9396.603343][ C1] ? __orc_find+0x9c/0xf0 [ 9396.603574][ C1] ? lock_acquire+0x1c1/0x220 [ 9396.603836][ C1] ? irqentry_enter+0x2b/0x60 [ 9396.604092][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9396.604359][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9396.604646][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9396.604947][ C1] ? lock_acquire+0x1c1/0x220 [ 9396.605194][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9396.605444][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9396.605718][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9396.605966][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9396.606231][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9396.606504][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9396.606799][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9396.607091][ C1] ip_local_deliver+0x19d/0x480 [ 9396.607349][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9396.607633][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9396.607899][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9396.608180][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9396.608445][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9396.608779][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9396.609058][ C1] ip_rcv+0x564/0x740 [ 9396.609272][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9396.609517][ C1] ? set_track_prepare+0x8a/0xd0 [ 9396.609784][ C1] ? irqentry_enter+0x2b/0x60 [ 9396.610033][ C1] ? irqentry_enter+0x2b/0x60 [ 9396.610282][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9396.610521][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9396.610840][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9396.611188][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9396.611500][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9396.611837][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9396.612134][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9396.612471][ C1] netif_receive_skb+0x55/0x280 [ 9396.612736][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9396.613066][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9396.613417][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9396.613728][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9396.614018][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9396.614324][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9396.614654][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9396.614938][ C1] ? arch_stack_walk+0x68/0x100 [ 9396.615196][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9396.615476][ C1] ? irqentry_enter+0x2b/0x60 [ 9396.615726][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9396.616048][ C1] ? irqentry_enter+0x2b/0x60 [ 9396.616305][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9396.616628][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9396.616906][ C1] ? arch_stack_walk+0x68/0x100 [ 9396.617170][ C1] __tcf_classify+0x32c/0x7d0 [ 9396.617426][ C1] tcf_classify+0x283/0x930 [ 9396.617673][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9396.617947][ C1] tc_run+0x2e4/0x5d0 [ 9396.618165][ C1] ? __pfx_tc_run+0x10/0x10 [ 9396.618413][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9396.618683][ C1] ? irqentry_enter+0x2b/0x60 [ 9396.618932][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9396.619221][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9396.619546][ C1] ip_finish_output2+0x786/0x18e0 [ 9396.619820][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9396.620112][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9396.620379][ C1] ? __ip_finish_output+0x10f/0x770 [ 9396.620660][ C1] ip_output+0x16b/0x4f0 [ 9396.620898][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9396.621222][ C1] ? __pfx_ip_output+0x10/0x10 [ 9396.621481][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9396.621835][ C1] ? __pfx_ip_output+0x10/0x10 [ 9396.622093][ C1] __ip_queue_xmit+0x672/0x1910 [ 9396.622353][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9396.622633][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9396.622934][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9396.623221][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9396.623516][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9396.623802][ C1] tcp_delack_timer+0x84/0x240 [ 9396.624058][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9396.624349][ C1] call_timer_fn+0x176/0x430 [ 9396.624601][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9396.624875][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9396.625156][ C1] __run_timers.part.0+0x52d/0x890 [ 9396.625436][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9396.625724][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9396.626023][ C1] ? __pfx___schedule+0x10/0x10 [ 9396.626287][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9396.626610][ C1] run_timer_softirq+0x72/0x100 [ 9396.626866][ C1] __do_softirq+0x1bc/0x7ff [ 9396.627109][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9396.627383][ C1] run_ksoftirqd+0x2e/0x60 [ 9396.627623][ C1] smpboot_thread_fn+0x30e/0x840 [ 9396.627888][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9396.628184][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9396.628473][ C1] kthread+0x292/0x360 [ 9396.628691][ C1] ? __pfx_kthread+0x10/0x10 [ 9396.628934][ C1] ret_from_fork+0x34/0x70 [ 9396.629175][ C1] ? __pfx_kthread+0x10/0x10 [ 9396.629422][ C1] ret_from_fork_asm+0x1b/0x30 [ 9396.629685][ C1] [ 9419.303025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9419.303412][ C1] rcu: 1-....: (8156463 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1953729 [ 9419.303996][ C1] rcu: (t=8224994 jiffies g=1007429 q=31 ncpus=4) [ 9419.304345][ C1] Sending NMI from CPU 1 to CPUs 0: [ 9419.304632][ C0] NMI backtrace for cpu 0 [ 9419.304640][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9419.304644][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9419.304647][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9419.304655][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9419.304658][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9419.304662][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9419.304664][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9419.304666][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9419.304668][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9419.304670][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9419.304671][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9419.304673][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9419.304677][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9419.304679][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9419.304680][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9419.304682][ C0] Call Trace: [ 9419.304685][ C0] [ 9419.304689][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 9419.304694][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9419.304698][ C0] ? nmi_handle+0x156/0x420 [ 9419.304703][ C0] ? default_do_nmi+0x41/0x100 [ 9419.304706][ C0] ? exc_nmi+0xf3/0x120 [ 9419.304709][ C0] ? end_repeat_nmi+0xf/0x60 [ 9419.304713][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9419.304717][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9419.304721][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9419.304724][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9419.304728][ C0] [ 9419.304729][ C0] [ 9419.304730][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9419.304733][ C0] ? get_stack_info+0x36/0xc0 [ 9419.304738][ C0] ? lock_acquire+0x1c1/0x220 [ 9419.304743][ C0] ? lock_release+0x1d5/0x250 [ 9419.304746][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9419.304750][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9419.304753][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9419.304756][ C0] ? lock_acquire+0x1c1/0x220 [ 9419.304759][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9419.304763][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9419.304767][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9419.304775][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9419.304778][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9419.304782][ C0] ? __inet_lookup_established+0x341/0x610 [ 9419.304787][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9419.304794][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9419.304798][ C0] ip_local_deliver+0x19d/0x480 [ 9419.304802][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9419.304804][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9419.304809][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9419.304813][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9419.304816][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9419.304820][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9419.304829][ C0] ip_rcv+0x564/0x740 [ 9419.304832][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9419.304835][ C0] ? set_track_prepare+0x8a/0xd0 [ 9419.304839][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9419.304842][ C0] ? rest_init+0x153/0x260 [ 9419.304844][ C0] ? skb_clone+0x10b/0x330 [ 9419.304848][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9419.304854][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9419.304860][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9419.304864][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9419.304872][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9419.304876][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9419.304878][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9419.304882][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9419.304885][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9419.304889][ C0] ? lock_acquire+0x1c1/0x220 [ 9419.304891][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9419.304895][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9419.304898][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9419.304901][ C0] ? __copy_skb_header+0xaf/0x490 [ 9419.304904][ C0] ? __skb_clone+0x57a/0x760 [ 9419.304907][ C0] netif_receive_skb+0x55/0x280 [ 9419.304909][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9419.304917][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9419.304924][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9419.304931][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9419.304936][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9419.304945][ C0] ? hlock_class+0x4e/0x130 [ 9419.304950][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9419.304960][ C0] ? place_entity+0x21/0x2f0 [ 9419.304963][ C0] ? resched_curr+0x219/0x280 [ 9419.304966][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9419.304968][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9419.304971][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9419.304976][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9419.304978][ C0] ? activate_task+0xf5/0x260 [ 9419.304981][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9419.304985][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9419.304989][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9419.304992][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9419.304996][ C0] ? get_stack_info+0x36/0xc0 [ 9419.304999][ C0] ? stack_access_ok+0xda/0x1f0 [ 9419.305001][ C0] ? get_reg+0x119/0x190 [ 9419.305005][ C0] __tcf_classify+0x32c/0x7d0 [ 9419.305009][ C0] tcf_classify+0x283/0x930 [ 9419.305012][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9419.305017][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9419.305019][ C0] ? arch_stack_walk+0x8c/0x100 [ 9419.305025][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9419.305028][ C0] tc_run+0x2e4/0x5d0 [ 9419.305032][ C0] ? __pfx_tc_run+0x10/0x10 [ 9419.305036][ C0] ? lock_acquire+0x1c1/0x220 [ 9419.305038][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9419.305042][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9419.305048][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9419.305051][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9419.305054][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9419.305059][ C0] ? neigh_hh_output+0x348/0x590 [ 9419.305064][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9419.305068][ C0] ip_finish_output2+0x786/0x18e0 [ 9419.305071][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9419.305076][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9419.305084][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9419.305087][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9419.305091][ C0] ? __ip_finish_output+0x10f/0x770 [ 9419.305095][ C0] ip_output+0x16b/0x4f0 [ 9419.305098][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9419.305103][ C0] ? __pfx_ip_output+0x10/0x10 [ 9419.305106][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9419.305111][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9419.305114][ C0] ? ip_local_out+0x114/0x3b0 [ 9419.305118][ C0] __ip_queue_xmit+0x672/0x1910 [ 9419.305122][ C0] ? __skb_clone+0x57a/0x760 [ 9419.305125][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9419.305132][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9419.305137][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9419.305140][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9419.305146][ C0] ? tcp_current_mss+0x40a/0x510 [ 9419.305149][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9419.305151][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9419.305155][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9419.305157][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9419.305160][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9419.305164][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9419.305168][ C0] ? ktime_get+0xb6/0x190 [ 9419.305172][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9419.305177][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9419.305180][ C0] tcp_write_timer+0x82/0x1d0 [ 9419.305184][ C0] call_timer_fn+0x176/0x430 [ 9419.305187][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9419.305192][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9419.305196][ C0] __run_timers.part.0+0x52d/0x890 [ 9419.305199][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9419.305204][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9419.305207][ C0] ? lock_acquire+0x1c1/0x220 [ 9419.305209][ C0] ? clockevents_program_event+0xf6/0x300 [ 9419.305213][ C0] ? lock_release+0x1d5/0x250 [ 9419.305216][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9419.305218][ C0] ? ktime_get+0xb6/0x190 [ 9419.305221][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9419.305224][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9419.305229][ C0] run_timer_softirq+0x72/0x100 [ 9419.305232][ C0] __do_softirq+0x1bc/0x7ff [ 9419.305237][ C0] irq_exit_rcu+0x98/0xc0 [ 9419.305240][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9419.305243][ C0] [ 9419.305244][ C0] [ 9419.305245][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9419.305250][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9419.305253][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9419.305255][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9419.305258][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9419.305260][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9419.305261][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9419.305263][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9419.305264][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9419.305268][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9419.305271][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9419.305275][ C0] default_idle_call+0x69/0xa0 [ 9419.305277][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9419.305280][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9419.305285][ C0] ? lock_release+0x1d5/0x250 [ 9419.305289][ C0] do_idle+0xfb/0x160 [ 9419.305292][ C0] cpu_startup_entry+0x55/0x60 [ 9419.305294][ C0] rest_init+0x153/0x260 [ 9419.305297][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9419.305301][ C0] arch_call_rest_init+0x13/0x40 [ 9419.305306][ C0] start_kernel+0x314/0x3d0 [ 9419.305310][ C0] x86_64_start_reservations+0x18/0x30 [ 9419.305314][ C0] x86_64_start_kernel+0xba/0x110 [ 9419.305318][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9419.305325][ C0] [ 9419.305628][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9419.359473][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9419.360122][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 9419.360424][ C1] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 9419.361448][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [ 9419.361769][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9419.362186][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9419.362604][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9419.363021][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9419.363438][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9419.363854][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9419.364334][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9419.364683][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9419.365100][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9419.365521][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9419.365943][ C1] Call Trace: [ 9419.366124][ C1] [ 9419.366282][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9419.366569][ C1] ? print_cpu_stall+0x263/0x6a0 [ 9419.366836][ C1] ? check_cpu_stall+0x284/0x500 [ 9419.367098][ C1] ? rcu_pending+0x92/0x360 [ 9419.367341][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9419.367627][ C1] ? update_process_times+0xb9/0x110 [ 9419.367909][ C1] ? tick_sched_handle+0x67/0x130 [ 9419.368182][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9419.368483][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9419.368742][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9419.369074][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9419.369359][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9419.369660][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9419.369937][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9419.370259][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9419.370534][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9419.370864][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9419.371177][ C1] [ 9419.371333][ C1] [ 9419.371489][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9419.371816][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9419.372124][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 9419.372420][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 9419.372715][ C1] ? run_ksoftirqd+0xb/0x60 [ 9419.372962][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9419.373296][ C1] ? __orc_find+0x9c/0xf0 [ 9419.373524][ C1] ? lock_acquire+0x1c1/0x220 [ 9419.373776][ C1] ? irqentry_enter+0x2b/0x60 [ 9419.374028][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9419.374286][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9419.374571][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9419.374867][ C1] ? lock_acquire+0x1c1/0x220 [ 9419.375118][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9419.375373][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9419.375647][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9419.375893][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9419.376152][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9419.376420][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9419.376707][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9419.376995][ C1] ip_local_deliver+0x19d/0x480 [ 9419.377259][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9419.377547][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9419.377814][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9419.378090][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9419.378351][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9419.378689][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9419.378962][ C1] ip_rcv+0x564/0x740 [ 9419.379173][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9419.379413][ C1] ? set_track_prepare+0x8a/0xd0 [ 9419.379676][ C1] ? irqentry_enter+0x2b/0x60 [ 9419.379927][ C1] ? irqentry_enter+0x2b/0x60 [ 9419.380179][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9419.380422][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9419.380745][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9419.381082][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9419.381388][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9419.381729][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9419.382030][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9419.382360][ C1] netif_receive_skb+0x55/0x280 [ 9419.382621][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9419.382947][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9419.383294][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9419.383609][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9419.383895][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9419.384197][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9419.384521][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9419.384799][ C1] ? arch_stack_walk+0x68/0x100 [ 9419.385062][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9419.385340][ C1] ? irqentry_enter+0x2b/0x60 [ 9419.385592][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9419.385915][ C1] ? irqentry_enter+0x2b/0x60 [ 9419.386166][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9419.386486][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9419.386768][ C1] ? arch_stack_walk+0x68/0x100 [ 9419.387026][ C1] __tcf_classify+0x32c/0x7d0 [ 9419.387279][ C1] tcf_classify+0x283/0x930 [ 9419.387519][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9419.387786][ C1] tc_run+0x2e4/0x5d0 [ 9419.388000][ C1] ? __pfx_tc_run+0x10/0x10 [ 9419.388242][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9419.388507][ C1] ? irqentry_enter+0x2b/0x60 [ 9419.388758][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9419.389043][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9419.389368][ C1] ip_finish_output2+0x786/0x18e0 [ 9419.389638][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9419.389925][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9419.390193][ C1] ? __ip_finish_output+0x10f/0x770 [ 9419.390469][ C1] ip_output+0x16b/0x4f0 [ 9419.390704][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9419.391023][ C1] ? __pfx_ip_output+0x10/0x10 [ 9419.391281][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9419.391631][ C1] ? __pfx_ip_output+0x10/0x10 [ 9419.391884][ C1] __ip_queue_xmit+0x672/0x1910 [ 9419.392151][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9419.392433][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9419.392732][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9419.393022][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9419.393320][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9419.393607][ C1] tcp_delack_timer+0x84/0x240 [ 9419.393865][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9419.394148][ C1] call_timer_fn+0x176/0x430 [ 9419.394393][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9419.394668][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9419.394943][ C1] __run_timers.part.0+0x52d/0x890 [ 9419.395213][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9419.395502][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9419.395802][ C1] ? __pfx___schedule+0x10/0x10 [ 9419.396062][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9419.396384][ C1] run_timer_softirq+0x72/0x100 [ 9419.396645][ C1] __do_softirq+0x1bc/0x7ff [ 9419.396891][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9419.397167][ C1] run_ksoftirqd+0x2e/0x60 [ 9419.397404][ C1] smpboot_thread_fn+0x30e/0x840 [ 9419.397672][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9419.397962][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9419.398258][ C1] kthread+0x292/0x360 [ 9419.398474][ C1] ? __pfx_kthread+0x10/0x10 [ 9419.398721][ C1] ret_from_fork+0x34/0x70 [ 9419.398956][ C1] ? __pfx_kthread+0x10/0x10 [ 9419.399204][ C1] ret_from_fork_asm+0x1b/0x30 [ 9419.399463][ C1] [ 9444.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7689s! [swapper/0:0] [ 9444.527918][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9444.529112][ C0] irq event stamp: 27567077 [ 9444.529353][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9444.529881][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9444.530362][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9444.530873][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9444.531365][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9444.531842][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9444.532491][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9444.532834][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9444.533857][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9444.534182][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9444.534604][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9444.535028][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9444.535446][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9444.535865][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9444.536290][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9444.536764][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9444.537113][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9444.537538][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9444.537956][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9444.538373][ C0] Call Trace: [ 9444.538549][ C0] [ 9444.538705][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9444.538983][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9444.539239][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9444.539531][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9444.539815][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9444.540115][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9444.540391][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9444.540720][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9444.540991][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9444.541269][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9444.541591][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9444.541902][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9444.542237][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9444.542538][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9444.542846][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9444.543152][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9444.543481][ C0] ? get_stack_info+0x36/0xc0 [ 9444.543730][ C0] ? lock_acquire+0x1c1/0x220 [ 9444.543979][ C0] ? lock_release+0x1d5/0x250 [ 9444.544228][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9444.544485][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9444.544766][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9444.545063][ C0] ? lock_acquire+0x1c1/0x220 [ 9444.545317][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9444.545572][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9444.545844][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9444.546087][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9444.546341][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9444.546606][ C0] ? __inet_lookup_established+0x341/0x610 [ 9444.546918][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9444.547206][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9444.547497][ C0] ip_local_deliver+0x19d/0x480 [ 9444.547753][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9444.548036][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9444.548297][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9444.548579][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9444.548843][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9444.549175][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9444.549452][ C0] ip_rcv+0x564/0x740 [ 9444.549665][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9444.549908][ C0] ? set_track_prepare+0x8a/0xd0 [ 9444.550173][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9444.550456][ C0] ? rest_init+0x153/0x260 [ 9444.550698][ C0] ? skb_clone+0x10b/0x330 [ 9444.550936][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9444.551266][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9444.551579][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9444.551873][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9444.552184][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9444.552443][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9444.552689][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9444.553003][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9444.553303][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9444.553640][ C0] ? lock_acquire+0x1c1/0x220 [ 9444.553889][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9444.554200][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9444.554500][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9444.554829][ C0] ? __copy_skb_header+0xaf/0x490 [ 9444.555095][ C0] ? __skb_clone+0x57a/0x760 [ 9444.555338][ C0] netif_receive_skb+0x55/0x280 [ 9444.555596][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9444.555926][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9444.556275][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9444.556590][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9444.556879][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9444.557181][ C0] ? hlock_class+0x4e/0x130 [ 9444.557428][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9444.557758][ C0] ? place_entity+0x21/0x2f0 [ 9444.558005][ C0] ? resched_curr+0x219/0x280 [ 9444.558252][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9444.558517][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9444.558797][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9444.559076][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9444.559338][ C0] ? activate_task+0xf5/0x260 [ 9444.559591][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9444.559865][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9444.560135][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9444.560395][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9444.560688][ C0] ? get_stack_info+0x36/0xc0 [ 9444.560939][ C0] ? stack_access_ok+0xda/0x1f0 [ 9444.561199][ C0] ? get_reg+0x119/0x190 [ 9444.561429][ C0] __tcf_classify+0x32c/0x7d0 [ 9444.561678][ C0] tcf_classify+0x283/0x930 [ 9444.561918][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9444.562245][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9444.562513][ C0] ? arch_stack_walk+0x8c/0x100 [ 9444.562774][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9444.563067][ C0] tc_run+0x2e4/0x5d0 [ 9444.563283][ C0] ? __pfx_tc_run+0x10/0x10 [ 9444.563524][ C0] ? lock_acquire+0x1c1/0x220 [ 9444.563772][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9444.564043][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9444.564310][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9444.564594][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9444.564868][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9444.565183][ C0] ? neigh_hh_output+0x348/0x590 [ 9444.565446][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9444.565719][ C0] ip_finish_output2+0x786/0x18e0 [ 9444.565984][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9444.566277][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9444.566629][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9444.566918][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9444.567182][ C0] ? __ip_finish_output+0x10f/0x770 [ 9444.567459][ C0] ip_output+0x16b/0x4f0 [ 9444.567691][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9444.567969][ C0] ? __pfx_ip_output+0x10/0x10 [ 9444.568225][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9444.568522][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9444.568789][ C0] ? ip_local_out+0x114/0x3b0 [ 9444.569039][ C0] __ip_queue_xmit+0x672/0x1910 [ 9444.569297][ C0] ? __skb_clone+0x57a/0x760 [ 9444.569539][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9444.569821][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9444.570117][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9444.570441][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9444.570702][ C0] ? tcp_current_mss+0x40a/0x510 [ 9444.570963][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9444.571246][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9444.571521][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9444.571774][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9444.572044][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9444.572365][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9444.572640][ C0] ? ktime_get+0xb6/0x190 [ 9444.572868][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9444.573140][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9444.573421][ C0] tcp_write_timer+0x82/0x1d0 [ 9444.573671][ C0] call_timer_fn+0x176/0x430 [ 9444.573918][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9444.574194][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9444.574464][ C0] __run_timers.part.0+0x52d/0x890 [ 9444.574737][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9444.575018][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9444.575319][ C0] ? lock_acquire+0x1c1/0x220 [ 9444.575568][ C0] ? clockevents_program_event+0xf6/0x300 [ 9444.575869][ C0] ? lock_release+0x1d5/0x250 [ 9444.576117][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9444.576390][ C0] ? ktime_get+0xb6/0x190 [ 9444.576618][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9444.576913][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9444.577228][ C0] run_timer_softirq+0x72/0x100 [ 9444.577488][ C0] __do_softirq+0x1bc/0x7ff [ 9444.577731][ C0] irq_exit_rcu+0x98/0xc0 [ 9444.577958][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9444.578257][ C0] [ 9444.578415][ C0] [ 9444.578573][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9444.578890][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9444.579158][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9444.580171][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9444.580491][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9444.580923][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9444.581345][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9444.581764][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9444.582187][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9444.582612][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9444.582916][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9444.583192][ C0] default_idle_call+0x69/0xa0 [ 9444.583445][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9444.583707][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9444.583995][ C0] ? lock_release+0x1d5/0x250 [ 9444.584250][ C0] do_idle+0xfb/0x160 [ 9444.584468][ C0] cpu_startup_entry+0x55/0x60 [ 9444.584725][ C0] rest_init+0x153/0x260 [ 9444.584949][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9444.585240][ C0] arch_call_rest_init+0x13/0x40 [ 9444.585509][ C0] start_kernel+0x314/0x3d0 [ 9444.585751][ C0] x86_64_start_reservations+0x18/0x30 [ 9444.586043][ C0] x86_64_start_kernel+0xba/0x110 [ 9444.586314][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9444.586648][ C0] [ 9444.586813][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7689s! [ksoftirqd/1:22] [ 9444.587280][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9444.588464][ C1] irq event stamp: 3886976 [ 9444.588700][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9444.589201][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9444.589699][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9444.590200][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9444.590695][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9444.591185][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9444.591828][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9444.592169][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9444.593183][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9444.593506][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9444.593923][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9444.594340][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9444.594762][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9444.595180][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9444.595597][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9444.596065][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9444.596417][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9444.596840][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9444.597261][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9444.597683][ C1] Call Trace: [ 9444.597867][ C1] [ 9444.598022][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9444.598296][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9444.598551][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9444.598840][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9444.599128][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9444.599432][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9444.599715][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9444.600037][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9444.600310][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9444.600645][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9444.600954][ C1] [ 9444.601114][ C1] [ 9444.601272][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9444.601608][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9444.601909][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9444.602218][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9444.602522][ C1] ? run_ksoftirqd+0xb/0x60 [ 9444.602767][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9444.603098][ C1] ? __orc_find+0x9c/0xf0 [ 9444.603327][ C1] ? lock_acquire+0x1c1/0x220 [ 9444.603577][ C1] ? irqentry_enter+0x2b/0x60 [ 9444.603829][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9444.604089][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9444.604373][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9444.604670][ C1] ? lock_acquire+0x1c1/0x220 [ 9444.604921][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9444.605176][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9444.605451][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9444.605698][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9444.605956][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9444.606226][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9444.606511][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9444.606799][ C1] ip_local_deliver+0x19d/0x480 [ 9444.607064][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9444.607352][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9444.607618][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9444.607894][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9444.608156][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9444.608495][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9444.608769][ C1] ip_rcv+0x564/0x740 [ 9444.608980][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9444.609221][ C1] ? set_track_prepare+0x8a/0xd0 [ 9444.609484][ C1] ? irqentry_enter+0x2b/0x60 [ 9444.609737][ C1] ? irqentry_enter+0x2b/0x60 [ 9444.609990][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9444.610234][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9444.610561][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9444.610899][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9444.611207][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9444.611549][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9444.611851][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9444.612183][ C1] netif_receive_skb+0x55/0x280 [ 9444.612442][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9444.612769][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9444.613115][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9444.613430][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9444.613717][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9444.614019][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9444.614345][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9444.614623][ C1] ? arch_stack_walk+0x68/0x100 [ 9444.614886][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9444.615165][ C1] ? irqentry_enter+0x2b/0x60 [ 9444.615416][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9444.615740][ C1] ? irqentry_enter+0x2b/0x60 [ 9444.615990][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9444.616311][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9444.616592][ C1] ? arch_stack_walk+0x68/0x100 [ 9444.616850][ C1] __tcf_classify+0x32c/0x7d0 [ 9444.617102][ C1] tcf_classify+0x283/0x930 [ 9444.617348][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9444.617615][ C1] tc_run+0x2e4/0x5d0 [ 9444.617828][ C1] ? __pfx_tc_run+0x10/0x10 [ 9444.618071][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9444.618335][ C1] ? irqentry_enter+0x2b/0x60 [ 9444.618587][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9444.618883][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9444.619209][ C1] ip_finish_output2+0x786/0x18e0 [ 9444.619478][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9444.619765][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9444.620033][ C1] ? __ip_finish_output+0x10f/0x770 [ 9444.620310][ C1] ip_output+0x16b/0x4f0 [ 9444.620545][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9444.620864][ C1] ? __pfx_ip_output+0x10/0x10 [ 9444.621123][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9444.621472][ C1] ? __pfx_ip_output+0x10/0x10 [ 9444.621726][ C1] __ip_queue_xmit+0x672/0x1910 [ 9444.622002][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9444.622292][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9444.622593][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9444.622883][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9444.623181][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9444.623468][ C1] tcp_delack_timer+0x84/0x240 [ 9444.623724][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9444.624007][ C1] call_timer_fn+0x176/0x430 [ 9444.624253][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9444.624529][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9444.624804][ C1] __run_timers.part.0+0x52d/0x890 [ 9444.625076][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9444.625365][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9444.625665][ C1] ? __pfx___schedule+0x10/0x10 [ 9444.625924][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9444.626242][ C1] run_timer_softirq+0x72/0x100 [ 9444.626503][ C1] __do_softirq+0x1bc/0x7ff [ 9444.626748][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9444.627023][ C1] run_ksoftirqd+0x2e/0x60 [ 9444.627261][ C1] smpboot_thread_fn+0x30e/0x840 [ 9444.627530][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9444.627819][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9444.628110][ C1] kthread+0x292/0x360 [ 9444.628327][ C1] ? __pfx_kthread+0x10/0x10 [ 9444.628575][ C1] ret_from_fork+0x34/0x70 [ 9444.628811][ C1] ? __pfx_kthread+0x10/0x10 [ 9444.629059][ C1] ret_from_fork_asm+0x1b/0x30 [ 9444.629320][ C1] [ 9472.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7715s! [swapper/0:0] [ 9472.527925][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9472.529114][ C0] irq event stamp: 27567077 [ 9472.529352][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9472.529881][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9472.530359][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9472.530869][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9472.531361][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9472.531840][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9472.532491][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9472.532835][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9472.533869][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9472.534201][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9472.534624][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9472.535048][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9472.535474][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9472.535903][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9472.536327][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9472.536797][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9472.537144][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9472.537565][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9472.537982][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9472.538402][ C0] Call Trace: [ 9472.538582][ C0] [ 9472.538737][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9472.539020][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9472.539275][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9472.539569][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9472.539853][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9472.540156][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9472.540441][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9472.540768][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9472.541044][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9472.541324][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9472.541647][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9472.541960][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9472.542294][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9472.542599][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9472.542907][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9472.543216][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9472.543547][ C0] ? get_stack_info+0x36/0xc0 [ 9472.543800][ C0] ? lock_acquire+0x1c1/0x220 [ 9472.544054][ C0] ? lock_release+0x1d5/0x250 [ 9472.544306][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9472.544568][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9472.544854][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9472.545153][ C0] ? lock_acquire+0x1c1/0x220 [ 9472.545404][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9472.545660][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9472.545941][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9472.546192][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9472.546451][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9472.546720][ C0] ? __inet_lookup_established+0x341/0x610 [ 9472.547032][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9472.547327][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9472.547621][ C0] ip_local_deliver+0x19d/0x480 [ 9472.547880][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9472.548168][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9472.548431][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9472.548713][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9472.548980][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9472.549317][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9472.549596][ C0] ip_rcv+0x564/0x740 [ 9472.549815][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9472.550061][ C0] ? set_track_prepare+0x8a/0xd0 [ 9472.550331][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9472.550630][ C0] ? rest_init+0x153/0x260 [ 9472.550867][ C0] ? skb_clone+0x10b/0x330 [ 9472.551110][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9472.551444][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9472.551764][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9472.552067][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9472.552379][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9472.552642][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9472.552889][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9472.553211][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9472.553514][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9472.553853][ C0] ? lock_acquire+0x1c1/0x220 [ 9472.554100][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9472.554409][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9472.554712][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9472.555044][ C0] ? __copy_skb_header+0xaf/0x490 [ 9472.555312][ C0] ? __skb_clone+0x57a/0x760 [ 9472.555558][ C0] netif_receive_skb+0x55/0x280 [ 9472.555824][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9472.556155][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9472.556512][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9472.556825][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9472.557117][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9472.557421][ C0] ? hlock_class+0x4e/0x130 [ 9472.557671][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9472.558005][ C0] ? place_entity+0x21/0x2f0 [ 9472.558256][ C0] ? resched_curr+0x219/0x280 [ 9472.558512][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9472.558779][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9472.559059][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9472.559340][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9472.559600][ C0] ? activate_task+0xf5/0x260 [ 9472.559854][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9472.560134][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9472.560409][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9472.560670][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9472.560963][ C0] ? get_stack_info+0x36/0xc0 [ 9472.561223][ C0] ? stack_access_ok+0xda/0x1f0 [ 9472.561485][ C0] ? get_reg+0x119/0x190 [ 9472.561715][ C0] __tcf_classify+0x32c/0x7d0 [ 9472.561967][ C0] tcf_classify+0x283/0x930 [ 9472.562209][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9472.562536][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9472.562807][ C0] ? arch_stack_walk+0x8c/0x100 [ 9472.563073][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9472.563366][ C0] tc_run+0x2e4/0x5d0 [ 9472.563580][ C0] ? __pfx_tc_run+0x10/0x10 [ 9472.563820][ C0] ? lock_acquire+0x1c1/0x220 [ 9472.564069][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9472.564345][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9472.564614][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9472.564898][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9472.565176][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9472.565496][ C0] ? neigh_hh_output+0x348/0x590 [ 9472.565768][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9472.566048][ C0] ip_finish_output2+0x786/0x18e0 [ 9472.566317][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9472.566609][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9472.566969][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9472.567263][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9472.567528][ C0] ? __ip_finish_output+0x10f/0x770 [ 9472.567809][ C0] ip_output+0x16b/0x4f0 [ 9472.568038][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9472.568322][ C0] ? __pfx_ip_output+0x10/0x10 [ 9472.568582][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9472.568881][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9472.569150][ C0] ? ip_local_out+0x114/0x3b0 [ 9472.569398][ C0] __ip_queue_xmit+0x672/0x1910 [ 9472.569658][ C0] ? __skb_clone+0x57a/0x760 [ 9472.569904][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9472.570189][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9472.570491][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9472.570810][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9472.571070][ C0] ? tcp_current_mss+0x40a/0x510 [ 9472.571335][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9472.571620][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9472.571895][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9472.572146][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9472.572423][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9472.572743][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9472.573018][ C0] ? ktime_get+0xb6/0x190 [ 9472.573250][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9472.573524][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9472.573809][ C0] tcp_write_timer+0x82/0x1d0 [ 9472.574058][ C0] call_timer_fn+0x176/0x430 [ 9472.574304][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9472.574581][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9472.574860][ C0] __run_timers.part.0+0x52d/0x890 [ 9472.575137][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9472.575419][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9472.575719][ C0] ? lock_acquire+0x1c1/0x220 [ 9472.575966][ C0] ? clockevents_program_event+0xf6/0x300 [ 9472.576272][ C0] ? lock_release+0x1d5/0x250 [ 9472.576522][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9472.576799][ C0] ? ktime_get+0xb6/0x190 [ 9472.577030][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9472.577330][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9472.577644][ C0] run_timer_softirq+0x72/0x100 [ 9472.577901][ C0] __do_softirq+0x1bc/0x7ff [ 9472.578143][ C0] irq_exit_rcu+0x98/0xc0 [ 9472.578375][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9472.578674][ C0] [ 9472.578835][ C0] [ 9472.578995][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9472.579323][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9472.579592][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9472.580619][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9472.580946][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9472.581369][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9472.581794][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9472.582219][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9472.582640][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9472.583063][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9472.583371][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9472.583646][ C0] default_idle_call+0x69/0xa0 [ 9472.583899][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9472.584167][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9472.584459][ C0] ? lock_release+0x1d5/0x250 [ 9472.584714][ C0] do_idle+0xfb/0x160 [ 9472.584929][ C0] cpu_startup_entry+0x55/0x60 [ 9472.585188][ C0] rest_init+0x153/0x260 [ 9472.585414][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9472.585705][ C0] arch_call_rest_init+0x13/0x40 [ 9472.585973][ C0] start_kernel+0x314/0x3d0 [ 9472.586215][ C0] x86_64_start_reservations+0x18/0x30 [ 9472.586505][ C0] x86_64_start_kernel+0xba/0x110 [ 9472.586778][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9472.587108][ C0] [ 9472.587278][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7715s! [ksoftirqd/1:22] [ 9472.587739][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9472.588939][ C1] irq event stamp: 3886976 [ 9472.589177][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9472.589671][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9472.590164][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9472.590671][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9472.591161][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9472.591661][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9472.592308][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9472.592654][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9472.593690][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9472.594018][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9472.594444][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9472.594864][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9472.595284][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9472.595703][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9472.596125][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9472.596595][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9472.596948][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9472.597373][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9472.597800][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9472.598224][ C1] Call Trace: [ 9472.598403][ C1] [ 9472.598563][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9472.598841][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9472.599099][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9472.599389][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9472.599678][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9472.599983][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9472.600265][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9472.600602][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9472.600879][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9472.601199][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9472.601510][ C1] [ 9472.601670][ C1] [ 9472.601833][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9472.602165][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9472.602469][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9472.602779][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9472.603088][ C1] ? run_ksoftirqd+0xb/0x60 [ 9472.603335][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9472.603663][ C1] ? __orc_find+0x9c/0xf0 [ 9472.603894][ C1] ? lock_acquire+0x1c1/0x220 [ 9472.604145][ C1] ? irqentry_enter+0x2b/0x60 [ 9472.604397][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9472.604655][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9472.604938][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9472.605237][ C1] ? lock_acquire+0x1c1/0x220 [ 9472.605492][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9472.605749][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9472.606024][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9472.606269][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9472.606526][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9472.606798][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9472.607089][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9472.607381][ C1] ip_local_deliver+0x19d/0x480 [ 9472.607643][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9472.607931][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9472.608199][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9472.608478][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9472.608743][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9472.609084][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9472.609359][ C1] ip_rcv+0x564/0x740 [ 9472.609575][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9472.609817][ C1] ? set_track_prepare+0x8a/0xd0 [ 9472.610084][ C1] ? irqentry_enter+0x2b/0x60 [ 9472.610341][ C1] ? irqentry_enter+0x2b/0x60 [ 9472.610604][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9472.610844][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9472.611160][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9472.611500][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9472.611809][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9472.612155][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9472.612457][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9472.612791][ C1] netif_receive_skb+0x55/0x280 [ 9472.613050][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9472.613378][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9472.613727][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9472.614046][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9472.614335][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9472.614640][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9472.614969][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9472.615251][ C1] ? arch_stack_walk+0x68/0x100 [ 9472.615519][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9472.615799][ C1] ? irqentry_enter+0x2b/0x60 [ 9472.616055][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9472.616376][ C1] ? irqentry_enter+0x2b/0x60 [ 9472.616624][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9472.616944][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9472.617228][ C1] ? arch_stack_walk+0x68/0x100 [ 9472.617488][ C1] __tcf_classify+0x32c/0x7d0 [ 9472.617738][ C1] tcf_classify+0x283/0x930 [ 9472.617980][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9472.618248][ C1] tc_run+0x2e4/0x5d0 [ 9472.618463][ C1] ? __pfx_tc_run+0x10/0x10 [ 9472.618705][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9472.618972][ C1] ? irqentry_enter+0x2b/0x60 [ 9472.619229][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9472.619519][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9472.619842][ C1] ip_finish_output2+0x786/0x18e0 [ 9472.620114][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9472.620409][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9472.620674][ C1] ? __ip_finish_output+0x10f/0x770 [ 9472.620955][ C1] ip_output+0x16b/0x4f0 [ 9472.621185][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9472.621501][ C1] ? __pfx_ip_output+0x10/0x10 [ 9472.621759][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9472.622114][ C1] ? __pfx_ip_output+0x10/0x10 [ 9472.622371][ C1] __ip_queue_xmit+0x672/0x1910 [ 9472.622635][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9472.622919][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9472.623217][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9472.623506][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9472.623804][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9472.624094][ C1] tcp_delack_timer+0x84/0x240 [ 9472.624354][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9472.624639][ C1] call_timer_fn+0x176/0x430 [ 9472.624888][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9472.625166][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9472.625445][ C1] __run_timers.part.0+0x52d/0x890 [ 9472.625717][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9472.626008][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9472.626313][ C1] ? __pfx___schedule+0x10/0x10 [ 9472.626574][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9472.626895][ C1] run_timer_softirq+0x72/0x100 [ 9472.627158][ C1] __do_softirq+0x1bc/0x7ff [ 9472.627407][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9472.627682][ C1] run_ksoftirqd+0x2e/0x60 [ 9472.627919][ C1] smpboot_thread_fn+0x30e/0x840 [ 9472.628187][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9472.628476][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9472.628771][ C1] kthread+0x292/0x360 [ 9472.628990][ C1] ? __pfx_kthread+0x10/0x10 [ 9472.629243][ C1] ret_from_fork+0x34/0x70 [ 9472.629486][ C1] ? __pfx_kthread+0x10/0x10 [ 9472.629733][ C1] ret_from_fork_asm+0x1b/0x30 [ 9472.629991][ C1] [ 9497.401024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9497.401411][ C1] rcu: 1-....: (8234281 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1973053 [ 9497.402001][ C1] rcu: (t=8303092 jiffies g=1007429 q=31 ncpus=4) [ 9497.402344][ C1] Sending NMI from CPU 1 to CPUs 0: [ 9497.402635][ C0] NMI backtrace for cpu 0 [ 9497.402645][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9497.402650][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9497.402652][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9497.402662][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9497.402666][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9497.402671][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9497.402673][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9497.402675][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9497.402677][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9497.402679][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9497.402681][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9497.402683][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9497.402687][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9497.402689][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9497.402690][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9497.402692][ C0] Call Trace: [ 9497.402695][ C0] [ 9497.402700][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 9497.402705][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9497.402710][ C0] ? nmi_handle+0x156/0x420 [ 9497.402715][ C0] ? default_do_nmi+0x41/0x100 [ 9497.402719][ C0] ? exc_nmi+0xf3/0x120 [ 9497.402722][ C0] ? end_repeat_nmi+0xf/0x60 [ 9497.402726][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9497.402730][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9497.402734][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9497.402737][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9497.402741][ C0] [ 9497.402742][ C0] [ 9497.402744][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9497.402747][ C0] ? get_stack_info+0x36/0xc0 [ 9497.402752][ C0] ? lock_acquire+0x1c1/0x220 [ 9497.402758][ C0] ? lock_release+0x1d5/0x250 [ 9497.402761][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9497.402765][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9497.402768][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9497.402771][ C0] ? lock_acquire+0x1c1/0x220 [ 9497.402773][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9497.402779][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9497.402782][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9497.402789][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9497.402792][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9497.402796][ C0] ? __inet_lookup_established+0x341/0x610 [ 9497.402801][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9497.402808][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9497.402812][ C0] ip_local_deliver+0x19d/0x480 [ 9497.402815][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9497.402818][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9497.402823][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9497.402827][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9497.402830][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9497.402834][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9497.402844][ C0] ip_rcv+0x564/0x740 [ 9497.402847][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9497.402850][ C0] ? set_track_prepare+0x8a/0xd0 [ 9497.402855][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9497.402857][ C0] ? rest_init+0x153/0x260 [ 9497.402860][ C0] ? skb_clone+0x10b/0x330 [ 9497.402866][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9497.402872][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9497.402877][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9497.402881][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9497.402890][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9497.402893][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9497.402896][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9497.402901][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9497.402904][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9497.402907][ C0] ? lock_acquire+0x1c1/0x220 [ 9497.402909][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9497.402913][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9497.402916][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9497.402919][ C0] ? __copy_skb_header+0xaf/0x490 [ 9497.402922][ C0] ? __skb_clone+0x57a/0x760 [ 9497.402925][ C0] netif_receive_skb+0x55/0x280 [ 9497.402928][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9497.402936][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9497.402943][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9497.402950][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9497.402956][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9497.402964][ C0] ? hlock_class+0x4e/0x130 [ 9497.402970][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9497.402980][ C0] ? place_entity+0x21/0x2f0 [ 9497.402985][ C0] ? resched_curr+0x219/0x280 [ 9497.402989][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9497.402992][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9497.402997][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9497.403002][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9497.403004][ C0] ? activate_task+0xf5/0x260 [ 9497.403007][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9497.403013][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9497.403016][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9497.403021][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9497.403024][ C0] ? get_stack_info+0x36/0xc0 [ 9497.403028][ C0] ? stack_access_ok+0xda/0x1f0 [ 9497.403030][ C0] ? get_reg+0x119/0x190 [ 9497.403034][ C0] __tcf_classify+0x32c/0x7d0 [ 9497.403039][ C0] tcf_classify+0x283/0x930 [ 9497.403042][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9497.403046][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9497.403048][ C0] ? arch_stack_walk+0x8c/0x100 [ 9497.403052][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9497.403056][ C0] tc_run+0x2e4/0x5d0 [ 9497.403060][ C0] ? __pfx_tc_run+0x10/0x10 [ 9497.403063][ C0] ? lock_acquire+0x1c1/0x220 [ 9497.403065][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9497.403070][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9497.403075][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9497.403078][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9497.403082][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9497.403087][ C0] ? neigh_hh_output+0x348/0x590 [ 9497.403091][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9497.403095][ C0] ip_finish_output2+0x786/0x18e0 [ 9497.403099][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9497.403106][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9497.403114][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9497.403117][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9497.403121][ C0] ? __ip_finish_output+0x10f/0x770 [ 9497.403125][ C0] ip_output+0x16b/0x4f0 [ 9497.403128][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9497.403134][ C0] ? __pfx_ip_output+0x10/0x10 [ 9497.403137][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9497.403142][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9497.403145][ C0] ? ip_local_out+0x114/0x3b0 [ 9497.403149][ C0] __ip_queue_xmit+0x672/0x1910 [ 9497.403153][ C0] ? __skb_clone+0x57a/0x760 [ 9497.403157][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9497.403164][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9497.403168][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9497.403173][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9497.403178][ C0] ? tcp_current_mss+0x40a/0x510 [ 9497.403180][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9497.403183][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9497.403186][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9497.403188][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9497.403191][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9497.403195][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9497.403199][ C0] ? ktime_get+0xb6/0x190 [ 9497.403203][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9497.403207][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9497.403211][ C0] tcp_write_timer+0x82/0x1d0 [ 9497.403215][ C0] call_timer_fn+0x176/0x430 [ 9497.403218][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9497.403223][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9497.403227][ C0] __run_timers.part.0+0x52d/0x890 [ 9497.403230][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9497.403235][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9497.403238][ C0] ? lock_acquire+0x1c1/0x220 [ 9497.403240][ C0] ? clockevents_program_event+0xf6/0x300 [ 9497.403245][ C0] ? lock_release+0x1d5/0x250 [ 9497.403247][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9497.403250][ C0] ? ktime_get+0xb6/0x190 [ 9497.403253][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9497.403257][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9497.403261][ C0] run_timer_softirq+0x72/0x100 [ 9497.403264][ C0] __do_softirq+0x1bc/0x7ff [ 9497.403269][ C0] irq_exit_rcu+0x98/0xc0 [ 9497.403272][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9497.403276][ C0] [ 9497.403277][ C0] [ 9497.403278][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9497.403284][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9497.403287][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9497.403290][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9497.403292][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9497.403294][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9497.403296][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9497.403297][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9497.403299][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9497.403303][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9497.403307][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9497.403311][ C0] default_idle_call+0x69/0xa0 [ 9497.403314][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9497.403316][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9497.403322][ C0] ? lock_release+0x1d5/0x250 [ 9497.403326][ C0] do_idle+0xfb/0x160 [ 9497.403329][ C0] cpu_startup_entry+0x55/0x60 [ 9497.403332][ C0] rest_init+0x153/0x260 [ 9497.403334][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9497.403341][ C0] arch_call_rest_init+0x13/0x40 [ 9497.403347][ C0] start_kernel+0x314/0x3d0 [ 9497.403351][ C0] x86_64_start_reservations+0x18/0x30 [ 9497.403357][ C0] x86_64_start_kernel+0xba/0x110 [ 9497.403360][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9497.403368][ C0] [ 9497.403632][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9497.403637][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9497.458065][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9497.458410][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9497.459418][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9497.459738][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9497.460156][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9497.460579][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9497.460995][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9497.461413][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9497.461832][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9497.462298][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9497.462643][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9497.463066][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9497.463480][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9497.463892][ C1] Call Trace: [ 9497.464067][ C1] [ 9497.464220][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9497.464506][ C1] ? print_cpu_stall+0x263/0x6a0 [ 9497.464766][ C1] ? check_cpu_stall+0x284/0x500 [ 9497.465031][ C1] ? rcu_pending+0x92/0x360 [ 9497.465270][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9497.465553][ C1] ? update_process_times+0xb9/0x110 [ 9497.465835][ C1] ? tick_sched_handle+0x67/0x130 [ 9497.466102][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9497.466397][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9497.466651][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9497.466972][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9497.467258][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9497.467562][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9497.467841][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9497.468161][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9497.468433][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9497.468755][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9497.469067][ C1] [ 9497.469221][ C1] [ 9497.469376][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9497.469703][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9497.470005][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9497.470324][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9497.470628][ C1] ? run_ksoftirqd+0xb/0x60 [ 9497.470872][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9497.471198][ C1] ? __orc_find+0x9c/0xf0 [ 9497.471425][ C1] ? lock_acquire+0x1c1/0x220 [ 9497.471671][ C1] ? irqentry_enter+0x2b/0x60 [ 9497.471918][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9497.472176][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9497.472458][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9497.472753][ C1] ? lock_acquire+0x1c1/0x220 [ 9497.473002][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9497.473255][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9497.473528][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9497.473769][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9497.474026][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9497.474300][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9497.474586][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9497.474872][ C1] ip_local_deliver+0x19d/0x480 [ 9497.475132][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9497.475418][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9497.475684][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9497.475960][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9497.476223][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9497.476559][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9497.476832][ C1] ip_rcv+0x564/0x740 [ 9497.477045][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9497.477286][ C1] ? set_track_prepare+0x8a/0xd0 [ 9497.477550][ C1] ? irqentry_enter+0x2b/0x60 [ 9497.477800][ C1] ? irqentry_enter+0x2b/0x60 [ 9497.478052][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9497.478297][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9497.478611][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9497.478953][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9497.479267][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9497.479601][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9497.479895][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9497.480228][ C1] netif_receive_skb+0x55/0x280 [ 9497.480493][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9497.480816][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9497.481161][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9497.481473][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9497.481759][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9497.482057][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9497.482381][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9497.482657][ C1] ? arch_stack_walk+0x68/0x100 [ 9497.482918][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9497.483197][ C1] ? irqentry_enter+0x2b/0x60 [ 9497.483449][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9497.483770][ C1] ? irqentry_enter+0x2b/0x60 [ 9497.484022][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9497.484338][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9497.484617][ C1] ? arch_stack_walk+0x68/0x100 [ 9497.484871][ C1] __tcf_classify+0x32c/0x7d0 [ 9497.485118][ C1] tcf_classify+0x283/0x930 [ 9497.485355][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9497.485620][ C1] tc_run+0x2e4/0x5d0 [ 9497.485834][ C1] ? __pfx_tc_run+0x10/0x10 [ 9497.486077][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9497.486347][ C1] ? irqentry_enter+0x2b/0x60 [ 9497.486598][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9497.486884][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9497.487207][ C1] ip_finish_output2+0x786/0x18e0 [ 9497.487475][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9497.487760][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9497.488025][ C1] ? __ip_finish_output+0x10f/0x770 [ 9497.488298][ C1] ip_output+0x16b/0x4f0 [ 9497.488523][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9497.488842][ C1] ? __pfx_ip_output+0x10/0x10 [ 9497.489098][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9497.489448][ C1] ? __pfx_ip_output+0x10/0x10 [ 9497.489703][ C1] __ip_queue_xmit+0x672/0x1910 [ 9497.489961][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9497.490239][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9497.490536][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9497.490823][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9497.491122][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9497.491409][ C1] tcp_delack_timer+0x84/0x240 [ 9497.491665][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9497.491949][ C1] call_timer_fn+0x176/0x430 [ 9497.492196][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9497.492470][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9497.492743][ C1] __run_timers.part.0+0x52d/0x890 [ 9497.493013][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9497.493302][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9497.493608][ C1] ? __pfx___schedule+0x10/0x10 [ 9497.493863][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9497.494178][ C1] run_timer_softirq+0x72/0x100 [ 9497.494437][ C1] __do_softirq+0x1bc/0x7ff [ 9497.494681][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9497.494955][ C1] run_ksoftirqd+0x2e/0x60 [ 9497.495190][ C1] smpboot_thread_fn+0x30e/0x840 [ 9497.495456][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9497.495746][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9497.496036][ C1] kthread+0x292/0x360 [ 9497.496250][ C1] ? __pfx_kthread+0x10/0x10 [ 9497.496496][ C1] ret_from_fork+0x34/0x70 [ 9497.496733][ C1] ? __pfx_kthread+0x10/0x10 [ 9497.496979][ C1] ret_from_fork_asm+0x1b/0x30 [ 9497.497241][ C1] [ 9524.527462][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7764s! [swapper/0:0] [ 9524.527933][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9524.529141][ C0] irq event stamp: 27567077 [ 9524.529385][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9524.529917][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9524.530406][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9524.530916][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9524.531413][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9524.531898][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9524.532541][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9524.532880][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9524.533898][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9524.534226][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9524.534643][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9524.535060][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9524.535476][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9524.535896][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9524.536316][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9524.536785][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9524.537139][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9524.537562][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9524.537987][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9524.538410][ C0] Call Trace: [ 9524.538589][ C0] [ 9524.538750][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9524.539025][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9524.539285][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9524.539576][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9524.539869][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9524.540183][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9524.540460][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9524.540782][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9524.541059][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9524.541336][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9524.541671][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9524.541988][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9524.542320][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9524.542625][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9524.542938][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9524.543240][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9524.543562][ C0] ? get_stack_info+0x36/0xc0 [ 9524.543820][ C0] ? lock_acquire+0x1c1/0x220 [ 9524.544077][ C0] ? lock_release+0x1d5/0x250 [ 9524.544329][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9524.544591][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9524.544879][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9524.545181][ C0] ? lock_acquire+0x1c1/0x220 [ 9524.545433][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9524.545685][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9524.545957][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9524.546209][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9524.546474][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9524.546744][ C0] ? __inet_lookup_established+0x341/0x610 [ 9524.547068][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9524.547355][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9524.547643][ C0] ip_local_deliver+0x19d/0x480 [ 9524.547905][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9524.548195][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9524.548466][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9524.548742][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9524.549003][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9524.549342][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9524.549616][ C0] ip_rcv+0x564/0x740 [ 9524.549830][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9524.550071][ C0] ? set_track_prepare+0x8a/0xd0 [ 9524.550347][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9524.550635][ C0] ? rest_init+0x153/0x260 [ 9524.550874][ C0] ? skb_clone+0x10b/0x330 [ 9524.551115][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9524.551452][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9524.551775][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9524.552068][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9524.552375][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9524.552633][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9524.552873][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9524.553186][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9524.553485][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9524.553826][ C0] ? lock_acquire+0x1c1/0x220 [ 9524.554079][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9524.554392][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9524.554691][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9524.555034][ C0] ? __copy_skb_header+0xaf/0x490 [ 9524.555302][ C0] ? __skb_clone+0x57a/0x760 [ 9524.555549][ C0] netif_receive_skb+0x55/0x280 [ 9524.555803][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9524.556130][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9524.556479][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9524.556796][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9524.557084][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9524.557382][ C0] ? hlock_class+0x4e/0x130 [ 9524.557624][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9524.557951][ C0] ? place_entity+0x21/0x2f0 [ 9524.558202][ C0] ? resched_curr+0x219/0x280 [ 9524.558457][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9524.558727][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9524.559010][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9524.559286][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9524.559547][ C0] ? activate_task+0xf5/0x260 [ 9524.559798][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9524.560073][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9524.560353][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9524.560612][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9524.560902][ C0] ? get_stack_info+0x36/0xc0 [ 9524.561151][ C0] ? stack_access_ok+0xda/0x1f0 [ 9524.561407][ C0] ? get_reg+0x119/0x190 [ 9524.561636][ C0] __tcf_classify+0x32c/0x7d0 [ 9524.561888][ C0] tcf_classify+0x283/0x930 [ 9524.562132][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9524.562463][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9524.562727][ C0] ? arch_stack_walk+0x8c/0x100 [ 9524.562994][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9524.563286][ C0] tc_run+0x2e4/0x5d0 [ 9524.563506][ C0] ? __pfx_tc_run+0x10/0x10 [ 9524.563753][ C0] ? lock_acquire+0x1c1/0x220 [ 9524.564007][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9524.564284][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9524.564550][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9524.564839][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9524.565120][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9524.565447][ C0] ? neigh_hh_output+0x348/0x590 [ 9524.565710][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9524.565995][ C0] ip_finish_output2+0x786/0x18e0 [ 9524.566268][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9524.566563][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9524.566920][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9524.567209][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9524.567478][ C0] ? __ip_finish_output+0x10f/0x770 [ 9524.567761][ C0] ip_output+0x16b/0x4f0 [ 9524.567987][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9524.568271][ C0] ? __pfx_ip_output+0x10/0x10 [ 9524.568522][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9524.568823][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9524.569086][ C0] ? ip_local_out+0x114/0x3b0 [ 9524.569338][ C0] __ip_queue_xmit+0x672/0x1910 [ 9524.569598][ C0] ? __skb_clone+0x57a/0x760 [ 9524.569845][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9524.570131][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9524.570428][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9524.570748][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9524.571005][ C0] ? tcp_current_mss+0x40a/0x510 [ 9524.571274][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9524.571552][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9524.571833][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9524.572089][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9524.572353][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9524.572675][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9524.572955][ C0] ? ktime_get+0xb6/0x190 [ 9524.573188][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9524.573463][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9524.573741][ C0] tcp_write_timer+0x82/0x1d0 [ 9524.573993][ C0] call_timer_fn+0x176/0x430 [ 9524.574247][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9524.574520][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9524.574798][ C0] __run_timers.part.0+0x52d/0x890 [ 9524.575070][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9524.575359][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9524.575657][ C0] ? lock_acquire+0x1c1/0x220 [ 9524.575909][ C0] ? clockevents_program_event+0xf6/0x300 [ 9524.576218][ C0] ? lock_release+0x1d5/0x250 [ 9524.576471][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9524.576750][ C0] ? ktime_get+0xb6/0x190 [ 9524.576982][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9524.577282][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9524.577594][ C0] run_timer_softirq+0x72/0x100 [ 9524.577863][ C0] __do_softirq+0x1bc/0x7ff [ 9524.578112][ C0] irq_exit_rcu+0x98/0xc0 [ 9524.578343][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9524.578644][ C0] [ 9524.578801][ C0] [ 9524.578957][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9524.579283][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9524.579555][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9524.580585][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9524.580907][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9524.581323][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9524.581751][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9524.582167][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9524.582587][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9524.583008][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9524.583309][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9524.583579][ C0] default_idle_call+0x69/0xa0 [ 9524.583835][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9524.584095][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9524.584390][ C0] ? lock_release+0x1d5/0x250 [ 9524.584645][ C0] do_idle+0xfb/0x160 [ 9524.584859][ C0] cpu_startup_entry+0x55/0x60 [ 9524.585114][ C0] rest_init+0x153/0x260 [ 9524.585340][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9524.585627][ C0] arch_call_rest_init+0x13/0x40 [ 9524.585891][ C0] start_kernel+0x314/0x3d0 [ 9524.586139][ C0] x86_64_start_reservations+0x18/0x30 [ 9524.586433][ C0] x86_64_start_kernel+0xba/0x110 [ 9524.586705][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9524.587027][ C0] [ 9524.587191][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7764s! [ksoftirqd/1:22] [ 9524.587659][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9524.588834][ C1] irq event stamp: 3886976 [ 9524.589066][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9524.589560][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9524.590050][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9524.590550][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9524.591037][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9524.591526][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9524.592161][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9524.592497][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9524.593507][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9524.593826][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9524.594239][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9524.594652][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9524.595063][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9524.595477][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9524.595889][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9524.596350][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9524.596701][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9524.597118][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9524.597533][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9524.597949][ C1] Call Trace: [ 9524.598130][ C1] [ 9524.598290][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9524.598562][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9524.598816][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9524.599103][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9524.599387][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9524.599690][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9524.599967][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9524.600292][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9524.600566][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9524.600885][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9524.601192][ C1] [ 9524.601349][ C1] [ 9524.601507][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9524.601837][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9524.602138][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9524.602445][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9524.602749][ C1] ? run_ksoftirqd+0xb/0x60 [ 9524.602994][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9524.603319][ C1] ? __orc_find+0x9c/0xf0 [ 9524.603547][ C1] ? lock_acquire+0x1c1/0x220 [ 9524.603796][ C1] ? irqentry_enter+0x2b/0x60 [ 9524.604043][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9524.604301][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9524.604583][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9524.604879][ C1] ? lock_acquire+0x1c1/0x220 [ 9524.605130][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9524.605384][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9524.605658][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9524.605905][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9524.606163][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9524.606433][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9524.606719][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9524.607005][ C1] ip_local_deliver+0x19d/0x480 [ 9524.607264][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9524.607551][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9524.607818][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9524.608095][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9524.608356][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9524.608693][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9524.608965][ C1] ip_rcv+0x564/0x740 [ 9524.609178][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9524.609419][ C1] ? set_track_prepare+0x8a/0xd0 [ 9524.609682][ C1] ? irqentry_enter+0x2b/0x60 [ 9524.609933][ C1] ? irqentry_enter+0x2b/0x60 [ 9524.610194][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9524.610433][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9524.610744][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9524.611080][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9524.611385][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9524.611723][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9524.612020][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9524.612345][ C1] netif_receive_skb+0x55/0x280 [ 9524.612601][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9524.612923][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9524.613269][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9524.613585][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9524.613870][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9524.614169][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9524.614493][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9524.614771][ C1] ? arch_stack_walk+0x68/0x100 [ 9524.615032][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9524.615309][ C1] ? irqentry_enter+0x2b/0x60 [ 9524.615561][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9524.615883][ C1] ? irqentry_enter+0x2b/0x60 [ 9524.616132][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9524.616450][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9524.616734][ C1] ? arch_stack_walk+0x68/0x100 [ 9524.616989][ C1] __tcf_classify+0x32c/0x7d0 [ 9524.617238][ C1] tcf_classify+0x283/0x930 [ 9524.617476][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9524.617743][ C1] tc_run+0x2e4/0x5d0 [ 9524.617959][ C1] ? __pfx_tc_run+0x10/0x10 [ 9524.618202][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9524.618467][ C1] ? irqentry_enter+0x2b/0x60 [ 9524.618718][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9524.619003][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9524.619328][ C1] ip_finish_output2+0x786/0x18e0 [ 9524.619596][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9524.619881][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9524.620153][ C1] ? __ip_finish_output+0x10f/0x770 [ 9524.620431][ C1] ip_output+0x16b/0x4f0 [ 9524.620660][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9524.620974][ C1] ? __pfx_ip_output+0x10/0x10 [ 9524.621233][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9524.621586][ C1] ? __pfx_ip_output+0x10/0x10 [ 9524.621838][ C1] __ip_queue_xmit+0x672/0x1910 [ 9524.622101][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9524.622383][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9524.622678][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9524.622966][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9524.623265][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9524.623552][ C1] tcp_delack_timer+0x84/0x240 [ 9524.623809][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9524.624092][ C1] call_timer_fn+0x176/0x430 [ 9524.624340][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9524.624614][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9524.624887][ C1] __run_timers.part.0+0x52d/0x890 [ 9524.625157][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9524.625447][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9524.625748][ C1] ? __pfx___schedule+0x10/0x10 [ 9524.626003][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9524.626319][ C1] run_timer_softirq+0x72/0x100 [ 9524.626579][ C1] __do_softirq+0x1bc/0x7ff [ 9524.626822][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9524.627096][ C1] run_ksoftirqd+0x2e/0x60 [ 9524.627331][ C1] smpboot_thread_fn+0x30e/0x840 [ 9524.627597][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9524.627887][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9524.628178][ C1] kthread+0x292/0x360 [ 9524.628391][ C1] ? __pfx_kthread+0x10/0x10 [ 9524.628637][ C1] ret_from_fork+0x34/0x70 [ 9524.628874][ C1] ? __pfx_kthread+0x10/0x10 [ 9524.629121][ C1] ret_from_fork_asm+0x1b/0x30 [ 9524.629381][ C1] [ 9552.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7790s! [swapper/0:0] [ 9552.527925][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9552.529112][ C0] irq event stamp: 27567077 [ 9552.529352][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9552.529880][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9552.530359][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9552.530861][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9552.531359][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9552.531838][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9552.532488][ C0] RIP: 0010:kasan_check_range+0x1b/0x1c0 [ 9552.532791][ C0] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 53 <72> 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 23 [ 9552.533810][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000286 [ 9552.534131][ C0] RAX: ffff88800a099b5c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9552.534552][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9552.534970][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9552.535389][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9552.535806][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9552.536224][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9552.536698][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9552.537054][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9552.537481][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9552.537908][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9552.538334][ C0] Call Trace: [ 9552.538516][ C0] [ 9552.538683][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9552.538960][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9552.539215][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9552.539511][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9552.539797][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9552.540110][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9552.540393][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9552.540715][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9552.540986][ C0] ? hrtimer_interrupt+0x31a/0x770 [ 9552.541264][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9552.541538][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9552.541869][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9552.542183][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9552.542511][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9552.542819][ C0] ? kasan_check_range+0x1b/0x1c0 [ 9552.543093][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 9552.543392][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9552.543721][ C0] ? get_stack_info+0x36/0xc0 [ 9552.543970][ C0] ? lock_acquire+0x1c1/0x220 [ 9552.544220][ C0] ? lock_release+0x1d5/0x250 [ 9552.544469][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9552.544728][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9552.545014][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9552.545314][ C0] ? lock_acquire+0x1c1/0x220 [ 9552.545567][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9552.545823][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9552.546100][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9552.546346][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9552.546604][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9552.546873][ C0] ? __inet_lookup_established+0x341/0x610 [ 9552.547186][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9552.547480][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9552.547779][ C0] ip_local_deliver+0x19d/0x480 [ 9552.548040][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9552.548326][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9552.548589][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9552.548869][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9552.549133][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9552.549466][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9552.549746][ C0] ip_rcv+0x564/0x740 [ 9552.549960][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9552.550214][ C0] ? set_track_prepare+0x8a/0xd0 [ 9552.550477][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9552.550767][ C0] ? rest_init+0x153/0x260 [ 9552.551002][ C0] ? skb_clone+0x10b/0x330 [ 9552.551245][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9552.551579][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9552.551898][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9552.552197][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9552.552508][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9552.552769][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9552.553012][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9552.553331][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9552.553634][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9552.553972][ C0] ? lock_acquire+0x1c1/0x220 [ 9552.554220][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9552.554528][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9552.554830][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9552.555161][ C0] ? __copy_skb_header+0xaf/0x490 [ 9552.555427][ C0] ? __skb_clone+0x57a/0x760 [ 9552.555671][ C0] netif_receive_skb+0x55/0x280 [ 9552.555931][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9552.556263][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9552.556616][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9552.556929][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9552.557220][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9552.557522][ C0] ? hlock_class+0x4e/0x130 [ 9552.557769][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9552.558107][ C0] ? place_entity+0x21/0x2f0 [ 9552.558358][ C0] ? resched_curr+0x219/0x280 [ 9552.558609][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9552.558878][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9552.559160][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9552.559442][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9552.559704][ C0] ? activate_task+0xf5/0x260 [ 9552.559958][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9552.560242][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9552.560518][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9552.560775][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9552.561066][ C0] ? get_stack_info+0x36/0xc0 [ 9552.561322][ C0] ? stack_access_ok+0xda/0x1f0 [ 9552.561586][ C0] ? get_reg+0x119/0x190 [ 9552.561814][ C0] __tcf_classify+0x32c/0x7d0 [ 9552.562065][ C0] tcf_classify+0x283/0x930 [ 9552.562305][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9552.562634][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9552.562903][ C0] ? arch_stack_walk+0x8c/0x100 [ 9552.563171][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9552.563465][ C0] tc_run+0x2e4/0x5d0 [ 9552.563678][ C0] ? __pfx_tc_run+0x10/0x10 [ 9552.563919][ C0] ? lock_acquire+0x1c1/0x220 [ 9552.564170][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9552.564445][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9552.564719][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9552.565005][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9552.565284][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9552.565603][ C0] ? neigh_hh_output+0x348/0x590 [ 9552.565872][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9552.566151][ C0] ip_finish_output2+0x786/0x18e0 [ 9552.566417][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9552.566708][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9552.567064][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9552.567357][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9552.567622][ C0] ? __ip_finish_output+0x10f/0x770 [ 9552.567904][ C0] ip_output+0x16b/0x4f0 [ 9552.568132][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9552.568413][ C0] ? __pfx_ip_output+0x10/0x10 [ 9552.568670][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9552.568972][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9552.569239][ C0] ? ip_local_out+0x114/0x3b0 [ 9552.569489][ C0] __ip_queue_xmit+0x672/0x1910 [ 9552.569746][ C0] ? __skb_clone+0x57a/0x760 [ 9552.569994][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9552.570275][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9552.570574][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9552.570896][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9552.571159][ C0] ? tcp_current_mss+0x40a/0x510 [ 9552.571422][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9552.571707][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9552.571982][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9552.572239][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9552.572510][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9552.572832][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9552.573109][ C0] ? ktime_get+0xb6/0x190 [ 9552.573340][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9552.573613][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9552.573896][ C0] tcp_write_timer+0x82/0x1d0 [ 9552.574148][ C0] call_timer_fn+0x176/0x430 [ 9552.574393][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9552.574671][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9552.574943][ C0] __run_timers.part.0+0x52d/0x890 [ 9552.575221][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9552.575511][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9552.575813][ C0] ? lock_acquire+0x1c1/0x220 [ 9552.576062][ C0] ? clockevents_program_event+0xf6/0x300 [ 9552.576367][ C0] ? lock_release+0x1d5/0x250 [ 9552.576618][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9552.576894][ C0] ? ktime_get+0xb6/0x190 [ 9552.577127][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9552.577424][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9552.577739][ C0] run_timer_softirq+0x72/0x100 [ 9552.578000][ C0] __do_softirq+0x1bc/0x7ff [ 9552.578244][ C0] irq_exit_rcu+0x98/0xc0 [ 9552.578474][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9552.578773][ C0] [ 9552.578931][ C0] [ 9552.579092][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9552.579416][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9552.579683][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9552.580710][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9552.581040][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9552.581462][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9552.581884][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9552.582311][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9552.582737][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9552.583160][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9552.583466][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9552.583742][ C0] default_idle_call+0x69/0xa0 [ 9552.583994][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9552.584262][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9552.584556][ C0] ? lock_release+0x1d5/0x250 [ 9552.584812][ C0] do_idle+0xfb/0x160 [ 9552.585029][ C0] cpu_startup_entry+0x55/0x60 [ 9552.585286][ C0] rest_init+0x153/0x260 [ 9552.585514][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9552.585806][ C0] arch_call_rest_init+0x13/0x40 [ 9552.586076][ C0] start_kernel+0x314/0x3d0 [ 9552.586318][ C0] x86_64_start_reservations+0x18/0x30 [ 9552.586610][ C0] x86_64_start_kernel+0xba/0x110 [ 9552.586882][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9552.587212][ C0] [ 9552.587381][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7790s! [ksoftirqd/1:22] [ 9552.587849][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9552.589039][ C1] irq event stamp: 3886976 [ 9552.589276][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9552.589770][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9552.590270][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9552.590772][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9552.591264][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9552.591758][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9552.592405][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9552.592750][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9552.593774][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9552.594098][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9552.594520][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9552.594943][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9552.595362][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9552.595780][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9552.596202][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9552.596675][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9552.597020][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9552.597444][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9552.597862][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9552.598277][ C1] Call Trace: [ 9552.598453][ C1] [ 9552.598607][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9552.598884][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9552.599140][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9552.599432][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9552.599717][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9552.600024][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9552.600304][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9552.600629][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9552.600901][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9552.601229][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9552.601540][ C1] [ 9552.601696][ C1] [ 9552.601851][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9552.602178][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9552.602484][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9552.602794][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9552.603094][ C1] ? run_ksoftirqd+0xb/0x60 [ 9552.603338][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9552.603660][ C1] ? __orc_find+0x9c/0xf0 [ 9552.603893][ C1] ? lock_acquire+0x1c1/0x220 [ 9552.604147][ C1] ? irqentry_enter+0x2b/0x60 [ 9552.604401][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9552.604662][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9552.604949][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9552.605251][ C1] ? lock_acquire+0x1c1/0x220 [ 9552.605500][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9552.605751][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9552.606023][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9552.606271][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9552.606530][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9552.606804][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9552.607098][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9552.607391][ C1] ip_local_deliver+0x19d/0x480 [ 9552.607650][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9552.607932][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9552.608197][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9552.608481][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9552.608747][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9552.609082][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9552.609359][ C1] ip_rcv+0x564/0x740 [ 9552.609577][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9552.609824][ C1] ? set_track_prepare+0x8a/0xd0 [ 9552.610096][ C1] ? irqentry_enter+0x2b/0x60 [ 9552.610350][ C1] ? irqentry_enter+0x2b/0x60 [ 9552.610605][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9552.610849][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9552.611170][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9552.611515][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9552.611825][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9552.612168][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9552.612466][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9552.612801][ C1] netif_receive_skb+0x55/0x280 [ 9552.613063][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9552.613393][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9552.613742][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9552.614055][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9552.614347][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9552.614652][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9552.614986][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9552.615269][ C1] ? arch_stack_walk+0x68/0x100 [ 9552.615529][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9552.615805][ C1] ? irqentry_enter+0x2b/0x60 [ 9552.616056][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9552.616372][ C1] ? irqentry_enter+0x2b/0x60 [ 9552.616624][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9552.616949][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9552.617230][ C1] ? arch_stack_walk+0x68/0x100 [ 9552.617492][ C1] __tcf_classify+0x32c/0x7d0 [ 9552.617747][ C1] tcf_classify+0x283/0x930 [ 9552.617994][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9552.618266][ C1] tc_run+0x2e4/0x5d0 [ 9552.618484][ C1] ? __pfx_tc_run+0x10/0x10 [ 9552.618731][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9552.619000][ C1] ? irqentry_enter+0x2b/0x60 [ 9552.619251][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9552.619536][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9552.619855][ C1] ip_finish_output2+0x786/0x18e0 [ 9552.620135][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9552.620426][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9552.620693][ C1] ? __ip_finish_output+0x10f/0x770 [ 9552.620968][ C1] ip_output+0x16b/0x4f0 [ 9552.621193][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9552.621514][ C1] ? __pfx_ip_output+0x10/0x10 [ 9552.621767][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9552.622124][ C1] ? __pfx_ip_output+0x10/0x10 [ 9552.622383][ C1] __ip_queue_xmit+0x672/0x1910 [ 9552.622643][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9552.622922][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9552.623217][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9552.623500][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9552.623792][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9552.624075][ C1] tcp_delack_timer+0x84/0x240 [ 9552.624328][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9552.624617][ C1] call_timer_fn+0x176/0x430 [ 9552.624866][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9552.625139][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9552.625420][ C1] __run_timers.part.0+0x52d/0x890 [ 9552.625693][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9552.625977][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9552.626277][ C1] ? __pfx___schedule+0x10/0x10 [ 9552.626539][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9552.626862][ C1] run_timer_softirq+0x72/0x100 [ 9552.627121][ C1] __do_softirq+0x1bc/0x7ff [ 9552.627364][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9552.627637][ C1] run_ksoftirqd+0x2e/0x60 [ 9552.627877][ C1] smpboot_thread_fn+0x30e/0x840 [ 9552.628142][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9552.628433][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9552.628720][ C1] kthread+0x292/0x360 [ 9552.628942][ C1] ? __pfx_kthread+0x10/0x10 [ 9552.629194][ C1] ret_from_fork+0x34/0x70 [ 9552.629434][ C1] ? __pfx_kthread+0x10/0x10 [ 9552.629676][ C1] ret_from_fork_asm+0x1b/0x30 [ 9552.629938][ C1] [ 9575.499024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9575.499409][ C1] rcu: 1-....: (8312099 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=1992393 [ 9575.500003][ C1] rcu: (t=8381190 jiffies g=1007429 q=31 ncpus=4) [ 9575.500348][ C1] Sending NMI from CPU 1 to CPUs 0: [ 9575.500644][ C0] NMI backtrace for cpu 0 [ 9575.500652][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9575.500657][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9575.500660][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9575.500669][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9575.500672][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9575.500676][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9575.500678][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9575.500680][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9575.500682][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9575.500684][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9575.500686][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9575.500689][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9575.500693][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9575.500696][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9575.500697][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9575.500699][ C0] Call Trace: [ 9575.500703][ C0] [ 9575.500707][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 9575.500713][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9575.500717][ C0] ? nmi_handle+0x156/0x420 [ 9575.500722][ C0] ? default_do_nmi+0x41/0x100 [ 9575.500727][ C0] ? exc_nmi+0xf3/0x120 [ 9575.500729][ C0] ? end_repeat_nmi+0xf/0x60 [ 9575.500734][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9575.500738][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9575.500742][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9575.500745][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9575.500749][ C0] [ 9575.500750][ C0] [ 9575.500751][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9575.500755][ C0] ? get_stack_info+0x36/0xc0 [ 9575.500759][ C0] ? lock_acquire+0x1c1/0x220 [ 9575.500764][ C0] ? lock_release+0x1d5/0x250 [ 9575.500768][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9575.500772][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9575.500775][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9575.500778][ C0] ? lock_acquire+0x1c1/0x220 [ 9575.500780][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9575.500785][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9575.500789][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9575.500796][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9575.500799][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9575.500803][ C0] ? __inet_lookup_established+0x341/0x610 [ 9575.500808][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9575.500815][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9575.500819][ C0] ip_local_deliver+0x19d/0x480 [ 9575.500822][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9575.500824][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9575.500829][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9575.500834][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9575.500836][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9575.500840][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9575.500851][ C0] ip_rcv+0x564/0x740 [ 9575.500854][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9575.500857][ C0] ? set_track_prepare+0x8a/0xd0 [ 9575.500862][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9575.500864][ C0] ? rest_init+0x153/0x260 [ 9575.500866][ C0] ? skb_clone+0x10b/0x330 [ 9575.500871][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9575.500877][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9575.500882][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9575.500887][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9575.500896][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9575.500899][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9575.500902][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9575.500905][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9575.500909][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9575.500912][ C0] ? lock_acquire+0x1c1/0x220 [ 9575.500914][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9575.500918][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9575.500921][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9575.500924][ C0] ? __copy_skb_header+0xaf/0x490 [ 9575.500928][ C0] ? __skb_clone+0x57a/0x760 [ 9575.500930][ C0] netif_receive_skb+0x55/0x280 [ 9575.500933][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9575.500940][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9575.500947][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9575.500954][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9575.500959][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9575.500967][ C0] ? hlock_class+0x4e/0x130 [ 9575.500973][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9575.500983][ C0] ? place_entity+0x21/0x2f0 [ 9575.500987][ C0] ? resched_curr+0x219/0x280 [ 9575.500990][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9575.500993][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9575.500996][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9575.501000][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9575.501002][ C0] ? activate_task+0xf5/0x260 [ 9575.501005][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9575.501010][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9575.501014][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9575.501018][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9575.501022][ C0] ? get_stack_info+0x36/0xc0 [ 9575.501026][ C0] ? stack_access_ok+0xda/0x1f0 [ 9575.501028][ C0] ? get_reg+0x119/0x190 [ 9575.501032][ C0] __tcf_classify+0x32c/0x7d0 [ 9575.501037][ C0] tcf_classify+0x283/0x930 [ 9575.501039][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9575.501043][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9575.501045][ C0] ? arch_stack_walk+0x8c/0x100 [ 9575.501050][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9575.501053][ C0] tc_run+0x2e4/0x5d0 [ 9575.501057][ C0] ? __pfx_tc_run+0x10/0x10 [ 9575.501060][ C0] ? lock_acquire+0x1c1/0x220 [ 9575.501063][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9575.501068][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9575.501074][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9575.501077][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9575.501080][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9575.501085][ C0] ? neigh_hh_output+0x348/0x590 [ 9575.501089][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9575.501093][ C0] ip_finish_output2+0x786/0x18e0 [ 9575.501096][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9575.501101][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9575.501109][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9575.501112][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9575.501116][ C0] ? __ip_finish_output+0x10f/0x770 [ 9575.501120][ C0] ip_output+0x16b/0x4f0 [ 9575.501123][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9575.501128][ C0] ? __pfx_ip_output+0x10/0x10 [ 9575.501131][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9575.501136][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9575.501139][ C0] ? ip_local_out+0x114/0x3b0 [ 9575.501143][ C0] __ip_queue_xmit+0x672/0x1910 [ 9575.501147][ C0] ? __skb_clone+0x57a/0x760 [ 9575.501150][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9575.501157][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9575.501161][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9575.501165][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9575.501170][ C0] ? tcp_current_mss+0x40a/0x510 [ 9575.501173][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9575.501176][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9575.501179][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9575.501181][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9575.501184][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9575.501187][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9575.501192][ C0] ? ktime_get+0xb6/0x190 [ 9575.501196][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9575.501199][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9575.501202][ C0] tcp_write_timer+0x82/0x1d0 [ 9575.501206][ C0] call_timer_fn+0x176/0x430 [ 9575.501210][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9575.501215][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9575.501219][ C0] __run_timers.part.0+0x52d/0x890 [ 9575.501222][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9575.501226][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9575.501229][ C0] ? lock_acquire+0x1c1/0x220 [ 9575.501232][ C0] ? clockevents_program_event+0xf6/0x300 [ 9575.501236][ C0] ? lock_release+0x1d5/0x250 [ 9575.501238][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9575.501241][ C0] ? ktime_get+0xb6/0x190 [ 9575.501244][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9575.501248][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9575.501252][ C0] run_timer_softirq+0x72/0x100 [ 9575.501256][ C0] __do_softirq+0x1bc/0x7ff [ 9575.501260][ C0] irq_exit_rcu+0x98/0xc0 [ 9575.501263][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9575.501267][ C0] [ 9575.501267][ C0] [ 9575.501269][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9575.501274][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9575.501277][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9575.501280][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9575.501282][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9575.501284][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9575.501286][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9575.501287][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9575.501289][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9575.501293][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9575.501296][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9575.501300][ C0] default_idle_call+0x69/0xa0 [ 9575.501302][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9575.501305][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9575.501310][ C0] ? lock_release+0x1d5/0x250 [ 9575.501314][ C0] do_idle+0xfb/0x160 [ 9575.501316][ C0] cpu_startup_entry+0x55/0x60 [ 9575.501319][ C0] rest_init+0x153/0x260 [ 9575.501321][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9575.501326][ C0] arch_call_rest_init+0x13/0x40 [ 9575.501332][ C0] start_kernel+0x314/0x3d0 [ 9575.501336][ C0] x86_64_start_reservations+0x18/0x30 [ 9575.501340][ C0] x86_64_start_kernel+0xba/0x110 [ 9575.501343][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9575.501351][ C0] [ 9575.501641][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9575.555368][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9575.556008][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9575.556353][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9575.557367][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9575.557695][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9575.558113][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9575.558531][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9575.558950][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9575.559369][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9575.559786][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9575.560263][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9575.560610][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9575.561032][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9575.561449][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9575.561866][ C1] Call Trace: [ 9575.562043][ C1] [ 9575.562197][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9575.562487][ C1] ? print_cpu_stall+0x263/0x6a0 [ 9575.562751][ C1] ? check_cpu_stall+0x284/0x500 [ 9575.563016][ C1] ? rcu_pending+0x92/0x360 [ 9575.563260][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9575.563543][ C1] ? update_process_times+0xb9/0x110 [ 9575.563828][ C1] ? tick_sched_handle+0x67/0x130 [ 9575.564096][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9575.564392][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9575.564649][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9575.564974][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9575.565263][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9575.565568][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9575.565848][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9575.566168][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9575.566441][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9575.566769][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9575.567080][ C1] [ 9575.567237][ C1] [ 9575.567393][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9575.567721][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9575.568026][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9575.568337][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9575.568636][ C1] ? run_ksoftirqd+0xb/0x60 [ 9575.568878][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9575.569204][ C1] ? __orc_find+0x9c/0xf0 [ 9575.569437][ C1] ? lock_acquire+0x1c1/0x220 [ 9575.569693][ C1] ? irqentry_enter+0x2b/0x60 [ 9575.569949][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9575.570210][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9575.570494][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9575.570791][ C1] ? lock_acquire+0x1c1/0x220 [ 9575.571042][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9575.571296][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9575.571571][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9575.571817][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9575.572076][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9575.572346][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9575.572631][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9575.572919][ C1] ip_local_deliver+0x19d/0x480 [ 9575.573185][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9575.573472][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9575.573738][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9575.574012][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9575.574274][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9575.574620][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9575.574894][ C1] ip_rcv+0x564/0x740 [ 9575.575105][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9575.575346][ C1] ? set_track_prepare+0x8a/0xd0 [ 9575.575609][ C1] ? irqentry_enter+0x2b/0x60 [ 9575.575861][ C1] ? irqentry_enter+0x2b/0x60 [ 9575.576114][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9575.576357][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9575.576675][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9575.577017][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9575.577327][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9575.577663][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9575.577965][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9575.578301][ C1] netif_receive_skb+0x55/0x280 [ 9575.578562][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9575.578896][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9575.579245][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9575.579556][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9575.579847][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9575.580157][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9575.580480][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9575.580756][ C1] ? arch_stack_walk+0x68/0x100 [ 9575.581019][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9575.581298][ C1] ? irqentry_enter+0x2b/0x60 [ 9575.581550][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9575.581873][ C1] ? irqentry_enter+0x2b/0x60 [ 9575.582124][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9575.582443][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9575.582728][ C1] ? arch_stack_walk+0x68/0x100 [ 9575.582986][ C1] __tcf_classify+0x32c/0x7d0 [ 9575.583237][ C1] tcf_classify+0x283/0x930 [ 9575.583476][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9575.583742][ C1] tc_run+0x2e4/0x5d0 [ 9575.583960][ C1] ? __pfx_tc_run+0x10/0x10 [ 9575.584201][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9575.584466][ C1] ? irqentry_enter+0x2b/0x60 [ 9575.584717][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9575.585002][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9575.585332][ C1] ip_finish_output2+0x786/0x18e0 [ 9575.585599][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9575.585885][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9575.586154][ C1] ? __ip_finish_output+0x10f/0x770 [ 9575.586436][ C1] ip_output+0x16b/0x4f0 [ 9575.586661][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9575.586981][ C1] ? __pfx_ip_output+0x10/0x10 [ 9575.587236][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9575.587588][ C1] ? __pfx_ip_output+0x10/0x10 [ 9575.587846][ C1] __ip_queue_xmit+0x672/0x1910 [ 9575.588105][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9575.588383][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9575.588676][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9575.588960][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9575.589253][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9575.589533][ C1] tcp_delack_timer+0x84/0x240 [ 9575.589784][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9575.590072][ C1] call_timer_fn+0x176/0x430 [ 9575.590315][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9575.590589][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9575.590862][ C1] __run_timers.part.0+0x52d/0x890 [ 9575.591131][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9575.591419][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9575.591718][ C1] ? __pfx___schedule+0x10/0x10 [ 9575.591976][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9575.592292][ C1] run_timer_softirq+0x72/0x100 [ 9575.592552][ C1] __do_softirq+0x1bc/0x7ff [ 9575.592796][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9575.593071][ C1] run_ksoftirqd+0x2e/0x60 [ 9575.593307][ C1] smpboot_thread_fn+0x30e/0x840 [ 9575.593575][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9575.593862][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9575.594151][ C1] kthread+0x292/0x360 [ 9575.594366][ C1] ? __pfx_kthread+0x10/0x10 [ 9575.594612][ C1] ret_from_fork+0x34/0x70 [ 9575.594847][ C1] ? __pfx_kthread+0x10/0x10 [ 9575.595094][ C1] ret_from_fork_asm+0x1b/0x30 [ 9575.595351][ C1] [ 9600.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7835s! [swapper/0:0] [ 9600.527922][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9600.529114][ C0] irq event stamp: 27567077 [ 9600.529353][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9600.529889][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9600.530366][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9600.530865][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9600.531363][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9600.531840][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9600.532495][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9600.532839][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9600.533862][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9600.534190][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9600.534614][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9600.535036][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9600.535457][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9600.535880][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9600.536310][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9600.536781][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9600.537131][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9600.537561][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9600.537981][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9600.538402][ C0] Call Trace: [ 9600.538578][ C0] [ 9600.538732][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9600.539011][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9600.539267][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9600.539558][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9600.539853][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9600.540160][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9600.540443][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9600.540766][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9600.541045][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9600.541323][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9600.541645][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9600.541953][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9600.542288][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9600.542590][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9600.542897][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9600.543202][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9600.543529][ C0] ? get_stack_info+0x36/0xc0 [ 9600.543779][ C0] ? lock_acquire+0x1c1/0x220 [ 9600.544027][ C0] ? lock_release+0x1d5/0x250 [ 9600.544275][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9600.544539][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9600.544823][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9600.545128][ C0] ? lock_acquire+0x1c1/0x220 [ 9600.545382][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9600.545635][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9600.545908][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9600.546153][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9600.546409][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9600.546675][ C0] ? __inet_lookup_established+0x341/0x610 [ 9600.546989][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9600.547281][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9600.547574][ C0] ip_local_deliver+0x19d/0x480 [ 9600.547832][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9600.548116][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9600.548378][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9600.548656][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9600.548920][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9600.549258][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9600.549536][ C0] ip_rcv+0x564/0x740 [ 9600.549763][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9600.550087][ C0] ? set_track_prepare+0x8a/0xd0 [ 9600.550353][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9600.550641][ C0] ? rest_init+0x153/0x260 [ 9600.550876][ C0] ? skb_clone+0x10b/0x330 [ 9600.551118][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9600.551449][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9600.551769][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9600.552066][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9600.552376][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9600.552638][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9600.552881][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9600.553199][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9600.553506][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9600.553844][ C0] ? lock_acquire+0x1c1/0x220 [ 9600.554092][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9600.554399][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9600.554701][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9600.555030][ C0] ? __copy_skb_header+0xaf/0x490 [ 9600.555295][ C0] ? __skb_clone+0x57a/0x760 [ 9600.555537][ C0] netif_receive_skb+0x55/0x280 [ 9600.555798][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9600.556132][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9600.556483][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9600.556800][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9600.557090][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9600.557390][ C0] ? hlock_class+0x4e/0x130 [ 9600.557636][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9600.557969][ C0] ? place_entity+0x21/0x2f0 [ 9600.558219][ C0] ? resched_curr+0x219/0x280 [ 9600.558468][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9600.558734][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9600.559019][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9600.559301][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9600.559562][ C0] ? activate_task+0xf5/0x260 [ 9600.559826][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9600.560102][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9600.560378][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9600.560634][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9600.560922][ C0] ? get_stack_info+0x36/0xc0 [ 9600.561180][ C0] ? stack_access_ok+0xda/0x1f0 [ 9600.561443][ C0] ? get_reg+0x119/0x190 [ 9600.561669][ C0] __tcf_classify+0x32c/0x7d0 [ 9600.561918][ C0] tcf_classify+0x283/0x930 [ 9600.562158][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9600.562486][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9600.562755][ C0] ? arch_stack_walk+0x8c/0x100 [ 9600.563024][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9600.563317][ C0] tc_run+0x2e4/0x5d0 [ 9600.563530][ C0] ? __pfx_tc_run+0x10/0x10 [ 9600.563771][ C0] ? lock_acquire+0x1c1/0x220 [ 9600.564020][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9600.564294][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9600.564565][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9600.564854][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9600.565135][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9600.565451][ C0] ? neigh_hh_output+0x348/0x590 [ 9600.565720][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9600.565996][ C0] ip_finish_output2+0x786/0x18e0 [ 9600.566264][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9600.566554][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9600.566914][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9600.567208][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9600.567474][ C0] ? __ip_finish_output+0x10f/0x770 [ 9600.567754][ C0] ip_output+0x16b/0x4f0 [ 9600.567980][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9600.568261][ C0] ? __pfx_ip_output+0x10/0x10 [ 9600.568521][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9600.568820][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9600.569090][ C0] ? ip_local_out+0x114/0x3b0 [ 9600.569339][ C0] __ip_queue_xmit+0x672/0x1910 [ 9600.569595][ C0] ? __skb_clone+0x57a/0x760 [ 9600.569853][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9600.570136][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9600.570431][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9600.570752][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9600.571007][ C0] ? tcp_current_mss+0x40a/0x510 [ 9600.571271][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9600.571547][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9600.571825][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9600.572079][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9600.572352][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9600.572676][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9600.572955][ C0] ? ktime_get+0xb6/0x190 [ 9600.573190][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9600.573464][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9600.573742][ C0] tcp_write_timer+0x82/0x1d0 [ 9600.573994][ C0] call_timer_fn+0x176/0x430 [ 9600.574243][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9600.574516][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9600.574790][ C0] __run_timers.part.0+0x52d/0x890 [ 9600.575062][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9600.575347][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9600.575648][ C0] ? lock_acquire+0x1c1/0x220 [ 9600.575896][ C0] ? clockevents_program_event+0xf6/0x300 [ 9600.576205][ C0] ? lock_release+0x1d5/0x250 [ 9600.576457][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9600.576740][ C0] ? ktime_get+0xb6/0x190 [ 9600.576973][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9600.577273][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9600.577579][ C0] run_timer_softirq+0x72/0x100 [ 9600.577838][ C0] __do_softirq+0x1bc/0x7ff [ 9600.578085][ C0] irq_exit_rcu+0x98/0xc0 [ 9600.578316][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9600.578615][ C0] [ 9600.578770][ C0] [ 9600.578925][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9600.579244][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9600.579513][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9600.580536][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9600.580857][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9600.581272][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9600.581685][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9600.582101][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9600.582521][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9600.582937][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9600.583238][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9600.583509][ C0] default_idle_call+0x69/0xa0 [ 9600.583769][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9600.584031][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9600.584324][ C0] ? lock_release+0x1d5/0x250 [ 9600.584574][ C0] do_idle+0xfb/0x160 [ 9600.584784][ C0] cpu_startup_entry+0x55/0x60 [ 9600.585036][ C0] rest_init+0x153/0x260 [ 9600.585270][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9600.585556][ C0] arch_call_rest_init+0x13/0x40 [ 9600.585819][ C0] start_kernel+0x314/0x3d0 [ 9600.586064][ C0] x86_64_start_reservations+0x18/0x30 [ 9600.586355][ C0] x86_64_start_kernel+0xba/0x110 [ 9600.586624][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9600.586947][ C0] [ 9600.587109][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7835s! [ksoftirqd/1:22] [ 9600.587579][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9600.588766][ C1] irq event stamp: 3886976 [ 9600.589000][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9600.589499][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9600.590000][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9600.590502][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9600.590993][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9600.591482][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9600.592121][ C1] RIP: 0010:kasan_check_range+0x1b/0x1c0 [ 9600.592423][ C1] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 53 <72> 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 23 [ 9600.593443][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000282 [ 9600.593765][ C1] RAX: ffff88800a098e1c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9600.594188][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9600.594608][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9600.595026][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9600.595446][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9600.595870][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9600.596339][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9600.596686][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9600.597112][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9600.597529][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9600.597945][ C1] Call Trace: [ 9600.598121][ C1] [ 9600.598275][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9600.598551][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9600.598805][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9600.599097][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9600.599381][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9600.599682][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9600.599967][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9600.600292][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9600.600566][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9600.600892][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9600.601207][ C1] [ 9600.601363][ C1] [ 9600.601519][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9600.601847][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9600.602155][ C1] ? kasan_check_range+0x1b/0x1c0 [ 9600.602430][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 9600.602729][ C1] ? run_ksoftirqd+0xb/0x60 [ 9600.602976][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9600.603305][ C1] ? __orc_find+0x9c/0xf0 [ 9600.603534][ C1] ? lock_acquire+0x1c1/0x220 [ 9600.603783][ C1] ? irqentry_enter+0x2b/0x60 [ 9600.604034][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9600.604292][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9600.604574][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9600.604872][ C1] ? lock_acquire+0x1c1/0x220 [ 9600.605127][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9600.605384][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9600.605659][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9600.605903][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9600.606159][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9600.606429][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9600.606717][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9600.607006][ C1] ip_local_deliver+0x19d/0x480 [ 9600.607266][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9600.607552][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9600.607820][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9600.608096][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9600.608359][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9600.608697][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9600.608970][ C1] ip_rcv+0x564/0x740 [ 9600.609185][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9600.609429][ C1] ? set_track_prepare+0x8a/0xd0 [ 9600.609693][ C1] ? irqentry_enter+0x2b/0x60 [ 9600.609955][ C1] ? irqentry_enter+0x2b/0x60 [ 9600.610205][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9600.610445][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9600.610757][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9600.611095][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9600.611403][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9600.611746][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9600.612046][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9600.612377][ C1] netif_receive_skb+0x55/0x280 [ 9600.612633][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9600.612958][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9600.613307][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9600.613623][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9600.613913][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9600.614219][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9600.614552][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9600.614835][ C1] ? arch_stack_walk+0x68/0x100 [ 9600.615098][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9600.615378][ C1] ? irqentry_enter+0x2b/0x60 [ 9600.615633][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9600.615955][ C1] ? irqentry_enter+0x2b/0x60 [ 9600.616204][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9600.616523][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9600.616805][ C1] ? arch_stack_walk+0x68/0x100 [ 9600.617065][ C1] __tcf_classify+0x32c/0x7d0 [ 9600.617315][ C1] tcf_classify+0x283/0x930 [ 9600.617556][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9600.617823][ C1] tc_run+0x2e4/0x5d0 [ 9600.618038][ C1] ? __pfx_tc_run+0x10/0x10 [ 9600.618280][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9600.618546][ C1] ? irqentry_enter+0x2b/0x60 [ 9600.618800][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9600.619091][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9600.619412][ C1] ip_finish_output2+0x786/0x18e0 [ 9600.619681][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9600.619978][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9600.620242][ C1] ? __ip_finish_output+0x10f/0x770 [ 9600.620521][ C1] ip_output+0x16b/0x4f0 [ 9600.620749][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9600.621064][ C1] ? __pfx_ip_output+0x10/0x10 [ 9600.621322][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9600.621671][ C1] ? __pfx_ip_output+0x10/0x10 [ 9600.621926][ C1] __ip_queue_xmit+0x672/0x1910 [ 9600.622190][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9600.622473][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9600.622770][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9600.623059][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9600.623356][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9600.623645][ C1] tcp_delack_timer+0x84/0x240 [ 9600.623909][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9600.624195][ C1] call_timer_fn+0x176/0x430 [ 9600.624443][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9600.624721][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9600.624997][ C1] __run_timers.part.0+0x52d/0x890 [ 9600.625269][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9600.625560][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9600.625864][ C1] ? __pfx___schedule+0x10/0x10 [ 9600.626123][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9600.626443][ C1] run_timer_softirq+0x72/0x100 [ 9600.626705][ C1] __do_softirq+0x1bc/0x7ff [ 9600.626952][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9600.627227][ C1] run_ksoftirqd+0x2e/0x60 [ 9600.627463][ C1] smpboot_thread_fn+0x30e/0x840 [ 9600.627729][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9600.628017][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9600.628311][ C1] kthread+0x292/0x360 [ 9600.628529][ C1] ? __pfx_kthread+0x10/0x10 [ 9600.628777][ C1] ret_from_fork+0x34/0x70 [ 9600.629015][ C1] ? __pfx_kthread+0x10/0x10 [ 9600.629263][ C1] ret_from_fork_asm+0x1b/0x30 [ 9600.629521][ C1] [ 9628.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7861s! [swapper/0:0] [ 9628.527924][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9628.529121][ C0] irq event stamp: 27567077 [ 9628.529364][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9628.529900][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9628.530378][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9628.530883][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9628.531380][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9628.531859][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9628.532510][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9628.532856][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9628.533890][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9628.534219][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9628.534645][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9628.535073][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9628.535496][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9628.535919][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9628.536347][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9628.536827][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9628.537177][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9628.537608][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9628.538032][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9628.538452][ C0] Call Trace: [ 9628.538631][ C0] [ 9628.538789][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9628.539069][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9628.539326][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9628.539629][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9628.539920][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9628.540227][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9628.540510][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9628.540837][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9628.541112][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9628.541392][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9628.541716][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9628.542034][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9628.542369][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9628.542673][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9628.542983][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9628.543291][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9628.543622][ C0] ? get_stack_info+0x36/0xc0 [ 9628.543873][ C0] ? lock_acquire+0x1c1/0x220 [ 9628.544124][ C0] ? lock_release+0x1d5/0x250 [ 9628.544373][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9628.544631][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9628.544919][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9628.545220][ C0] ? lock_acquire+0x1c1/0x220 [ 9628.545476][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9628.545735][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9628.546011][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9628.546258][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9628.546515][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9628.546784][ C0] ? __inet_lookup_established+0x341/0x610 [ 9628.547099][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9628.547391][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9628.547685][ C0] ip_local_deliver+0x19d/0x480 [ 9628.547944][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9628.548231][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9628.548497][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9628.548780][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9628.549049][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9628.549385][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9628.549670][ C0] ip_rcv+0x564/0x740 [ 9628.549886][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9628.550134][ C0] ? set_track_prepare+0x8a/0xd0 [ 9628.550400][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9628.550692][ C0] ? rest_init+0x153/0x260 [ 9628.550931][ C0] ? skb_clone+0x10b/0x330 [ 9628.551174][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9628.551505][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9628.551824][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9628.552124][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9628.552438][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9628.552702][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9628.552948][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9628.553265][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9628.553568][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9628.553908][ C0] ? lock_acquire+0x1c1/0x220 [ 9628.554160][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9628.554470][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9628.554773][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9628.555105][ C0] ? __copy_skb_header+0xaf/0x490 [ 9628.555373][ C0] ? __skb_clone+0x57a/0x760 [ 9628.555619][ C0] netif_receive_skb+0x55/0x280 [ 9628.555881][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9628.556216][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9628.556568][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9628.556882][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9628.557178][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9628.557481][ C0] ? hlock_class+0x4e/0x130 [ 9628.557732][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9628.558066][ C0] ? place_entity+0x21/0x2f0 [ 9628.558317][ C0] ? resched_curr+0x219/0x280 [ 9628.558566][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9628.558834][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9628.559118][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9628.559400][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9628.559673][ C0] ? activate_task+0xf5/0x260 [ 9628.559924][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9628.560199][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9628.560476][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9628.560736][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9628.561025][ C0] ? get_stack_info+0x36/0xc0 [ 9628.561280][ C0] ? stack_access_ok+0xda/0x1f0 [ 9628.561548][ C0] ? get_reg+0x119/0x190 [ 9628.561781][ C0] __tcf_classify+0x32c/0x7d0 [ 9628.562034][ C0] tcf_classify+0x283/0x930 [ 9628.562276][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9628.562608][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9628.562878][ C0] ? arch_stack_walk+0x8c/0x100 [ 9628.563143][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9628.563440][ C0] tc_run+0x2e4/0x5d0 [ 9628.563657][ C0] ? __pfx_tc_run+0x10/0x10 [ 9628.563901][ C0] ? lock_acquire+0x1c1/0x220 [ 9628.564152][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9628.564426][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9628.564697][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9628.564983][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9628.565261][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9628.565579][ C0] ? neigh_hh_output+0x348/0x590 [ 9628.565847][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9628.566126][ C0] ip_finish_output2+0x786/0x18e0 [ 9628.566394][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9628.566688][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9628.567046][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9628.567342][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9628.567606][ C0] ? __ip_finish_output+0x10f/0x770 [ 9628.567887][ C0] ip_output+0x16b/0x4f0 [ 9628.568124][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9628.568405][ C0] ? __pfx_ip_output+0x10/0x10 [ 9628.568666][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9628.568964][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9628.569233][ C0] ? ip_local_out+0x114/0x3b0 [ 9628.569484][ C0] __ip_queue_xmit+0x672/0x1910 [ 9628.569749][ C0] ? __skb_clone+0x57a/0x760 [ 9628.569998][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9628.570282][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9628.570577][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9628.570895][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9628.571164][ C0] ? tcp_current_mss+0x40a/0x510 [ 9628.571427][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9628.571711][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9628.571988][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9628.572244][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9628.572515][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9628.572838][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9628.573116][ C0] ? ktime_get+0xb6/0x190 [ 9628.573347][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9628.573619][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9628.573903][ C0] tcp_write_timer+0x82/0x1d0 [ 9628.574156][ C0] call_timer_fn+0x176/0x430 [ 9628.574407][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9628.574684][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9628.574956][ C0] __run_timers.part.0+0x52d/0x890 [ 9628.575232][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9628.575516][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9628.575820][ C0] ? lock_acquire+0x1c1/0x220 [ 9628.576072][ C0] ? clockevents_program_event+0xf6/0x300 [ 9628.576375][ C0] ? lock_release+0x1d5/0x250 [ 9628.576622][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9628.576900][ C0] ? ktime_get+0xb6/0x190 [ 9628.577131][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9628.577429][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9628.577745][ C0] run_timer_softirq+0x72/0x100 [ 9628.578005][ C0] __do_softirq+0x1bc/0x7ff [ 9628.578252][ C0] irq_exit_rcu+0x98/0xc0 [ 9628.578481][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9628.578780][ C0] [ 9628.578939][ C0] [ 9628.579099][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9628.579418][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9628.579693][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9628.580719][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9628.581045][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9628.581470][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9628.581892][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9628.582316][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9628.582740][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9628.583170][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9628.583476][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9628.583752][ C0] default_idle_call+0x69/0xa0 [ 9628.584006][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9628.584271][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9628.584561][ C0] ? lock_release+0x1d5/0x250 [ 9628.584817][ C0] do_idle+0xfb/0x160 [ 9628.585038][ C0] cpu_startup_entry+0x55/0x60 [ 9628.585296][ C0] rest_init+0x153/0x260 [ 9628.585520][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9628.585812][ C0] arch_call_rest_init+0x13/0x40 [ 9628.586084][ C0] start_kernel+0x314/0x3d0 [ 9628.586328][ C0] x86_64_start_reservations+0x18/0x30 [ 9628.586623][ C0] x86_64_start_kernel+0xba/0x110 [ 9628.586894][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9628.587226][ C0] [ 9628.587392][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7861s! [ksoftirqd/1:22] [ 9628.587859][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9628.589048][ C1] irq event stamp: 3886976 [ 9628.589283][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9628.589788][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9628.590282][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9628.590779][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9628.591271][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9628.591761][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9628.592399][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9628.592742][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9628.593756][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9628.594076][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9628.594498][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9628.594914][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9628.595329][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9628.595745][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9628.596162][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9628.596630][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9628.596982][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9628.597404][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9628.597829][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9628.598248][ C1] Call Trace: [ 9628.598427][ C1] [ 9628.598585][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9628.598859][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9628.599117][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9628.599407][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9628.599701][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9628.600002][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9628.600278][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9628.600600][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9628.600875][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9628.601196][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9628.601506][ C1] [ 9628.601666][ C1] [ 9628.601826][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9628.602158][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9628.602459][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9628.602767][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9628.603073][ C1] ? run_ksoftirqd+0xb/0x60 [ 9628.603319][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9628.603645][ C1] ? __orc_find+0x9c/0xf0 [ 9628.603873][ C1] ? lock_acquire+0x1c1/0x220 [ 9628.604124][ C1] ? irqentry_enter+0x2b/0x60 [ 9628.604375][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9628.604636][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9628.604917][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9628.605217][ C1] ? lock_acquire+0x1c1/0x220 [ 9628.605470][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9628.605727][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9628.606000][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9628.606245][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9628.606501][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9628.606771][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9628.607061][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9628.607351][ C1] ip_local_deliver+0x19d/0x480 [ 9628.607612][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9628.607898][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9628.608165][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9628.608441][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9628.608704][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9628.609041][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9628.609315][ C1] ip_rcv+0x564/0x740 [ 9628.609528][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9628.609774][ C1] ? set_track_prepare+0x8a/0xd0 [ 9628.610042][ C1] ? irqentry_enter+0x2b/0x60 [ 9628.610293][ C1] ? irqentry_enter+0x2b/0x60 [ 9628.610544][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9628.610784][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9628.611098][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9628.611436][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9628.611746][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9628.612090][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9628.612390][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9628.612721][ C1] netif_receive_skb+0x55/0x280 [ 9628.612977][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9628.613301][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9628.613649][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9628.613964][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9628.614253][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9628.614555][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9628.614883][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9628.615165][ C1] ? arch_stack_walk+0x68/0x100 [ 9628.615428][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9628.615713][ C1] ? irqentry_enter+0x2b/0x60 [ 9628.615966][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9628.616285][ C1] ? irqentry_enter+0x2b/0x60 [ 9628.616533][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9628.616852][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9628.617135][ C1] ? arch_stack_walk+0x68/0x100 [ 9628.617394][ C1] __tcf_classify+0x32c/0x7d0 [ 9628.617644][ C1] tcf_classify+0x283/0x930 [ 9628.617885][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9628.618152][ C1] tc_run+0x2e4/0x5d0 [ 9628.618366][ C1] ? __pfx_tc_run+0x10/0x10 [ 9628.618614][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9628.618884][ C1] ? irqentry_enter+0x2b/0x60 [ 9628.619136][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9628.619420][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9628.619751][ C1] ip_finish_output2+0x786/0x18e0 [ 9628.620020][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9628.620308][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9628.620572][ C1] ? __ip_finish_output+0x10f/0x770 [ 9628.620848][ C1] ip_output+0x16b/0x4f0 [ 9628.621076][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9628.621392][ C1] ? __pfx_ip_output+0x10/0x10 [ 9628.621647][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9628.622001][ C1] ? __pfx_ip_output+0x10/0x10 [ 9628.622262][ C1] __ip_queue_xmit+0x672/0x1910 [ 9628.622520][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9628.622798][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9628.623090][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9628.623373][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9628.623668][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9628.623958][ C1] tcp_delack_timer+0x84/0x240 [ 9628.624214][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9628.624502][ C1] call_timer_fn+0x176/0x430 [ 9628.624752][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9628.625029][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9628.625308][ C1] __run_timers.part.0+0x52d/0x890 [ 9628.625582][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9628.625873][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9628.626173][ C1] ? __pfx___schedule+0x10/0x10 [ 9628.626433][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9628.626756][ C1] run_timer_softirq+0x72/0x100 [ 9628.627014][ C1] __do_softirq+0x1bc/0x7ff [ 9628.627259][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9628.627532][ C1] run_ksoftirqd+0x2e/0x60 [ 9628.627772][ C1] smpboot_thread_fn+0x30e/0x840 [ 9628.628035][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9628.628329][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9628.628619][ C1] kthread+0x292/0x360 [ 9628.628837][ C1] ? __pfx_kthread+0x10/0x10 [ 9628.629081][ C1] ret_from_fork+0x34/0x70 [ 9628.629322][ C1] ? __pfx_kthread+0x10/0x10 [ 9628.629566][ C1] ret_from_fork_asm+0x1b/0x30 [ 9628.629834][ C1] [ 9653.597023][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9653.597403][ C1] rcu: 1-....: (8389918 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=2011773 [ 9653.597990][ C1] rcu: (t=8459288 jiffies g=1007429 q=31 ncpus=4) [ 9653.598344][ C1] Sending NMI from CPU 1 to CPUs 0: [ 9653.598639][ C0] NMI backtrace for cpu 0 [ 9653.598650][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9653.598655][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9653.598661][ C0] RIP: 0010:kasan_check_range+0x84/0x1c0 [ 9653.598675][ C0] Code: 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 89 da 48 29 ea <48> 83 fa 10 0f 8e c0 00 00 00 41 89 eb 41 83 e3 07 75 7d 48 85 d2 [ 9653.598678][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000202 [ 9653.598682][ C0] RAX: ffffed100141336b RBX: ffffed100141336c RCX: ffffffff90c7aaa0 [ 9653.598685][ C0] RDX: 0000000000000001 RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9653.598686][ C0] RBP: ffffed100141336b R08: 0000000000000000 R09: ffffed100141336b [ 9653.598688][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9653.598690][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9653.598692][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9653.598694][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9653.598698][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9653.598700][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9653.598701][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9653.598703][ C0] Call Trace: [ 9653.598706][ C0] [ 9653.598711][ C0] ? nmi_cpu_backtrace+0x112/0x220 [ 9653.598716][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9653.598720][ C0] ? nmi_handle+0x156/0x420 [ 9653.598725][ C0] ? default_do_nmi+0x41/0x100 [ 9653.598729][ C0] ? exc_nmi+0xf3/0x120 [ 9653.598732][ C0] ? end_repeat_nmi+0xf/0x60 [ 9653.598737][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9653.598742][ C0] ? kasan_check_range+0x84/0x1c0 [ 9653.598746][ C0] ? kasan_check_range+0x84/0x1c0 [ 9653.598750][ C0] ? kasan_check_range+0x84/0x1c0 [ 9653.598753][ C0] [ 9653.598754][ C0] [ 9653.598756][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [ 9653.598759][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9653.598762][ C0] ? get_stack_info+0x36/0xc0 [ 9653.598767][ C0] ? lock_acquire+0x1c1/0x220 [ 9653.598772][ C0] ? lock_release+0x1d5/0x250 [ 9653.598775][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9653.598779][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9653.598782][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9653.598785][ C0] ? lock_acquire+0x1c1/0x220 [ 9653.598788][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9653.598793][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9653.598796][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9653.598804][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9653.598807][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9653.598811][ C0] ? __inet_lookup_established+0x341/0x610 [ 9653.598817][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9653.598824][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9653.598829][ C0] ip_local_deliver+0x19d/0x480 [ 9653.598832][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9653.598835][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9653.598840][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9653.598843][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9653.598847][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9653.598851][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9653.598861][ C0] ip_rcv+0x564/0x740 [ 9653.598864][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9653.598867][ C0] ? set_track_prepare+0x8a/0xd0 [ 9653.598872][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9653.598874][ C0] ? rest_init+0x153/0x260 [ 9653.598877][ C0] ? skb_clone+0x10b/0x330 [ 9653.598881][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9653.598887][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9653.598893][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9653.598897][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9653.598906][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9653.598909][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9653.598912][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9653.598916][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9653.598919][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9653.598923][ C0] ? lock_acquire+0x1c1/0x220 [ 9653.598925][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9653.598929][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9653.598932][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9653.598935][ C0] ? __copy_skb_header+0xaf/0x490 [ 9653.598938][ C0] ? __skb_clone+0x57a/0x760 [ 9653.598941][ C0] netif_receive_skb+0x55/0x280 [ 9653.598944][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9653.598951][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9653.598958][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9653.598965][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9653.598969][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9653.598978][ C0] ? hlock_class+0x4e/0x130 [ 9653.598984][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9653.598994][ C0] ? place_entity+0x21/0x2f0 [ 9653.598997][ C0] ? resched_curr+0x219/0x280 [ 9653.599001][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9653.599003][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9653.599007][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9653.599011][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9653.599014][ C0] ? activate_task+0xf5/0x260 [ 9653.599016][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9653.599023][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9653.599026][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9653.599030][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9653.599033][ C0] ? get_stack_info+0x36/0xc0 [ 9653.599037][ C0] ? stack_access_ok+0xda/0x1f0 [ 9653.599039][ C0] ? get_reg+0x119/0x190 [ 9653.599043][ C0] __tcf_classify+0x32c/0x7d0 [ 9653.599048][ C0] tcf_classify+0x283/0x930 [ 9653.599051][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9653.599055][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9653.599057][ C0] ? arch_stack_walk+0x8c/0x100 [ 9653.599061][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9653.599065][ C0] tc_run+0x2e4/0x5d0 [ 9653.599069][ C0] ? __pfx_tc_run+0x10/0x10 [ 9653.599072][ C0] ? lock_acquire+0x1c1/0x220 [ 9653.599074][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9653.599079][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9653.599084][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9653.599087][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9653.599091][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9653.599096][ C0] ? neigh_hh_output+0x348/0x590 [ 9653.599100][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9653.599104][ C0] ip_finish_output2+0x786/0x18e0 [ 9653.599107][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9653.599113][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9653.599120][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9653.599123][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9653.599128][ C0] ? __ip_finish_output+0x10f/0x770 [ 9653.599132][ C0] ip_output+0x16b/0x4f0 [ 9653.599135][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9653.599140][ C0] ? __pfx_ip_output+0x10/0x10 [ 9653.599143][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9653.599148][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9653.599151][ C0] ? ip_local_out+0x114/0x3b0 [ 9653.599155][ C0] __ip_queue_xmit+0x672/0x1910 [ 9653.599159][ C0] ? __skb_clone+0x57a/0x760 [ 9653.599163][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9653.599170][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9653.599174][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9653.599179][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9653.599184][ C0] ? tcp_current_mss+0x40a/0x510 [ 9653.599187][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9653.599190][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9653.599193][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9653.599195][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9653.599198][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9653.599201][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9653.599206][ C0] ? ktime_get+0xb6/0x190 [ 9653.599210][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9653.599214][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9653.599217][ C0] tcp_write_timer+0x82/0x1d0 [ 9653.599222][ C0] call_timer_fn+0x176/0x430 [ 9653.599225][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9653.599230][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9653.599234][ C0] __run_timers.part.0+0x52d/0x890 [ 9653.599237][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9653.599242][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9653.599245][ C0] ? lock_acquire+0x1c1/0x220 [ 9653.599247][ C0] ? clockevents_program_event+0xf6/0x300 [ 9653.599251][ C0] ? lock_release+0x1d5/0x250 [ 9653.599254][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9653.599257][ C0] ? ktime_get+0xb6/0x190 [ 9653.599260][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9653.599263][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9653.599267][ C0] run_timer_softirq+0x72/0x100 [ 9653.599271][ C0] __do_softirq+0x1bc/0x7ff [ 9653.599275][ C0] irq_exit_rcu+0x98/0xc0 [ 9653.599278][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9653.599282][ C0] [ 9653.599283][ C0] [ 9653.599284][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9653.599288][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9653.599291][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9653.599294][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9653.599296][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9653.599297][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9653.599299][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9653.599300][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9653.599302][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9653.599305][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9653.599309][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9653.599312][ C0] default_idle_call+0x69/0xa0 [ 9653.599315][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9653.599317][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9653.599322][ C0] ? lock_release+0x1d5/0x250 [ 9653.599326][ C0] do_idle+0xfb/0x160 [ 9653.599329][ C0] cpu_startup_entry+0x55/0x60 [ 9653.599332][ C0] rest_init+0x153/0x260 [ 9653.599334][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9653.599339][ C0] arch_call_rest_init+0x13/0x40 [ 9653.599345][ C0] start_kernel+0x314/0x3d0 [ 9653.599348][ C0] x86_64_start_reservations+0x18/0x30 [ 9653.599353][ C0] x86_64_start_kernel+0xba/0x110 [ 9653.599356][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9653.599365][ C0] [ 9653.599632][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9653.599637][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9653.654431][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9653.654776][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9653.655791][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9653.656115][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9653.656534][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9653.656951][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9653.657370][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9653.657789][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9653.658207][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9653.658678][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9653.659032][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9653.659451][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9653.659875][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9653.660292][ C1] Call Trace: [ 9653.660471][ C1] [ 9653.660626][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9653.660916][ C1] ? print_cpu_stall+0x263/0x6a0 [ 9653.661180][ C1] ? check_cpu_stall+0x284/0x500 [ 9653.661446][ C1] ? rcu_pending+0x92/0x360 [ 9653.661686][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9653.661970][ C1] ? update_process_times+0xb9/0x110 [ 9653.662257][ C1] ? tick_sched_handle+0x67/0x130 [ 9653.662526][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9653.662822][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9653.663081][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9653.663407][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9653.663697][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9653.664003][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9653.664285][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9653.664606][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9653.664878][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9653.665207][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9653.665519][ C1] [ 9653.665675][ C1] [ 9653.665832][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9653.666160][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9653.666465][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9653.666778][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9653.667079][ C1] ? run_ksoftirqd+0xb/0x60 [ 9653.667321][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9653.667646][ C1] ? __orc_find+0x9c/0xf0 [ 9653.667879][ C1] ? lock_acquire+0x1c1/0x220 [ 9653.668134][ C1] ? irqentry_enter+0x2b/0x60 [ 9653.668396][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9653.668660][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9653.668947][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9653.669247][ C1] ? lock_acquire+0x1c1/0x220 [ 9653.669499][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9653.669754][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9653.670029][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9653.670276][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9653.670534][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9653.670802][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9653.671090][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9653.671379][ C1] ip_local_deliver+0x19d/0x480 [ 9653.671644][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9653.671933][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9653.672201][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9653.672477][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9653.672739][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9653.673078][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9653.673356][ C1] ip_rcv+0x564/0x740 [ 9653.673568][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9653.673808][ C1] ? set_track_prepare+0x8a/0xd0 [ 9653.674073][ C1] ? irqentry_enter+0x2b/0x60 [ 9653.674325][ C1] ? irqentry_enter+0x2b/0x60 [ 9653.674578][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9653.674824][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9653.675144][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9653.675489][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9653.675799][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9653.676137][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9653.676435][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9653.676771][ C1] netif_receive_skb+0x55/0x280 [ 9653.677034][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9653.677373][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9653.677722][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9653.678041][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9653.678338][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9653.678647][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9653.678978][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9653.679262][ C1] ? arch_stack_walk+0x68/0x100 [ 9653.679529][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9653.679810][ C1] ? irqentry_enter+0x2b/0x60 [ 9653.680062][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9653.680389][ C1] ? irqentry_enter+0x2b/0x60 [ 9653.680640][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9653.680961][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9653.681244][ C1] ? arch_stack_walk+0x68/0x100 [ 9653.681502][ C1] __tcf_classify+0x32c/0x7d0 [ 9653.681754][ C1] tcf_classify+0x283/0x930 [ 9653.681995][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9653.682263][ C1] tc_run+0x2e4/0x5d0 [ 9653.682476][ C1] ? __pfx_tc_run+0x10/0x10 [ 9653.682719][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9653.682986][ C1] ? irqentry_enter+0x2b/0x60 [ 9653.683239][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9653.683527][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9653.683853][ C1] ip_finish_output2+0x786/0x18e0 [ 9653.684123][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9653.684411][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9653.684679][ C1] ? __ip_finish_output+0x10f/0x770 [ 9653.684957][ C1] ip_output+0x16b/0x4f0 [ 9653.685184][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9653.685506][ C1] ? __pfx_ip_output+0x10/0x10 [ 9653.685763][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9653.686118][ C1] ? __pfx_ip_output+0x10/0x10 [ 9653.686378][ C1] __ip_queue_xmit+0x672/0x1910 [ 9653.686640][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9653.686926][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9653.687221][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9653.687506][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9653.687800][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9653.688083][ C1] tcp_delack_timer+0x84/0x240 [ 9653.688335][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9653.688621][ C1] call_timer_fn+0x176/0x430 [ 9653.688870][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9653.689144][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9653.689423][ C1] __run_timers.part.0+0x52d/0x890 [ 9653.689705][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9653.689993][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9653.690294][ C1] ? __pfx___schedule+0x10/0x10 [ 9653.690553][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9653.690870][ C1] run_timer_softirq+0x72/0x100 [ 9653.691132][ C1] __do_softirq+0x1bc/0x7ff [ 9653.691378][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9653.691655][ C1] run_ksoftirqd+0x2e/0x60 [ 9653.691892][ C1] smpboot_thread_fn+0x30e/0x840 [ 9653.692162][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9653.692451][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9653.692742][ C1] kthread+0x292/0x360 [ 9653.692959][ C1] ? __pfx_kthread+0x10/0x10 [ 9653.693209][ C1] ret_from_fork+0x34/0x70 [ 9653.693445][ C1] ? __pfx_kthread+0x10/0x10 [ 9653.693692][ C1] ret_from_fork_asm+0x1b/0x30 [ 9653.693951][ C1] [ 9680.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7909s! [swapper/0:0] [ 9680.527929][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9680.529135][ C0] irq event stamp: 27567077 [ 9680.529386][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9680.529915][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9680.530401][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9680.530911][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9680.531412][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9680.531897][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9680.532540][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9680.532880][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9680.533901][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9680.534224][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9680.534644][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9680.535066][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9680.535485][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9680.535903][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9680.536324][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9680.536793][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9680.537149][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9680.537573][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9680.538001][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9680.538425][ C0] Call Trace: [ 9680.538605][ C0] [ 9680.538764][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9680.539040][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9680.539300][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9680.539599][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9680.539888][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9680.540190][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9680.540467][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9680.540790][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9680.541069][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9680.541343][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9680.541677][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9680.541991][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9680.542323][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9680.542630][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9680.542943][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9680.543246][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9680.543569][ C0] ? get_stack_info+0x36/0xc0 [ 9680.543825][ C0] ? lock_acquire+0x1c1/0x220 [ 9680.544080][ C0] ? lock_release+0x1d5/0x250 [ 9680.544335][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9680.544599][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9680.544890][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9680.545195][ C0] ? lock_acquire+0x1c1/0x220 [ 9680.545446][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9680.545699][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9680.545973][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9680.546225][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9680.546488][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9680.546762][ C0] ? __inet_lookup_established+0x341/0x610 [ 9680.547079][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9680.547367][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9680.547658][ C0] ip_local_deliver+0x19d/0x480 [ 9680.547925][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9680.548215][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9680.548483][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9680.548761][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9680.549024][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9680.549369][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9680.549649][ C0] ip_rcv+0x564/0x740 [ 9680.549865][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9680.550114][ C0] ? set_track_prepare+0x8a/0xd0 [ 9680.550382][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9680.550670][ C0] ? rest_init+0x153/0x260 [ 9680.550911][ C0] ? skb_clone+0x10b/0x330 [ 9680.551154][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9680.551493][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9680.551818][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9680.552112][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9680.552420][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9680.552680][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9680.552921][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9680.553235][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9680.553535][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9680.553878][ C0] ? lock_acquire+0x1c1/0x220 [ 9680.554133][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9680.554449][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9680.554749][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9680.555086][ C0] ? __copy_skb_header+0xaf/0x490 [ 9680.555356][ C0] ? __skb_clone+0x57a/0x760 [ 9680.555606][ C0] netif_receive_skb+0x55/0x280 [ 9680.555863][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9680.556189][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9680.556538][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9680.556857][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9680.557146][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9680.557446][ C0] ? hlock_class+0x4e/0x130 [ 9680.557689][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9680.558019][ C0] ? place_entity+0x21/0x2f0 [ 9680.558266][ C0] ? resched_curr+0x219/0x280 [ 9680.558521][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9680.558795][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9680.559081][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9680.559366][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9680.559632][ C0] ? activate_task+0xf5/0x260 [ 9680.559887][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9680.560165][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9680.560437][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9680.560698][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9680.560992][ C0] ? get_stack_info+0x36/0xc0 [ 9680.561241][ C0] ? stack_access_ok+0xda/0x1f0 [ 9680.561499][ C0] ? get_reg+0x119/0x190 [ 9680.561726][ C0] __tcf_classify+0x32c/0x7d0 [ 9680.561980][ C0] tcf_classify+0x283/0x930 [ 9680.562226][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9680.562558][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9680.562823][ C0] ? arch_stack_walk+0x8c/0x100 [ 9680.563083][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9680.563374][ C0] tc_run+0x2e4/0x5d0 [ 9680.563591][ C0] ? __pfx_tc_run+0x10/0x10 [ 9680.563838][ C0] ? lock_acquire+0x1c1/0x220 [ 9680.564100][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9680.564376][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9680.564641][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9680.564930][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9680.565212][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9680.565534][ C0] ? neigh_hh_output+0x348/0x590 [ 9680.565797][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9680.566085][ C0] ip_finish_output2+0x786/0x18e0 [ 9680.566357][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9680.566652][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9680.567002][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9680.567291][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9680.567559][ C0] ? __ip_finish_output+0x10f/0x770 [ 9680.567836][ C0] ip_output+0x16b/0x4f0 [ 9680.568063][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9680.568347][ C0] ? __pfx_ip_output+0x10/0x10 [ 9680.568598][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9680.568901][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9680.569164][ C0] ? ip_local_out+0x114/0x3b0 [ 9680.569423][ C0] __ip_queue_xmit+0x672/0x1910 [ 9680.569683][ C0] ? __skb_clone+0x57a/0x760 [ 9680.569928][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9680.570213][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9680.570511][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9680.570834][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9680.571093][ C0] ? tcp_current_mss+0x40a/0x510 [ 9680.571359][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9680.571638][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9680.571918][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9680.572175][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9680.572441][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9680.572757][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9680.573038][ C0] ? ktime_get+0xb6/0x190 [ 9680.573274][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9680.573552][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9680.573833][ C0] tcp_write_timer+0x82/0x1d0 [ 9680.574088][ C0] call_timer_fn+0x176/0x430 [ 9680.574337][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9680.574611][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9680.574889][ C0] __run_timers.part.0+0x52d/0x890 [ 9680.575162][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9680.575448][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9680.575745][ C0] ? lock_acquire+0x1c1/0x220 [ 9680.575997][ C0] ? clockevents_program_event+0xf6/0x300 [ 9680.576306][ C0] ? lock_release+0x1d5/0x250 [ 9680.576561][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9680.576841][ C0] ? ktime_get+0xb6/0x190 [ 9680.577077][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9680.577380][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9680.577692][ C0] run_timer_softirq+0x72/0x100 [ 9680.577954][ C0] __do_softirq+0x1bc/0x7ff [ 9680.578203][ C0] irq_exit_rcu+0x98/0xc0 [ 9680.578436][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9680.578741][ C0] [ 9680.578897][ C0] [ 9680.579055][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9680.579377][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9680.579646][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9680.580664][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9680.580987][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9680.581410][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9680.581830][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9680.582253][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9680.582673][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9680.583095][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9680.583397][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9680.583668][ C0] default_idle_call+0x69/0xa0 [ 9680.583924][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9680.584189][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9680.584486][ C0] ? lock_release+0x1d5/0x250 [ 9680.584741][ C0] do_idle+0xfb/0x160 [ 9680.584954][ C0] cpu_startup_entry+0x55/0x60 [ 9680.585209][ C0] rest_init+0x153/0x260 [ 9680.585437][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9680.585725][ C0] arch_call_rest_init+0x13/0x40 [ 9680.585990][ C0] start_kernel+0x314/0x3d0 [ 9680.586239][ C0] x86_64_start_reservations+0x18/0x30 [ 9680.586533][ C0] x86_64_start_kernel+0xba/0x110 [ 9680.586800][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9680.587125][ C0] [ 9680.587290][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7909s! [ksoftirqd/1:22] [ 9680.587757][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9680.588953][ C1] irq event stamp: 3886976 [ 9680.589193][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9680.589696][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9680.590193][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9680.590692][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9680.591180][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9680.591679][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9680.592327][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 9680.592666][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 9680.593683][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9680.594005][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9680.594424][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9680.594841][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9680.595258][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9680.595676][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9680.596108][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9680.596573][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9680.596927][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9680.597352][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9680.597771][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9680.598190][ C1] Call Trace: [ 9680.598372][ C1] [ 9680.598529][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9680.598802][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9680.599058][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9680.599344][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9680.599634][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9680.599940][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9680.600217][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9680.600534][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9680.600811][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9680.601132][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9680.601440][ C1] [ 9680.601599][ C1] [ 9680.601758][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9680.602091][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9680.602392][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 9680.602693][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9680.602995][ C1] ? run_ksoftirqd+0xb/0x60 [ 9680.603237][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9680.603563][ C1] ? __orc_find+0x9c/0xf0 [ 9680.603795][ C1] ? lock_acquire+0x1c1/0x220 [ 9680.604050][ C1] ? irqentry_enter+0x2b/0x60 [ 9680.604306][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9680.604571][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9680.604860][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9680.605161][ C1] ? lock_acquire+0x1c1/0x220 [ 9680.605407][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9680.605657][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9680.605928][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9680.606177][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9680.606441][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9680.606713][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9680.607007][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9680.607299][ C1] ip_local_deliver+0x19d/0x480 [ 9680.607558][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9680.607842][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9680.608107][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9680.608388][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9680.608653][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9680.608993][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9680.609272][ C1] ip_rcv+0x564/0x740 [ 9680.609494][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9680.609735][ C1] ? set_track_prepare+0x8a/0xd0 [ 9680.609998][ C1] ? irqentry_enter+0x2b/0x60 [ 9680.610250][ C1] ? irqentry_enter+0x2b/0x60 [ 9680.610503][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9680.610751][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9680.611068][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9680.611410][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9680.611722][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9680.612059][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9680.612354][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9680.612689][ C1] netif_receive_skb+0x55/0x280 [ 9680.612953][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9680.613283][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9680.613637][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9680.613948][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9680.614240][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9680.614547][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9680.614882][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9680.615165][ C1] ? arch_stack_walk+0x68/0x100 [ 9680.615423][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9680.615697][ C1] ? irqentry_enter+0x2b/0x60 [ 9680.615945][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9680.616265][ C1] ? irqentry_enter+0x2b/0x60 [ 9680.616520][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9680.616848][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9680.617126][ C1] ? arch_stack_walk+0x68/0x100 [ 9680.617388][ C1] __tcf_classify+0x32c/0x7d0 [ 9680.617644][ C1] tcf_classify+0x283/0x930 [ 9680.617889][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9680.618168][ C1] tc_run+0x2e4/0x5d0 [ 9680.618385][ C1] ? __pfx_tc_run+0x10/0x10 [ 9680.618631][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9680.618900][ C1] ? irqentry_enter+0x2b/0x60 [ 9680.619149][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9680.619441][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9680.619766][ C1] ip_finish_output2+0x786/0x18e0 [ 9680.620036][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9680.620321][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9680.620588][ C1] ? __ip_finish_output+0x10f/0x770 [ 9680.620864][ C1] ip_output+0x16b/0x4f0 [ 9680.621090][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9680.621412][ C1] ? __pfx_ip_output+0x10/0x10 [ 9680.621669][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9680.622022][ C1] ? __pfx_ip_output+0x10/0x10 [ 9680.622279][ C1] __ip_queue_xmit+0x672/0x1910 [ 9680.622539][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9680.622818][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9680.623112][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9680.623397][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9680.623691][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9680.623976][ C1] tcp_delack_timer+0x84/0x240 [ 9680.624231][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9680.624518][ C1] call_timer_fn+0x176/0x430 [ 9680.624769][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9680.625043][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9680.625323][ C1] __run_timers.part.0+0x52d/0x890 [ 9680.625597][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9680.625884][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9680.626183][ C1] ? __pfx___schedule+0x10/0x10 [ 9680.626444][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9680.626765][ C1] run_timer_softirq+0x72/0x100 [ 9680.627021][ C1] __do_softirq+0x1bc/0x7ff [ 9680.627262][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9680.627535][ C1] run_ksoftirqd+0x2e/0x60 [ 9680.627773][ C1] smpboot_thread_fn+0x30e/0x840 [ 9680.628040][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9680.628333][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9680.628622][ C1] kthread+0x292/0x360 [ 9680.628840][ C1] ? __pfx_kthread+0x10/0x10 [ 9680.629083][ C1] ret_from_fork+0x34/0x70 [ 9680.629327][ C1] ? __pfx_kthread+0x10/0x10 [ 9680.629580][ C1] ret_from_fork_asm+0x1b/0x30 [ 9680.629840][ C1] [ 9708.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7935s! [swapper/0:0] [ 9708.527923][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9708.529122][ C0] irq event stamp: 27567077 [ 9708.529371][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9708.529906][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9708.530383][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9708.530887][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9708.531379][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9708.531857][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9708.532506][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9708.532851][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9708.533880][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9708.534207][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9708.534631][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9708.535057][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9708.535477][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9708.535898][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9708.536323][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9708.536801][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9708.537148][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9708.537576][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9708.537996][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9708.538414][ C0] Call Trace: [ 9708.538591][ C0] [ 9708.538747][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9708.539026][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9708.539289][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9708.539581][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9708.539871][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9708.540176][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9708.540457][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9708.540780][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9708.541054][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9708.541333][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9708.541658][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9708.541967][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9708.542303][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9708.542605][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9708.542915][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9708.543221][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9708.543551][ C0] ? get_stack_info+0x36/0xc0 [ 9708.543802][ C0] ? lock_acquire+0x1c1/0x220 [ 9708.544053][ C0] ? lock_release+0x1d5/0x250 [ 9708.544301][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9708.544562][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9708.544844][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9708.545144][ C0] ? lock_acquire+0x1c1/0x220 [ 9708.545398][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9708.545657][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9708.545931][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9708.546176][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9708.546431][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9708.546698][ C0] ? __inet_lookup_established+0x341/0x610 [ 9708.547011][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9708.547302][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9708.547594][ C0] ip_local_deliver+0x19d/0x480 [ 9708.547851][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9708.548137][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9708.548402][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9708.548683][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9708.548948][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9708.549290][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9708.549562][ C0] ip_rcv+0x564/0x740 [ 9708.549777][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9708.550019][ C0] ? set_track_prepare+0x8a/0xd0 [ 9708.550282][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9708.550572][ C0] ? rest_init+0x153/0x260 [ 9708.550808][ C0] ? skb_clone+0x10b/0x330 [ 9708.551048][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9708.551378][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9708.551694][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9708.551989][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9708.552302][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9708.552563][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9708.552808][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9708.553123][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9708.553424][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9708.553762][ C0] ? lock_acquire+0x1c1/0x220 [ 9708.554011][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9708.554318][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9708.554618][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9708.554948][ C0] ? __copy_skb_header+0xaf/0x490 [ 9708.555214][ C0] ? __skb_clone+0x57a/0x760 [ 9708.555457][ C0] netif_receive_skb+0x55/0x280 [ 9708.555716][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9708.556047][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9708.556403][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9708.556715][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9708.557006][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9708.557308][ C0] ? hlock_class+0x4e/0x130 [ 9708.557556][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9708.557891][ C0] ? place_entity+0x21/0x2f0 [ 9708.558140][ C0] ? resched_curr+0x219/0x280 [ 9708.558387][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9708.558653][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9708.558935][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9708.559220][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9708.559481][ C0] ? activate_task+0xf5/0x260 [ 9708.559732][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9708.560005][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9708.560282][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9708.560540][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9708.560827][ C0] ? get_stack_info+0x36/0xc0 [ 9708.561081][ C0] ? stack_access_ok+0xda/0x1f0 [ 9708.561341][ C0] ? get_reg+0x119/0x190 [ 9708.561572][ C0] __tcf_classify+0x32c/0x7d0 [ 9708.561822][ C0] tcf_classify+0x283/0x930 [ 9708.562062][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9708.562389][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9708.562658][ C0] ? arch_stack_walk+0x8c/0x100 [ 9708.562921][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9708.563214][ C0] tc_run+0x2e4/0x5d0 [ 9708.563429][ C0] ? __pfx_tc_run+0x10/0x10 [ 9708.563672][ C0] ? lock_acquire+0x1c1/0x220 [ 9708.563921][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9708.564194][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9708.564463][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9708.564748][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9708.565023][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9708.565339][ C0] ? neigh_hh_output+0x348/0x590 [ 9708.565604][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9708.565879][ C0] ip_finish_output2+0x786/0x18e0 [ 9708.566145][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9708.566438][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9708.566792][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9708.567083][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9708.567347][ C0] ? __ip_finish_output+0x10f/0x770 [ 9708.567627][ C0] ip_output+0x16b/0x4f0 [ 9708.567857][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9708.568138][ C0] ? __pfx_ip_output+0x10/0x10 [ 9708.568393][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9708.568690][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9708.568958][ C0] ? ip_local_out+0x114/0x3b0 [ 9708.569210][ C0] __ip_queue_xmit+0x672/0x1910 [ 9708.569477][ C0] ? __skb_clone+0x57a/0x760 [ 9708.569726][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9708.570006][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9708.570301][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9708.570618][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9708.570879][ C0] ? tcp_current_mss+0x40a/0x510 [ 9708.571143][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9708.571426][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9708.571702][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9708.571956][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9708.572227][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9708.572549][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9708.572825][ C0] ? ktime_get+0xb6/0x190 [ 9708.573057][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9708.573328][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9708.573611][ C0] tcp_write_timer+0x82/0x1d0 [ 9708.573862][ C0] call_timer_fn+0x176/0x430 [ 9708.574112][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9708.574387][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9708.574659][ C0] __run_timers.part.0+0x52d/0x890 [ 9708.574933][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9708.575216][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9708.575518][ C0] ? lock_acquire+0x1c1/0x220 [ 9708.575767][ C0] ? clockevents_program_event+0xf6/0x300 [ 9708.576072][ C0] ? lock_release+0x1d5/0x250 [ 9708.576322][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9708.576597][ C0] ? ktime_get+0xb6/0x190 [ 9708.576827][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9708.577125][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9708.577441][ C0] run_timer_softirq+0x72/0x100 [ 9708.577700][ C0] __do_softirq+0x1bc/0x7ff [ 9708.577944][ C0] irq_exit_rcu+0x98/0xc0 [ 9708.578176][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9708.578475][ C0] [ 9708.578634][ C0] [ 9708.578793][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9708.579115][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9708.579389][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9708.580414][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9708.580738][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9708.581166][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9708.581585][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9708.582007][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9708.582431][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9708.582859][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9708.583164][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9708.583439][ C0] default_idle_call+0x69/0xa0 [ 9708.583693][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9708.583957][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9708.584247][ C0] ? lock_release+0x1d5/0x250 [ 9708.584502][ C0] do_idle+0xfb/0x160 [ 9708.584722][ C0] cpu_startup_entry+0x55/0x60 [ 9708.584980][ C0] rest_init+0x153/0x260 [ 9708.585205][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9708.585496][ C0] arch_call_rest_init+0x13/0x40 [ 9708.585765][ C0] start_kernel+0x314/0x3d0 [ 9708.586008][ C0] x86_64_start_reservations+0x18/0x30 [ 9708.586302][ C0] x86_64_start_kernel+0xba/0x110 [ 9708.586572][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9708.586902][ C0] [ 9708.587069][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7935s! [ksoftirqd/1:22] [ 9708.587541][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9708.588731][ C1] irq event stamp: 3886976 [ 9708.588966][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9708.589471][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9708.589972][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9708.590472][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9708.590963][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9708.591455][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9708.592092][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9708.592429][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9708.593447][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9708.593767][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9708.594186][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9708.594603][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9708.595023][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9708.595439][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9708.595856][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9708.596325][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9708.596678][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9708.597099][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9708.597525][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9708.597946][ C1] Call Trace: [ 9708.598125][ C1] [ 9708.598284][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9708.598558][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9708.598817][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9708.599107][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9708.599401][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9708.599702][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9708.599979][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9708.600300][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9708.600576][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9708.600895][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9708.601206][ C1] [ 9708.601365][ C1] [ 9708.601525][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9708.601856][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9708.602158][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9708.602466][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9708.602775][ C1] ? run_ksoftirqd+0xb/0x60 [ 9708.603021][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9708.603349][ C1] ? __orc_find+0x9c/0xf0 [ 9708.603577][ C1] ? lock_acquire+0x1c1/0x220 [ 9708.603827][ C1] ? irqentry_enter+0x2b/0x60 [ 9708.604081][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9708.604338][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9708.604622][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9708.604922][ C1] ? lock_acquire+0x1c1/0x220 [ 9708.605180][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9708.605438][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9708.605711][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9708.605955][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9708.606212][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9708.606483][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9708.606771][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9708.607063][ C1] ip_local_deliver+0x19d/0x480 [ 9708.607323][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9708.607612][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9708.607880][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9708.608156][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9708.608419][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9708.608756][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9708.609029][ C1] ip_rcv+0x564/0x740 [ 9708.609254][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9708.609498][ C1] ? set_track_prepare+0x8a/0xd0 [ 9708.609767][ C1] ? irqentry_enter+0x2b/0x60 [ 9708.610018][ C1] ? irqentry_enter+0x2b/0x60 [ 9708.610269][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9708.610509][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9708.610823][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9708.611165][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9708.611481][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9708.611824][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9708.612126][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9708.612456][ C1] netif_receive_skb+0x55/0x280 [ 9708.612713][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9708.613041][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9708.613395][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9708.613712][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9708.614001][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9708.614306][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9708.614635][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9708.614917][ C1] ? arch_stack_walk+0x68/0x100 [ 9708.615181][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9708.615462][ C1] ? irqentry_enter+0x2b/0x60 [ 9708.615717][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9708.616038][ C1] ? irqentry_enter+0x2b/0x60 [ 9708.616286][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9708.616613][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9708.616896][ C1] ? arch_stack_walk+0x68/0x100 [ 9708.617156][ C1] __tcf_classify+0x32c/0x7d0 [ 9708.617406][ C1] tcf_classify+0x283/0x930 [ 9708.617649][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9708.617917][ C1] tc_run+0x2e4/0x5d0 [ 9708.618139][ C1] ? __pfx_tc_run+0x10/0x10 [ 9708.618382][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9708.618650][ C1] ? irqentry_enter+0x2b/0x60 [ 9708.618906][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9708.619196][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9708.619522][ C1] ip_finish_output2+0x786/0x18e0 [ 9708.619803][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9708.620096][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9708.620360][ C1] ? __ip_finish_output+0x10f/0x770 [ 9708.620639][ C1] ip_output+0x16b/0x4f0 [ 9708.620868][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9708.621187][ C1] ? __pfx_ip_output+0x10/0x10 [ 9708.621443][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9708.621793][ C1] ? __pfx_ip_output+0x10/0x10 [ 9708.622050][ C1] __ip_queue_xmit+0x672/0x1910 [ 9708.622312][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9708.622594][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9708.622890][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9708.623177][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9708.623475][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9708.623764][ C1] tcp_delack_timer+0x84/0x240 [ 9708.624024][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9708.624309][ C1] call_timer_fn+0x176/0x430 [ 9708.624556][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9708.624835][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9708.625111][ C1] __run_timers.part.0+0x52d/0x890 [ 9708.625384][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9708.625676][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9708.625980][ C1] ? __pfx___schedule+0x10/0x10 [ 9708.626241][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9708.626562][ C1] run_timer_softirq+0x72/0x100 [ 9708.626825][ C1] __do_softirq+0x1bc/0x7ff [ 9708.627072][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9708.627348][ C1] run_ksoftirqd+0x2e/0x60 [ 9708.627584][ C1] smpboot_thread_fn+0x30e/0x840 [ 9708.627852][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9708.628142][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9708.628435][ C1] kthread+0x292/0x360 [ 9708.628653][ C1] ? __pfx_kthread+0x10/0x10 [ 9708.628902][ C1] ret_from_fork+0x34/0x70 [ 9708.629141][ C1] ? __pfx_kthread+0x10/0x10 [ 9708.629394][ C1] ret_from_fork_asm+0x1b/0x30 [ 9708.629656][ C1] [ 9731.695024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9731.695428][ C0] rcu: 0-....: (8478746 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=2031004 [ 9731.695946][ C0] rcu: (t=8537386 jiffies g=1007429 q=31 ncpus=4) [ 9731.696299][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9731.696776][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9731.697429][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9731.697778][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9731.698800][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9731.699129][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9731.699557][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9731.699981][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9731.700406][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9731.700835][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9731.701263][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9731.701740][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9731.702091][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9731.702518][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9731.702939][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9731.703359][ C0] Call Trace: [ 9731.703537][ C0] [ 9731.703692][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9731.703982][ C0] ? print_cpu_stall+0x263/0x6a0 [ 9731.704246][ C0] ? check_cpu_stall+0x284/0x500 [ 9731.704515][ C0] ? rcu_pending+0x92/0x360 [ 9731.704758][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9731.705042][ C0] ? update_process_times+0xb9/0x110 [ 9731.705329][ C0] ? tick_sched_handle+0x67/0x130 [ 9731.705596][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9731.705894][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9731.706150][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9731.706474][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9731.706761][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9731.707071][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9731.707353][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9731.707675][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9731.707949][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9731.708226][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9731.708546][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9731.708857][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9731.709195][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9731.709506][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9731.709817][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9731.710122][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9731.710448][ C0] ? get_stack_info+0x36/0xc0 [ 9731.710705][ C0] ? lock_acquire+0x1c1/0x220 [ 9731.710962][ C0] ? lock_release+0x1d5/0x250 [ 9731.711219][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9731.711485][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9731.711776][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9731.712092][ C0] ? lock_acquire+0x1c1/0x220 [ 9731.712339][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9731.712591][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9731.712864][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9731.713114][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9731.713379][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9731.713650][ C0] ? __inet_lookup_established+0x341/0x610 [ 9731.713968][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9731.714259][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9731.714552][ C0] ip_local_deliver+0x19d/0x480 [ 9731.714819][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9731.715108][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9731.715375][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9731.715650][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9731.715911][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9731.716252][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9731.716534][ C0] ip_rcv+0x564/0x740 [ 9731.716748][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9731.716993][ C0] ? set_track_prepare+0x8a/0xd0 [ 9731.717260][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9731.717548][ C0] ? rest_init+0x153/0x260 [ 9731.717789][ C0] ? skb_clone+0x10b/0x330 [ 9731.718029][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9731.718369][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9731.718689][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9731.718984][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9731.719299][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9731.719561][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9731.719805][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9731.720125][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9731.720427][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9731.720766][ C0] ? lock_acquire+0x1c1/0x220 [ 9731.721013][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9731.721324][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9731.721626][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9731.721956][ C0] ? __copy_skb_header+0xaf/0x490 [ 9731.722224][ C0] ? __skb_clone+0x57a/0x760 [ 9731.722467][ C0] netif_receive_skb+0x55/0x280 [ 9731.722730][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9731.723061][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9731.723412][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9731.723724][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9731.724014][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9731.724318][ C0] ? hlock_class+0x4e/0x130 [ 9731.724565][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9731.724905][ C0] ? place_entity+0x21/0x2f0 [ 9731.725160][ C0] ? resched_curr+0x219/0x280 [ 9731.725414][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9731.725681][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9731.725961][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9731.726243][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9731.726504][ C0] ? activate_task+0xf5/0x260 [ 9731.726757][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9731.727036][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9731.727311][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9731.727573][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9731.727867][ C0] ? get_stack_info+0x36/0xc0 [ 9731.728121][ C0] ? stack_access_ok+0xda/0x1f0 [ 9731.728380][ C0] ? get_reg+0x119/0x190 [ 9731.728606][ C0] __tcf_classify+0x32c/0x7d0 [ 9731.728863][ C0] tcf_classify+0x283/0x930 [ 9731.729114][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9731.729443][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9731.729713][ C0] ? arch_stack_walk+0x8c/0x100 [ 9731.729980][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9731.730276][ C0] tc_run+0x2e4/0x5d0 [ 9731.730489][ C0] ? __pfx_tc_run+0x10/0x10 [ 9731.730730][ C0] ? lock_acquire+0x1c1/0x220 [ 9731.730979][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9731.731255][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9731.731525][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9731.731812][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9731.732093][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9731.732412][ C0] ? neigh_hh_output+0x348/0x590 [ 9731.732679][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9731.732956][ C0] ip_finish_output2+0x786/0x18e0 [ 9731.733225][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9731.733517][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9731.733873][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9731.734169][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9731.734433][ C0] ? __ip_finish_output+0x10f/0x770 [ 9731.734716][ C0] ip_output+0x16b/0x4f0 [ 9731.734943][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9731.735223][ C0] ? __pfx_ip_output+0x10/0x10 [ 9731.735480][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9731.735779][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9731.736046][ C0] ? ip_local_out+0x114/0x3b0 [ 9731.736296][ C0] __ip_queue_xmit+0x672/0x1910 [ 9731.736553][ C0] ? __skb_clone+0x57a/0x760 [ 9731.736799][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9731.737084][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9731.737383][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9731.737706][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9731.737963][ C0] ? tcp_current_mss+0x40a/0x510 [ 9731.738228][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9731.738507][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9731.738786][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9731.739043][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9731.739317][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9731.739638][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9731.739913][ C0] ? ktime_get+0xb6/0x190 [ 9731.740145][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9731.740417][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9731.740703][ C0] tcp_write_timer+0x82/0x1d0 [ 9731.740951][ C0] call_timer_fn+0x176/0x430 [ 9731.741197][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9731.741473][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9731.741744][ C0] __run_timers.part.0+0x52d/0x890 [ 9731.742019][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9731.742303][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9731.742603][ C0] ? lock_acquire+0x1c1/0x220 [ 9731.742850][ C0] ? clockevents_program_event+0xf6/0x300 [ 9731.743154][ C0] ? lock_release+0x1d5/0x250 [ 9731.743404][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9731.743679][ C0] ? ktime_get+0xb6/0x190 [ 9731.743908][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9731.744205][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9731.744519][ C0] run_timer_softirq+0x72/0x100 [ 9731.744778][ C0] __do_softirq+0x1bc/0x7ff [ 9731.745020][ C0] irq_exit_rcu+0x98/0xc0 [ 9731.745251][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9731.745549][ C0] [ 9731.745708][ C0] [ 9731.745867][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9731.746192][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9731.746461][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9731.747480][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9731.747805][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9731.748225][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9731.748642][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9731.749062][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9731.749490][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9731.749912][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9731.750219][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9731.750494][ C0] default_idle_call+0x69/0xa0 [ 9731.750746][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9731.751012][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9731.751304][ C0] ? lock_release+0x1d5/0x250 [ 9731.751559][ C0] do_idle+0xfb/0x160 [ 9731.751773][ C0] cpu_startup_entry+0x55/0x60 [ 9731.752030][ C0] rest_init+0x153/0x260 [ 9731.752257][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9731.752549][ C0] arch_call_rest_init+0x13/0x40 [ 9731.752816][ C0] start_kernel+0x314/0x3d0 [ 9731.753058][ C0] x86_64_start_reservations+0x18/0x30 [ 9731.753348][ C0] x86_64_start_kernel+0xba/0x110 [ 9731.753617][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9731.753945][ C0] [ 9731.754118][ C0] Sending NMI from CPU 0 to CPUs 1: [ 9731.754418][ C1] NMI backtrace for cpu 1 [ 9731.754426][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9731.754431][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9731.754433][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9731.754441][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9731.754445][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9731.754449][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9731.754451][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9731.754453][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9731.754455][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9731.754456][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9731.754458][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9731.754460][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9731.754464][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9731.754465][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9731.754467][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9731.754468][ C1] Call Trace: [ 9731.754471][ C1] [ 9731.754475][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 9731.754481][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9731.754486][ C1] ? nmi_handle+0x156/0x420 [ 9731.754491][ C1] ? default_do_nmi+0x41/0x100 [ 9731.754495][ C1] ? exc_nmi+0xf3/0x120 [ 9731.754498][ C1] ? end_repeat_nmi+0xf/0x60 [ 9731.754503][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9731.754507][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9731.754511][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9731.754514][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9731.754518][ C1] [ 9731.754519][ C1] [ 9731.754520][ C1] ? run_ksoftirqd+0xb/0x60 [ 9731.754526][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9731.754529][ C1] ? __orc_find+0x9c/0xf0 [ 9731.754531][ C1] ? lock_acquire+0x1c1/0x220 [ 9731.754536][ C1] ? irqentry_enter+0x2b/0x60 [ 9731.754541][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9731.754545][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9731.754548][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9731.754551][ C1] ? lock_acquire+0x1c1/0x220 [ 9731.754554][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9731.754560][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9731.754563][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9731.754571][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9731.754574][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9731.754580][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9731.754587][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9731.754591][ C1] ip_local_deliver+0x19d/0x480 [ 9731.754595][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9731.754598][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9731.754603][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9731.754606][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9731.754609][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9731.754613][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9731.754623][ C1] ip_rcv+0x564/0x740 [ 9731.754626][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9731.754629][ C1] ? set_track_prepare+0x8a/0xd0 [ 9731.754633][ C1] ? irqentry_enter+0x2b/0x60 [ 9731.754637][ C1] ? irqentry_enter+0x2b/0x60 [ 9731.754640][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9731.754643][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9731.754647][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9731.754651][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9731.754654][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9731.754656][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9731.754660][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9731.754665][ C1] netif_receive_skb+0x55/0x280 [ 9731.754668][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9731.754677][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9731.754684][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9731.754691][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9731.754699][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9731.754711][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9731.754721][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9731.754723][ C1] ? arch_stack_walk+0x68/0x100 [ 9731.754728][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9731.754732][ C1] ? irqentry_enter+0x2b/0x60 [ 9731.754735][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9731.754740][ C1] ? irqentry_enter+0x2b/0x60 [ 9731.754743][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9731.754750][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9731.754753][ C1] ? arch_stack_walk+0x68/0x100 [ 9731.754757][ C1] __tcf_classify+0x32c/0x7d0 [ 9731.754763][ C1] tcf_classify+0x283/0x930 [ 9731.754766][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9731.754771][ C1] tc_run+0x2e4/0x5d0 [ 9731.754776][ C1] ? __pfx_tc_run+0x10/0x10 [ 9731.754781][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9731.754787][ C1] ? irqentry_enter+0x2b/0x60 [ 9731.754790][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9731.754793][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9731.754800][ C1] ip_finish_output2+0x786/0x18e0 [ 9731.754805][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9731.754808][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9731.754812][ C1] ? __ip_finish_output+0x10f/0x770 [ 9731.754816][ C1] ip_output+0x16b/0x4f0 [ 9731.754819][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9731.754822][ C1] ? __pfx_ip_output+0x10/0x10 [ 9731.754826][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9731.754833][ C1] ? __pfx_ip_output+0x10/0x10 [ 9731.754838][ C1] __ip_queue_xmit+0x672/0x1910 [ 9731.754843][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9731.754851][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9731.754855][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9731.754859][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9731.754864][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9731.754867][ C1] tcp_delack_timer+0x84/0x240 [ 9731.754871][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9731.754873][ C1] call_timer_fn+0x176/0x430 [ 9731.754878][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9731.754883][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9731.754887][ C1] __run_timers.part.0+0x52d/0x890 [ 9731.754890][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9731.754895][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9731.754900][ C1] ? __pfx___schedule+0x10/0x10 [ 9731.754904][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9731.754909][ C1] run_timer_softirq+0x72/0x100 [ 9731.754913][ C1] __do_softirq+0x1bc/0x7ff [ 9731.754917][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9731.754921][ C1] run_ksoftirqd+0x2e/0x60 [ 9731.754924][ C1] smpboot_thread_fn+0x30e/0x840 [ 9731.754930][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9731.754934][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9731.754937][ C1] kthread+0x292/0x360 [ 9731.754940][ C1] ? __pfx_kthread+0x10/0x10 [ 9731.754943][ C1] ret_from_fork+0x34/0x70 [ 9731.754946][ C1] ? __pfx_kthread+0x10/0x10 [ 9731.754948][ C1] ret_from_fork_asm+0x1b/0x30 [ 9731.754956][ C1] [ 9756.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 7980s! [swapper/0:0] [ 9756.527931][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9756.529145][ C0] irq event stamp: 27567077 [ 9756.529383][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9756.529915][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9756.530393][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9756.530904][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9756.531404][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9756.531893][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9756.532540][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9756.532880][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9756.533896][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9756.534221][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9756.534638][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9756.535059][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9756.535478][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9756.535895][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9756.536314][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9756.536780][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9756.537133][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9756.537553][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9756.537974][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9756.538402][ C0] Call Trace: [ 9756.538589][ C0] [ 9756.538745][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9756.539029][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9756.539293][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9756.539585][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9756.539868][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9756.540171][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9756.540449][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9756.540767][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9756.541046][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9756.541326][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9756.541662][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9756.541978][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9756.542307][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9756.542614][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9756.542925][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9756.543229][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9756.543555][ C0] ? get_stack_info+0x36/0xc0 [ 9756.543811][ C0] ? lock_acquire+0x1c1/0x220 [ 9756.544068][ C0] ? lock_release+0x1d5/0x250 [ 9756.544323][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9756.544586][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9756.544872][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9756.545173][ C0] ? lock_acquire+0x1c1/0x220 [ 9756.545419][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9756.545671][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9756.545941][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9756.546192][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9756.546457][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9756.546727][ C0] ? __inet_lookup_established+0x341/0x610 [ 9756.547045][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9756.547333][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9756.547621][ C0] ip_local_deliver+0x19d/0x480 [ 9756.547880][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9756.548166][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9756.548432][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9756.548706][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9756.548968][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9756.549311][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9756.549595][ C0] ip_rcv+0x564/0x740 [ 9756.549815][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9756.550061][ C0] ? set_track_prepare+0x8a/0xd0 [ 9756.550328][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9756.550617][ C0] ? rest_init+0x153/0x260 [ 9756.550854][ C0] ? skb_clone+0x10b/0x330 [ 9756.551093][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9756.551431][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9756.551753][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9756.552048][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9756.552355][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9756.552613][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9756.552861][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9756.553178][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9756.553474][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9756.553818][ C0] ? lock_acquire+0x1c1/0x220 [ 9756.554073][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9756.554385][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9756.554681][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9756.555013][ C0] ? __copy_skb_header+0xaf/0x490 [ 9756.555286][ C0] ? __skb_clone+0x57a/0x760 [ 9756.555535][ C0] netif_receive_skb+0x55/0x280 [ 9756.555796][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9756.556124][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9756.556470][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9756.556785][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9756.557071][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9756.557367][ C0] ? hlock_class+0x4e/0x130 [ 9756.557610][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9756.557934][ C0] ? place_entity+0x21/0x2f0 [ 9756.558180][ C0] ? resched_curr+0x219/0x280 [ 9756.558432][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9756.558708][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9756.558999][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9756.559281][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9756.559540][ C0] ? activate_task+0xf5/0x260 [ 9756.559791][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9756.560068][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9756.560339][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9756.560603][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9756.560896][ C0] ? get_stack_info+0x36/0xc0 [ 9756.561148][ C0] ? stack_access_ok+0xda/0x1f0 [ 9756.561405][ C0] ? get_reg+0x119/0x190 [ 9756.561635][ C0] __tcf_classify+0x32c/0x7d0 [ 9756.561891][ C0] tcf_classify+0x283/0x930 [ 9756.562138][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9756.562466][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9756.562731][ C0] ? arch_stack_walk+0x8c/0x100 [ 9756.562990][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9756.563278][ C0] tc_run+0x2e4/0x5d0 [ 9756.563497][ C0] ? __pfx_tc_run+0x10/0x10 [ 9756.563741][ C0] ? lock_acquire+0x1c1/0x220 [ 9756.563991][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9756.564269][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9756.564533][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9756.564819][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9756.565100][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9756.565423][ C0] ? neigh_hh_output+0x348/0x590 [ 9756.565694][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9756.565974][ C0] ip_finish_output2+0x786/0x18e0 [ 9756.566245][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9756.566536][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9756.566886][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9756.567175][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9756.567438][ C0] ? __ip_finish_output+0x10f/0x770 [ 9756.567711][ C0] ip_output+0x16b/0x4f0 [ 9756.567938][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9756.568223][ C0] ? __pfx_ip_output+0x10/0x10 [ 9756.568483][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9756.568783][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9756.569052][ C0] ? ip_local_out+0x114/0x3b0 [ 9756.569299][ C0] __ip_queue_xmit+0x672/0x1910 [ 9756.569558][ C0] ? __skb_clone+0x57a/0x760 [ 9756.569803][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9756.570091][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9756.570389][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9756.570709][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9756.570963][ C0] ? tcp_current_mss+0x40a/0x510 [ 9756.571229][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9756.571508][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9756.571785][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9756.572039][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9756.572306][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9756.572622][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9756.572901][ C0] ? ktime_get+0xb6/0x190 [ 9756.573140][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9756.573417][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9756.573697][ C0] tcp_write_timer+0x82/0x1d0 [ 9756.573950][ C0] call_timer_fn+0x176/0x430 [ 9756.574199][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9756.574470][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9756.574745][ C0] __run_timers.part.0+0x52d/0x890 [ 9756.575014][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9756.575299][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9756.575596][ C0] ? lock_acquire+0x1c1/0x220 [ 9756.575848][ C0] ? clockevents_program_event+0xf6/0x300 [ 9756.576156][ C0] ? lock_release+0x1d5/0x250 [ 9756.576408][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9756.576686][ C0] ? ktime_get+0xb6/0x190 [ 9756.576916][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9756.577218][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9756.577525][ C0] run_timer_softirq+0x72/0x100 [ 9756.577785][ C0] __do_softirq+0x1bc/0x7ff [ 9756.578031][ C0] irq_exit_rcu+0x98/0xc0 [ 9756.578264][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9756.578562][ C0] [ 9756.578717][ C0] [ 9756.578872][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9756.579199][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9756.579465][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9756.580475][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9756.580793][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9756.581209][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9756.581625][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9756.582040][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9756.582453][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9756.582868][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9756.583171][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9756.583443][ C0] default_idle_call+0x69/0xa0 [ 9756.583699][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9756.583960][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9756.584264][ C0] ? lock_release+0x1d5/0x250 [ 9756.584511][ C0] do_idle+0xfb/0x160 [ 9756.584722][ C0] cpu_startup_entry+0x55/0x60 [ 9756.584972][ C0] rest_init+0x153/0x260 [ 9756.585204][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9756.585488][ C0] arch_call_rest_init+0x13/0x40 [ 9756.585753][ C0] start_kernel+0x314/0x3d0 [ 9756.586000][ C0] x86_64_start_reservations+0x18/0x30 [ 9756.586294][ C0] x86_64_start_kernel+0xba/0x110 [ 9756.586561][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9756.586889][ C0] [ 9756.587055][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7980s! [ksoftirqd/1:22] [ 9756.587519][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9756.588703][ C1] irq event stamp: 3886976 [ 9756.588940][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9756.589445][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9756.589938][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9756.590433][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9756.590925][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9756.591417][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9756.592059][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9756.592396][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9756.593411][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9756.593734][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9756.594152][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9756.594567][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9756.594983][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9756.595401][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9756.595818][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9756.596284][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9756.596634][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9756.597051][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9756.597470][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9756.597894][ C1] Call Trace: [ 9756.598080][ C1] [ 9756.598236][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9756.598514][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9756.598770][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9756.599063][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9756.599346][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9756.599645][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9756.599924][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9756.600242][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9756.600517][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9756.600838][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9756.601145][ C1] [ 9756.601303][ C1] [ 9756.601462][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9756.601800][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9756.602101][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9756.602410][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9756.602712][ C1] ? run_ksoftirqd+0xb/0x60 [ 9756.602956][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9756.603287][ C1] ? __orc_find+0x9c/0xf0 [ 9756.603516][ C1] ? lock_acquire+0x1c1/0x220 [ 9756.603766][ C1] ? irqentry_enter+0x2b/0x60 [ 9756.604016][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9756.604276][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9756.604559][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9756.604855][ C1] ? lock_acquire+0x1c1/0x220 [ 9756.605105][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9756.605359][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9756.605634][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9756.605881][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9756.606139][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9756.606408][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9756.606694][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9756.606982][ C1] ip_local_deliver+0x19d/0x480 [ 9756.607245][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9756.607532][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9756.607799][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9756.608074][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9756.608335][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9756.608672][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9756.608945][ C1] ip_rcv+0x564/0x740 [ 9756.609166][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9756.609411][ C1] ? set_track_prepare+0x8a/0xd0 [ 9756.609677][ C1] ? irqentry_enter+0x2b/0x60 [ 9756.609925][ C1] ? irqentry_enter+0x2b/0x60 [ 9756.610173][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9756.610411][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9756.610723][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9756.611059][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9756.611365][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9756.611704][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9756.612004][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9756.612334][ C1] netif_receive_skb+0x55/0x280 [ 9756.612592][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9756.612918][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9756.613264][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9756.613577][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9756.613868][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9756.614171][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9756.614495][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9756.614772][ C1] ? arch_stack_walk+0x68/0x100 [ 9756.615033][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9756.615313][ C1] ? irqentry_enter+0x2b/0x60 [ 9756.615564][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9756.615887][ C1] ? irqentry_enter+0x2b/0x60 [ 9756.616137][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9756.616455][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9756.616737][ C1] ? arch_stack_walk+0x68/0x100 [ 9756.616999][ C1] __tcf_classify+0x32c/0x7d0 [ 9756.617250][ C1] tcf_classify+0x283/0x930 [ 9756.617490][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9756.617757][ C1] tc_run+0x2e4/0x5d0 [ 9756.617969][ C1] ? __pfx_tc_run+0x10/0x10 [ 9756.618215][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9756.618481][ C1] ? irqentry_enter+0x2b/0x60 [ 9756.618732][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9756.619022][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9756.619344][ C1] ip_finish_output2+0x786/0x18e0 [ 9756.619615][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9756.619903][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9756.620167][ C1] ? __ip_finish_output+0x10f/0x770 [ 9756.620445][ C1] ip_output+0x16b/0x4f0 [ 9756.620675][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9756.620993][ C1] ? __pfx_ip_output+0x10/0x10 [ 9756.621252][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9756.621604][ C1] ? __pfx_ip_output+0x10/0x10 [ 9756.621859][ C1] __ip_queue_xmit+0x672/0x1910 [ 9756.622125][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9756.622408][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9756.622707][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9756.622996][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9756.623292][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9756.623578][ C1] tcp_delack_timer+0x84/0x240 [ 9756.623835][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9756.624117][ C1] call_timer_fn+0x176/0x430 [ 9756.624363][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9756.624639][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9756.624914][ C1] __run_timers.part.0+0x52d/0x890 [ 9756.625184][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9756.625472][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9756.625771][ C1] ? __pfx___schedule+0x10/0x10 [ 9756.626028][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9756.626344][ C1] run_timer_softirq+0x72/0x100 [ 9756.626606][ C1] __do_softirq+0x1bc/0x7ff [ 9756.626851][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9756.627128][ C1] run_ksoftirqd+0x2e/0x60 [ 9756.627366][ C1] smpboot_thread_fn+0x30e/0x840 [ 9756.627634][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9756.627923][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9756.628215][ C1] kthread+0x292/0x360 [ 9756.628430][ C1] ? __pfx_kthread+0x10/0x10 [ 9756.628682][ C1] ret_from_fork+0x34/0x70 [ 9756.628917][ C1] ? __pfx_kthread+0x10/0x10 [ 9756.629174][ C1] ret_from_fork_asm+0x1b/0x30 [ 9756.629438][ C1] [ 9784.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8006s! [swapper/0:0] [ 9784.527931][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9784.529134][ C0] irq event stamp: 27567077 [ 9784.529375][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9784.529907][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9784.530393][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9784.530901][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9784.531398][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9784.531879][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9784.532521][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9784.532861][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9784.533879][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9784.534200][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9784.534618][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9784.535036][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9784.535453][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9784.535869][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9784.536289][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9784.536759][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9784.537111][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9784.537534][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9784.537962][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9784.538385][ C0] Call Trace: [ 9784.538564][ C0] [ 9784.538724][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9784.539010][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9784.539266][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9784.539561][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9784.539847][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9784.540148][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9784.540428][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9784.540751][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9784.541027][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9784.541303][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9784.541633][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9784.541946][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9784.542277][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9784.542584][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9784.542899][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9784.543202][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9784.543526][ C0] ? get_stack_info+0x36/0xc0 [ 9784.543783][ C0] ? lock_acquire+0x1c1/0x220 [ 9784.544038][ C0] ? lock_release+0x1d5/0x250 [ 9784.544292][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9784.544555][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9784.544844][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9784.545148][ C0] ? lock_acquire+0x1c1/0x220 [ 9784.545398][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9784.545653][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9784.545925][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9784.546175][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9784.546443][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9784.546716][ C0] ? __inet_lookup_established+0x341/0x610 [ 9784.547036][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9784.547324][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9784.547611][ C0] ip_local_deliver+0x19d/0x480 [ 9784.547877][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9784.548170][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9784.548449][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9784.548725][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9784.548994][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9784.549334][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9784.549614][ C0] ip_rcv+0x564/0x740 [ 9784.549829][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9784.550074][ C0] ? set_track_prepare+0x8a/0xd0 [ 9784.550340][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9784.550626][ C0] ? rest_init+0x153/0x260 [ 9784.550865][ C0] ? skb_clone+0x10b/0x330 [ 9784.551106][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9784.551443][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9784.551765][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9784.552057][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9784.552364][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9784.552624][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9784.552864][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9784.553176][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9784.553479][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9784.553822][ C0] ? lock_acquire+0x1c1/0x220 [ 9784.554074][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9784.554386][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9784.554685][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9784.555019][ C0] ? __copy_skb_header+0xaf/0x490 [ 9784.555288][ C0] ? __skb_clone+0x57a/0x760 [ 9784.555535][ C0] netif_receive_skb+0x55/0x280 [ 9784.555791][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9784.556115][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9784.556462][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9784.556782][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9784.557069][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9784.557367][ C0] ? hlock_class+0x4e/0x130 [ 9784.557611][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9784.557939][ C0] ? place_entity+0x21/0x2f0 [ 9784.558186][ C0] ? resched_curr+0x219/0x280 [ 9784.558445][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9784.558717][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9784.559007][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9784.559289][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9784.559554][ C0] ? activate_task+0xf5/0x260 [ 9784.559809][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9784.560091][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9784.560362][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9784.560623][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9784.560914][ C0] ? get_stack_info+0x36/0xc0 [ 9784.561163][ C0] ? stack_access_ok+0xda/0x1f0 [ 9784.561419][ C0] ? get_reg+0x119/0x190 [ 9784.561645][ C0] __tcf_classify+0x32c/0x7d0 [ 9784.561897][ C0] tcf_classify+0x283/0x930 [ 9784.562140][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9784.562472][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9784.562737][ C0] ? arch_stack_walk+0x8c/0x100 [ 9784.562997][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9784.563288][ C0] tc_run+0x2e4/0x5d0 [ 9784.563505][ C0] ? __pfx_tc_run+0x10/0x10 [ 9784.563751][ C0] ? lock_acquire+0x1c1/0x220 [ 9784.564005][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9784.564282][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9784.564548][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9784.564838][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9784.565118][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9784.565440][ C0] ? neigh_hh_output+0x348/0x590 [ 9784.565704][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9784.565985][ C0] ip_finish_output2+0x786/0x18e0 [ 9784.566256][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9784.566552][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9784.566903][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9784.567191][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9784.567466][ C0] ? __ip_finish_output+0x10f/0x770 [ 9784.567744][ C0] ip_output+0x16b/0x4f0 [ 9784.567969][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9784.568254][ C0] ? __pfx_ip_output+0x10/0x10 [ 9784.568506][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9784.568808][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9784.569080][ C0] ? ip_local_out+0x114/0x3b0 [ 9784.569331][ C0] __ip_queue_xmit+0x672/0x1910 [ 9784.569590][ C0] ? __skb_clone+0x57a/0x760 [ 9784.569835][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9784.570119][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9784.570418][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9784.570741][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9784.570998][ C0] ? tcp_current_mss+0x40a/0x510 [ 9784.571267][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9784.571546][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9784.571825][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9784.572083][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9784.572348][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9784.572663][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9784.572943][ C0] ? ktime_get+0xb6/0x190 [ 9784.573176][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9784.573454][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9784.573733][ C0] tcp_write_timer+0x82/0x1d0 [ 9784.573991][ C0] call_timer_fn+0x176/0x430 [ 9784.574241][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9784.574515][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9784.574792][ C0] __run_timers.part.0+0x52d/0x890 [ 9784.575063][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9784.575350][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9784.575647][ C0] ? lock_acquire+0x1c1/0x220 [ 9784.575898][ C0] ? clockevents_program_event+0xf6/0x300 [ 9784.576206][ C0] ? lock_release+0x1d5/0x250 [ 9784.576460][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9784.576739][ C0] ? ktime_get+0xb6/0x190 [ 9784.576974][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9784.577274][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9784.577584][ C0] run_timer_softirq+0x72/0x100 [ 9784.577846][ C0] __do_softirq+0x1bc/0x7ff [ 9784.578094][ C0] irq_exit_rcu+0x98/0xc0 [ 9784.578326][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9784.578629][ C0] [ 9784.578785][ C0] [ 9784.578950][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9784.579270][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9784.579538][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9784.580558][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9784.580881][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9784.581297][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9784.581713][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9784.582127][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9784.582544][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9784.582962][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9784.583262][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9784.583533][ C0] default_idle_call+0x69/0xa0 [ 9784.583789][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9784.584049][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9784.584345][ C0] ? lock_release+0x1d5/0x250 [ 9784.584595][ C0] do_idle+0xfb/0x160 [ 9784.584809][ C0] cpu_startup_entry+0x55/0x60 [ 9784.585061][ C0] rest_init+0x153/0x260 [ 9784.585287][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9784.585573][ C0] arch_call_rest_init+0x13/0x40 [ 9784.585837][ C0] start_kernel+0x314/0x3d0 [ 9784.586083][ C0] x86_64_start_reservations+0x18/0x30 [ 9784.586376][ C0] x86_64_start_kernel+0xba/0x110 [ 9784.586642][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9784.586966][ C0] [ 9784.587129][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8006s! [ksoftirqd/1:22] [ 9784.587583][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9784.588765][ C1] irq event stamp: 3886976 [ 9784.589006][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9784.589498][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9784.589989][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9784.590484][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9784.590976][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9784.591466][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9784.592106][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9784.592443][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9784.593452][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9784.593771][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9784.594186][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9784.594604][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9784.595020][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9784.595436][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9784.595851][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9784.596321][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9784.596670][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9784.597090][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9784.597512][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9784.597941][ C1] Call Trace: [ 9784.598125][ C1] [ 9784.598281][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9784.598555][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9784.598812][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9784.599116][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9784.599401][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9784.599701][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9784.599976][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9784.600294][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9784.600571][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9784.600895][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9784.601202][ C1] [ 9784.601362][ C1] [ 9784.601523][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9784.601854][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9784.602155][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9784.602462][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9784.602764][ C1] ? run_ksoftirqd+0xb/0x60 [ 9784.603010][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9784.603338][ C1] ? __orc_find+0x9c/0xf0 [ 9784.603567][ C1] ? lock_acquire+0x1c1/0x220 [ 9784.603817][ C1] ? irqentry_enter+0x2b/0x60 [ 9784.604072][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9784.604330][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9784.604611][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9784.604906][ C1] ? lock_acquire+0x1c1/0x220 [ 9784.605159][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9784.605416][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9784.605691][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9784.605936][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9784.606193][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9784.606461][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9784.606748][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9784.607039][ C1] ip_local_deliver+0x19d/0x480 [ 9784.607299][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9784.607585][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9784.607849][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9784.608123][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9784.608384][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9784.608721][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9784.608999][ C1] ip_rcv+0x564/0x740 [ 9784.609212][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9784.609455][ C1] ? set_track_prepare+0x8a/0xd0 [ 9784.609718][ C1] ? irqentry_enter+0x2b/0x60 [ 9784.609966][ C1] ? irqentry_enter+0x2b/0x60 [ 9784.610213][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9784.610451][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9784.610768][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9784.611106][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9784.611411][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9784.611751][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9784.612052][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9784.612382][ C1] netif_receive_skb+0x55/0x280 [ 9784.612639][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9784.612965][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9784.613309][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9784.613626][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9784.613913][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9784.614214][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9784.614543][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9784.614822][ C1] ? arch_stack_walk+0x68/0x100 [ 9784.615087][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9784.615365][ C1] ? irqentry_enter+0x2b/0x60 [ 9784.615618][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9784.615938][ C1] ? irqentry_enter+0x2b/0x60 [ 9784.616187][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9784.616510][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9784.616793][ C1] ? arch_stack_walk+0x68/0x100 [ 9784.617053][ C1] __tcf_classify+0x32c/0x7d0 [ 9784.617305][ C1] tcf_classify+0x283/0x930 [ 9784.617548][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9784.617816][ C1] tc_run+0x2e4/0x5d0 [ 9784.618028][ C1] ? __pfx_tc_run+0x10/0x10 [ 9784.618270][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9784.618535][ C1] ? irqentry_enter+0x2b/0x60 [ 9784.618788][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9784.619078][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9784.619397][ C1] ip_finish_output2+0x786/0x18e0 [ 9784.619669][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9784.619961][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9784.620226][ C1] ? __ip_finish_output+0x10f/0x770 [ 9784.620505][ C1] ip_output+0x16b/0x4f0 [ 9784.620732][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9784.621050][ C1] ? __pfx_ip_output+0x10/0x10 [ 9784.621309][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9784.621662][ C1] ? __pfx_ip_output+0x10/0x10 [ 9784.621917][ C1] __ip_queue_xmit+0x672/0x1910 [ 9784.622181][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9784.622465][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9784.622762][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9784.623052][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9784.623347][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9784.623633][ C1] tcp_delack_timer+0x84/0x240 [ 9784.623890][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9784.624173][ C1] call_timer_fn+0x176/0x430 [ 9784.624417][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9784.624693][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9784.624971][ C1] __run_timers.part.0+0x52d/0x890 [ 9784.625241][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9784.625530][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9784.625832][ C1] ? __pfx___schedule+0x10/0x10 [ 9784.626090][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9784.626408][ C1] run_timer_softirq+0x72/0x100 [ 9784.626672][ C1] __do_softirq+0x1bc/0x7ff [ 9784.626918][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9784.627193][ C1] run_ksoftirqd+0x2e/0x60 [ 9784.627431][ C1] smpboot_thread_fn+0x30e/0x840 [ 9784.627698][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9784.627985][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9784.628276][ C1] kthread+0x292/0x360 [ 9784.628494][ C1] ? __pfx_kthread+0x10/0x10 [ 9784.628743][ C1] ret_from_fork+0x34/0x70 [ 9784.628986][ C1] ? __pfx_kthread+0x10/0x10 [ 9784.629230][ C1] ret_from_fork_asm+0x1b/0x30 [ 9784.629491][ C1] [ 9809.758023][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9809.758417][ C0] rcu: 0-....: (8556632 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=2050234 [ 9809.758944][ C0] rcu: (t=8615449 jiffies g=1007429 q=31 ncpus=4) [ 9809.759293][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9809.759775][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9809.760424][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9809.760775][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9809.761799][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9809.762123][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9809.762544][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9809.762967][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9809.763387][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9809.763810][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9809.764231][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9809.764705][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9809.765049][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9809.765471][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9809.765886][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9809.766304][ C0] Call Trace: [ 9809.766480][ C0] [ 9809.766635][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9809.766924][ C0] ? print_cpu_stall+0x263/0x6a0 [ 9809.767198][ C0] ? check_cpu_stall+0x284/0x500 [ 9809.767468][ C0] ? rcu_pending+0x92/0x360 [ 9809.767710][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9809.767989][ C0] ? update_process_times+0xb9/0x110 [ 9809.768275][ C0] ? tick_sched_handle+0x67/0x130 [ 9809.768543][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9809.768847][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9809.769100][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9809.769434][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9809.769718][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9809.770017][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9809.770297][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9809.770620][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9809.770895][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9809.771170][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9809.771498][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9809.771809][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9809.772139][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9809.772444][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9809.772757][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9809.773056][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9809.773379][ C0] ? get_stack_info+0x36/0xc0 [ 9809.773640][ C0] ? lock_acquire+0x1c1/0x220 [ 9809.773893][ C0] ? lock_release+0x1d5/0x250 [ 9809.774144][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9809.774405][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9809.774693][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9809.775001][ C0] ? lock_acquire+0x1c1/0x220 [ 9809.775249][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9809.775501][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9809.775772][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9809.776024][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9809.776284][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9809.776555][ C0] ? __inet_lookup_established+0x341/0x610 [ 9809.776874][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9809.777159][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9809.777446][ C0] ip_local_deliver+0x19d/0x480 [ 9809.777715][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9809.778001][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9809.778267][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9809.778547][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9809.778813][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9809.779147][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9809.779424][ C0] ip_rcv+0x564/0x740 [ 9809.779638][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9809.779884][ C0] ? set_track_prepare+0x8a/0xd0 [ 9809.780154][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9809.780439][ C0] ? rest_init+0x153/0x260 [ 9809.780681][ C0] ? skb_clone+0x10b/0x330 [ 9809.780927][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9809.781262][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9809.781585][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9809.781876][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9809.782188][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9809.782445][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9809.782684][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9809.782994][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9809.783290][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9809.783633][ C0] ? lock_acquire+0x1c1/0x220 [ 9809.783884][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9809.784198][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9809.784496][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9809.784832][ C0] ? __copy_skb_header+0xaf/0x490 [ 9809.785102][ C0] ? __skb_clone+0x57a/0x760 [ 9809.785347][ C0] netif_receive_skb+0x55/0x280 [ 9809.785606][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9809.785930][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9809.786279][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9809.786594][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9809.786880][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9809.787177][ C0] ? hlock_class+0x4e/0x130 [ 9809.787420][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9809.787746][ C0] ? place_entity+0x21/0x2f0 [ 9809.787995][ C0] ? resched_curr+0x219/0x280 [ 9809.788255][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9809.788525][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9809.788828][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9809.789109][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9809.789376][ C0] ? activate_task+0xf5/0x260 [ 9809.789629][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9809.789907][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9809.790176][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9809.790435][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9809.790723][ C0] ? get_stack_info+0x36/0xc0 [ 9809.790971][ C0] ? stack_access_ok+0xda/0x1f0 [ 9809.791226][ C0] ? get_reg+0x119/0x190 [ 9809.791451][ C0] __tcf_classify+0x32c/0x7d0 [ 9809.791706][ C0] tcf_classify+0x283/0x930 [ 9809.791955][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9809.792286][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9809.792549][ C0] ? arch_stack_walk+0x8c/0x100 [ 9809.792813][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9809.793104][ C0] tc_run+0x2e4/0x5d0 [ 9809.793321][ C0] ? __pfx_tc_run+0x10/0x10 [ 9809.793566][ C0] ? lock_acquire+0x1c1/0x220 [ 9809.793820][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9809.794102][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9809.794367][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9809.794654][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9809.794933][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9809.795254][ C0] ? neigh_hh_output+0x348/0x590 [ 9809.795516][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9809.795795][ C0] ip_finish_output2+0x786/0x18e0 [ 9809.796066][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9809.796361][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9809.796709][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9809.796994][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9809.797261][ C0] ? __ip_finish_output+0x10f/0x770 [ 9809.797537][ C0] ip_output+0x16b/0x4f0 [ 9809.797762][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9809.798045][ C0] ? __pfx_ip_output+0x10/0x10 [ 9809.798294][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9809.798595][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9809.798864][ C0] ? ip_local_out+0x114/0x3b0 [ 9809.799113][ C0] __ip_queue_xmit+0x672/0x1910 [ 9809.799372][ C0] ? __skb_clone+0x57a/0x760 [ 9809.799615][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9809.799900][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9809.800196][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9809.800516][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9809.800772][ C0] ? tcp_current_mss+0x40a/0x510 [ 9809.801035][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9809.801312][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9809.801597][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9809.801854][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9809.802120][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9809.802437][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9809.802716][ C0] ? ktime_get+0xb6/0x190 [ 9809.802946][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9809.803220][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9809.803497][ C0] tcp_write_timer+0x82/0x1d0 [ 9809.803748][ C0] call_timer_fn+0x176/0x430 [ 9809.804001][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9809.804279][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9809.804555][ C0] __run_timers.part.0+0x52d/0x890 [ 9809.804825][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9809.805109][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9809.805408][ C0] ? lock_acquire+0x1c1/0x220 [ 9809.805658][ C0] ? clockevents_program_event+0xf6/0x300 [ 9809.805964][ C0] ? lock_release+0x1d5/0x250 [ 9809.806215][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9809.806496][ C0] ? ktime_get+0xb6/0x190 [ 9809.806727][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9809.807023][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9809.807338][ C0] run_timer_softirq+0x72/0x100 [ 9809.807606][ C0] __do_softirq+0x1bc/0x7ff [ 9809.807852][ C0] irq_exit_rcu+0x98/0xc0 [ 9809.808083][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9809.808384][ C0] [ 9809.808539][ C0] [ 9809.808695][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9809.809021][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9809.809286][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9809.810296][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9809.810616][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9809.811030][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9809.811448][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9809.811860][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9809.812274][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9809.812694][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9809.812995][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9809.813265][ C0] default_idle_call+0x69/0xa0 [ 9809.813519][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9809.813778][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9809.814077][ C0] ? lock_release+0x1d5/0x250 [ 9809.814326][ C0] do_idle+0xfb/0x160 [ 9809.814538][ C0] cpu_startup_entry+0x55/0x60 [ 9809.814790][ C0] rest_init+0x153/0x260 [ 9809.815015][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9809.815302][ C0] arch_call_rest_init+0x13/0x40 [ 9809.815566][ C0] start_kernel+0x314/0x3d0 [ 9809.815814][ C0] x86_64_start_reservations+0x18/0x30 [ 9809.816108][ C0] x86_64_start_kernel+0xba/0x110 [ 9809.816372][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9809.816694][ C0] [ 9809.816858][ C0] Sending NMI from CPU 0 to CPUs 1: [ 9809.817147][ C1] NMI backtrace for cpu 1 [ 9809.817153][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9809.817157][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9809.817160][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9809.817166][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9809.817169][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9809.817172][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9809.817174][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9809.817176][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9809.817177][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9809.817179][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9809.817181][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9809.817183][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9809.817186][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9809.817188][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9809.817190][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9809.817191][ C1] Call Trace: [ 9809.817193][ C1] [ 9809.817196][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 9809.817202][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9809.817207][ C1] ? nmi_handle+0x156/0x420 [ 9809.817211][ C1] ? default_do_nmi+0x41/0x100 [ 9809.817214][ C1] ? exc_nmi+0xf3/0x120 [ 9809.817217][ C1] ? end_repeat_nmi+0xf/0x60 [ 9809.817222][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9809.817225][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9809.817229][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9809.817233][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9809.817236][ C1] [ 9809.817237][ C1] [ 9809.817237][ C1] ? run_ksoftirqd+0xb/0x60 [ 9809.817243][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9809.817246][ C1] ? __orc_find+0x9c/0xf0 [ 9809.817248][ C1] ? lock_acquire+0x1c1/0x220 [ 9809.817252][ C1] ? irqentry_enter+0x2b/0x60 [ 9809.817257][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9809.817260][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9809.817263][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9809.817266][ C1] ? lock_acquire+0x1c1/0x220 [ 9809.817269][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9809.817273][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9809.817276][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9809.817283][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9809.817287][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9809.817292][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9809.817298][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9809.817302][ C1] ip_local_deliver+0x19d/0x480 [ 9809.817305][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9809.817308][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9809.817311][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9809.817315][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9809.817318][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9809.817322][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9809.817331][ C1] ip_rcv+0x564/0x740 [ 9809.817334][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9809.817337][ C1] ? set_track_prepare+0x8a/0xd0 [ 9809.817340][ C1] ? irqentry_enter+0x2b/0x60 [ 9809.817344][ C1] ? irqentry_enter+0x2b/0x60 [ 9809.817347][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9809.817350][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9809.817354][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9809.817357][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9809.817360][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9809.817363][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9809.817366][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9809.817371][ C1] netif_receive_skb+0x55/0x280 [ 9809.817374][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9809.817381][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9809.817388][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9809.817394][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9809.817400][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9809.817411][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9809.817421][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9809.817423][ C1] ? arch_stack_walk+0x68/0x100 [ 9809.817427][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9809.817430][ C1] ? irqentry_enter+0x2b/0x60 [ 9809.817434][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9809.817438][ C1] ? irqentry_enter+0x2b/0x60 [ 9809.817441][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9809.817449][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9809.817451][ C1] ? arch_stack_walk+0x68/0x100 [ 9809.817456][ C1] __tcf_classify+0x32c/0x7d0 [ 9809.817461][ C1] tcf_classify+0x283/0x930 [ 9809.817464][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9809.817469][ C1] tc_run+0x2e4/0x5d0 [ 9809.817472][ C1] ? __pfx_tc_run+0x10/0x10 [ 9809.817477][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9809.817483][ C1] ? irqentry_enter+0x2b/0x60 [ 9809.817486][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9809.817489][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9809.817496][ C1] ip_finish_output2+0x786/0x18e0 [ 9809.817502][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9809.817505][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9809.817509][ C1] ? __ip_finish_output+0x10f/0x770 [ 9809.817513][ C1] ip_output+0x16b/0x4f0 [ 9809.817516][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9809.817520][ C1] ? __pfx_ip_output+0x10/0x10 [ 9809.817524][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9809.817532][ C1] ? __pfx_ip_output+0x10/0x10 [ 9809.817536][ C1] __ip_queue_xmit+0x672/0x1910 [ 9809.817541][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9809.817548][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9809.817552][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9809.817556][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9809.817560][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9809.817563][ C1] tcp_delack_timer+0x84/0x240 [ 9809.817567][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9809.817570][ C1] call_timer_fn+0x176/0x430 [ 9809.817574][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9809.817579][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9809.817583][ C1] __run_timers.part.0+0x52d/0x890 [ 9809.817586][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9809.817591][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9809.817596][ C1] ? __pfx___schedule+0x10/0x10 [ 9809.817599][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9809.817604][ C1] run_timer_softirq+0x72/0x100 [ 9809.817608][ C1] __do_softirq+0x1bc/0x7ff [ 9809.817611][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9809.817615][ C1] run_ksoftirqd+0x2e/0x60 [ 9809.817618][ C1] smpboot_thread_fn+0x30e/0x840 [ 9809.817622][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9809.817626][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9809.817629][ C1] kthread+0x292/0x360 [ 9809.817632][ C1] ? __pfx_kthread+0x10/0x10 [ 9809.817635][ C1] ret_from_fork+0x34/0x70 [ 9809.817638][ C1] ? __pfx_kthread+0x10/0x10 [ 9809.817640][ C1] ret_from_fork_asm+0x1b/0x30 [ 9809.817647][ C1] [ 9836.527476][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8054s! [swapper/0:0] [ 9836.527960][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9836.529167][ C0] irq event stamp: 27567077 [ 9836.529409][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9836.529943][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9836.530414][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9836.530914][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9836.531407][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9836.531885][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9836.532537][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 9836.532873][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 9836.533886][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9836.534209][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9836.534627][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9836.535044][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9836.535460][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9836.535879][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9836.536297][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9836.536764][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9836.537118][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9836.537540][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9836.537959][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9836.538380][ C0] Call Trace: [ 9836.538563][ C0] [ 9836.538726][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9836.539005][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9836.539259][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9836.539551][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9836.539834][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9836.540135][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9836.540411][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9836.540729][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9836.541004][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9836.541280][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9836.541607][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9836.541919][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9836.542248][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9836.542555][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 9836.542860][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9836.543166][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9836.543494][ C0] ? get_stack_info+0x36/0xc0 [ 9836.543748][ C0] ? lock_acquire+0x1c1/0x220 [ 9836.544001][ C0] ? lock_release+0x1d5/0x250 [ 9836.544252][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9836.544512][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9836.544796][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9836.545093][ C0] ? lock_acquire+0x1c1/0x220 [ 9836.545344][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9836.545598][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9836.545873][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9836.546120][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9836.546378][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9836.546645][ C0] ? __inet_lookup_established+0x341/0x610 [ 9836.546959][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9836.547259][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9836.547549][ C0] ip_local_deliver+0x19d/0x480 [ 9836.547814][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9836.548102][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9836.548369][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9836.548652][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9836.548917][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9836.549251][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9836.549530][ C0] ip_rcv+0x564/0x740 [ 9836.549745][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9836.549987][ C0] ? set_track_prepare+0x8a/0xd0 [ 9836.550252][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9836.550542][ C0] ? rest_init+0x153/0x260 [ 9836.550779][ C0] ? skb_clone+0x10b/0x330 [ 9836.551019][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9836.551350][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9836.551667][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9836.551963][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9836.552276][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9836.552538][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9836.552783][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9836.553098][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9836.553399][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9836.553742][ C0] ? lock_acquire+0x1c1/0x220 [ 9836.553991][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9836.554297][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9836.554596][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9836.554925][ C0] ? __copy_skb_header+0xaf/0x490 [ 9836.555190][ C0] ? __skb_clone+0x57a/0x760 [ 9836.555433][ C0] netif_receive_skb+0x55/0x280 [ 9836.555692][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9836.556026][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9836.556375][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9836.556687][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9836.556977][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9836.557283][ C0] ? hlock_class+0x4e/0x130 [ 9836.557532][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9836.557863][ C0] ? place_entity+0x21/0x2f0 [ 9836.558113][ C0] ? resched_curr+0x219/0x280 [ 9836.558361][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9836.558633][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9836.558917][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9836.559192][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9836.559449][ C0] ? activate_task+0xf5/0x260 [ 9836.559700][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9836.559973][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9836.560247][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9836.560506][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9836.560792][ C0] ? get_stack_info+0x36/0xc0 [ 9836.561045][ C0] ? stack_access_ok+0xda/0x1f0 [ 9836.561305][ C0] ? get_reg+0x119/0x190 [ 9836.561537][ C0] __tcf_classify+0x32c/0x7d0 [ 9836.561786][ C0] tcf_classify+0x283/0x930 [ 9836.562025][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9836.562353][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9836.562621][ C0] ? arch_stack_walk+0x8c/0x100 [ 9836.562883][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9836.563177][ C0] tc_run+0x2e4/0x5d0 [ 9836.563393][ C0] ? __pfx_tc_run+0x10/0x10 [ 9836.563635][ C0] ? lock_acquire+0x1c1/0x220 [ 9836.563883][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9836.564155][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9836.564423][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9836.564706][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9836.564980][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9836.565296][ C0] ? neigh_hh_output+0x348/0x590 [ 9836.565561][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9836.565835][ C0] ip_finish_output2+0x786/0x18e0 [ 9836.566102][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9836.566399][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9836.566756][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9836.567046][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9836.567309][ C0] ? __ip_finish_output+0x10f/0x770 [ 9836.567588][ C0] ip_output+0x16b/0x4f0 [ 9836.567819][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9836.568100][ C0] ? __pfx_ip_output+0x10/0x10 [ 9836.568356][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9836.568656][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9836.568920][ C0] ? ip_local_out+0x114/0x3b0 [ 9836.569176][ C0] __ip_queue_xmit+0x672/0x1910 [ 9836.569438][ C0] ? __skb_clone+0x57a/0x760 [ 9836.569687][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9836.569968][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9836.570263][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9836.570582][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9836.570843][ C0] ? tcp_current_mss+0x40a/0x510 [ 9836.571105][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9836.571387][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9836.571663][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9836.571918][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9836.572187][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9836.572509][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9836.572785][ C0] ? ktime_get+0xb6/0x190 [ 9836.573015][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9836.573286][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9836.573568][ C0] tcp_write_timer+0x82/0x1d0 [ 9836.573818][ C0] call_timer_fn+0x176/0x430 [ 9836.574066][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9836.574339][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9836.574609][ C0] __run_timers.part.0+0x52d/0x890 [ 9836.574883][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9836.575164][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9836.575467][ C0] ? lock_acquire+0x1c1/0x220 [ 9836.575716][ C0] ? clockevents_program_event+0xf6/0x300 [ 9836.576019][ C0] ? lock_release+0x1d5/0x250 [ 9836.576265][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9836.576539][ C0] ? ktime_get+0xb6/0x190 [ 9836.576768][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9836.577065][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9836.577379][ C0] run_timer_softirq+0x72/0x100 [ 9836.577638][ C0] __do_softirq+0x1bc/0x7ff [ 9836.577881][ C0] irq_exit_rcu+0x98/0xc0 [ 9836.578110][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9836.578408][ C0] [ 9836.578565][ C0] [ 9836.578729][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9836.579046][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9836.579318][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9836.580342][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9836.580666][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9836.581092][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9836.581512][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9836.581935][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9836.582358][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9836.582784][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9836.583088][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9836.583363][ C0] default_idle_call+0x69/0xa0 [ 9836.583616][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9836.583880][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9836.584169][ C0] ? lock_release+0x1d5/0x250 [ 9836.584423][ C0] do_idle+0xfb/0x160 [ 9836.584642][ C0] cpu_startup_entry+0x55/0x60 [ 9836.584899][ C0] rest_init+0x153/0x260 [ 9836.585122][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9836.585414][ C0] arch_call_rest_init+0x13/0x40 [ 9836.585682][ C0] start_kernel+0x314/0x3d0 [ 9836.585925][ C0] x86_64_start_reservations+0x18/0x30 [ 9836.586218][ C0] x86_64_start_kernel+0xba/0x110 [ 9836.586487][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9836.586818][ C0] [ 9836.586984][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8054s! [ksoftirqd/1:22] [ 9836.587438][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9836.588631][ C1] irq event stamp: 3886976 [ 9836.588865][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9836.589363][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9836.589859][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9836.590359][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9836.590846][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9836.591339][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9836.591985][ C1] RIP: 0010:kasan_check_range+0x1b/0x1c0 [ 9836.592289][ C1] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 53 <72> 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 23 [ 9836.593309][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000282 [ 9836.593631][ C1] RAX: ffff88800a098e1c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9836.594047][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9836.594463][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9836.594880][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9836.595297][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9836.595714][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9836.596181][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9836.596533][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9836.596950][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9836.597375][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9836.597797][ C1] Call Trace: [ 9836.597981][ C1] [ 9836.598135][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9836.598408][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9836.598670][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9836.598961][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9836.599245][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9836.599546][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9836.599825][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9836.600142][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9836.600424][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9836.600747][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9836.601060][ C1] [ 9836.601219][ C1] [ 9836.601377][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9836.601710][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9836.602012][ C1] ? kasan_check_range+0x1b/0x1c0 [ 9836.602280][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 9836.602573][ C1] ? run_ksoftirqd+0xb/0x60 [ 9836.602815][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9836.603144][ C1] ? __orc_find+0x9c/0xf0 [ 9836.603375][ C1] ? lock_acquire+0x1c1/0x220 [ 9836.603630][ C1] ? irqentry_enter+0x2b/0x60 [ 9836.603885][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9836.604150][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9836.604438][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9836.604738][ C1] ? lock_acquire+0x1c1/0x220 [ 9836.604986][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9836.605236][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9836.605508][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9836.605757][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9836.606022][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9836.606293][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9836.606581][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9836.606872][ C1] ip_local_deliver+0x19d/0x480 [ 9836.607130][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9836.607414][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9836.607677][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9836.607957][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9836.608222][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9836.608554][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9836.608834][ C1] ip_rcv+0x564/0x740 [ 9836.609049][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9836.609292][ C1] ? set_track_prepare+0x8a/0xd0 [ 9836.609553][ C1] ? irqentry_enter+0x2b/0x60 [ 9836.609806][ C1] ? irqentry_enter+0x2b/0x60 [ 9836.610059][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9836.610304][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9836.610620][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9836.610962][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9836.611274][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9836.611610][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9836.611906][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9836.612242][ C1] netif_receive_skb+0x55/0x280 [ 9836.612505][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9836.612834][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9836.613184][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9836.613494][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9836.613784][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9836.614088][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9836.614421][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9836.614710][ C1] ? arch_stack_walk+0x68/0x100 [ 9836.614966][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9836.615241][ C1] ? irqentry_enter+0x2b/0x60 [ 9836.615489][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9836.615809][ C1] ? irqentry_enter+0x2b/0x60 [ 9836.616064][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9836.616386][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9836.616664][ C1] ? arch_stack_walk+0x68/0x100 [ 9836.616925][ C1] __tcf_classify+0x32c/0x7d0 [ 9836.617181][ C1] tcf_classify+0x283/0x930 [ 9836.617426][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9836.617698][ C1] tc_run+0x2e4/0x5d0 [ 9836.617915][ C1] ? __pfx_tc_run+0x10/0x10 [ 9836.618163][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9836.618431][ C1] ? irqentry_enter+0x2b/0x60 [ 9836.618689][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9836.618975][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9836.619301][ C1] ip_finish_output2+0x786/0x18e0 [ 9836.619570][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9836.619859][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9836.620126][ C1] ? __ip_finish_output+0x10f/0x770 [ 9836.620402][ C1] ip_output+0x16b/0x4f0 [ 9836.620628][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9836.620950][ C1] ? __pfx_ip_output+0x10/0x10 [ 9836.621208][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9836.621562][ C1] ? __pfx_ip_output+0x10/0x10 [ 9836.621819][ C1] __ip_queue_xmit+0x672/0x1910 [ 9836.622079][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9836.622357][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9836.622654][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9836.622939][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9836.623233][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9836.623518][ C1] tcp_delack_timer+0x84/0x240 [ 9836.623772][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9836.624060][ C1] call_timer_fn+0x176/0x430 [ 9836.624310][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9836.624583][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9836.624863][ C1] __run_timers.part.0+0x52d/0x890 [ 9836.625137][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9836.625424][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9836.625721][ C1] ? __pfx___schedule+0x10/0x10 [ 9836.625982][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9836.626304][ C1] run_timer_softirq+0x72/0x100 [ 9836.626559][ C1] __do_softirq+0x1bc/0x7ff [ 9836.626799][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9836.627072][ C1] run_ksoftirqd+0x2e/0x60 [ 9836.627311][ C1] smpboot_thread_fn+0x30e/0x840 [ 9836.627576][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9836.627869][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9836.628157][ C1] kthread+0x292/0x360 [ 9836.628374][ C1] ? __pfx_kthread+0x10/0x10 [ 9836.628621][ C1] ret_from_fork+0x34/0x70 [ 9836.628862][ C1] ? __pfx_kthread+0x10/0x10 [ 9836.629110][ C1] ret_from_fork_asm+0x1b/0x30 [ 9836.629370][ C1] [ 9864.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8081s! [swapper/0:0] [ 9864.527934][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9864.529141][ C0] irq event stamp: 27567077 [ 9864.529380][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9864.529913][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9864.530393][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9864.530904][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9864.531415][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9864.531901][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9864.532545][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9864.532888][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9864.533914][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9864.534237][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9864.534654][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9864.535070][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9864.535487][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9864.535904][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9864.536320][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9864.536793][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9864.537150][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9864.537570][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9864.537990][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9864.538414][ C0] Call Trace: [ 9864.538609][ C0] [ 9864.538765][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9864.539045][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9864.539298][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9864.539590][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9864.539874][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9864.540175][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9864.540454][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9864.540773][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9864.541051][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9864.541328][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9864.541655][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9864.541971][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9864.542302][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9864.542610][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9864.542922][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9864.543225][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9864.543553][ C0] ? get_stack_info+0x36/0xc0 [ 9864.543819][ C0] ? lock_acquire+0x1c1/0x220 [ 9864.544081][ C0] ? lock_release+0x1d5/0x250 [ 9864.544345][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9864.544608][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9864.544900][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9864.545200][ C0] ? lock_acquire+0x1c1/0x220 [ 9864.545446][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9864.545696][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9864.545967][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9864.546218][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9864.546479][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9864.546750][ C0] ? __inet_lookup_established+0x341/0x610 [ 9864.547069][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9864.547360][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9864.547656][ C0] ip_local_deliver+0x19d/0x480 [ 9864.547916][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9864.548202][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9864.548482][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9864.548764][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9864.549029][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9864.549365][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9864.549644][ C0] ip_rcv+0x564/0x740 [ 9864.549860][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9864.550105][ C0] ? set_track_prepare+0x8a/0xd0 [ 9864.550377][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9864.550666][ C0] ? rest_init+0x153/0x260 [ 9864.550911][ C0] ? skb_clone+0x10b/0x330 [ 9864.551151][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9864.551490][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9864.551822][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9864.552118][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9864.552425][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9864.552683][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9864.552922][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9864.553235][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9864.553538][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9864.553883][ C0] ? lock_acquire+0x1c1/0x220 [ 9864.554140][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9864.554454][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9864.554757][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9864.555092][ C0] ? __copy_skb_header+0xaf/0x490 [ 9864.555365][ C0] ? __skb_clone+0x57a/0x760 [ 9864.555615][ C0] netif_receive_skb+0x55/0x280 [ 9864.555879][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9864.556206][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9864.556553][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9864.556868][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9864.557154][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9864.557460][ C0] ? hlock_class+0x4e/0x130 [ 9864.557705][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9864.558033][ C0] ? place_entity+0x21/0x2f0 [ 9864.558279][ C0] ? resched_curr+0x219/0x280 [ 9864.558540][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9864.558813][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9864.559093][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9864.559373][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9864.559633][ C0] ? activate_task+0xf5/0x260 [ 9864.559885][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9864.560164][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9864.560436][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9864.560701][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9864.560995][ C0] ? get_stack_info+0x36/0xc0 [ 9864.561248][ C0] ? stack_access_ok+0xda/0x1f0 [ 9864.561505][ C0] ? get_reg+0x119/0x190 [ 9864.561738][ C0] __tcf_classify+0x32c/0x7d0 [ 9864.561999][ C0] tcf_classify+0x283/0x930 [ 9864.562244][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9864.562574][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9864.562838][ C0] ? arch_stack_walk+0x8c/0x100 [ 9864.563099][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9864.563385][ C0] tc_run+0x2e4/0x5d0 [ 9864.563605][ C0] ? __pfx_tc_run+0x10/0x10 [ 9864.563849][ C0] ? lock_acquire+0x1c1/0x220 [ 9864.564103][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9864.564382][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9864.564648][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9864.564935][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9864.565223][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9864.565547][ C0] ? neigh_hh_output+0x348/0x590 [ 9864.565810][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9864.566092][ C0] ip_finish_output2+0x786/0x18e0 [ 9864.566362][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9864.566658][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9864.567008][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9864.567296][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9864.567561][ C0] ? __ip_finish_output+0x10f/0x770 [ 9864.567836][ C0] ip_output+0x16b/0x4f0 [ 9864.568063][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9864.568348][ C0] ? __pfx_ip_output+0x10/0x10 [ 9864.568608][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9864.568908][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9864.569173][ C0] ? ip_local_out+0x114/0x3b0 [ 9864.569421][ C0] __ip_queue_xmit+0x672/0x1910 [ 9864.569681][ C0] ? __skb_clone+0x57a/0x760 [ 9864.569929][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9864.570214][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9864.570512][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9864.570835][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9864.571090][ C0] ? tcp_current_mss+0x40a/0x510 [ 9864.571360][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9864.571641][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9864.571921][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9864.572176][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9864.572442][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9864.572759][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9864.573040][ C0] ? ktime_get+0xb6/0x190 [ 9864.573276][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9864.573552][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9864.573832][ C0] tcp_write_timer+0x82/0x1d0 [ 9864.574088][ C0] call_timer_fn+0x176/0x430 [ 9864.574338][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9864.574610][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9864.574886][ C0] __run_timers.part.0+0x52d/0x890 [ 9864.575157][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9864.575442][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9864.575739][ C0] ? lock_acquire+0x1c1/0x220 [ 9864.575994][ C0] ? clockevents_program_event+0xf6/0x300 [ 9864.576311][ C0] ? lock_release+0x1d5/0x250 [ 9864.576563][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9864.576844][ C0] ? ktime_get+0xb6/0x190 [ 9864.577077][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9864.577379][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9864.577688][ C0] run_timer_softirq+0x72/0x100 [ 9864.577951][ C0] __do_softirq+0x1bc/0x7ff [ 9864.578198][ C0] irq_exit_rcu+0x98/0xc0 [ 9864.578434][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9864.578741][ C0] [ 9864.578901][ C0] [ 9864.579070][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9864.579393][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9864.579663][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9864.580675][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9864.580994][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9864.581410][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9864.581828][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9864.582243][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9864.582663][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9864.583082][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9864.583385][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9864.583657][ C0] default_idle_call+0x69/0xa0 [ 9864.583915][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9864.584179][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9864.584473][ C0] ? lock_release+0x1d5/0x250 [ 9864.584723][ C0] do_idle+0xfb/0x160 [ 9864.584945][ C0] cpu_startup_entry+0x55/0x60 [ 9864.585197][ C0] rest_init+0x153/0x260 [ 9864.585432][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9864.585719][ C0] arch_call_rest_init+0x13/0x40 [ 9864.585983][ C0] start_kernel+0x314/0x3d0 [ 9864.586229][ C0] x86_64_start_reservations+0x18/0x30 [ 9864.586522][ C0] x86_64_start_kernel+0xba/0x110 [ 9864.586789][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9864.587117][ C0] [ 9864.587285][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8081s! [ksoftirqd/1:22] [ 9864.587739][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9864.588935][ C1] irq event stamp: 3886976 [ 9864.589172][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9864.589672][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9864.590176][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9864.590680][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9864.591168][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9864.591668][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9864.592315][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9864.592661][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9864.593688][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9864.594013][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9864.594439][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9864.594865][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9864.595287][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9864.595709][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9864.596135][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9864.596609][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9864.596956][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9864.597383][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9864.597804][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9864.598223][ C1] Call Trace: [ 9864.598400][ C1] [ 9864.598561][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9864.598841][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9864.599099][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9864.599391][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9864.599681][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9864.599986][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9864.600267][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9864.600591][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9864.600866][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9864.601192][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9864.601505][ C1] [ 9864.601662][ C1] [ 9864.601818][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9864.602145][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9864.602452][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9864.602763][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9864.603064][ C1] ? run_ksoftirqd+0xb/0x60 [ 9864.603308][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9864.603631][ C1] ? __orc_find+0x9c/0xf0 [ 9864.603864][ C1] ? lock_acquire+0x1c1/0x220 [ 9864.604117][ C1] ? irqentry_enter+0x2b/0x60 [ 9864.604372][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9864.604634][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9864.604920][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9864.605221][ C1] ? lock_acquire+0x1c1/0x220 [ 9864.605470][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9864.605721][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9864.605993][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9864.606242][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9864.606503][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9864.606779][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9864.607072][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9864.607367][ C1] ip_local_deliver+0x19d/0x480 [ 9864.607626][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9864.607910][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9864.608174][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9864.608461][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9864.608725][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9864.609065][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9864.609338][ C1] ip_rcv+0x564/0x740 [ 9864.609549][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9864.609789][ C1] ? set_track_prepare+0x8a/0xd0 [ 9864.610053][ C1] ? irqentry_enter+0x2b/0x60 [ 9864.610308][ C1] ? irqentry_enter+0x2b/0x60 [ 9864.610563][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9864.610807][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9864.611127][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9864.611469][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9864.611780][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9864.612118][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9864.612416][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9864.612753][ C1] netif_receive_skb+0x55/0x280 [ 9864.613013][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9864.613346][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9864.613695][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9864.614008][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9864.614300][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9864.614606][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9864.614940][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9864.615224][ C1] ? arch_stack_walk+0x68/0x100 [ 9864.615485][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9864.615761][ C1] ? irqentry_enter+0x2b/0x60 [ 9864.616013][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9864.616331][ C1] ? irqentry_enter+0x2b/0x60 [ 9864.616584][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9864.616911][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9864.617193][ C1] ? arch_stack_walk+0x68/0x100 [ 9864.617456][ C1] __tcf_classify+0x32c/0x7d0 [ 9864.617709][ C1] tcf_classify+0x283/0x930 [ 9864.617956][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9864.618228][ C1] tc_run+0x2e4/0x5d0 [ 9864.618446][ C1] ? __pfx_tc_run+0x10/0x10 [ 9864.618696][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9864.618962][ C1] ? irqentry_enter+0x2b/0x60 [ 9864.619217][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9864.619506][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9864.619830][ C1] ip_finish_output2+0x786/0x18e0 [ 9864.620099][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9864.620389][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9864.620657][ C1] ? __ip_finish_output+0x10f/0x770 [ 9864.620933][ C1] ip_output+0x16b/0x4f0 [ 9864.621162][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9864.621484][ C1] ? __pfx_ip_output+0x10/0x10 [ 9864.621743][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9864.622102][ C1] ? __pfx_ip_output+0x10/0x10 [ 9864.622361][ C1] __ip_queue_xmit+0x672/0x1910 [ 9864.622622][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9864.622901][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9864.623197][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9864.623482][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9864.623777][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9864.624058][ C1] tcp_delack_timer+0x84/0x240 [ 9864.624313][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9864.624602][ C1] call_timer_fn+0x176/0x430 [ 9864.624853][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9864.625126][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9864.625410][ C1] __run_timers.part.0+0x52d/0x890 [ 9864.625684][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9864.625970][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9864.626275][ C1] ? __pfx___schedule+0x10/0x10 [ 9864.626539][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9864.626863][ C1] run_timer_softirq+0x72/0x100 [ 9864.627124][ C1] __do_softirq+0x1bc/0x7ff [ 9864.627370][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9864.627643][ C1] run_ksoftirqd+0x2e/0x60 [ 9864.627885][ C1] smpboot_thread_fn+0x30e/0x840 [ 9864.628151][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9864.628444][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9864.628740][ C1] kthread+0x292/0x360 [ 9864.628960][ C1] ? __pfx_kthread+0x10/0x10 [ 9864.629210][ C1] ret_from_fork+0x34/0x70 [ 9864.629446][ C1] ? __pfx_kthread+0x10/0x10 [ 9864.629693][ C1] ret_from_fork_asm+0x1b/0x30 [ 9864.629951][ C1] [ 9887.821023][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9887.821428][ C0] rcu: 0-....: (8634519 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=2069658 [ 9887.821950][ C0] rcu: (t=8693512 jiffies g=1007429 q=31 ncpus=4) [ 9887.822297][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9887.822780][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9887.823433][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9887.823785][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9887.824816][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9887.825146][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9887.825571][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9887.825999][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9887.826428][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9887.826850][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9887.827273][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9887.827749][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9887.828100][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9887.828527][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9887.828951][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9887.829382][ C0] Call Trace: [ 9887.829569][ C0] [ 9887.829726][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9887.830013][ C0] ? print_cpu_stall+0x263/0x6a0 [ 9887.830283][ C0] ? check_cpu_stall+0x284/0x500 [ 9887.830547][ C0] ? rcu_pending+0x92/0x360 [ 9887.830791][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9887.831078][ C0] ? update_process_times+0xb9/0x110 [ 9887.831364][ C0] ? tick_sched_handle+0x67/0x130 [ 9887.831637][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9887.831943][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9887.832198][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9887.832528][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9887.832813][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9887.833114][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9887.833392][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9887.833712][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9887.833989][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9887.834266][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9887.834592][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9887.834906][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9887.835240][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9887.835546][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9887.835860][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9887.836162][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9887.836487][ C0] ? get_stack_info+0x36/0xc0 [ 9887.836749][ C0] ? lock_acquire+0x1c1/0x220 [ 9887.837004][ C0] ? lock_release+0x1d5/0x250 [ 9887.837257][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9887.837520][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9887.837807][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9887.838108][ C0] ? lock_acquire+0x1c1/0x220 [ 9887.838361][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9887.838620][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9887.838896][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9887.839141][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9887.839398][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9887.839666][ C0] ? __inet_lookup_established+0x341/0x610 [ 9887.839978][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9887.840270][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9887.840562][ C0] ip_local_deliver+0x19d/0x480 [ 9887.840821][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9887.841102][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9887.841370][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9887.841650][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9887.841917][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9887.842256][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9887.842534][ C0] ip_rcv+0x564/0x740 [ 9887.842754][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9887.842998][ C0] ? set_track_prepare+0x8a/0xd0 [ 9887.843267][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9887.843554][ C0] ? rest_init+0x153/0x260 [ 9887.843795][ C0] ? skb_clone+0x10b/0x330 [ 9887.844033][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9887.844369][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9887.844693][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9887.844990][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9887.845297][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9887.845556][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9887.845798][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9887.846110][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9887.846406][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9887.846750][ C0] ? lock_acquire+0x1c1/0x220 [ 9887.847004][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9887.847316][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9887.847616][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9887.847949][ C0] ? __copy_skb_header+0xaf/0x490 [ 9887.848221][ C0] ? __skb_clone+0x57a/0x760 [ 9887.848474][ C0] netif_receive_skb+0x55/0x280 [ 9887.848735][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9887.849067][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9887.849416][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9887.849729][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9887.850020][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9887.850325][ C0] ? hlock_class+0x4e/0x130 [ 9887.850573][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9887.850904][ C0] ? place_entity+0x21/0x2f0 [ 9887.851153][ C0] ? resched_curr+0x219/0x280 [ 9887.851403][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9887.851671][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9887.851953][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9887.852234][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9887.852495][ C0] ? activate_task+0xf5/0x260 [ 9887.852750][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9887.853030][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9887.853303][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9887.853567][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9887.853859][ C0] ? get_stack_info+0x36/0xc0 [ 9887.854109][ C0] ? stack_access_ok+0xda/0x1f0 [ 9887.854364][ C0] ? get_reg+0x119/0x190 [ 9887.854591][ C0] __tcf_classify+0x32c/0x7d0 [ 9887.854846][ C0] tcf_classify+0x283/0x930 [ 9887.855093][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9887.855424][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9887.855690][ C0] ? arch_stack_walk+0x8c/0x100 [ 9887.855949][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9887.856238][ C0] tc_run+0x2e4/0x5d0 [ 9887.856461][ C0] ? __pfx_tc_run+0x10/0x10 [ 9887.856707][ C0] ? lock_acquire+0x1c1/0x220 [ 9887.856960][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9887.857239][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9887.857504][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9887.857798][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9887.858078][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9887.858413][ C0] ? neigh_hh_output+0x348/0x590 [ 9887.858680][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9887.858957][ C0] ip_finish_output2+0x786/0x18e0 [ 9887.859224][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9887.859517][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9887.859874][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9887.860167][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9887.860434][ C0] ? __ip_finish_output+0x10f/0x770 [ 9887.860715][ C0] ip_output+0x16b/0x4f0 [ 9887.860945][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9887.861228][ C0] ? __pfx_ip_output+0x10/0x10 [ 9887.861485][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9887.861784][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9887.862050][ C0] ? ip_local_out+0x114/0x3b0 [ 9887.862302][ C0] __ip_queue_xmit+0x672/0x1910 [ 9887.862566][ C0] ? __skb_clone+0x57a/0x760 [ 9887.862813][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9887.863098][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9887.863398][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9887.863716][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9887.863971][ C0] ? tcp_current_mss+0x40a/0x510 [ 9887.864239][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9887.864521][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9887.864800][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9887.865058][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9887.865325][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9887.865644][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9887.865924][ C0] ? ktime_get+0xb6/0x190 [ 9887.866160][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9887.866436][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9887.866718][ C0] tcp_write_timer+0x82/0x1d0 [ 9887.866974][ C0] call_timer_fn+0x176/0x430 [ 9887.867225][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9887.867497][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9887.867772][ C0] __run_timers.part.0+0x52d/0x890 [ 9887.868048][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9887.868334][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9887.868638][ C0] ? lock_acquire+0x1c1/0x220 [ 9887.868888][ C0] ? clockevents_program_event+0xf6/0x300 [ 9887.869197][ C0] ? lock_release+0x1d5/0x250 [ 9887.869445][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9887.869720][ C0] ? ktime_get+0xb6/0x190 [ 9887.869949][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9887.870247][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9887.870560][ C0] run_timer_softirq+0x72/0x100 [ 9887.870819][ C0] __do_softirq+0x1bc/0x7ff [ 9887.871061][ C0] irq_exit_rcu+0x98/0xc0 [ 9887.871291][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9887.871588][ C0] [ 9887.871749][ C0] [ 9887.871910][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9887.872231][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9887.872499][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9887.873516][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9887.873836][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9887.874257][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9887.874676][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9887.875094][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9887.875512][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9887.875934][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9887.876237][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9887.876510][ C0] default_idle_call+0x69/0xa0 [ 9887.876766][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9887.877027][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9887.877321][ C0] ? lock_release+0x1d5/0x250 [ 9887.877569][ C0] do_idle+0xfb/0x160 [ 9887.877781][ C0] cpu_startup_entry+0x55/0x60 [ 9887.878036][ C0] rest_init+0x153/0x260 [ 9887.878263][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9887.878553][ C0] arch_call_rest_init+0x13/0x40 [ 9887.878822][ C0] start_kernel+0x314/0x3d0 [ 9887.879064][ C0] x86_64_start_reservations+0x18/0x30 [ 9887.879354][ C0] x86_64_start_kernel+0xba/0x110 [ 9887.879626][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9887.879960][ C0] [ 9887.880128][ C0] Sending NMI from CPU 0 to CPUs 1: [ 9887.880414][ C1] NMI backtrace for cpu 1 [ 9887.880419][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9887.880422][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9887.880424][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9887.880430][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9887.880433][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9887.880436][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9887.880438][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9887.880440][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9887.880442][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9887.880444][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9887.880445][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9887.880447][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9887.880451][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9887.880452][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9887.880454][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9887.880456][ C1] Call Trace: [ 9887.880458][ C1] [ 9887.880460][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 9887.880465][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9887.880470][ C1] ? nmi_handle+0x156/0x420 [ 9887.880475][ C1] ? default_do_nmi+0x41/0x100 [ 9887.880478][ C1] ? exc_nmi+0xf3/0x120 [ 9887.880481][ C1] ? end_repeat_nmi+0xf/0x60 [ 9887.880485][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9887.880489][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9887.880492][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9887.880496][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9887.880499][ C1] [ 9887.880500][ C1] [ 9887.880501][ C1] ? run_ksoftirqd+0xb/0x60 [ 9887.880506][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9887.880509][ C1] ? __orc_find+0x9c/0xf0 [ 9887.880512][ C1] ? lock_acquire+0x1c1/0x220 [ 9887.880515][ C1] ? irqentry_enter+0x2b/0x60 [ 9887.880520][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9887.880524][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9887.880526][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9887.880530][ C1] ? lock_acquire+0x1c1/0x220 [ 9887.880532][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9887.880537][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9887.880540][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9887.880547][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9887.880550][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9887.880555][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9887.880561][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9887.880565][ C1] ip_local_deliver+0x19d/0x480 [ 9887.880568][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9887.880570][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9887.880574][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9887.880578][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9887.880581][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9887.880585][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9887.880594][ C1] ip_rcv+0x564/0x740 [ 9887.880598][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9887.880601][ C1] ? set_track_prepare+0x8a/0xd0 [ 9887.880604][ C1] ? irqentry_enter+0x2b/0x60 [ 9887.880607][ C1] ? irqentry_enter+0x2b/0x60 [ 9887.880611][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9887.880614][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9887.880617][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9887.880621][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9887.880623][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9887.880626][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9887.880629][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9887.880634][ C1] netif_receive_skb+0x55/0x280 [ 9887.880637][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9887.880645][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9887.880652][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9887.880658][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9887.880665][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9887.880676][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9887.880685][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9887.880688][ C1] ? arch_stack_walk+0x68/0x100 [ 9887.880692][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9887.880695][ C1] ? irqentry_enter+0x2b/0x60 [ 9887.880699][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9887.880703][ C1] ? irqentry_enter+0x2b/0x60 [ 9887.880707][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9887.880714][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9887.880716][ C1] ? arch_stack_walk+0x68/0x100 [ 9887.880721][ C1] __tcf_classify+0x32c/0x7d0 [ 9887.880726][ C1] tcf_classify+0x283/0x930 [ 9887.880729][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9887.880734][ C1] tc_run+0x2e4/0x5d0 [ 9887.880738][ C1] ? __pfx_tc_run+0x10/0x10 [ 9887.880743][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9887.880749][ C1] ? irqentry_enter+0x2b/0x60 [ 9887.880752][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9887.880755][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9887.880762][ C1] ip_finish_output2+0x786/0x18e0 [ 9887.880767][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9887.880770][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9887.880774][ C1] ? __ip_finish_output+0x10f/0x770 [ 9887.880779][ C1] ip_output+0x16b/0x4f0 [ 9887.880782][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9887.880785][ C1] ? __pfx_ip_output+0x10/0x10 [ 9887.880790][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9887.880797][ C1] ? __pfx_ip_output+0x10/0x10 [ 9887.880801][ C1] __ip_queue_xmit+0x672/0x1910 [ 9887.880807][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9887.880813][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9887.880817][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9887.880821][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9887.880825][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9887.880828][ C1] tcp_delack_timer+0x84/0x240 [ 9887.880831][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9887.880834][ C1] call_timer_fn+0x176/0x430 [ 9887.880839][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9887.880844][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9887.880848][ C1] __run_timers.part.0+0x52d/0x890 [ 9887.880851][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9887.880855][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9887.880860][ C1] ? __pfx___schedule+0x10/0x10 [ 9887.880864][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9887.880869][ C1] run_timer_softirq+0x72/0x100 [ 9887.880873][ C1] __do_softirq+0x1bc/0x7ff [ 9887.880876][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9887.880880][ C1] run_ksoftirqd+0x2e/0x60 [ 9887.880883][ C1] smpboot_thread_fn+0x30e/0x840 [ 9887.880888][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9887.880892][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9887.880895][ C1] kthread+0x292/0x360 [ 9887.880898][ C1] ? __pfx_kthread+0x10/0x10 [ 9887.880900][ C1] ret_from_fork+0x34/0x70 [ 9887.880904][ C1] ? __pfx_kthread+0x10/0x10 [ 9887.880906][ C1] ret_from_fork_asm+0x1b/0x30 [ 9887.880914][ C1] [ 9912.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8125s! [swapper/0:0] [ 9912.527935][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9912.529137][ C0] irq event stamp: 27567077 [ 9912.529381][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9912.529926][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9912.530404][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9912.530912][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9912.531408][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9912.531894][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9912.532534][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9912.532872][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9912.533890][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9912.534210][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9912.534627][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9912.535048][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9912.535470][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9912.535884][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9912.536300][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9912.536767][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9912.537117][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9912.537538][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9912.537964][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9912.538391][ C0] Call Trace: [ 9912.538569][ C0] [ 9912.538731][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9912.539013][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9912.539271][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9912.539559][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9912.539846][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9912.540156][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9912.540440][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9912.540763][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9912.541040][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9912.541318][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9912.541639][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9912.541951][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9912.542289][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9912.542590][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9912.542896][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9912.543202][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9912.543529][ C0] ? get_stack_info+0x36/0xc0 [ 9912.543781][ C0] ? lock_acquire+0x1c1/0x220 [ 9912.544033][ C0] ? lock_release+0x1d5/0x250 [ 9912.544282][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9912.544541][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9912.544831][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9912.545129][ C0] ? lock_acquire+0x1c1/0x220 [ 9912.545380][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9912.545635][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9912.545914][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9912.546160][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9912.546417][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9912.546685][ C0] ? __inet_lookup_established+0x341/0x610 [ 9912.546999][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9912.547303][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9912.547596][ C0] ip_local_deliver+0x19d/0x480 [ 9912.547853][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9912.548135][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9912.548409][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9912.548683][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9912.548943][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9912.549280][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9912.549555][ C0] ip_rcv+0x564/0x740 [ 9912.549764][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9912.550009][ C0] ? set_track_prepare+0x8a/0xd0 [ 9912.550282][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9912.550577][ C0] ? rest_init+0x153/0x260 [ 9912.550812][ C0] ? skb_clone+0x10b/0x330 [ 9912.551058][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9912.551391][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9912.551711][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9912.552013][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9912.552325][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9912.552588][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9912.552835][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9912.553154][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9912.553453][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9912.553799][ C0] ? lock_acquire+0x1c1/0x220 [ 9912.554045][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9912.554354][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9912.554655][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9912.554985][ C0] ? __copy_skb_header+0xaf/0x490 [ 9912.555256][ C0] ? __skb_clone+0x57a/0x760 [ 9912.555506][ C0] netif_receive_skb+0x55/0x280 [ 9912.555769][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9912.556099][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9912.556450][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9912.556760][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9912.557049][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9912.557351][ C0] ? hlock_class+0x4e/0x130 [ 9912.557600][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9912.557932][ C0] ? place_entity+0x21/0x2f0 [ 9912.558181][ C0] ? resched_curr+0x219/0x280 [ 9912.558443][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9912.558711][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9912.558994][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9912.559267][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9912.559531][ C0] ? activate_task+0xf5/0x260 [ 9912.559779][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9912.560053][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9912.560325][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9912.560582][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9912.560873][ C0] ? get_stack_info+0x36/0xc0 [ 9912.561132][ C0] ? stack_access_ok+0xda/0x1f0 [ 9912.561392][ C0] ? get_reg+0x119/0x190 [ 9912.561619][ C0] __tcf_classify+0x32c/0x7d0 [ 9912.561870][ C0] tcf_classify+0x283/0x930 [ 9912.562108][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9912.562432][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9912.562702][ C0] ? arch_stack_walk+0x8c/0x100 [ 9912.562966][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9912.563256][ C0] tc_run+0x2e4/0x5d0 [ 9912.563469][ C0] ? __pfx_tc_run+0x10/0x10 [ 9912.563707][ C0] ? lock_acquire+0x1c1/0x220 [ 9912.563954][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9912.564228][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9912.564496][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9912.564778][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9912.565052][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9912.565369][ C0] ? neigh_hh_output+0x348/0x590 [ 9912.565637][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9912.565914][ C0] ip_finish_output2+0x786/0x18e0 [ 9912.566180][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9912.566468][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9912.566827][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9912.567121][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9912.567384][ C0] ? __ip_finish_output+0x10f/0x770 [ 9912.567662][ C0] ip_output+0x16b/0x4f0 [ 9912.567889][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9912.568171][ C0] ? __pfx_ip_output+0x10/0x10 [ 9912.568433][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9912.568736][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9912.568997][ C0] ? ip_local_out+0x114/0x3b0 [ 9912.569254][ C0] __ip_queue_xmit+0x672/0x1910 [ 9912.569515][ C0] ? __skb_clone+0x57a/0x760 [ 9912.569768][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9912.570046][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9912.570337][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9912.570650][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9912.570909][ C0] ? tcp_current_mss+0x40a/0x510 [ 9912.571169][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9912.571451][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9912.571723][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9912.571972][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9912.572243][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9912.572560][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9912.572833][ C0] ? ktime_get+0xb6/0x190 [ 9912.573064][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9912.573336][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9912.573617][ C0] tcp_write_timer+0x82/0x1d0 [ 9912.573864][ C0] call_timer_fn+0x176/0x430 [ 9912.574107][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9912.574381][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9912.574653][ C0] __run_timers.part.0+0x52d/0x890 [ 9912.574927][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9912.575206][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9912.575503][ C0] ? lock_acquire+0x1c1/0x220 [ 9912.575747][ C0] ? clockevents_program_event+0xf6/0x300 [ 9912.576051][ C0] ? lock_release+0x1d5/0x250 [ 9912.576299][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9912.576575][ C0] ? ktime_get+0xb6/0x190 [ 9912.576803][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9912.577100][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9912.577409][ C0] run_timer_softirq+0x72/0x100 [ 9912.577664][ C0] __do_softirq+0x1bc/0x7ff [ 9912.577904][ C0] irq_exit_rcu+0x98/0xc0 [ 9912.578133][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9912.578438][ C0] [ 9912.578593][ C0] [ 9912.578749][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9912.579070][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9912.579342][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9912.580370][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9912.580695][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9912.581112][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9912.581532][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9912.581959][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9912.582377][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9912.582797][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9912.583111][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9912.583383][ C0] default_idle_call+0x69/0xa0 [ 9912.583634][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9912.583899][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9912.584189][ C0] ? lock_release+0x1d5/0x250 [ 9912.584440][ C0] do_idle+0xfb/0x160 [ 9912.584652][ C0] cpu_startup_entry+0x55/0x60 [ 9912.584905][ C0] rest_init+0x153/0x260 [ 9912.585127][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9912.585416][ C0] arch_call_rest_init+0x13/0x40 [ 9912.585682][ C0] start_kernel+0x314/0x3d0 [ 9912.585925][ C0] x86_64_start_reservations+0x18/0x30 [ 9912.586215][ C0] x86_64_start_kernel+0xba/0x110 [ 9912.586485][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9912.586814][ C0] [ 9912.586982][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8125s! [ksoftirqd/1:22] [ 9912.587441][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9912.588639][ C1] irq event stamp: 3886976 [ 9912.588873][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9912.589370][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9912.589867][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9912.590364][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9912.590851][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9912.591346][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9912.591993][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9912.592338][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9912.593362][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9912.593687][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9912.594113][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9912.594534][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9912.594956][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9912.595380][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9912.595805][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9912.596278][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9912.596628][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9912.597056][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9912.597476][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9912.597899][ C1] Call Trace: [ 9912.598075][ C1] [ 9912.598236][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9912.598512][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9912.598769][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9912.599060][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9912.599350][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9912.599655][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9912.599935][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9912.600260][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9912.600534][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9912.600859][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9912.601174][ C1] [ 9912.601330][ C1] [ 9912.601487][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9912.601814][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9912.602121][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9912.602437][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9912.602738][ C1] ? run_ksoftirqd+0xb/0x60 [ 9912.602983][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9912.603308][ C1] ? __orc_find+0x9c/0xf0 [ 9912.603542][ C1] ? lock_acquire+0x1c1/0x220 [ 9912.603795][ C1] ? irqentry_enter+0x2b/0x60 [ 9912.604048][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9912.604310][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9912.604598][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9912.604901][ C1] ? lock_acquire+0x1c1/0x220 [ 9912.605152][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9912.605405][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9912.605678][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9912.605927][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9912.606189][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9912.606462][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9912.606752][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9912.607045][ C1] ip_local_deliver+0x19d/0x480 [ 9912.607302][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9912.607585][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9912.607849][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9912.608132][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9912.608404][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9912.608741][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9912.609017][ C1] ip_rcv+0x564/0x740 [ 9912.609231][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9912.609470][ C1] ? set_track_prepare+0x8a/0xd0 [ 9912.609735][ C1] ? irqentry_enter+0x2b/0x60 [ 9912.609997][ C1] ? irqentry_enter+0x2b/0x60 [ 9912.610254][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9912.610498][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9912.610817][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9912.611161][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9912.611474][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9912.611813][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9912.612111][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9912.612446][ C1] netif_receive_skb+0x55/0x280 [ 9912.612708][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9912.613037][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9912.613391][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9912.613704][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9912.613997][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9912.614301][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9912.614635][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9912.614918][ C1] ? arch_stack_walk+0x68/0x100 [ 9912.615179][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9912.615454][ C1] ? irqentry_enter+0x2b/0x60 [ 9912.615705][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9912.616022][ C1] ? irqentry_enter+0x2b/0x60 [ 9912.616278][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9912.616607][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9912.616886][ C1] ? arch_stack_walk+0x68/0x100 [ 9912.617148][ C1] __tcf_classify+0x32c/0x7d0 [ 9912.617402][ C1] tcf_classify+0x283/0x930 [ 9912.617647][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9912.617919][ C1] tc_run+0x2e4/0x5d0 [ 9912.618140][ C1] ? __pfx_tc_run+0x10/0x10 [ 9912.618390][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9912.618655][ C1] ? irqentry_enter+0x2b/0x60 [ 9912.618910][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9912.619201][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9912.619524][ C1] ip_finish_output2+0x786/0x18e0 [ 9912.619793][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9912.620083][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9912.620350][ C1] ? __ip_finish_output+0x10f/0x770 [ 9912.620626][ C1] ip_output+0x16b/0x4f0 [ 9912.620855][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9912.621175][ C1] ? __pfx_ip_output+0x10/0x10 [ 9912.621430][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9912.621786][ C1] ? __pfx_ip_output+0x10/0x10 [ 9912.622044][ C1] __ip_queue_xmit+0x672/0x1910 [ 9912.622302][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9912.622581][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9912.622872][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9912.623156][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9912.623450][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9912.623736][ C1] tcp_delack_timer+0x84/0x240 [ 9912.623993][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9912.624282][ C1] call_timer_fn+0x176/0x430 [ 9912.624534][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9912.624807][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9912.625087][ C1] __run_timers.part.0+0x52d/0x890 [ 9912.625362][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9912.625649][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9912.625949][ C1] ? __pfx___schedule+0x10/0x10 [ 9912.626211][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9912.626535][ C1] run_timer_softirq+0x72/0x100 [ 9912.626794][ C1] __do_softirq+0x1bc/0x7ff [ 9912.627036][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9912.627310][ C1] run_ksoftirqd+0x2e/0x60 [ 9912.627551][ C1] smpboot_thread_fn+0x30e/0x840 [ 9912.627815][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9912.628112][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9912.628407][ C1] kthread+0x292/0x360 [ 9912.628627][ C1] ? __pfx_kthread+0x10/0x10 [ 9912.628877][ C1] ret_from_fork+0x34/0x70 [ 9912.629118][ C1] ? __pfx_kthread+0x10/0x10 [ 9912.629366][ C1] ret_from_fork_asm+0x1b/0x30 [ 9912.629624][ C1] [ 9940.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8151s! [swapper/0:0] [ 9940.527920][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9940.529125][ C0] irq event stamp: 27567077 [ 9940.529367][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9940.529899][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9940.530368][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9940.530869][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9940.531364][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9940.531840][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9940.532490][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9940.532832][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9940.533853][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9940.534178][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9940.534596][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9940.535017][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9940.535440][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9940.535859][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9940.536281][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9940.536751][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9940.537096][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9940.537518][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9940.537934][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9940.538359][ C0] Call Trace: [ 9940.538544][ C0] [ 9940.538701][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9940.538975][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9940.539230][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9940.539517][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9940.539805][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9940.540110][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9940.540398][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9940.540717][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9940.540987][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9940.541266][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9940.541585][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9940.541893][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9940.542226][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9940.542527][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9940.542834][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9940.543138][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9940.543466][ C0] ? get_stack_info+0x36/0xc0 [ 9940.543719][ C0] ? lock_acquire+0x1c1/0x220 [ 9940.543971][ C0] ? lock_release+0x1d5/0x250 [ 9940.544228][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9940.544486][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9940.544766][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9940.545060][ C0] ? lock_acquire+0x1c1/0x220 [ 9940.545310][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9940.545565][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9940.545838][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9940.546081][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9940.546336][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9940.546601][ C0] ? __inet_lookup_established+0x341/0x610 [ 9940.546909][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9940.547198][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9940.547487][ C0] ip_local_deliver+0x19d/0x480 [ 9940.547740][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9940.548018][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9940.548289][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9940.548565][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9940.548827][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9940.549163][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9940.549440][ C0] ip_rcv+0x564/0x740 [ 9940.549652][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9940.549892][ C0] ? set_track_prepare+0x8a/0xd0 [ 9940.550155][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9940.550445][ C0] ? rest_init+0x153/0x260 [ 9940.550681][ C0] ? skb_clone+0x10b/0x330 [ 9940.550922][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9940.551264][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9940.551584][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9940.551882][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9940.552191][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9940.552454][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9940.552697][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9940.553013][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9940.553310][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9940.553647][ C0] ? lock_acquire+0x1c1/0x220 [ 9940.553899][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9940.554207][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9940.554506][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9940.554831][ C0] ? __copy_skb_header+0xaf/0x490 [ 9940.555100][ C0] ? __skb_clone+0x57a/0x760 [ 9940.555346][ C0] netif_receive_skb+0x55/0x280 [ 9940.555607][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9940.555938][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9940.556287][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9940.556600][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9940.556890][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9940.557195][ C0] ? hlock_class+0x4e/0x130 [ 9940.557444][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9940.557774][ C0] ? place_entity+0x21/0x2f0 [ 9940.558023][ C0] ? resched_curr+0x219/0x280 [ 9940.558282][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9940.558551][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9940.558835][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9940.559115][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9940.559370][ C0] ? activate_task+0xf5/0x260 [ 9940.559616][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9940.559889][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9940.560162][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9940.560420][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9940.560713][ C0] ? get_stack_info+0x36/0xc0 [ 9940.560966][ C0] ? stack_access_ok+0xda/0x1f0 [ 9940.561225][ C0] ? get_reg+0x119/0x190 [ 9940.561455][ C0] __tcf_classify+0x32c/0x7d0 [ 9940.561706][ C0] tcf_classify+0x283/0x930 [ 9940.561951][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9940.562275][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9940.562549][ C0] ? arch_stack_walk+0x8c/0x100 [ 9940.562806][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9940.563093][ C0] tc_run+0x2e4/0x5d0 [ 9940.563315][ C0] ? __pfx_tc_run+0x10/0x10 [ 9940.563565][ C0] ? lock_acquire+0x1c1/0x220 [ 9940.563818][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9940.564095][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9940.564359][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9940.564652][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9940.564932][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9940.565254][ C0] ? neigh_hh_output+0x348/0x590 [ 9940.565516][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9940.565798][ C0] ip_finish_output2+0x786/0x18e0 [ 9940.566068][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9940.566364][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9940.566720][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9940.567006][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9940.567272][ C0] ? __ip_finish_output+0x10f/0x770 [ 9940.567547][ C0] ip_output+0x16b/0x4f0 [ 9940.567772][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9940.568057][ C0] ? __pfx_ip_output+0x10/0x10 [ 9940.568320][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9940.568616][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9940.568880][ C0] ? ip_local_out+0x114/0x3b0 [ 9940.569131][ C0] __ip_queue_xmit+0x672/0x1910 [ 9940.569390][ C0] ? __skb_clone+0x57a/0x760 [ 9940.569638][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9940.569921][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9940.570220][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9940.570538][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9940.570791][ C0] ? tcp_current_mss+0x40a/0x510 [ 9940.571057][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9940.571338][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9940.571627][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9940.571884][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9940.572152][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9940.572471][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9940.572755][ C0] ? ktime_get+0xb6/0x190 [ 9940.572989][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9940.573264][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9940.573546][ C0] tcp_write_timer+0x82/0x1d0 [ 9940.573801][ C0] call_timer_fn+0x176/0x430 [ 9940.574050][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9940.574322][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9940.574597][ C0] __run_timers.part.0+0x52d/0x890 [ 9940.574868][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9940.575152][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9940.575449][ C0] ? lock_acquire+0x1c1/0x220 [ 9940.575703][ C0] ? clockevents_program_event+0xf6/0x300 [ 9940.576008][ C0] ? lock_release+0x1d5/0x250 [ 9940.576259][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9940.576536][ C0] ? ktime_get+0xb6/0x190 [ 9940.576769][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9940.577069][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9940.577378][ C0] run_timer_softirq+0x72/0x100 [ 9940.577641][ C0] __do_softirq+0x1bc/0x7ff [ 9940.577887][ C0] irq_exit_rcu+0x98/0xc0 [ 9940.578127][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9940.578424][ C0] [ 9940.578583][ C0] [ 9940.578743][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9940.579065][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9940.579337][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9940.580350][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9940.580668][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9940.581084][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9940.581499][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9940.581915][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9940.582330][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9940.582750][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9940.583052][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9940.583325][ C0] default_idle_call+0x69/0xa0 [ 9940.583587][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9940.583848][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9940.584140][ C0] ? lock_release+0x1d5/0x250 [ 9940.584388][ C0] do_idle+0xfb/0x160 [ 9940.584600][ C0] cpu_startup_entry+0x55/0x60 [ 9940.584854][ C0] rest_init+0x153/0x260 [ 9940.585085][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9940.585370][ C0] arch_call_rest_init+0x13/0x40 [ 9940.585640][ C0] start_kernel+0x314/0x3d0 [ 9940.585886][ C0] x86_64_start_reservations+0x18/0x30 [ 9940.586181][ C0] x86_64_start_kernel+0xba/0x110 [ 9940.586449][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9940.586774][ C0] [ 9940.586939][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8151s! [ksoftirqd/1:22] [ 9940.587389][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9940.588585][ C1] irq event stamp: 3886976 [ 9940.588819][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9940.589316][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9940.589818][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9940.590319][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9940.590804][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9940.591300][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9940.591945][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 9940.592283][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [ 9940.593296][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9940.593614][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9940.594031][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9940.594447][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9940.594862][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9940.595276][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9940.595689][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9940.596156][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9940.596502][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9940.596920][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9940.597343][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9940.597768][ C1] Call Trace: [ 9940.597947][ C1] [ 9940.598112][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9940.598387][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9940.598638][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9940.598932][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9940.599217][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9940.599518][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9940.599794][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9940.600112][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9940.600393][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9940.600715][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9940.601023][ C1] [ 9940.601182][ C1] [ 9940.601343][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9940.601674][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9940.601975][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 9940.602277][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9940.602578][ C1] ? run_ksoftirqd+0xb/0x60 [ 9940.602819][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9940.603141][ C1] ? __orc_find+0x9c/0xf0 [ 9940.603375][ C1] ? lock_acquire+0x1c1/0x220 [ 9940.603627][ C1] ? irqentry_enter+0x2b/0x60 [ 9940.603881][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9940.604142][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9940.604427][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9940.604729][ C1] ? lock_acquire+0x1c1/0x220 [ 9940.604978][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9940.605236][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9940.605508][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9940.605757][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9940.606022][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9940.606296][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9940.606588][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9940.606881][ C1] ip_local_deliver+0x19d/0x480 [ 9940.607139][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9940.607421][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9940.607683][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9940.607963][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9940.608232][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9940.608571][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9940.608843][ C1] ip_rcv+0x564/0x740 [ 9940.609055][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9940.609294][ C1] ? set_track_prepare+0x8a/0xd0 [ 9940.609556][ C1] ? irqentry_enter+0x2b/0x60 [ 9940.609814][ C1] ? irqentry_enter+0x2b/0x60 [ 9940.610069][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9940.610313][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9940.610633][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9940.610976][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9940.611288][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9940.611627][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9940.611924][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9940.612259][ C1] netif_receive_skb+0x55/0x280 [ 9940.612519][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9940.612850][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9940.613199][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9940.613510][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9940.613802][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9940.614108][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9940.614446][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9940.614733][ C1] ? arch_stack_walk+0x68/0x100 [ 9940.614993][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9940.615269][ C1] ? irqentry_enter+0x2b/0x60 [ 9940.615519][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9940.615834][ C1] ? irqentry_enter+0x2b/0x60 [ 9940.616086][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9940.616411][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9940.616691][ C1] ? arch_stack_walk+0x68/0x100 [ 9940.616953][ C1] __tcf_classify+0x32c/0x7d0 [ 9940.617208][ C1] tcf_classify+0x283/0x930 [ 9940.617453][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9940.617723][ C1] tc_run+0x2e4/0x5d0 [ 9940.617941][ C1] ? __pfx_tc_run+0x10/0x10 [ 9940.618191][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9940.618456][ C1] ? irqentry_enter+0x2b/0x60 [ 9940.618709][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9940.618997][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9940.619320][ C1] ip_finish_output2+0x786/0x18e0 [ 9940.619589][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9940.619879][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9940.620151][ C1] ? __ip_finish_output+0x10f/0x770 [ 9940.620426][ C1] ip_output+0x16b/0x4f0 [ 9940.620652][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9940.620978][ C1] ? __pfx_ip_output+0x10/0x10 [ 9940.621231][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9940.621591][ C1] ? __pfx_ip_output+0x10/0x10 [ 9940.621850][ C1] __ip_queue_xmit+0x672/0x1910 [ 9940.622112][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9940.622390][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9940.622684][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9940.622972][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9940.623264][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9940.623546][ C1] tcp_delack_timer+0x84/0x240 [ 9940.623799][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9940.624088][ C1] call_timer_fn+0x176/0x430 [ 9940.624338][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9940.624610][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9940.624893][ C1] __run_timers.part.0+0x52d/0x890 [ 9940.625167][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9940.625451][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9940.625753][ C1] ? __pfx___schedule+0x10/0x10 [ 9940.626013][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9940.626338][ C1] run_timer_softirq+0x72/0x100 [ 9940.626601][ C1] __do_softirq+0x1bc/0x7ff [ 9940.626844][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9940.627116][ C1] run_ksoftirqd+0x2e/0x60 [ 9940.627356][ C1] smpboot_thread_fn+0x30e/0x840 [ 9940.627620][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9940.627910][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9940.628205][ C1] kthread+0x292/0x360 [ 9940.628423][ C1] ? __pfx_kthread+0x10/0x10 [ 9940.628677][ C1] ret_from_fork+0x34/0x70 [ 9940.628913][ C1] ? __pfx_kthread+0x10/0x10 [ 9940.629159][ C1] ret_from_fork_asm+0x1b/0x30 [ 9940.629415][ C1] [ 9965.884025][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9965.884417][ C0] rcu: 0-....: (8712407 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=2088817 [ 9965.884937][ C0] rcu: (t=8771575 jiffies g=1007429 q=31 ncpus=4) [ 9965.885284][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9965.885769][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9965.886412][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9965.886760][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9965.887781][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9965.888109][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9965.888537][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9965.888963][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9965.889385][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9965.889807][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9965.890232][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9965.890710][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9965.891058][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9965.891488][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9965.891909][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9965.892329][ C0] Call Trace: [ 9965.892506][ C0] [ 9965.892664][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9965.892956][ C0] ? print_cpu_stall+0x263/0x6a0 [ 9965.893221][ C0] ? check_cpu_stall+0x284/0x500 [ 9965.893489][ C0] ? rcu_pending+0x92/0x360 [ 9965.893730][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9965.894012][ C0] ? update_process_times+0xb9/0x110 [ 9965.894300][ C0] ? tick_sched_handle+0x67/0x130 [ 9965.894570][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9965.894870][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9965.895128][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9965.895457][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9965.895745][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9965.896052][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9965.896337][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9965.896663][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9965.896937][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9965.897221][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9965.897547][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9965.897857][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9965.898202][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9965.898509][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9965.898823][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9965.899127][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9965.899450][ C0] ? get_stack_info+0x36/0xc0 [ 9965.899708][ C0] ? lock_acquire+0x1c1/0x220 [ 9965.899964][ C0] ? lock_release+0x1d5/0x250 [ 9965.900223][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9965.900486][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9965.900777][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9965.901081][ C0] ? lock_acquire+0x1c1/0x220 [ 9965.901330][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9965.901585][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9965.901857][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9965.902107][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9965.902370][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9965.902644][ C0] ? __inet_lookup_established+0x341/0x610 [ 9965.902961][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9965.903249][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9965.903540][ C0] ip_local_deliver+0x19d/0x480 [ 9965.903809][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9965.904100][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9965.904369][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9965.904646][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9965.904909][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9965.905248][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9965.905527][ C0] ip_rcv+0x564/0x740 [ 9965.905739][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9965.905980][ C0] ? set_track_prepare+0x8a/0xd0 [ 9965.906245][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9965.906536][ C0] ? rest_init+0x153/0x260 [ 9965.906771][ C0] ? skb_clone+0x10b/0x330 [ 9965.907015][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9965.907350][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9965.907668][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9965.907972][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9965.908282][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9965.908541][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9965.908781][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9965.909095][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9965.909394][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9965.909737][ C0] ? lock_acquire+0x1c1/0x220 [ 9965.909989][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9965.910304][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9965.910604][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9965.910939][ C0] ? __copy_skb_header+0xaf/0x490 [ 9965.911214][ C0] ? __skb_clone+0x57a/0x760 [ 9965.911463][ C0] netif_receive_skb+0x55/0x280 [ 9965.911719][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9965.912046][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9965.912395][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9965.912712][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9965.913005][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9965.913306][ C0] ? hlock_class+0x4e/0x130 [ 9965.913550][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9965.913882][ C0] ? place_entity+0x21/0x2f0 [ 9965.914130][ C0] ? resched_curr+0x219/0x280 [ 9965.914386][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9965.914657][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9965.914941][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9965.915219][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9965.915478][ C0] ? activate_task+0xf5/0x260 [ 9965.915728][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9965.916005][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9965.916282][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9965.916538][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9965.916827][ C0] ? get_stack_info+0x36/0xc0 [ 9965.917087][ C0] ? stack_access_ok+0xda/0x1f0 [ 9965.917351][ C0] ? get_reg+0x119/0x190 [ 9965.917579][ C0] __tcf_classify+0x32c/0x7d0 [ 9965.917827][ C0] tcf_classify+0x283/0x930 [ 9965.918073][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9965.918406][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9965.918672][ C0] ? arch_stack_walk+0x8c/0x100 [ 9965.918931][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9965.919223][ C0] tc_run+0x2e4/0x5d0 [ 9965.919440][ C0] ? __pfx_tc_run+0x10/0x10 [ 9965.919688][ C0] ? lock_acquire+0x1c1/0x220 [ 9965.919943][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9965.920221][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9965.920487][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9965.920778][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9965.921059][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9965.921382][ C0] ? neigh_hh_output+0x348/0x590 [ 9965.921645][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9965.921926][ C0] ip_finish_output2+0x786/0x18e0 [ 9965.922201][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9965.922497][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9965.922847][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9965.923136][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9965.923405][ C0] ? __ip_finish_output+0x10f/0x770 [ 9965.923686][ C0] ip_output+0x16b/0x4f0 [ 9965.923912][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9965.924197][ C0] ? __pfx_ip_output+0x10/0x10 [ 9965.924449][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9965.924751][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9965.925014][ C0] ? ip_local_out+0x114/0x3b0 [ 9965.925269][ C0] __ip_queue_xmit+0x672/0x1910 [ 9965.925533][ C0] ? __skb_clone+0x57a/0x760 [ 9965.925781][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9965.926063][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9965.926358][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9965.926678][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9965.926939][ C0] ? tcp_current_mss+0x40a/0x510 [ 9965.927203][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9965.927487][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9965.927762][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9965.928021][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9965.928290][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9965.928606][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9965.928887][ C0] ? ktime_get+0xb6/0x190 [ 9965.929122][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9965.929399][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9965.929678][ C0] tcp_write_timer+0x82/0x1d0 [ 9965.929937][ C0] call_timer_fn+0x176/0x430 [ 9965.930188][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9965.930463][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9965.930741][ C0] __run_timers.part.0+0x52d/0x890 [ 9965.931015][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9965.931301][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9965.931599][ C0] ? lock_acquire+0x1c1/0x220 [ 9965.931852][ C0] ? clockevents_program_event+0xf6/0x300 [ 9965.932160][ C0] ? lock_release+0x1d5/0x250 [ 9965.932414][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9965.932695][ C0] ? ktime_get+0xb6/0x190 [ 9965.932930][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9965.933231][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9965.933541][ C0] run_timer_softirq+0x72/0x100 [ 9965.933804][ C0] __do_softirq+0x1bc/0x7ff [ 9965.934057][ C0] irq_exit_rcu+0x98/0xc0 [ 9965.934290][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9965.934594][ C0] [ 9965.934752][ C0] [ 9965.934909][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9965.935229][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9965.935502][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9965.936528][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9965.936858][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9965.937281][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9965.937704][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9965.938137][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9965.938557][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9965.938977][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9965.939280][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9965.939552][ C0] default_idle_call+0x69/0xa0 [ 9965.939808][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9965.940071][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9965.940368][ C0] ? lock_release+0x1d5/0x250 [ 9965.940618][ C0] do_idle+0xfb/0x160 [ 9965.940832][ C0] cpu_startup_entry+0x55/0x60 [ 9965.941088][ C0] rest_init+0x153/0x260 [ 9965.941315][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9965.941604][ C0] arch_call_rest_init+0x13/0x40 [ 9965.941870][ C0] start_kernel+0x314/0x3d0 [ 9965.942117][ C0] x86_64_start_reservations+0x18/0x30 [ 9965.942413][ C0] x86_64_start_kernel+0xba/0x110 [ 9965.942680][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9965.943005][ C0] [ 9965.943169][ C0] Sending NMI from CPU 0 to CPUs 1: [ 9965.943462][ C1] NMI backtrace for cpu 1 [ 9965.943468][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9965.943472][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9965.943474][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9965.943481][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9965.943484][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9965.943487][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9965.943489][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9965.943491][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9965.943493][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9965.943494][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9965.943496][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9965.943498][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9965.943501][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9965.943502][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9965.943504][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9965.943505][ C1] Call Trace: [ 9965.943508][ C1] [ 9965.943510][ C1] ? nmi_cpu_backtrace+0x112/0x220 [ 9965.943516][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9965.943521][ C1] ? nmi_handle+0x156/0x420 [ 9965.943525][ C1] ? default_do_nmi+0x41/0x100 [ 9965.943529][ C1] ? exc_nmi+0xf3/0x120 [ 9965.943531][ C1] ? end_repeat_nmi+0xf/0x60 [ 9965.943535][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9965.943539][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9965.943542][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9965.943546][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9965.943550][ C1] [ 9965.943550][ C1] [ 9965.943551][ C1] ? run_ksoftirqd+0xb/0x60 [ 9965.943557][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9965.943560][ C1] ? __orc_find+0x9c/0xf0 [ 9965.943563][ C1] ? lock_acquire+0x1c1/0x220 [ 9965.943567][ C1] ? irqentry_enter+0x2b/0x60 [ 9965.943572][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9965.943576][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9965.943579][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9965.943582][ C1] ? lock_acquire+0x1c1/0x220 [ 9965.943585][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9965.943589][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9965.943592][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9965.943599][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9965.943602][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9965.943607][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9965.943613][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9965.943617][ C1] ip_local_deliver+0x19d/0x480 [ 9965.943620][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9965.943623][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9965.943627][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9965.943631][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9965.943634][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9965.943637][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9965.943646][ C1] ip_rcv+0x564/0x740 [ 9965.943650][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9965.943653][ C1] ? set_track_prepare+0x8a/0xd0 [ 9965.943656][ C1] ? irqentry_enter+0x2b/0x60 [ 9965.943659][ C1] ? irqentry_enter+0x2b/0x60 [ 9965.943663][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9965.943665][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9965.943669][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9965.943672][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9965.943675][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9965.943678][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9965.943681][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9965.943686][ C1] netif_receive_skb+0x55/0x280 [ 9965.943689][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9965.943696][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9965.943703][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9965.943710][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9965.943716][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9965.943727][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9965.943737][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9965.943739][ C1] ? arch_stack_walk+0x68/0x100 [ 9965.943744][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9965.943747][ C1] ? irqentry_enter+0x2b/0x60 [ 9965.943751][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9965.943755][ C1] ? irqentry_enter+0x2b/0x60 [ 9965.943759][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9965.943766][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9965.943768][ C1] ? arch_stack_walk+0x68/0x100 [ 9965.943773][ C1] __tcf_classify+0x32c/0x7d0 [ 9965.943778][ C1] tcf_classify+0x283/0x930 [ 9965.943782][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9965.943786][ C1] tc_run+0x2e4/0x5d0 [ 9965.943791][ C1] ? __pfx_tc_run+0x10/0x10 [ 9965.943796][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9965.943802][ C1] ? irqentry_enter+0x2b/0x60 [ 9965.943805][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9965.943808][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9965.943815][ C1] ip_finish_output2+0x786/0x18e0 [ 9965.943820][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9965.943823][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9965.943827][ C1] ? __ip_finish_output+0x10f/0x770 [ 9965.943831][ C1] ip_output+0x16b/0x4f0 [ 9965.943834][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9965.943837][ C1] ? __pfx_ip_output+0x10/0x10 [ 9965.943841][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9965.943848][ C1] ? __pfx_ip_output+0x10/0x10 [ 9965.943853][ C1] __ip_queue_xmit+0x672/0x1910 [ 9965.943858][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9965.943865][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9965.943869][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9965.943873][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9965.943877][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9965.943880][ C1] tcp_delack_timer+0x84/0x240 [ 9965.943884][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9965.943887][ C1] call_timer_fn+0x176/0x430 [ 9965.943892][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9965.943896][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9965.943901][ C1] __run_timers.part.0+0x52d/0x890 [ 9965.943904][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9965.943909][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9965.943913][ C1] ? __pfx___schedule+0x10/0x10 [ 9965.943917][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9965.943922][ C1] run_timer_softirq+0x72/0x100 [ 9965.943925][ C1] __do_softirq+0x1bc/0x7ff [ 9965.943929][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9965.943933][ C1] run_ksoftirqd+0x2e/0x60 [ 9965.943936][ C1] smpboot_thread_fn+0x30e/0x840 [ 9965.943941][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9965.943945][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9965.943948][ C1] kthread+0x292/0x360 [ 9965.943951][ C1] ? __pfx_kthread+0x10/0x10 [ 9965.943954][ C1] ret_from_fork+0x34/0x70 [ 9965.943957][ C1] ? __pfx_kthread+0x10/0x10 [ 9965.943960][ C1] ret_from_fork_asm+0x1b/0x30 [ 9965.943967][ C1] [ 9992.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8200s! [swapper/0:0] [ 9992.527929][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9992.529130][ C0] irq event stamp: 27567077 [ 9992.529374][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [ 9992.529909][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [ 9992.530385][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [ 9992.530887][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [ 9992.531382][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [ 9992.531863][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9992.532513][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9992.532858][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9992.533885][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [ 9992.534212][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9992.534638][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [ 9992.535058][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [ 9992.535477][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [ 9992.535900][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [ 9992.536324][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [ 9992.536794][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9992.537148][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [ 9992.537574][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9992.538000][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9992.538426][ C0] Call Trace: [ 9992.538604][ C0] [ 9992.538765][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9992.539042][ C0] ? __run_hrtimer+0x1c3/0x710 [ 9992.539301][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9992.539592][ C0] ? __hrtimer_run_queues+0x197/0x270 [ 9992.539881][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9992.540185][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9992.540466][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9992.540791][ C0] ? hrtimer_interrupt+0x2c3/0x770 [ 9992.541065][ C0] ? trace_rcu_dyntick+0x10a/0x150 [ 9992.541346][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9992.541670][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9992.541979][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9992.542315][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9992.542617][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9992.542925][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9992.543230][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9992.543558][ C0] ? get_stack_info+0x36/0xc0 [ 9992.543809][ C0] ? lock_acquire+0x1c1/0x220 [ 9992.544058][ C0] ? lock_release+0x1d5/0x250 [ 9992.544307][ C0] do_raw_spin_lock+0x1ec/0x270 [ 9992.544566][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9992.544850][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9992.545149][ C0] ? lock_acquire+0x1c1/0x220 [ 9992.545401][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [ 9992.545658][ C0] _raw_spin_lock_nested+0x65/0x80 [ 9992.545935][ C0] tcp_v4_rcv+0x2159/0x29b0 [ 9992.546180][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9992.546438][ C0] ? __pfx_raw_v4_input+0x10/0x10 [ 9992.546707][ C0] ? __inet_lookup_established+0x341/0x610 [ 9992.547026][ C0] ip_protocol_deliver_rcu+0x93/0x360 [ 9992.547323][ C0] ip_local_deliver_finish+0x2ae/0x450 [ 9992.547618][ C0] ip_local_deliver+0x19d/0x480 [ 9992.547883][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [ 9992.548174][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9992.548443][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [ 9992.548720][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9992.548983][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9992.549322][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9992.549597][ C0] ip_rcv+0x564/0x740 [ 9992.549810][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9992.550051][ C0] ? set_track_prepare+0x8a/0xd0 [ 9992.550316][ C0] ? __pfx_set_track_prepare+0x10/0x10 [ 9992.550607][ C0] ? rest_init+0x153/0x260 [ 9992.550844][ C0] ? skb_clone+0x10b/0x330 [ 9992.551088][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9992.551422][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9992.551740][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [ 9992.552041][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9992.552354][ C0] ? __tcf_classify+0x32c/0x7d0 [ 9992.552617][ C0] ? __pfx_ip_rcv+0x10/0x10 [ 9992.552861][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [ 9992.553181][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9992.553484][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9992.553824][ C0] ? lock_acquire+0x1c1/0x220 [ 9992.554072][ C0] ? netif_receive_skb_internal+0x84/0x300 [ 9992.554382][ C0] netif_receive_skb_internal+0xb0/0x300 [ 9992.554685][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9992.555023][ C0] ? __copy_skb_header+0xaf/0x490 [ 9992.555290][ C0] ? __skb_clone+0x57a/0x760 [ 9992.555533][ C0] netif_receive_skb+0x55/0x280 [ 9992.555795][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9992.556126][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9992.556480][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9992.556793][ C0] tcf_action_exec.part.0+0x115/0x3d0 [ 9992.557084][ C0] fl_classify+0x4dc/0x650 [cls_flower] [ 9992.557386][ C0] ? hlock_class+0x4e/0x130 [ 9992.557634][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9992.557970][ C0] ? place_entity+0x21/0x2f0 [ 9992.558217][ C0] ? resched_curr+0x219/0x280 [ 9992.558472][ C0] ? __pfx_resched_curr+0x10/0x10 [ 9992.558745][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [ 9992.559030][ C0] ? unwind_next_frame+0x1cc/0x1d10 [ 9992.559308][ C0] ? wakeup_preempt+0x161/0x2c0 [ 9992.559567][ C0] ? activate_task+0xf5/0x260 [ 9992.559818][ C0] ? trace_sched_wakeup+0xd2/0x100 [ 9992.560099][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 9992.560376][ C0] ? _raw_spin_unlock+0x23/0x40 [ 9992.560632][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9992.560920][ C0] ? get_stack_info+0x36/0xc0 [ 9992.561176][ C0] ? stack_access_ok+0xda/0x1f0 [ 9992.561446][ C0] ? get_reg+0x119/0x190 [ 9992.561674][ C0] __tcf_classify+0x32c/0x7d0 [ 9992.561923][ C0] tcf_classify+0x283/0x930 [ 9992.562163][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9992.562492][ C0] ? __pfx_tcf_classify+0x10/0x10 [ 9992.562761][ C0] ? arch_stack_walk+0x8c/0x100 [ 9992.563029][ C0] ? get_stack_info_noinstr+0x18/0x110 [ 9992.563323][ C0] tc_run+0x2e4/0x5d0 [ 9992.563538][ C0] ? __pfx_tc_run+0x10/0x10 [ 9992.563779][ C0] ? lock_acquire+0x1c1/0x220 [ 9992.564029][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [ 9992.564303][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [ 9992.564576][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9992.564861][ C0] ? ip_finish_output2+0x786/0x18e0 [ 9992.565139][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9992.565456][ C0] ? neigh_hh_output+0x348/0x590 [ 9992.565725][ C0] ? ip_finish_output2+0x262/0x18e0 [ 9992.566001][ C0] ip_finish_output2+0x786/0x18e0 [ 9992.566269][ C0] ? stack_depot_save_flags+0x45/0x550 [ 9992.566562][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9992.566918][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [ 9992.567214][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9992.567479][ C0] ? __ip_finish_output+0x10f/0x770 [ 9992.567760][ C0] ip_output+0x16b/0x4f0 [ 9992.567993][ C0] ? __run_timers.part.0+0x52d/0x890 [ 9992.568282][ C0] ? __pfx_ip_output+0x10/0x10 [ 9992.568535][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9992.568838][ C0] ? rcu_read_lock_held+0xe/0x50 [ 9992.569103][ C0] ? ip_local_out+0x114/0x3b0 [ 9992.569357][ C0] __ip_queue_xmit+0x672/0x1910 [ 9992.569620][ C0] ? __skb_clone+0x57a/0x760 [ 9992.569869][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [ 9992.570150][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9992.570445][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 9992.570766][ C0] tcp_write_xmit+0xe42/0x24c0 [ 9992.571027][ C0] ? tcp_current_mss+0x40a/0x510 [ 9992.571290][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [ 9992.571572][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [ 9992.571848][ C0] ? mark_lock_irq+0x6e2/0xa10 [ 9992.572102][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [ 9992.572373][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9992.572693][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9992.572970][ C0] ? ktime_get+0xb6/0x190 [ 9992.573202][ C0] tcp_send_loss_probe+0x4c9/0x830 [ 9992.573474][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9992.573758][ C0] tcp_write_timer+0x82/0x1d0 [ 9992.574008][ C0] call_timer_fn+0x176/0x430 [ 9992.574258][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 9992.574535][ C0] ? next_expiry_recalc+0xcd/0x220 [ 9992.574808][ C0] __run_timers.part.0+0x52d/0x890 [ 9992.575084][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [ 9992.575368][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [ 9992.575669][ C0] ? lock_acquire+0x1c1/0x220 [ 9992.575916][ C0] ? clockevents_program_event+0xf6/0x300 [ 9992.576220][ C0] ? lock_release+0x1d5/0x250 [ 9992.576471][ C0] ? kvm_clock_get_cycles+0x18/0x30 [ 9992.576745][ C0] ? ktime_get+0xb6/0x190 [ 9992.576975][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [ 9992.577273][ C0] ? clockevents_program_event+0x1ed/0x300 [ 9992.577587][ C0] run_timer_softirq+0x72/0x100 [ 9992.577850][ C0] __do_softirq+0x1bc/0x7ff [ 9992.578099][ C0] irq_exit_rcu+0x98/0xc0 [ 9992.578331][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 9992.578640][ C0] [ 9992.578796][ C0] [ 9992.578952][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9992.579271][ C0] RIP: 0010:default_idle+0xf/0x20 [ 9992.579549][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9992.580571][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [ 9992.580901][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [ 9992.581324][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [ 9992.581746][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [ 9992.582171][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [ 9992.582598][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [ 9992.583021][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9992.583327][ C0] ? cpuidle_idle_call+0x1f6/0x280 [ 9992.583604][ C0] default_idle_call+0x69/0xa0 [ 9992.583855][ C0] cpuidle_idle_call+0x1f6/0x280 [ 9992.584122][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9992.584415][ C0] ? lock_release+0x1d5/0x250 [ 9992.584671][ C0] do_idle+0xfb/0x160 [ 9992.584886][ C0] cpu_startup_entry+0x55/0x60 [ 9992.585142][ C0] rest_init+0x153/0x260 [ 9992.585368][ C0] ? acpi_enable_subsystem+0xac/0x150 [ 9992.585660][ C0] arch_call_rest_init+0x13/0x40 [ 9992.585928][ C0] start_kernel+0x314/0x3d0 [ 9992.586170][ C0] x86_64_start_reservations+0x18/0x30 [ 9992.586461][ C0] x86_64_start_kernel+0xba/0x110 [ 9992.586734][ C0] secondary_startup_64_no_verify+0x16d/0x17b [ 9992.587065][ C0] [ 9992.587233][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8200s! [ksoftirqd/1:22] [ 9992.587683][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [ 9992.588878][ C1] irq event stamp: 3886976 [ 9992.589112][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [ 9992.589608][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [ 9992.590105][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [ 9992.590605][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [ 9992.591093][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [ 9992.591590][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9992.592240][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9992.592583][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9992.593611][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [ 9992.593939][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [ 9992.594363][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [ 9992.594786][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [ 9992.595216][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [ 9992.595642][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [ 9992.596064][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9992.596537][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9992.596884][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [ 9992.597305][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9992.597722][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9992.598148][ C1] Call Trace: [ 9992.598329][ C1] [ 9992.598485][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9992.598758][ C1] ? __run_hrtimer+0x1c3/0x710 [ 9992.599013][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9992.599303][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9992.599592][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9992.599900][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9992.600181][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [ 9992.600508][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9992.600784][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [ 9992.601111][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [ 9992.601425][ C1] [ 9992.601582][ C1] [ 9992.601739][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9992.602071][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9992.602377][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9992.602692][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9992.602993][ C1] ? run_ksoftirqd+0xb/0x60 [ 9992.603238][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9992.603566][ C1] ? __orc_find+0x9c/0xf0 [ 9992.603799][ C1] ? lock_acquire+0x1c1/0x220 [ 9992.604055][ C1] ? irqentry_enter+0x2b/0x60 [ 9992.604311][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9992.604578][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9992.604868][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9992.605171][ C1] ? lock_acquire+0x1c1/0x220 [ 9992.605419][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [ 9992.605671][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9992.605944][ C1] tcp_v4_rcv+0x2159/0x29b0 [ 9992.606195][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9992.606459][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9992.606732][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9992.607023][ C1] ip_local_deliver_finish+0x2ae/0x450 [ 9992.607315][ C1] ip_local_deliver+0x19d/0x480 [ 9992.607573][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9992.607863][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9992.608133][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [ 9992.608411][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9992.608674][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9992.609014][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9992.609288][ C1] ip_rcv+0x564/0x740 [ 9992.609503][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9992.609749][ C1] ? set_track_prepare+0x8a/0xd0 [ 9992.610013][ C1] ? irqentry_enter+0x2b/0x60 [ 9992.610267][ C1] ? irqentry_enter+0x2b/0x60 [ 9992.610521][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9992.610767][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9992.611083][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9992.611426][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9992.611739][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9992.612078][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9992.612375][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9992.612710][ C1] netif_receive_skb+0x55/0x280 [ 9992.612975][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9992.613304][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9992.613656][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9992.613968][ C1] tcf_action_exec.part.0+0x115/0x3d0 [ 9992.614258][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9992.614563][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9992.614895][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9992.615178][ C1] ? arch_stack_walk+0x68/0x100 [ 9992.615436][ C1] ? unwind_next_frame+0x1cc/0x1d10 [ 9992.615712][ C1] ? irqentry_enter+0x2b/0x60 [ 9992.615961][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9992.616282][ C1] ? irqentry_enter+0x2b/0x60 [ 9992.616537][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9992.616860][ C1] ? unwind_next_frame+0x1478/0x1d10 [ 9992.617140][ C1] ? arch_stack_walk+0x68/0x100 [ 9992.617402][ C1] __tcf_classify+0x32c/0x7d0 [ 9992.617659][ C1] tcf_classify+0x283/0x930 [ 9992.617913][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9992.618186][ C1] tc_run+0x2e4/0x5d0 [ 9992.618402][ C1] ? __pfx_tc_run+0x10/0x10 [ 9992.618646][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [ 9992.618913][ C1] ? irqentry_enter+0x2b/0x60 [ 9992.619167][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9992.619455][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9992.619783][ C1] ip_finish_output2+0x786/0x18e0 [ 9992.620058][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9992.620346][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9992.620614][ C1] ? __ip_finish_output+0x10f/0x770 [ 9992.620891][ C1] ip_output+0x16b/0x4f0 [ 9992.621119][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9992.621443][ C1] ? __pfx_ip_output+0x10/0x10 [ 9992.621700][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [ 9992.622056][ C1] ? __pfx_ip_output+0x10/0x10 [ 9992.622314][ C1] __ip_queue_xmit+0x672/0x1910 [ 9992.622576][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9992.622855][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9992.623152][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9992.623438][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9992.623734][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9992.624021][ C1] tcp_delack_timer+0x84/0x240 [ 9992.624278][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9992.624565][ C1] call_timer_fn+0x176/0x430 [ 9992.624817][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9992.625093][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [ 9992.625375][ C1] __run_timers.part.0+0x52d/0x890 [ 9992.625650][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9992.625938][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9992.626238][ C1] ? __pfx___schedule+0x10/0x10 [ 9992.626500][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9992.626823][ C1] run_timer_softirq+0x72/0x100 [ 9992.627081][ C1] __do_softirq+0x1bc/0x7ff [ 9992.627322][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [ 9992.627598][ C1] run_ksoftirqd+0x2e/0x60 [ 9992.627844][ C1] smpboot_thread_fn+0x30e/0x840 [ 9992.628115][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9992.628406][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 9992.628700][ C1] kthread+0x292/0x360 [ 9992.628916][ C1] ? __pfx_kthread+0x10/0x10 [ 9992.629165][ C1] ret_from_fork+0x34/0x70 [ 9992.629404][ C1] ? __pfx_kthread+0x10/0x10 [ 9992.629652][ C1] ret_from_fork_asm+0x1b/0x30 [ 9992.629914][ C1] [10020.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8226s! [swapper/0:0] [10020.527929][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10020.529135][ C0] irq event stamp: 27567077 [10020.529379][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10020.529915][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10020.530391][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10020.530895][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10020.531389][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10020.531873][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10020.532525][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10020.532872][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10020.533900][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10020.534227][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10020.534652][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10020.535074][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10020.535496][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10020.535925][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10020.536353][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10020.536829][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10020.537180][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10020.537611][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10020.538044][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10020.538467][ C0] Call Trace: [10020.538648][ C0] [10020.538809][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10020.539087][ C0] ? __run_hrtimer+0x1c3/0x710 [10020.539347][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10020.539638][ C0] ? __hrtimer_run_queues+0x197/0x270 [10020.539927][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10020.540234][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10020.540518][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10020.540845][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10020.541121][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10020.541402][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10020.541728][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10020.542038][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10020.542376][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10020.542679][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10020.542989][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10020.543296][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10020.543625][ C0] ? get_stack_info+0x36/0xc0 [10020.543876][ C0] ? lock_acquire+0x1c1/0x220 [10020.544128][ C0] ? lock_release+0x1d5/0x250 [10020.544380][ C0] do_raw_spin_lock+0x1ec/0x270 [10020.544640][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10020.544927][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10020.545226][ C0] ? lock_acquire+0x1c1/0x220 [10020.545478][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10020.545735][ C0] _raw_spin_lock_nested+0x65/0x80 [10020.546010][ C0] tcp_v4_rcv+0x2159/0x29b0 [10020.546256][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10020.546513][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10020.546783][ C0] ? __inet_lookup_established+0x341/0x610 [10020.547099][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10020.547393][ C0] ip_local_deliver_finish+0x2ae/0x450 [10020.547691][ C0] ip_local_deliver+0x19d/0x480 [10020.547958][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10020.548247][ C0] ? rcu_read_lock_held+0xe/0x50 [10020.548516][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10020.548792][ C0] ? rcu_read_lock_held+0xe/0x50 [10020.549056][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10020.549396][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10020.549671][ C0] ip_rcv+0x564/0x740 [10020.549883][ C0] ? __pfx_ip_rcv+0x10/0x10 [10020.550124][ C0] ? set_track_prepare+0x8a/0xd0 [10020.550390][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10020.550680][ C0] ? rest_init+0x153/0x260 [10020.550916][ C0] ? skb_clone+0x10b/0x330 [10020.551160][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10020.551495][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10020.551812][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10020.552113][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10020.552426][ C0] ? __tcf_classify+0x32c/0x7d0 [10020.552688][ C0] ? __pfx_ip_rcv+0x10/0x10 [10020.552933][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10020.553254][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10020.553560][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10020.553900][ C0] ? lock_acquire+0x1c1/0x220 [10020.554148][ C0] ? netif_receive_skb_internal+0x84/0x300 [10020.554463][ C0] netif_receive_skb_internal+0xb0/0x300 [10020.554766][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10020.555098][ C0] ? __copy_skb_header+0xaf/0x490 [10020.555364][ C0] ? __skb_clone+0x57a/0x760 [10020.555608][ C0] netif_receive_skb+0x55/0x280 [10020.555870][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10020.556201][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10020.556554][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10020.556865][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10020.557157][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10020.557459][ C0] ? hlock_class+0x4e/0x130 [10020.557712][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10020.558044][ C0] ? place_entity+0x21/0x2f0 [10020.558294][ C0] ? resched_curr+0x219/0x280 [10020.558550][ C0] ? __pfx_resched_curr+0x10/0x10 [10020.558821][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10020.559106][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10020.559386][ C0] ? wakeup_preempt+0x161/0x2c0 [10020.559644][ C0] ? activate_task+0xf5/0x260 [10020.559895][ C0] ? trace_sched_wakeup+0xd2/0x100 [10020.560170][ C0] ? do_raw_spin_unlock+0x58/0x220 [10020.560446][ C0] ? _raw_spin_unlock+0x23/0x40 [10020.560702][ C0] ? get_stack_info_noinstr+0x18/0x110 [10020.560991][ C0] ? get_stack_info+0x36/0xc0 [10020.561252][ C0] ? stack_access_ok+0xda/0x1f0 [10020.561516][ C0] ? get_reg+0x119/0x190 [10020.561748][ C0] __tcf_classify+0x32c/0x7d0 [10020.561997][ C0] tcf_classify+0x283/0x930 [10020.562239][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10020.562568][ C0] ? __pfx_tcf_classify+0x10/0x10 [10020.562838][ C0] ? arch_stack_walk+0x8c/0x100 [10020.563107][ C0] ? get_stack_info_noinstr+0x18/0x110 [10020.563401][ C0] tc_run+0x2e4/0x5d0 [10020.563615][ C0] ? __pfx_tc_run+0x10/0x10 [10020.563856][ C0] ? lock_acquire+0x1c1/0x220 [10020.564106][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10020.564380][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10020.564652][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10020.564937][ C0] ? ip_finish_output2+0x786/0x18e0 [10020.565215][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10020.565535][ C0] ? neigh_hh_output+0x348/0x590 [10020.565802][ C0] ? ip_finish_output2+0x262/0x18e0 [10020.566084][ C0] ip_finish_output2+0x786/0x18e0 [10020.566351][ C0] ? stack_depot_save_flags+0x45/0x550 [10020.566644][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10020.567005][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10020.567305][ C0] ? rcu_read_lock_held+0xe/0x50 [10020.567570][ C0] ? __ip_finish_output+0x10f/0x770 [10020.567856][ C0] ip_output+0x16b/0x4f0 [10020.568083][ C0] ? __run_timers.part.0+0x52d/0x890 [10020.568368][ C0] ? __pfx_ip_output+0x10/0x10 [10020.568621][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10020.568925][ C0] ? rcu_read_lock_held+0xe/0x50 [10020.569190][ C0] ? ip_local_out+0x114/0x3b0 [10020.569448][ C0] __ip_queue_xmit+0x672/0x1910 [10020.569711][ C0] ? __skb_clone+0x57a/0x760 [10020.569960][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10020.570240][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10020.570536][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10020.570856][ C0] tcp_write_xmit+0xe42/0x24c0 [10020.571118][ C0] ? tcp_current_mss+0x40a/0x510 [10020.571380][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10020.571663][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10020.571938][ C0] ? mark_lock_irq+0x6e2/0xa10 [10020.572194][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10020.572465][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10020.572786][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10020.573061][ C0] ? ktime_get+0xb6/0x190 [10020.573292][ C0] tcp_send_loss_probe+0x4c9/0x830 [10020.573568][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10020.573852][ C0] tcp_write_timer+0x82/0x1d0 [10020.574102][ C0] call_timer_fn+0x176/0x430 [10020.574347][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10020.574625][ C0] ? next_expiry_recalc+0xcd/0x220 [10020.574901][ C0] __run_timers.part.0+0x52d/0x890 [10020.575177][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10020.575462][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10020.575763][ C0] ? lock_acquire+0x1c1/0x220 [10020.576011][ C0] ? clockevents_program_event+0xf6/0x300 [10020.576317][ C0] ? lock_release+0x1d5/0x250 [10020.576567][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10020.576842][ C0] ? ktime_get+0xb6/0x190 [10020.577073][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10020.577371][ C0] ? clockevents_program_event+0x1ed/0x300 [10020.577690][ C0] run_timer_softirq+0x72/0x100 [10020.577954][ C0] __do_softirq+0x1bc/0x7ff [10020.578203][ C0] irq_exit_rcu+0x98/0xc0 [10020.578435][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10020.578739][ C0] [10020.578896][ C0] [10020.579054][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10020.579372][ C0] RIP: 0010:default_idle+0xf/0x20 [10020.579644][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10020.580674][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10020.581004][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10020.581427][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10020.581851][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10020.582279][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10020.582707][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10020.583131][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10020.583435][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10020.583713][ C0] default_idle_call+0x69/0xa0 [10020.583963][ C0] cpuidle_idle_call+0x1f6/0x280 [10020.584234][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10020.584528][ C0] ? lock_release+0x1d5/0x250 [10020.584783][ C0] do_idle+0xfb/0x160 [10020.584998][ C0] cpu_startup_entry+0x55/0x60 [10020.585255][ C0] rest_init+0x153/0x260 [10020.585482][ C0] ? acpi_enable_subsystem+0xac/0x150 [10020.585774][ C0] arch_call_rest_init+0x13/0x40 [10020.586044][ C0] start_kernel+0x314/0x3d0 [10020.586284][ C0] x86_64_start_reservations+0x18/0x30 [10020.586575][ C0] x86_64_start_kernel+0xba/0x110 [10020.586845][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10020.587176][ C0] [10020.587343][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8226s! [ksoftirqd/1:22] [10020.587801][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10020.588982][ C1] irq event stamp: 3886976 [10020.589218][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10020.589719][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10020.590218][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10020.590718][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10020.591204][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10020.591700][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10020.592344][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10020.592687][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10020.593711][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10020.594036][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10020.594461][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10020.594885][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10020.595304][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10020.595723][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10020.596146][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10020.596620][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10020.596966][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10020.597391][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10020.597818][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10020.598244][ C1] Call Trace: [10020.598423][ C1] [10020.598580][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10020.598852][ C1] ? __run_hrtimer+0x1c3/0x710 [10020.599110][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10020.599401][ C1] ? __hrtimer_run_queues+0x197/0x270 [10020.599690][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10020.599993][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10020.600272][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10020.600595][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10020.600868][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10020.601194][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10020.601506][ C1] [10020.601662][ C1] [10020.601818][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10020.602144][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10020.602450][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10020.602760][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10020.603062][ C1] ? run_ksoftirqd+0xb/0x60 [10020.603304][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10020.603627][ C1] ? __orc_find+0x9c/0xf0 [10020.603860][ C1] ? lock_acquire+0x1c1/0x220 [10020.604114][ C1] ? irqentry_enter+0x2b/0x60 [10020.604369][ C1] do_raw_spin_lock+0x1ec/0x270 [10020.604630][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10020.604916][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10020.605217][ C1] ? lock_acquire+0x1c1/0x220 [10020.605470][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10020.605722][ C1] _raw_spin_lock_nested+0x65/0x80 [10020.605994][ C1] tcp_v4_rcv+0x2159/0x29b0 [10020.606242][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10020.606503][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10020.606776][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10020.607068][ C1] ip_local_deliver_finish+0x2ae/0x450 [10020.607362][ C1] ip_local_deliver+0x19d/0x480 [10020.607619][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10020.607907][ C1] ? rcu_read_lock_held+0xe/0x50 [10020.608173][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10020.608448][ C1] ? rcu_read_lock_held+0xe/0x50 [10020.608710][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10020.609047][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10020.609320][ C1] ip_rcv+0x564/0x740 [10020.609531][ C1] ? __pfx_ip_rcv+0x10/0x10 [10020.609770][ C1] ? set_track_prepare+0x8a/0xd0 [10020.610031][ C1] ? irqentry_enter+0x2b/0x60 [10020.610285][ C1] ? irqentry_enter+0x2b/0x60 [10020.610539][ C1] ? __pfx_ip_rcv+0x10/0x10 [10020.610783][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10020.611102][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10020.611446][ C1] ? netif_receive_skb_internal+0x84/0x300 [10020.611757][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10020.612095][ C1] netif_receive_skb_internal+0xb0/0x300 [10020.612393][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10020.612729][ C1] netif_receive_skb+0x55/0x280 [10020.612989][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10020.613319][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10020.613673][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10020.613985][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10020.614277][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10020.614582][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10020.614916][ C1] ? unwind_next_frame+0x1478/0x1d10 [10020.615200][ C1] ? arch_stack_walk+0x68/0x100 [10020.615459][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10020.615738][ C1] ? irqentry_enter+0x2b/0x60 [10020.615989][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10020.616306][ C1] ? irqentry_enter+0x2b/0x60 [10020.616559][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10020.616889][ C1] ? unwind_next_frame+0x1478/0x1d10 [10020.617170][ C1] ? arch_stack_walk+0x68/0x100 [10020.617432][ C1] __tcf_classify+0x32c/0x7d0 [10020.617692][ C1] tcf_classify+0x283/0x930 [10020.617940][ C1] ? __pfx_tcf_classify+0x10/0x10 [10020.618208][ C1] tc_run+0x2e4/0x5d0 [10020.618420][ C1] ? __pfx_tc_run+0x10/0x10 [10020.618662][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10020.618926][ C1] ? irqentry_enter+0x2b/0x60 [10020.619181][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10020.619469][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10020.619792][ C1] ip_finish_output2+0x786/0x18e0 [10020.620062][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10020.620351][ C1] ? rcu_read_lock_held+0xe/0x50 [10020.620618][ C1] ? __ip_finish_output+0x10f/0x770 [10020.620894][ C1] ip_output+0x16b/0x4f0 [10020.621120][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10020.621440][ C1] ? __pfx_ip_output+0x10/0x10 [10020.621693][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10020.622052][ C1] ? __pfx_ip_output+0x10/0x10 [10020.622311][ C1] __ip_queue_xmit+0x672/0x1910 [10020.622571][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10020.622853][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10020.623148][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10020.623430][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10020.623722][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10020.624004][ C1] tcp_delack_timer+0x84/0x240 [10020.624258][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10020.624546][ C1] call_timer_fn+0x176/0x430 [10020.624795][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10020.625068][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10020.625348][ C1] __run_timers.part.0+0x52d/0x890 [10020.625621][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10020.625904][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10020.626204][ C1] ? __pfx___schedule+0x10/0x10 [10020.626466][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10020.626790][ C1] run_timer_softirq+0x72/0x100 [10020.627050][ C1] __do_softirq+0x1bc/0x7ff [10020.627294][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10020.627567][ C1] run_ksoftirqd+0x2e/0x60 [10020.627815][ C1] smpboot_thread_fn+0x30e/0x840 [10020.628085][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10020.628373][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10020.628663][ C1] kthread+0x292/0x360 [10020.628884][ C1] ? __pfx_kthread+0x10/0x10 [10020.629133][ C1] ret_from_fork+0x34/0x70 [10020.629370][ C1] ? __pfx_kthread+0x10/0x10 [10020.629617][ C1] ret_from_fork_asm+0x1b/0x30 [10020.629874][ C1] [10043.947024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [10043.947415][ C0] rcu: 0-....: (8790293 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=2106408 [10043.947942][ C0] rcu: (t=8849638 jiffies g=1007429 q=31 ncpus=4) [10043.948293][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10043.948774][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10043.949422][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10043.949775][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10043.950809][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10043.951139][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10043.951564][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10043.951989][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10043.952414][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10043.952834][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10043.953259][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10043.953734][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10043.954082][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10043.954510][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10043.954931][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10043.955351][ C0] Call Trace: [10043.955527][ C0] [10043.955684][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10043.955974][ C0] ? print_cpu_stall+0x263/0x6a0 [10043.956240][ C0] ? check_cpu_stall+0x284/0x500 [10043.956507][ C0] ? rcu_pending+0x92/0x360 [10043.956747][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [10043.957028][ C0] ? update_process_times+0xb9/0x110 [10043.957315][ C0] ? tick_sched_handle+0x67/0x130 [10043.957588][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [10043.957893][ C0] ? __run_hrtimer+0x1c3/0x710 [10043.958149][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10043.958481][ C0] ? __hrtimer_run_queues+0x197/0x270 [10043.958768][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10043.959073][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10043.959351][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10043.959674][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10043.959950][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10043.960224][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10043.960555][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10043.960867][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10043.961200][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10043.961505][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10043.961820][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10043.962121][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10043.962445][ C0] ? get_stack_info+0x36/0xc0 [10043.962704][ C0] ? lock_acquire+0x1c1/0x220 [10043.962960][ C0] ? lock_release+0x1d5/0x250 [10043.963214][ C0] do_raw_spin_lock+0x1ec/0x270 [10043.963477][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10043.963768][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10043.964072][ C0] ? lock_acquire+0x1c1/0x220 [10043.964321][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10043.964576][ C0] _raw_spin_lock_nested+0x65/0x80 [10043.964849][ C0] tcp_v4_rcv+0x2159/0x29b0 [10043.965100][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10043.965368][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10043.965642][ C0] ? __inet_lookup_established+0x341/0x610 [10043.965957][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10043.966246][ C0] ip_local_deliver_finish+0x2ae/0x450 [10043.966535][ C0] ip_local_deliver+0x19d/0x480 [10043.966800][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10043.967090][ C0] ? rcu_read_lock_held+0xe/0x50 [10043.967359][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10043.967644][ C0] ? rcu_read_lock_held+0xe/0x50 [10043.967912][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10043.968248][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10043.968528][ C0] ip_rcv+0x564/0x740 [10043.968744][ C0] ? __pfx_ip_rcv+0x10/0x10 [10043.968991][ C0] ? set_track_prepare+0x8a/0xd0 [10043.969261][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10043.969547][ C0] ? rest_init+0x153/0x260 [10043.969787][ C0] ? skb_clone+0x10b/0x330 [10043.970027][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10043.970365][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10043.970689][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10043.970981][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10043.971290][ C0] ? __tcf_classify+0x32c/0x7d0 [10043.971548][ C0] ? __pfx_ip_rcv+0x10/0x10 [10043.971788][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10043.972101][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10043.972400][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10043.972743][ C0] ? lock_acquire+0x1c1/0x220 [10043.972995][ C0] ? netif_receive_skb_internal+0x84/0x300 [10043.973309][ C0] netif_receive_skb_internal+0xb0/0x300 [10043.973612][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10043.973947][ C0] ? __copy_skb_header+0xaf/0x490 [10043.974218][ C0] ? __skb_clone+0x57a/0x760 [10043.974467][ C0] netif_receive_skb+0x55/0x280 [10043.974723][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10043.975049][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10043.975397][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10043.975714][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10043.976002][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10043.976302][ C0] ? hlock_class+0x4e/0x130 [10043.976546][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10043.976881][ C0] ? place_entity+0x21/0x2f0 [10043.977128][ C0] ? resched_curr+0x219/0x280 [10043.977384][ C0] ? __pfx_resched_curr+0x10/0x10 [10043.977661][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10043.977946][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10043.978228][ C0] ? wakeup_preempt+0x161/0x2c0 [10043.978492][ C0] ? activate_task+0xf5/0x260 [10043.978747][ C0] ? trace_sched_wakeup+0xd2/0x100 [10043.979026][ C0] ? do_raw_spin_unlock+0x58/0x220 [10043.979297][ C0] ? _raw_spin_unlock+0x23/0x40 [10043.979558][ C0] ? get_stack_info_noinstr+0x18/0x110 [10043.979850][ C0] ? get_stack_info+0x36/0xc0 [10043.980100][ C0] ? stack_access_ok+0xda/0x1f0 [10043.980357][ C0] ? get_reg+0x119/0x190 [10043.980584][ C0] __tcf_classify+0x32c/0x7d0 [10043.980838][ C0] tcf_classify+0x283/0x930 [10043.981084][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10043.981417][ C0] ? __pfx_tcf_classify+0x10/0x10 [10043.981684][ C0] ? arch_stack_walk+0x8c/0x100 [10043.981947][ C0] ? get_stack_info_noinstr+0x18/0x110 [10043.982239][ C0] tc_run+0x2e4/0x5d0 [10043.982456][ C0] ? __pfx_tc_run+0x10/0x10 [10043.982702][ C0] ? lock_acquire+0x1c1/0x220 [10043.982956][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10043.983233][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10043.983499][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10043.983788][ C0] ? ip_finish_output2+0x786/0x18e0 [10043.984070][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10043.984393][ C0] ? neigh_hh_output+0x348/0x590 [10043.984656][ C0] ? ip_finish_output2+0x262/0x18e0 [10043.984937][ C0] ip_finish_output2+0x786/0x18e0 [10043.985210][ C0] ? stack_depot_save_flags+0x45/0x550 [10043.985506][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10043.985856][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10043.986145][ C0] ? rcu_read_lock_held+0xe/0x50 [10043.986413][ C0] ? __ip_finish_output+0x10f/0x770 [10043.986691][ C0] ip_output+0x16b/0x4f0 [10043.986918][ C0] ? __run_timers.part.0+0x52d/0x890 [10043.987203][ C0] ? __pfx_ip_output+0x10/0x10 [10043.987456][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10043.987765][ C0] ? rcu_read_lock_held+0xe/0x50 [10043.988034][ C0] ? ip_local_out+0x114/0x3b0 [10043.988287][ C0] __ip_queue_xmit+0x672/0x1910 [10043.988548][ C0] ? __skb_clone+0x57a/0x760 [10043.988793][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10043.989079][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10043.989378][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10043.989701][ C0] tcp_write_xmit+0xe42/0x24c0 [10043.989959][ C0] ? tcp_current_mss+0x40a/0x510 [10043.990226][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10043.990505][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10043.990785][ C0] ? mark_lock_irq+0x6e2/0xa10 [10043.991043][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10043.991310][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10043.991633][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10043.991905][ C0] ? ktime_get+0xb6/0x190 [10043.992150][ C0] tcp_send_loss_probe+0x4c9/0x830 [10043.992428][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10043.992713][ C0] tcp_write_timer+0x82/0x1d0 [10043.992967][ C0] call_timer_fn+0x176/0x430 [10043.993218][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10043.993492][ C0] ? next_expiry_recalc+0xcd/0x220 [10043.993774][ C0] __run_timers.part.0+0x52d/0x890 [10043.994047][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10043.994334][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10043.994637][ C0] ? lock_acquire+0x1c1/0x220 [10043.994889][ C0] ? clockevents_program_event+0xf6/0x300 [10043.995197][ C0] ? lock_release+0x1d5/0x250 [10043.995452][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10043.995732][ C0] ? ktime_get+0xb6/0x190 [10043.995966][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10043.996267][ C0] ? clockevents_program_event+0x1ed/0x300 [10043.996577][ C0] run_timer_softirq+0x72/0x100 [10043.996840][ C0] __do_softirq+0x1bc/0x7ff [10043.997090][ C0] irq_exit_rcu+0x98/0xc0 [10043.997324][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10043.997634][ C0] [10043.997793][ C0] [10043.997952][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10043.998274][ C0] RIP: 0010:default_idle+0xf/0x20 [10043.998542][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10043.999559][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10043.999882][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10044.000303][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10044.000720][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10044.001137][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10044.001556][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10044.001977][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10044.002279][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10044.002549][ C0] default_idle_call+0x69/0xa0 [10044.002806][ C0] cpuidle_idle_call+0x1f6/0x280 [10044.003068][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10044.003364][ C0] ? lock_release+0x1d5/0x250 [10044.003615][ C0] do_idle+0xfb/0x160 [10044.003829][ C0] cpu_startup_entry+0x55/0x60 [10044.004083][ C0] rest_init+0x153/0x260 [10044.004310][ C0] ? acpi_enable_subsystem+0xac/0x150 [10044.004598][ C0] arch_call_rest_init+0x13/0x40 [10044.004864][ C0] start_kernel+0x314/0x3d0 [10044.005111][ C0] x86_64_start_reservations+0x18/0x30 [10044.005406][ C0] x86_64_start_kernel+0xba/0x110 [10044.005673][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10044.005998][ C0] [10044.006161][ C0] Sending NMI from CPU 0 to CPUs 1: [10044.006452][ C1] NMI backtrace for cpu 1 [10044.006464][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10044.006467][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10044.006469][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10044.006476][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10044.006479][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10044.006482][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10044.006484][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10044.006486][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10044.006487][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10044.006489][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10044.006491][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10044.006493][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10044.006496][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10044.006497][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10044.006499][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10044.006500][ C1] Call Trace: [10044.006502][ C1] [10044.006504][ C1] ? nmi_cpu_backtrace+0x112/0x220 [10044.006510][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [10044.006515][ C1] ? nmi_handle+0x156/0x420 [10044.006519][ C1] ? default_do_nmi+0x41/0x100 [10044.006523][ C1] ? exc_nmi+0xf3/0x120 [10044.006525][ C1] ? end_repeat_nmi+0xf/0x60 [10044.006530][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10044.006533][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10044.006537][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10044.006540][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10044.006544][ C1] [10044.006545][ C1] [10044.006546][ C1] ? run_ksoftirqd+0xb/0x60 [10044.006551][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10044.006554][ C1] ? __orc_find+0x9c/0xf0 [10044.006556][ C1] ? lock_acquire+0x1c1/0x220 [10044.006560][ C1] ? irqentry_enter+0x2b/0x60 [10044.006565][ C1] do_raw_spin_lock+0x1ec/0x270 [10044.006569][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10044.006571][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10044.006575][ C1] ? lock_acquire+0x1c1/0x220 [10044.006577][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10044.006581][ C1] _raw_spin_lock_nested+0x65/0x80 [10044.006584][ C1] tcp_v4_rcv+0x2159/0x29b0 [10044.006591][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10044.006594][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10044.006599][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10044.006605][ C1] ip_local_deliver_finish+0x2ae/0x450 [10044.006609][ C1] ip_local_deliver+0x19d/0x480 [10044.006611][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10044.006614][ C1] ? rcu_read_lock_held+0xe/0x50 [10044.006618][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10044.006622][ C1] ? rcu_read_lock_held+0xe/0x50 [10044.006624][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10044.006628][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10044.006637][ C1] ip_rcv+0x564/0x740 [10044.006640][ C1] ? __pfx_ip_rcv+0x10/0x10 [10044.006643][ C1] ? set_track_prepare+0x8a/0xd0 [10044.006647][ C1] ? irqentry_enter+0x2b/0x60 [10044.006650][ C1] ? irqentry_enter+0x2b/0x60 [10044.006654][ C1] ? __pfx_ip_rcv+0x10/0x10 [10044.006656][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10044.006660][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10044.006663][ C1] ? netif_receive_skb_internal+0x84/0x300 [10044.006666][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10044.006669][ C1] netif_receive_skb_internal+0xb0/0x300 [10044.006672][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10044.006677][ C1] netif_receive_skb+0x55/0x280 [10044.006680][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10044.006687][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10044.006694][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10044.006701][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10044.006707][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10044.006718][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10044.006728][ C1] ? unwind_next_frame+0x1478/0x1d10 [10044.006731][ C1] ? arch_stack_walk+0x68/0x100 [10044.006736][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10044.006739][ C1] ? irqentry_enter+0x2b/0x60 [10044.006742][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10044.006747][ C1] ? irqentry_enter+0x2b/0x60 [10044.006750][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10044.006758][ C1] ? unwind_next_frame+0x1478/0x1d10 [10044.006760][ C1] ? arch_stack_walk+0x68/0x100 [10044.006764][ C1] __tcf_classify+0x32c/0x7d0 [10044.006769][ C1] tcf_classify+0x283/0x930 [10044.006773][ C1] ? __pfx_tcf_classify+0x10/0x10 [10044.006777][ C1] tc_run+0x2e4/0x5d0 [10044.006781][ C1] ? __pfx_tc_run+0x10/0x10 [10044.006786][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10044.006791][ C1] ? irqentry_enter+0x2b/0x60 [10044.006794][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10044.006797][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10044.006804][ C1] ip_finish_output2+0x786/0x18e0 [10044.006809][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10044.006812][ C1] ? rcu_read_lock_held+0xe/0x50 [10044.006816][ C1] ? __ip_finish_output+0x10f/0x770 [10044.006820][ C1] ip_output+0x16b/0x4f0 [10044.006824][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10044.006827][ C1] ? __pfx_ip_output+0x10/0x10 [10044.006831][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10044.006839][ C1] ? __pfx_ip_output+0x10/0x10 [10044.006843][ C1] __ip_queue_xmit+0x672/0x1910 [10044.006848][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10044.006855][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10044.006859][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10044.006863][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10044.006867][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10044.006870][ C1] tcp_delack_timer+0x84/0x240 [10044.006873][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10044.006876][ C1] call_timer_fn+0x176/0x430 [10044.006880][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10044.006885][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10044.006889][ C1] __run_timers.part.0+0x52d/0x890 [10044.006892][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10044.006897][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10044.006902][ C1] ? __pfx___schedule+0x10/0x10 [10044.006906][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10044.006911][ C1] run_timer_softirq+0x72/0x100 [10044.006914][ C1] __do_softirq+0x1bc/0x7ff [10044.006919][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10044.006923][ C1] run_ksoftirqd+0x2e/0x60 [10044.006926][ C1] smpboot_thread_fn+0x30e/0x840 [10044.006931][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10044.006935][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10044.006938][ C1] kthread+0x292/0x360 [10044.006941][ C1] ? __pfx_kthread+0x10/0x10 [10044.006944][ C1] ret_from_fork+0x34/0x70 [10044.006947][ C1] ? __pfx_kthread+0x10/0x10 [10044.006950][ C1] ret_from_fork_asm+0x1b/0x30 [10044.006957][ C1] [10068.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8271s! [swapper/0:0] [10068.527920][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10068.529114][ C0] irq event stamp: 27567077 [10068.529355][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10068.529881][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10068.530362][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10068.530869][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10068.531367][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10068.531851][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10068.532494][ C0] RIP: 0010:kasan_check_range+0x1b/0x1c0 [10068.532797][ C0] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 53 <72> 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 23 [10068.533822][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000286 [10068.534147][ C0] RAX: ffff88800a099b5c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10068.534573][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [10068.534992][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10068.535418][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10068.535843][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10068.536269][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10068.536741][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10068.537092][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10068.537525][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10068.537953][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10068.538377][ C0] Call Trace: [10068.538557][ C0] [10068.538719][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10068.538995][ C0] ? __run_hrtimer+0x1c3/0x710 [10068.539255][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10068.539546][ C0] ? __hrtimer_run_queues+0x197/0x270 [10068.539833][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10068.540139][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10068.540423][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10068.540749][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10068.541021][ C0] ? hrtimer_interrupt+0x31a/0x770 [10068.541298][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10068.541576][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10068.541903][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10068.542218][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10068.542558][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10068.542864][ C0] ? kasan_check_range+0x1b/0x1c0 [10068.543138][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [10068.543437][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10068.543768][ C0] ? get_stack_info+0x36/0xc0 [10068.544024][ C0] ? lock_acquire+0x1c1/0x220 [10068.544277][ C0] ? lock_release+0x1d5/0x250 [10068.544529][ C0] do_raw_spin_lock+0x1ec/0x270 [10068.544789][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10068.545073][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10068.545371][ C0] ? lock_acquire+0x1c1/0x220 [10068.545625][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10068.545883][ C0] _raw_spin_lock_nested+0x65/0x80 [10068.546161][ C0] tcp_v4_rcv+0x2159/0x29b0 [10068.546406][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10068.546666][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10068.546934][ C0] ? __inet_lookup_established+0x341/0x610 [10068.547250][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10068.547547][ C0] ip_local_deliver_finish+0x2ae/0x450 [10068.547838][ C0] ip_local_deliver+0x19d/0x480 [10068.548101][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10068.548387][ C0] ? rcu_read_lock_held+0xe/0x50 [10068.548657][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10068.548934][ C0] ? rcu_read_lock_held+0xe/0x50 [10068.549198][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10068.549536][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10068.549811][ C0] ip_rcv+0x564/0x740 [10068.550025][ C0] ? __pfx_ip_rcv+0x10/0x10 [10068.550265][ C0] ? set_track_prepare+0x8a/0xd0 [10068.550530][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10068.550822][ C0] ? rest_init+0x153/0x260 [10068.551062][ C0] ? skb_clone+0x10b/0x330 [10068.551305][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10068.551643][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10068.551965][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10068.552266][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10068.552578][ C0] ? __tcf_classify+0x32c/0x7d0 [10068.552843][ C0] ? __pfx_ip_rcv+0x10/0x10 [10068.553089][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10068.553407][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10068.553707][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10068.554047][ C0] ? lock_acquire+0x1c1/0x220 [10068.554297][ C0] ? netif_receive_skb_internal+0x84/0x300 [10068.554606][ C0] netif_receive_skb_internal+0xb0/0x300 [10068.554906][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10068.555234][ C0] ? __copy_skb_header+0xaf/0x490 [10068.555501][ C0] ? __skb_clone+0x57a/0x760 [10068.555748][ C0] netif_receive_skb+0x55/0x280 [10068.556010][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10068.556344][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10068.556693][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10068.557007][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10068.557308][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10068.557624][ C0] ? hlock_class+0x4e/0x130 [10068.557868][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10068.558195][ C0] ? place_entity+0x21/0x2f0 [10068.558440][ C0] ? resched_curr+0x219/0x280 [10068.558710][ C0] ? __pfx_resched_curr+0x10/0x10 [10068.558960][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10068.559224][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10068.559479][ C0] ? wakeup_preempt+0x161/0x2c0 [10068.559715][ C0] ? activate_task+0xf5/0x260 [10068.559945][ C0] ? trace_sched_wakeup+0xd2/0x100 [10068.560198][ C0] ? do_raw_spin_unlock+0x58/0x220 [10068.560453][ C0] ? _raw_spin_unlock+0x23/0x40 [10068.560698][ C0] ? get_stack_info_noinstr+0x18/0x110 [10068.560993][ C0] ? get_stack_info+0x36/0xc0 [10068.561241][ C0] ? stack_access_ok+0xda/0x1f0 [10068.561493][ C0] ? get_reg+0x119/0x190 [10068.561717][ C0] __tcf_classify+0x32c/0x7d0 [10068.561973][ C0] tcf_classify+0x283/0x930 [10068.562197][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10068.562499][ C0] ? __pfx_tcf_classify+0x10/0x10 [10068.562749][ C0] ? arch_stack_walk+0x8c/0x100 [10068.562992][ C0] ? get_stack_info_noinstr+0x18/0x110 [10068.563261][ C0] tc_run+0x2e4/0x5d0 [10068.563460][ C0] ? __pfx_tc_run+0x10/0x10 [10068.563681][ C0] ? lock_acquire+0x1c1/0x220 [10068.563909][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10068.564160][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10068.564407][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10068.564668][ C0] ? ip_finish_output2+0x786/0x18e0 [10068.564921][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10068.565219][ C0] ? neigh_hh_output+0x348/0x590 [10068.565465][ C0] ? ip_finish_output2+0x262/0x18e0 [10068.565745][ C0] ip_finish_output2+0x786/0x18e0 [10068.566004][ C0] ? stack_depot_save_flags+0x45/0x550 [10068.566289][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10068.566635][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10068.566942][ C0] ? rcu_read_lock_held+0xe/0x50 [10068.567197][ C0] ? __ip_finish_output+0x10f/0x770 [10068.567493][ C0] ip_output+0x16b/0x4f0 [10068.567720][ C0] ? __run_timers.part.0+0x52d/0x890 [10068.568008][ C0] ? __pfx_ip_output+0x10/0x10 [10068.568265][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10068.568567][ C0] ? rcu_read_lock_held+0xe/0x50 [10068.568834][ C0] ? ip_local_out+0x114/0x3b0 [10068.569088][ C0] __ip_queue_xmit+0x672/0x1910 [10068.569347][ C0] ? __skb_clone+0x57a/0x760 [10068.569590][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10068.569862][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10068.570149][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10068.570457][ C0] tcp_write_xmit+0xe42/0x24c0 [10068.570709][ C0] ? tcp_current_mss+0x40a/0x510 [10068.570965][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10068.571242][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10068.571510][ C0] ? mark_lock_irq+0x6e2/0xa10 [10068.571755][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10068.572019][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10068.572334][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10068.572601][ C0] ? ktime_get+0xb6/0x190 [10068.572825][ C0] tcp_send_loss_probe+0x4c9/0x830 [10068.573092][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10068.573372][ C0] tcp_write_timer+0x82/0x1d0 [10068.573616][ C0] call_timer_fn+0x176/0x430 [10068.573856][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10068.574126][ C0] ? next_expiry_recalc+0xcd/0x220 [10068.574393][ C0] __run_timers.part.0+0x52d/0x890 [10068.574659][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10068.574933][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10068.575226][ C0] ? lock_acquire+0x1c1/0x220 [10068.575469][ C0] ? clockevents_program_event+0xf6/0x300 [10068.575766][ C0] ? lock_release+0x1d5/0x250 [10068.576007][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10068.576298][ C0] ? ktime_get+0xb6/0x190 [10068.576527][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10068.576825][ C0] ? clockevents_program_event+0x1ed/0x300 [10068.577140][ C0] run_timer_softirq+0x72/0x100 [10068.577399][ C0] __do_softirq+0x1bc/0x7ff [10068.577647][ C0] irq_exit_rcu+0x98/0xc0 [10068.577881][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10068.578182][ C0] [10068.578337][ C0] [10068.578493][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10068.578809][ C0] RIP: 0010:default_idle+0xf/0x20 [10068.579080][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10068.580106][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10068.580429][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10068.580853][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10068.581280][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10068.581700][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10068.582121][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10068.582548][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10068.582856][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10068.583133][ C0] default_idle_call+0x69/0xa0 [10068.583388][ C0] cpuidle_idle_call+0x1f6/0x280 [10068.583658][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10068.583946][ C0] ? lock_release+0x1d5/0x250 [10068.584201][ C0] do_idle+0xfb/0x160 [10068.584419][ C0] cpu_startup_entry+0x55/0x60 [10068.584677][ C0] rest_init+0x153/0x260 [10068.584903][ C0] ? acpi_enable_subsystem+0xac/0x150 [10068.585195][ C0] arch_call_rest_init+0x13/0x40 [10068.585465][ C0] start_kernel+0x314/0x3d0 [10068.585706][ C0] x86_64_start_reservations+0x18/0x30 [10068.585997][ C0] x86_64_start_kernel+0xba/0x110 [10068.586282][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10068.586627][ C0] [10068.586794][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8271s! [ksoftirqd/1:22] [10068.587245][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10068.588437][ C1] irq event stamp: 3886976 [10068.588674][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10068.589164][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10068.589654][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10068.590150][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10068.590632][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10068.591129][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10068.591768][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10068.592106][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10068.593116][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10068.593444][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10068.593848][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10068.594252][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10068.594656][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10068.595059][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10068.595463][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10068.595915][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10068.596258][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10068.596664][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10068.597073][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10068.597484][ C1] Call Trace: [10068.597677][ C1] [10068.597830][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10068.598108][ C1] ? __run_hrtimer+0x1c3/0x710 [10068.598360][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10068.598651][ C1] ? __hrtimer_run_queues+0x197/0x270 [10068.598937][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10068.599229][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10068.599498][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10068.599806][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10068.600075][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10068.600387][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10068.600685][ C1] [10068.600838][ C1] [10068.600993][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10068.601316][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10068.601609][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10068.601908][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10068.602204][ C1] ? run_ksoftirqd+0xb/0x60 [10068.602441][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10068.602761][ C1] ? __orc_find+0x9c/0xf0 [10068.602983][ C1] ? lock_acquire+0x1c1/0x220 [10068.603227][ C1] ? irqentry_enter+0x2b/0x60 [10068.603470][ C1] do_raw_spin_lock+0x1ec/0x270 [10068.603723][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10068.604000][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10068.604289][ C1] ? lock_acquire+0x1c1/0x220 [10068.604533][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10068.604779][ C1] _raw_spin_lock_nested+0x65/0x80 [10068.605047][ C1] tcp_v4_rcv+0x2159/0x29b0 [10068.605285][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10068.605536][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10068.605797][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10068.606074][ C1] ip_local_deliver_finish+0x2ae/0x450 [10068.606353][ C1] ip_local_deliver+0x19d/0x480 [10068.606609][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10068.606890][ C1] ? rcu_read_lock_held+0xe/0x50 [10068.607149][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10068.607417][ C1] ? rcu_read_lock_held+0xe/0x50 [10068.607700][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10068.608034][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10068.608310][ C1] ip_rcv+0x564/0x740 [10068.608526][ C1] ? __pfx_ip_rcv+0x10/0x10 [10068.608777][ C1] ? set_track_prepare+0x8a/0xd0 [10068.609036][ C1] ? irqentry_enter+0x2b/0x60 [10068.609277][ C1] ? irqentry_enter+0x2b/0x60 [10068.609518][ C1] ? __pfx_ip_rcv+0x10/0x10 [10068.609750][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10068.610052][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10068.610380][ C1] ? netif_receive_skb_internal+0x84/0x300 [10068.610679][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10068.611011][ C1] netif_receive_skb_internal+0xb0/0x300 [10068.611304][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10068.611626][ C1] netif_receive_skb+0x55/0x280 [10068.611878][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10068.612195][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10068.612531][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10068.612837][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10068.613115][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10068.613408][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10068.613728][ C1] ? unwind_next_frame+0x1478/0x1d10 [10068.613999][ C1] ? arch_stack_walk+0x68/0x100 [10068.614254][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10068.614526][ C1] ? irqentry_enter+0x2b/0x60 [10068.614772][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10068.615086][ C1] ? irqentry_enter+0x2b/0x60 [10068.615330][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10068.615641][ C1] ? unwind_next_frame+0x1478/0x1d10 [10068.615915][ C1] ? arch_stack_walk+0x68/0x100 [10068.616168][ C1] __tcf_classify+0x32c/0x7d0 [10068.616413][ C1] tcf_classify+0x283/0x930 [10068.616646][ C1] ? __pfx_tcf_classify+0x10/0x10 [10068.616907][ C1] tc_run+0x2e4/0x5d0 [10068.617114][ C1] ? __pfx_tc_run+0x10/0x10 [10068.617352][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10068.617637][ C1] ? irqentry_enter+0x2b/0x60 [10068.617885][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10068.618169][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10068.618490][ C1] ip_finish_output2+0x786/0x18e0 [10068.618768][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10068.619051][ C1] ? rcu_read_lock_held+0xe/0x50 [10068.619308][ C1] ? __ip_finish_output+0x10f/0x770 [10068.619579][ C1] ip_output+0x16b/0x4f0 [10068.619803][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10068.620114][ C1] ? __pfx_ip_output+0x10/0x10 [10068.620365][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10068.620704][ C1] ? __pfx_ip_output+0x10/0x10 [10068.620952][ C1] __ip_queue_xmit+0x672/0x1910 [10068.621211][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10068.621485][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10068.621777][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10068.622059][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10068.622348][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10068.622627][ C1] tcp_delack_timer+0x84/0x240 [10068.622876][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10068.623151][ C1] call_timer_fn+0x176/0x430 [10068.623391][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10068.623660][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10068.623928][ C1] __run_timers.part.0+0x52d/0x890 [10068.624194][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10068.624475][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10068.624768][ C1] ? __pfx___schedule+0x10/0x10 [10068.625020][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10068.625329][ C1] run_timer_softirq+0x72/0x100 [10068.625582][ C1] __do_softirq+0x1bc/0x7ff [10068.625820][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10068.626089][ C1] run_ksoftirqd+0x2e/0x60 [10068.626321][ C1] smpboot_thread_fn+0x30e/0x840 [10068.626581][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10068.626863][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10068.627152][ C1] kthread+0x292/0x360 [10068.627362][ C1] ? __pfx_kthread+0x10/0x10 [10068.627629][ C1] ret_from_fork+0x34/0x70 [10068.627870][ C1] ? __pfx_kthread+0x10/0x10 [10068.628117][ C1] ret_from_fork_asm+0x1b/0x30 [10068.628379][ C1] [10096.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8297s! [swapper/0:0] [10096.527935][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10096.529138][ C0] irq event stamp: 27567077 [10096.529380][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10096.529913][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10096.530386][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10096.530887][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10096.531377][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10096.531855][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10096.532505][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10096.532852][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10096.533871][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10096.534194][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10096.534610][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10096.535025][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10096.535440][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10096.535857][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10096.536274][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10096.536739][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10096.537094][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10096.537522][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10096.537940][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10096.538356][ C0] Call Trace: [10096.538534][ C0] [10096.538688][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10096.538968][ C0] ? __run_hrtimer+0x1c3/0x710 [10096.539224][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10096.539517][ C0] ? __hrtimer_run_queues+0x197/0x270 [10096.539801][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10096.540104][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10096.540382][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10096.540700][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10096.540976][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10096.541253][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10096.541582][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10096.541896][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10096.542224][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10096.542533][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10096.542844][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10096.543147][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10096.543476][ C0] ? get_stack_info+0x36/0xc0 [10096.543733][ C0] ? lock_acquire+0x1c1/0x220 [10096.543989][ C0] ? lock_release+0x1d5/0x250 [10096.544244][ C0] do_raw_spin_lock+0x1ec/0x270 [10096.544509][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10096.544798][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10096.545100][ C0] ? lock_acquire+0x1c1/0x220 [10096.545346][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10096.545597][ C0] _raw_spin_lock_nested+0x65/0x80 [10096.545868][ C0] tcp_v4_rcv+0x2159/0x29b0 [10096.546118][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10096.546381][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10096.546652][ C0] ? __inet_lookup_established+0x341/0x610 [10096.546968][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10096.547258][ C0] ip_local_deliver_finish+0x2ae/0x450 [10096.547556][ C0] ip_local_deliver+0x19d/0x480 [10096.547815][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10096.548101][ C0] ? rcu_read_lock_held+0xe/0x50 [10096.548365][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10096.548645][ C0] ? rcu_read_lock_held+0xe/0x50 [10096.548909][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10096.549242][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10096.549523][ C0] ip_rcv+0x564/0x740 [10096.549736][ C0] ? __pfx_ip_rcv+0x10/0x10 [10096.549980][ C0] ? set_track_prepare+0x8a/0xd0 [10096.550248][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10096.550534][ C0] ? rest_init+0x153/0x260 [10096.550774][ C0] ? skb_clone+0x10b/0x330 [10096.551014][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10096.551352][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10096.551672][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10096.551967][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10096.552276][ C0] ? __tcf_classify+0x32c/0x7d0 [10096.552533][ C0] ? __pfx_ip_rcv+0x10/0x10 [10096.552772][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10096.553088][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10096.553386][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10096.553728][ C0] ? lock_acquire+0x1c1/0x220 [10096.553979][ C0] ? netif_receive_skb_internal+0x84/0x300 [10096.554293][ C0] netif_receive_skb_internal+0xb0/0x300 [10096.554591][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10096.554926][ C0] ? __copy_skb_header+0xaf/0x490 [10096.555197][ C0] ? __skb_clone+0x57a/0x760 [10096.555445][ C0] netif_receive_skb+0x55/0x280 [10096.555702][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10096.556027][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10096.556375][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10096.556688][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10096.556973][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10096.557270][ C0] ? hlock_class+0x4e/0x130 [10096.557519][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10096.557857][ C0] ? place_entity+0x21/0x2f0 [10096.558109][ C0] ? resched_curr+0x219/0x280 [10096.558358][ C0] ? __pfx_resched_curr+0x10/0x10 [10096.558625][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10096.558906][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10096.559188][ C0] ? wakeup_preempt+0x161/0x2c0 [10096.559449][ C0] ? activate_task+0xf5/0x260 [10096.559702][ C0] ? trace_sched_wakeup+0xd2/0x100 [10096.559979][ C0] ? do_raw_spin_unlock+0x58/0x220 [10096.560250][ C0] ? _raw_spin_unlock+0x23/0x40 [10096.560513][ C0] ? get_stack_info_noinstr+0x18/0x110 [10096.560807][ C0] ? get_stack_info+0x36/0xc0 [10096.561058][ C0] ? stack_access_ok+0xda/0x1f0 [10096.561316][ C0] ? get_reg+0x119/0x190 [10096.561542][ C0] __tcf_classify+0x32c/0x7d0 [10096.561799][ C0] tcf_classify+0x283/0x930 [10096.562044][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10096.562377][ C0] ? __pfx_tcf_classify+0x10/0x10 [10096.562643][ C0] ? arch_stack_walk+0x8c/0x100 [10096.562904][ C0] ? get_stack_info_noinstr+0x18/0x110 [10096.563195][ C0] tc_run+0x2e4/0x5d0 [10096.563411][ C0] ? __pfx_tc_run+0x10/0x10 [10096.563655][ C0] ? lock_acquire+0x1c1/0x220 [10096.563911][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10096.564189][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10096.564454][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10096.564740][ C0] ? ip_finish_output2+0x786/0x18e0 [10096.565024][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10096.565344][ C0] ? neigh_hh_output+0x348/0x590 [10096.565607][ C0] ? ip_finish_output2+0x262/0x18e0 [10096.565894][ C0] ip_finish_output2+0x786/0x18e0 [10096.566158][ C0] ? stack_depot_save_flags+0x45/0x550 [10096.566444][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10096.566785][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10096.567088][ C0] ? rcu_read_lock_held+0xe/0x50 [10096.567362][ C0] ? __ip_finish_output+0x10f/0x770 [10096.567648][ C0] ip_output+0x16b/0x4f0 [10096.567875][ C0] ? __run_timers.part.0+0x52d/0x890 [10096.568156][ C0] ? __pfx_ip_output+0x10/0x10 [10096.568411][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10096.568710][ C0] ? rcu_read_lock_held+0xe/0x50 [10096.568980][ C0] ? ip_local_out+0x114/0x3b0 [10096.569223][ C0] __ip_queue_xmit+0x672/0x1910 [10096.569472][ C0] ? __skb_clone+0x57a/0x760 [10096.569712][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10096.569988][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10096.570276][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10096.570591][ C0] tcp_write_xmit+0xe42/0x24c0 [10096.570840][ C0] ? tcp_current_mss+0x40a/0x510 [10096.571097][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10096.571367][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10096.571656][ C0] ? mark_lock_irq+0x6e2/0xa10 [10096.571911][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10096.572178][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10096.572498][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10096.572769][ C0] ? ktime_get+0xb6/0x190 [10096.572996][ C0] tcp_send_loss_probe+0x4c9/0x830 [10096.573263][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10096.573534][ C0] tcp_write_timer+0x82/0x1d0 [10096.573779][ C0] call_timer_fn+0x176/0x430 [10096.574021][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10096.574286][ C0] ? next_expiry_recalc+0xcd/0x220 [10096.574555][ C0] __run_timers.part.0+0x52d/0x890 [10096.574818][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10096.575095][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10096.575383][ C0] ? lock_acquire+0x1c1/0x220 [10096.575645][ C0] ? clockevents_program_event+0xf6/0x300 [10096.575958][ C0] ? lock_release+0x1d5/0x250 [10096.576213][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10096.576497][ C0] ? ktime_get+0xb6/0x190 [10096.576725][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10096.577016][ C0] ? clockevents_program_event+0x1ed/0x300 [10096.577322][ C0] run_timer_softirq+0x72/0x100 [10096.577595][ C0] __do_softirq+0x1bc/0x7ff [10096.577836][ C0] irq_exit_rcu+0x98/0xc0 [10096.578066][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10096.578364][ C0] [10096.578525][ C0] [10096.578690][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10096.579001][ C0] RIP: 0010:default_idle+0xf/0x20 [10096.579261][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10096.580277][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10096.580599][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10096.581003][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10096.581408][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10096.581812][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10096.582216][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10096.582621][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10096.582914][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10096.583197][ C0] default_idle_call+0x69/0xa0 [10096.583451][ C0] cpuidle_idle_call+0x1f6/0x280 [10096.583737][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10096.584031][ C0] ? lock_release+0x1d5/0x250 [10096.584281][ C0] do_idle+0xfb/0x160 [10096.584498][ C0] cpu_startup_entry+0x55/0x60 [10096.584741][ C0] rest_init+0x153/0x260 [10096.584964][ C0] ? acpi_enable_subsystem+0xac/0x150 [10096.585245][ C0] arch_call_rest_init+0x13/0x40 [10096.585502][ C0] start_kernel+0x314/0x3d0 [10096.585739][ C0] x86_64_start_reservations+0x18/0x30 [10096.586024][ C0] x86_64_start_kernel+0xba/0x110 [10096.586284][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10096.586599][ C0] [10096.586757][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8297s! [ksoftirqd/1:22] [10096.587199][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10096.588388][ C1] irq event stamp: 3886976 [10096.588629][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10096.589113][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10096.589596][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10096.590082][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10096.590556][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10096.591040][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10096.591691][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10096.592034][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10096.593046][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10096.593365][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10096.593773][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10096.594182][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10096.594592][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10096.595005][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10096.595418][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10096.595897][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10096.596243][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10096.596662][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10096.597066][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10096.597507][ C1] Call Trace: [10096.597687][ C1] [10096.597843][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10096.598116][ C1] ? __run_hrtimer+0x1c3/0x710 [10096.598373][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10096.598661][ C1] ? __hrtimer_run_queues+0x197/0x270 [10096.598949][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10096.599259][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10096.599540][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10096.599863][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10096.600138][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10096.600465][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10096.600778][ C1] [10096.600935][ C1] [10096.601093][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10096.601422][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10096.601726][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10096.602040][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10096.602341][ C1] ? run_ksoftirqd+0xb/0x60 [10096.602584][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10096.602911][ C1] ? __orc_find+0x9c/0xf0 [10096.603144][ C1] ? lock_acquire+0x1c1/0x220 [10096.603399][ C1] ? irqentry_enter+0x2b/0x60 [10096.603654][ C1] do_raw_spin_lock+0x1ec/0x270 [10096.603919][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10096.604209][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10096.604511][ C1] ? lock_acquire+0x1c1/0x220 [10096.604759][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10096.605009][ C1] _raw_spin_lock_nested+0x65/0x80 [10096.605283][ C1] tcp_v4_rcv+0x2159/0x29b0 [10096.605532][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10096.605796][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10096.606073][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10096.606363][ C1] ip_local_deliver_finish+0x2ae/0x450 [10096.606655][ C1] ip_local_deliver+0x19d/0x480 [10096.606914][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10096.607199][ C1] ? rcu_read_lock_held+0xe/0x50 [10096.607468][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10096.607746][ C1] ? rcu_read_lock_held+0xe/0x50 [10096.608008][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10096.608349][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10096.608623][ C1] ip_rcv+0x564/0x740 [10096.608838][ C1] ? __pfx_ip_rcv+0x10/0x10 [10096.609082][ C1] ? set_track_prepare+0x8a/0xd0 [10096.609345][ C1] ? irqentry_enter+0x2b/0x60 [10096.609598][ C1] ? irqentry_enter+0x2b/0x60 [10096.609852][ C1] ? __pfx_ip_rcv+0x10/0x10 [10096.610098][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10096.610413][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10096.610757][ C1] ? netif_receive_skb_internal+0x84/0x300 [10096.611070][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10096.611411][ C1] netif_receive_skb_internal+0xb0/0x300 [10096.611709][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10096.612046][ C1] netif_receive_skb+0x55/0x280 [10096.612311][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10096.612640][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10096.612991][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10096.613303][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10096.613593][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10096.613898][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10096.614229][ C1] ? unwind_next_frame+0x1478/0x1d10 [10096.614511][ C1] ? arch_stack_walk+0x68/0x100 [10096.614768][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10096.615042][ C1] ? irqentry_enter+0x2b/0x60 [10096.615290][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10096.615615][ C1] ? irqentry_enter+0x2b/0x60 [10096.615870][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10096.616193][ C1] ? unwind_next_frame+0x1478/0x1d10 [10096.616470][ C1] ? arch_stack_walk+0x68/0x100 [10096.616732][ C1] __tcf_classify+0x32c/0x7d0 [10096.616987][ C1] tcf_classify+0x283/0x930 [10096.617232][ C1] ? __pfx_tcf_classify+0x10/0x10 [10096.617507][ C1] tc_run+0x2e4/0x5d0 [10096.617723][ C1] ? __pfx_tc_run+0x10/0x10 [10096.617967][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10096.618234][ C1] ? irqentry_enter+0x2b/0x60 [10096.618487][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10096.618774][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10096.619101][ C1] ip_finish_output2+0x786/0x18e0 [10096.619371][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10096.619659][ C1] ? rcu_read_lock_held+0xe/0x50 [10096.619925][ C1] ? __ip_finish_output+0x10f/0x770 [10096.620201][ C1] ip_output+0x16b/0x4f0 [10096.620428][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10096.620751][ C1] ? __pfx_ip_output+0x10/0x10 [10096.621008][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10096.621364][ C1] ? __pfx_ip_output+0x10/0x10 [10096.621621][ C1] __ip_queue_xmit+0x672/0x1910 [10096.621882][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10096.622161][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10096.622455][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10096.622741][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10096.623036][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10096.623321][ C1] tcp_delack_timer+0x84/0x240 [10096.623576][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10096.623863][ C1] call_timer_fn+0x176/0x430 [10096.624114][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10096.624388][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10096.624667][ C1] __run_timers.part.0+0x52d/0x890 [10096.624941][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10096.625228][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10096.625532][ C1] ? __pfx___schedule+0x10/0x10 [10096.625793][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10096.626115][ C1] run_timer_softirq+0x72/0x100 [10096.626372][ C1] __do_softirq+0x1bc/0x7ff [10096.626612][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10096.626885][ C1] run_ksoftirqd+0x2e/0x60 [10096.627126][ C1] smpboot_thread_fn+0x30e/0x840 [10096.627397][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10096.627688][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10096.627981][ C1] kthread+0x292/0x360 [10096.628197][ C1] ? __pfx_kthread+0x10/0x10 [10096.628444][ C1] ret_from_fork+0x34/0x70 [10096.628682][ C1] ? __pfx_kthread+0x10/0x10 [10096.628930][ C1] ret_from_fork_asm+0x1b/0x30 [10096.629191][ C1] [10122.010024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [10122.010419][ C0] rcu: 0-....: (8868181 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=2123590 [10122.010936][ C0] rcu: (t=8927701 jiffies g=1007429 q=31 ncpus=4) [10122.011281][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10122.011763][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10122.012408][ C0] RIP: 0010:kasan_check_range+0x74/0x1c0 [10122.012713][ C0] Code: ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 <49> 01 c1 48 89 e8 49 8d 59 01 48 89 da 48 29 ea 48 83 fa 10 0f 8e [10122.013741][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000282 [10122.014069][ C0] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10122.014494][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [10122.014918][ C0] RBP: ffffed100141336b R08: 0000000000000000 R09: 1ffff1100141336b [10122.015338][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10122.015760][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10122.016184][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10122.016659][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10122.017005][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10122.017434][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10122.017859][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10122.018285][ C0] Call Trace: [10122.018467][ C0] [10122.018626][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10122.018914][ C0] ? print_cpu_stall+0x263/0x6a0 [10122.019186][ C0] ? check_cpu_stall+0x284/0x500 [10122.019451][ C0] ? rcu_pending+0x92/0x360 [10122.019696][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [10122.019982][ C0] ? update_process_times+0xb9/0x110 [10122.020265][ C0] ? tick_sched_handle+0x67/0x130 [10122.020538][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [10122.020840][ C0] ? __run_hrtimer+0x1c3/0x710 [10122.021095][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10122.021427][ C0] ? __hrtimer_run_queues+0x197/0x270 [10122.021713][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10122.022013][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10122.022292][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10122.022617][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10122.022891][ C0] ? hrtimer_interrupt+0x31a/0x770 [10122.023163][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10122.023443][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10122.023765][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10122.024078][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10122.024412][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10122.024718][ C0] ? kasan_check_range+0x74/0x1c0 [10122.024986][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [10122.025282][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10122.025609][ C0] ? get_stack_info+0x36/0xc0 [10122.025867][ C0] ? lock_acquire+0x1c1/0x220 [10122.026126][ C0] ? lock_release+0x1d5/0x250 [10122.026387][ C0] do_raw_spin_lock+0x1ec/0x270 [10122.026649][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10122.026936][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10122.027241][ C0] ? lock_acquire+0x1c1/0x220 [10122.027492][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10122.027747][ C0] _raw_spin_lock_nested+0x65/0x80 [10122.028026][ C0] tcp_v4_rcv+0x2159/0x29b0 [10122.028274][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10122.028533][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10122.028801][ C0] ? __inet_lookup_established+0x341/0x610 [10122.029115][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10122.029409][ C0] ip_local_deliver_finish+0x2ae/0x450 [10122.029707][ C0] ip_local_deliver+0x19d/0x480 [10122.029966][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10122.030249][ C0] ? rcu_read_lock_held+0xe/0x50 [10122.030513][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10122.030794][ C0] ? rcu_read_lock_held+0xe/0x50 [10122.031061][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10122.031396][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10122.031678][ C0] ip_rcv+0x564/0x740 [10122.031895][ C0] ? __pfx_ip_rcv+0x10/0x10 [10122.032142][ C0] ? set_track_prepare+0x8a/0xd0 [10122.032411][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10122.032700][ C0] ? rest_init+0x153/0x260 [10122.032939][ C0] ? skb_clone+0x10b/0x330 [10122.033179][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10122.033519][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10122.033844][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10122.034141][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10122.034449][ C0] ? __tcf_classify+0x32c/0x7d0 [10122.034708][ C0] ? __pfx_ip_rcv+0x10/0x10 [10122.034948][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10122.035261][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10122.035559][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10122.035902][ C0] ? lock_acquire+0x1c1/0x220 [10122.036156][ C0] ? netif_receive_skb_internal+0x84/0x300 [10122.036469][ C0] netif_receive_skb_internal+0xb0/0x300 [10122.036766][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10122.037100][ C0] ? __copy_skb_header+0xaf/0x490 [10122.037376][ C0] ? __skb_clone+0x57a/0x760 [10122.037621][ C0] netif_receive_skb+0x55/0x280 [10122.037886][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10122.038217][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10122.038568][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10122.038879][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10122.039174][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10122.039477][ C0] ? hlock_class+0x4e/0x130 [10122.039726][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10122.040060][ C0] ? place_entity+0x21/0x2f0 [10122.040310][ C0] ? resched_curr+0x219/0x280 [10122.040562][ C0] ? __pfx_resched_curr+0x10/0x10 [10122.040830][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10122.041112][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10122.041392][ C0] ? wakeup_preempt+0x161/0x2c0 [10122.041653][ C0] ? activate_task+0xf5/0x260 [10122.041905][ C0] ? trace_sched_wakeup+0xd2/0x100 [10122.042185][ C0] ? do_raw_spin_unlock+0x58/0x220 [10122.042458][ C0] ? _raw_spin_unlock+0x23/0x40 [10122.042724][ C0] ? get_stack_info_noinstr+0x18/0x110 [10122.043018][ C0] ? get_stack_info+0x36/0xc0 [10122.043269][ C0] ? stack_access_ok+0xda/0x1f0 [10122.043527][ C0] ? get_reg+0x119/0x190 [10122.043755][ C0] __tcf_classify+0x32c/0x7d0 [10122.044013][ C0] tcf_classify+0x283/0x930 [10122.044259][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10122.044589][ C0] ? __pfx_tcf_classify+0x10/0x10 [10122.044857][ C0] ? arch_stack_walk+0x8c/0x100 [10122.045119][ C0] ? get_stack_info_noinstr+0x18/0x110 [10122.045407][ C0] tc_run+0x2e4/0x5d0 [10122.045626][ C0] ? __pfx_tc_run+0x10/0x10 [10122.045872][ C0] ? lock_acquire+0x1c1/0x220 [10122.046123][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10122.046401][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10122.046666][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10122.046953][ C0] ? ip_finish_output2+0x786/0x18e0 [10122.047240][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10122.047562][ C0] ? neigh_hh_output+0x348/0x590 [10122.047830][ C0] ? ip_finish_output2+0x262/0x18e0 [10122.048109][ C0] ip_finish_output2+0x786/0x18e0 [10122.048376][ C0] ? stack_depot_save_flags+0x45/0x550 [10122.048666][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10122.049026][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10122.049320][ C0] ? rcu_read_lock_held+0xe/0x50 [10122.049584][ C0] ? __ip_finish_output+0x10f/0x770 [10122.049865][ C0] ip_output+0x16b/0x4f0 [10122.050094][ C0] ? __run_timers.part.0+0x52d/0x890 [10122.050376][ C0] ? __pfx_ip_output+0x10/0x10 [10122.050636][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10122.050937][ C0] ? rcu_read_lock_held+0xe/0x50 [10122.051202][ C0] ? ip_local_out+0x114/0x3b0 [10122.051451][ C0] __ip_queue_xmit+0x672/0x1910 [10122.051711][ C0] ? __skb_clone+0x57a/0x760 [10122.051957][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10122.052246][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10122.052543][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10122.052863][ C0] tcp_write_xmit+0xe42/0x24c0 [10122.053117][ C0] ? tcp_current_mss+0x40a/0x510 [10122.053384][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10122.053664][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10122.053943][ C0] ? mark_lock_irq+0x6e2/0xa10 [10122.054198][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10122.054464][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10122.054781][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10122.055062][ C0] ? ktime_get+0xb6/0x190 [10122.055297][ C0] tcp_send_loss_probe+0x4c9/0x830 [10122.055572][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10122.055853][ C0] tcp_write_timer+0x82/0x1d0 [10122.056109][ C0] call_timer_fn+0x176/0x430 [10122.056358][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10122.056630][ C0] ? next_expiry_recalc+0xcd/0x220 [10122.056907][ C0] __run_timers.part.0+0x52d/0x890 [10122.057179][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10122.057466][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10122.057765][ C0] ? lock_acquire+0x1c1/0x220 [10122.058012][ C0] ? clockevents_program_event+0xf6/0x300 [10122.058317][ C0] ? lock_release+0x1d5/0x250 [10122.058567][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10122.058843][ C0] ? ktime_get+0xb6/0x190 [10122.059074][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10122.059372][ C0] ? clockevents_program_event+0x1ed/0x300 [10122.059684][ C0] run_timer_softirq+0x72/0x100 [10122.059946][ C0] __do_softirq+0x1bc/0x7ff [10122.060188][ C0] irq_exit_rcu+0x98/0xc0 [10122.060426][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10122.060725][ C0] [10122.060886][ C0] [10122.061052][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10122.061380][ C0] RIP: 0010:default_idle+0xf/0x20 [10122.061648][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10122.062673][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10122.062999][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10122.063432][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10122.063858][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10122.064280][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10122.064704][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10122.065130][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10122.065438][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10122.065715][ C0] default_idle_call+0x69/0xa0 [10122.065969][ C0] cpuidle_idle_call+0x1f6/0x280 [10122.066235][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10122.066525][ C0] ? lock_release+0x1d5/0x250 [10122.066777][ C0] do_idle+0xfb/0x160 [10122.066994][ C0] cpu_startup_entry+0x55/0x60 [10122.067260][ C0] rest_init+0x153/0x260 [10122.067493][ C0] ? acpi_enable_subsystem+0xac/0x150 [10122.067780][ C0] arch_call_rest_init+0x13/0x40 [10122.068045][ C0] start_kernel+0x314/0x3d0 [10122.068291][ C0] x86_64_start_reservations+0x18/0x30 [10122.068585][ C0] x86_64_start_kernel+0xba/0x110 [10122.068852][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10122.069181][ C0] [10122.069348][ C0] Sending NMI from CPU 0 to CPUs 1: [10122.069639][ C1] NMI backtrace for cpu 1 [10122.069645][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10122.069649][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10122.069651][ C1] RIP: 0010:kasan_check_range+0x161/0x1c0 [10122.069659][ C1] Code: 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 48 83 c0 01 48 39 d0 74 a5 <80> 38 00 74 f2 e9 74 ff ff ff b8 01 00 00 00 c3 cc cc cc cc 48 29 [10122.069662][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000282 [10122.069664][ C1] RAX: ffffed10014131c3 RBX: ffffed10014131c4 RCX: ffffffff90c7aaa0 [10122.069666][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10122.069668][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: ffffed10014131c3 [10122.069670][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10122.069672][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10122.069674][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10122.069676][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10122.069679][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10122.069681][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10122.069682][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10122.069684][ C1] Call Trace: [10122.069686][ C1] [10122.069689][ C1] ? nmi_cpu_backtrace+0x112/0x220 [10122.069695][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [10122.069699][ C1] ? nmi_handle+0x156/0x420 [10122.069704][ C1] ? default_do_nmi+0x41/0x100 [10122.069708][ C1] ? exc_nmi+0xf3/0x120 [10122.069710][ C1] ? end_repeat_nmi+0xf/0x60 [10122.069715][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10122.069720][ C1] ? kasan_check_range+0x161/0x1c0 [10122.069723][ C1] ? kasan_check_range+0x161/0x1c0 [10122.069727][ C1] ? kasan_check_range+0x161/0x1c0 [10122.069730][ C1] [10122.069732][ C1] [10122.069733][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [10122.069736][ C1] ? run_ksoftirqd+0xb/0x60 [10122.069743][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10122.069745][ C1] ? __orc_find+0x9c/0xf0 [10122.069749][ C1] ? lock_acquire+0x1c1/0x220 [10122.069752][ C1] ? irqentry_enter+0x2b/0x60 [10122.069757][ C1] do_raw_spin_lock+0x1ec/0x270 [10122.069760][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10122.069763][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10122.069767][ C1] ? lock_acquire+0x1c1/0x220 [10122.069769][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10122.069774][ C1] _raw_spin_lock_nested+0x65/0x80 [10122.069777][ C1] tcp_v4_rcv+0x2159/0x29b0 [10122.069784][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10122.069788][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10122.069793][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10122.069799][ C1] ip_local_deliver_finish+0x2ae/0x450 [10122.069802][ C1] ip_local_deliver+0x19d/0x480 [10122.069806][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10122.069808][ C1] ? rcu_read_lock_held+0xe/0x50 [10122.069812][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10122.069817][ C1] ? rcu_read_lock_held+0xe/0x50 [10122.069820][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10122.069824][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10122.069833][ C1] ip_rcv+0x564/0x740 [10122.069836][ C1] ? __pfx_ip_rcv+0x10/0x10 [10122.069839][ C1] ? set_track_prepare+0x8a/0xd0 [10122.069842][ C1] ? irqentry_enter+0x2b/0x60 [10122.069846][ C1] ? irqentry_enter+0x2b/0x60 [10122.069849][ C1] ? __pfx_ip_rcv+0x10/0x10 [10122.069852][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10122.069856][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10122.069860][ C1] ? netif_receive_skb_internal+0x84/0x300 [10122.069863][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10122.069866][ C1] netif_receive_skb_internal+0xb0/0x300 [10122.069869][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10122.069873][ C1] netif_receive_skb+0x55/0x280 [10122.069876][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10122.069884][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10122.069891][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10122.069898][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10122.069904][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10122.069915][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10122.069925][ C1] ? unwind_next_frame+0x1478/0x1d10 [10122.069928][ C1] ? arch_stack_walk+0x68/0x100 [10122.069931][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10122.069935][ C1] ? irqentry_enter+0x2b/0x60 [10122.069938][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10122.069942][ C1] ? irqentry_enter+0x2b/0x60 [10122.069945][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10122.069952][ C1] ? unwind_next_frame+0x1478/0x1d10 [10122.069954][ C1] ? arch_stack_walk+0x68/0x100 [10122.069958][ C1] __tcf_classify+0x32c/0x7d0 [10122.069963][ C1] tcf_classify+0x283/0x930 [10122.069966][ C1] ? __pfx_tcf_classify+0x10/0x10 [10122.069971][ C1] tc_run+0x2e4/0x5d0 [10122.069975][ C1] ? __pfx_tc_run+0x10/0x10 [10122.069980][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10122.069985][ C1] ? irqentry_enter+0x2b/0x60 [10122.069988][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10122.069991][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10122.069998][ C1] ip_finish_output2+0x786/0x18e0 [10122.070003][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10122.070005][ C1] ? rcu_read_lock_held+0xe/0x50 [10122.070009][ C1] ? __ip_finish_output+0x10f/0x770 [10122.070013][ C1] ip_output+0x16b/0x4f0 [10122.070017][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10122.070021][ C1] ? __pfx_ip_output+0x10/0x10 [10122.070025][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10122.070032][ C1] ? __pfx_ip_output+0x10/0x10 [10122.070036][ C1] __ip_queue_xmit+0x672/0x1910 [10122.070042][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10122.070048][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10122.070052][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10122.070056][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10122.070061][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10122.070063][ C1] tcp_delack_timer+0x84/0x240 [10122.070067][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10122.070070][ C1] call_timer_fn+0x176/0x430 [10122.070074][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10122.070079][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10122.070083][ C1] __run_timers.part.0+0x52d/0x890 [10122.070086][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10122.070091][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10122.070096][ C1] ? __pfx___schedule+0x10/0x10 [10122.070099][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10122.070104][ C1] run_timer_softirq+0x72/0x100 [10122.070108][ C1] __do_softirq+0x1bc/0x7ff [10122.070112][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10122.070116][ C1] run_ksoftirqd+0x2e/0x60 [10122.070119][ C1] smpboot_thread_fn+0x30e/0x840 [10122.070123][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10122.070127][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10122.070129][ C1] kthread+0x292/0x360 [10122.070132][ C1] ? __pfx_kthread+0x10/0x10 [10122.070135][ C1] ret_from_fork+0x34/0x70 [10122.070138][ C1] ? __pfx_kthread+0x10/0x10 [10122.070140][ C1] ret_from_fork_asm+0x1b/0x30 [10122.070148][ C1] [10148.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8345s! [swapper/0:0] [10148.527942][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10148.529135][ C0] irq event stamp: 27567077 [10148.529371][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10148.529897][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10148.530373][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10148.530890][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10148.531390][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10148.531870][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10148.532509][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10148.532849][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10148.533863][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10148.534184][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10148.534600][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10148.535018][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10148.535435][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10148.535850][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10148.536271][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10148.536743][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10148.537098][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10148.537520][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10148.537937][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10148.538355][ C0] Call Trace: [10148.538536][ C0] [10148.538693][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10148.538971][ C0] ? __run_hrtimer+0x1c3/0x710 [10148.539224][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10148.539520][ C0] ? __hrtimer_run_queues+0x197/0x270 [10148.539818][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10148.540119][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10148.540396][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10148.540716][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10148.540992][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10148.541270][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10148.541595][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10148.541909][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10148.542240][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10148.542546][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10148.542859][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10148.543162][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10148.543491][ C0] ? get_stack_info+0x36/0xc0 [10148.543749][ C0] ? lock_acquire+0x1c1/0x220 [10148.544003][ C0] ? lock_release+0x1d5/0x250 [10148.544257][ C0] do_raw_spin_lock+0x1ec/0x270 [10148.544518][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10148.544805][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10148.545106][ C0] ? lock_acquire+0x1c1/0x220 [10148.545355][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10148.545608][ C0] _raw_spin_lock_nested+0x65/0x80 [10148.545880][ C0] tcp_v4_rcv+0x2159/0x29b0 [10148.546129][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10148.546389][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10148.546662][ C0] ? __inet_lookup_established+0x341/0x610 [10148.546979][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10148.547276][ C0] ip_local_deliver_finish+0x2ae/0x450 [10148.547569][ C0] ip_local_deliver+0x19d/0x480 [10148.547824][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10148.548106][ C0] ? rcu_read_lock_held+0xe/0x50 [10148.548371][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10148.548651][ C0] ? rcu_read_lock_held+0xe/0x50 [10148.548918][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10148.549253][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10148.549531][ C0] ip_rcv+0x564/0x740 [10148.549751][ C0] ? __pfx_ip_rcv+0x10/0x10 [10148.549997][ C0] ? set_track_prepare+0x8a/0xd0 [10148.550271][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10148.550560][ C0] ? rest_init+0x153/0x260 [10148.550800][ C0] ? skb_clone+0x10b/0x330 [10148.551039][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10148.551377][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10148.551701][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10148.551997][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10148.552304][ C0] ? __tcf_classify+0x32c/0x7d0 [10148.552563][ C0] ? __pfx_ip_rcv+0x10/0x10 [10148.552805][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10148.553118][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10148.553414][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10148.553758][ C0] ? lock_acquire+0x1c1/0x220 [10148.554012][ C0] ? netif_receive_skb_internal+0x84/0x300 [10148.554325][ C0] netif_receive_skb_internal+0xb0/0x300 [10148.554620][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10148.554954][ C0] ? __copy_skb_header+0xaf/0x490 [10148.555226][ C0] ? __skb_clone+0x57a/0x760 [10148.555474][ C0] netif_receive_skb+0x55/0x280 [10148.555732][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10148.556059][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10148.556405][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10148.556723][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10148.557010][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10148.557317][ C0] ? hlock_class+0x4e/0x130 [10148.557566][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10148.557897][ C0] ? place_entity+0x21/0x2f0 [10148.558147][ C0] ? resched_curr+0x219/0x280 [10148.558396][ C0] ? __pfx_resched_curr+0x10/0x10 [10148.558663][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10148.558945][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10148.559226][ C0] ? wakeup_preempt+0x161/0x2c0 [10148.559487][ C0] ? activate_task+0xf5/0x260 [10148.559742][ C0] ? trace_sched_wakeup+0xd2/0x100 [10148.560022][ C0] ? do_raw_spin_unlock+0x58/0x220 [10148.560295][ C0] ? _raw_spin_unlock+0x23/0x40 [10148.560561][ C0] ? get_stack_info_noinstr+0x18/0x110 [10148.560854][ C0] ? get_stack_info+0x36/0xc0 [10148.561104][ C0] ? stack_access_ok+0xda/0x1f0 [10148.561360][ C0] ? get_reg+0x119/0x190 [10148.561586][ C0] __tcf_classify+0x32c/0x7d0 [10148.561840][ C0] tcf_classify+0x283/0x930 [10148.562087][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10148.562418][ C0] ? __pfx_tcf_classify+0x10/0x10 [10148.562684][ C0] ? arch_stack_walk+0x8c/0x100 [10148.562942][ C0] ? get_stack_info_noinstr+0x18/0x110 [10148.563231][ C0] tc_run+0x2e4/0x5d0 [10148.563453][ C0] ? __pfx_tc_run+0x10/0x10 [10148.563699][ C0] ? lock_acquire+0x1c1/0x220 [10148.563952][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10148.564231][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10148.564496][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10148.564785][ C0] ? ip_finish_output2+0x786/0x18e0 [10148.565067][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10148.565395][ C0] ? neigh_hh_output+0x348/0x590 [10148.565660][ C0] ? ip_finish_output2+0x262/0x18e0 [10148.565940][ C0] ip_finish_output2+0x786/0x18e0 [10148.566212][ C0] ? stack_depot_save_flags+0x45/0x550 [10148.566508][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10148.566859][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10148.567153][ C0] ? rcu_read_lock_held+0xe/0x50 [10148.567416][ C0] ? __ip_finish_output+0x10f/0x770 [10148.567697][ C0] ip_output+0x16b/0x4f0 [10148.567927][ C0] ? __run_timers.part.0+0x52d/0x890 [10148.568212][ C0] ? __pfx_ip_output+0x10/0x10 [10148.568471][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10148.568771][ C0] ? rcu_read_lock_held+0xe/0x50 [10148.569038][ C0] ? ip_local_out+0x114/0x3b0 [10148.569290][ C0] __ip_queue_xmit+0x672/0x1910 [10148.569554][ C0] ? __skb_clone+0x57a/0x760 [10148.569803][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10148.570089][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10148.570394][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10148.570714][ C0] tcp_write_xmit+0xe42/0x24c0 [10148.570974][ C0] ? tcp_current_mss+0x40a/0x510 [10148.571243][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10148.571525][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10148.571805][ C0] ? mark_lock_irq+0x6e2/0xa10 [10148.572065][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10148.572335][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10148.572656][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10148.572936][ C0] ? ktime_get+0xb6/0x190 [10148.573173][ C0] tcp_send_loss_probe+0x4c9/0x830 [10148.573449][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10148.573732][ C0] tcp_write_timer+0x82/0x1d0 [10148.573993][ C0] call_timer_fn+0x176/0x430 [10148.574256][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10148.574543][ C0] ? next_expiry_recalc+0xcd/0x220 [10148.574819][ C0] __run_timers.part.0+0x52d/0x890 [10148.575091][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10148.575376][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10148.575674][ C0] ? lock_acquire+0x1c1/0x220 [10148.575928][ C0] ? clockevents_program_event+0xf6/0x300 [10148.576237][ C0] ? lock_release+0x1d5/0x250 [10148.576487][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10148.576766][ C0] ? ktime_get+0xb6/0x190 [10148.577003][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10148.577308][ C0] ? clockevents_program_event+0x1ed/0x300 [10148.577621][ C0] run_timer_softirq+0x72/0x100 [10148.577880][ C0] __do_softirq+0x1bc/0x7ff [10148.578122][ C0] irq_exit_rcu+0x98/0xc0 [10148.578351][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10148.578649][ C0] [10148.578809][ C0] [10148.578969][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10148.579292][ C0] RIP: 0010:default_idle+0xf/0x20 [10148.579559][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10148.580575][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10148.580894][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10148.581314][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10148.581733][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10148.582151][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10148.582566][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10148.582985][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10148.583288][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10148.583560][ C0] default_idle_call+0x69/0xa0 [10148.583816][ C0] cpuidle_idle_call+0x1f6/0x280 [10148.584079][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10148.584372][ C0] ? lock_release+0x1d5/0x250 [10148.584620][ C0] do_idle+0xfb/0x160 [10148.584833][ C0] cpu_startup_entry+0x55/0x60 [10148.585088][ C0] rest_init+0x153/0x260 [10148.585314][ C0] ? acpi_enable_subsystem+0xac/0x150 [10148.585599][ C0] arch_call_rest_init+0x13/0x40 [10148.585865][ C0] start_kernel+0x314/0x3d0 [10148.586113][ C0] x86_64_start_reservations+0x18/0x30 [10148.586409][ C0] x86_64_start_kernel+0xba/0x110 [10148.586681][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10148.587008][ C0] [10148.587181][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8345s! [ksoftirqd/1:22] [10148.587640][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10148.588812][ C1] irq event stamp: 3886976 [10148.589046][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10148.589543][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10148.590044][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10148.590543][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10148.591030][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10148.591526][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10148.592177][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10148.592519][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10148.593548][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10148.593876][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10148.594298][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10148.594720][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10148.595144][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10148.595570][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10148.595989][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10148.596460][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10148.596806][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10148.597233][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10148.597656][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10148.598080][ C1] Call Trace: [10148.598261][ C1] [10148.598418][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10148.598691][ C1] ? __run_hrtimer+0x1c3/0x710 [10148.598947][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10148.599240][ C1] ? __hrtimer_run_queues+0x197/0x270 [10148.599527][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10148.599838][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10148.600119][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10148.600441][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10148.600717][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10148.601044][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10148.601357][ C1] [10148.601513][ C1] [10148.601670][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10148.602001][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10148.602306][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10148.602621][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10148.602922][ C1] ? run_ksoftirqd+0xb/0x60 [10148.603166][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10148.603494][ C1] ? __orc_find+0x9c/0xf0 [10148.603726][ C1] ? lock_acquire+0x1c1/0x220 [10148.603984][ C1] ? irqentry_enter+0x2b/0x60 [10148.604241][ C1] do_raw_spin_lock+0x1ec/0x270 [10148.604507][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10148.604796][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10148.605103][ C1] ? lock_acquire+0x1c1/0x220 [10148.605351][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10148.605604][ C1] _raw_spin_lock_nested+0x65/0x80 [10148.605876][ C1] tcp_v4_rcv+0x2159/0x29b0 [10148.606126][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10148.606391][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10148.606662][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10148.606950][ C1] ip_local_deliver_finish+0x2ae/0x450 [10148.607250][ C1] ip_local_deliver+0x19d/0x480 [10148.607511][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10148.607798][ C1] ? rcu_read_lock_held+0xe/0x50 [10148.608069][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10148.608346][ C1] ? rcu_read_lock_held+0xe/0x50 [10148.608609][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10148.608948][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10148.609221][ C1] ip_rcv+0x564/0x740 [10148.609435][ C1] ? __pfx_ip_rcv+0x10/0x10 [10148.609676][ C1] ? set_track_prepare+0x8a/0xd0 [10148.609939][ C1] ? irqentry_enter+0x2b/0x60 [10148.610193][ C1] ? irqentry_enter+0x2b/0x60 [10148.610446][ C1] ? __pfx_ip_rcv+0x10/0x10 [10148.610692][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10148.611006][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10148.611349][ C1] ? netif_receive_skb_internal+0x84/0x300 [10148.611659][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10148.611996][ C1] netif_receive_skb_internal+0xb0/0x300 [10148.612293][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10148.612627][ C1] netif_receive_skb+0x55/0x280 [10148.612895][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10148.613224][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10148.613574][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10148.613886][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10148.614176][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10148.614480][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10148.614811][ C1] ? unwind_next_frame+0x1478/0x1d10 [10148.615095][ C1] ? arch_stack_walk+0x68/0x100 [10148.615352][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10148.615627][ C1] ? irqentry_enter+0x2b/0x60 [10148.615878][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10148.616200][ C1] ? irqentry_enter+0x2b/0x60 [10148.616455][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10148.616778][ C1] ? unwind_next_frame+0x1478/0x1d10 [10148.617061][ C1] ? arch_stack_walk+0x68/0x100 [10148.617328][ C1] __tcf_classify+0x32c/0x7d0 [10148.617581][ C1] tcf_classify+0x283/0x930 [10148.617822][ C1] ? __pfx_tcf_classify+0x10/0x10 [10148.618091][ C1] tc_run+0x2e4/0x5d0 [10148.618307][ C1] ? __pfx_tc_run+0x10/0x10 [10148.618551][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10148.618817][ C1] ? irqentry_enter+0x2b/0x60 [10148.619071][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10148.619358][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10148.619685][ C1] ip_finish_output2+0x786/0x18e0 [10148.619954][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10148.620242][ C1] ? rcu_read_lock_held+0xe/0x50 [10148.620509][ C1] ? __ip_finish_output+0x10f/0x770 [10148.620785][ C1] ip_output+0x16b/0x4f0 [10148.621011][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10148.621335][ C1] ? __pfx_ip_output+0x10/0x10 [10148.621591][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10148.621945][ C1] ? __pfx_ip_output+0x10/0x10 [10148.622207][ C1] __ip_queue_xmit+0x672/0x1910 [10148.622467][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10148.622745][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10148.623040][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10148.623326][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10148.623625][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10148.623910][ C1] tcp_delack_timer+0x84/0x240 [10148.624167][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10148.624455][ C1] call_timer_fn+0x176/0x430 [10148.624706][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10148.624981][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10148.625262][ C1] __run_timers.part.0+0x52d/0x890 [10148.625537][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10148.625825][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10148.626126][ C1] ? __pfx___schedule+0x10/0x10 [10148.626389][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10148.626711][ C1] run_timer_softirq+0x72/0x100 [10148.626968][ C1] __do_softirq+0x1bc/0x7ff [10148.627215][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10148.627492][ C1] run_ksoftirqd+0x2e/0x60 [10148.627728][ C1] smpboot_thread_fn+0x30e/0x840 [10148.627996][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10148.628287][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10148.628580][ C1] kthread+0x292/0x360 [10148.628797][ C1] ? __pfx_kthread+0x10/0x10 [10148.629044][ C1] ret_from_fork+0x34/0x70 [10148.629283][ C1] ? __pfx_kthread+0x10/0x10 [10148.629532][ C1] ret_from_fork_asm+0x1b/0x30 [10148.629794][ C1] [10176.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8371s! [swapper/0:0] [10176.527930][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10176.529127][ C0] irq event stamp: 27567077 [10176.529370][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10176.529902][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10176.530373][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10176.530877][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10176.531371][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10176.531850][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10176.532499][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10176.532842][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10176.533869][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10176.534196][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10176.534619][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10176.535044][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10176.535469][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10176.535890][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10176.536311][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10176.536785][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10176.537138][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10176.537559][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10176.537977][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10176.538400][ C0] Call Trace: [10176.538585][ C0] [10176.538742][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10176.539016][ C0] ? __run_hrtimer+0x1c3/0x710 [10176.539272][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10176.539559][ C0] ? __hrtimer_run_queues+0x197/0x270 [10176.539848][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10176.540153][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10176.540435][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10176.540755][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10176.541026][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10176.541305][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10176.541627][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10176.541936][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10176.542272][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10176.542575][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10176.542884][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10176.543190][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10176.543519][ C0] ? get_stack_info+0x36/0xc0 [10176.543774][ C0] ? lock_acquire+0x1c1/0x220 [10176.544026][ C0] ? lock_release+0x1d5/0x250 [10176.544277][ C0] do_raw_spin_lock+0x1ec/0x270 [10176.544536][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10176.544819][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10176.545117][ C0] ? lock_acquire+0x1c1/0x220 [10176.545369][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10176.545627][ C0] _raw_spin_lock_nested+0x65/0x80 [10176.545903][ C0] tcp_v4_rcv+0x2159/0x29b0 [10176.546148][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10176.546406][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10176.546673][ C0] ? __inet_lookup_established+0x341/0x610 [10176.546987][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10176.547280][ C0] ip_local_deliver_finish+0x2ae/0x450 [10176.547574][ C0] ip_local_deliver+0x19d/0x480 [10176.547834][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10176.548120][ C0] ? rcu_read_lock_held+0xe/0x50 [10176.548389][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10176.548664][ C0] ? rcu_read_lock_held+0xe/0x50 [10176.548927][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10176.549266][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10176.549540][ C0] ip_rcv+0x564/0x740 [10176.549753][ C0] ? __pfx_ip_rcv+0x10/0x10 [10176.549993][ C0] ? set_track_prepare+0x8a/0xd0 [10176.550259][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10176.550550][ C0] ? rest_init+0x153/0x260 [10176.550787][ C0] ? skb_clone+0x10b/0x330 [10176.551029][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10176.551363][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10176.551684][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10176.551981][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10176.552293][ C0] ? __tcf_classify+0x32c/0x7d0 [10176.552558][ C0] ? __pfx_ip_rcv+0x10/0x10 [10176.552802][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10176.553120][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10176.553419][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10176.553758][ C0] ? lock_acquire+0x1c1/0x220 [10176.554007][ C0] ? netif_receive_skb_internal+0x84/0x300 [10176.554315][ C0] netif_receive_skb_internal+0xb0/0x300 [10176.554614][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10176.554941][ C0] ? __copy_skb_header+0xaf/0x490 [10176.555209][ C0] ? __skb_clone+0x57a/0x760 [10176.555456][ C0] netif_receive_skb+0x55/0x280 [10176.555718][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10176.556054][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10176.556405][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10176.556717][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10176.557012][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10176.557312][ C0] ? hlock_class+0x4e/0x130 [10176.557555][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10176.557881][ C0] ? place_entity+0x21/0x2f0 [10176.558127][ C0] ? resched_curr+0x219/0x280 [10176.558385][ C0] ? __pfx_resched_curr+0x10/0x10 [10176.558655][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10176.558939][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10176.559218][ C0] ? wakeup_preempt+0x161/0x2c0 [10176.559474][ C0] ? activate_task+0xf5/0x260 [10176.559721][ C0] ? trace_sched_wakeup+0xd2/0x100 [10176.559995][ C0] ? do_raw_spin_unlock+0x58/0x220 [10176.560275][ C0] ? _raw_spin_unlock+0x23/0x40 [10176.560534][ C0] ? get_stack_info_noinstr+0x18/0x110 [10176.560822][ C0] ? get_stack_info+0x36/0xc0 [10176.561075][ C0] ? stack_access_ok+0xda/0x1f0 [10176.561334][ C0] ? get_reg+0x119/0x190 [10176.561564][ C0] __tcf_classify+0x32c/0x7d0 [10176.561814][ C0] tcf_classify+0x283/0x930 [10176.562057][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10176.562382][ C0] ? __pfx_tcf_classify+0x10/0x10 [10176.562652][ C0] ? arch_stack_walk+0x8c/0x100 [10176.562914][ C0] ? get_stack_info_noinstr+0x18/0x110 [10176.563206][ C0] tc_run+0x2e4/0x5d0 [10176.563421][ C0] ? __pfx_tc_run+0x10/0x10 [10176.563660][ C0] ? lock_acquire+0x1c1/0x220 [10176.563905][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10176.564179][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10176.564444][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10176.564725][ C0] ? ip_finish_output2+0x786/0x18e0 [10176.565000][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10176.565321][ C0] ? neigh_hh_output+0x348/0x590 [10176.565588][ C0] ? ip_finish_output2+0x262/0x18e0 [10176.565863][ C0] ip_finish_output2+0x786/0x18e0 [10176.566130][ C0] ? stack_depot_save_flags+0x45/0x550 [10176.566420][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10176.566774][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10176.567070][ C0] ? rcu_read_lock_held+0xe/0x50 [10176.567336][ C0] ? __ip_finish_output+0x10f/0x770 [10176.567610][ C0] ip_output+0x16b/0x4f0 [10176.567837][ C0] ? __run_timers.part.0+0x52d/0x890 [10176.568123][ C0] ? __pfx_ip_output+0x10/0x10 [10176.568377][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10176.568678][ C0] ? rcu_read_lock_held+0xe/0x50 [10176.568939][ C0] ? ip_local_out+0x114/0x3b0 [10176.569193][ C0] __ip_queue_xmit+0x672/0x1910 [10176.569458][ C0] ? __skb_clone+0x57a/0x760 [10176.569707][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10176.569985][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10176.570278][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10176.570593][ C0] tcp_write_xmit+0xe42/0x24c0 [10176.570850][ C0] ? tcp_current_mss+0x40a/0x510 [10176.571114][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10176.571396][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10176.571669][ C0] ? mark_lock_irq+0x6e2/0xa10 [10176.571919][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10176.572190][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10176.572511][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10176.572785][ C0] ? ktime_get+0xb6/0x190 [10176.573015][ C0] tcp_send_loss_probe+0x4c9/0x830 [10176.573287][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10176.573572][ C0] tcp_write_timer+0x82/0x1d0 [10176.573822][ C0] call_timer_fn+0x176/0x430 [10176.574068][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10176.574345][ C0] ? next_expiry_recalc+0xcd/0x220 [10176.574617][ C0] __run_timers.part.0+0x52d/0x890 [10176.574889][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10176.575169][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10176.575469][ C0] ? lock_acquire+0x1c1/0x220 [10176.575718][ C0] ? clockevents_program_event+0xf6/0x300 [10176.576021][ C0] ? lock_release+0x1d5/0x250 [10176.576268][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10176.576541][ C0] ? ktime_get+0xb6/0x190 [10176.576769][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10176.577072][ C0] ? clockevents_program_event+0x1ed/0x300 [10176.577380][ C0] run_timer_softirq+0x72/0x100 [10176.577641][ C0] __do_softirq+0x1bc/0x7ff [10176.577886][ C0] irq_exit_rcu+0x98/0xc0 [10176.578119][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10176.578418][ C0] [10176.578574][ C0] [10176.578729][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10176.579045][ C0] RIP: 0010:default_idle+0xf/0x20 [10176.579315][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10176.580340][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10176.580667][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10176.581094][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10176.581515][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10176.581932][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10176.582350][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10176.582773][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10176.583079][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10176.583353][ C0] default_idle_call+0x69/0xa0 [10176.583606][ C0] cpuidle_idle_call+0x1f6/0x280 [10176.583870][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10176.584157][ C0] ? lock_release+0x1d5/0x250 [10176.584408][ C0] do_idle+0xfb/0x160 [10176.584623][ C0] cpu_startup_entry+0x55/0x60 [10176.584879][ C0] rest_init+0x153/0x260 [10176.585105][ C0] ? acpi_enable_subsystem+0xac/0x150 [10176.585393][ C0] arch_call_rest_init+0x13/0x40 [10176.585661][ C0] start_kernel+0x314/0x3d0 [10176.585901][ C0] x86_64_start_reservations+0x18/0x30 [10176.586190][ C0] x86_64_start_kernel+0xba/0x110 [10176.586461][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10176.586793][ C0] [10176.586964][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8371s! [ksoftirqd/1:22] [10176.587426][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10176.588614][ C1] irq event stamp: 3886976 [10176.588850][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10176.589352][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10176.589854][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10176.590353][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10176.590845][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10176.591343][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10176.591986][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa8/0xb90 [10176.592327][ C1] Code: 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 be 04 00 00 00 <48> 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c 08 84 c0 0f 85 [10176.593342][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10176.593661][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10176.594079][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10176.594495][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10176.594909][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10176.595325][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10176.595742][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10176.596211][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10176.596562][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10176.596992][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10176.597413][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10176.597830][ C1] Call Trace: [10176.598006][ C1] [10176.598161][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10176.598439][ C1] ? __run_hrtimer+0x1c3/0x710 [10176.598696][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10176.598989][ C1] ? __hrtimer_run_queues+0x197/0x270 [10176.599276][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10176.599577][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10176.599853][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10176.600177][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10176.600454][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10176.600775][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10176.601087][ C1] [10176.601248][ C1] [10176.601408][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10176.601739][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10176.602042][ C1] ? queued_spin_lock_slowpath+0xa8/0xb90 [10176.602344][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10176.602646][ C1] ? run_ksoftirqd+0xb/0x60 [10176.602891][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10176.603218][ C1] ? __orc_find+0x9c/0xf0 [10176.603452][ C1] ? lock_acquire+0x1c1/0x220 [10176.603705][ C1] ? irqentry_enter+0x2b/0x60 [10176.603959][ C1] do_raw_spin_lock+0x1ec/0x270 [10176.604221][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10176.604511][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10176.604814][ C1] ? lock_acquire+0x1c1/0x220 [10176.605064][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10176.605316][ C1] _raw_spin_lock_nested+0x65/0x80 [10176.605594][ C1] tcp_v4_rcv+0x2159/0x29b0 [10176.605843][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10176.606106][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10176.606380][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10176.606671][ C1] ip_local_deliver_finish+0x2ae/0x450 [10176.606971][ C1] ip_local_deliver+0x19d/0x480 [10176.607233][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10176.607520][ C1] ? rcu_read_lock_held+0xe/0x50 [10176.607788][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10176.608067][ C1] ? rcu_read_lock_held+0xe/0x50 [10176.608331][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10176.608670][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10176.608947][ C1] ip_rcv+0x564/0x740 [10176.609161][ C1] ? __pfx_ip_rcv+0x10/0x10 [10176.609400][ C1] ? set_track_prepare+0x8a/0xd0 [10176.609665][ C1] ? irqentry_enter+0x2b/0x60 [10176.609920][ C1] ? irqentry_enter+0x2b/0x60 [10176.610177][ C1] ? __pfx_ip_rcv+0x10/0x10 [10176.610422][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10176.610739][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10176.611082][ C1] ? netif_receive_skb_internal+0x84/0x300 [10176.611397][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10176.611736][ C1] netif_receive_skb_internal+0xb0/0x300 [10176.612034][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10176.612370][ C1] netif_receive_skb+0x55/0x280 [10176.612632][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10176.612962][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10176.613315][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10176.613627][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10176.613920][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10176.614227][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10176.614559][ C1] ? unwind_next_frame+0x1478/0x1d10 [10176.614842][ C1] ? arch_stack_walk+0x68/0x100 [10176.615103][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10176.615379][ C1] ? irqentry_enter+0x2b/0x60 [10176.615631][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10176.615950][ C1] ? irqentry_enter+0x2b/0x60 [10176.616205][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10176.616530][ C1] ? unwind_next_frame+0x1478/0x1d10 [10176.616809][ C1] ? arch_stack_walk+0x68/0x100 [10176.617078][ C1] __tcf_classify+0x32c/0x7d0 [10176.617330][ C1] tcf_classify+0x283/0x930 [10176.617572][ C1] ? __pfx_tcf_classify+0x10/0x10 [10176.617841][ C1] tc_run+0x2e4/0x5d0 [10176.618057][ C1] ? __pfx_tc_run+0x10/0x10 [10176.618299][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10176.618565][ C1] ? irqentry_enter+0x2b/0x60 [10176.618820][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10176.619109][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10176.619431][ C1] ip_finish_output2+0x786/0x18e0 [10176.619701][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10176.619991][ C1] ? rcu_read_lock_held+0xe/0x50 [10176.620257][ C1] ? __ip_finish_output+0x10f/0x770 [10176.620532][ C1] ip_output+0x16b/0x4f0 [10176.620760][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10176.621080][ C1] ? __pfx_ip_output+0x10/0x10 [10176.621335][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10176.621691][ C1] ? __pfx_ip_output+0x10/0x10 [10176.621950][ C1] __ip_queue_xmit+0x672/0x1910 [10176.622210][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10176.622488][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10176.622781][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10176.623065][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10176.623358][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10176.623643][ C1] tcp_delack_timer+0x84/0x240 [10176.623901][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10176.624190][ C1] call_timer_fn+0x176/0x430 [10176.624441][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10176.624714][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10176.624994][ C1] __run_timers.part.0+0x52d/0x890 [10176.625271][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10176.625564][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10176.625865][ C1] ? __pfx___schedule+0x10/0x10 [10176.626128][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10176.626455][ C1] run_timer_softirq+0x72/0x100 [10176.626715][ C1] __do_softirq+0x1bc/0x7ff [10176.626967][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10176.627243][ C1] run_ksoftirqd+0x2e/0x60 [10176.627480][ C1] smpboot_thread_fn+0x30e/0x840 [10176.627748][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10176.628039][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10176.628335][ C1] kthread+0x292/0x360 [10176.628553][ C1] ? __pfx_kthread+0x10/0x10 [10176.628802][ C1] ret_from_fork+0x34/0x70 [10176.629041][ C1] ? __pfx_kthread+0x10/0x10 [10176.629289][ C1] ret_from_fork_asm+0x1b/0x30 [10176.629548][ C1] [10200.073024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [10200.073416][ C0] rcu: 0-....: (8946068 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=2140913 [10200.073938][ C0] rcu: (t=9005764 jiffies g=1007429 q=31 ncpus=4) [10200.074290][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10200.074770][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10200.075420][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10200.075769][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10200.076799][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10200.077132][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10200.077548][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10200.077966][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10200.078386][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10200.078803][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10200.079219][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10200.079685][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10200.080042][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10200.080459][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10200.080879][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10200.081301][ C0] Call Trace: [10200.081485][ C0] [10200.081642][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10200.081928][ C0] ? print_cpu_stall+0x263/0x6a0 [10200.082196][ C0] ? check_cpu_stall+0x284/0x500 [10200.082459][ C0] ? rcu_pending+0x92/0x360 [10200.082702][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [10200.082986][ C0] ? update_process_times+0xb9/0x110 [10200.083271][ C0] ? tick_sched_handle+0x67/0x130 [10200.083542][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [10200.083843][ C0] ? __run_hrtimer+0x1c3/0x710 [10200.084099][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10200.084428][ C0] ? __hrtimer_run_queues+0x197/0x270 [10200.084714][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10200.085014][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10200.085293][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10200.085612][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10200.085888][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10200.086165][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10200.086490][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10200.086805][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10200.087148][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10200.087449][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10200.087758][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10200.088064][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10200.088394][ C0] ? get_stack_info+0x36/0xc0 [10200.088648][ C0] ? lock_acquire+0x1c1/0x220 [10200.088900][ C0] ? lock_release+0x1d5/0x250 [10200.089151][ C0] do_raw_spin_lock+0x1ec/0x270 [10200.089410][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10200.089693][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10200.089990][ C0] ? lock_acquire+0x1c1/0x220 [10200.090243][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10200.090499][ C0] _raw_spin_lock_nested+0x65/0x80 [10200.090775][ C0] tcp_v4_rcv+0x2159/0x29b0 [10200.091019][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10200.091277][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10200.091546][ C0] ? __inet_lookup_established+0x341/0x610 [10200.091855][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10200.092147][ C0] ip_local_deliver_finish+0x2ae/0x450 [10200.092439][ C0] ip_local_deliver+0x19d/0x480 [10200.092695][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10200.092976][ C0] ? rcu_read_lock_held+0xe/0x50 [10200.093241][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10200.093521][ C0] ? rcu_read_lock_held+0xe/0x50 [10200.093788][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10200.094122][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10200.094399][ C0] ip_rcv+0x564/0x740 [10200.094618][ C0] ? __pfx_ip_rcv+0x10/0x10 [10200.094863][ C0] ? set_track_prepare+0x8a/0xd0 [10200.095133][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10200.095421][ C0] ? rest_init+0x153/0x260 [10200.095660][ C0] ? skb_clone+0x10b/0x330 [10200.095896][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10200.096237][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10200.096560][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10200.096859][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10200.097171][ C0] ? __tcf_classify+0x32c/0x7d0 [10200.097436][ C0] ? __pfx_ip_rcv+0x10/0x10 [10200.097680][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10200.097997][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10200.098297][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10200.098632][ C0] ? lock_acquire+0x1c1/0x220 [10200.098880][ C0] ? netif_receive_skb_internal+0x84/0x300 [10200.099188][ C0] netif_receive_skb_internal+0xb0/0x300 [10200.099486][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10200.099812][ C0] ? __copy_skb_header+0xaf/0x490 [10200.100078][ C0] ? __skb_clone+0x57a/0x760 [10200.100324][ C0] netif_receive_skb+0x55/0x280 [10200.100586][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10200.100917][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10200.101267][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10200.101579][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10200.101876][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10200.102184][ C0] ? hlock_class+0x4e/0x130 [10200.102432][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10200.102763][ C0] ? place_entity+0x21/0x2f0 [10200.103012][ C0] ? resched_curr+0x219/0x280 [10200.103261][ C0] ? __pfx_resched_curr+0x10/0x10 [10200.103527][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10200.103808][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10200.104093][ C0] ? wakeup_preempt+0x161/0x2c0 [10200.104354][ C0] ? activate_task+0xf5/0x260 [10200.104608][ C0] ? trace_sched_wakeup+0xd2/0x100 [10200.104886][ C0] ? do_raw_spin_unlock+0x58/0x220 [10200.105159][ C0] ? _raw_spin_unlock+0x23/0x40 [10200.105420][ C0] ? get_stack_info_noinstr+0x18/0x110 [10200.105711][ C0] ? get_stack_info+0x36/0xc0 [10200.105959][ C0] ? stack_access_ok+0xda/0x1f0 [10200.106214][ C0] ? get_reg+0x119/0x190 [10200.106441][ C0] __tcf_classify+0x32c/0x7d0 [10200.106696][ C0] tcf_classify+0x283/0x930 [10200.106946][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10200.107274][ C0] ? __pfx_tcf_classify+0x10/0x10 [10200.107544][ C0] ? arch_stack_walk+0x8c/0x100 [10200.107805][ C0] ? get_stack_info_noinstr+0x18/0x110 [10200.108096][ C0] tc_run+0x2e4/0x5d0 [10200.108311][ C0] ? __pfx_tc_run+0x10/0x10 [10200.108550][ C0] ? lock_acquire+0x1c1/0x220 [10200.108799][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10200.109073][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10200.109340][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10200.109621][ C0] ? ip_finish_output2+0x786/0x18e0 [10200.109894][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10200.110215][ C0] ? neigh_hh_output+0x348/0x590 [10200.110480][ C0] ? ip_finish_output2+0x262/0x18e0 [10200.110755][ C0] ip_finish_output2+0x786/0x18e0 [10200.111020][ C0] ? stack_depot_save_flags+0x45/0x550 [10200.111310][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10200.111664][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10200.111955][ C0] ? rcu_read_lock_held+0xe/0x50 [10200.112219][ C0] ? __ip_finish_output+0x10f/0x770 [10200.112498][ C0] ip_output+0x16b/0x4f0 [10200.112728][ C0] ? __run_timers.part.0+0x52d/0x890 [10200.113014][ C0] ? __pfx_ip_output+0x10/0x10 [10200.113271][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10200.113569][ C0] ? rcu_read_lock_held+0xe/0x50 [10200.113834][ C0] ? ip_local_out+0x114/0x3b0 [10200.114085][ C0] __ip_queue_xmit+0x672/0x1910 [10200.114345][ C0] ? __skb_clone+0x57a/0x760 [10200.114591][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10200.114875][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10200.115174][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10200.115491][ C0] tcp_write_xmit+0xe42/0x24c0 [10200.115746][ C0] ? tcp_current_mss+0x40a/0x510 [10200.116014][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10200.116295][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10200.116572][ C0] ? mark_lock_irq+0x6e2/0xa10 [10200.116832][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10200.117104][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10200.117426][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10200.117699][ C0] ? ktime_get+0xb6/0x190 [10200.117929][ C0] tcp_send_loss_probe+0x4c9/0x830 [10200.118202][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10200.118485][ C0] tcp_write_timer+0x82/0x1d0 [10200.118735][ C0] call_timer_fn+0x176/0x430 [10200.118980][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10200.119256][ C0] ? next_expiry_recalc+0xcd/0x220 [10200.119528][ C0] __run_timers.part.0+0x52d/0x890 [10200.119805][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10200.120085][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10200.120385][ C0] ? lock_acquire+0x1c1/0x220 [10200.120636][ C0] ? clockevents_program_event+0xf6/0x300 [10200.120939][ C0] ? lock_release+0x1d5/0x250 [10200.121186][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10200.121460][ C0] ? ktime_get+0xb6/0x190 [10200.121689][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10200.121985][ C0] ? clockevents_program_event+0x1ed/0x300 [10200.122297][ C0] run_timer_softirq+0x72/0x100 [10200.122555][ C0] __do_softirq+0x1bc/0x7ff [10200.122795][ C0] irq_exit_rcu+0x98/0xc0 [10200.123025][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10200.123321][ C0] [10200.123481][ C0] [10200.123640][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10200.123961][ C0] RIP: 0010:default_idle+0xf/0x20 [10200.124226][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10200.125236][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10200.125553][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10200.125968][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10200.126381][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10200.126794][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10200.127212][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10200.127634][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10200.127939][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10200.128217][ C0] default_idle_call+0x69/0xa0 [10200.128473][ C0] cpuidle_idle_call+0x1f6/0x280 [10200.128738][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10200.129026][ C0] ? lock_release+0x1d5/0x250 [10200.129277][ C0] do_idle+0xfb/0x160 [10200.129492][ C0] cpu_startup_entry+0x55/0x60 [10200.129753][ C0] rest_init+0x153/0x260 [10200.129976][ C0] ? acpi_enable_subsystem+0xac/0x150 [10200.130264][ C0] arch_call_rest_init+0x13/0x40 [10200.130533][ C0] start_kernel+0x314/0x3d0 [10200.130773][ C0] x86_64_start_reservations+0x18/0x30 [10200.131061][ C0] x86_64_start_kernel+0xba/0x110 [10200.131332][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10200.131664][ C0] [10200.131831][ C0] Sending NMI from CPU 0 to CPUs 1: [10200.132115][ C1] NMI backtrace for cpu 1 [10200.132121][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10200.132125][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10200.132128][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10200.132134][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10200.132137][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10200.132140][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10200.132141][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10200.132143][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10200.132145][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10200.132147][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10200.132149][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10200.132151][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10200.132154][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10200.132155][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10200.132157][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10200.132158][ C1] Call Trace: [10200.132160][ C1] [10200.132162][ C1] ? nmi_cpu_backtrace+0x112/0x220 [10200.132168][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [10200.132173][ C1] ? nmi_handle+0x156/0x420 [10200.132178][ C1] ? default_do_nmi+0x41/0x100 [10200.132181][ C1] ? exc_nmi+0xf3/0x120 [10200.132183][ C1] ? end_repeat_nmi+0xf/0x60 [10200.132188][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10200.132191][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10200.132195][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10200.132198][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10200.132202][ C1] [10200.132203][ C1] [10200.132204][ C1] ? run_ksoftirqd+0xb/0x60 [10200.132210][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10200.132213][ C1] ? __orc_find+0x9c/0xf0 [10200.132216][ C1] ? lock_acquire+0x1c1/0x220 [10200.132219][ C1] ? irqentry_enter+0x2b/0x60 [10200.132224][ C1] do_raw_spin_lock+0x1ec/0x270 [10200.132228][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10200.132231][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10200.132234][ C1] ? lock_acquire+0x1c1/0x220 [10200.132236][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10200.132241][ C1] _raw_spin_lock_nested+0x65/0x80 [10200.132244][ C1] tcp_v4_rcv+0x2159/0x29b0 [10200.132251][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10200.132254][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10200.132260][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10200.132265][ C1] ip_local_deliver_finish+0x2ae/0x450 [10200.132269][ C1] ip_local_deliver+0x19d/0x480 [10200.132272][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10200.132275][ C1] ? rcu_read_lock_held+0xe/0x50 [10200.132279][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10200.132283][ C1] ? rcu_read_lock_held+0xe/0x50 [10200.132286][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10200.132289][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10200.132298][ C1] ip_rcv+0x564/0x740 [10200.132302][ C1] ? __pfx_ip_rcv+0x10/0x10 [10200.132305][ C1] ? set_track_prepare+0x8a/0xd0 [10200.132309][ C1] ? irqentry_enter+0x2b/0x60 [10200.132312][ C1] ? irqentry_enter+0x2b/0x60 [10200.132316][ C1] ? __pfx_ip_rcv+0x10/0x10 [10200.132318][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10200.132322][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10200.132325][ C1] ? netif_receive_skb_internal+0x84/0x300 [10200.132328][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10200.132332][ C1] netif_receive_skb_internal+0xb0/0x300 [10200.132334][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10200.132339][ C1] netif_receive_skb+0x55/0x280 [10200.132342][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10200.132350][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10200.132356][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10200.132363][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10200.132369][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10200.132380][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10200.132390][ C1] ? unwind_next_frame+0x1478/0x1d10 [10200.132393][ C1] ? arch_stack_walk+0x68/0x100 [10200.132397][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10200.132400][ C1] ? irqentry_enter+0x2b/0x60 [10200.132404][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10200.132408][ C1] ? irqentry_enter+0x2b/0x60 [10200.132412][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10200.132419][ C1] ? unwind_next_frame+0x1478/0x1d10 [10200.132422][ C1] ? arch_stack_walk+0x68/0x100 [10200.132426][ C1] __tcf_classify+0x32c/0x7d0 [10200.132431][ C1] tcf_classify+0x283/0x930 [10200.132435][ C1] ? __pfx_tcf_classify+0x10/0x10 [10200.132439][ C1] tc_run+0x2e4/0x5d0 [10200.132443][ C1] ? __pfx_tc_run+0x10/0x10 [10200.132448][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10200.132454][ C1] ? irqentry_enter+0x2b/0x60 [10200.132457][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10200.132460][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10200.132467][ C1] ip_finish_output2+0x786/0x18e0 [10200.132473][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10200.132475][ C1] ? rcu_read_lock_held+0xe/0x50 [10200.132480][ C1] ? __ip_finish_output+0x10f/0x770 [10200.132484][ C1] ip_output+0x16b/0x4f0 [10200.132487][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10200.132491][ C1] ? __pfx_ip_output+0x10/0x10 [10200.132495][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10200.132502][ C1] ? __pfx_ip_output+0x10/0x10 [10200.132507][ C1] __ip_queue_xmit+0x672/0x1910 [10200.132512][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10200.132519][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10200.132523][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10200.132527][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10200.132531][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10200.132534][ C1] tcp_delack_timer+0x84/0x240 [10200.132538][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10200.132540][ C1] call_timer_fn+0x176/0x430 [10200.132545][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10200.132550][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10200.132554][ C1] __run_timers.part.0+0x52d/0x890 [10200.132557][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10200.132561][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10200.132566][ C1] ? __pfx___schedule+0x10/0x10 [10200.132570][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10200.132575][ C1] run_timer_softirq+0x72/0x100 [10200.132578][ C1] __do_softirq+0x1bc/0x7ff [10200.132582][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10200.132586][ C1] run_ksoftirqd+0x2e/0x60 [10200.132589][ C1] smpboot_thread_fn+0x30e/0x840 [10200.132594][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10200.132598][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10200.132601][ C1] kthread+0x292/0x360 [10200.132604][ C1] ? __pfx_kthread+0x10/0x10 [10200.132606][ C1] ret_from_fork+0x34/0x70 [10200.132609][ C1] ? __pfx_kthread+0x10/0x10 [10200.132611][ C1] ret_from_fork_asm+0x1b/0x30 [10200.132619][ C1] [10224.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8416s! [swapper/0:0] [10224.527926][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10224.529117][ C0] irq event stamp: 27567077 [10224.529358][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10224.529885][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10224.530366][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10224.530872][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10224.531368][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10224.531849][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10224.532490][ C0] RIP: 0010:kasan_check_range+0x10f/0x1c0 [10224.532794][ C0] Code: 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff 5b b8 01 00 00 00 5d 41 5c cc cc cc cc 41 bc 08 00 00 00 45 29 dc 49 8d 14 2c eb 0c 48 83 [10224.533806][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000246 [10224.534129][ C0] RAX: 0000000000000001 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10224.534546][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10224.534963][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10224.535379][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10224.535798][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10224.536217][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10224.536683][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10224.537040][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10224.537468][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10224.537886][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10224.538303][ C0] Call Trace: [10224.538480][ C0] [10224.538636][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10224.538913][ C0] ? __run_hrtimer+0x1c3/0x710 [10224.539168][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10224.539460][ C0] ? __hrtimer_run_queues+0x197/0x270 [10224.539742][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10224.540042][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10224.540319][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10224.540637][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10224.540912][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10224.541188][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10224.541516][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10224.541828][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10224.542156][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10224.542471][ C0] ? kasan_check_range+0x10f/0x1c0 [10224.542746][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [10224.543039][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10224.543363][ C0] ? get_stack_info+0x36/0xc0 [10224.543620][ C0] ? lock_acquire+0x1c1/0x220 [10224.543876][ C0] ? lock_release+0x1d5/0x250 [10224.544129][ C0] do_raw_spin_lock+0x1ec/0x270 [10224.544397][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10224.544686][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10224.544985][ C0] ? lock_acquire+0x1c1/0x220 [10224.545233][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10224.545484][ C0] _raw_spin_lock_nested+0x65/0x80 [10224.545758][ C0] tcp_v4_rcv+0x2159/0x29b0 [10224.546007][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10224.546271][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10224.546541][ C0] ? __inet_lookup_established+0x341/0x610 [10224.546860][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10224.547154][ C0] ip_local_deliver_finish+0x2ae/0x450 [10224.547448][ C0] ip_local_deliver+0x19d/0x480 [10224.547706][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10224.547995][ C0] ? rcu_read_lock_held+0xe/0x50 [10224.548259][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10224.548538][ C0] ? rcu_read_lock_held+0xe/0x50 [10224.548801][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10224.549135][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10224.549419][ C0] ip_rcv+0x564/0x740 [10224.549632][ C0] ? __pfx_ip_rcv+0x10/0x10 [10224.549875][ C0] ? set_track_prepare+0x8a/0xd0 [10224.550146][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10224.550432][ C0] ? rest_init+0x153/0x260 [10224.550672][ C0] ? skb_clone+0x10b/0x330 [10224.550911][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10224.551250][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10224.551570][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10224.551863][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10224.552171][ C0] ? __tcf_classify+0x32c/0x7d0 [10224.552427][ C0] ? __pfx_ip_rcv+0x10/0x10 [10224.552666][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10224.552981][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10224.553279][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10224.553620][ C0] ? lock_acquire+0x1c1/0x220 [10224.553871][ C0] ? netif_receive_skb_internal+0x84/0x300 [10224.554187][ C0] netif_receive_skb_internal+0xb0/0x300 [10224.554486][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10224.554819][ C0] ? __copy_skb_header+0xaf/0x490 [10224.555090][ C0] ? __skb_clone+0x57a/0x760 [10224.555337][ C0] netif_receive_skb+0x55/0x280 [10224.555594][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10224.555916][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10224.556264][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10224.556578][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10224.556872][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10224.557178][ C0] ? hlock_class+0x4e/0x130 [10224.557428][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10224.557763][ C0] ? place_entity+0x21/0x2f0 [10224.558014][ C0] ? resched_curr+0x219/0x280 [10224.558265][ C0] ? __pfx_resched_curr+0x10/0x10 [10224.558532][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10224.558812][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10224.559093][ C0] ? wakeup_preempt+0x161/0x2c0 [10224.559354][ C0] ? activate_task+0xf5/0x260 [10224.559607][ C0] ? trace_sched_wakeup+0xd2/0x100 [10224.559885][ C0] ? do_raw_spin_unlock+0x58/0x220 [10224.560156][ C0] ? _raw_spin_unlock+0x23/0x40 [10224.560418][ C0] ? get_stack_info_noinstr+0x18/0x110 [10224.560711][ C0] ? get_stack_info+0x36/0xc0 [10224.560963][ C0] ? stack_access_ok+0xda/0x1f0 [10224.561220][ C0] ? get_reg+0x119/0x190 [10224.561445][ C0] __tcf_classify+0x32c/0x7d0 [10224.561700][ C0] tcf_classify+0x283/0x930 [10224.561945][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10224.562278][ C0] ? __pfx_tcf_classify+0x10/0x10 [10224.562544][ C0] ? arch_stack_walk+0x8c/0x100 [10224.562805][ C0] ? get_stack_info_noinstr+0x18/0x110 [10224.563096][ C0] tc_run+0x2e4/0x5d0 [10224.563312][ C0] ? __pfx_tc_run+0x10/0x10 [10224.563556][ C0] ? lock_acquire+0x1c1/0x220 [10224.563808][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10224.564085][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10224.564351][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10224.564638][ C0] ? ip_finish_output2+0x786/0x18e0 [10224.564918][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10224.565238][ C0] ? neigh_hh_output+0x348/0x590 [10224.565502][ C0] ? ip_finish_output2+0x262/0x18e0 [10224.565782][ C0] ip_finish_output2+0x786/0x18e0 [10224.566054][ C0] ? stack_depot_save_flags+0x45/0x550 [10224.566349][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10224.566701][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10224.566996][ C0] ? rcu_read_lock_held+0xe/0x50 [10224.567262][ C0] ? __ip_finish_output+0x10f/0x770 [10224.567543][ C0] ip_output+0x16b/0x4f0 [10224.567769][ C0] ? __run_timers.part.0+0x52d/0x890 [10224.568050][ C0] ? __pfx_ip_output+0x10/0x10 [10224.568305][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10224.568603][ C0] ? rcu_read_lock_held+0xe/0x50 [10224.568869][ C0] ? ip_local_out+0x114/0x3b0 [10224.569120][ C0] __ip_queue_xmit+0x672/0x1910 [10224.569377][ C0] ? __skb_clone+0x57a/0x760 [10224.569621][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10224.569904][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10224.570201][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10224.570523][ C0] tcp_write_xmit+0xe42/0x24c0 [10224.570780][ C0] ? tcp_current_mss+0x40a/0x510 [10224.571045][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10224.571323][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10224.571602][ C0] ? mark_lock_irq+0x6e2/0xa10 [10224.571857][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10224.572124][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10224.572440][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10224.572718][ C0] ? ktime_get+0xb6/0x190 [10224.572952][ C0] tcp_send_loss_probe+0x4c9/0x830 [10224.573227][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10224.573506][ C0] tcp_write_timer+0x82/0x1d0 [10224.573764][ C0] call_timer_fn+0x176/0x430 [10224.574012][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10224.574290][ C0] ? next_expiry_recalc+0xcd/0x220 [10224.574565][ C0] __run_timers.part.0+0x52d/0x890 [10224.574835][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10224.575122][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10224.575418][ C0] ? lock_acquire+0x1c1/0x220 [10224.575668][ C0] ? clockevents_program_event+0xf6/0x300 [10224.575978][ C0] ? lock_release+0x1d5/0x250 [10224.576233][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10224.576513][ C0] ? ktime_get+0xb6/0x190 [10224.576752][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10224.577050][ C0] ? clockevents_program_event+0x1ed/0x300 [10224.577364][ C0] run_timer_softirq+0x72/0x100 [10224.577625][ C0] __do_softirq+0x1bc/0x7ff [10224.577867][ C0] irq_exit_rcu+0x98/0xc0 [10224.578097][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10224.578396][ C0] [10224.578556][ C0] [10224.578714][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10224.579039][ C0] RIP: 0010:default_idle+0xf/0x20 [10224.579312][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10224.580326][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10224.580649][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10224.581072][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10224.581495][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10224.581913][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10224.582332][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10224.582751][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10224.583054][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10224.583325][ C0] default_idle_call+0x69/0xa0 [10224.583579][ C0] cpuidle_idle_call+0x1f6/0x280 [10224.583845][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10224.584140][ C0] ? lock_release+0x1d5/0x250 [10224.584391][ C0] do_idle+0xfb/0x160 [10224.584602][ C0] cpu_startup_entry+0x55/0x60 [10224.584853][ C0] rest_init+0x153/0x260 [10224.585083][ C0] ? acpi_enable_subsystem+0xac/0x150 [10224.585370][ C0] arch_call_rest_init+0x13/0x40 [10224.585635][ C0] start_kernel+0x314/0x3d0 [10224.585879][ C0] x86_64_start_reservations+0x18/0x30 [10224.586173][ C0] x86_64_start_kernel+0xba/0x110 [10224.586439][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10224.586767][ C0] [10224.586935][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8416s! [ksoftirqd/1:22] [10224.587396][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10224.588593][ C1] irq event stamp: 3886976 [10224.588832][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10224.589328][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10224.589822][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10224.590318][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10224.590810][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10224.591302][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10224.591941][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10224.592279][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10224.593294][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10224.593615][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10224.594035][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10224.594453][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10224.594870][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10224.595288][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10224.595705][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10224.596174][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10224.596529][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10224.596959][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10224.597381][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10224.597799][ C1] Call Trace: [10224.597975][ C1] [10224.598132][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10224.598409][ C1] ? __run_hrtimer+0x1c3/0x710 [10224.598665][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10224.598958][ C1] ? __hrtimer_run_queues+0x197/0x270 [10224.599245][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10224.599544][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10224.599819][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10224.600141][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10224.600417][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10224.600737][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10224.601046][ C1] [10224.601206][ C1] [10224.601366][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10224.601696][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10224.601999][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10224.602308][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10224.602614][ C1] ? run_ksoftirqd+0xb/0x60 [10224.602864][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10224.603193][ C1] ? __orc_find+0x9c/0xf0 [10224.603423][ C1] ? lock_acquire+0x1c1/0x220 [10224.603673][ C1] ? irqentry_enter+0x2b/0x60 [10224.603922][ C1] do_raw_spin_lock+0x1ec/0x270 [10224.604180][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10224.604462][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10224.604761][ C1] ? lock_acquire+0x1c1/0x220 [10224.605016][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10224.605277][ C1] _raw_spin_lock_nested+0x65/0x80 [10224.605555][ C1] tcp_v4_rcv+0x2159/0x29b0 [10224.605800][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10224.606057][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10224.606327][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10224.606617][ C1] ip_local_deliver_finish+0x2ae/0x450 [10224.606915][ C1] ip_local_deliver+0x19d/0x480 [10224.607175][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10224.607457][ C1] ? rcu_read_lock_held+0xe/0x50 [10224.607719][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10224.607999][ C1] ? rcu_read_lock_held+0xe/0x50 [10224.608265][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10224.608602][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10224.608877][ C1] ip_rcv+0x564/0x740 [10224.609095][ C1] ? __pfx_ip_rcv+0x10/0x10 [10224.609340][ C1] ? set_track_prepare+0x8a/0xd0 [10224.609607][ C1] ? irqentry_enter+0x2b/0x60 [10224.609859][ C1] ? irqentry_enter+0x2b/0x60 [10224.610112][ C1] ? __pfx_ip_rcv+0x10/0x10 [10224.610352][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10224.610667][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10224.611006][ C1] ? netif_receive_skb_internal+0x84/0x300 [10224.611316][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10224.611658][ C1] netif_receive_skb_internal+0xb0/0x300 [10224.611958][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10224.612291][ C1] netif_receive_skb+0x55/0x280 [10224.612547][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10224.612872][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10224.613226][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10224.613542][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10224.613830][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10224.614133][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10224.614463][ C1] ? unwind_next_frame+0x1478/0x1d10 [10224.614745][ C1] ? arch_stack_walk+0x68/0x100 [10224.615008][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10224.615290][ C1] ? irqentry_enter+0x2b/0x60 [10224.615546][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10224.615871][ C1] ? irqentry_enter+0x2b/0x60 [10224.616120][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10224.616440][ C1] ? unwind_next_frame+0x1478/0x1d10 [10224.616731][ C1] ? arch_stack_walk+0x68/0x100 [10224.616995][ C1] __tcf_classify+0x32c/0x7d0 [10224.617253][ C1] tcf_classify+0x283/0x930 [10224.617506][ C1] ? __pfx_tcf_classify+0x10/0x10 [10224.617778][ C1] tc_run+0x2e4/0x5d0 [10224.617996][ C1] ? __pfx_tc_run+0x10/0x10 [10224.618246][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10224.618516][ C1] ? irqentry_enter+0x2b/0x60 [10224.618766][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10224.619052][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10224.619373][ C1] ip_finish_output2+0x786/0x18e0 [10224.619647][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10224.619940][ C1] ? rcu_read_lock_held+0xe/0x50 [10224.620206][ C1] ? __ip_finish_output+0x10f/0x770 [10224.620487][ C1] ip_output+0x16b/0x4f0 [10224.620716][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10224.621034][ C1] ? __pfx_ip_output+0x10/0x10 [10224.621293][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10224.621644][ C1] ? __pfx_ip_output+0x10/0x10 [10224.621901][ C1] __ip_queue_xmit+0x672/0x1910 [10224.622166][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10224.622451][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10224.622748][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10224.623037][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10224.623334][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10224.623623][ C1] tcp_delack_timer+0x84/0x240 [10224.623882][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10224.624167][ C1] call_timer_fn+0x176/0x430 [10224.624415][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10224.624694][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10224.624971][ C1] __run_timers.part.0+0x52d/0x890 [10224.625244][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10224.625534][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10224.625839][ C1] ? __pfx___schedule+0x10/0x10 [10224.626100][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10224.626421][ C1] run_timer_softirq+0x72/0x100 [10224.626683][ C1] __do_softirq+0x1bc/0x7ff [10224.626936][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10224.627210][ C1] run_ksoftirqd+0x2e/0x60 [10224.627451][ C1] smpboot_thread_fn+0x30e/0x840 [10224.627716][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10224.628008][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10224.628298][ C1] kthread+0x292/0x360 [10224.628521][ C1] ? __pfx_kthread+0x10/0x10 [10224.628768][ C1] ret_from_fork+0x34/0x70 [10224.629014][ C1] ? __pfx_kthread+0x10/0x10 [10224.629258][ C1] ret_from_fork_asm+0x1b/0x30 [10224.629519][ C1] [10252.527462][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8442s! [swapper/0:0] [10252.527924][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10252.529116][ C0] irq event stamp: 27567077 [10252.529355][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10252.529883][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10252.530365][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10252.530871][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10252.531370][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10252.531859][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10252.532506][ C0] RIP: 0010:__kasan_check_read+0x0/0x20 [10252.532802][ C0] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [10252.533823][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000202 [10252.534145][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10252.534563][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10252.534980][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10252.535397][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10252.535814][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10252.536232][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10252.536703][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10252.537052][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10252.537478][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10252.537895][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10252.538312][ C0] Call Trace: [10252.538489][ C0] [10252.538645][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10252.538923][ C0] ? __run_hrtimer+0x1c3/0x710 [10252.539179][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10252.539470][ C0] ? __hrtimer_run_queues+0x197/0x270 [10252.539754][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10252.540059][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10252.540336][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10252.540653][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10252.540929][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10252.541204][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10252.541530][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10252.541843][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10252.542172][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10252.542478][ C0] ? __pfx___kasan_check_read+0x10/0x10 [10252.542773][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [10252.543070][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10252.543398][ C0] ? get_stack_info+0x36/0xc0 [10252.543649][ C0] ? lock_acquire+0x1c1/0x220 [10252.543899][ C0] ? lock_release+0x1d5/0x250 [10252.544149][ C0] do_raw_spin_lock+0x1ec/0x270 [10252.544406][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10252.544687][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10252.544984][ C0] ? lock_acquire+0x1c1/0x220 [10252.545237][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10252.545494][ C0] _raw_spin_lock_nested+0x65/0x80 [10252.545768][ C0] tcp_v4_rcv+0x2159/0x29b0 [10252.546011][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10252.546267][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10252.546533][ C0] ? __inet_lookup_established+0x341/0x610 [10252.546851][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10252.547143][ C0] ip_local_deliver_finish+0x2ae/0x450 [10252.547430][ C0] ip_local_deliver+0x19d/0x480 [10252.547691][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10252.547977][ C0] ? rcu_read_lock_held+0xe/0x50 [10252.548247][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10252.548524][ C0] ? rcu_read_lock_held+0xe/0x50 [10252.548786][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10252.549135][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10252.549405][ C0] ip_rcv+0x564/0x740 [10252.549613][ C0] ? __pfx_ip_rcv+0x10/0x10 [10252.549864][ C0] ? set_track_prepare+0x8a/0xd0 [10252.550128][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10252.550417][ C0] ? rest_init+0x153/0x260 [10252.550653][ C0] ? skb_clone+0x10b/0x330 [10252.550893][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10252.551224][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10252.551539][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10252.551838][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10252.552151][ C0] ? __tcf_classify+0x32c/0x7d0 [10252.552413][ C0] ? __pfx_ip_rcv+0x10/0x10 [10252.552658][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10252.552973][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10252.553274][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10252.553612][ C0] ? lock_acquire+0x1c1/0x220 [10252.553861][ C0] ? netif_receive_skb_internal+0x84/0x300 [10252.554168][ C0] netif_receive_skb_internal+0xb0/0x300 [10252.554468][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10252.554803][ C0] ? __copy_skb_header+0xaf/0x490 [10252.555070][ C0] ? __skb_clone+0x57a/0x760 [10252.555314][ C0] netif_receive_skb+0x55/0x280 [10252.555573][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10252.555904][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10252.556256][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10252.556567][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10252.556860][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10252.557161][ C0] ? hlock_class+0x4e/0x130 [10252.557405][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10252.557731][ C0] ? place_entity+0x21/0x2f0 [10252.557974][ C0] ? resched_curr+0x219/0x280 [10252.558226][ C0] ? __pfx_resched_curr+0x10/0x10 [10252.558501][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10252.558787][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10252.559063][ C0] ? wakeup_preempt+0x161/0x2c0 [10252.559319][ C0] ? activate_task+0xf5/0x260 [10252.559570][ C0] ? trace_sched_wakeup+0xd2/0x100 [10252.559845][ C0] ? do_raw_spin_unlock+0x58/0x220 [10252.560120][ C0] ? _raw_spin_unlock+0x23/0x40 [10252.560379][ C0] ? get_stack_info_noinstr+0x18/0x110 [10252.560666][ C0] ? get_stack_info+0x36/0xc0 [10252.560919][ C0] ? stack_access_ok+0xda/0x1f0 [10252.561179][ C0] ? get_reg+0x119/0x190 [10252.561410][ C0] __tcf_classify+0x32c/0x7d0 [10252.561660][ C0] tcf_classify+0x283/0x930 [10252.561901][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10252.562231][ C0] ? __pfx_tcf_classify+0x10/0x10 [10252.562500][ C0] ? arch_stack_walk+0x8c/0x100 [10252.562764][ C0] ? get_stack_info_noinstr+0x18/0x110 [10252.563061][ C0] tc_run+0x2e4/0x5d0 [10252.563277][ C0] ? __pfx_tc_run+0x10/0x10 [10252.563520][ C0] ? lock_acquire+0x1c1/0x220 [10252.563769][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10252.564043][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10252.564312][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10252.564598][ C0] ? ip_finish_output2+0x786/0x18e0 [10252.564874][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10252.565191][ C0] ? neigh_hh_output+0x348/0x590 [10252.565457][ C0] ? ip_finish_output2+0x262/0x18e0 [10252.565732][ C0] ip_finish_output2+0x786/0x18e0 [10252.566001][ C0] ? stack_depot_save_flags+0x45/0x550 [10252.566295][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10252.566652][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10252.566947][ C0] ? rcu_read_lock_held+0xe/0x50 [10252.567215][ C0] ? __ip_finish_output+0x10f/0x770 [10252.567490][ C0] ip_output+0x16b/0x4f0 [10252.567715][ C0] ? __run_timers.part.0+0x52d/0x890 [10252.567998][ C0] ? __pfx_ip_output+0x10/0x10 [10252.568253][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10252.568553][ C0] ? rcu_read_lock_held+0xe/0x50 [10252.568814][ C0] ? ip_local_out+0x114/0x3b0 [10252.569070][ C0] __ip_queue_xmit+0x672/0x1910 [10252.569332][ C0] ? __skb_clone+0x57a/0x760 [10252.569580][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10252.569860][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10252.570158][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10252.570479][ C0] tcp_write_xmit+0xe42/0x24c0 [10252.570740][ C0] ? tcp_current_mss+0x40a/0x510 [10252.571002][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10252.571289][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10252.571569][ C0] ? mark_lock_irq+0x6e2/0xa10 [10252.571823][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10252.572094][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10252.572415][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10252.572691][ C0] ? ktime_get+0xb6/0x190 [10252.572921][ C0] tcp_send_loss_probe+0x4c9/0x830 [10252.573193][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10252.573475][ C0] tcp_write_timer+0x82/0x1d0 [10252.573726][ C0] call_timer_fn+0x176/0x430 [10252.573973][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10252.574249][ C0] ? next_expiry_recalc+0xcd/0x220 [10252.574520][ C0] __run_timers.part.0+0x52d/0x890 [10252.574794][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10252.575077][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10252.575378][ C0] ? lock_acquire+0x1c1/0x220 [10252.575627][ C0] ? clockevents_program_event+0xf6/0x300 [10252.575931][ C0] ? lock_release+0x1d5/0x250 [10252.576177][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10252.576450][ C0] ? ktime_get+0xb6/0x190 [10252.576686][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10252.576986][ C0] ? clockevents_program_event+0x1ed/0x300 [10252.577298][ C0] run_timer_softirq+0x72/0x100 [10252.577562][ C0] __do_softirq+0x1bc/0x7ff [10252.577808][ C0] irq_exit_rcu+0x98/0xc0 [10252.578042][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10252.578343][ C0] [10252.578498][ C0] [10252.578654][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10252.578970][ C0] RIP: 0010:default_idle+0xf/0x20 [10252.579242][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10252.580263][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10252.580587][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10252.581012][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10252.581430][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10252.581848][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10252.582271][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10252.582698][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10252.583001][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10252.583276][ C0] default_idle_call+0x69/0xa0 [10252.583529][ C0] cpuidle_idle_call+0x1f6/0x280 [10252.583792][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10252.584081][ C0] ? lock_release+0x1d5/0x250 [10252.584335][ C0] do_idle+0xfb/0x160 [10252.584553][ C0] cpu_startup_entry+0x55/0x60 [10252.584810][ C0] rest_init+0x153/0x260 [10252.585033][ C0] ? acpi_enable_subsystem+0xac/0x150 [10252.585325][ C0] arch_call_rest_init+0x13/0x40 [10252.585595][ C0] start_kernel+0x314/0x3d0 [10252.585837][ C0] x86_64_start_reservations+0x18/0x30 [10252.586131][ C0] x86_64_start_kernel+0xba/0x110 [10252.586399][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10252.586734][ C0] [10252.586901][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8442s! [ksoftirqd/1:22] [10252.587357][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10252.588544][ C1] irq event stamp: 3886976 [10252.588777][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10252.589273][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10252.589771][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10252.590271][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10252.590754][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10252.591248][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10252.591889][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10252.592232][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10252.593257][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10252.593581][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10252.594000][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10252.594423][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10252.594845][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10252.595264][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10252.595683][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10252.596157][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10252.596503][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10252.596928][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10252.597350][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10252.597773][ C1] Call Trace: [10252.597958][ C1] [10252.598114][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10252.598386][ C1] ? __run_hrtimer+0x1c3/0x710 [10252.598641][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10252.598930][ C1] ? __hrtimer_run_queues+0x197/0x270 [10252.599219][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10252.599525][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10252.599806][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10252.600129][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10252.600409][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10252.600729][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10252.601051][ C1] [10252.601207][ C1] [10252.601363][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10252.601691][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10252.601995][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10252.602307][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10252.602607][ C1] ? run_ksoftirqd+0xb/0x60 [10252.602849][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10252.603174][ C1] ? __orc_find+0x9c/0xf0 [10252.603406][ C1] ? lock_acquire+0x1c1/0x220 [10252.603660][ C1] ? irqentry_enter+0x2b/0x60 [10252.603916][ C1] do_raw_spin_lock+0x1ec/0x270 [10252.604179][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10252.604466][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10252.604764][ C1] ? lock_acquire+0x1c1/0x220 [10252.605010][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10252.605259][ C1] _raw_spin_lock_nested+0x65/0x80 [10252.605530][ C1] tcp_v4_rcv+0x2159/0x29b0 [10252.605780][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10252.606041][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10252.606312][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10252.606606][ C1] ip_local_deliver_finish+0x2ae/0x450 [10252.606894][ C1] ip_local_deliver+0x19d/0x480 [10252.607157][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10252.607444][ C1] ? rcu_read_lock_held+0xe/0x50 [10252.607711][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10252.607985][ C1] ? rcu_read_lock_held+0xe/0x50 [10252.608252][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10252.608580][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10252.608844][ C1] ip_rcv+0x564/0x740 [10252.609051][ C1] ? __pfx_ip_rcv+0x10/0x10 [10252.609285][ C1] ? set_track_prepare+0x8a/0xd0 [10252.609557][ C1] ? irqentry_enter+0x2b/0x60 [10252.609809][ C1] ? irqentry_enter+0x2b/0x60 [10252.610062][ C1] ? __pfx_ip_rcv+0x10/0x10 [10252.610305][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10252.610622][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10252.610967][ C1] ? netif_receive_skb_internal+0x84/0x300 [10252.611277][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10252.611617][ C1] netif_receive_skb_internal+0xb0/0x300 [10252.611914][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10252.612249][ C1] netif_receive_skb+0x55/0x280 [10252.612519][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10252.612859][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10252.613209][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10252.613521][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10252.613811][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10252.614118][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10252.614448][ C1] ? unwind_next_frame+0x1478/0x1d10 [10252.614731][ C1] ? arch_stack_walk+0x68/0x100 [10252.614989][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10252.615267][ C1] ? irqentry_enter+0x2b/0x60 [10252.615515][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10252.615834][ C1] ? irqentry_enter+0x2b/0x60 [10252.616088][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10252.616416][ C1] ? unwind_next_frame+0x1478/0x1d10 [10252.616699][ C1] ? arch_stack_walk+0x68/0x100 [10252.616957][ C1] __tcf_classify+0x32c/0x7d0 [10252.617210][ C1] tcf_classify+0x283/0x930 [10252.617452][ C1] ? __pfx_tcf_classify+0x10/0x10 [10252.617726][ C1] tc_run+0x2e4/0x5d0 [10252.617940][ C1] ? __pfx_tc_run+0x10/0x10 [10252.618186][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10252.618452][ C1] ? irqentry_enter+0x2b/0x60 [10252.618703][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10252.618989][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10252.619317][ C1] ip_finish_output2+0x786/0x18e0 [10252.619585][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10252.619874][ C1] ? rcu_read_lock_held+0xe/0x50 [10252.620143][ C1] ? __ip_finish_output+0x10f/0x770 [10252.620421][ C1] ip_output+0x16b/0x4f0 [10252.620649][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10252.620976][ C1] ? __pfx_ip_output+0x10/0x10 [10252.621234][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10252.621595][ C1] ? __pfx_ip_output+0x10/0x10 [10252.621859][ C1] __ip_queue_xmit+0x672/0x1910 [10252.622122][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10252.622401][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10252.622695][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10252.622980][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10252.623276][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10252.623558][ C1] tcp_delack_timer+0x84/0x240 [10252.623815][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10252.624103][ C1] call_timer_fn+0x176/0x430 [10252.624354][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10252.624628][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10252.624908][ C1] __run_timers.part.0+0x52d/0x890 [10252.625184][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10252.625470][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10252.625767][ C1] ? __pfx___schedule+0x10/0x10 [10252.626035][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10252.626355][ C1] run_timer_softirq+0x72/0x100 [10252.626618][ C1] __do_softirq+0x1bc/0x7ff [10252.626863][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10252.627141][ C1] run_ksoftirqd+0x2e/0x60 [10252.627380][ C1] smpboot_thread_fn+0x30e/0x840 [10252.627648][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10252.627937][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10252.628230][ C1] kthread+0x292/0x360 [10252.628447][ C1] ? __pfx_kthread+0x10/0x10 [10252.628695][ C1] ret_from_fork+0x34/0x70 [10252.628932][ C1] ? __pfx_kthread+0x10/0x10 [10252.629180][ C1] ret_from_fork_asm+0x1b/0x30 [10252.629440][ C1] [10278.136025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [10278.136422][ C1] rcu: 1-....: (9012637 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=2158600 [10278.137018][ C1] rcu: (t=9083827 jiffies g=1007429 q=31 ncpus=4) [10278.137366][ C1] Sending NMI from CPU 1 to CPUs 0: [10278.137652][ C0] NMI backtrace for cpu 0 [10278.137659][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10278.137664][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10278.137666][ C0] RIP: 0010:kasan_check_range+0x12/0x1c0 [10278.137678][ C0] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [10278.137681][ C0] RSP: 0018:ffffc900000069c8 EFLAGS: 00000202 [10278.137685][ C0] RAX: ffff88800a099b58 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10278.137687][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [10278.137689][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10278.137690][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10278.137692][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10278.137694][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10278.137696][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10278.137700][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10278.137702][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10278.137703][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10278.137705][ C0] Call Trace: [10278.137709][ C0] [10278.137714][ C0] ? nmi_cpu_backtrace+0x112/0x220 [10278.137720][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [10278.137726][ C0] ? nmi_handle+0x156/0x420 [10278.137731][ C0] ? default_do_nmi+0x41/0x100 [10278.137736][ C0] ? exc_nmi+0xf3/0x120 [10278.137739][ C0] ? end_repeat_nmi+0xf/0x60 [10278.137744][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10278.137750][ C0] ? kasan_check_range+0x12/0x1c0 [10278.137754][ C0] ? kasan_check_range+0x12/0x1c0 [10278.137758][ C0] ? kasan_check_range+0x12/0x1c0 [10278.137762][ C0] [10278.137763][ C0] [10278.137764][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [10278.137768][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10278.137772][ C0] ? get_stack_info+0x36/0xc0 [10278.137778][ C0] ? lock_acquire+0x1c1/0x220 [10278.137783][ C0] ? lock_release+0x1d5/0x250 [10278.137787][ C0] do_raw_spin_lock+0x1ec/0x270 [10278.137791][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10278.137794][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10278.137798][ C0] ? lock_acquire+0x1c1/0x220 [10278.137800][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10278.137806][ C0] _raw_spin_lock_nested+0x65/0x80 [10278.137810][ C0] tcp_v4_rcv+0x2159/0x29b0 [10278.137818][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10278.137820][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10278.137824][ C0] ? __inet_lookup_established+0x341/0x610 [10278.137831][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10278.137840][ C0] ip_local_deliver_finish+0x2ae/0x450 [10278.137844][ C0] ip_local_deliver+0x19d/0x480 [10278.137847][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10278.137850][ C0] ? rcu_read_lock_held+0xe/0x50 [10278.137856][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10278.137860][ C0] ? rcu_read_lock_held+0xe/0x50 [10278.137863][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10278.137866][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10278.137877][ C0] ip_rcv+0x564/0x740 [10278.137880][ C0] ? __pfx_ip_rcv+0x10/0x10 [10278.137883][ C0] ? set_track_prepare+0x8a/0xd0 [10278.137888][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10278.137891][ C0] ? rest_init+0x153/0x260 [10278.137894][ C0] ? skb_clone+0x10b/0x330 [10278.137900][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10278.137907][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10278.137912][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10278.137917][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10278.137927][ C0] ? __tcf_classify+0x32c/0x7d0 [10278.137931][ C0] ? __pfx_ip_rcv+0x10/0x10 [10278.137933][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10278.137938][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10278.137941][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10278.137944][ C0] ? lock_acquire+0x1c1/0x220 [10278.137947][ C0] ? netif_receive_skb_internal+0x84/0x300 [10278.137950][ C0] netif_receive_skb_internal+0xb0/0x300 [10278.137953][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10278.137956][ C0] ? __copy_skb_header+0xaf/0x490 [10278.137959][ C0] ? __skb_clone+0x57a/0x760 [10278.137962][ C0] netif_receive_skb+0x55/0x280 [10278.137964][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10278.137973][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10278.137980][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10278.137987][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10278.137992][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10278.138001][ C0] ? hlock_class+0x4e/0x130 [10278.138007][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10278.138017][ C0] ? place_entity+0x21/0x2f0 [10278.138022][ C0] ? resched_curr+0x219/0x280 [10278.138026][ C0] ? __pfx_resched_curr+0x10/0x10 [10278.138029][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10278.138033][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10278.138038][ C0] ? wakeup_preempt+0x161/0x2c0 [10278.138040][ C0] ? activate_task+0xf5/0x260 [10278.138043][ C0] ? trace_sched_wakeup+0xd2/0x100 [10278.138048][ C0] ? do_raw_spin_unlock+0x58/0x220 [10278.138052][ C0] ? _raw_spin_unlock+0x23/0x40 [10278.138055][ C0] ? get_stack_info_noinstr+0x18/0x110 [10278.138058][ C0] ? get_stack_info+0x36/0xc0 [10278.138062][ C0] ? stack_access_ok+0xda/0x1f0 [10278.138064][ C0] ? get_reg+0x119/0x190 [10278.138068][ C0] __tcf_classify+0x32c/0x7d0 [10278.138072][ C0] tcf_classify+0x283/0x930 [10278.138076][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10278.138081][ C0] ? __pfx_tcf_classify+0x10/0x10 [10278.138083][ C0] ? arch_stack_walk+0x8c/0x100 [10278.138087][ C0] ? get_stack_info_noinstr+0x18/0x110 [10278.138090][ C0] tc_run+0x2e4/0x5d0 [10278.138095][ C0] ? __pfx_tc_run+0x10/0x10 [10278.138098][ C0] ? lock_acquire+0x1c1/0x220 [10278.138100][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10278.138105][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10278.138111][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10278.138114][ C0] ? ip_finish_output2+0x786/0x18e0 [10278.138118][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10278.138124][ C0] ? neigh_hh_output+0x348/0x590 [10278.138128][ C0] ? ip_finish_output2+0x262/0x18e0 [10278.138132][ C0] ip_finish_output2+0x786/0x18e0 [10278.138136][ C0] ? stack_depot_save_flags+0x45/0x550 [10278.138142][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10278.138149][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10278.138153][ C0] ? rcu_read_lock_held+0xe/0x50 [10278.138157][ C0] ? __ip_finish_output+0x10f/0x770 [10278.138161][ C0] ip_output+0x16b/0x4f0 [10278.138164][ C0] ? __run_timers.part.0+0x52d/0x890 [10278.138170][ C0] ? __pfx_ip_output+0x10/0x10 [10278.138173][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10278.138178][ C0] ? rcu_read_lock_held+0xe/0x50 [10278.138181][ C0] ? ip_local_out+0x114/0x3b0 [10278.138185][ C0] __ip_queue_xmit+0x672/0x1910 [10278.138189][ C0] ? __skb_clone+0x57a/0x760 [10278.138193][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10278.138201][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10278.138206][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10278.138210][ C0] tcp_write_xmit+0xe42/0x24c0 [10278.138215][ C0] ? tcp_current_mss+0x40a/0x510 [10278.138218][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10278.138221][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10278.138224][ C0] ? mark_lock_irq+0x6e2/0xa10 [10278.138226][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10278.138229][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10278.138232][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10278.138238][ C0] ? ktime_get+0xb6/0x190 [10278.138242][ C0] tcp_send_loss_probe+0x4c9/0x830 [10278.138246][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10278.138249][ C0] tcp_write_timer+0x82/0x1d0 [10278.138253][ C0] call_timer_fn+0x176/0x430 [10278.138257][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10278.138261][ C0] ? next_expiry_recalc+0xcd/0x220 [10278.138266][ C0] __run_timers.part.0+0x52d/0x890 [10278.138269][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10278.138273][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10278.138276][ C0] ? lock_acquire+0x1c1/0x220 [10278.138279][ C0] ? clockevents_program_event+0xf6/0x300 [10278.138284][ C0] ? lock_release+0x1d5/0x250 [10278.138287][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10278.138290][ C0] ? ktime_get+0xb6/0x190 [10278.138292][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10278.138297][ C0] ? clockevents_program_event+0x1ed/0x300 [10278.138301][ C0] run_timer_softirq+0x72/0x100 [10278.138305][ C0] __do_softirq+0x1bc/0x7ff [10278.138310][ C0] irq_exit_rcu+0x98/0xc0 [10278.138313][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10278.138317][ C0] [10278.138318][ C0] [10278.138319][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10278.138325][ C0] RIP: 0010:default_idle+0xf/0x20 [10278.138329][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10278.138331][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10278.138334][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10278.138335][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10278.138337][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10278.138339][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10278.138340][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10278.138344][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10278.138348][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10278.138352][ C0] default_idle_call+0x69/0xa0 [10278.138354][ C0] cpuidle_idle_call+0x1f6/0x280 [10278.138356][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10278.138361][ C0] ? lock_release+0x1d5/0x250 [10278.138365][ C0] do_idle+0xfb/0x160 [10278.138368][ C0] cpu_startup_entry+0x55/0x60 [10278.138371][ C0] rest_init+0x153/0x260 [10278.138373][ C0] ? acpi_enable_subsystem+0xac/0x150 [10278.138379][ C0] arch_call_rest_init+0x13/0x40 [10278.138385][ C0] start_kernel+0x314/0x3d0 [10278.138389][ C0] x86_64_start_reservations+0x18/0x30 [10278.138394][ C0] x86_64_start_kernel+0xba/0x110 [10278.138398][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10278.138407][ C0] [10278.138648][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10278.192594][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10278.193241][ C1] RIP: 0010:kasan_check_range+0x10f/0x1c0 [10278.193549][ C1] Code: 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff 5b b8 01 00 00 00 5d 41 5c cc cc cc cc 41 bc 08 00 00 00 45 29 dc 49 8d 14 2c eb 0c 48 83 [10278.194581][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000246 [10278.194907][ C1] RAX: 0000000000000001 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10278.195328][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10278.195752][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10278.196176][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10278.196602][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10278.197019][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10278.197487][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10278.197839][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10278.198258][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10278.198678][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10278.199101][ C1] Call Trace: [10278.199289][ C1] [10278.199446][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10278.199731][ C1] ? print_cpu_stall+0x263/0x6a0 [10278.199998][ C1] ? check_cpu_stall+0x284/0x500 [10278.200259][ C1] ? rcu_pending+0x92/0x360 [10278.200503][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [10278.200786][ C1] ? update_process_times+0xb9/0x110 [10278.201071][ C1] ? tick_sched_handle+0x67/0x130 [10278.201341][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [10278.201641][ C1] ? __run_hrtimer+0x1c3/0x710 [10278.201895][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10278.202224][ C1] ? __hrtimer_run_queues+0x197/0x270 [10278.202510][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10278.202810][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10278.203085][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10278.203406][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10278.203683][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10278.204004][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10278.204311][ C1] [10278.204476][ C1] [10278.204637][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10278.204970][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10278.205273][ C1] ? kasan_check_range+0x10f/0x1c0 [10278.205543][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [10278.205841][ C1] ? run_ksoftirqd+0xb/0x60 [10278.206087][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10278.206416][ C1] ? __orc_find+0x9c/0xf0 [10278.206649][ C1] ? lock_acquire+0x1c1/0x220 [10278.206905][ C1] ? irqentry_enter+0x2b/0x60 [10278.207162][ C1] do_raw_spin_lock+0x1ec/0x270 [10278.207423][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10278.207710][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10278.208009][ C1] ? lock_acquire+0x1c1/0x220 [10278.208256][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10278.208503][ C1] _raw_spin_lock_nested+0x65/0x80 [10278.208773][ C1] tcp_v4_rcv+0x2159/0x29b0 [10278.209022][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10278.209283][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10278.209554][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10278.209844][ C1] ip_local_deliver_finish+0x2ae/0x450 [10278.210139][ C1] ip_local_deliver+0x19d/0x480 [10278.210396][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10278.210680][ C1] ? rcu_read_lock_held+0xe/0x50 [10278.210941][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10278.211221][ C1] ? rcu_read_lock_held+0xe/0x50 [10278.211485][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10278.211817][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10278.212097][ C1] ip_rcv+0x564/0x740 [10278.212310][ C1] ? __pfx_ip_rcv+0x10/0x10 [10278.212553][ C1] ? set_track_prepare+0x8a/0xd0 [10278.212817][ C1] ? irqentry_enter+0x2b/0x60 [10278.213065][ C1] ? irqentry_enter+0x2b/0x60 [10278.213311][ C1] ? __pfx_ip_rcv+0x10/0x10 [10278.213550][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10278.213864][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10278.214202][ C1] ? netif_receive_skb_internal+0x84/0x300 [10278.214507][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10278.214849][ C1] netif_receive_skb_internal+0xb0/0x300 [10278.215151][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10278.215481][ C1] netif_receive_skb+0x55/0x280 [10278.215737][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10278.216064][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10278.216408][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10278.216727][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10278.217017][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10278.217323][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10278.217653][ C1] ? unwind_next_frame+0x1478/0x1d10 [10278.217935][ C1] ? arch_stack_walk+0x68/0x100 [10278.218194][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10278.218467][ C1] ? irqentry_enter+0x2b/0x60 [10278.218714][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10278.219029][ C1] ? irqentry_enter+0x2b/0x60 [10278.219281][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10278.219605][ C1] ? unwind_next_frame+0x1478/0x1d10 [10278.219882][ C1] ? arch_stack_walk+0x68/0x100 [10278.220147][ C1] __tcf_classify+0x32c/0x7d0 [10278.220402][ C1] tcf_classify+0x283/0x930 [10278.220648][ C1] ? __pfx_tcf_classify+0x10/0x10 [10278.220918][ C1] tc_run+0x2e4/0x5d0 [10278.221133][ C1] ? __pfx_tc_run+0x10/0x10 [10278.221376][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10278.221642][ C1] ? irqentry_enter+0x2b/0x60 [10278.221888][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10278.222169][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10278.222488][ C1] ip_finish_output2+0x786/0x18e0 [10278.222758][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10278.223050][ C1] ? rcu_read_lock_held+0xe/0x50 [10278.223314][ C1] ? __ip_finish_output+0x10f/0x770 [10278.223593][ C1] ip_output+0x16b/0x4f0 [10278.223819][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10278.224136][ C1] ? __pfx_ip_output+0x10/0x10 [10278.224394][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10278.224746][ C1] ? __pfx_ip_output+0x10/0x10 [10278.225002][ C1] __ip_queue_xmit+0x672/0x1910 [10278.225267][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10278.225548][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10278.225850][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10278.226138][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10278.226433][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10278.226721][ C1] tcp_delack_timer+0x84/0x240 [10278.226973][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10278.227259][ C1] call_timer_fn+0x176/0x430 [10278.227510][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10278.227784][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10278.228063][ C1] __run_timers.part.0+0x52d/0x890 [10278.228336][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10278.228620][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10278.228917][ C1] ? __pfx___schedule+0x10/0x10 [10278.229182][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10278.229501][ C1] run_timer_softirq+0x72/0x100 [10278.229758][ C1] __do_softirq+0x1bc/0x7ff [10278.229997][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10278.230269][ C1] run_ksoftirqd+0x2e/0x60 [10278.230508][ C1] smpboot_thread_fn+0x30e/0x840 [10278.230772][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10278.231063][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10278.231349][ C1] kthread+0x292/0x360 [10278.231572][ C1] ? __pfx_kthread+0x10/0x10 [10278.231816][ C1] ret_from_fork+0x34/0x70 [10278.232057][ C1] ? __pfx_kthread+0x10/0x10 [10278.232299][ C1] ret_from_fork_asm+0x1b/0x30 [10278.232559][ C1] [10304.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8490s! [swapper/0:0] [10304.527928][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10304.529136][ C0] irq event stamp: 27567077 [10304.529380][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10304.529916][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10304.530390][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10304.530893][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10304.531387][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10304.531865][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10304.532511][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10304.532857][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10304.533885][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10304.534211][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10304.534635][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10304.535061][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10304.535481][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10304.535902][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10304.536328][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10304.536810][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10304.537168][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10304.537592][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10304.538017][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10304.538448][ C0] Call Trace: [10304.538629][ C0] [10304.538787][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10304.539064][ C0] ? __run_hrtimer+0x1c3/0x710 [10304.539324][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10304.539617][ C0] ? __hrtimer_run_queues+0x197/0x270 [10304.539908][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10304.540217][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10304.540501][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10304.540827][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10304.541100][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10304.541380][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10304.541709][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10304.542020][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10304.542356][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10304.542658][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10304.542968][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10304.543274][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10304.543604][ C0] ? get_stack_info+0x36/0xc0 [10304.543858][ C0] ? lock_acquire+0x1c1/0x220 [10304.544110][ C0] ? lock_release+0x1d5/0x250 [10304.544360][ C0] do_raw_spin_lock+0x1ec/0x270 [10304.544618][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10304.544900][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10304.545200][ C0] ? lock_acquire+0x1c1/0x220 [10304.545455][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10304.545714][ C0] _raw_spin_lock_nested+0x65/0x80 [10304.545989][ C0] tcp_v4_rcv+0x2159/0x29b0 [10304.546234][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10304.546497][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10304.546771][ C0] ? __inet_lookup_established+0x341/0x610 [10304.547085][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10304.547374][ C0] ip_local_deliver_finish+0x2ae/0x450 [10304.547662][ C0] ip_local_deliver+0x19d/0x480 [10304.547925][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10304.548214][ C0] ? rcu_read_lock_held+0xe/0x50 [10304.548484][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10304.548762][ C0] ? rcu_read_lock_held+0xe/0x50 [10304.549025][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10304.549365][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10304.549641][ C0] ip_rcv+0x564/0x740 [10304.549855][ C0] ? __pfx_ip_rcv+0x10/0x10 [10304.550098][ C0] ? set_track_prepare+0x8a/0xd0 [10304.550364][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10304.550654][ C0] ? rest_init+0x153/0x260 [10304.550895][ C0] ? skb_clone+0x10b/0x330 [10304.551137][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10304.551467][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10304.551784][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10304.552082][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10304.552395][ C0] ? __tcf_classify+0x32c/0x7d0 [10304.552659][ C0] ? __pfx_ip_rcv+0x10/0x10 [10304.552905][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10304.553222][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10304.553524][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10304.553863][ C0] ? lock_acquire+0x1c1/0x220 [10304.554113][ C0] ? netif_receive_skb_internal+0x84/0x300 [10304.554421][ C0] netif_receive_skb_internal+0xb0/0x300 [10304.554726][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10304.555058][ C0] ? __copy_skb_header+0xaf/0x490 [10304.555325][ C0] ? __skb_clone+0x57a/0x760 [10304.555569][ C0] netif_receive_skb+0x55/0x280 [10304.555829][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10304.556161][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10304.556514][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10304.556833][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10304.557121][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10304.557420][ C0] ? hlock_class+0x4e/0x130 [10304.557666][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10304.557991][ C0] ? place_entity+0x21/0x2f0 [10304.558240][ C0] ? resched_curr+0x219/0x280 [10304.558492][ C0] ? __pfx_resched_curr+0x10/0x10 [10304.558766][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10304.559052][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10304.559327][ C0] ? wakeup_preempt+0x161/0x2c0 [10304.559585][ C0] ? activate_task+0xf5/0x260 [10304.559835][ C0] ? trace_sched_wakeup+0xd2/0x100 [10304.560110][ C0] ? do_raw_spin_unlock+0x58/0x220 [10304.560385][ C0] ? _raw_spin_unlock+0x23/0x40 [10304.560643][ C0] ? get_stack_info_noinstr+0x18/0x110 [10304.560936][ C0] ? get_stack_info+0x36/0xc0 [10304.561184][ C0] ? stack_access_ok+0xda/0x1f0 [10304.561438][ C0] ? get_reg+0x119/0x190 [10304.561664][ C0] __tcf_classify+0x32c/0x7d0 [10304.561907][ C0] tcf_classify+0x283/0x930 [10304.562142][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10304.562462][ C0] ? __pfx_tcf_classify+0x10/0x10 [10304.562723][ C0] ? arch_stack_walk+0x8c/0x100 [10304.562979][ C0] ? get_stack_info_noinstr+0x18/0x110 [10304.563267][ C0] tc_run+0x2e4/0x5d0 [10304.563477][ C0] ? __pfx_tc_run+0x10/0x10 [10304.563714][ C0] ? lock_acquire+0x1c1/0x220 [10304.563955][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10304.564221][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10304.564483][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10304.564761][ C0] ? ip_finish_output2+0x786/0x18e0 [10304.565029][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10304.565338][ C0] ? neigh_hh_output+0x348/0x590 [10304.565617][ C0] ? ip_finish_output2+0x262/0x18e0 [10304.565892][ C0] ip_finish_output2+0x786/0x18e0 [10304.566159][ C0] ? stack_depot_save_flags+0x45/0x550 [10304.566455][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10304.566807][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10304.567098][ C0] ? rcu_read_lock_held+0xe/0x50 [10304.567366][ C0] ? __ip_finish_output+0x10f/0x770 [10304.567651][ C0] ip_output+0x16b/0x4f0 [10304.567888][ C0] ? __run_timers.part.0+0x52d/0x890 [10304.568174][ C0] ? __pfx_ip_output+0x10/0x10 [10304.568432][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10304.568733][ C0] ? rcu_read_lock_held+0xe/0x50 [10304.569007][ C0] ? ip_local_out+0x114/0x3b0 [10304.569257][ C0] __ip_queue_xmit+0x672/0x1910 [10304.569513][ C0] ? __skb_clone+0x57a/0x760 [10304.569755][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10304.570029][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10304.570315][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10304.570623][ C0] tcp_write_xmit+0xe42/0x24c0 [10304.570877][ C0] ? tcp_current_mss+0x40a/0x510 [10304.571133][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10304.571408][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10304.571676][ C0] ? mark_lock_irq+0x6e2/0xa10 [10304.571924][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10304.572186][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10304.572499][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10304.572768][ C0] ? ktime_get+0xb6/0x190 [10304.572992][ C0] tcp_send_loss_probe+0x4c9/0x830 [10304.573258][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10304.573533][ C0] tcp_write_timer+0x82/0x1d0 [10304.573777][ C0] call_timer_fn+0x176/0x430 [10304.574018][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10304.574286][ C0] ? next_expiry_recalc+0xcd/0x220 [10304.574551][ C0] __run_timers.part.0+0x52d/0x890 [10304.574817][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10304.575092][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10304.575385][ C0] ? lock_acquire+0x1c1/0x220 [10304.575628][ C0] ? clockevents_program_event+0xf6/0x300 [10304.575945][ C0] ? lock_release+0x1d5/0x250 [10304.576193][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10304.576472][ C0] ? ktime_get+0xb6/0x190 [10304.576706][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10304.577006][ C0] ? clockevents_program_event+0x1ed/0x300 [10304.577316][ C0] run_timer_softirq+0x72/0x100 [10304.577589][ C0] __do_softirq+0x1bc/0x7ff [10304.577830][ C0] irq_exit_rcu+0x98/0xc0 [10304.578058][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10304.578356][ C0] [10304.578508][ C0] [10304.578660][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10304.578967][ C0] RIP: 0010:default_idle+0xf/0x20 [10304.579233][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10304.580234][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10304.580548][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10304.580964][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10304.581379][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10304.581788][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10304.582202][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10304.582618][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10304.582914][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10304.583184][ C0] default_idle_call+0x69/0xa0 [10304.583430][ C0] cpuidle_idle_call+0x1f6/0x280 [10304.583687][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10304.583969][ C0] ? lock_release+0x1d5/0x250 [10304.584218][ C0] do_idle+0xfb/0x160 [10304.584432][ C0] cpu_startup_entry+0x55/0x60 [10304.584683][ C0] rest_init+0x153/0x260 [10304.584901][ C0] ? acpi_enable_subsystem+0xac/0x150 [10304.585187][ C0] arch_call_rest_init+0x13/0x40 [10304.585451][ C0] start_kernel+0x314/0x3d0 [10304.585687][ C0] x86_64_start_reservations+0x18/0x30 [10304.585992][ C0] x86_64_start_kernel+0xba/0x110 [10304.586263][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10304.586598][ C0] [10304.586762][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8490s! [ksoftirqd/1:22] [10304.587214][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10304.588380][ C1] irq event stamp: 3886976 [10304.588607][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10304.589093][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10304.589578][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10304.590089][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10304.590578][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10304.591080][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10304.591710][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10304.592045][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10304.593043][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10304.593360][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10304.593768][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10304.594180][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10304.594593][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10304.595001][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10304.595410][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10304.595870][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10304.596229][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10304.596656][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10304.597077][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10304.597499][ C1] Call Trace: [10304.597690][ C1] [10304.597841][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10304.598127][ C1] ? __run_hrtimer+0x1c3/0x710 [10304.598382][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10304.598671][ C1] ? __hrtimer_run_queues+0x197/0x270 [10304.598959][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10304.599273][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10304.599545][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10304.599857][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10304.600122][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10304.600441][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10304.600743][ C1] [10304.600899][ C1] [10304.601052][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10304.601373][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10304.601668][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10304.601972][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10304.602264][ C1] ? run_ksoftirqd+0xb/0x60 [10304.602500][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10304.602818][ C1] ? __orc_find+0x9c/0xf0 [10304.603044][ C1] ? lock_acquire+0x1c1/0x220 [10304.603292][ C1] ? irqentry_enter+0x2b/0x60 [10304.603542][ C1] do_raw_spin_lock+0x1ec/0x270 [10304.603796][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10304.604075][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10304.604366][ C1] ? lock_acquire+0x1c1/0x220 [10304.604606][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10304.604848][ C1] _raw_spin_lock_nested+0x65/0x80 [10304.605112][ C1] tcp_v4_rcv+0x2159/0x29b0 [10304.605355][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10304.605614][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10304.605878][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10304.606180][ C1] ip_local_deliver_finish+0x2ae/0x450 [10304.606479][ C1] ip_local_deliver+0x19d/0x480 [10304.606742][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10304.607030][ C1] ? rcu_read_lock_held+0xe/0x50 [10304.607296][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10304.607571][ C1] ? rcu_read_lock_held+0xe/0x50 [10304.607837][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10304.608166][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10304.608431][ C1] ip_rcv+0x564/0x740 [10304.608636][ C1] ? __pfx_ip_rcv+0x10/0x10 [10304.608868][ C1] ? set_track_prepare+0x8a/0xd0 [10304.609124][ C1] ? irqentry_enter+0x2b/0x60 [10304.609369][ C1] ? irqentry_enter+0x2b/0x60 [10304.609613][ C1] ? __pfx_ip_rcv+0x10/0x10 [10304.609850][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10304.610159][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10304.610492][ C1] ? netif_receive_skb_internal+0x84/0x300 [10304.610793][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10304.611121][ C1] netif_receive_skb_internal+0xb0/0x300 [10304.611410][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10304.611735][ C1] netif_receive_skb+0x55/0x280 [10304.611989][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10304.612313][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10304.612652][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10304.612956][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10304.613240][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10304.613540][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10304.613861][ C1] ? unwind_next_frame+0x1478/0x1d10 [10304.614137][ C1] ? arch_stack_walk+0x68/0x100 [10304.614387][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10304.614658][ C1] ? irqentry_enter+0x2b/0x60 [10304.614898][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10304.615222][ C1] ? irqentry_enter+0x2b/0x60 [10304.615476][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10304.615802][ C1] ? unwind_next_frame+0x1478/0x1d10 [10304.616082][ C1] ? arch_stack_walk+0x68/0x100 [10304.616354][ C1] __tcf_classify+0x32c/0x7d0 [10304.616607][ C1] tcf_classify+0x283/0x930 [10304.616852][ C1] ? __pfx_tcf_classify+0x10/0x10 [10304.617120][ C1] tc_run+0x2e4/0x5d0 [10304.617333][ C1] ? __pfx_tc_run+0x10/0x10 [10304.617585][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10304.617843][ C1] ? irqentry_enter+0x2b/0x60 [10304.618087][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10304.618366][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10304.618682][ C1] ip_finish_output2+0x786/0x18e0 [10304.618943][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10304.619225][ C1] ? rcu_read_lock_held+0xe/0x50 [10304.619485][ C1] ? __ip_finish_output+0x10f/0x770 [10304.619757][ C1] ip_output+0x16b/0x4f0 [10304.619997][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10304.620320][ C1] ? __pfx_ip_output+0x10/0x10 [10304.620574][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10304.620928][ C1] ? __pfx_ip_output+0x10/0x10 [10304.621194][ C1] __ip_queue_xmit+0x672/0x1910 [10304.621448][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10304.621720][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10304.622005][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10304.622284][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10304.622569][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10304.622843][ C1] tcp_delack_timer+0x84/0x240 [10304.623089][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10304.623367][ C1] call_timer_fn+0x176/0x430 [10304.623608][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10304.623875][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10304.624147][ C1] __run_timers.part.0+0x52d/0x890 [10304.624414][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10304.624690][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10304.624978][ C1] ? __pfx___schedule+0x10/0x10 [10304.625239][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10304.625549][ C1] run_timer_softirq+0x72/0x100 [10304.625800][ C1] __do_softirq+0x1bc/0x7ff [10304.626034][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10304.626298][ C1] run_ksoftirqd+0x2e/0x60 [10304.626559][ C1] smpboot_thread_fn+0x30e/0x840 [10304.626828][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10304.627122][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10304.627413][ C1] kthread+0x292/0x360 [10304.627641][ C1] ? __pfx_kthread+0x10/0x10 [10304.627885][ C1] ret_from_fork+0x34/0x70 [10304.628133][ C1] ? __pfx_kthread+0x10/0x10 [10304.628381][ C1] ret_from_fork_asm+0x1b/0x30 [10304.628639][ C1] [10332.527470][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8516s! [swapper/0:0] [10332.527931][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10332.529132][ C0] irq event stamp: 27567077 [10332.529373][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10332.529910][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10332.530384][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10332.530886][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10332.531377][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10332.531854][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10332.532519][ C0] RIP: 0010:kasan_check_range+0x1a/0x1c0 [10332.532824][ C0] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [10332.533838][ C0] RSP: 0018:ffffc900000069c0 EFLAGS: 00000286 [10332.534164][ C0] RAX: ffff88800a099b5c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10332.534582][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [10332.534998][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10332.535416][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10332.535833][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10332.536253][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10332.536722][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10332.537069][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10332.537490][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10332.537905][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10332.538322][ C0] Call Trace: [10332.538507][ C0] [10332.538667][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10332.538947][ C0] ? __run_hrtimer+0x1c3/0x710 [10332.539201][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10332.539497][ C0] ? __hrtimer_run_queues+0x197/0x270 [10332.539780][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10332.540081][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10332.540361][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10332.540679][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10332.540956][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10332.541234][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10332.541565][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10332.541880][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10332.542210][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10332.542518][ C0] ? kasan_check_range+0x1a/0x1c0 [10332.542789][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [10332.543091][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10332.543419][ C0] ? get_stack_info+0x36/0xc0 [10332.543673][ C0] ? lock_acquire+0x1c1/0x220 [10332.543925][ C0] ? lock_release+0x1d5/0x250 [10332.544176][ C0] do_raw_spin_lock+0x1ec/0x270 [10332.544435][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10332.544719][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10332.545016][ C0] ? lock_acquire+0x1c1/0x220 [10332.545266][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10332.545520][ C0] _raw_spin_lock_nested+0x65/0x80 [10332.545794][ C0] tcp_v4_rcv+0x2159/0x29b0 [10332.546040][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10332.546307][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10332.546579][ C0] ? __inet_lookup_established+0x341/0x610 [10332.546895][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10332.547187][ C0] ip_local_deliver_finish+0x2ae/0x450 [10332.547491][ C0] ip_local_deliver+0x19d/0x480 [10332.547746][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10332.548024][ C0] ? rcu_read_lock_held+0xe/0x50 [10332.548284][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10332.548551][ C0] ? rcu_read_lock_held+0xe/0x50 [10332.548823][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10332.549162][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10332.549436][ C0] ip_rcv+0x564/0x740 [10332.549647][ C0] ? __pfx_ip_rcv+0x10/0x10 [10332.549885][ C0] ? set_track_prepare+0x8a/0xd0 [10332.550148][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10332.550439][ C0] ? rest_init+0x153/0x260 [10332.550675][ C0] ? skb_clone+0x10b/0x330 [10332.550916][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10332.551249][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10332.551567][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10332.551867][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10332.552177][ C0] ? __tcf_classify+0x32c/0x7d0 [10332.552437][ C0] ? __pfx_ip_rcv+0x10/0x10 [10332.552681][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10332.553000][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10332.553301][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10332.553637][ C0] ? lock_acquire+0x1c1/0x220 [10332.553883][ C0] ? netif_receive_skb_internal+0x84/0x300 [10332.554191][ C0] netif_receive_skb_internal+0xb0/0x300 [10332.554489][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10332.554823][ C0] ? __copy_skb_header+0xaf/0x490 [10332.555090][ C0] ? __skb_clone+0x57a/0x760 [10332.555334][ C0] netif_receive_skb+0x55/0x280 [10332.555597][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10332.555951][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10332.556309][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10332.556622][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10332.556907][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10332.557203][ C0] ? hlock_class+0x4e/0x130 [10332.557445][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10332.557774][ C0] ? place_entity+0x21/0x2f0 [10332.558021][ C0] ? resched_curr+0x219/0x280 [10332.558277][ C0] ? __pfx_resched_curr+0x10/0x10 [10332.558547][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10332.558830][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10332.559105][ C0] ? wakeup_preempt+0x161/0x2c0 [10332.559362][ C0] ? activate_task+0xf5/0x260 [10332.559610][ C0] ? trace_sched_wakeup+0xd2/0x100 [10332.559884][ C0] ? do_raw_spin_unlock+0x58/0x220 [10332.560158][ C0] ? _raw_spin_unlock+0x23/0x40 [10332.560415][ C0] ? get_stack_info_noinstr+0x18/0x110 [10332.560705][ C0] ? get_stack_info+0x36/0xc0 [10332.560960][ C0] ? stack_access_ok+0xda/0x1f0 [10332.561222][ C0] ? get_reg+0x119/0x190 [10332.561450][ C0] __tcf_classify+0x32c/0x7d0 [10332.561701][ C0] tcf_classify+0x283/0x930 [10332.561940][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10332.562266][ C0] ? __pfx_tcf_classify+0x10/0x10 [10332.562540][ C0] ? arch_stack_walk+0x8c/0x100 [10332.562804][ C0] ? get_stack_info_noinstr+0x18/0x110 [10332.563096][ C0] tc_run+0x2e4/0x5d0 [10332.563310][ C0] ? __pfx_tc_run+0x10/0x10 [10332.563550][ C0] ? lock_acquire+0x1c1/0x220 [10332.563803][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10332.564069][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10332.564350][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10332.564632][ C0] ? ip_finish_output2+0x786/0x18e0 [10332.564906][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10332.565224][ C0] ? neigh_hh_output+0x348/0x590 [10332.565491][ C0] ? ip_finish_output2+0x262/0x18e0 [10332.565767][ C0] ip_finish_output2+0x786/0x18e0 [10332.566040][ C0] ? stack_depot_save_flags+0x45/0x550 [10332.566348][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10332.566699][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10332.566987][ C0] ? rcu_read_lock_held+0xe/0x50 [10332.567254][ C0] ? __ip_finish_output+0x10f/0x770 [10332.567539][ C0] ip_output+0x16b/0x4f0 [10332.567756][ C0] ? __run_timers.part.0+0x52d/0x890 [10332.568033][ C0] ? __pfx_ip_output+0x10/0x10 [10332.568278][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10332.568571][ C0] ? rcu_read_lock_held+0xe/0x50 [10332.568842][ C0] ? ip_local_out+0x114/0x3b0 [10332.569094][ C0] __ip_queue_xmit+0x672/0x1910 [10332.569355][ C0] ? __skb_clone+0x57a/0x760 [10332.569602][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10332.569881][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10332.570177][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10332.570515][ C0] tcp_write_xmit+0xe42/0x24c0 [10332.570788][ C0] ? tcp_current_mss+0x40a/0x510 [10332.571049][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10332.571332][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10332.571611][ C0] ? mark_lock_irq+0x6e2/0xa10 [10332.571854][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10332.572118][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10332.572428][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10332.572711][ C0] ? ktime_get+0xb6/0x190 [10332.572941][ C0] tcp_send_loss_probe+0x4c9/0x830 [10332.573216][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10332.573498][ C0] tcp_write_timer+0x82/0x1d0 [10332.573745][ C0] call_timer_fn+0x176/0x430 [10332.573996][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10332.574286][ C0] ? next_expiry_recalc+0xcd/0x220 [10332.574560][ C0] __run_timers.part.0+0x52d/0x890 [10332.574834][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10332.575122][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10332.575419][ C0] ? lock_acquire+0x1c1/0x220 [10332.575673][ C0] ? clockevents_program_event+0xf6/0x300 [10332.575968][ C0] ? lock_release+0x1d5/0x250 [10332.576217][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10332.576509][ C0] ? ktime_get+0xb6/0x190 [10332.576743][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10332.577047][ C0] ? clockevents_program_event+0x1ed/0x300 [10332.577355][ C0] run_timer_softirq+0x72/0x100 [10332.577619][ C0] __do_softirq+0x1bc/0x7ff [10332.577858][ C0] irq_exit_rcu+0x98/0xc0 [10332.578085][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10332.578377][ C0] [10332.578529][ C0] [10332.578683][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10332.578994][ C0] RIP: 0010:default_idle+0xf/0x20 [10332.579275][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10332.580279][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10332.580594][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10332.581021][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10332.581443][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10332.581865][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10332.582307][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10332.582728][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10332.583034][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10332.583308][ C0] default_idle_call+0x69/0xa0 [10332.583559][ C0] cpuidle_idle_call+0x1f6/0x280 [10332.583825][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10332.584118][ C0] ? lock_release+0x1d5/0x250 [10332.584370][ C0] do_idle+0xfb/0x160 [10332.584583][ C0] cpu_startup_entry+0x55/0x60 [10332.584837][ C0] rest_init+0x153/0x260 [10332.585063][ C0] ? acpi_enable_subsystem+0xac/0x150 [10332.585351][ C0] arch_call_rest_init+0x13/0x40 [10332.585618][ C0] start_kernel+0x314/0x3d0 [10332.585858][ C0] x86_64_start_reservations+0x18/0x30 [10332.586152][ C0] x86_64_start_kernel+0xba/0x110 [10332.586427][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10332.586752][ C0] [10332.586914][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8516s! [ksoftirqd/1:22] [10332.587370][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10332.588551][ C1] irq event stamp: 3886976 [10332.588784][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10332.589282][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10332.589776][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10332.590275][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10332.590760][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10332.591259][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10332.591900][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10332.592241][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10332.593260][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10332.593584][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10332.594003][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10332.594426][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10332.594849][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10332.595269][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10332.595688][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10332.596160][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10332.596515][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10332.596938][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10332.597361][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10332.597786][ C1] Call Trace: [10332.597970][ C1] [10332.598126][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10332.598398][ C1] ? __run_hrtimer+0x1c3/0x710 [10332.598654][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10332.598943][ C1] ? __hrtimer_run_queues+0x197/0x270 [10332.599233][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10332.599539][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10332.599820][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10332.600141][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10332.600414][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10332.600742][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10332.601054][ C1] [10332.601211][ C1] [10332.601368][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10332.601700][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10332.602004][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10332.602317][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10332.602617][ C1] ? run_ksoftirqd+0xb/0x60 [10332.602859][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10332.603187][ C1] ? __orc_find+0x9c/0xf0 [10332.603419][ C1] ? lock_acquire+0x1c1/0x220 [10332.603674][ C1] ? irqentry_enter+0x2b/0x60 [10332.603930][ C1] do_raw_spin_lock+0x1ec/0x270 [10332.604192][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10332.604478][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10332.604777][ C1] ? lock_acquire+0x1c1/0x220 [10332.605024][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10332.605274][ C1] _raw_spin_lock_nested+0x65/0x80 [10332.605545][ C1] tcp_v4_rcv+0x2159/0x29b0 [10332.605795][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10332.606058][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10332.606337][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10332.606621][ C1] ip_local_deliver_finish+0x2ae/0x450 [10332.606909][ C1] ip_local_deliver+0x19d/0x480 [10332.607173][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10332.607460][ C1] ? rcu_read_lock_held+0xe/0x50 [10332.607726][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10332.608002][ C1] ? rcu_read_lock_held+0xe/0x50 [10332.608269][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10332.608607][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10332.608879][ C1] ip_rcv+0x564/0x740 [10332.609092][ C1] ? __pfx_ip_rcv+0x10/0x10 [10332.609333][ C1] ? set_track_prepare+0x8a/0xd0 [10332.609595][ C1] ? irqentry_enter+0x2b/0x60 [10332.609847][ C1] ? irqentry_enter+0x2b/0x60 [10332.610099][ C1] ? __pfx_ip_rcv+0x10/0x10 [10332.610343][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10332.610660][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10332.611002][ C1] ? netif_receive_skb_internal+0x84/0x300 [10332.611313][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10332.611649][ C1] netif_receive_skb_internal+0xb0/0x300 [10332.611948][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10332.612288][ C1] netif_receive_skb+0x55/0x280 [10332.612549][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10332.612881][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10332.613235][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10332.613547][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10332.613837][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10332.614144][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10332.614474][ C1] ? unwind_next_frame+0x1478/0x1d10 [10332.614756][ C1] ? arch_stack_walk+0x68/0x100 [10332.615014][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10332.615289][ C1] ? irqentry_enter+0x2b/0x60 [10332.615536][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10332.615852][ C1] ? irqentry_enter+0x2b/0x60 [10332.616105][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10332.616437][ C1] ? unwind_next_frame+0x1478/0x1d10 [10332.616720][ C1] ? arch_stack_walk+0x68/0x100 [10332.616980][ C1] __tcf_classify+0x32c/0x7d0 [10332.617233][ C1] tcf_classify+0x283/0x930 [10332.617473][ C1] ? __pfx_tcf_classify+0x10/0x10 [10332.617740][ C1] tc_run+0x2e4/0x5d0 [10332.617953][ C1] ? __pfx_tc_run+0x10/0x10 [10332.618195][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10332.618461][ C1] ? irqentry_enter+0x2b/0x60 [10332.618712][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10332.618998][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10332.619324][ C1] ip_finish_output2+0x786/0x18e0 [10332.619591][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10332.619878][ C1] ? rcu_read_lock_held+0xe/0x50 [10332.620146][ C1] ? __ip_finish_output+0x10f/0x770 [10332.620423][ C1] ip_output+0x16b/0x4f0 [10332.620649][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10332.620970][ C1] ? __pfx_ip_output+0x10/0x10 [10332.621229][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10332.621584][ C1] ? __pfx_ip_output+0x10/0x10 [10332.621844][ C1] __ip_queue_xmit+0x672/0x1910 [10332.622105][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10332.622385][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10332.622680][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10332.622966][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10332.623261][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10332.623543][ C1] tcp_delack_timer+0x84/0x240 [10332.623800][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10332.624086][ C1] call_timer_fn+0x176/0x430 [10332.624335][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10332.624610][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10332.624890][ C1] __run_timers.part.0+0x52d/0x890 [10332.625166][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10332.625451][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10332.625750][ C1] ? __pfx___schedule+0x10/0x10 [10332.626015][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10332.626339][ C1] run_timer_softirq+0x72/0x100 [10332.626602][ C1] __do_softirq+0x1bc/0x7ff [10332.626847][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10332.627128][ C1] run_ksoftirqd+0x2e/0x60 [10332.627367][ C1] smpboot_thread_fn+0x30e/0x840 [10332.627636][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10332.627935][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10332.628241][ C1] kthread+0x292/0x360 [10332.628457][ C1] ? __pfx_kthread+0x10/0x10 [10332.628705][ C1] ret_from_fork+0x34/0x70 [10332.628940][ C1] ? __pfx_kthread+0x10/0x10 [10332.629189][ C1] ret_from_fork_asm+0x1b/0x30 [10332.629447][ C1] [10356.234024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [10356.234416][ C0] rcu: 0-....: (9101938 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=2176732 [10356.234934][ C0] rcu: (t=9161925 jiffies g=1007429 q=31 ncpus=4) [10356.235282][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10356.235769][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10356.236420][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10356.236769][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10356.237804][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10356.238136][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10356.238558][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10356.238984][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10356.239410][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10356.239835][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10356.240257][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10356.240731][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10356.241080][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10356.241502][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10356.241918][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10356.242335][ C0] Call Trace: [10356.242514][ C0] [10356.242670][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10356.242961][ C0] ? print_cpu_stall+0x263/0x6a0 [10356.243227][ C0] ? check_cpu_stall+0x284/0x500 [10356.243494][ C0] ? rcu_pending+0x92/0x360 [10356.243735][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [10356.244022][ C0] ? update_process_times+0xb9/0x110 [10356.244311][ C0] ? tick_sched_handle+0x67/0x130 [10356.244580][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [10356.244877][ C0] ? __run_hrtimer+0x1c3/0x710 [10356.245138][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10356.245466][ C0] ? __hrtimer_run_queues+0x197/0x270 [10356.245756][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10356.246064][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10356.246353][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10356.246674][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10356.246951][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10356.247230][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10356.247566][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10356.247888][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10356.248219][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10356.248528][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10356.248843][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10356.249146][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10356.249474][ C0] ? get_stack_info+0x36/0xc0 [10356.249734][ C0] ? lock_acquire+0x1c1/0x220 [10356.249993][ C0] ? lock_release+0x1d5/0x250 [10356.250251][ C0] do_raw_spin_lock+0x1ec/0x270 [10356.250515][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10356.250804][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10356.251105][ C0] ? lock_acquire+0x1c1/0x220 [10356.251353][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10356.251605][ C0] _raw_spin_lock_nested+0x65/0x80 [10356.251878][ C0] tcp_v4_rcv+0x2159/0x29b0 [10356.252131][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10356.252395][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10356.252667][ C0] ? __inet_lookup_established+0x341/0x610 [10356.252985][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10356.253278][ C0] ip_local_deliver_finish+0x2ae/0x450 [10356.253569][ C0] ip_local_deliver+0x19d/0x480 [10356.253835][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10356.254123][ C0] ? rcu_read_lock_held+0xe/0x50 [10356.254395][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10356.254671][ C0] ? rcu_read_lock_held+0xe/0x50 [10356.254935][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10356.255277][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10356.255552][ C0] ip_rcv+0x564/0x740 [10356.255766][ C0] ? __pfx_ip_rcv+0x10/0x10 [10356.256007][ C0] ? set_track_prepare+0x8a/0xd0 [10356.256278][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10356.256569][ C0] ? rest_init+0x153/0x260 [10356.256808][ C0] ? skb_clone+0x10b/0x330 [10356.257048][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10356.257392][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10356.257717][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10356.258013][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10356.258323][ C0] ? __tcf_classify+0x32c/0x7d0 [10356.258582][ C0] ? __pfx_ip_rcv+0x10/0x10 [10356.258822][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10356.259136][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10356.259434][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10356.259781][ C0] ? lock_acquire+0x1c1/0x220 [10356.260037][ C0] ? netif_receive_skb_internal+0x84/0x300 [10356.260350][ C0] netif_receive_skb_internal+0xb0/0x300 [10356.260648][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10356.260984][ C0] ? __copy_skb_header+0xaf/0x490 [10356.261257][ C0] ? __skb_clone+0x57a/0x760 [10356.261508][ C0] netif_receive_skb+0x55/0x280 [10356.261767][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10356.262097][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10356.262446][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10356.262767][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10356.263053][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10356.263353][ C0] ? hlock_class+0x4e/0x130 [10356.263601][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10356.263928][ C0] ? place_entity+0x21/0x2f0 [10356.264173][ C0] ? resched_curr+0x219/0x280 [10356.264432][ C0] ? __pfx_resched_curr+0x10/0x10 [10356.264703][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10356.264988][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10356.265266][ C0] ? wakeup_preempt+0x161/0x2c0 [10356.265522][ C0] ? activate_task+0xf5/0x260 [10356.265770][ C0] ? trace_sched_wakeup+0xd2/0x100 [10356.266046][ C0] ? do_raw_spin_unlock+0x58/0x220 [10356.266328][ C0] ? _raw_spin_unlock+0x23/0x40 [10356.266594][ C0] ? get_stack_info_noinstr+0x18/0x110 [10356.266889][ C0] ? get_stack_info+0x36/0xc0 [10356.267142][ C0] ? stack_access_ok+0xda/0x1f0 [10356.267401][ C0] ? get_reg+0x119/0x190 [10356.267634][ C0] __tcf_classify+0x32c/0x7d0 [10356.267892][ C0] tcf_classify+0x283/0x930 [10356.268139][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10356.268470][ C0] ? __pfx_tcf_classify+0x10/0x10 [10356.268735][ C0] ? arch_stack_walk+0x8c/0x100 [10356.268997][ C0] ? get_stack_info_noinstr+0x18/0x110 [10356.269285][ C0] tc_run+0x2e4/0x5d0 [10356.269505][ C0] ? __pfx_tc_run+0x10/0x10 [10356.269750][ C0] ? lock_acquire+0x1c1/0x220 [10356.270004][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10356.270283][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10356.270549][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10356.270835][ C0] ? ip_finish_output2+0x786/0x18e0 [10356.271117][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10356.271447][ C0] ? neigh_hh_output+0x348/0x590 [10356.271712][ C0] ? ip_finish_output2+0x262/0x18e0 [10356.271993][ C0] ip_finish_output2+0x786/0x18e0 [10356.272265][ C0] ? stack_depot_save_flags+0x45/0x550 [10356.272559][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10356.272910][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10356.273201][ C0] ? rcu_read_lock_held+0xe/0x50 [10356.273466][ C0] ? __ip_finish_output+0x10f/0x770 [10356.273743][ C0] ip_output+0x16b/0x4f0 [10356.273971][ C0] ? __run_timers.part.0+0x52d/0x890 [10356.274257][ C0] ? __pfx_ip_output+0x10/0x10 [10356.274513][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10356.274817][ C0] ? rcu_read_lock_held+0xe/0x50 [10356.275080][ C0] ? ip_local_out+0x114/0x3b0 [10356.275336][ C0] __ip_queue_xmit+0x672/0x1910 [10356.275603][ C0] ? __skb_clone+0x57a/0x760 [10356.275853][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10356.276139][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10356.276438][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10356.276760][ C0] tcp_write_xmit+0xe42/0x24c0 [10356.277015][ C0] ? tcp_current_mss+0x40a/0x510 [10356.277282][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10356.277564][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10356.277847][ C0] ? mark_lock_irq+0x6e2/0xa10 [10356.278103][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10356.278372][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10356.278689][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10356.278969][ C0] ? ktime_get+0xb6/0x190 [10356.279205][ C0] tcp_send_loss_probe+0x4c9/0x830 [10356.279481][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10356.279762][ C0] tcp_write_timer+0x82/0x1d0 [10356.280018][ C0] call_timer_fn+0x176/0x430 [10356.280269][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10356.280541][ C0] ? next_expiry_recalc+0xcd/0x220 [10356.280817][ C0] __run_timers.part.0+0x52d/0x890 [10356.281089][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10356.281378][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10356.281675][ C0] ? lock_acquire+0x1c1/0x220 [10356.281929][ C0] ? clockevents_program_event+0xf6/0x300 [10356.282241][ C0] ? lock_release+0x1d5/0x250 [10356.282494][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10356.282775][ C0] ? ktime_get+0xb6/0x190 [10356.283007][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10356.283310][ C0] ? clockevents_program_event+0x1ed/0x300 [10356.283619][ C0] run_timer_softirq+0x72/0x100 [10356.283881][ C0] __do_softirq+0x1bc/0x7ff [10356.284129][ C0] irq_exit_rcu+0x98/0xc0 [10356.284364][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10356.284665][ C0] [10356.284821][ C0] [10356.284977][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10356.285294][ C0] RIP: 0010:default_idle+0xf/0x20 [10356.285566][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10356.286596][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10356.286918][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10356.287343][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10356.287763][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10356.288182][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10356.288601][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10356.289022][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10356.289325][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10356.289599][ C0] default_idle_call+0x69/0xa0 [10356.289862][ C0] cpuidle_idle_call+0x1f6/0x280 [10356.290126][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10356.290421][ C0] ? lock_release+0x1d5/0x250 [10356.290672][ C0] do_idle+0xfb/0x160 [10356.290883][ C0] cpu_startup_entry+0x55/0x60 [10356.291137][ C0] rest_init+0x153/0x260 [10356.291368][ C0] ? acpi_enable_subsystem+0xac/0x150 [10356.291657][ C0] arch_call_rest_init+0x13/0x40 [10356.291921][ C0] start_kernel+0x314/0x3d0 [10356.292168][ C0] x86_64_start_reservations+0x18/0x30 [10356.292462][ C0] x86_64_start_kernel+0xba/0x110 [10356.292731][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10356.293059][ C0] [10356.293226][ C0] Sending NMI from CPU 0 to CPUs 1: [10356.293516][ C1] NMI backtrace for cpu 1 [10356.293523][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10356.293527][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10356.293529][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [10356.293535][ C1] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [10356.293538][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [10356.293541][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10356.293543][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10356.293545][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10356.293547][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10356.293549][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10356.293550][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10356.293552][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10356.293556][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10356.293558][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10356.293559][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10356.293561][ C1] Call Trace: [10356.293564][ C1] [10356.293566][ C1] ? nmi_cpu_backtrace+0x112/0x220 [10356.293572][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [10356.293577][ C1] ? nmi_handle+0x156/0x420 [10356.293581][ C1] ? default_do_nmi+0x41/0x100 [10356.293585][ C1] ? exc_nmi+0xf3/0x120 [10356.293588][ C1] ? end_repeat_nmi+0xf/0x60 [10356.293592][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10356.293597][ C1] ? __pfx___kasan_check_read+0x10/0x10 [10356.293600][ C1] ? __pfx___kasan_check_read+0x10/0x10 [10356.293603][ C1] ? __pfx___kasan_check_read+0x10/0x10 [10356.293606][ C1] [10356.293607][ C1] [10356.293608][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [10356.293611][ C1] ? run_ksoftirqd+0xb/0x60 [10356.293616][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10356.293619][ C1] ? __orc_find+0x9c/0xf0 [10356.293622][ C1] ? lock_acquire+0x1c1/0x220 [10356.293626][ C1] ? irqentry_enter+0x2b/0x60 [10356.293631][ C1] do_raw_spin_lock+0x1ec/0x270 [10356.293635][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10356.293638][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10356.293641][ C1] ? lock_acquire+0x1c1/0x220 [10356.293643][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10356.293648][ C1] _raw_spin_lock_nested+0x65/0x80 [10356.293651][ C1] tcp_v4_rcv+0x2159/0x29b0 [10356.293658][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10356.293661][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10356.293666][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10356.293672][ C1] ip_local_deliver_finish+0x2ae/0x450 [10356.293676][ C1] ip_local_deliver+0x19d/0x480 [10356.293679][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10356.293682][ C1] ? rcu_read_lock_held+0xe/0x50 [10356.293686][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10356.293690][ C1] ? rcu_read_lock_held+0xe/0x50 [10356.293693][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10356.293697][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10356.293706][ C1] ip_rcv+0x564/0x740 [10356.293709][ C1] ? __pfx_ip_rcv+0x10/0x10 [10356.293712][ C1] ? set_track_prepare+0x8a/0xd0 [10356.293716][ C1] ? irqentry_enter+0x2b/0x60 [10356.293719][ C1] ? irqentry_enter+0x2b/0x60 [10356.293723][ C1] ? __pfx_ip_rcv+0x10/0x10 [10356.293726][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10356.293729][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10356.293733][ C1] ? netif_receive_skb_internal+0x84/0x300 [10356.293736][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10356.293739][ C1] netif_receive_skb_internal+0xb0/0x300 [10356.293742][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10356.293747][ C1] netif_receive_skb+0x55/0x280 [10356.293750][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10356.293757][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10356.293764][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10356.293771][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10356.293776][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10356.293788][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10356.293797][ C1] ? unwind_next_frame+0x1478/0x1d10 [10356.293800][ C1] ? arch_stack_walk+0x68/0x100 [10356.293804][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10356.293808][ C1] ? irqentry_enter+0x2b/0x60 [10356.293811][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10356.293815][ C1] ? irqentry_enter+0x2b/0x60 [10356.293819][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10356.293826][ C1] ? unwind_next_frame+0x1478/0x1d10 [10356.293829][ C1] ? arch_stack_walk+0x68/0x100 [10356.293833][ C1] __tcf_classify+0x32c/0x7d0 [10356.293839][ C1] tcf_classify+0x283/0x930 [10356.293842][ C1] ? __pfx_tcf_classify+0x10/0x10 [10356.293846][ C1] tc_run+0x2e4/0x5d0 [10356.293850][ C1] ? __pfx_tc_run+0x10/0x10 [10356.293855][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10356.293861][ C1] ? irqentry_enter+0x2b/0x60 [10356.293864][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10356.293867][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10356.293874][ C1] ip_finish_output2+0x786/0x18e0 [10356.293879][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10356.293882][ C1] ? rcu_read_lock_held+0xe/0x50 [10356.293886][ C1] ? __ip_finish_output+0x10f/0x770 [10356.293890][ C1] ip_output+0x16b/0x4f0 [10356.293893][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10356.293897][ C1] ? __pfx_ip_output+0x10/0x10 [10356.293901][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10356.293909][ C1] ? __pfx_ip_output+0x10/0x10 [10356.293913][ C1] __ip_queue_xmit+0x672/0x1910 [10356.293919][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10356.293925][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10356.293930][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10356.293934][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10356.293938][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10356.293941][ C1] tcp_delack_timer+0x84/0x240 [10356.293945][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10356.293948][ C1] call_timer_fn+0x176/0x430 [10356.293952][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10356.293957][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10356.293961][ C1] __run_timers.part.0+0x52d/0x890 [10356.293964][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10356.293968][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10356.293973][ C1] ? __pfx___schedule+0x10/0x10 [10356.293977][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10356.293982][ C1] run_timer_softirq+0x72/0x100 [10356.293986][ C1] __do_softirq+0x1bc/0x7ff [10356.293990][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10356.293994][ C1] run_ksoftirqd+0x2e/0x60 [10356.293997][ C1] smpboot_thread_fn+0x30e/0x840 [10356.294002][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10356.294006][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10356.294009][ C1] kthread+0x292/0x360 [10356.294012][ C1] ? __pfx_kthread+0x10/0x10 [10356.294014][ C1] ret_from_fork+0x34/0x70 [10356.294018][ C1] ? __pfx_kthread+0x10/0x10 [10356.294021][ C1] ret_from_fork_asm+0x1b/0x30 [10356.294028][ C1] [10380.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8561s! [swapper/0:0] [10380.527927][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10380.529122][ C0] irq event stamp: 27567077 [10380.529360][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10380.529894][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10380.530374][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10380.530885][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10380.531389][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10380.531877][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10380.532521][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10380.532861][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10380.533880][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10380.534205][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10380.534628][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10380.535047][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10380.535468][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10380.535885][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10380.536312][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10380.536784][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10380.537133][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10380.537556][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10380.537974][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10380.538393][ C0] Call Trace: [10380.538574][ C0] [10380.538730][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10380.539011][ C0] ? __run_hrtimer+0x1c3/0x710 [10380.539265][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10380.539558][ C0] ? __hrtimer_run_queues+0x197/0x270 [10380.539841][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10380.540143][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10380.540423][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10380.540742][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10380.541019][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10380.541297][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10380.541630][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10380.541945][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10380.542276][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10380.542583][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10380.542896][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10380.543204][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10380.543532][ C0] ? get_stack_info+0x36/0xc0 [10380.543792][ C0] ? lock_acquire+0x1c1/0x220 [10380.544051][ C0] ? lock_release+0x1d5/0x250 [10380.544306][ C0] do_raw_spin_lock+0x1ec/0x270 [10380.544570][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10380.544858][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10380.545160][ C0] ? lock_acquire+0x1c1/0x220 [10380.545407][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10380.545658][ C0] _raw_spin_lock_nested+0x65/0x80 [10380.545930][ C0] tcp_v4_rcv+0x2159/0x29b0 [10380.546187][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10380.546445][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10380.546714][ C0] ? __inet_lookup_established+0x341/0x610 [10380.547026][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10380.547327][ C0] ip_local_deliver_finish+0x2ae/0x450 [10380.547622][ C0] ip_local_deliver+0x19d/0x480 [10380.547880][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10380.548164][ C0] ? rcu_read_lock_held+0xe/0x50 [10380.548429][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10380.548710][ C0] ? rcu_read_lock_held+0xe/0x50 [10380.548978][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10380.549322][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10380.549602][ C0] ip_rcv+0x564/0x740 [10380.549820][ C0] ? __pfx_ip_rcv+0x10/0x10 [10380.550067][ C0] ? set_track_prepare+0x8a/0xd0 [10380.550337][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10380.550628][ C0] ? rest_init+0x153/0x260 [10380.550868][ C0] ? skb_clone+0x10b/0x330 [10380.551114][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10380.551453][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10380.551779][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10380.552077][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10380.552385][ C0] ? __tcf_classify+0x32c/0x7d0 [10380.552643][ C0] ? __pfx_ip_rcv+0x10/0x10 [10380.552886][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10380.553201][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10380.553498][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10380.553841][ C0] ? lock_acquire+0x1c1/0x220 [10380.554097][ C0] ? netif_receive_skb_internal+0x84/0x300 [10380.554410][ C0] netif_receive_skb_internal+0xb0/0x300 [10380.554707][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10380.555042][ C0] ? __copy_skb_header+0xaf/0x490 [10380.555315][ C0] ? __skb_clone+0x57a/0x760 [10380.555565][ C0] netif_receive_skb+0x55/0x280 [10380.555823][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10380.556182][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10380.556544][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10380.556856][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10380.557147][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10380.557450][ C0] ? hlock_class+0x4e/0x130 [10380.557699][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10380.558034][ C0] ? place_entity+0x21/0x2f0 [10380.558284][ C0] ? resched_curr+0x219/0x280 [10380.558536][ C0] ? __pfx_resched_curr+0x10/0x10 [10380.558807][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10380.559088][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10380.559372][ C0] ? wakeup_preempt+0x161/0x2c0 [10380.559632][ C0] ? activate_task+0xf5/0x260 [10380.559888][ C0] ? trace_sched_wakeup+0xd2/0x100 [10380.560168][ C0] ? do_raw_spin_unlock+0x58/0x220 [10380.560440][ C0] ? _raw_spin_unlock+0x23/0x40 [10380.560705][ C0] ? get_stack_info_noinstr+0x18/0x110 [10380.560998][ C0] ? get_stack_info+0x36/0xc0 [10380.561253][ C0] ? stack_access_ok+0xda/0x1f0 [10380.561516][ C0] ? get_reg+0x119/0x190 [10380.561744][ C0] __tcf_classify+0x32c/0x7d0 [10380.562004][ C0] tcf_classify+0x283/0x930 [10380.562250][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10380.562579][ C0] ? __pfx_tcf_classify+0x10/0x10 [10380.562843][ C0] ? arch_stack_walk+0x8c/0x100 [10380.563105][ C0] ? get_stack_info_noinstr+0x18/0x110 [10380.563392][ C0] tc_run+0x2e4/0x5d0 [10380.563610][ C0] ? __pfx_tc_run+0x10/0x10 [10380.563855][ C0] ? lock_acquire+0x1c1/0x220 [10380.564106][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10380.564383][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10380.564648][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10380.564934][ C0] ? ip_finish_output2+0x786/0x18e0 [10380.565214][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10380.565538][ C0] ? neigh_hh_output+0x348/0x590 [10380.565801][ C0] ? ip_finish_output2+0x262/0x18e0 [10380.566086][ C0] ip_finish_output2+0x786/0x18e0 [10380.566354][ C0] ? stack_depot_save_flags+0x45/0x550 [10380.566643][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10380.567001][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10380.567294][ C0] ? rcu_read_lock_held+0xe/0x50 [10380.567556][ C0] ? __ip_finish_output+0x10f/0x770 [10380.567836][ C0] ip_output+0x16b/0x4f0 [10380.568066][ C0] ? __run_timers.part.0+0x52d/0x890 [10380.568349][ C0] ? __pfx_ip_output+0x10/0x10 [10380.568608][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10380.568907][ C0] ? rcu_read_lock_held+0xe/0x50 [10380.569173][ C0] ? ip_local_out+0x114/0x3b0 [10380.569421][ C0] __ip_queue_xmit+0x672/0x1910 [10380.569681][ C0] ? __skb_clone+0x57a/0x760 [10380.569927][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10380.570212][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10380.570510][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10380.570831][ C0] tcp_write_xmit+0xe42/0x24c0 [10380.571087][ C0] ? tcp_current_mss+0x40a/0x510 [10380.571353][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10380.571632][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10380.571912][ C0] ? mark_lock_irq+0x6e2/0xa10 [10380.572168][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10380.572434][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10380.572750][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10380.573037][ C0] ? ktime_get+0xb6/0x190 [10380.573272][ C0] tcp_send_loss_probe+0x4c9/0x830 [10380.573548][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10380.573828][ C0] tcp_write_timer+0x82/0x1d0 [10380.574084][ C0] call_timer_fn+0x176/0x430 [10380.574334][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10380.574606][ C0] ? next_expiry_recalc+0xcd/0x220 [10380.574882][ C0] __run_timers.part.0+0x52d/0x890 [10380.575155][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10380.575440][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10380.575736][ C0] ? lock_acquire+0x1c1/0x220 [10380.575992][ C0] ? clockevents_program_event+0xf6/0x300 [10380.576299][ C0] ? lock_release+0x1d5/0x250 [10380.576549][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10380.576824][ C0] ? ktime_get+0xb6/0x190 [10380.577055][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10380.577353][ C0] ? clockevents_program_event+0x1ed/0x300 [10380.577665][ C0] run_timer_softirq+0x72/0x100 [10380.577921][ C0] __do_softirq+0x1bc/0x7ff [10380.578163][ C0] irq_exit_rcu+0x98/0xc0 [10380.578393][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10380.578691][ C0] [10380.578851][ C0] [10380.579012][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10380.579336][ C0] RIP: 0010:default_idle+0xf/0x20 [10380.579604][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10380.580619][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10380.580939][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10380.581358][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10380.581776][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10380.582195][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10380.582610][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10380.583030][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10380.583331][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10380.583602][ C0] default_idle_call+0x69/0xa0 [10380.583860][ C0] cpuidle_idle_call+0x1f6/0x280 [10380.584124][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10380.584417][ C0] ? lock_release+0x1d5/0x250 [10380.584665][ C0] do_idle+0xfb/0x160 [10380.584876][ C0] cpu_startup_entry+0x55/0x60 [10380.585128][ C0] rest_init+0x153/0x260 [10380.585358][ C0] ? acpi_enable_subsystem+0xac/0x150 [10380.585644][ C0] arch_call_rest_init+0x13/0x40 [10380.585907][ C0] start_kernel+0x314/0x3d0 [10380.586162][ C0] x86_64_start_reservations+0x18/0x30 [10380.586451][ C0] x86_64_start_kernel+0xba/0x110 [10380.586724][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10380.587058][ C0] [10380.587226][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8561s! [ksoftirqd/1:22] [10380.587684][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10380.588873][ C1] irq event stamp: 3886976 [10380.589110][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10380.589609][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10380.590109][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10380.590612][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10380.591101][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10380.591597][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10380.592249][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10380.592592][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10380.593622][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10380.593946][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10380.594371][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10380.594799][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10380.595217][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10380.595636][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10380.596060][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10380.596528][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10380.596877][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10380.597298][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10380.597721][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10380.598147][ C1] Call Trace: [10380.598326][ C1] [10380.598483][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10380.598757][ C1] ? __run_hrtimer+0x1c3/0x710 [10380.599016][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10380.599309][ C1] ? __hrtimer_run_queues+0x197/0x270 [10380.599598][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10380.599902][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10380.600183][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10380.600507][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10380.600778][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10380.601106][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10380.601418][ C1] [10380.601575][ C1] [10380.601735][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10380.602062][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10380.602369][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10380.602679][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10380.602980][ C1] ? run_ksoftirqd+0xb/0x60 [10380.603225][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10380.603549][ C1] ? __orc_find+0x9c/0xf0 [10380.603782][ C1] ? lock_acquire+0x1c1/0x220 [10380.604037][ C1] ? irqentry_enter+0x2b/0x60 [10380.604300][ C1] do_raw_spin_lock+0x1ec/0x270 [10380.604563][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10380.604851][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10380.605154][ C1] ? lock_acquire+0x1c1/0x220 [10380.605404][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10380.605656][ C1] _raw_spin_lock_nested+0x65/0x80 [10380.605927][ C1] tcp_v4_rcv+0x2159/0x29b0 [10380.606183][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10380.606441][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10380.606713][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10380.607001][ C1] ip_local_deliver_finish+0x2ae/0x450 [10380.607294][ C1] ip_local_deliver+0x19d/0x480 [10380.607555][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10380.607842][ C1] ? rcu_read_lock_held+0xe/0x50 [10380.608109][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10380.608387][ C1] ? rcu_read_lock_held+0xe/0x50 [10380.608651][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10380.608990][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10380.609265][ C1] ip_rcv+0x564/0x740 [10380.609477][ C1] ? __pfx_ip_rcv+0x10/0x10 [10380.609717][ C1] ? set_track_prepare+0x8a/0xd0 [10380.609980][ C1] ? irqentry_enter+0x2b/0x60 [10380.610237][ C1] ? irqentry_enter+0x2b/0x60 [10380.610491][ C1] ? __pfx_ip_rcv+0x10/0x10 [10380.610737][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10380.611057][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10380.611398][ C1] ? netif_receive_skb_internal+0x84/0x300 [10380.611710][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10380.612047][ C1] netif_receive_skb_internal+0xb0/0x300 [10380.612345][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10380.612681][ C1] netif_receive_skb+0x55/0x280 [10380.612941][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10380.613273][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10380.613623][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10380.613935][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10380.614229][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10380.614534][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10380.614868][ C1] ? unwind_next_frame+0x1478/0x1d10 [10380.615154][ C1] ? arch_stack_walk+0x68/0x100 [10380.615413][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10380.615691][ C1] ? irqentry_enter+0x2b/0x60 [10380.615942][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10380.616273][ C1] ? irqentry_enter+0x2b/0x60 [10380.616522][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10380.616846][ C1] ? unwind_next_frame+0x1478/0x1d10 [10380.617135][ C1] ? arch_stack_walk+0x68/0x100 [10380.617394][ C1] __tcf_classify+0x32c/0x7d0 [10380.617651][ C1] tcf_classify+0x283/0x930 [10380.617894][ C1] ? __pfx_tcf_classify+0x10/0x10 [10380.618163][ C1] tc_run+0x2e4/0x5d0 [10380.618376][ C1] ? __pfx_tc_run+0x10/0x10 [10380.618618][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10380.618883][ C1] ? irqentry_enter+0x2b/0x60 [10380.619139][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10380.619428][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10380.619752][ C1] ip_finish_output2+0x786/0x18e0 [10380.620021][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10380.620312][ C1] ? rcu_read_lock_held+0xe/0x50 [10380.620578][ C1] ? __ip_finish_output+0x10f/0x770 [10380.620854][ C1] ip_output+0x16b/0x4f0 [10380.621080][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10380.621400][ C1] ? __pfx_ip_output+0x10/0x10 [10380.621654][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10380.622012][ C1] ? __pfx_ip_output+0x10/0x10 [10380.622273][ C1] __ip_queue_xmit+0x672/0x1910 [10380.622534][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10380.622816][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10380.623113][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10380.623397][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10380.623690][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10380.623973][ C1] tcp_delack_timer+0x84/0x240 [10380.624230][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10380.624518][ C1] call_timer_fn+0x176/0x430 [10380.624767][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10380.625044][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10380.625327][ C1] __run_timers.part.0+0x52d/0x890 [10380.625601][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10380.625886][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10380.626197][ C1] ? __pfx___schedule+0x10/0x10 [10380.626457][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10380.626776][ C1] run_timer_softirq+0x72/0x100 [10380.627042][ C1] __do_softirq+0x1bc/0x7ff [10380.627288][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10380.627565][ C1] run_ksoftirqd+0x2e/0x60 [10380.627803][ C1] smpboot_thread_fn+0x30e/0x840 [10380.628072][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10380.628361][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10380.628650][ C1] kthread+0x292/0x360 [10380.628870][ C1] ? __pfx_kthread+0x10/0x10 [10380.629121][ C1] ret_from_fork+0x34/0x70 [10380.629358][ C1] ? __pfx_kthread+0x10/0x10 [10380.629606][ C1] ret_from_fork_asm+0x1b/0x30 [10380.629861][ C1] [10408.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8587s! [swapper/0:0] [10408.527932][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10408.529137][ C0] irq event stamp: 27567077 [10408.529376][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10408.529903][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10408.530382][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10408.530895][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10408.531399][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10408.531880][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10408.532522][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [10408.532857][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [10408.533882][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10408.534209][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10408.534629][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10408.535054][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10408.535476][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10408.535899][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10408.536315][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10408.536782][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10408.537134][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10408.537553][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10408.537973][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10408.538402][ C0] Call Trace: [10408.538589][ C0] [10408.538746][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10408.539023][ C0] ? __run_hrtimer+0x1c3/0x710 [10408.539281][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10408.539570][ C0] ? __hrtimer_run_queues+0x197/0x270 [10408.539860][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10408.540167][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10408.540450][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10408.540776][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10408.541049][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10408.541330][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10408.541652][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10408.541963][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10408.542299][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10408.542602][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [10408.542904][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10408.543207][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10408.543534][ C0] ? get_stack_info+0x36/0xc0 [10408.543791][ C0] ? lock_acquire+0x1c1/0x220 [10408.544047][ C0] ? lock_release+0x1d5/0x250 [10408.544302][ C0] do_raw_spin_lock+0x1ec/0x270 [10408.544564][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10408.544852][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10408.545155][ C0] ? lock_acquire+0x1c1/0x220 [10408.545405][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10408.545659][ C0] _raw_spin_lock_nested+0x65/0x80 [10408.545936][ C0] tcp_v4_rcv+0x2159/0x29b0 [10408.546182][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10408.546442][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10408.546711][ C0] ? __inet_lookup_established+0x341/0x610 [10408.547025][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10408.547320][ C0] ip_local_deliver_finish+0x2ae/0x450 [10408.547612][ C0] ip_local_deliver+0x19d/0x480 [10408.547868][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10408.548151][ C0] ? rcu_read_lock_held+0xe/0x50 [10408.548417][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10408.548699][ C0] ? rcu_read_lock_held+0xe/0x50 [10408.548966][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10408.549303][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10408.549581][ C0] ip_rcv+0x564/0x740 [10408.549802][ C0] ? __pfx_ip_rcv+0x10/0x10 [10408.550048][ C0] ? set_track_prepare+0x8a/0xd0 [10408.550317][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10408.550606][ C0] ? rest_init+0x153/0x260 [10408.550846][ C0] ? skb_clone+0x10b/0x330 [10408.551085][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10408.551422][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10408.551746][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10408.552044][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10408.552352][ C0] ? __tcf_classify+0x32c/0x7d0 [10408.552611][ C0] ? __pfx_ip_rcv+0x10/0x10 [10408.552853][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10408.553168][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10408.553469][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10408.553814][ C0] ? lock_acquire+0x1c1/0x220 [10408.554070][ C0] ? netif_receive_skb_internal+0x84/0x300 [10408.554381][ C0] netif_receive_skb_internal+0xb0/0x300 [10408.554678][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10408.555013][ C0] ? __copy_skb_header+0xaf/0x490 [10408.555286][ C0] ? __skb_clone+0x57a/0x760 [10408.555535][ C0] netif_receive_skb+0x55/0x280 [10408.555793][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10408.556132][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10408.556481][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10408.556798][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10408.557086][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10408.557385][ C0] ? hlock_class+0x4e/0x130 [10408.557629][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10408.557956][ C0] ? place_entity+0x21/0x2f0 [10408.558202][ C0] ? resched_curr+0x219/0x280 [10408.558457][ C0] ? __pfx_resched_curr+0x10/0x10 [10408.558728][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10408.559013][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10408.559290][ C0] ? wakeup_preempt+0x161/0x2c0 [10408.559546][ C0] ? activate_task+0xf5/0x260 [10408.559794][ C0] ? trace_sched_wakeup+0xd2/0x100 [10408.560071][ C0] ? do_raw_spin_unlock+0x58/0x220 [10408.560353][ C0] ? _raw_spin_unlock+0x23/0x40 [10408.560613][ C0] ? get_stack_info_noinstr+0x18/0x110 [10408.560903][ C0] ? get_stack_info+0x36/0xc0 [10408.561158][ C0] ? stack_access_ok+0xda/0x1f0 [10408.561418][ C0] ? get_reg+0x119/0x190 [10408.561649][ C0] __tcf_classify+0x32c/0x7d0 [10408.561902][ C0] tcf_classify+0x283/0x930 [10408.562147][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10408.562475][ C0] ? __pfx_tcf_classify+0x10/0x10 [10408.562746][ C0] ? arch_stack_walk+0x8c/0x100 [10408.563009][ C0] ? get_stack_info_noinstr+0x18/0x110 [10408.563302][ C0] tc_run+0x2e4/0x5d0 [10408.563518][ C0] ? __pfx_tc_run+0x10/0x10 [10408.563759][ C0] ? lock_acquire+0x1c1/0x220 [10408.564005][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10408.564280][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10408.564547][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10408.564829][ C0] ? ip_finish_output2+0x786/0x18e0 [10408.565105][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10408.565427][ C0] ? neigh_hh_output+0x348/0x590 [10408.565693][ C0] ? ip_finish_output2+0x262/0x18e0 [10408.565977][ C0] ip_finish_output2+0x786/0x18e0 [10408.566249][ C0] ? stack_depot_save_flags+0x45/0x550 [10408.566543][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10408.566893][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10408.567184][ C0] ? rcu_read_lock_held+0xe/0x50 [10408.567449][ C0] ? __ip_finish_output+0x10f/0x770 [10408.567724][ C0] ip_output+0x16b/0x4f0 [10408.567951][ C0] ? __run_timers.part.0+0x52d/0x890 [10408.568238][ C0] ? __pfx_ip_output+0x10/0x10 [10408.568494][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10408.568796][ C0] ? rcu_read_lock_held+0xe/0x50 [10408.569058][ C0] ? ip_local_out+0x114/0x3b0 [10408.569313][ C0] __ip_queue_xmit+0x672/0x1910 [10408.569579][ C0] ? __skb_clone+0x57a/0x760 [10408.569829][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10408.570109][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10408.570403][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10408.570719][ C0] tcp_write_xmit+0xe42/0x24c0 [10408.570976][ C0] ? tcp_current_mss+0x40a/0x510 [10408.571240][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10408.571524][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10408.571799][ C0] ? mark_lock_irq+0x6e2/0xa10 [10408.572052][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10408.572324][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10408.572646][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10408.572920][ C0] ? ktime_get+0xb6/0x190 [10408.573151][ C0] tcp_send_loss_probe+0x4c9/0x830 [10408.573424][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10408.573707][ C0] tcp_write_timer+0x82/0x1d0 [10408.573959][ C0] call_timer_fn+0x176/0x430 [10408.574207][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10408.574488][ C0] ? next_expiry_recalc+0xcd/0x220 [10408.574761][ C0] __run_timers.part.0+0x52d/0x890 [10408.575036][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10408.575317][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10408.575619][ C0] ? lock_acquire+0x1c1/0x220 [10408.575874][ C0] ? clockevents_program_event+0xf6/0x300 [10408.576186][ C0] ? lock_release+0x1d5/0x250 [10408.576440][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10408.576721][ C0] ? ktime_get+0xb6/0x190 [10408.576954][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10408.577256][ C0] ? clockevents_program_event+0x1ed/0x300 [10408.577564][ C0] run_timer_softirq+0x72/0x100 [10408.577827][ C0] __do_softirq+0x1bc/0x7ff [10408.578076][ C0] irq_exit_rcu+0x98/0xc0 [10408.578311][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10408.578612][ C0] [10408.578767][ C0] [10408.578923][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10408.579242][ C0] RIP: 0010:default_idle+0xf/0x20 [10408.579512][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10408.580541][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10408.580871][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10408.581297][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10408.581722][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10408.582144][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10408.582564][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10408.582989][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10408.583297][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10408.583573][ C0] default_idle_call+0x69/0xa0 [10408.583828][ C0] cpuidle_idle_call+0x1f6/0x280 [10408.584094][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10408.584384][ C0] ? lock_release+0x1d5/0x250 [10408.584637][ C0] do_idle+0xfb/0x160 [10408.584854][ C0] cpu_startup_entry+0x55/0x60 [10408.585113][ C0] rest_init+0x153/0x260 [10408.585344][ C0] ? acpi_enable_subsystem+0xac/0x150 [10408.585636][ C0] arch_call_rest_init+0x13/0x40 [10408.585912][ C0] start_kernel+0x314/0x3d0 [10408.586160][ C0] x86_64_start_reservations+0x18/0x30 [10408.586454][ C0] x86_64_start_kernel+0xba/0x110 [10408.586720][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10408.587047][ C0] [10408.587213][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8587s! [ksoftirqd/1:22] [10408.587666][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10408.588861][ C1] irq event stamp: 3886976 [10408.589101][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10408.589595][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10408.590091][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10408.590585][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10408.591076][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10408.591565][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10408.592207][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [10408.592542][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [10408.593564][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10408.593888][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10408.594314][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10408.594733][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10408.595155][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10408.595577][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10408.596004][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10408.596474][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10408.596829][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10408.597252][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10408.597675][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10408.598096][ C1] Call Trace: [10408.598273][ C1] [10408.598431][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10408.598706][ C1] ? __run_hrtimer+0x1c3/0x710 [10408.598964][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10408.599258][ C1] ? __hrtimer_run_queues+0x197/0x270 [10408.599546][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10408.599851][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10408.600132][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10408.600456][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10408.600730][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10408.601057][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10408.601373][ C1] [10408.601529][ C1] [10408.601686][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10408.602014][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10408.602322][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [10408.602628][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10408.602934][ C1] ? run_ksoftirqd+0xb/0x60 [10408.603183][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10408.603513][ C1] ? __orc_find+0x9c/0xf0 [10408.603743][ C1] ? lock_acquire+0x1c1/0x220 [10408.603992][ C1] ? irqentry_enter+0x2b/0x60 [10408.604243][ C1] do_raw_spin_lock+0x1ec/0x270 [10408.604502][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10408.604787][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10408.605087][ C1] ? lock_acquire+0x1c1/0x220 [10408.605338][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10408.605592][ C1] _raw_spin_lock_nested+0x65/0x80 [10408.605872][ C1] tcp_v4_rcv+0x2159/0x29b0 [10408.606122][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10408.606383][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10408.606658][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10408.606948][ C1] ip_local_deliver_finish+0x2ae/0x450 [10408.607240][ C1] ip_local_deliver+0x19d/0x480 [10408.607497][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10408.607779][ C1] ? rcu_read_lock_held+0xe/0x50 [10408.608045][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10408.608326][ C1] ? rcu_read_lock_held+0xe/0x50 [10408.608593][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10408.608928][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10408.609205][ C1] ip_rcv+0x564/0x740 [10408.609426][ C1] ? __pfx_ip_rcv+0x10/0x10 [10408.609671][ C1] ? set_track_prepare+0x8a/0xd0 [10408.609938][ C1] ? irqentry_enter+0x2b/0x60 [10408.610190][ C1] ? irqentry_enter+0x2b/0x60 [10408.610442][ C1] ? __pfx_ip_rcv+0x10/0x10 [10408.610688][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10408.611001][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10408.611340][ C1] ? netif_receive_skb_internal+0x84/0x300 [10408.611648][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10408.611991][ C1] netif_receive_skb_internal+0xb0/0x300 [10408.612295][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10408.612624][ C1] netif_receive_skb+0x55/0x280 [10408.612883][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10408.613209][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10408.613556][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10408.613871][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10408.614158][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10408.614460][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10408.614787][ C1] ? unwind_next_frame+0x1478/0x1d10 [10408.615068][ C1] ? arch_stack_walk+0x68/0x100 [10408.615330][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10408.615608][ C1] ? irqentry_enter+0x2b/0x60 [10408.615868][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10408.616186][ C1] ? irqentry_enter+0x2b/0x60 [10408.616442][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10408.616771][ C1] ? unwind_next_frame+0x1478/0x1d10 [10408.617052][ C1] ? arch_stack_walk+0x68/0x100 [10408.617314][ C1] __tcf_classify+0x32c/0x7d0 [10408.617567][ C1] tcf_classify+0x283/0x930 [10408.617812][ C1] ? __pfx_tcf_classify+0x10/0x10 [10408.618085][ C1] tc_run+0x2e4/0x5d0 [10408.618306][ C1] ? __pfx_tc_run+0x10/0x10 [10408.618553][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10408.618824][ C1] ? irqentry_enter+0x2b/0x60 [10408.619077][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10408.619368][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10408.619689][ C1] ip_finish_output2+0x786/0x18e0 [10408.619963][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10408.620258][ C1] ? rcu_read_lock_held+0xe/0x50 [10408.620522][ C1] ? __ip_finish_output+0x10f/0x770 [10408.620803][ C1] ip_output+0x16b/0x4f0 [10408.621034][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10408.621353][ C1] ? __pfx_ip_output+0x10/0x10 [10408.621613][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10408.621965][ C1] ? __pfx_ip_output+0x10/0x10 [10408.622221][ C1] __ip_queue_xmit+0x672/0x1910 [10408.622484][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10408.622767][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10408.623065][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10408.623356][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10408.623656][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10408.623944][ C1] tcp_delack_timer+0x84/0x240 [10408.624204][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10408.624490][ C1] call_timer_fn+0x176/0x430 [10408.624739][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10408.625014][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10408.625293][ C1] __run_timers.part.0+0x52d/0x890 [10408.625570][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10408.625867][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10408.626168][ C1] ? __pfx___schedule+0x10/0x10 [10408.626430][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10408.626753][ C1] run_timer_softirq+0x72/0x100 [10408.627013][ C1] __do_softirq+0x1bc/0x7ff [10408.627256][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10408.627530][ C1] run_ksoftirqd+0x2e/0x60 [10408.627771][ C1] smpboot_thread_fn+0x30e/0x840 [10408.628036][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10408.628331][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10408.628621][ C1] kthread+0x292/0x360 [10408.628841][ C1] ? __pfx_kthread+0x10/0x10 [10408.629086][ C1] ret_from_fork+0x34/0x70 [10408.629328][ C1] ? __pfx_kthread+0x10/0x10 [10408.629572][ C1] ret_from_fork_asm+0x1b/0x30 [10408.629838][ C1] [10434.297026][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [10434.297415][ C1] rcu: 1-....: (9168299 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=2194448 [10434.298004][ C1] rcu: (t=9239988 jiffies g=1007429 q=31 ncpus=4) [10434.298349][ C1] Sending NMI from CPU 1 to CPUs 0: [10434.298639][ C0] NMI backtrace for cpu 0 [10434.298646][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10434.298650][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10434.298653][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10434.298663][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10434.298667][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10434.298671][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10434.298673][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10434.298675][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10434.298677][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10434.298679][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10434.298682][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10434.298684][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10434.298687][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10434.298690][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10434.298691][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10434.298693][ C0] Call Trace: [10434.298697][ C0] [10434.298701][ C0] ? nmi_cpu_backtrace+0x112/0x220 [10434.298708][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [10434.298714][ C0] ? nmi_handle+0x156/0x420 [10434.298720][ C0] ? default_do_nmi+0x41/0x100 [10434.298724][ C0] ? exc_nmi+0xf3/0x120 [10434.298727][ C0] ? end_repeat_nmi+0xf/0x60 [10434.298731][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10434.298735][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10434.298739][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10434.298743][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10434.298747][ C0] [10434.298748][ C0] [10434.298749][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10434.298752][ C0] ? get_stack_info+0x36/0xc0 [10434.298757][ C0] ? lock_acquire+0x1c1/0x220 [10434.298763][ C0] ? lock_release+0x1d5/0x250 [10434.298766][ C0] do_raw_spin_lock+0x1ec/0x270 [10434.298770][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10434.298773][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10434.298776][ C0] ? lock_acquire+0x1c1/0x220 [10434.298779][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10434.298785][ C0] _raw_spin_lock_nested+0x65/0x80 [10434.298789][ C0] tcp_v4_rcv+0x2159/0x29b0 [10434.298796][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10434.298798][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10434.298803][ C0] ? __inet_lookup_established+0x341/0x610 [10434.298809][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10434.298817][ C0] ip_local_deliver_finish+0x2ae/0x450 [10434.298821][ C0] ip_local_deliver+0x19d/0x480 [10434.298824][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10434.298826][ C0] ? rcu_read_lock_held+0xe/0x50 [10434.298833][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10434.298837][ C0] ? rcu_read_lock_held+0xe/0x50 [10434.298840][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10434.298843][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10434.298854][ C0] ip_rcv+0x564/0x740 [10434.298858][ C0] ? __pfx_ip_rcv+0x10/0x10 [10434.298861][ C0] ? set_track_prepare+0x8a/0xd0 [10434.298866][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10434.298868][ C0] ? rest_init+0x153/0x260 [10434.298871][ C0] ? skb_clone+0x10b/0x330 [10434.298877][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10434.298883][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10434.298889][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10434.298894][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10434.298903][ C0] ? __tcf_classify+0x32c/0x7d0 [10434.298906][ C0] ? __pfx_ip_rcv+0x10/0x10 [10434.298909][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10434.298914][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10434.298917][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10434.298921][ C0] ? lock_acquire+0x1c1/0x220 [10434.298923][ C0] ? netif_receive_skb_internal+0x84/0x300 [10434.298926][ C0] netif_receive_skb_internal+0xb0/0x300 [10434.298929][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10434.298933][ C0] ? __copy_skb_header+0xaf/0x490 [10434.298935][ C0] ? __skb_clone+0x57a/0x760 [10434.298938][ C0] netif_receive_skb+0x55/0x280 [10434.298941][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10434.298950][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10434.298956][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10434.298963][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10434.298968][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10434.298977][ C0] ? hlock_class+0x4e/0x130 [10434.298983][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10434.298993][ C0] ? place_entity+0x21/0x2f0 [10434.298996][ C0] ? resched_curr+0x219/0x280 [10434.298999][ C0] ? __pfx_resched_curr+0x10/0x10 [10434.299002][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10434.299006][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10434.299011][ C0] ? wakeup_preempt+0x161/0x2c0 [10434.299014][ C0] ? activate_task+0xf5/0x260 [10434.299017][ C0] ? trace_sched_wakeup+0xd2/0x100 [10434.299023][ C0] ? do_raw_spin_unlock+0x58/0x220 [10434.299027][ C0] ? _raw_spin_unlock+0x23/0x40 [10434.299030][ C0] ? get_stack_info_noinstr+0x18/0x110 [10434.299033][ C0] ? get_stack_info+0x36/0xc0 [10434.299037][ C0] ? stack_access_ok+0xda/0x1f0 [10434.299039][ C0] ? get_reg+0x119/0x190 [10434.299043][ C0] __tcf_classify+0x32c/0x7d0 [10434.299047][ C0] tcf_classify+0x283/0x930 [10434.299051][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10434.299056][ C0] ? __pfx_tcf_classify+0x10/0x10 [10434.299058][ C0] ? arch_stack_walk+0x8c/0x100 [10434.299062][ C0] ? get_stack_info_noinstr+0x18/0x110 [10434.299066][ C0] tc_run+0x2e4/0x5d0 [10434.299070][ C0] ? __pfx_tc_run+0x10/0x10 [10434.299073][ C0] ? lock_acquire+0x1c1/0x220 [10434.299076][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10434.299081][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10434.299087][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10434.299090][ C0] ? ip_finish_output2+0x786/0x18e0 [10434.299093][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10434.299099][ C0] ? neigh_hh_output+0x348/0x590 [10434.299103][ C0] ? ip_finish_output2+0x262/0x18e0 [10434.299107][ C0] ip_finish_output2+0x786/0x18e0 [10434.299111][ C0] ? stack_depot_save_flags+0x45/0x550 [10434.299117][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10434.299124][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10434.299128][ C0] ? rcu_read_lock_held+0xe/0x50 [10434.299132][ C0] ? __ip_finish_output+0x10f/0x770 [10434.299136][ C0] ip_output+0x16b/0x4f0 [10434.299139][ C0] ? __run_timers.part.0+0x52d/0x890 [10434.299145][ C0] ? __pfx_ip_output+0x10/0x10 [10434.299148][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10434.299153][ C0] ? rcu_read_lock_held+0xe/0x50 [10434.299156][ C0] ? ip_local_out+0x114/0x3b0 [10434.299160][ C0] __ip_queue_xmit+0x672/0x1910 [10434.299165][ C0] ? __skb_clone+0x57a/0x760 [10434.299168][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10434.299176][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10434.299180][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10434.299184][ C0] tcp_write_xmit+0xe42/0x24c0 [10434.299190][ C0] ? tcp_current_mss+0x40a/0x510 [10434.299193][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10434.299195][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10434.299198][ C0] ? mark_lock_irq+0x6e2/0xa10 [10434.299200][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10434.299203][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10434.299207][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10434.299212][ C0] ? ktime_get+0xb6/0x190 [10434.299216][ C0] tcp_send_loss_probe+0x4c9/0x830 [10434.299220][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10434.299223][ C0] tcp_write_timer+0x82/0x1d0 [10434.299227][ C0] call_timer_fn+0x176/0x430 [10434.299231][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10434.299235][ C0] ? next_expiry_recalc+0xcd/0x220 [10434.299239][ C0] __run_timers.part.0+0x52d/0x890 [10434.299243][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10434.299248][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10434.299251][ C0] ? lock_acquire+0x1c1/0x220 [10434.299254][ C0] ? clockevents_program_event+0xf6/0x300 [10434.299259][ C0] ? lock_release+0x1d5/0x250 [10434.299261][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10434.299264][ C0] ? ktime_get+0xb6/0x190 [10434.299267][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10434.299271][ C0] ? clockevents_program_event+0x1ed/0x300 [10434.299275][ C0] run_timer_softirq+0x72/0x100 [10434.299279][ C0] __do_softirq+0x1bc/0x7ff [10434.299283][ C0] irq_exit_rcu+0x98/0xc0 [10434.299286][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10434.299291][ C0] [10434.299292][ C0] [10434.299293][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10434.299299][ C0] RIP: 0010:default_idle+0xf/0x20 [10434.299303][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10434.299305][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10434.299307][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10434.299308][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10434.299310][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10434.299311][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10434.299313][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10434.299317][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10434.299320][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10434.299324][ C0] default_idle_call+0x69/0xa0 [10434.299326][ C0] cpuidle_idle_call+0x1f6/0x280 [10434.299329][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10434.299334][ C0] ? lock_release+0x1d5/0x250 [10434.299338][ C0] do_idle+0xfb/0x160 [10434.299341][ C0] cpu_startup_entry+0x55/0x60 [10434.299343][ C0] rest_init+0x153/0x260 [10434.299346][ C0] ? acpi_enable_subsystem+0xac/0x150 [10434.299352][ C0] arch_call_rest_init+0x13/0x40 [10434.299358][ C0] start_kernel+0x314/0x3d0 [10434.299361][ C0] x86_64_start_reservations+0x18/0x30 [10434.299367][ C0] x86_64_start_kernel+0xba/0x110 [10434.299371][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10434.299379][ C0] [10434.299634][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10434.353447][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10434.354089][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10434.354430][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10434.355444][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10434.355773][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10434.356195][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10434.356616][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10434.357041][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10434.357467][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10434.357889][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10434.358361][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10434.358708][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10434.359131][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10434.359547][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10434.359964][ C1] Call Trace: [10434.360147][ C1] [10434.360301][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10434.360589][ C1] ? print_cpu_stall+0x263/0x6a0 [10434.360852][ C1] ? check_cpu_stall+0x284/0x500 [10434.361118][ C1] ? rcu_pending+0x92/0x360 [10434.361358][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [10434.361640][ C1] ? update_process_times+0xb9/0x110 [10434.361925][ C1] ? tick_sched_handle+0x67/0x130 [10434.362193][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [10434.362488][ C1] ? __run_hrtimer+0x1c3/0x710 [10434.362745][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10434.363070][ C1] ? __hrtimer_run_queues+0x197/0x270 [10434.363359][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10434.363667][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10434.363946][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10434.364265][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10434.364537][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10434.364864][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10434.365174][ C1] [10434.365330][ C1] [10434.365487][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10434.365820][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10434.366122][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10434.366430][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10434.366733][ C1] ? run_ksoftirqd+0xb/0x60 [10434.366977][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10434.367308][ C1] ? __orc_find+0x9c/0xf0 [10434.367536][ C1] ? lock_acquire+0x1c1/0x220 [10434.367787][ C1] ? irqentry_enter+0x2b/0x60 [10434.368038][ C1] do_raw_spin_lock+0x1ec/0x270 [10434.368297][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10434.368582][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10434.368882][ C1] ? lock_acquire+0x1c1/0x220 [10434.369133][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10434.369387][ C1] _raw_spin_lock_nested+0x65/0x80 [10434.369661][ C1] tcp_v4_rcv+0x2159/0x29b0 [10434.369907][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10434.370166][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10434.370433][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10434.370718][ C1] ip_local_deliver_finish+0x2ae/0x450 [10434.371007][ C1] ip_local_deliver+0x19d/0x480 [10434.371271][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10434.371559][ C1] ? rcu_read_lock_held+0xe/0x50 [10434.371824][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10434.372100][ C1] ? rcu_read_lock_held+0xe/0x50 [10434.372361][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10434.372699][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10434.372972][ C1] ip_rcv+0x564/0x740 [10434.373185][ C1] ? __pfx_ip_rcv+0x10/0x10 [10434.373425][ C1] ? set_track_prepare+0x8a/0xd0 [10434.373687][ C1] ? irqentry_enter+0x2b/0x60 [10434.373939][ C1] ? irqentry_enter+0x2b/0x60 [10434.374191][ C1] ? __pfx_ip_rcv+0x10/0x10 [10434.374436][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10434.374753][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10434.375097][ C1] ? netif_receive_skb_internal+0x84/0x300 [10434.375406][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10434.375748][ C1] netif_receive_skb_internal+0xb0/0x300 [10434.376050][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10434.376381][ C1] netif_receive_skb+0x55/0x280 [10434.376639][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10434.376965][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10434.377311][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10434.377626][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10434.377911][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10434.378217][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10434.378542][ C1] ? unwind_next_frame+0x1478/0x1d10 [10434.378820][ C1] ? arch_stack_walk+0x68/0x100 [10434.379082][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10434.379361][ C1] ? irqentry_enter+0x2b/0x60 [10434.379612][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10434.379934][ C1] ? irqentry_enter+0x2b/0x60 [10434.380184][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10434.380505][ C1] ? unwind_next_frame+0x1478/0x1d10 [10434.380791][ C1] ? arch_stack_walk+0x68/0x100 [10434.381050][ C1] __tcf_classify+0x32c/0x7d0 [10434.381302][ C1] tcf_classify+0x283/0x930 [10434.381542][ C1] ? __pfx_tcf_classify+0x10/0x10 [10434.381810][ C1] tc_run+0x2e4/0x5d0 [10434.382023][ C1] ? __pfx_tc_run+0x10/0x10 [10434.382264][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10434.382528][ C1] ? irqentry_enter+0x2b/0x60 [10434.382780][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10434.383067][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10434.383393][ C1] ip_finish_output2+0x786/0x18e0 [10434.383661][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10434.383947][ C1] ? rcu_read_lock_held+0xe/0x50 [10434.384216][ C1] ? __ip_finish_output+0x10f/0x770 [10434.384492][ C1] ip_output+0x16b/0x4f0 [10434.384718][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10434.385040][ C1] ? __pfx_ip_output+0x10/0x10 [10434.385296][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10434.385651][ C1] ? __pfx_ip_output+0x10/0x10 [10434.385914][ C1] __ip_queue_xmit+0x672/0x1910 [10434.386181][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10434.386462][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10434.386763][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10434.387053][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10434.387352][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10434.387639][ C1] tcp_delack_timer+0x84/0x240 [10434.387896][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10434.388180][ C1] call_timer_fn+0x176/0x430 [10434.388425][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10434.388702][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10434.388977][ C1] __run_timers.part.0+0x52d/0x890 [10434.389249][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10434.389538][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10434.389839][ C1] ? __pfx___schedule+0x10/0x10 [10434.390098][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10434.390416][ C1] run_timer_softirq+0x72/0x100 [10434.390679][ C1] __do_softirq+0x1bc/0x7ff [10434.390924][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10434.391200][ C1] run_ksoftirqd+0x2e/0x60 [10434.391442][ C1] smpboot_thread_fn+0x30e/0x840 [10434.391711][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10434.392000][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10434.392291][ C1] kthread+0x292/0x360 [10434.392507][ C1] ? __pfx_kthread+0x10/0x10 [10434.392755][ C1] ret_from_fork+0x34/0x70 [10434.392990][ C1] ? __pfx_kthread+0x10/0x10 [10434.393238][ C1] ret_from_fork_asm+0x1b/0x30 [10434.393496][ C1] [10460.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8636s! [swapper/0:0] [10460.527929][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10460.529129][ C0] irq event stamp: 27567077 [10460.529373][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10460.529908][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10460.530382][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10460.530881][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10460.531372][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10460.531852][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10460.532503][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10460.532845][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10460.533870][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10460.534200][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10460.534623][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10460.535046][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10460.535471][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10460.535899][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10460.536319][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10460.536788][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10460.537144][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10460.537565][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10460.537984][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10460.538406][ C0] Call Trace: [10460.538589][ C0] [10460.538748][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10460.539023][ C0] ? __run_hrtimer+0x1c3/0x710 [10460.539280][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10460.539569][ C0] ? __hrtimer_run_queues+0x197/0x270 [10460.539855][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10460.540162][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10460.540444][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10460.540766][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10460.541041][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10460.541319][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10460.541638][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10460.541950][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10460.542282][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10460.542585][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10460.542892][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10460.543201][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10460.543532][ C0] ? get_stack_info+0x36/0xc0 [10460.543787][ C0] ? lock_acquire+0x1c1/0x220 [10460.544040][ C0] ? lock_release+0x1d5/0x250 [10460.544291][ C0] do_raw_spin_lock+0x1ec/0x270 [10460.544551][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10460.544835][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10460.545139][ C0] ? lock_acquire+0x1c1/0x220 [10460.545389][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10460.545648][ C0] _raw_spin_lock_nested+0x65/0x80 [10460.545922][ C0] tcp_v4_rcv+0x2159/0x29b0 [10460.546172][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10460.546435][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10460.546706][ C0] ? __inet_lookup_established+0x341/0x610 [10460.547025][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10460.547314][ C0] ip_local_deliver_finish+0x2ae/0x450 [10460.547604][ C0] ip_local_deliver+0x19d/0x480 [10460.547865][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10460.548156][ C0] ? rcu_read_lock_held+0xe/0x50 [10460.548421][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10460.548696][ C0] ? rcu_read_lock_held+0xe/0x50 [10460.548956][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10460.549299][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10460.549571][ C0] ip_rcv+0x564/0x740 [10460.549781][ C0] ? __pfx_ip_rcv+0x10/0x10 [10460.550023][ C0] ? set_track_prepare+0x8a/0xd0 [10460.550287][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10460.550579][ C0] ? rest_init+0x153/0x260 [10460.550814][ C0] ? skb_clone+0x10b/0x330 [10460.551056][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10460.551388][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10460.551706][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10460.552007][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10460.552317][ C0] ? __tcf_classify+0x32c/0x7d0 [10460.552576][ C0] ? __pfx_ip_rcv+0x10/0x10 [10460.552819][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10460.553140][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10460.553439][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10460.553776][ C0] ? lock_acquire+0x1c1/0x220 [10460.554021][ C0] ? netif_receive_skb_internal+0x84/0x300 [10460.554330][ C0] netif_receive_skb_internal+0xb0/0x300 [10460.554628][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10460.554957][ C0] ? __copy_skb_header+0xaf/0x490 [10460.555223][ C0] ? __skb_clone+0x57a/0x760 [10460.555467][ C0] netif_receive_skb+0x55/0x280 [10460.555755][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10460.556080][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10460.556426][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10460.556738][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10460.557022][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10460.557318][ C0] ? hlock_class+0x4e/0x130 [10460.557560][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10460.557888][ C0] ? place_entity+0x21/0x2f0 [10460.558137][ C0] ? resched_curr+0x219/0x280 [10460.558392][ C0] ? __pfx_resched_curr+0x10/0x10 [10460.558660][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10460.558942][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10460.559220][ C0] ? wakeup_preempt+0x161/0x2c0 [10460.559477][ C0] ? activate_task+0xf5/0x260 [10460.559724][ C0] ? trace_sched_wakeup+0xd2/0x100 [10460.559998][ C0] ? do_raw_spin_unlock+0x58/0x220 [10460.560271][ C0] ? _raw_spin_unlock+0x23/0x40 [10460.560529][ C0] ? get_stack_info_noinstr+0x18/0x110 [10460.560819][ C0] ? get_stack_info+0x36/0xc0 [10460.561074][ C0] ? stack_access_ok+0xda/0x1f0 [10460.561334][ C0] ? get_reg+0x119/0x190 [10460.561561][ C0] __tcf_classify+0x32c/0x7d0 [10460.561812][ C0] tcf_classify+0x283/0x930 [10460.562051][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10460.562379][ C0] ? __pfx_tcf_classify+0x10/0x10 [10460.562648][ C0] ? arch_stack_walk+0x8c/0x100 [10460.562909][ C0] ? get_stack_info_noinstr+0x18/0x110 [10460.563202][ C0] tc_run+0x2e4/0x5d0 [10460.563414][ C0] ? __pfx_tc_run+0x10/0x10 [10460.563653][ C0] ? lock_acquire+0x1c1/0x220 [10460.563899][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10460.564172][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10460.564440][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10460.564722][ C0] ? ip_finish_output2+0x786/0x18e0 [10460.564996][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10460.565315][ C0] ? neigh_hh_output+0x348/0x590 [10460.565581][ C0] ? ip_finish_output2+0x262/0x18e0 [10460.565864][ C0] ip_finish_output2+0x786/0x18e0 [10460.566138][ C0] ? stack_depot_save_flags+0x45/0x550 [10460.566430][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10460.566781][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10460.567071][ C0] ? rcu_read_lock_held+0xe/0x50 [10460.567338][ C0] ? __ip_finish_output+0x10f/0x770 [10460.567613][ C0] ip_output+0x16b/0x4f0 [10460.567838][ C0] ? __run_timers.part.0+0x52d/0x890 [10460.568125][ C0] ? __pfx_ip_output+0x10/0x10 [10460.568377][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10460.568680][ C0] ? rcu_read_lock_held+0xe/0x50 [10460.568941][ C0] ? ip_local_out+0x114/0x3b0 [10460.569199][ C0] __ip_queue_xmit+0x672/0x1910 [10460.569461][ C0] ? __skb_clone+0x57a/0x760 [10460.569708][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10460.569985][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10460.570277][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10460.570591][ C0] tcp_write_xmit+0xe42/0x24c0 [10460.570848][ C0] ? tcp_current_mss+0x40a/0x510 [10460.571110][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10460.571397][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10460.571670][ C0] ? mark_lock_irq+0x6e2/0xa10 [10460.571920][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10460.572192][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10460.572511][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10460.572784][ C0] ? ktime_get+0xb6/0x190 [10460.573013][ C0] tcp_send_loss_probe+0x4c9/0x830 [10460.573286][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10460.573569][ C0] tcp_write_timer+0x82/0x1d0 [10460.573819][ C0] call_timer_fn+0x176/0x430 [10460.574068][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10460.574343][ C0] ? next_expiry_recalc+0xcd/0x220 [10460.574615][ C0] __run_timers.part.0+0x52d/0x890 [10460.574889][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10460.575169][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10460.575467][ C0] ? lock_acquire+0x1c1/0x220 [10460.575718][ C0] ? clockevents_program_event+0xf6/0x300 [10460.576028][ C0] ? lock_release+0x1d5/0x250 [10460.576282][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10460.576560][ C0] ? ktime_get+0xb6/0x190 [10460.576793][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10460.577093][ C0] ? clockevents_program_event+0x1ed/0x300 [10460.577401][ C0] run_timer_softirq+0x72/0x100 [10460.577660][ C0] __do_softirq+0x1bc/0x7ff [10460.577904][ C0] irq_exit_rcu+0x98/0xc0 [10460.578138][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10460.578438][ C0] [10460.578597][ C0] [10460.578753][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10460.579073][ C0] RIP: 0010:default_idle+0xf/0x20 [10460.579343][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10460.580365][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10460.580700][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10460.581136][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10460.581558][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10460.581979][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10460.582398][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10460.582819][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10460.583126][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10460.583398][ C0] default_idle_call+0x69/0xa0 [10460.583651][ C0] cpuidle_idle_call+0x1f6/0x280 [10460.583918][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10460.584209][ C0] ? lock_release+0x1d5/0x250 [10460.584461][ C0] do_idle+0xfb/0x160 [10460.584673][ C0] cpu_startup_entry+0x55/0x60 [10460.584929][ C0] rest_init+0x153/0x260 [10460.585154][ C0] ? acpi_enable_subsystem+0xac/0x150 [10460.585448][ C0] arch_call_rest_init+0x13/0x40 [10460.585717][ C0] start_kernel+0x314/0x3d0 [10460.585962][ C0] x86_64_start_reservations+0x18/0x30 [10460.586255][ C0] x86_64_start_kernel+0xba/0x110 [10460.586520][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10460.586843][ C0] [10460.587005][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8636s! [ksoftirqd/1:22] [10460.587458][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10460.588652][ C1] irq event stamp: 3886976 [10460.588891][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10460.589385][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10460.589877][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10460.590372][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10460.590865][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10460.591357][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10460.591997][ C1] RIP: 0010:kasan_check_range+0x4/0x1c0 [10460.592294][ C1] Code: 6a 00 5b 5d 41 5c 41 5d c3 cc cc cc cc 66 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 <48> 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 [10460.593310][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000246 [10460.593634][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10460.594054][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [10460.594470][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10460.594888][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10460.595306][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10460.595728][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10460.596197][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10460.596545][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10460.596966][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10460.597384][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10460.597801][ C1] Call Trace: [10460.597979][ C1] [10460.598134][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10460.598413][ C1] ? __run_hrtimer+0x1c3/0x710 [10460.598665][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10460.598958][ C1] ? __hrtimer_run_queues+0x197/0x270 [10460.599243][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10460.599544][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10460.599823][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10460.600142][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10460.600420][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10460.600744][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10460.601053][ C1] [10460.601212][ C1] [10460.601371][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10460.601705][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10460.602007][ C1] ? kasan_check_range+0x4/0x1c0 [10460.602272][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [10460.602569][ C1] ? run_ksoftirqd+0xb/0x60 [10460.602819][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10460.603150][ C1] ? __orc_find+0x9c/0xf0 [10460.603380][ C1] ? lock_acquire+0x1c1/0x220 [10460.603629][ C1] ? irqentry_enter+0x2b/0x60 [10460.603878][ C1] do_raw_spin_lock+0x1ec/0x270 [10460.604139][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10460.604429][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10460.604728][ C1] ? lock_acquire+0x1c1/0x220 [10460.604980][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10460.605235][ C1] _raw_spin_lock_nested+0x65/0x80 [10460.605510][ C1] tcp_v4_rcv+0x2159/0x29b0 [10460.605760][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10460.606023][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10460.606297][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10460.606588][ C1] ip_local_deliver_finish+0x2ae/0x450 [10460.606881][ C1] ip_local_deliver+0x19d/0x480 [10460.607138][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10460.607421][ C1] ? rcu_read_lock_held+0xe/0x50 [10460.607684][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10460.607964][ C1] ? rcu_read_lock_held+0xe/0x50 [10460.608232][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10460.608566][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10460.608842][ C1] ip_rcv+0x564/0x740 [10460.609063][ C1] ? __pfx_ip_rcv+0x10/0x10 [10460.609309][ C1] ? set_track_prepare+0x8a/0xd0 [10460.609579][ C1] ? irqentry_enter+0x2b/0x60 [10460.609830][ C1] ? irqentry_enter+0x2b/0x60 [10460.610083][ C1] ? __pfx_ip_rcv+0x10/0x10 [10460.610325][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10460.610637][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10460.610975][ C1] ? netif_receive_skb_internal+0x84/0x300 [10460.611285][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10460.611626][ C1] netif_receive_skb_internal+0xb0/0x300 [10460.611925][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10460.612254][ C1] netif_receive_skb+0x55/0x280 [10460.612512][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10460.612835][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10460.613183][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10460.613496][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10460.613782][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10460.614087][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10460.614416][ C1] ? unwind_next_frame+0x1478/0x1d10 [10460.614695][ C1] ? arch_stack_walk+0x68/0x100 [10460.614955][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10460.615235][ C1] ? irqentry_enter+0x2b/0x60 [10460.615491][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10460.615817][ C1] ? irqentry_enter+0x2b/0x60 [10460.616072][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10460.616396][ C1] ? unwind_next_frame+0x1478/0x1d10 [10460.616674][ C1] ? arch_stack_walk+0x68/0x100 [10460.616936][ C1] __tcf_classify+0x32c/0x7d0 [10460.617190][ C1] tcf_classify+0x283/0x930 [10460.617435][ C1] ? __pfx_tcf_classify+0x10/0x10 [10460.617707][ C1] tc_run+0x2e4/0x5d0 [10460.617927][ C1] ? __pfx_tc_run+0x10/0x10 [10460.618175][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10460.618445][ C1] ? irqentry_enter+0x2b/0x60 [10460.618696][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10460.618981][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10460.619303][ C1] ip_finish_output2+0x786/0x18e0 [10460.619576][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10460.619867][ C1] ? rcu_read_lock_held+0xe/0x50 [10460.620131][ C1] ? __ip_finish_output+0x10f/0x770 [10460.620410][ C1] ip_output+0x16b/0x4f0 [10460.620640][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10460.620957][ C1] ? __pfx_ip_output+0x10/0x10 [10460.621218][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10460.621569][ C1] ? __pfx_ip_output+0x10/0x10 [10460.621823][ C1] __ip_queue_xmit+0x672/0x1910 [10460.622087][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10460.622370][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10460.622672][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10460.622965][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10460.623265][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10460.623555][ C1] tcp_delack_timer+0x84/0x240 [10460.623813][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10460.624100][ C1] call_timer_fn+0x176/0x430 [10460.624354][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10460.624630][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10460.624905][ C1] __run_timers.part.0+0x52d/0x890 [10460.625178][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10460.625468][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10460.625773][ C1] ? __pfx___schedule+0x10/0x10 [10460.626035][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10460.626358][ C1] run_timer_softirq+0x72/0x100 [10460.626617][ C1] __do_softirq+0x1bc/0x7ff [10460.626857][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10460.627130][ C1] run_ksoftirqd+0x2e/0x60 [10460.627371][ C1] smpboot_thread_fn+0x30e/0x840 [10460.627634][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10460.627929][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10460.628220][ C1] kthread+0x292/0x360 [10460.628439][ C1] ? __pfx_kthread+0x10/0x10 [10460.628683][ C1] ret_from_fork+0x34/0x70 [10460.628924][ C1] ? __pfx_kthread+0x10/0x10 [10460.629169][ C1] ret_from_fork_asm+0x1b/0x30 [10460.629432][ C1] [10488.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8662s! [swapper/0:0] [10488.527935][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10488.529138][ C0] irq event stamp: 27567077 [10488.529383][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10488.529917][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10488.530391][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10488.530893][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10488.531386][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10488.531866][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10488.532516][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10488.532862][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10488.533888][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10488.534215][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10488.534640][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10488.535063][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10488.535491][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10488.535908][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10488.536327][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10488.536795][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10488.537148][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10488.537571][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10488.537996][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10488.538417][ C0] Call Trace: [10488.538597][ C0] [10488.538757][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10488.539034][ C0] ? __run_hrtimer+0x1c3/0x710 [10488.539295][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10488.539586][ C0] ? __hrtimer_run_queues+0x197/0x270 [10488.539874][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10488.540179][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10488.540463][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10488.540788][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10488.541062][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10488.541343][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10488.541667][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10488.541976][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10488.542314][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10488.542616][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10488.542924][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10488.543231][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10488.543559][ C0] ? get_stack_info+0x36/0xc0 [10488.543811][ C0] ? lock_acquire+0x1c1/0x220 [10488.544061][ C0] ? lock_release+0x1d5/0x250 [10488.544308][ C0] do_raw_spin_lock+0x1ec/0x270 [10488.544567][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10488.544856][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10488.545156][ C0] ? lock_acquire+0x1c1/0x220 [10488.545407][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10488.545668][ C0] _raw_spin_lock_nested+0x65/0x80 [10488.545940][ C0] tcp_v4_rcv+0x2159/0x29b0 [10488.546190][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10488.546452][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10488.546725][ C0] ? __inet_lookup_established+0x341/0x610 [10488.547044][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10488.547332][ C0] ip_local_deliver_finish+0x2ae/0x450 [10488.547622][ C0] ip_local_deliver+0x19d/0x480 [10488.547886][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10488.548180][ C0] ? rcu_read_lock_held+0xe/0x50 [10488.548448][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10488.548724][ C0] ? rcu_read_lock_held+0xe/0x50 [10488.548986][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10488.549325][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10488.549599][ C0] ip_rcv+0x564/0x740 [10488.549810][ C0] ? __pfx_ip_rcv+0x10/0x10 [10488.550051][ C0] ? set_track_prepare+0x8a/0xd0 [10488.550316][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10488.550606][ C0] ? rest_init+0x153/0x260 [10488.550845][ C0] ? skb_clone+0x10b/0x330 [10488.551088][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10488.551422][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10488.551740][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10488.552040][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10488.552352][ C0] ? __tcf_classify+0x32c/0x7d0 [10488.552613][ C0] ? __pfx_ip_rcv+0x10/0x10 [10488.552856][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10488.553180][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10488.553484][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10488.553822][ C0] ? lock_acquire+0x1c1/0x220 [10488.554069][ C0] ? netif_receive_skb_internal+0x84/0x300 [10488.554379][ C0] netif_receive_skb_internal+0xb0/0x300 [10488.554681][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10488.555012][ C0] ? __copy_skb_header+0xaf/0x490 [10488.555280][ C0] ? __skb_clone+0x57a/0x760 [10488.555527][ C0] netif_receive_skb+0x55/0x280 [10488.555785][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10488.556110][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10488.556462][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10488.556779][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10488.557067][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10488.557367][ C0] ? hlock_class+0x4e/0x130 [10488.557611][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10488.557940][ C0] ? place_entity+0x21/0x2f0 [10488.558187][ C0] ? resched_curr+0x219/0x280 [10488.558443][ C0] ? __pfx_resched_curr+0x10/0x10 [10488.558715][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10488.558999][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10488.559277][ C0] ? wakeup_preempt+0x161/0x2c0 [10488.559536][ C0] ? activate_task+0xf5/0x260 [10488.559787][ C0] ? trace_sched_wakeup+0xd2/0x100 [10488.560063][ C0] ? do_raw_spin_unlock+0x58/0x220 [10488.560339][ C0] ? _raw_spin_unlock+0x23/0x40 [10488.560595][ C0] ? get_stack_info_noinstr+0x18/0x110 [10488.560883][ C0] ? get_stack_info+0x36/0xc0 [10488.561139][ C0] ? stack_access_ok+0xda/0x1f0 [10488.561402][ C0] ? get_reg+0x119/0x190 [10488.561630][ C0] __tcf_classify+0x32c/0x7d0 [10488.561879][ C0] tcf_classify+0x283/0x930 [10488.562120][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10488.562448][ C0] ? __pfx_tcf_classify+0x10/0x10 [10488.562717][ C0] ? arch_stack_walk+0x8c/0x100 [10488.562983][ C0] ? get_stack_info_noinstr+0x18/0x110 [10488.563276][ C0] tc_run+0x2e4/0x5d0 [10488.563490][ C0] ? __pfx_tc_run+0x10/0x10 [10488.563731][ C0] ? lock_acquire+0x1c1/0x220 [10488.563980][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10488.564255][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10488.564526][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10488.564811][ C0] ? ip_finish_output2+0x786/0x18e0 [10488.565089][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10488.565408][ C0] ? neigh_hh_output+0x348/0x590 [10488.565677][ C0] ? ip_finish_output2+0x262/0x18e0 [10488.565958][ C0] ip_finish_output2+0x786/0x18e0 [10488.566231][ C0] ? stack_depot_save_flags+0x45/0x550 [10488.566527][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10488.566877][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10488.567164][ C0] ? rcu_read_lock_held+0xe/0x50 [10488.567432][ C0] ? __ip_finish_output+0x10f/0x770 [10488.567709][ C0] ip_output+0x16b/0x4f0 [10488.567936][ C0] ? __run_timers.part.0+0x52d/0x890 [10488.568227][ C0] ? __pfx_ip_output+0x10/0x10 [10488.568479][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10488.568781][ C0] ? rcu_read_lock_held+0xe/0x50 [10488.569044][ C0] ? ip_local_out+0x114/0x3b0 [10488.569298][ C0] __ip_queue_xmit+0x672/0x1910 [10488.569559][ C0] ? __skb_clone+0x57a/0x760 [10488.569807][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10488.570092][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10488.570386][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10488.570706][ C0] tcp_write_xmit+0xe42/0x24c0 [10488.570966][ C0] ? tcp_current_mss+0x40a/0x510 [10488.571230][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10488.571519][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10488.571793][ C0] ? mark_lock_irq+0x6e2/0xa10 [10488.572048][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10488.572317][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10488.572639][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10488.572915][ C0] ? ktime_get+0xb6/0x190 [10488.573148][ C0] tcp_send_loss_probe+0x4c9/0x830 [10488.573420][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10488.573703][ C0] tcp_write_timer+0x82/0x1d0 [10488.573953][ C0] call_timer_fn+0x176/0x430 [10488.574198][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10488.574475][ C0] ? next_expiry_recalc+0xcd/0x220 [10488.574748][ C0] __run_timers.part.0+0x52d/0x890 [10488.575023][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10488.575310][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10488.575616][ C0] ? lock_acquire+0x1c1/0x220 [10488.575868][ C0] ? clockevents_program_event+0xf6/0x300 [10488.576177][ C0] ? lock_release+0x1d5/0x250 [10488.576430][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10488.576709][ C0] ? ktime_get+0xb6/0x190 [10488.576943][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10488.577245][ C0] ? clockevents_program_event+0x1ed/0x300 [10488.577554][ C0] run_timer_softirq+0x72/0x100 [10488.577816][ C0] __do_softirq+0x1bc/0x7ff [10488.578064][ C0] irq_exit_rcu+0x98/0xc0 [10488.578295][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10488.578597][ C0] [10488.578753][ C0] [10488.578909][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10488.579227][ C0] RIP: 0010:default_idle+0xf/0x20 [10488.579499][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10488.580523][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10488.580850][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10488.581271][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10488.581690][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10488.582112][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10488.582536][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10488.582958][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10488.583264][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10488.583540][ C0] default_idle_call+0x69/0xa0 [10488.583790][ C0] cpuidle_idle_call+0x1f6/0x280 [10488.584056][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10488.584348][ C0] ? lock_release+0x1d5/0x250 [10488.584603][ C0] do_idle+0xfb/0x160 [10488.584817][ C0] cpu_startup_entry+0x55/0x60 [10488.585073][ C0] rest_init+0x153/0x260 [10488.585299][ C0] ? acpi_enable_subsystem+0xac/0x150 [10488.585593][ C0] arch_call_rest_init+0x13/0x40 [10488.585859][ C0] start_kernel+0x314/0x3d0 [10488.586106][ C0] x86_64_start_reservations+0x18/0x30 [10488.586400][ C0] x86_64_start_kernel+0xba/0x110 [10488.586670][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10488.586994][ C0] [10488.587158][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8662s! [ksoftirqd/1:22] [10488.587611][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10488.588801][ C1] irq event stamp: 3886976 [10488.589041][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10488.589536][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10488.590031][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10488.590530][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10488.591022][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10488.591512][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10488.592151][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [10488.592446][ C1] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [10488.593467][ C1] RSP: 0018:ffffc9000019e9e0 EFLAGS: 00000202 [10488.593787][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10488.594211][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10488.594628][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10488.595045][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10488.595461][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10488.595887][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10488.596362][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10488.596706][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10488.597132][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10488.597552][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10488.597968][ C1] Call Trace: [10488.598144][ C1] [10488.598299][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10488.598576][ C1] ? __run_hrtimer+0x1c3/0x710 [10488.598832][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10488.599126][ C1] ? __hrtimer_run_queues+0x197/0x270 [10488.599412][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10488.599714][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10488.599990][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10488.600313][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10488.600590][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10488.600910][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10488.601227][ C1] [10488.601387][ C1] [10488.601548][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10488.601880][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10488.602182][ C1] ? __pfx___kasan_check_read+0x10/0x10 [10488.602476][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [10488.602767][ C1] ? run_ksoftirqd+0xb/0x60 [10488.603009][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10488.603342][ C1] ? __orc_find+0x9c/0xf0 [10488.603575][ C1] ? lock_acquire+0x1c1/0x220 [10488.603831][ C1] ? irqentry_enter+0x2b/0x60 [10488.604088][ C1] do_raw_spin_lock+0x1ec/0x270 [10488.604352][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10488.604640][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10488.604939][ C1] ? lock_acquire+0x1c1/0x220 [10488.605187][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10488.605440][ C1] _raw_spin_lock_nested+0x65/0x80 [10488.605717][ C1] tcp_v4_rcv+0x2159/0x29b0 [10488.605964][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10488.606224][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10488.606493][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10488.606778][ C1] ip_local_deliver_finish+0x2ae/0x450 [10488.607069][ C1] ip_local_deliver+0x19d/0x480 [10488.607335][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10488.607626][ C1] ? rcu_read_lock_held+0xe/0x50 [10488.607894][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10488.608170][ C1] ? rcu_read_lock_held+0xe/0x50 [10488.608432][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10488.608771][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10488.609044][ C1] ip_rcv+0x564/0x740 [10488.609255][ C1] ? __pfx_ip_rcv+0x10/0x10 [10488.609495][ C1] ? set_track_prepare+0x8a/0xd0 [10488.609759][ C1] ? irqentry_enter+0x2b/0x60 [10488.610011][ C1] ? irqentry_enter+0x2b/0x60 [10488.610264][ C1] ? __pfx_ip_rcv+0x10/0x10 [10488.610508][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10488.610826][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10488.611172][ C1] ? netif_receive_skb_internal+0x84/0x300 [10488.611482][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10488.611819][ C1] netif_receive_skb_internal+0xb0/0x300 [10488.612119][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10488.612456][ C1] netif_receive_skb+0x55/0x280 [10488.612718][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10488.613051][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10488.613400][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10488.613715][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10488.614007][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10488.614315][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10488.614646][ C1] ? unwind_next_frame+0x1478/0x1d10 [10488.614929][ C1] ? arch_stack_walk+0x68/0x100 [10488.615189][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10488.615465][ C1] ? irqentry_enter+0x2b/0x60 [10488.615722][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10488.616048][ C1] ? irqentry_enter+0x2b/0x60 [10488.616299][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10488.616621][ C1] ? unwind_next_frame+0x1478/0x1d10 [10488.616904][ C1] ? arch_stack_walk+0x68/0x100 [10488.617165][ C1] __tcf_classify+0x32c/0x7d0 [10488.617417][ C1] tcf_classify+0x283/0x930 [10488.617659][ C1] ? __pfx_tcf_classify+0x10/0x10 [10488.617929][ C1] tc_run+0x2e4/0x5d0 [10488.618143][ C1] ? __pfx_tc_run+0x10/0x10 [10488.618386][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10488.618653][ C1] ? irqentry_enter+0x2b/0x60 [10488.618905][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10488.619192][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10488.619519][ C1] ip_finish_output2+0x786/0x18e0 [10488.619787][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10488.620076][ C1] ? rcu_read_lock_held+0xe/0x50 [10488.620345][ C1] ? __ip_finish_output+0x10f/0x770 [10488.620623][ C1] ip_output+0x16b/0x4f0 [10488.620850][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10488.621174][ C1] ? __pfx_ip_output+0x10/0x10 [10488.621430][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10488.621786][ C1] ? __pfx_ip_output+0x10/0x10 [10488.622047][ C1] __ip_queue_xmit+0x672/0x1910 [10488.622312][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10488.622592][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10488.622886][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10488.623173][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10488.623468][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10488.623752][ C1] tcp_delack_timer+0x84/0x240 [10488.624006][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10488.624294][ C1] call_timer_fn+0x176/0x430 [10488.624544][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10488.624818][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10488.625100][ C1] __run_timers.part.0+0x52d/0x890 [10488.625377][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10488.625671][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10488.625974][ C1] ? __pfx___schedule+0x10/0x10 [10488.626233][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10488.626551][ C1] run_timer_softirq+0x72/0x100 [10488.626813][ C1] __do_softirq+0x1bc/0x7ff [10488.627059][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10488.627336][ C1] run_ksoftirqd+0x2e/0x60 [10488.627573][ C1] smpboot_thread_fn+0x30e/0x840 [10488.627842][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10488.628133][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10488.628424][ C1] kthread+0x292/0x360 [10488.628642][ C1] ? __pfx_kthread+0x10/0x10 [10488.628889][ C1] ret_from_fork+0x34/0x70 [10488.629127][ C1] ? __pfx_kthread+0x10/0x10 [10488.629375][ C1] ret_from_fork_asm+0x1b/0x30 [10488.629633][ C1] [10512.396025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [10512.396422][ C1] rcu: 1-....: (9246119 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=2212051 [10512.397014][ C1] rcu: (t=9318087 jiffies g=1007429 q=31 ncpus=4) [10512.397359][ C1] Sending NMI from CPU 1 to CPUs 0: [10512.397650][ C0] NMI backtrace for cpu 0 [10512.397657][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10512.397661][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10512.397664][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10512.397675][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10512.397678][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10512.397682][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10512.397684][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10512.397686][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10512.397688][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10512.397690][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10512.397691][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10512.397694][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10512.397697][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10512.397699][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10512.397700][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10512.397702][ C0] Call Trace: [10512.397706][ C0] [10512.397717][ C0] ? nmi_cpu_backtrace+0x112/0x220 [10512.397723][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [10512.397730][ C0] ? nmi_handle+0x156/0x420 [10512.397735][ C0] ? default_do_nmi+0x41/0x100 [10512.397740][ C0] ? exc_nmi+0xf3/0x120 [10512.397742][ C0] ? end_repeat_nmi+0xf/0x60 [10512.397747][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10512.397751][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10512.397754][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10512.397758][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10512.397762][ C0] [10512.397762][ C0] [10512.397764][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10512.397767][ C0] ? get_stack_info+0x36/0xc0 [10512.397772][ C0] ? lock_acquire+0x1c1/0x220 [10512.397777][ C0] ? lock_release+0x1d5/0x250 [10512.397781][ C0] do_raw_spin_lock+0x1ec/0x270 [10512.397785][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10512.397788][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10512.397791][ C0] ? lock_acquire+0x1c1/0x220 [10512.397793][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10512.397800][ C0] _raw_spin_lock_nested+0x65/0x80 [10512.397803][ C0] tcp_v4_rcv+0x2159/0x29b0 [10512.397811][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10512.397813][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10512.397818][ C0] ? __inet_lookup_established+0x341/0x610 [10512.397824][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10512.397832][ C0] ip_local_deliver_finish+0x2ae/0x450 [10512.397836][ C0] ip_local_deliver+0x19d/0x480 [10512.397839][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10512.397841][ C0] ? rcu_read_lock_held+0xe/0x50 [10512.397848][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10512.397851][ C0] ? rcu_read_lock_held+0xe/0x50 [10512.397854][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10512.397858][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10512.397869][ C0] ip_rcv+0x564/0x740 [10512.397872][ C0] ? __pfx_ip_rcv+0x10/0x10 [10512.397875][ C0] ? set_track_prepare+0x8a/0xd0 [10512.397881][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10512.397883][ C0] ? rest_init+0x153/0x260 [10512.397886][ C0] ? skb_clone+0x10b/0x330 [10512.397892][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10512.397898][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10512.397904][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10512.397909][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10512.397919][ C0] ? __tcf_classify+0x32c/0x7d0 [10512.397922][ C0] ? __pfx_ip_rcv+0x10/0x10 [10512.397924][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10512.397929][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10512.397932][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10512.397935][ C0] ? lock_acquire+0x1c1/0x220 [10512.397938][ C0] ? netif_receive_skb_internal+0x84/0x300 [10512.397941][ C0] netif_receive_skb_internal+0xb0/0x300 [10512.397944][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10512.397947][ C0] ? __copy_skb_header+0xaf/0x490 [10512.397950][ C0] ? __skb_clone+0x57a/0x760 [10512.397953][ C0] netif_receive_skb+0x55/0x280 [10512.397955][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10512.397964][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10512.397971][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10512.397978][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10512.397983][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10512.397992][ C0] ? hlock_class+0x4e/0x130 [10512.397998][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10512.398008][ C0] ? place_entity+0x21/0x2f0 [10512.398011][ C0] ? resched_curr+0x219/0x280 [10512.398015][ C0] ? __pfx_resched_curr+0x10/0x10 [10512.398018][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10512.398023][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10512.398028][ C0] ? wakeup_preempt+0x161/0x2c0 [10512.398031][ C0] ? activate_task+0xf5/0x260 [10512.398033][ C0] ? trace_sched_wakeup+0xd2/0x100 [10512.398039][ C0] ? do_raw_spin_unlock+0x58/0x220 [10512.398042][ C0] ? _raw_spin_unlock+0x23/0x40 [10512.398045][ C0] ? get_stack_info_noinstr+0x18/0x110 [10512.398048][ C0] ? get_stack_info+0x36/0xc0 [10512.398052][ C0] ? stack_access_ok+0xda/0x1f0 [10512.398054][ C0] ? get_reg+0x119/0x190 [10512.398058][ C0] __tcf_classify+0x32c/0x7d0 [10512.398062][ C0] tcf_classify+0x283/0x930 [10512.398065][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10512.398071][ C0] ? __pfx_tcf_classify+0x10/0x10 [10512.398072][ C0] ? arch_stack_walk+0x8c/0x100 [10512.398077][ C0] ? get_stack_info_noinstr+0x18/0x110 [10512.398081][ C0] tc_run+0x2e4/0x5d0 [10512.398085][ C0] ? __pfx_tc_run+0x10/0x10 [10512.398088][ C0] ? lock_acquire+0x1c1/0x220 [10512.398091][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10512.398096][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10512.398102][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10512.398105][ C0] ? ip_finish_output2+0x786/0x18e0 [10512.398108][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10512.398114][ C0] ? neigh_hh_output+0x348/0x590 [10512.398119][ C0] ? ip_finish_output2+0x262/0x18e0 [10512.398123][ C0] ip_finish_output2+0x786/0x18e0 [10512.398126][ C0] ? stack_depot_save_flags+0x45/0x550 [10512.398132][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10512.398140][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10512.398143][ C0] ? rcu_read_lock_held+0xe/0x50 [10512.398147][ C0] ? __ip_finish_output+0x10f/0x770 [10512.398151][ C0] ip_output+0x16b/0x4f0 [10512.398155][ C0] ? __run_timers.part.0+0x52d/0x890 [10512.398160][ C0] ? __pfx_ip_output+0x10/0x10 [10512.398163][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10512.398168][ C0] ? rcu_read_lock_held+0xe/0x50 [10512.398172][ C0] ? ip_local_out+0x114/0x3b0 [10512.398176][ C0] __ip_queue_xmit+0x672/0x1910 [10512.398180][ C0] ? __skb_clone+0x57a/0x760 [10512.398183][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10512.398191][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10512.398195][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10512.398199][ C0] tcp_write_xmit+0xe42/0x24c0 [10512.398204][ C0] ? tcp_current_mss+0x40a/0x510 [10512.398207][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10512.398211][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10512.398214][ C0] ? mark_lock_irq+0x6e2/0xa10 [10512.398216][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10512.398219][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10512.398223][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10512.398228][ C0] ? ktime_get+0xb6/0x190 [10512.398232][ C0] tcp_send_loss_probe+0x4c9/0x830 [10512.398237][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10512.398240][ C0] tcp_write_timer+0x82/0x1d0 [10512.398244][ C0] call_timer_fn+0x176/0x430 [10512.398247][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10512.398252][ C0] ? next_expiry_recalc+0xcd/0x220 [10512.398256][ C0] __run_timers.part.0+0x52d/0x890 [10512.398259][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10512.398264][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10512.398267][ C0] ? lock_acquire+0x1c1/0x220 [10512.398269][ C0] ? clockevents_program_event+0xf6/0x300 [10512.398273][ C0] ? lock_release+0x1d5/0x250 [10512.398276][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10512.398279][ C0] ? ktime_get+0xb6/0x190 [10512.398281][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10512.398285][ C0] ? clockevents_program_event+0x1ed/0x300 [10512.398290][ C0] run_timer_softirq+0x72/0x100 [10512.398293][ C0] __do_softirq+0x1bc/0x7ff [10512.398298][ C0] irq_exit_rcu+0x98/0xc0 [10512.398301][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10512.398305][ C0] [10512.398306][ C0] [10512.398307][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10512.398313][ C0] RIP: 0010:default_idle+0xf/0x20 [10512.398316][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10512.398318][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10512.398320][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10512.398322][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10512.398324][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10512.398325][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10512.398326][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10512.398330][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10512.398333][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10512.398337][ C0] default_idle_call+0x69/0xa0 [10512.398340][ C0] cpuidle_idle_call+0x1f6/0x280 [10512.398342][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10512.398348][ C0] ? lock_release+0x1d5/0x250 [10512.398352][ C0] do_idle+0xfb/0x160 [10512.398355][ C0] cpu_startup_entry+0x55/0x60 [10512.398358][ C0] rest_init+0x153/0x260 [10512.398360][ C0] ? acpi_enable_subsystem+0xac/0x150 [10512.398366][ C0] arch_call_rest_init+0x13/0x40 [10512.398372][ C0] start_kernel+0x314/0x3d0 [10512.398376][ C0] x86_64_start_reservations+0x18/0x30 [10512.398381][ C0] x86_64_start_kernel+0xba/0x110 [10512.398385][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10512.398394][ C0] [10512.398647][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10512.451562][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10512.452187][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10512.452519][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10512.453504][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10512.453819][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10512.454228][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10512.454635][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10512.455045][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10512.455477][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10512.455902][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10512.456377][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10512.456733][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10512.457149][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10512.457559][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10512.457966][ C1] Call Trace: [10512.458138][ C1] [10512.458288][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10512.458568][ C1] ? print_cpu_stall+0x263/0x6a0 [10512.458823][ C1] ? check_cpu_stall+0x284/0x500 [10512.459089][ C1] ? rcu_pending+0x92/0x360 [10512.459324][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [10512.459597][ C1] ? update_process_times+0xb9/0x110 [10512.459874][ C1] ? tick_sched_handle+0x67/0x130 [10512.460137][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [10512.460427][ C1] ? __run_hrtimer+0x1c3/0x710 [10512.460675][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10512.460989][ C1] ? __hrtimer_run_queues+0x197/0x270 [10512.461270][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10512.461566][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10512.461838][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10512.462152][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10512.462418][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10512.462733][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10512.463037][ C1] [10512.463193][ C1] [10512.463345][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10512.463668][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10512.463963][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10512.464269][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10512.464560][ C1] ? run_ksoftirqd+0xb/0x60 [10512.464795][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10512.465112][ C1] ? __orc_find+0x9c/0xf0 [10512.465337][ C1] ? lock_acquire+0x1c1/0x220 [10512.465586][ C1] ? irqentry_enter+0x2b/0x60 [10512.465827][ C1] do_raw_spin_lock+0x1ec/0x270 [10512.466098][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10512.466382][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10512.466680][ C1] ? lock_acquire+0x1c1/0x220 [10512.466931][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10512.467184][ C1] _raw_spin_lock_nested+0x65/0x80 [10512.467463][ C1] tcp_v4_rcv+0x2159/0x29b0 [10512.467699][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10512.467948][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10512.468209][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10512.468485][ C1] ip_local_deliver_finish+0x2ae/0x450 [10512.468763][ C1] ip_local_deliver+0x19d/0x480 [10512.469017][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10512.469296][ C1] ? rcu_read_lock_held+0xe/0x50 [10512.469555][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10512.469823][ C1] ? rcu_read_lock_held+0xe/0x50 [10512.470078][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10512.470406][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10512.470670][ C1] ip_rcv+0x564/0x740 [10512.470877][ C1] ? __pfx_ip_rcv+0x10/0x10 [10512.471112][ C1] ? set_track_prepare+0x8a/0xd0 [10512.471366][ C1] ? irqentry_enter+0x2b/0x60 [10512.471631][ C1] ? irqentry_enter+0x2b/0x60 [10512.471883][ C1] ? __pfx_ip_rcv+0x10/0x10 [10512.472127][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10512.472440][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10512.472790][ C1] ? netif_receive_skb_internal+0x84/0x300 [10512.473093][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10512.473420][ C1] netif_receive_skb_internal+0xb0/0x300 [10512.473706][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10512.474031][ C1] netif_receive_skb+0x55/0x280 [10512.474287][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10512.474605][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10512.474945][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10512.475247][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10512.475532][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10512.475822][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10512.476138][ C1] ? unwind_next_frame+0x1478/0x1d10 [10512.476409][ C1] ? arch_stack_walk+0x68/0x100 [10512.476662][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10512.476932][ C1] ? irqentry_enter+0x2b/0x60 [10512.477182][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10512.477497][ C1] ? irqentry_enter+0x2b/0x60 [10512.477740][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10512.478053][ C1] ? unwind_next_frame+0x1478/0x1d10 [10512.478327][ C1] ? arch_stack_walk+0x68/0x100 [10512.478577][ C1] __tcf_classify+0x32c/0x7d0 [10512.478819][ C1] tcf_classify+0x283/0x930 [10512.479056][ C1] ? __pfx_tcf_classify+0x10/0x10 [10512.479316][ C1] tc_run+0x2e4/0x5d0 [10512.479525][ C1] ? __pfx_tc_run+0x10/0x10 [10512.479762][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10512.480021][ C1] ? irqentry_enter+0x2b/0x60 [10512.480266][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10512.480546][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10512.480863][ C1] ip_finish_output2+0x786/0x18e0 [10512.481125][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10512.481405][ C1] ? rcu_read_lock_held+0xe/0x50 [10512.481665][ C1] ? __ip_finish_output+0x10f/0x770 [10512.481933][ C1] ip_output+0x16b/0x4f0 [10512.482153][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10512.482466][ C1] ? __pfx_ip_output+0x10/0x10 [10512.482715][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10512.483063][ C1] ? __pfx_ip_output+0x10/0x10 [10512.483317][ C1] __ip_queue_xmit+0x672/0x1910 [10512.483569][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10512.483840][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10512.484127][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10512.484406][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10512.484693][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10512.484973][ C1] tcp_delack_timer+0x84/0x240 [10512.485221][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10512.485507][ C1] call_timer_fn+0x176/0x430 [10512.485769][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10512.486044][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10512.486319][ C1] __run_timers.part.0+0x52d/0x890 [10512.486590][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10512.486887][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10512.487182][ C1] ? __pfx___schedule+0x10/0x10 [10512.487431][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10512.487739][ C1] run_timer_softirq+0x72/0x100 [10512.487994][ C1] __do_softirq+0x1bc/0x7ff [10512.488233][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10512.488501][ C1] run_ksoftirqd+0x2e/0x60 [10512.488730][ C1] smpboot_thread_fn+0x30e/0x840 [10512.488991][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10512.489275][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10512.489559][ C1] kthread+0x292/0x360 [10512.489768][ C1] ? __pfx_kthread+0x10/0x10 [10512.490009][ C1] ret_from_fork+0x34/0x70 [10512.490241][ C1] ? __pfx_kthread+0x10/0x10 [10512.490483][ C1] ret_from_fork_asm+0x1b/0x30 [10512.490737][ C1] [10536.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8706s! [swapper/0:0] [10536.527929][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10536.529128][ C0] irq event stamp: 27567077 [10536.529368][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10536.529899][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10536.530376][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10536.530892][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10536.531393][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10536.531875][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10536.532515][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10536.532854][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10536.533871][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10536.534193][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10536.534613][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10536.535034][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10536.535461][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10536.535882][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10536.536305][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10536.536780][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10536.537128][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10536.537552][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10536.537971][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10536.538391][ C0] Call Trace: [10536.538572][ C0] [10536.538729][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10536.539008][ C0] ? __run_hrtimer+0x1c3/0x710 [10536.539262][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10536.539558][ C0] ? __hrtimer_run_queues+0x197/0x270 [10536.539843][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10536.540146][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10536.540424][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10536.540744][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10536.541026][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10536.541304][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10536.541630][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10536.541944][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10536.542277][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10536.542582][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10536.542897][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10536.543199][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10536.543524][ C0] ? get_stack_info+0x36/0xc0 [10536.543782][ C0] ? lock_acquire+0x1c1/0x220 [10536.544036][ C0] ? lock_release+0x1d5/0x250 [10536.544290][ C0] do_raw_spin_lock+0x1ec/0x270 [10536.544552][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10536.544838][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10536.545140][ C0] ? lock_acquire+0x1c1/0x220 [10536.545394][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10536.545652][ C0] _raw_spin_lock_nested+0x65/0x80 [10536.545928][ C0] tcp_v4_rcv+0x2159/0x29b0 [10536.546174][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10536.546431][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10536.546698][ C0] ? __inet_lookup_established+0x341/0x610 [10536.547010][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10536.547302][ C0] ip_local_deliver_finish+0x2ae/0x450 [10536.547594][ C0] ip_local_deliver+0x19d/0x480 [10536.547849][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10536.548132][ C0] ? rcu_read_lock_held+0xe/0x50 [10536.548398][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10536.548678][ C0] ? rcu_read_lock_held+0xe/0x50 [10536.548946][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10536.549281][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10536.549559][ C0] ip_rcv+0x564/0x740 [10536.549779][ C0] ? __pfx_ip_rcv+0x10/0x10 [10536.550025][ C0] ? set_track_prepare+0x8a/0xd0 [10536.550294][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10536.550582][ C0] ? rest_init+0x153/0x260 [10536.550822][ C0] ? skb_clone+0x10b/0x330 [10536.551061][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10536.551398][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10536.551723][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10536.552018][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10536.552325][ C0] ? __tcf_classify+0x32c/0x7d0 [10536.552590][ C0] ? __pfx_ip_rcv+0x10/0x10 [10536.552831][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10536.553144][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10536.553440][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10536.553785][ C0] ? lock_acquire+0x1c1/0x220 [10536.554041][ C0] ? netif_receive_skb_internal+0x84/0x300 [10536.554351][ C0] netif_receive_skb_internal+0xb0/0x300 [10536.554648][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10536.554983][ C0] ? __copy_skb_header+0xaf/0x490 [10536.555281][ C0] ? __skb_clone+0x57a/0x760 [10536.555530][ C0] netif_receive_skb+0x55/0x280 [10536.555792][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10536.556125][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10536.556474][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10536.556787][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10536.557082][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10536.557388][ C0] ? hlock_class+0x4e/0x130 [10536.557637][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10536.557968][ C0] ? place_entity+0x21/0x2f0 [10536.558217][ C0] ? resched_curr+0x219/0x280 [10536.558466][ C0] ? __pfx_resched_curr+0x10/0x10 [10536.558733][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10536.559015][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10536.559296][ C0] ? wakeup_preempt+0x161/0x2c0 [10536.559558][ C0] ? activate_task+0xf5/0x260 [10536.559814][ C0] ? trace_sched_wakeup+0xd2/0x100 [10536.560093][ C0] ? do_raw_spin_unlock+0x58/0x220 [10536.560366][ C0] ? _raw_spin_unlock+0x23/0x40 [10536.560629][ C0] ? get_stack_info_noinstr+0x18/0x110 [10536.560921][ C0] ? get_stack_info+0x36/0xc0 [10536.561172][ C0] ? stack_access_ok+0xda/0x1f0 [10536.561427][ C0] ? get_reg+0x119/0x190 [10536.561654][ C0] __tcf_classify+0x32c/0x7d0 [10536.561909][ C0] tcf_classify+0x283/0x930 [10536.562155][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10536.562488][ C0] ? __pfx_tcf_classify+0x10/0x10 [10536.562755][ C0] ? arch_stack_walk+0x8c/0x100 [10536.563015][ C0] ? get_stack_info_noinstr+0x18/0x110 [10536.563304][ C0] tc_run+0x2e4/0x5d0 [10536.563526][ C0] ? __pfx_tc_run+0x10/0x10 [10536.563772][ C0] ? lock_acquire+0x1c1/0x220 [10536.564025][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10536.564303][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10536.564569][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10536.564859][ C0] ? ip_finish_output2+0x786/0x18e0 [10536.565140][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10536.565470][ C0] ? neigh_hh_output+0x348/0x590 [10536.565738][ C0] ? ip_finish_output2+0x262/0x18e0 [10536.566015][ C0] ip_finish_output2+0x786/0x18e0 [10536.566283][ C0] ? stack_depot_save_flags+0x45/0x550 [10536.566575][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10536.566931][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10536.567223][ C0] ? rcu_read_lock_held+0xe/0x50 [10536.567486][ C0] ? __ip_finish_output+0x10f/0x770 [10536.567767][ C0] ip_output+0x16b/0x4f0 [10536.567996][ C0] ? __run_timers.part.0+0x52d/0x890 [10536.568282][ C0] ? __pfx_ip_output+0x10/0x10 [10536.568540][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10536.568839][ C0] ? rcu_read_lock_held+0xe/0x50 [10536.569106][ C0] ? ip_local_out+0x114/0x3b0 [10536.569359][ C0] __ip_queue_xmit+0x672/0x1910 [10536.569619][ C0] ? __skb_clone+0x57a/0x760 [10536.569867][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10536.570151][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10536.570452][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10536.570771][ C0] tcp_write_xmit+0xe42/0x24c0 [10536.571026][ C0] ? tcp_current_mss+0x40a/0x510 [10536.571294][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10536.571577][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10536.571856][ C0] ? mark_lock_irq+0x6e2/0xa10 [10536.572116][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10536.572383][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10536.572706][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10536.572985][ C0] ? ktime_get+0xb6/0x190 [10536.573223][ C0] tcp_send_loss_probe+0x4c9/0x830 [10536.573501][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10536.573783][ C0] tcp_write_timer+0x82/0x1d0 [10536.574040][ C0] call_timer_fn+0x176/0x430 [10536.574292][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10536.574564][ C0] ? next_expiry_recalc+0xcd/0x220 [10536.574840][ C0] __run_timers.part.0+0x52d/0x890 [10536.575113][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10536.575403][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10536.575706][ C0] ? lock_acquire+0x1c1/0x220 [10536.575955][ C0] ? clockevents_program_event+0xf6/0x300 [10536.576261][ C0] ? lock_release+0x1d5/0x250 [10536.576518][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10536.576807][ C0] ? ktime_get+0xb6/0x190 [10536.577037][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10536.577333][ C0] ? clockevents_program_event+0x1ed/0x300 [10536.577644][ C0] run_timer_softirq+0x72/0x100 [10536.577902][ C0] __do_softirq+0x1bc/0x7ff [10536.578143][ C0] irq_exit_rcu+0x98/0xc0 [10536.578371][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10536.578667][ C0] [10536.578827][ C0] [10536.578987][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10536.579308][ C0] RIP: 0010:default_idle+0xf/0x20 [10536.579574][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10536.580593][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10536.580923][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10536.581341][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10536.581756][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10536.582171][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10536.582586][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10536.583005][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10536.583308][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10536.583580][ C0] default_idle_call+0x69/0xa0 [10536.583836][ C0] cpuidle_idle_call+0x1f6/0x280 [10536.584098][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10536.584396][ C0] ? lock_release+0x1d5/0x250 [10536.584643][ C0] do_idle+0xfb/0x160 [10536.584855][ C0] cpu_startup_entry+0x55/0x60 [10536.585109][ C0] rest_init+0x153/0x260 [10536.585339][ C0] ? acpi_enable_subsystem+0xac/0x150 [10536.585630][ C0] arch_call_rest_init+0x13/0x40 [10536.585898][ C0] start_kernel+0x314/0x3d0 [10536.586139][ C0] x86_64_start_reservations+0x18/0x30 [10536.586429][ C0] x86_64_start_kernel+0xba/0x110 [10536.586700][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10536.587032][ C0] [10536.587199][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8706s! [ksoftirqd/1:22] [10536.587656][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10536.588840][ C1] irq event stamp: 3886976 [10536.589075][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10536.589579][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10536.590078][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10536.590580][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10536.591070][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10536.591568][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10536.592218][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10536.592561][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10536.593586][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10536.593912][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10536.594337][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10536.594762][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10536.595183][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10536.595610][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10536.596027][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10536.596506][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10536.596857][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10536.597283][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10536.597709][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10536.598135][ C1] Call Trace: [10536.598315][ C1] [10536.598471][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10536.598745][ C1] ? __run_hrtimer+0x1c3/0x710 [10536.599003][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10536.599296][ C1] ? __hrtimer_run_queues+0x197/0x270 [10536.599586][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10536.599890][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10536.600171][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10536.600496][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10536.600770][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10536.601098][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10536.601411][ C1] [10536.601571][ C1] [10536.601727][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10536.602054][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10536.602360][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10536.602672][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10536.602973][ C1] ? run_ksoftirqd+0xb/0x60 [10536.603216][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10536.603543][ C1] ? __orc_find+0x9c/0xf0 [10536.603776][ C1] ? lock_acquire+0x1c1/0x220 [10536.604030][ C1] ? irqentry_enter+0x2b/0x60 [10536.604284][ C1] do_raw_spin_lock+0x1ec/0x270 [10536.604546][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10536.604833][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10536.605134][ C1] ? lock_acquire+0x1c1/0x220 [10536.605390][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10536.605647][ C1] _raw_spin_lock_nested+0x65/0x80 [10536.605922][ C1] tcp_v4_rcv+0x2159/0x29b0 [10536.606168][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10536.606426][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10536.606699][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10536.606987][ C1] ip_local_deliver_finish+0x2ae/0x450 [10536.607279][ C1] ip_local_deliver+0x19d/0x480 [10536.607541][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10536.607828][ C1] ? rcu_read_lock_held+0xe/0x50 [10536.608094][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10536.608371][ C1] ? rcu_read_lock_held+0xe/0x50 [10536.608634][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10536.608973][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10536.609247][ C1] ip_rcv+0x564/0x740 [10536.609458][ C1] ? __pfx_ip_rcv+0x10/0x10 [10536.609698][ C1] ? set_track_prepare+0x8a/0xd0 [10536.609960][ C1] ? irqentry_enter+0x2b/0x60 [10536.610215][ C1] ? irqentry_enter+0x2b/0x60 [10536.610470][ C1] ? __pfx_ip_rcv+0x10/0x10 [10536.610714][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10536.611035][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10536.611377][ C1] ? netif_receive_skb_internal+0x84/0x300 [10536.611688][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10536.612026][ C1] netif_receive_skb_internal+0xb0/0x300 [10536.612324][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10536.612659][ C1] netif_receive_skb+0x55/0x280 [10536.612920][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10536.613252][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10536.613602][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10536.613915][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10536.614207][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10536.614513][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10536.614848][ C1] ? unwind_next_frame+0x1478/0x1d10 [10536.615133][ C1] ? arch_stack_walk+0x68/0x100 [10536.615400][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10536.615679][ C1] ? irqentry_enter+0x2b/0x60 [10536.615935][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10536.616262][ C1] ? irqentry_enter+0x2b/0x60 [10536.616511][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10536.616834][ C1] ? unwind_next_frame+0x1478/0x1d10 [10536.617120][ C1] ? arch_stack_walk+0x68/0x100 [10536.617380][ C1] __tcf_classify+0x32c/0x7d0 [10536.617633][ C1] tcf_classify+0x283/0x930 [10536.617876][ C1] ? __pfx_tcf_classify+0x10/0x10 [10536.618144][ C1] tc_run+0x2e4/0x5d0 [10536.618357][ C1] ? __pfx_tc_run+0x10/0x10 [10536.618598][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10536.618862][ C1] ? irqentry_enter+0x2b/0x60 [10536.619116][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10536.619404][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10536.619728][ C1] ip_finish_output2+0x786/0x18e0 [10536.619997][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10536.620291][ C1] ? rcu_read_lock_held+0xe/0x50 [10536.620557][ C1] ? __ip_finish_output+0x10f/0x770 [10536.620833][ C1] ip_output+0x16b/0x4f0 [10536.621061][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10536.621382][ C1] ? __pfx_ip_output+0x10/0x10 [10536.621636][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10536.621995][ C1] ? __pfx_ip_output+0x10/0x10 [10536.622253][ C1] __ip_queue_xmit+0x672/0x1910 [10536.622516][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10536.622799][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10536.623097][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10536.623384][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10536.623681][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10536.623974][ C1] tcp_delack_timer+0x84/0x240 [10536.624234][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10536.624520][ C1] call_timer_fn+0x176/0x430 [10536.624767][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10536.625045][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10536.625330][ C1] __run_timers.part.0+0x52d/0x890 [10536.625603][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10536.625889][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10536.626190][ C1] ? __pfx___schedule+0x10/0x10 [10536.626452][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10536.626775][ C1] run_timer_softirq+0x72/0x100 [10536.627035][ C1] __do_softirq+0x1bc/0x7ff [10536.627278][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10536.627550][ C1] run_ksoftirqd+0x2e/0x60 [10536.627790][ C1] smpboot_thread_fn+0x30e/0x840 [10536.628054][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10536.628345][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10536.628634][ C1] kthread+0x292/0x360 [10536.628856][ C1] ? __pfx_kthread+0x10/0x10 [10536.629104][ C1] ret_from_fork+0x34/0x70 [10536.629343][ C1] ? __pfx_kthread+0x10/0x10 [10536.629588][ C1] ret_from_fork_asm+0x1b/0x30 [10536.629848][ C1] [10564.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8732s! [swapper/0:0] [10564.527933][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10564.529147][ C0] irq event stamp: 27567077 [10564.529391][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10564.529924][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10564.530400][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10564.530903][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10564.531397][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10564.531876][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10564.532523][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10564.532869][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10564.533896][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10564.534222][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10564.534646][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10564.535072][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10564.535495][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10564.535911][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10564.536329][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10564.536796][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10564.537148][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10564.537572][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10564.537996][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10564.538418][ C0] Call Trace: [10564.538605][ C0] [10564.538761][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10564.539031][ C0] ? __run_hrtimer+0x1c3/0x710 [10564.539305][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10564.539596][ C0] ? __hrtimer_run_queues+0x197/0x270 [10564.539884][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10564.540194][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10564.540487][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10564.540805][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10564.541072][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10564.541350][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10564.541666][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10564.541968][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10564.542296][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10564.542591][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10564.542912][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10564.543217][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10564.543550][ C0] ? get_stack_info+0x36/0xc0 [10564.543800][ C0] ? lock_acquire+0x1c1/0x220 [10564.544050][ C0] ? lock_release+0x1d5/0x250 [10564.544298][ C0] do_raw_spin_lock+0x1ec/0x270 [10564.544557][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10564.544843][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10564.545147][ C0] ? lock_acquire+0x1c1/0x220 [10564.545399][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10564.545652][ C0] _raw_spin_lock_nested+0x65/0x80 [10564.545924][ C0] tcp_v4_rcv+0x2159/0x29b0 [10564.546176][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10564.546447][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10564.546713][ C0] ? __inet_lookup_established+0x341/0x610 [10564.547046][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10564.547333][ C0] ip_local_deliver_finish+0x2ae/0x450 [10564.547621][ C0] ip_local_deliver+0x19d/0x480 [10564.547885][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10564.548173][ C0] ? rcu_read_lock_held+0xe/0x50 [10564.548442][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10564.548718][ C0] ? rcu_read_lock_held+0xe/0x50 [10564.548979][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10564.549319][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10564.549603][ C0] ip_rcv+0x564/0x740 [10564.549808][ C0] ? __pfx_ip_rcv+0x10/0x10 [10564.550043][ C0] ? set_track_prepare+0x8a/0xd0 [10564.550301][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10564.550600][ C0] ? rest_init+0x153/0x260 [10564.550834][ C0] ? skb_clone+0x10b/0x330 [10564.551078][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10564.551411][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10564.551728][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10564.552026][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10564.552339][ C0] ? __tcf_classify+0x32c/0x7d0 [10564.552599][ C0] ? __pfx_ip_rcv+0x10/0x10 [10564.552843][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10564.553160][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10564.553461][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10564.553799][ C0] ? lock_acquire+0x1c1/0x220 [10564.554047][ C0] ? netif_receive_skb_internal+0x84/0x300 [10564.554355][ C0] netif_receive_skb_internal+0xb0/0x300 [10564.554657][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10564.554987][ C0] ? __copy_skb_header+0xaf/0x490 [10564.555261][ C0] ? __skb_clone+0x57a/0x760 [10564.555509][ C0] netif_receive_skb+0x55/0x280 [10564.555764][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10564.556088][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10564.556436][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10564.556751][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10564.557039][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10564.557363][ C0] ? hlock_class+0x4e/0x130 [10564.557607][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10564.557935][ C0] ? place_entity+0x21/0x2f0 [10564.558181][ C0] ? resched_curr+0x219/0x280 [10564.558435][ C0] ? __pfx_resched_curr+0x10/0x10 [10564.558706][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10564.558990][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10564.559268][ C0] ? wakeup_preempt+0x161/0x2c0 [10564.559526][ C0] ? activate_task+0xf5/0x260 [10564.559777][ C0] ? trace_sched_wakeup+0xd2/0x100 [10564.560052][ C0] ? do_raw_spin_unlock+0x58/0x220 [10564.560327][ C0] ? _raw_spin_unlock+0x23/0x40 [10564.560582][ C0] ? get_stack_info_noinstr+0x18/0x110 [10564.560877][ C0] ? get_stack_info+0x36/0xc0 [10564.561126][ C0] ? stack_access_ok+0xda/0x1f0 [10564.561403][ C0] ? get_reg+0x119/0x190 [10564.561630][ C0] __tcf_classify+0x32c/0x7d0 [10564.561879][ C0] tcf_classify+0x283/0x930 [10564.562118][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10564.562455][ C0] ? __pfx_tcf_classify+0x10/0x10 [10564.562716][ C0] ? arch_stack_walk+0x8c/0x100 [10564.562975][ C0] ? get_stack_info_noinstr+0x18/0x110 [10564.563279][ C0] tc_run+0x2e4/0x5d0 [10564.563491][ C0] ? __pfx_tc_run+0x10/0x10 [10564.563730][ C0] ? lock_acquire+0x1c1/0x220 [10564.563979][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10564.564252][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10564.564548][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10564.564833][ C0] ? ip_finish_output2+0x786/0x18e0 [10564.565115][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10564.565437][ C0] ? neigh_hh_output+0x348/0x590 [10564.565700][ C0] ? ip_finish_output2+0x262/0x18e0 [10564.565979][ C0] ip_finish_output2+0x786/0x18e0 [10564.566252][ C0] ? stack_depot_save_flags+0x45/0x550 [10564.566547][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10564.566902][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10564.567190][ C0] ? rcu_read_lock_held+0xe/0x50 [10564.567457][ C0] ? __ip_finish_output+0x10f/0x770 [10564.567734][ C0] ip_output+0x16b/0x4f0 [10564.567960][ C0] ? __run_timers.part.0+0x52d/0x890 [10564.568246][ C0] ? __pfx_ip_output+0x10/0x10 [10564.568497][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10564.568799][ C0] ? rcu_read_lock_held+0xe/0x50 [10564.569063][ C0] ? ip_local_out+0x114/0x3b0 [10564.569316][ C0] __ip_queue_xmit+0x672/0x1910 [10564.569578][ C0] ? __skb_clone+0x57a/0x760 [10564.569826][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10564.570107][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10564.570400][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10564.570719][ C0] tcp_write_xmit+0xe42/0x24c0 [10564.570980][ C0] ? tcp_current_mss+0x40a/0x510 [10564.571243][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10564.571525][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10564.571803][ C0] ? mark_lock_irq+0x6e2/0xa10 [10564.572056][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10564.572326][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10564.572649][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10564.572923][ C0] ? ktime_get+0xb6/0x190 [10564.573154][ C0] tcp_send_loss_probe+0x4c9/0x830 [10564.573425][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10564.573708][ C0] tcp_write_timer+0x82/0x1d0 [10564.573958][ C0] call_timer_fn+0x176/0x430 [10564.574203][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10564.574479][ C0] ? next_expiry_recalc+0xcd/0x220 [10564.574751][ C0] __run_timers.part.0+0x52d/0x890 [10564.575026][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10564.575315][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10564.575613][ C0] ? lock_acquire+0x1c1/0x220 [10564.575865][ C0] ? clockevents_program_event+0xf6/0x300 [10564.576174][ C0] ? lock_release+0x1d5/0x250 [10564.576438][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10564.576709][ C0] ? ktime_get+0xb6/0x190 [10564.576936][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10564.577229][ C0] ? clockevents_program_event+0x1ed/0x300 [10564.577531][ C0] run_timer_softirq+0x72/0x100 [10564.577786][ C0] __do_softirq+0x1bc/0x7ff [10564.578028][ C0] irq_exit_rcu+0x98/0xc0 [10564.578254][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10564.578550][ C0] [10564.578702][ C0] [10564.578854][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10564.579165][ C0] RIP: 0010:default_idle+0xf/0x20 [10564.579452][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10564.580487][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10564.580811][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10564.581222][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10564.581632][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10564.582045][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10564.582460][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10564.582875][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10564.583172][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10564.583463][ C0] default_idle_call+0x69/0xa0 [10564.583714][ C0] cpuidle_idle_call+0x1f6/0x280 [10564.583981][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10564.584275][ C0] ? lock_release+0x1d5/0x250 [10564.584540][ C0] do_idle+0xfb/0x160 [10564.584750][ C0] cpu_startup_entry+0x55/0x60 [10564.585000][ C0] rest_init+0x153/0x260 [10564.585244][ C0] ? acpi_enable_subsystem+0xac/0x150 [10564.585532][ C0] arch_call_rest_init+0x13/0x40 [10564.585798][ C0] start_kernel+0x314/0x3d0 [10564.586045][ C0] x86_64_start_reservations+0x18/0x30 [10564.586340][ C0] x86_64_start_kernel+0xba/0x110 [10564.586607][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10564.586931][ C0] [10564.587095][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8732s! [ksoftirqd/1:22] [10564.587545][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10564.588734][ C1] irq event stamp: 3886976 [10564.588970][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10564.589461][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10564.589949][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10564.590444][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10564.590935][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10564.591421][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10564.592055][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10564.592390][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10564.593403][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10564.593722][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10564.594139][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10564.594556][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10564.594973][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10564.595400][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10564.595822][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10564.596297][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10564.596644][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10564.597069][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10564.597494][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10564.597913][ C1] Call Trace: [10564.598092][ C1] [10564.598246][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10564.598521][ C1] ? __run_hrtimer+0x1c3/0x710 [10564.598773][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10564.599068][ C1] ? __hrtimer_run_queues+0x197/0x270 [10564.599354][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10564.599655][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10564.599931][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10564.600255][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10564.600533][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10564.600857][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10564.601165][ C1] [10564.601325][ C1] [10564.601486][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10564.601818][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10564.602122][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10564.602429][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10564.602734][ C1] ? run_ksoftirqd+0xb/0x60 [10564.602980][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10564.603310][ C1] ? __orc_find+0x9c/0xf0 [10564.603542][ C1] ? lock_acquire+0x1c1/0x220 [10564.603793][ C1] ? irqentry_enter+0x2b/0x60 [10564.604045][ C1] do_raw_spin_lock+0x1ec/0x270 [10564.604305][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10564.604587][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10564.604883][ C1] ? lock_acquire+0x1c1/0x220 [10564.605141][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10564.605390][ C1] _raw_spin_lock_nested+0x65/0x80 [10564.605664][ C1] tcp_v4_rcv+0x2159/0x29b0 [10564.605918][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10564.606180][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10564.606452][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10564.606748][ C1] ip_local_deliver_finish+0x2ae/0x450 [10564.607043][ C1] ip_local_deliver+0x19d/0x480 [10564.607301][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10564.607587][ C1] ? rcu_read_lock_held+0xe/0x50 [10564.607851][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10564.608132][ C1] ? rcu_read_lock_held+0xe/0x50 [10564.608396][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10564.608731][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10564.609009][ C1] ip_rcv+0x564/0x740 [10564.609224][ C1] ? __pfx_ip_rcv+0x10/0x10 [10564.609468][ C1] ? set_track_prepare+0x8a/0xd0 [10564.609733][ C1] ? irqentry_enter+0x2b/0x60 [10564.609982][ C1] ? irqentry_enter+0x2b/0x60 [10564.610232][ C1] ? __pfx_ip_rcv+0x10/0x10 [10564.610471][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10564.610786][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10564.611126][ C1] ? netif_receive_skb_internal+0x84/0x300 [10564.611434][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10564.611776][ C1] netif_receive_skb_internal+0xb0/0x300 [10564.612079][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10564.612411][ C1] netif_receive_skb+0x55/0x280 [10564.612670][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10564.612997][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10564.613344][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10564.613663][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10564.613950][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10564.614253][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10564.614581][ C1] ? unwind_next_frame+0x1478/0x1d10 [10564.614862][ C1] ? arch_stack_walk+0x68/0x100 [10564.615133][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10564.615410][ C1] ? irqentry_enter+0x2b/0x60 [10564.615658][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10564.615975][ C1] ? irqentry_enter+0x2b/0x60 [10564.616231][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10564.616558][ C1] ? unwind_next_frame+0x1478/0x1d10 [10564.616838][ C1] ? arch_stack_walk+0x68/0x100 [10564.617104][ C1] __tcf_classify+0x32c/0x7d0 [10564.617361][ C1] tcf_classify+0x283/0x930 [10564.617611][ C1] ? __pfx_tcf_classify+0x10/0x10 [10564.617884][ C1] tc_run+0x2e4/0x5d0 [10564.618100][ C1] ? __pfx_tc_run+0x10/0x10 [10564.618347][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10564.618615][ C1] ? irqentry_enter+0x2b/0x60 [10564.618864][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10564.619149][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10564.619469][ C1] ip_finish_output2+0x786/0x18e0 [10564.619742][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10564.620038][ C1] ? rcu_read_lock_held+0xe/0x50 [10564.620302][ C1] ? __ip_finish_output+0x10f/0x770 [10564.620585][ C1] ip_output+0x16b/0x4f0 [10564.620813][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10564.621131][ C1] ? __pfx_ip_output+0x10/0x10 [10564.621391][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10564.621744][ C1] ? __pfx_ip_output+0x10/0x10 [10564.622001][ C1] __ip_queue_xmit+0x672/0x1910 [10564.622267][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10564.622552][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10564.622851][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10564.623142][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10564.623439][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10564.623726][ C1] tcp_delack_timer+0x84/0x240 [10564.623983][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10564.624268][ C1] call_timer_fn+0x176/0x430 [10564.624513][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10564.624790][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10564.625069][ C1] __run_timers.part.0+0x52d/0x890 [10564.625353][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10564.625638][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10564.625938][ C1] ? __pfx___schedule+0x10/0x10 [10564.626204][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10564.626524][ C1] run_timer_softirq+0x72/0x100 [10564.626784][ C1] __do_softirq+0x1bc/0x7ff [10564.627025][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10564.627298][ C1] run_ksoftirqd+0x2e/0x60 [10564.627540][ C1] smpboot_thread_fn+0x30e/0x840 [10564.627806][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10564.628099][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10564.628388][ C1] kthread+0x292/0x360 [10564.628609][ C1] ? __pfx_kthread+0x10/0x10 [10564.628854][ C1] ret_from_fork+0x34/0x70 [10564.629097][ C1] ? __pfx_kthread+0x10/0x10 [10564.629341][ C1] ret_from_fork_asm+0x1b/0x30 [10564.629602][ C1] [10590.489024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [10590.489426][ C0] rcu: 0-....: (9335781 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=2229745 [10590.489950][ C0] rcu: (t=9396180 jiffies g=1007429 q=31 ncpus=4) [10590.490300][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10590.490779][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10590.491428][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10590.491780][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10590.492806][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10590.493133][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10590.493558][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10590.493979][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10590.494401][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10590.494825][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10590.495254][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10590.495724][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10590.496078][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10590.496502][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10590.496929][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10590.497351][ C0] Call Trace: [10590.497531][ C0] [10590.497692][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10590.497978][ C0] ? print_cpu_stall+0x263/0x6a0 [10590.498245][ C0] ? check_cpu_stall+0x284/0x500 [10590.498509][ C0] ? rcu_pending+0x92/0x360 [10590.498755][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [10590.499043][ C0] ? update_process_times+0xb9/0x110 [10590.499325][ C0] ? tick_sched_handle+0x67/0x130 [10590.499601][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [10590.499903][ C0] ? __run_hrtimer+0x1c3/0x710 [10590.500155][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10590.500497][ C0] ? __hrtimer_run_queues+0x197/0x270 [10590.500795][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10590.501096][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10590.501373][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10590.501690][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10590.501965][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10590.502239][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10590.502566][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10590.502879][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10590.503206][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10590.503512][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10590.503822][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10590.504127][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10590.504451][ C0] ? get_stack_info+0x36/0xc0 [10590.504710][ C0] ? lock_acquire+0x1c1/0x220 [10590.504966][ C0] ? lock_release+0x1d5/0x250 [10590.505222][ C0] do_raw_spin_lock+0x1ec/0x270 [10590.505481][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10590.505766][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10590.506064][ C0] ? lock_acquire+0x1c1/0x220 [10590.506339][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10590.506596][ C0] _raw_spin_lock_nested+0x65/0x80 [10590.506871][ C0] tcp_v4_rcv+0x2159/0x29b0 [10590.507116][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10590.507374][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10590.507643][ C0] ? __inet_lookup_established+0x341/0x610 [10590.507955][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10590.508249][ C0] ip_local_deliver_finish+0x2ae/0x450 [10590.508543][ C0] ip_local_deliver+0x19d/0x480 [10590.508806][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10590.509104][ C0] ? rcu_read_lock_held+0xe/0x50 [10590.509380][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10590.509660][ C0] ? rcu_read_lock_held+0xe/0x50 [10590.509924][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10590.510257][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10590.510535][ C0] ip_rcv+0x564/0x740 [10590.510748][ C0] ? __pfx_ip_rcv+0x10/0x10 [10590.510991][ C0] ? set_track_prepare+0x8a/0xd0 [10590.511258][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10590.511544][ C0] ? rest_init+0x153/0x260 [10590.511784][ C0] ? skb_clone+0x10b/0x330 [10590.512023][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10590.512360][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10590.512680][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10590.512974][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10590.513284][ C0] ? __tcf_classify+0x32c/0x7d0 [10590.513531][ C0] ? __pfx_ip_rcv+0x10/0x10 [10590.513783][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10590.514098][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10590.514394][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10590.514735][ C0] ? lock_acquire+0x1c1/0x220 [10590.514989][ C0] ? netif_receive_skb_internal+0x84/0x300 [10590.515301][ C0] netif_receive_skb_internal+0xb0/0x300 [10590.515603][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10590.515931][ C0] ? __copy_skb_header+0xaf/0x490 [10590.516201][ C0] ? __skb_clone+0x57a/0x760 [10590.516453][ C0] netif_receive_skb+0x55/0x280 [10590.516706][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10590.517027][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10590.517369][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10590.517671][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10590.517952][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10590.518245][ C0] ? hlock_class+0x4e/0x130 [10590.518486][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10590.518832][ C0] ? place_entity+0x21/0x2f0 [10590.519083][ C0] ? resched_curr+0x219/0x280 [10590.519332][ C0] ? __pfx_resched_curr+0x10/0x10 [10590.519599][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10590.519879][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10590.520162][ C0] ? wakeup_preempt+0x161/0x2c0 [10590.520423][ C0] ? activate_task+0xf5/0x260 [10590.520676][ C0] ? trace_sched_wakeup+0xd2/0x100 [10590.520953][ C0] ? do_raw_spin_unlock+0x58/0x220 [10590.521226][ C0] ? _raw_spin_unlock+0x23/0x40 [10590.521488][ C0] ? get_stack_info_noinstr+0x18/0x110 [10590.521783][ C0] ? get_stack_info+0x36/0xc0 [10590.522034][ C0] ? stack_access_ok+0xda/0x1f0 [10590.522292][ C0] ? get_reg+0x119/0x190 [10590.522518][ C0] __tcf_classify+0x32c/0x7d0 [10590.522774][ C0] tcf_classify+0x283/0x930 [10590.523018][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10590.523352][ C0] ? __pfx_tcf_classify+0x10/0x10 [10590.523618][ C0] ? arch_stack_walk+0x8c/0x100 [10590.523879][ C0] ? get_stack_info_noinstr+0x18/0x110 [10590.524170][ C0] tc_run+0x2e4/0x5d0 [10590.524385][ C0] ? __pfx_tc_run+0x10/0x10 [10590.524633][ C0] ? lock_acquire+0x1c1/0x220 [10590.524885][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10590.525169][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10590.525440][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10590.525724][ C0] ? ip_finish_output2+0x786/0x18e0 [10590.526002][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10590.526321][ C0] ? neigh_hh_output+0x348/0x590 [10590.526596][ C0] ? ip_finish_output2+0x262/0x18e0 [10590.526864][ C0] ip_finish_output2+0x786/0x18e0 [10590.527126][ C0] ? stack_depot_save_flags+0x45/0x550 [10590.527432][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10590.527787][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10590.528079][ C0] ? rcu_read_lock_held+0xe/0x50 [10590.528342][ C0] ? __ip_finish_output+0x10f/0x770 [10590.528623][ C0] ip_output+0x16b/0x4f0 [10590.528850][ C0] ? __run_timers.part.0+0x52d/0x890 [10590.529137][ C0] ? __pfx_ip_output+0x10/0x10 [10590.529386][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10590.529678][ C0] ? rcu_read_lock_held+0xe/0x50 [10590.529935][ C0] ? ip_local_out+0x114/0x3b0 [10590.530179][ C0] __ip_queue_xmit+0x672/0x1910 [10590.530450][ C0] ? __skb_clone+0x57a/0x760 [10590.530694][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10590.530977][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10590.531274][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10590.531597][ C0] tcp_write_xmit+0xe42/0x24c0 [10590.531853][ C0] ? tcp_current_mss+0x40a/0x510 [10590.532117][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10590.532395][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10590.532674][ C0] ? mark_lock_irq+0x6e2/0xa10 [10590.532930][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10590.533197][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10590.533513][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10590.533792][ C0] ? ktime_get+0xb6/0x190 [10590.534026][ C0] tcp_send_loss_probe+0x4c9/0x830 [10590.534301][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10590.534580][ C0] tcp_write_timer+0x82/0x1d0 [10590.534837][ C0] call_timer_fn+0x176/0x430 [10590.535090][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10590.535367][ C0] ? next_expiry_recalc+0xcd/0x220 [10590.535640][ C0] __run_timers.part.0+0x52d/0x890 [10590.535914][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10590.536199][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10590.536499][ C0] ? lock_acquire+0x1c1/0x220 [10590.536745][ C0] ? clockevents_program_event+0xf6/0x300 [10590.537051][ C0] ? lock_release+0x1d5/0x250 [10590.537294][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10590.537581][ C0] ? ktime_get+0xb6/0x190 [10590.537810][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10590.538106][ C0] ? clockevents_program_event+0x1ed/0x300 [10590.538419][ C0] run_timer_softirq+0x72/0x100 [10590.538677][ C0] __do_softirq+0x1bc/0x7ff [10590.538918][ C0] irq_exit_rcu+0x98/0xc0 [10590.539149][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10590.539450][ C0] [10590.539608][ C0] [10590.539766][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10590.540099][ C0] RIP: 0010:default_idle+0xf/0x20 [10590.540366][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10590.541385][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10590.541708][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10590.542125][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10590.542541][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10590.542969][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10590.543386][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10590.543809][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10590.544111][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10590.544382][ C0] default_idle_call+0x69/0xa0 [10590.544647][ C0] cpuidle_idle_call+0x1f6/0x280 [10590.544902][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10590.545214][ C0] ? lock_release+0x1d5/0x250 [10590.545469][ C0] do_idle+0xfb/0x160 [10590.545684][ C0] cpu_startup_entry+0x55/0x60 [10590.545940][ C0] rest_init+0x153/0x260 [10590.546167][ C0] ? acpi_enable_subsystem+0xac/0x150 [10590.546459][ C0] arch_call_rest_init+0x13/0x40 [10590.546726][ C0] start_kernel+0x314/0x3d0 [10590.546968][ C0] x86_64_start_reservations+0x18/0x30 [10590.547258][ C0] x86_64_start_kernel+0xba/0x110 [10590.547528][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10590.547857][ C0] [10590.548023][ C0] Sending NMI from CPU 0 to CPUs 1: [10590.548308][ C1] NMI backtrace for cpu 1 [10590.548314][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10590.548318][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10590.548320][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10590.548327][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10590.548330][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10590.548333][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10590.548335][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10590.548337][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10590.548338][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10590.548340][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10590.548342][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10590.548344][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10590.548347][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10590.548349][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10590.548350][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10590.548352][ C1] Call Trace: [10590.548354][ C1] [10590.548357][ C1] ? nmi_cpu_backtrace+0x112/0x220 [10590.548363][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [10590.548368][ C1] ? nmi_handle+0x156/0x420 [10590.548373][ C1] ? default_do_nmi+0x41/0x100 [10590.548376][ C1] ? exc_nmi+0xf3/0x120 [10590.548379][ C1] ? end_repeat_nmi+0xf/0x60 [10590.548383][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10590.548387][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10590.548390][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10590.548393][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10590.548397][ C1] [10590.548398][ C1] [10590.548398][ C1] ? run_ksoftirqd+0xb/0x60 [10590.548404][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10590.548406][ C1] ? __orc_find+0x9c/0xf0 [10590.548409][ C1] ? lock_acquire+0x1c1/0x220 [10590.548413][ C1] ? irqentry_enter+0x2b/0x60 [10590.548418][ C1] do_raw_spin_lock+0x1ec/0x270 [10590.548421][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10590.548424][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10590.548428][ C1] ? lock_acquire+0x1c1/0x220 [10590.548430][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10590.548435][ C1] _raw_spin_lock_nested+0x65/0x80 [10590.548438][ C1] tcp_v4_rcv+0x2159/0x29b0 [10590.548445][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10590.548448][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10590.548453][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10590.548459][ C1] ip_local_deliver_finish+0x2ae/0x450 [10590.548463][ C1] ip_local_deliver+0x19d/0x480 [10590.548466][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10590.548468][ C1] ? rcu_read_lock_held+0xe/0x50 [10590.548472][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10590.548477][ C1] ? rcu_read_lock_held+0xe/0x50 [10590.548480][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10590.548483][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10590.548492][ C1] ip_rcv+0x564/0x740 [10590.548496][ C1] ? __pfx_ip_rcv+0x10/0x10 [10590.548499][ C1] ? set_track_prepare+0x8a/0xd0 [10590.548502][ C1] ? irqentry_enter+0x2b/0x60 [10590.548505][ C1] ? irqentry_enter+0x2b/0x60 [10590.548509][ C1] ? __pfx_ip_rcv+0x10/0x10 [10590.548512][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10590.548516][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10590.548519][ C1] ? netif_receive_skb_internal+0x84/0x300 [10590.548523][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10590.548526][ C1] netif_receive_skb_internal+0xb0/0x300 [10590.548529][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10590.548534][ C1] netif_receive_skb+0x55/0x280 [10590.548537][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10590.548545][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10590.548552][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10590.548558][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10590.548564][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10590.548575][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10590.548585][ C1] ? unwind_next_frame+0x1478/0x1d10 [10590.548587][ C1] ? arch_stack_walk+0x68/0x100 [10590.548591][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10590.548595][ C1] ? irqentry_enter+0x2b/0x60 [10590.548598][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10590.548602][ C1] ? irqentry_enter+0x2b/0x60 [10590.548606][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10590.548613][ C1] ? unwind_next_frame+0x1478/0x1d10 [10590.548616][ C1] ? arch_stack_walk+0x68/0x100 [10590.548620][ C1] __tcf_classify+0x32c/0x7d0 [10590.548625][ C1] tcf_classify+0x283/0x930 [10590.548629][ C1] ? __pfx_tcf_classify+0x10/0x10 [10590.548633][ C1] tc_run+0x2e4/0x5d0 [10590.548637][ C1] ? __pfx_tc_run+0x10/0x10 [10590.548642][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10590.548647][ C1] ? irqentry_enter+0x2b/0x60 [10590.548650][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10590.548653][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10590.548660][ C1] ip_finish_output2+0x786/0x18e0 [10590.548665][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10590.548668][ C1] ? rcu_read_lock_held+0xe/0x50 [10590.548672][ C1] ? __ip_finish_output+0x10f/0x770 [10590.548676][ C1] ip_output+0x16b/0x4f0 [10590.548679][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10590.548683][ C1] ? __pfx_ip_output+0x10/0x10 [10590.548687][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10590.548695][ C1] ? __pfx_ip_output+0x10/0x10 [10590.548699][ C1] __ip_queue_xmit+0x672/0x1910 [10590.548704][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10590.548711][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10590.548715][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10590.548719][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10590.548723][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10590.548726][ C1] tcp_delack_timer+0x84/0x240 [10590.548729][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10590.548732][ C1] call_timer_fn+0x176/0x430 [10590.548736][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10590.548741][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10590.548746][ C1] __run_timers.part.0+0x52d/0x890 [10590.548749][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10590.548754][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10590.548758][ C1] ? __pfx___schedule+0x10/0x10 [10590.548763][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10590.548768][ C1] run_timer_softirq+0x72/0x100 [10590.548771][ C1] __do_softirq+0x1bc/0x7ff [10590.548775][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10590.548779][ C1] run_ksoftirqd+0x2e/0x60 [10590.548782][ C1] smpboot_thread_fn+0x30e/0x840 [10590.548787][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10590.548790][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10590.548794][ C1] kthread+0x292/0x360 [10590.548796][ C1] ? __pfx_kthread+0x10/0x10 [10590.548799][ C1] ret_from_fork+0x34/0x70 [10590.548803][ C1] ? __pfx_kthread+0x10/0x10 [10590.548805][ C1] ret_from_fork_asm+0x1b/0x30 [10590.548812][ C1] [10616.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8781s! [swapper/0:0] [10616.527928][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10616.529133][ C0] irq event stamp: 27567077 [10616.529377][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10616.529915][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10616.530391][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10616.530895][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10616.531387][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10616.531869][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10616.532521][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10616.532865][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10616.533893][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10616.534226][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10616.534649][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10616.535078][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10616.535497][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10616.535917][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10616.536337][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10616.536804][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10616.537162][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10616.537585][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10616.538005][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10616.538430][ C0] Call Trace: [10616.538614][ C0] [10616.538774][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10616.539052][ C0] ? __run_hrtimer+0x1c3/0x710 [10616.539309][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10616.539598][ C0] ? __hrtimer_run_queues+0x197/0x270 [10616.539886][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10616.540193][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10616.540476][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10616.540800][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10616.541075][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10616.541353][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10616.541678][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10616.541990][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10616.542323][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10616.542626][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10616.542934][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10616.543242][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10616.543572][ C0] ? get_stack_info+0x36/0xc0 [10616.543830][ C0] ? lock_acquire+0x1c1/0x220 [10616.544084][ C0] ? lock_release+0x1d5/0x250 [10616.544336][ C0] do_raw_spin_lock+0x1ec/0x270 [10616.544597][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10616.544893][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10616.545197][ C0] ? lock_acquire+0x1c1/0x220 [10616.545444][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10616.545697][ C0] _raw_spin_lock_nested+0x65/0x80 [10616.545971][ C0] tcp_v4_rcv+0x2159/0x29b0 [10616.546226][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10616.546490][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10616.546764][ C0] ? __inet_lookup_established+0x341/0x610 [10616.547089][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10616.547380][ C0] ip_local_deliver_finish+0x2ae/0x450 [10616.547672][ C0] ip_local_deliver+0x19d/0x480 [10616.547935][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10616.548224][ C0] ? rcu_read_lock_held+0xe/0x50 [10616.548492][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10616.548768][ C0] ? rcu_read_lock_held+0xe/0x50 [10616.549033][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10616.549373][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10616.549648][ C0] ip_rcv+0x564/0x740 [10616.549860][ C0] ? __pfx_ip_rcv+0x10/0x10 [10616.550101][ C0] ? set_track_prepare+0x8a/0xd0 [10616.550366][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10616.550660][ C0] ? rest_init+0x153/0x260 [10616.550896][ C0] ? skb_clone+0x10b/0x330 [10616.551141][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10616.551476][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10616.551796][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10616.552099][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10616.552411][ C0] ? __tcf_classify+0x32c/0x7d0 [10616.552674][ C0] ? __pfx_ip_rcv+0x10/0x10 [10616.552919][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10616.553241][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10616.553543][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10616.553886][ C0] ? lock_acquire+0x1c1/0x220 [10616.554133][ C0] ? netif_receive_skb_internal+0x84/0x300 [10616.554442][ C0] netif_receive_skb_internal+0xb0/0x300 [10616.554743][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10616.555081][ C0] ? __copy_skb_header+0xaf/0x490 [10616.555357][ C0] ? __skb_clone+0x57a/0x760 [10616.555606][ C0] netif_receive_skb+0x55/0x280 [10616.555863][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10616.556188][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10616.556535][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10616.556849][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10616.557134][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10616.557430][ C0] ? hlock_class+0x4e/0x130 [10616.557671][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10616.558000][ C0] ? place_entity+0x21/0x2f0 [10616.558249][ C0] ? resched_curr+0x219/0x280 [10616.558505][ C0] ? __pfx_resched_curr+0x10/0x10 [10616.558774][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10616.559059][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10616.559334][ C0] ? wakeup_preempt+0x161/0x2c0 [10616.559592][ C0] ? activate_task+0xf5/0x260 [10616.559839][ C0] ? trace_sched_wakeup+0xd2/0x100 [10616.560115][ C0] ? do_raw_spin_unlock+0x58/0x220 [10616.560392][ C0] ? _raw_spin_unlock+0x23/0x40 [10616.560650][ C0] ? get_stack_info_noinstr+0x18/0x110 [10616.560940][ C0] ? get_stack_info+0x36/0xc0 [10616.561198][ C0] ? stack_access_ok+0xda/0x1f0 [10616.561458][ C0] ? get_reg+0x119/0x190 [10616.561687][ C0] __tcf_classify+0x32c/0x7d0 [10616.561938][ C0] tcf_classify+0x283/0x930 [10616.562179][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10616.562504][ C0] ? __pfx_tcf_classify+0x10/0x10 [10616.562774][ C0] ? arch_stack_walk+0x8c/0x100 [10616.563039][ C0] ? get_stack_info_noinstr+0x18/0x110 [10616.563331][ C0] tc_run+0x2e4/0x5d0 [10616.563545][ C0] ? __pfx_tc_run+0x10/0x10 [10616.563784][ C0] ? lock_acquire+0x1c1/0x220 [10616.564037][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10616.564311][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10616.564579][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10616.564865][ C0] ? ip_finish_output2+0x786/0x18e0 [10616.565147][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10616.565472][ C0] ? neigh_hh_output+0x348/0x590 [10616.565736][ C0] ? ip_finish_output2+0x262/0x18e0 [10616.566019][ C0] ip_finish_output2+0x786/0x18e0 [10616.566291][ C0] ? stack_depot_save_flags+0x45/0x550 [10616.566586][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10616.566940][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10616.567233][ C0] ? rcu_read_lock_held+0xe/0x50 [10616.567501][ C0] ? __ip_finish_output+0x10f/0x770 [10616.567777][ C0] ip_output+0x16b/0x4f0 [10616.568006][ C0] ? __run_timers.part.0+0x52d/0x890 [10616.568294][ C0] ? __pfx_ip_output+0x10/0x10 [10616.568547][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10616.568851][ C0] ? rcu_read_lock_held+0xe/0x50 [10616.569114][ C0] ? ip_local_out+0x114/0x3b0 [10616.569367][ C0] __ip_queue_xmit+0x672/0x1910 [10616.569630][ C0] ? __skb_clone+0x57a/0x760 [10616.569880][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10616.570160][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10616.570452][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10616.570767][ C0] tcp_write_xmit+0xe42/0x24c0 [10616.571027][ C0] ? tcp_current_mss+0x40a/0x510 [10616.571290][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10616.571573][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10616.571847][ C0] ? mark_lock_irq+0x6e2/0xa10 [10616.572100][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10616.572372][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10616.572692][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10616.572967][ C0] ? ktime_get+0xb6/0x190 [10616.573199][ C0] tcp_send_loss_probe+0x4c9/0x830 [10616.573472][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10616.573755][ C0] tcp_write_timer+0x82/0x1d0 [10616.574004][ C0] call_timer_fn+0x176/0x430 [10616.574250][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10616.574526][ C0] ? next_expiry_recalc+0xcd/0x220 [10616.574800][ C0] __run_timers.part.0+0x52d/0x890 [10616.575082][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10616.575367][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10616.575665][ C0] ? lock_acquire+0x1c1/0x220 [10616.575916][ C0] ? clockevents_program_event+0xf6/0x300 [10616.576226][ C0] ? lock_release+0x1d5/0x250 [10616.576481][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10616.576761][ C0] ? ktime_get+0xb6/0x190 [10616.576996][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10616.577298][ C0] ? clockevents_program_event+0x1ed/0x300 [10616.577608][ C0] run_timer_softirq+0x72/0x100 [10616.577869][ C0] __do_softirq+0x1bc/0x7ff [10616.578116][ C0] irq_exit_rcu+0x98/0xc0 [10616.578349][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10616.578651][ C0] [10616.578808][ C0] [10616.578965][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10616.579286][ C0] RIP: 0010:default_idle+0xf/0x20 [10616.579558][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10616.580585][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10616.580911][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10616.581334][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10616.581760][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10616.582187][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10616.582611][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10616.583038][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10616.583345][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10616.583624][ C0] default_idle_call+0x69/0xa0 [10616.583876][ C0] cpuidle_idle_call+0x1f6/0x280 [10616.584144][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10616.584437][ C0] ? lock_release+0x1d5/0x250 [10616.584690][ C0] do_idle+0xfb/0x160 [10616.584909][ C0] cpu_startup_entry+0x55/0x60 [10616.585163][ C0] rest_init+0x153/0x260 [10616.585393][ C0] ? acpi_enable_subsystem+0xac/0x150 [10616.585680][ C0] arch_call_rest_init+0x13/0x40 [10616.585948][ C0] start_kernel+0x314/0x3d0 [10616.586193][ C0] x86_64_start_reservations+0x18/0x30 [10616.586487][ C0] x86_64_start_kernel+0xba/0x110 [10616.586754][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10616.587080][ C0] [10616.587243][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8781s! [ksoftirqd/1:22] [10616.587691][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10616.588885][ C1] irq event stamp: 3886976 [10616.589125][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10616.589618][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10616.590111][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10616.590606][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10616.591100][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10616.591594][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10616.592239][ C1] RIP: 0010:kasan_check_range+0x74/0x1c0 [10616.592540][ C1] Code: ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 <49> 01 c1 48 89 e8 49 8d 59 01 48 89 da 48 29 ea 48 83 fa 10 0f 8e [10616.593567][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000286 [10616.593894][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10616.594320][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [10616.594746][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: 1ffff110014131c3 [10616.595177][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10616.595596][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10616.596019][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10616.596489][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10616.596841][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10616.597261][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10616.597685][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10616.598109][ C1] Call Trace: [10616.598294][ C1] [10616.598448][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10616.598721][ C1] ? __run_hrtimer+0x1c3/0x710 [10616.598976][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10616.599265][ C1] ? __hrtimer_run_queues+0x197/0x270 [10616.599559][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10616.599865][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10616.600148][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10616.600469][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10616.600743][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10616.601073][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10616.601384][ C1] [10616.601540][ C1] [10616.601697][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10616.602026][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10616.602333][ C1] ? kasan_check_range+0x74/0x1c0 [10616.602605][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [10616.602901][ C1] ? run_ksoftirqd+0xb/0x60 [10616.603149][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10616.603480][ C1] ? __orc_find+0x9c/0xf0 [10616.603711][ C1] ? lock_acquire+0x1c1/0x220 [10616.603963][ C1] ? irqentry_enter+0x2b/0x60 [10616.604216][ C1] do_raw_spin_lock+0x1ec/0x270 [10616.604476][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10616.604762][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10616.605073][ C1] ? lock_acquire+0x1c1/0x220 [10616.605322][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10616.605572][ C1] _raw_spin_lock_nested+0x65/0x80 [10616.605845][ C1] tcp_v4_rcv+0x2159/0x29b0 [10616.606096][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10616.606361][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10616.606634][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10616.606924][ C1] ip_local_deliver_finish+0x2ae/0x450 [10616.607215][ C1] ip_local_deliver+0x19d/0x480 [10616.607480][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10616.607771][ C1] ? rcu_read_lock_held+0xe/0x50 [10616.608040][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10616.608318][ C1] ? rcu_read_lock_held+0xe/0x50 [10616.608580][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10616.608920][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10616.609195][ C1] ip_rcv+0x564/0x740 [10616.609409][ C1] ? __pfx_ip_rcv+0x10/0x10 [10616.609653][ C1] ? set_track_prepare+0x8a/0xd0 [10616.609917][ C1] ? irqentry_enter+0x2b/0x60 [10616.610171][ C1] ? irqentry_enter+0x2b/0x60 [10616.610424][ C1] ? __pfx_ip_rcv+0x10/0x10 [10616.610670][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10616.610989][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10616.611335][ C1] ? netif_receive_skb_internal+0x84/0x300 [10616.611648][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10616.611987][ C1] netif_receive_skb_internal+0xb0/0x300 [10616.612287][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10616.612624][ C1] netif_receive_skb+0x55/0x280 [10616.612887][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10616.613221][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10616.613572][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10616.613886][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10616.614180][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10616.614488][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10616.614819][ C1] ? unwind_next_frame+0x1478/0x1d10 [10616.615112][ C1] ? arch_stack_walk+0x68/0x100 [10616.615377][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10616.615657][ C1] ? irqentry_enter+0x2b/0x60 [10616.615911][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10616.616235][ C1] ? irqentry_enter+0x2b/0x60 [10616.616487][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10616.616809][ C1] ? unwind_next_frame+0x1478/0x1d10 [10616.617094][ C1] ? arch_stack_walk+0x68/0x100 [10616.617354][ C1] __tcf_classify+0x32c/0x7d0 [10616.617608][ C1] tcf_classify+0x283/0x930 [10616.617850][ C1] ? __pfx_tcf_classify+0x10/0x10 [10616.618120][ C1] tc_run+0x2e4/0x5d0 [10616.618334][ C1] ? __pfx_tc_run+0x10/0x10 [10616.618578][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10616.618844][ C1] ? irqentry_enter+0x2b/0x60 [10616.619098][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10616.619387][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10616.619715][ C1] ip_finish_output2+0x786/0x18e0 [10616.619985][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10616.620275][ C1] ? rcu_read_lock_held+0xe/0x50 [10616.620545][ C1] ? __ip_finish_output+0x10f/0x770 [10616.620824][ C1] ip_output+0x16b/0x4f0 [10616.621056][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10616.621380][ C1] ? __pfx_ip_output+0x10/0x10 [10616.621637][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10616.621994][ C1] ? __pfx_ip_output+0x10/0x10 [10616.622256][ C1] __ip_queue_xmit+0x672/0x1910 [10616.622519][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10616.622800][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10616.623097][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10616.623385][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10616.623681][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10616.623965][ C1] tcp_delack_timer+0x84/0x240 [10616.624220][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10616.624506][ C1] call_timer_fn+0x176/0x430 [10616.624755][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10616.625041][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10616.625318][ C1] __run_timers.part.0+0x52d/0x890 [10616.625590][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10616.625880][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10616.626182][ C1] ? __pfx___schedule+0x10/0x10 [10616.626441][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10616.626760][ C1] run_timer_softirq+0x72/0x100 [10616.627023][ C1] __do_softirq+0x1bc/0x7ff [10616.627269][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10616.627551][ C1] run_ksoftirqd+0x2e/0x60 [10616.627791][ C1] smpboot_thread_fn+0x30e/0x840 [10616.628066][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10616.628358][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10616.628650][ C1] kthread+0x292/0x360 [10616.628868][ C1] ? __pfx_kthread+0x10/0x10 [10616.629117][ C1] ret_from_fork+0x34/0x70 [10616.629354][ C1] ? __pfx_kthread+0x10/0x10 [10616.629603][ C1] ret_from_fork_asm+0x1b/0x30 [10616.629864][ C1] [10644.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8807s! [swapper/0:0] [10644.527932][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10644.529136][ C0] irq event stamp: 27567077 [10644.529375][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10644.529906][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10644.530385][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10644.530901][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10644.531412][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10644.531892][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10644.532546][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10644.532892][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10644.533916][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10644.534242][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10644.534671][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10644.535097][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10644.535516][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10644.535933][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10644.536354][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10644.536824][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10644.537177][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10644.537600][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10644.538027][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10644.538449][ C0] Call Trace: [10644.538630][ C0] [10644.538791][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10644.539073][ C0] ? __run_hrtimer+0x1c3/0x710 [10644.539333][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10644.539624][ C0] ? __hrtimer_run_queues+0x197/0x270 [10644.539913][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10644.540222][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10644.540506][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10644.540833][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10644.541108][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10644.541391][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10644.541717][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10644.542027][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10644.542364][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10644.542668][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10644.542977][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10644.543284][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10644.543612][ C0] ? get_stack_info+0x36/0xc0 [10644.543864][ C0] ? lock_acquire+0x1c1/0x220 [10644.544115][ C0] ? lock_release+0x1d5/0x250 [10644.544364][ C0] do_raw_spin_lock+0x1ec/0x270 [10644.544625][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10644.544914][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10644.545219][ C0] ? lock_acquire+0x1c1/0x220 [10644.545469][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10644.545723][ C0] _raw_spin_lock_nested+0x65/0x80 [10644.545997][ C0] tcp_v4_rcv+0x2159/0x29b0 [10644.546248][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10644.546510][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10644.546784][ C0] ? __inet_lookup_established+0x341/0x610 [10644.547101][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10644.547389][ C0] ip_local_deliver_finish+0x2ae/0x450 [10644.547680][ C0] ip_local_deliver+0x19d/0x480 [10644.547944][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10644.548234][ C0] ? rcu_read_lock_held+0xe/0x50 [10644.548502][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10644.548777][ C0] ? rcu_read_lock_held+0xe/0x50 [10644.549040][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10644.549385][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10644.549660][ C0] ip_rcv+0x564/0x740 [10644.549872][ C0] ? __pfx_ip_rcv+0x10/0x10 [10644.550113][ C0] ? set_track_prepare+0x8a/0xd0 [10644.550378][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10644.550668][ C0] ? rest_init+0x153/0x260 [10644.550903][ C0] ? skb_clone+0x10b/0x330 [10644.551146][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10644.551480][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10644.551797][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10644.552101][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10644.552414][ C0] ? __tcf_classify+0x32c/0x7d0 [10644.552675][ C0] ? __pfx_ip_rcv+0x10/0x10 [10644.552918][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10644.553237][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10644.553539][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10644.553877][ C0] ? lock_acquire+0x1c1/0x220 [10644.554124][ C0] ? netif_receive_skb_internal+0x84/0x300 [10644.554434][ C0] netif_receive_skb_internal+0xb0/0x300 [10644.554744][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10644.555080][ C0] ? __copy_skb_header+0xaf/0x490 [10644.555350][ C0] ? __skb_clone+0x57a/0x760 [10644.555599][ C0] netif_receive_skb+0x55/0x280 [10644.555854][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10644.556179][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10644.556527][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10644.556843][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10644.557134][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10644.557434][ C0] ? hlock_class+0x4e/0x130 [10644.557678][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10644.558007][ C0] ? place_entity+0x21/0x2f0 [10644.558254][ C0] ? resched_curr+0x219/0x280 [10644.558510][ C0] ? __pfx_resched_curr+0x10/0x10 [10644.558782][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10644.559069][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10644.559346][ C0] ? wakeup_preempt+0x161/0x2c0 [10644.559604][ C0] ? activate_task+0xf5/0x260 [10644.559859][ C0] ? trace_sched_wakeup+0xd2/0x100 [10644.560135][ C0] ? do_raw_spin_unlock+0x58/0x220 [10644.560411][ C0] ? _raw_spin_unlock+0x23/0x40 [10644.560668][ C0] ? get_stack_info_noinstr+0x18/0x110 [10644.560962][ C0] ? get_stack_info+0x36/0xc0 [10644.561218][ C0] ? stack_access_ok+0xda/0x1f0 [10644.561482][ C0] ? get_reg+0x119/0x190 [10644.561709][ C0] __tcf_classify+0x32c/0x7d0 [10644.561958][ C0] tcf_classify+0x283/0x930 [10644.562198][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10644.562527][ C0] ? __pfx_tcf_classify+0x10/0x10 [10644.562795][ C0] ? arch_stack_walk+0x8c/0x100 [10644.563063][ C0] ? get_stack_info_noinstr+0x18/0x110 [10644.563357][ C0] tc_run+0x2e4/0x5d0 [10644.563571][ C0] ? __pfx_tc_run+0x10/0x10 [10644.563812][ C0] ? lock_acquire+0x1c1/0x220 [10644.564063][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10644.564337][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10644.564609][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10644.564904][ C0] ? ip_finish_output2+0x786/0x18e0 [10644.565185][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10644.565512][ C0] ? neigh_hh_output+0x348/0x590 [10644.565775][ C0] ? ip_finish_output2+0x262/0x18e0 [10644.566057][ C0] ip_finish_output2+0x786/0x18e0 [10644.566331][ C0] ? stack_depot_save_flags+0x45/0x550 [10644.566627][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10644.566979][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10644.567268][ C0] ? rcu_read_lock_held+0xe/0x50 [10644.567537][ C0] ? __ip_finish_output+0x10f/0x770 [10644.567816][ C0] ip_output+0x16b/0x4f0 [10644.568044][ C0] ? __run_timers.part.0+0x52d/0x890 [10644.568331][ C0] ? __pfx_ip_output+0x10/0x10 [10644.568584][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10644.568887][ C0] ? rcu_read_lock_held+0xe/0x50 [10644.569152][ C0] ? ip_local_out+0x114/0x3b0 [10644.569406][ C0] __ip_queue_xmit+0x672/0x1910 [10644.569669][ C0] ? __skb_clone+0x57a/0x760 [10644.569919][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10644.570200][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10644.570495][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10644.570816][ C0] tcp_write_xmit+0xe42/0x24c0 [10644.571077][ C0] ? tcp_current_mss+0x40a/0x510 [10644.571341][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10644.571625][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10644.571900][ C0] ? mark_lock_irq+0x6e2/0xa10 [10644.572155][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10644.572425][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10644.572746][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10644.573022][ C0] ? ktime_get+0xb6/0x190 [10644.573253][ C0] tcp_send_loss_probe+0x4c9/0x830 [10644.573526][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10644.573810][ C0] tcp_write_timer+0x82/0x1d0 [10644.574065][ C0] call_timer_fn+0x176/0x430 [10644.574311][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10644.574588][ C0] ? next_expiry_recalc+0xcd/0x220 [10644.574865][ C0] __run_timers.part.0+0x52d/0x890 [10644.575138][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10644.575425][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10644.575723][ C0] ? lock_acquire+0x1c1/0x220 [10644.575974][ C0] ? clockevents_program_event+0xf6/0x300 [10644.576287][ C0] ? lock_release+0x1d5/0x250 [10644.576541][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10644.576821][ C0] ? ktime_get+0xb6/0x190 [10644.577057][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10644.577356][ C0] ? clockevents_program_event+0x1ed/0x300 [10644.577666][ C0] run_timer_softirq+0x72/0x100 [10644.577930][ C0] __do_softirq+0x1bc/0x7ff [10644.578179][ C0] irq_exit_rcu+0x98/0xc0 [10644.578411][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10644.578715][ C0] [10644.578871][ C0] [10644.579029][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10644.579347][ C0] RIP: 0010:default_idle+0xf/0x20 [10644.579620][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10644.580642][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10644.580970][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10644.581394][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10644.581816][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10644.582244][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10644.582671][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10644.583095][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10644.583400][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10644.583677][ C0] default_idle_call+0x69/0xa0 [10644.583929][ C0] cpuidle_idle_call+0x1f6/0x280 [10644.584199][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10644.584493][ C0] ? lock_release+0x1d5/0x250 [10644.584753][ C0] do_idle+0xfb/0x160 [10644.584967][ C0] cpu_startup_entry+0x55/0x60 [10644.585222][ C0] rest_init+0x153/0x260 [10644.585450][ C0] ? acpi_enable_subsystem+0xac/0x150 [10644.585739][ C0] arch_call_rest_init+0x13/0x40 [10644.586005][ C0] start_kernel+0x314/0x3d0 [10644.586252][ C0] x86_64_start_reservations+0x18/0x30 [10644.586551][ C0] x86_64_start_kernel+0xba/0x110 [10644.586818][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10644.587143][ C0] [10644.587307][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8807s! [ksoftirqd/1:22] [10644.587764][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10644.588965][ C1] irq event stamp: 3886976 [10644.589206][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10644.589700][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10644.590192][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10644.590687][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10644.591182][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10644.591674][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10644.592320][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10644.592659][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10644.593676][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10644.594000][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10644.594424][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10644.594851][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10644.595283][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10644.595709][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10644.596132][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10644.596603][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10644.596951][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10644.597373][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10644.597790][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10644.598209][ C1] Call Trace: [10644.598387][ C1] [10644.598540][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10644.598819][ C1] ? __run_hrtimer+0x1c3/0x710 [10644.599073][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10644.599364][ C1] ? __hrtimer_run_queues+0x197/0x270 [10644.599648][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10644.599950][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10644.600230][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10644.600549][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10644.600827][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10644.601152][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10644.601460][ C1] [10644.601620][ C1] [10644.601779][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10644.602113][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10644.602415][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10644.602726][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10644.603030][ C1] ? run_ksoftirqd+0xb/0x60 [10644.603281][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10644.603613][ C1] ? __orc_find+0x9c/0xf0 [10644.603844][ C1] ? lock_acquire+0x1c1/0x220 [10644.604098][ C1] ? irqentry_enter+0x2b/0x60 [10644.604351][ C1] do_raw_spin_lock+0x1ec/0x270 [10644.604612][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10644.604907][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10644.605209][ C1] ? lock_acquire+0x1c1/0x220 [10644.605457][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10644.605707][ C1] _raw_spin_lock_nested+0x65/0x80 [10644.605980][ C1] tcp_v4_rcv+0x2159/0x29b0 [10644.606231][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10644.606495][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10644.606767][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10644.607057][ C1] ip_local_deliver_finish+0x2ae/0x450 [10644.607348][ C1] ip_local_deliver+0x19d/0x480 [10644.607607][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10644.607891][ C1] ? rcu_read_lock_held+0xe/0x50 [10644.608158][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10644.608440][ C1] ? rcu_read_lock_held+0xe/0x50 [10644.608706][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10644.609042][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10644.609320][ C1] ip_rcv+0x564/0x740 [10644.609535][ C1] ? __pfx_ip_rcv+0x10/0x10 [10644.609782][ C1] ? set_track_prepare+0x8a/0xd0 [10644.610049][ C1] ? irqentry_enter+0x2b/0x60 [10644.610299][ C1] ? irqentry_enter+0x2b/0x60 [10644.610548][ C1] ? __pfx_ip_rcv+0x10/0x10 [10644.610788][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10644.611101][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10644.611438][ C1] ? netif_receive_skb_internal+0x84/0x300 [10644.611746][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10644.612090][ C1] netif_receive_skb_internal+0xb0/0x300 [10644.612392][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10644.612723][ C1] netif_receive_skb+0x55/0x280 [10644.612984][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10644.613310][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10644.613658][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10644.613974][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10644.614262][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10644.614564][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10644.614897][ C1] ? unwind_next_frame+0x1478/0x1d10 [10644.615179][ C1] ? arch_stack_walk+0x68/0x100 [10644.615436][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10644.615713][ C1] ? irqentry_enter+0x2b/0x60 [10644.615963][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10644.616286][ C1] ? irqentry_enter+0x2b/0x60 [10644.616542][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10644.616865][ C1] ? unwind_next_frame+0x1478/0x1d10 [10644.617144][ C1] ? arch_stack_walk+0x68/0x100 [10644.617407][ C1] __tcf_classify+0x32c/0x7d0 [10644.617663][ C1] tcf_classify+0x283/0x930 [10644.617907][ C1] ? __pfx_tcf_classify+0x10/0x10 [10644.618182][ C1] tc_run+0x2e4/0x5d0 [10644.618398][ C1] ? __pfx_tc_run+0x10/0x10 [10644.618647][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10644.618918][ C1] ? irqentry_enter+0x2b/0x60 [10644.619168][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10644.619451][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10644.619774][ C1] ip_finish_output2+0x786/0x18e0 [10644.620046][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10644.620336][ C1] ? rcu_read_lock_held+0xe/0x50 [10644.620601][ C1] ? __ip_finish_output+0x10f/0x770 [10644.620882][ C1] ip_output+0x16b/0x4f0 [10644.621114][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10644.621434][ C1] ? __pfx_ip_output+0x10/0x10 [10644.621693][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10644.622045][ C1] ? __pfx_ip_output+0x10/0x10 [10644.622301][ C1] __ip_queue_xmit+0x672/0x1910 [10644.622567][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10644.622849][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10644.623151][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10644.623441][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10644.623738][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10644.624026][ C1] tcp_delack_timer+0x84/0x240 [10644.624282][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10644.624565][ C1] call_timer_fn+0x176/0x430 [10644.624819][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10644.625095][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10644.625376][ C1] __run_timers.part.0+0x52d/0x890 [10644.625651][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10644.625939][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10644.626240][ C1] ? __pfx___schedule+0x10/0x10 [10644.626503][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10644.626828][ C1] run_timer_softirq+0x72/0x100 [10644.627087][ C1] __do_softirq+0x1bc/0x7ff [10644.627328][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10644.627602][ C1] run_ksoftirqd+0x2e/0x60 [10644.627842][ C1] smpboot_thread_fn+0x30e/0x840 [10644.628110][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10644.628403][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10644.628693][ C1] kthread+0x292/0x360 [10644.628912][ C1] ? __pfx_kthread+0x10/0x10 [10644.629157][ C1] ret_from_fork+0x34/0x70 [10644.629398][ C1] ? __pfx_kthread+0x10/0x10 [10644.629645][ C1] ret_from_fork_asm+0x1b/0x30 [10644.629907][ C1] [10668.552025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [10668.552415][ C1] rcu: 1-....: (9401776 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=2247704 [10668.553002][ C1] rcu: (t=9474243 jiffies g=1007429 q=31 ncpus=4) [10668.553357][ C1] Sending NMI from CPU 1 to CPUs 0: [10668.553657][ C0] NMI backtrace for cpu 0 [10668.553664][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10668.553668][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10668.553671][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10668.553683][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10668.553686][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10668.553690][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10668.553692][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10668.553694][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10668.553695][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10668.553697][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10668.553699][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10668.553701][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10668.553705][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10668.553707][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10668.553709][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10668.553711][ C0] Call Trace: [10668.553716][ C0] [10668.553720][ C0] ? nmi_cpu_backtrace+0x112/0x220 [10668.553727][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [10668.553733][ C0] ? nmi_handle+0x156/0x420 [10668.553739][ C0] ? default_do_nmi+0x41/0x100 [10668.553744][ C0] ? exc_nmi+0xf3/0x120 [10668.553747][ C0] ? end_repeat_nmi+0xf/0x60 [10668.553752][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10668.553756][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10668.553760][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10668.553763][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10668.553766][ C0] [10668.553767][ C0] [10668.553769][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10668.553772][ C0] ? get_stack_info+0x36/0xc0 [10668.553777][ C0] ? lock_acquire+0x1c1/0x220 [10668.553782][ C0] ? lock_release+0x1d5/0x250 [10668.553786][ C0] do_raw_spin_lock+0x1ec/0x270 [10668.553790][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10668.553793][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10668.553796][ C0] ? lock_acquire+0x1c1/0x220 [10668.553798][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10668.553804][ C0] _raw_spin_lock_nested+0x65/0x80 [10668.553808][ C0] tcp_v4_rcv+0x2159/0x29b0 [10668.553815][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10668.553818][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10668.553822][ C0] ? __inet_lookup_established+0x341/0x610 [10668.553829][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10668.553837][ C0] ip_local_deliver_finish+0x2ae/0x450 [10668.553841][ C0] ip_local_deliver+0x19d/0x480 [10668.553845][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10668.553847][ C0] ? rcu_read_lock_held+0xe/0x50 [10668.553853][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10668.553857][ C0] ? rcu_read_lock_held+0xe/0x50 [10668.553860][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10668.553863][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10668.553875][ C0] ip_rcv+0x564/0x740 [10668.553878][ C0] ? __pfx_ip_rcv+0x10/0x10 [10668.553882][ C0] ? set_track_prepare+0x8a/0xd0 [10668.553886][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10668.553889][ C0] ? rest_init+0x153/0x260 [10668.553892][ C0] ? skb_clone+0x10b/0x330 [10668.553898][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10668.553904][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10668.553909][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10668.553915][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10668.553924][ C0] ? __tcf_classify+0x32c/0x7d0 [10668.553927][ C0] ? __pfx_ip_rcv+0x10/0x10 [10668.553930][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10668.553934][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10668.553937][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10668.553941][ C0] ? lock_acquire+0x1c1/0x220 [10668.553944][ C0] ? netif_receive_skb_internal+0x84/0x300 [10668.553947][ C0] netif_receive_skb_internal+0xb0/0x300 [10668.553950][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10668.553953][ C0] ? __copy_skb_header+0xaf/0x490 [10668.553956][ C0] ? __skb_clone+0x57a/0x760 [10668.553959][ C0] netif_receive_skb+0x55/0x280 [10668.553961][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10668.553970][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10668.553977][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10668.553983][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10668.553989][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10668.553998][ C0] ? hlock_class+0x4e/0x130 [10668.554004][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10668.554014][ C0] ? place_entity+0x21/0x2f0 [10668.554017][ C0] ? resched_curr+0x219/0x280 [10668.554022][ C0] ? __pfx_resched_curr+0x10/0x10 [10668.554025][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10668.554030][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10668.554035][ C0] ? wakeup_preempt+0x161/0x2c0 [10668.554037][ C0] ? activate_task+0xf5/0x260 [10668.554040][ C0] ? trace_sched_wakeup+0xd2/0x100 [10668.554046][ C0] ? do_raw_spin_unlock+0x58/0x220 [10668.554049][ C0] ? _raw_spin_unlock+0x23/0x40 [10668.554053][ C0] ? get_stack_info_noinstr+0x18/0x110 [10668.554056][ C0] ? get_stack_info+0x36/0xc0 [10668.554059][ C0] ? stack_access_ok+0xda/0x1f0 [10668.554062][ C0] ? get_reg+0x119/0x190 [10668.554066][ C0] __tcf_classify+0x32c/0x7d0 [10668.554070][ C0] tcf_classify+0x283/0x930 [10668.554073][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10668.554078][ C0] ? __pfx_tcf_classify+0x10/0x10 [10668.554080][ C0] ? arch_stack_walk+0x8c/0x100 [10668.554084][ C0] ? get_stack_info_noinstr+0x18/0x110 [10668.554088][ C0] tc_run+0x2e4/0x5d0 [10668.554093][ C0] ? __pfx_tc_run+0x10/0x10 [10668.554096][ C0] ? lock_acquire+0x1c1/0x220 [10668.554098][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10668.554103][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10668.554109][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10668.554112][ C0] ? ip_finish_output2+0x786/0x18e0 [10668.554115][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10668.554121][ C0] ? neigh_hh_output+0x348/0x590 [10668.554125][ C0] ? ip_finish_output2+0x262/0x18e0 [10668.554129][ C0] ip_finish_output2+0x786/0x18e0 [10668.554132][ C0] ? stack_depot_save_flags+0x45/0x550 [10668.554138][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10668.554146][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10668.554149][ C0] ? rcu_read_lock_held+0xe/0x50 [10668.554153][ C0] ? __ip_finish_output+0x10f/0x770 [10668.554157][ C0] ip_output+0x16b/0x4f0 [10668.554160][ C0] ? __run_timers.part.0+0x52d/0x890 [10668.554166][ C0] ? __pfx_ip_output+0x10/0x10 [10668.554169][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10668.554173][ C0] ? rcu_read_lock_held+0xe/0x50 [10668.554177][ C0] ? ip_local_out+0x114/0x3b0 [10668.554180][ C0] __ip_queue_xmit+0x672/0x1910 [10668.554185][ C0] ? __skb_clone+0x57a/0x760 [10668.554188][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10668.554196][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10668.554200][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10668.554204][ C0] tcp_write_xmit+0xe42/0x24c0 [10668.554209][ C0] ? tcp_current_mss+0x40a/0x510 [10668.554212][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10668.554215][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10668.554218][ C0] ? mark_lock_irq+0x6e2/0xa10 [10668.554220][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10668.554223][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10668.554227][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10668.554232][ C0] ? ktime_get+0xb6/0x190 [10668.554236][ C0] tcp_send_loss_probe+0x4c9/0x830 [10668.554240][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10668.554244][ C0] tcp_write_timer+0x82/0x1d0 [10668.554247][ C0] call_timer_fn+0x176/0x430 [10668.554251][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10668.554256][ C0] ? next_expiry_recalc+0xcd/0x220 [10668.554260][ C0] __run_timers.part.0+0x52d/0x890 [10668.554263][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10668.554268][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10668.554271][ C0] ? lock_acquire+0x1c1/0x220 [10668.554273][ C0] ? clockevents_program_event+0xf6/0x300 [10668.554277][ C0] ? lock_release+0x1d5/0x250 [10668.554280][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10668.554283][ C0] ? ktime_get+0xb6/0x190 [10668.554286][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10668.554290][ C0] ? clockevents_program_event+0x1ed/0x300 [10668.554294][ C0] run_timer_softirq+0x72/0x100 [10668.554298][ C0] __do_softirq+0x1bc/0x7ff [10668.554302][ C0] irq_exit_rcu+0x98/0xc0 [10668.554306][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10668.554310][ C0] [10668.554311][ C0] [10668.554312][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10668.554318][ C0] RIP: 0010:default_idle+0xf/0x20 [10668.554322][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10668.554324][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10668.554326][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10668.554328][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10668.554330][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10668.554331][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10668.554333][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10668.554337][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10668.554340][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10668.554344][ C0] default_idle_call+0x69/0xa0 [10668.554347][ C0] cpuidle_idle_call+0x1f6/0x280 [10668.554349][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10668.554355][ C0] ? lock_release+0x1d5/0x250 [10668.554359][ C0] do_idle+0xfb/0x160 [10668.554362][ C0] cpu_startup_entry+0x55/0x60 [10668.554364][ C0] rest_init+0x153/0x260 [10668.554366][ C0] ? acpi_enable_subsystem+0xac/0x150 [10668.554372][ C0] arch_call_rest_init+0x13/0x40 [10668.554378][ C0] start_kernel+0x314/0x3d0 [10668.554382][ C0] x86_64_start_reservations+0x18/0x30 [10668.554387][ C0] x86_64_start_kernel+0xba/0x110 [10668.554391][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10668.554399][ C0] [10668.554647][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10668.608726][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10668.609378][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10668.609725][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10668.610751][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10668.611079][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10668.611501][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10668.611926][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10668.612351][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10668.612770][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10668.613195][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10668.613667][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10668.614013][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10668.614435][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10668.614864][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10668.615286][ C1] Call Trace: [10668.615470][ C1] [10668.615625][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10668.615911][ C1] ? print_cpu_stall+0x263/0x6a0 [10668.616179][ C1] ? check_cpu_stall+0x284/0x500 [10668.616442][ C1] ? rcu_pending+0x92/0x360 [10668.616689][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [10668.616973][ C1] ? update_process_times+0xb9/0x110 [10668.617256][ C1] ? tick_sched_handle+0x67/0x130 [10668.617527][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [10668.617828][ C1] ? __run_hrtimer+0x1c3/0x710 [10668.618082][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10668.618412][ C1] ? __hrtimer_run_queues+0x197/0x270 [10668.618698][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10668.618999][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10668.619275][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10668.619594][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10668.619872][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10668.620195][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10668.620502][ C1] [10668.620663][ C1] [10668.620824][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10668.621156][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10668.621458][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10668.621766][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10668.622070][ C1] ? run_ksoftirqd+0xb/0x60 [10668.622315][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10668.622644][ C1] ? __orc_find+0x9c/0xf0 [10668.622873][ C1] ? lock_acquire+0x1c1/0x220 [10668.623123][ C1] ? irqentry_enter+0x2b/0x60 [10668.623374][ C1] do_raw_spin_lock+0x1ec/0x270 [10668.623632][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10668.623914][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10668.624216][ C1] ? lock_acquire+0x1c1/0x220 [10668.624470][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10668.624726][ C1] _raw_spin_lock_nested+0x65/0x80 [10668.624997][ C1] tcp_v4_rcv+0x2159/0x29b0 [10668.625248][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10668.625510][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10668.625782][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10668.626076][ C1] ip_local_deliver_finish+0x2ae/0x450 [10668.626371][ C1] ip_local_deliver+0x19d/0x480 [10668.626630][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10668.626914][ C1] ? rcu_read_lock_held+0xe/0x50 [10668.627177][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10668.627456][ C1] ? rcu_read_lock_held+0xe/0x50 [10668.627721][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10668.628054][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10668.628331][ C1] ip_rcv+0x564/0x740 [10668.628545][ C1] ? __pfx_ip_rcv+0x10/0x10 [10668.628789][ C1] ? set_track_prepare+0x8a/0xd0 [10668.629054][ C1] ? irqentry_enter+0x2b/0x60 [10668.629301][ C1] ? irqentry_enter+0x2b/0x60 [10668.629548][ C1] ? __pfx_ip_rcv+0x10/0x10 [10668.629787][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10668.630103][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10668.630441][ C1] ? netif_receive_skb_internal+0x84/0x300 [10668.630747][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10668.631091][ C1] netif_receive_skb_internal+0xb0/0x300 [10668.631393][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10668.631725][ C1] netif_receive_skb+0x55/0x280 [10668.631984][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10668.632312][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10668.632659][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10668.632977][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10668.633265][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10668.633567][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10668.633899][ C1] ? unwind_next_frame+0x1478/0x1d10 [10668.634181][ C1] ? arch_stack_walk+0x68/0x100 [10668.634446][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10668.634728][ C1] ? irqentry_enter+0x2b/0x60 [10668.634981][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10668.635297][ C1] ? irqentry_enter+0x2b/0x60 [10668.635550][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10668.635876][ C1] ? unwind_next_frame+0x1478/0x1d10 [10668.636156][ C1] ? arch_stack_walk+0x68/0x100 [10668.636423][ C1] __tcf_classify+0x32c/0x7d0 [10668.636680][ C1] tcf_classify+0x283/0x930 [10668.636926][ C1] ? __pfx_tcf_classify+0x10/0x10 [10668.637200][ C1] tc_run+0x2e4/0x5d0 [10668.637415][ C1] ? __pfx_tc_run+0x10/0x10 [10668.637660][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10668.637927][ C1] ? irqentry_enter+0x2b/0x60 [10668.638176][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10668.638458][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10668.638777][ C1] ip_finish_output2+0x786/0x18e0 [10668.639051][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10668.639344][ C1] ? rcu_read_lock_held+0xe/0x50 [10668.639609][ C1] ? __ip_finish_output+0x10f/0x770 [10668.639891][ C1] ip_output+0x16b/0x4f0 [10668.640119][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10668.640434][ C1] ? __pfx_ip_output+0x10/0x10 [10668.640696][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10668.641049][ C1] ? __pfx_ip_output+0x10/0x10 [10668.641306][ C1] __ip_queue_xmit+0x672/0x1910 [10668.641570][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10668.641853][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10668.642151][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10668.642438][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10668.642734][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10668.643020][ C1] tcp_delack_timer+0x84/0x240 [10668.643277][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10668.643559][ C1] call_timer_fn+0x176/0x430 [10668.643803][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10668.644080][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10668.644358][ C1] __run_timers.part.0+0x52d/0x890 [10668.644633][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10668.644917][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10668.645215][ C1] ? __pfx___schedule+0x10/0x10 [10668.645480][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10668.645799][ C1] run_timer_softirq+0x72/0x100 [10668.646057][ C1] __do_softirq+0x1bc/0x7ff [10668.646297][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10668.646569][ C1] run_ksoftirqd+0x2e/0x60 [10668.646810][ C1] smpboot_thread_fn+0x30e/0x840 [10668.647076][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10668.647368][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10668.647654][ C1] kthread+0x292/0x360 [10668.647878][ C1] ? __pfx_kthread+0x10/0x10 [10668.648126][ C1] ret_from_fork+0x34/0x70 [10668.648366][ C1] ? __pfx_kthread+0x10/0x10 [10668.648609][ C1] ret_from_fork_asm+0x1b/0x30 [10668.648871][ C1] [10696.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8855s! [swapper/0:0] [10696.527948][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10696.529152][ C0] irq event stamp: 27567077 [10696.529395][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10696.529935][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10696.530418][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10696.530927][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10696.531431][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10696.531916][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10696.532561][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa8/0xb90 [10696.532896][ C0] Code: 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 be 04 00 00 00 <48> 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c 08 84 c0 0f 85 [10696.533915][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10696.534236][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10696.534658][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10696.535081][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10696.535506][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10696.535925][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10696.536345][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10696.536819][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10696.537165][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10696.537586][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10696.538002][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10696.538420][ C0] Call Trace: [10696.538601][ C0] [10696.538757][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10696.539035][ C0] ? __run_hrtimer+0x1c3/0x710 [10696.539287][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10696.539581][ C0] ? __hrtimer_run_queues+0x197/0x270 [10696.539866][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10696.540167][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10696.540444][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10696.540763][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10696.541040][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10696.541317][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10696.541642][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10696.541956][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10696.542288][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10696.542593][ C0] ? queued_spin_lock_slowpath+0xa8/0xb90 [10696.542898][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10696.543202][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10696.543531][ C0] ? get_stack_info+0x36/0xc0 [10696.543782][ C0] ? lock_acquire+0x1c1/0x220 [10696.544032][ C0] ? lock_release+0x1d5/0x250 [10696.544280][ C0] do_raw_spin_lock+0x1ec/0x270 [10696.544547][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10696.544833][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10696.545135][ C0] ? lock_acquire+0x1c1/0x220 [10696.545384][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10696.545637][ C0] _raw_spin_lock_nested+0x65/0x80 [10696.545908][ C0] tcp_v4_rcv+0x2159/0x29b0 [10696.546157][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10696.546415][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10696.546688][ C0] ? __inet_lookup_established+0x341/0x610 [10696.547004][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10696.547292][ C0] ip_local_deliver_finish+0x2ae/0x450 [10696.547578][ C0] ip_local_deliver+0x19d/0x480 [10696.547839][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10696.548127][ C0] ? rcu_read_lock_held+0xe/0x50 [10696.548396][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10696.548672][ C0] ? rcu_read_lock_held+0xe/0x50 [10696.548935][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10696.549274][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10696.549554][ C0] ip_rcv+0x564/0x740 [10696.549772][ C0] ? __pfx_ip_rcv+0x10/0x10 [10696.550017][ C0] ? set_track_prepare+0x8a/0xd0 [10696.550285][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10696.550573][ C0] ? rest_init+0x153/0x260 [10696.550812][ C0] ? skb_clone+0x10b/0x330 [10696.551050][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10696.551391][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10696.551714][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10696.552007][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10696.552314][ C0] ? __tcf_classify+0x32c/0x7d0 [10696.552572][ C0] ? __pfx_ip_rcv+0x10/0x10 [10696.552813][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10696.553125][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10696.553420][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10696.553764][ C0] ? lock_acquire+0x1c1/0x220 [10696.554017][ C0] ? netif_receive_skb_internal+0x84/0x300 [10696.554328][ C0] netif_receive_skb_internal+0xb0/0x300 [10696.554632][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10696.554960][ C0] ? __copy_skb_header+0xaf/0x490 [10696.555228][ C0] ? __skb_clone+0x57a/0x760 [10696.555475][ C0] netif_receive_skb+0x55/0x280 [10696.555737][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10696.556070][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10696.556419][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10696.556732][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10696.557023][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10696.557328][ C0] ? hlock_class+0x4e/0x130 [10696.557577][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10696.557907][ C0] ? place_entity+0x21/0x2f0 [10696.558156][ C0] ? resched_curr+0x219/0x280 [10696.558404][ C0] ? __pfx_resched_curr+0x10/0x10 [10696.558670][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10696.558951][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10696.559235][ C0] ? wakeup_preempt+0x161/0x2c0 [10696.559495][ C0] ? activate_task+0xf5/0x260 [10696.559749][ C0] ? trace_sched_wakeup+0xd2/0x100 [10696.560028][ C0] ? do_raw_spin_unlock+0x58/0x220 [10696.560299][ C0] ? _raw_spin_unlock+0x23/0x40 [10696.560562][ C0] ? get_stack_info_noinstr+0x18/0x110 [10696.560853][ C0] ? get_stack_info+0x36/0xc0 [10696.561104][ C0] ? stack_access_ok+0xda/0x1f0 [10696.561359][ C0] ? get_reg+0x119/0x190 [10696.561585][ C0] __tcf_classify+0x32c/0x7d0 [10696.561839][ C0] tcf_classify+0x283/0x930 [10696.562085][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10696.562415][ C0] ? __pfx_tcf_classify+0x10/0x10 [10696.562680][ C0] ? arch_stack_walk+0x8c/0x100 [10696.562937][ C0] ? get_stack_info_noinstr+0x18/0x110 [10696.563225][ C0] tc_run+0x2e4/0x5d0 [10696.563447][ C0] ? __pfx_tc_run+0x10/0x10 [10696.563692][ C0] ? lock_acquire+0x1c1/0x220 [10696.563945][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10696.564224][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10696.564491][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10696.564777][ C0] ? ip_finish_output2+0x786/0x18e0 [10696.565054][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10696.565380][ C0] ? neigh_hh_output+0x348/0x590 [10696.565647][ C0] ? ip_finish_output2+0x262/0x18e0 [10696.565924][ C0] ip_finish_output2+0x786/0x18e0 [10696.566192][ C0] ? stack_depot_save_flags+0x45/0x550 [10696.566483][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10696.566839][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10696.567130][ C0] ? rcu_read_lock_held+0xe/0x50 [10696.567392][ C0] ? __ip_finish_output+0x10f/0x770 [10696.567673][ C0] ip_output+0x16b/0x4f0 [10696.567903][ C0] ? __run_timers.part.0+0x52d/0x890 [10696.568189][ C0] ? __pfx_ip_output+0x10/0x10 [10696.568447][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10696.568747][ C0] ? rcu_read_lock_held+0xe/0x50 [10696.569013][ C0] ? ip_local_out+0x114/0x3b0 [10696.569264][ C0] __ip_queue_xmit+0x672/0x1910 [10696.569524][ C0] ? __skb_clone+0x57a/0x760 [10696.569772][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10696.570056][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10696.570357][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10696.570676][ C0] tcp_write_xmit+0xe42/0x24c0 [10696.570931][ C0] ? tcp_current_mss+0x40a/0x510 [10696.571200][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10696.571481][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10696.571760][ C0] ? mark_lock_irq+0x6e2/0xa10 [10696.572018][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10696.572286][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10696.572605][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10696.572885][ C0] ? ktime_get+0xb6/0x190 [10696.573121][ C0] tcp_send_loss_probe+0x4c9/0x830 [10696.573397][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10696.573679][ C0] tcp_write_timer+0x82/0x1d0 [10696.573935][ C0] call_timer_fn+0x176/0x430 [10696.574187][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10696.574459][ C0] ? next_expiry_recalc+0xcd/0x220 [10696.574740][ C0] __run_timers.part.0+0x52d/0x890 [10696.575014][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10696.575295][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10696.575596][ C0] ? lock_acquire+0x1c1/0x220 [10696.575846][ C0] ? clockevents_program_event+0xf6/0x300 [10696.576151][ C0] ? lock_release+0x1d5/0x250 [10696.576400][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10696.576674][ C0] ? ktime_get+0xb6/0x190 [10696.576904][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10696.577203][ C0] ? clockevents_program_event+0x1ed/0x300 [10696.577514][ C0] run_timer_softirq+0x72/0x100 [10696.577773][ C0] __do_softirq+0x1bc/0x7ff [10696.578014][ C0] irq_exit_rcu+0x98/0xc0 [10696.578245][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10696.578542][ C0] [10696.578702][ C0] [10696.578863][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10696.579184][ C0] RIP: 0010:default_idle+0xf/0x20 [10696.579452][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10696.580464][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10696.580787][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10696.581205][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10696.581622][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10696.582038][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10696.582454][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10696.582873][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10696.583177][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10696.583453][ C0] default_idle_call+0x69/0xa0 [10696.583712][ C0] cpuidle_idle_call+0x1f6/0x280 [10696.583975][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10696.584269][ C0] ? lock_release+0x1d5/0x250 [10696.584522][ C0] do_idle+0xfb/0x160 [10696.584739][ C0] cpu_startup_entry+0x55/0x60 [10696.584997][ C0] rest_init+0x153/0x260 [10696.585224][ C0] ? acpi_enable_subsystem+0xac/0x150 [10696.585513][ C0] arch_call_rest_init+0x13/0x40 [10696.585783][ C0] start_kernel+0x314/0x3d0 [10696.586023][ C0] x86_64_start_reservations+0x18/0x30 [10696.586312][ C0] x86_64_start_kernel+0xba/0x110 [10696.586584][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10696.586917][ C0] [10696.587086][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8855s! [ksoftirqd/1:22] [10696.587538][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10696.588738][ C1] irq event stamp: 3886976 [10696.588975][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10696.589469][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10696.589959][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10696.590454][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10696.590947][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10696.591440][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10696.592083][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10696.592422][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10696.593439][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10696.593761][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10696.594181][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10696.594609][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10696.595041][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10696.595463][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10696.595886][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10696.596362][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10696.596711][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10696.597136][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10696.597557][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10696.597978][ C1] Call Trace: [10696.598159][ C1] [10696.598315][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10696.598590][ C1] ? __run_hrtimer+0x1c3/0x710 [10696.598844][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10696.599141][ C1] ? __hrtimer_run_queues+0x197/0x270 [10696.599427][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10696.599730][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10696.600007][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10696.600327][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10696.600606][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10696.600930][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10696.601240][ C1] [10696.601401][ C1] [10696.601562][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10696.601896][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10696.602199][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10696.602508][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10696.602813][ C1] ? run_ksoftirqd+0xb/0x60 [10696.603062][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10696.603393][ C1] ? __orc_find+0x9c/0xf0 [10696.603624][ C1] ? lock_acquire+0x1c1/0x220 [10696.603876][ C1] ? irqentry_enter+0x2b/0x60 [10696.604133][ C1] do_raw_spin_lock+0x1ec/0x270 [10696.604393][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10696.604685][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10696.604986][ C1] ? lock_acquire+0x1c1/0x220 [10696.605234][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10696.605484][ C1] _raw_spin_lock_nested+0x65/0x80 [10696.605758][ C1] tcp_v4_rcv+0x2159/0x29b0 [10696.606009][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10696.606273][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10696.606546][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10696.606838][ C1] ip_local_deliver_finish+0x2ae/0x450 [10696.607134][ C1] ip_local_deliver+0x19d/0x480 [10696.607394][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10696.607680][ C1] ? rcu_read_lock_held+0xe/0x50 [10696.607944][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10696.608223][ C1] ? rcu_read_lock_held+0xe/0x50 [10696.608489][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10696.608823][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10696.609102][ C1] ip_rcv+0x564/0x740 [10696.609317][ C1] ? __pfx_ip_rcv+0x10/0x10 [10696.609562][ C1] ? set_track_prepare+0x8a/0xd0 [10696.609827][ C1] ? irqentry_enter+0x2b/0x60 [10696.610078][ C1] ? irqentry_enter+0x2b/0x60 [10696.610328][ C1] ? __pfx_ip_rcv+0x10/0x10 [10696.610568][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10696.610889][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10696.611229][ C1] ? netif_receive_skb_internal+0x84/0x300 [10696.611537][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10696.611880][ C1] netif_receive_skb_internal+0xb0/0x300 [10696.612184][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10696.612517][ C1] netif_receive_skb+0x55/0x280 [10696.612776][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10696.613104][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10696.613450][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10696.613768][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10696.614058][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10696.614362][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10696.614701][ C1] ? unwind_next_frame+0x1478/0x1d10 [10696.614985][ C1] ? arch_stack_walk+0x68/0x100 [10696.615245][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10696.615521][ C1] ? irqentry_enter+0x2b/0x60 [10696.615769][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10696.616087][ C1] ? irqentry_enter+0x2b/0x60 [10696.616341][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10696.616672][ C1] ? unwind_next_frame+0x1478/0x1d10 [10696.616952][ C1] ? arch_stack_walk+0x68/0x100 [10696.617218][ C1] __tcf_classify+0x32c/0x7d0 [10696.617476][ C1] tcf_classify+0x283/0x930 [10696.617722][ C1] ? __pfx_tcf_classify+0x10/0x10 [10696.617995][ C1] tc_run+0x2e4/0x5d0 [10696.618211][ C1] ? __pfx_tc_run+0x10/0x10 [10696.618457][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10696.618728][ C1] ? irqentry_enter+0x2b/0x60 [10696.618977][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10696.619261][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10696.619581][ C1] ip_finish_output2+0x786/0x18e0 [10696.619854][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10696.620149][ C1] ? rcu_read_lock_held+0xe/0x50 [10696.620414][ C1] ? __ip_finish_output+0x10f/0x770 [10696.620697][ C1] ip_output+0x16b/0x4f0 [10696.620924][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10696.621242][ C1] ? __pfx_ip_output+0x10/0x10 [10696.621505][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10696.621859][ C1] ? __pfx_ip_output+0x10/0x10 [10696.622118][ C1] __ip_queue_xmit+0x672/0x1910 [10696.622383][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10696.622668][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10696.622966][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10696.623256][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10696.623553][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10696.623840][ C1] tcp_delack_timer+0x84/0x240 [10696.624099][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10696.624383][ C1] call_timer_fn+0x176/0x430 [10696.624633][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10696.624909][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10696.625190][ C1] __run_timers.part.0+0x52d/0x890 [10696.625466][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10696.625752][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10696.626053][ C1] ? __pfx___schedule+0x10/0x10 [10696.626318][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10696.626638][ C1] run_timer_softirq+0x72/0x100 [10696.626898][ C1] __do_softirq+0x1bc/0x7ff [10696.627140][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10696.627414][ C1] run_ksoftirqd+0x2e/0x60 [10696.627655][ C1] smpboot_thread_fn+0x30e/0x840 [10696.627921][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10696.628215][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10696.628503][ C1] kthread+0x292/0x360 [10696.628725][ C1] ? __pfx_kthread+0x10/0x10 [10696.628975][ C1] ret_from_fork+0x34/0x70 [10696.629218][ C1] ? __pfx_kthread+0x10/0x10 [10696.629462][ C1] ret_from_fork_asm+0x1b/0x30 [10696.629725][ C1] [10724.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8881s! [swapper/0:0] [10724.527927][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10724.529122][ C0] irq event stamp: 27567077 [10724.529361][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10724.529894][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10724.530373][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10724.530882][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10724.531384][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10724.531872][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10724.532517][ C0] RIP: 0010:kasan_check_range+0x12/0x1c0 [10724.532819][ C0] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [10724.533847][ C0] RSP: 0018:ffffc900000069c8 EFLAGS: 00000202 [10724.534175][ C0] RAX: ffff88800a099b58 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10724.534601][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [10724.535017][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10724.535437][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10724.535859][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10724.536279][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10724.536747][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10724.537103][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10724.537523][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10724.537944][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10724.538370][ C0] Call Trace: [10724.538558][ C0] [10724.538720][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10724.538995][ C0] ? __run_hrtimer+0x1c3/0x710 [10724.539253][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10724.539542][ C0] ? __hrtimer_run_queues+0x197/0x270 [10724.539831][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10724.540143][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10724.540427][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10724.540748][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10724.541020][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10724.541300][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10724.541622][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10724.541932][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10724.542271][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10724.542575][ C0] ? kasan_check_range+0x12/0x1c0 [10724.542842][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [10724.543138][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10724.543465][ C0] ? get_stack_info+0x36/0xc0 [10724.543724][ C0] ? lock_acquire+0x1c1/0x220 [10724.543981][ C0] ? lock_release+0x1d5/0x250 [10724.544237][ C0] do_raw_spin_lock+0x1ec/0x270 [10724.544505][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10724.544789][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10724.545087][ C0] ? lock_acquire+0x1c1/0x220 [10724.545337][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10724.545592][ C0] _raw_spin_lock_nested+0x65/0x80 [10724.545867][ C0] tcp_v4_rcv+0x2159/0x29b0 [10724.546114][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10724.546374][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10724.546640][ C0] ? __inet_lookup_established+0x341/0x610 [10724.546951][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10724.547246][ C0] ip_local_deliver_finish+0x2ae/0x450 [10724.547538][ C0] ip_local_deliver+0x19d/0x480 [10724.547796][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10724.548079][ C0] ? rcu_read_lock_held+0xe/0x50 [10724.548343][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10724.548623][ C0] ? rcu_read_lock_held+0xe/0x50 [10724.548889][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10724.549225][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10724.549501][ C0] ip_rcv+0x564/0x740 [10724.549718][ C0] ? __pfx_ip_rcv+0x10/0x10 [10724.549962][ C0] ? set_track_prepare+0x8a/0xd0 [10724.550230][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10724.550518][ C0] ? rest_init+0x153/0x260 [10724.550756][ C0] ? skb_clone+0x10b/0x330 [10724.550998][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10724.551335][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10724.551660][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10724.551954][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10724.552262][ C0] ? __tcf_classify+0x32c/0x7d0 [10724.552520][ C0] ? __pfx_ip_rcv+0x10/0x10 [10724.552759][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10724.553072][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10724.553368][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10724.553712][ C0] ? lock_acquire+0x1c1/0x220 [10724.553965][ C0] ? netif_receive_skb_internal+0x84/0x300 [10724.554278][ C0] netif_receive_skb_internal+0xb0/0x300 [10724.554582][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10724.554914][ C0] ? __copy_skb_header+0xaf/0x490 [10724.555181][ C0] ? __skb_clone+0x57a/0x760 [10724.555427][ C0] netif_receive_skb+0x55/0x280 [10724.555691][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10724.556021][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10724.556373][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10724.556683][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10724.556973][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10724.557276][ C0] ? hlock_class+0x4e/0x130 [10724.557524][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10724.557858][ C0] ? place_entity+0x21/0x2f0 [10724.558107][ C0] ? resched_curr+0x219/0x280 [10724.558358][ C0] ? __pfx_resched_curr+0x10/0x10 [10724.558623][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10724.558902][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10724.559183][ C0] ? wakeup_preempt+0x161/0x2c0 [10724.559444][ C0] ? activate_task+0xf5/0x260 [10724.559697][ C0] ? trace_sched_wakeup+0xd2/0x100 [10724.559976][ C0] ? do_raw_spin_unlock+0x58/0x220 [10724.560249][ C0] ? _raw_spin_unlock+0x23/0x40 [10724.560514][ C0] ? get_stack_info_noinstr+0x18/0x110 [10724.560806][ C0] ? get_stack_info+0x36/0xc0 [10724.561059][ C0] ? stack_access_ok+0xda/0x1f0 [10724.561317][ C0] ? get_reg+0x119/0x190 [10724.561544][ C0] __tcf_classify+0x32c/0x7d0 [10724.561801][ C0] tcf_classify+0x283/0x930 [10724.562048][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10724.562377][ C0] ? __pfx_tcf_classify+0x10/0x10 [10724.562642][ C0] ? arch_stack_walk+0x8c/0x100 [10724.562902][ C0] ? get_stack_info_noinstr+0x18/0x110 [10724.563191][ C0] tc_run+0x2e4/0x5d0 [10724.563410][ C0] ? __pfx_tc_run+0x10/0x10 [10724.563655][ C0] ? lock_acquire+0x1c1/0x220 [10724.563906][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10724.564184][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10724.564453][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10724.564737][ C0] ? ip_finish_output2+0x786/0x18e0 [10724.565014][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10724.565332][ C0] ? neigh_hh_output+0x348/0x590 [10724.565601][ C0] ? ip_finish_output2+0x262/0x18e0 [10724.565878][ C0] ip_finish_output2+0x786/0x18e0 [10724.566150][ C0] ? stack_depot_save_flags+0x45/0x550 [10724.566439][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10724.566796][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10724.567089][ C0] ? rcu_read_lock_held+0xe/0x50 [10724.567352][ C0] ? __ip_finish_output+0x10f/0x770 [10724.567632][ C0] ip_output+0x16b/0x4f0 [10724.567859][ C0] ? __run_timers.part.0+0x52d/0x890 [10724.568143][ C0] ? __pfx_ip_output+0x10/0x10 [10724.568402][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10724.568700][ C0] ? rcu_read_lock_held+0xe/0x50 [10724.568964][ C0] ? ip_local_out+0x114/0x3b0 [10724.569213][ C0] __ip_queue_xmit+0x672/0x1910 [10724.569472][ C0] ? __skb_clone+0x57a/0x760 [10724.569716][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10724.570000][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10724.570297][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10724.570617][ C0] tcp_write_xmit+0xe42/0x24c0 [10724.570874][ C0] ? tcp_current_mss+0x40a/0x510 [10724.571141][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10724.571424][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10724.571702][ C0] ? mark_lock_irq+0x6e2/0xa10 [10724.571957][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10724.572223][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10724.572540][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10724.572819][ C0] ? ktime_get+0xb6/0x190 [10724.573055][ C0] tcp_send_loss_probe+0x4c9/0x830 [10724.573330][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10724.573610][ C0] tcp_write_timer+0x82/0x1d0 [10724.573864][ C0] call_timer_fn+0x176/0x430 [10724.574114][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10724.574391][ C0] ? next_expiry_recalc+0xcd/0x220 [10724.574665][ C0] __run_timers.part.0+0x52d/0x890 [10724.574940][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10724.575221][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10724.575519][ C0] ? lock_acquire+0x1c1/0x220 [10724.575766][ C0] ? clockevents_program_event+0xf6/0x300 [10724.576071][ C0] ? lock_release+0x1d5/0x250 [10724.576322][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10724.576598][ C0] ? ktime_get+0xb6/0x190 [10724.576826][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10724.577123][ C0] ? clockevents_program_event+0x1ed/0x300 [10724.577435][ C0] run_timer_softirq+0x72/0x100 [10724.577695][ C0] __do_softirq+0x1bc/0x7ff [10724.577937][ C0] irq_exit_rcu+0x98/0xc0 [10724.578168][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10724.578465][ C0] [10724.578625][ C0] [10724.578785][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10724.579109][ C0] RIP: 0010:default_idle+0xf/0x20 [10724.579376][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10724.580389][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10724.580710][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10724.581127][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10724.581546][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10724.581963][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10724.582381][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10724.582799][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10724.583102][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10724.583374][ C0] default_idle_call+0x69/0xa0 [10724.583631][ C0] cpuidle_idle_call+0x1f6/0x280 [10724.583894][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10724.584188][ C0] ? lock_release+0x1d5/0x250 [10724.584443][ C0] do_idle+0xfb/0x160 [10724.584658][ C0] cpu_startup_entry+0x55/0x60 [10724.584914][ C0] rest_init+0x153/0x260 [10724.585140][ C0] ? acpi_enable_subsystem+0xac/0x150 [10724.585430][ C0] arch_call_rest_init+0x13/0x40 [10724.585699][ C0] start_kernel+0x314/0x3d0 [10724.585938][ C0] x86_64_start_reservations+0x18/0x30 [10724.586230][ C0] x86_64_start_kernel+0xba/0x110 [10724.586505][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10724.586834][ C0] [10724.587002][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8882s! [ksoftirqd/1:22] [10724.587454][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10724.588638][ C1] irq event stamp: 3886976 [10724.588872][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10724.589373][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10724.589872][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10724.590375][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10724.590862][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10724.591358][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10724.592002][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10724.592350][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10724.593378][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10724.593703][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10724.594126][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10724.594564][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10724.594982][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10724.595400][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10724.595816][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10724.596287][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10724.596637][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10724.597057][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10724.597481][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10724.597906][ C1] Call Trace: [10724.598087][ C1] [10724.598244][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10724.598517][ C1] ? __run_hrtimer+0x1c3/0x710 [10724.598776][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10724.599069][ C1] ? __hrtimer_run_queues+0x197/0x270 [10724.599359][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10724.599664][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10724.599944][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10724.600271][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10724.600543][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10724.600874][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10724.601188][ C1] [10724.601345][ C1] [10724.601501][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10724.601827][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10724.602135][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10724.602447][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10724.602748][ C1] ? run_ksoftirqd+0xb/0x60 [10724.602988][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10724.603314][ C1] ? __orc_find+0x9c/0xf0 [10724.603547][ C1] ? lock_acquire+0x1c1/0x220 [10724.603800][ C1] ? irqentry_enter+0x2b/0x60 [10724.604055][ C1] do_raw_spin_lock+0x1ec/0x270 [10724.604316][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10724.604606][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10724.604903][ C1] ? lock_acquire+0x1c1/0x220 [10724.605157][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10724.605412][ C1] _raw_spin_lock_nested+0x65/0x80 [10724.605688][ C1] tcp_v4_rcv+0x2159/0x29b0 [10724.605931][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10724.606191][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10724.606460][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10724.606748][ C1] ip_local_deliver_finish+0x2ae/0x450 [10724.607039][ C1] ip_local_deliver+0x19d/0x480 [10724.607302][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10724.607589][ C1] ? rcu_read_lock_held+0xe/0x50 [10724.607855][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10724.608132][ C1] ? rcu_read_lock_held+0xe/0x50 [10724.608393][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10724.608732][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10724.609005][ C1] ip_rcv+0x564/0x740 [10724.609218][ C1] ? __pfx_ip_rcv+0x10/0x10 [10724.609458][ C1] ? set_track_prepare+0x8a/0xd0 [10724.609720][ C1] ? irqentry_enter+0x2b/0x60 [10724.609975][ C1] ? irqentry_enter+0x2b/0x60 [10724.610231][ C1] ? __pfx_ip_rcv+0x10/0x10 [10724.610475][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10724.610795][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10724.611138][ C1] ? netif_receive_skb_internal+0x84/0x300 [10724.611449][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10724.611787][ C1] netif_receive_skb_internal+0xb0/0x300 [10724.612086][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10724.612422][ C1] netif_receive_skb+0x55/0x280 [10724.612683][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10724.613012][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10724.613364][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10724.613676][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10724.613972][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10724.614279][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10724.614620][ C1] ? unwind_next_frame+0x1478/0x1d10 [10724.614900][ C1] ? arch_stack_walk+0x68/0x100 [10724.615169][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10724.615449][ C1] ? irqentry_enter+0x2b/0x60 [10724.615703][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10724.616025][ C1] ? irqentry_enter+0x2b/0x60 [10724.616275][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10724.616600][ C1] ? unwind_next_frame+0x1478/0x1d10 [10724.616884][ C1] ? arch_stack_walk+0x68/0x100 [10724.617145][ C1] __tcf_classify+0x32c/0x7d0 [10724.617404][ C1] tcf_classify+0x283/0x930 [10724.617647][ C1] ? __pfx_tcf_classify+0x10/0x10 [10724.617917][ C1] tc_run+0x2e4/0x5d0 [10724.618131][ C1] ? __pfx_tc_run+0x10/0x10 [10724.618373][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10724.618639][ C1] ? irqentry_enter+0x2b/0x60 [10724.618893][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10724.619184][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10724.619508][ C1] ip_finish_output2+0x786/0x18e0 [10724.619777][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10724.620068][ C1] ? rcu_read_lock_held+0xe/0x50 [10724.620334][ C1] ? __ip_finish_output+0x10f/0x770 [10724.620610][ C1] ip_output+0x16b/0x4f0 [10724.620834][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10724.621156][ C1] ? __pfx_ip_output+0x10/0x10 [10724.621410][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10724.621768][ C1] ? __pfx_ip_output+0x10/0x10 [10724.622028][ C1] __ip_queue_xmit+0x672/0x1910 [10724.622289][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10724.622568][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10724.622862][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10724.623147][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10724.623439][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10724.623721][ C1] tcp_delack_timer+0x84/0x240 [10724.623974][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10724.624264][ C1] call_timer_fn+0x176/0x430 [10724.624519][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10724.624796][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10724.625075][ C1] __run_timers.part.0+0x52d/0x890 [10724.625346][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10724.625635][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10724.625938][ C1] ? __pfx___schedule+0x10/0x10 [10724.626199][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10724.626521][ C1] run_timer_softirq+0x72/0x100 [10724.626786][ C1] __do_softirq+0x1bc/0x7ff [10724.627037][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10724.627314][ C1] run_ksoftirqd+0x2e/0x60 [10724.627552][ C1] smpboot_thread_fn+0x30e/0x840 [10724.627819][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10724.628109][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10724.628399][ C1] kthread+0x292/0x360 [10724.628616][ C1] ? __pfx_kthread+0x10/0x10 [10724.628866][ C1] ret_from_fork+0x34/0x70 [10724.629103][ C1] ? __pfx_kthread+0x10/0x10 [10724.629350][ C1] ret_from_fork_asm+0x1b/0x30 [10724.629608][ C1] [10746.650025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [10746.650412][ C1] rcu: 1-....: (9479594 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=2265625 [10746.650999][ C1] rcu: (t=9552341 jiffies g=1007429 q=31 ncpus=4) [10746.651354][ C1] Sending NMI from CPU 1 to CPUs 0: [10746.651649][ C0] NMI backtrace for cpu 0 [10746.651656][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10746.651660][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10746.651663][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10746.651674][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10746.651677][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10746.651681][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10746.651683][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10746.651685][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10746.651687][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10746.651689][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10746.651691][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10746.651693][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10746.651697][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10746.651698][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10746.651700][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10746.651701][ C0] Call Trace: [10746.651706][ C0] [10746.651709][ C0] ? nmi_cpu_backtrace+0x112/0x220 [10746.651716][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [10746.651722][ C0] ? nmi_handle+0x156/0x420 [10746.651728][ C0] ? default_do_nmi+0x41/0x100 [10746.651732][ C0] ? exc_nmi+0xf3/0x120 [10746.651735][ C0] ? end_repeat_nmi+0xf/0x60 [10746.651740][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10746.651744][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10746.651747][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10746.651751][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10746.651755][ C0] [10746.651756][ C0] [10746.651757][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10746.651760][ C0] ? get_stack_info+0x36/0xc0 [10746.651765][ C0] ? lock_acquire+0x1c1/0x220 [10746.651771][ C0] ? lock_release+0x1d5/0x250 [10746.651774][ C0] do_raw_spin_lock+0x1ec/0x270 [10746.651778][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10746.651781][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10746.651785][ C0] ? lock_acquire+0x1c1/0x220 [10746.651787][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10746.651793][ C0] _raw_spin_lock_nested+0x65/0x80 [10746.651797][ C0] tcp_v4_rcv+0x2159/0x29b0 [10746.651804][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10746.651807][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10746.651811][ C0] ? __inet_lookup_established+0x341/0x610 [10746.651817][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10746.651825][ C0] ip_local_deliver_finish+0x2ae/0x450 [10746.651829][ C0] ip_local_deliver+0x19d/0x480 [10746.651832][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10746.651835][ C0] ? rcu_read_lock_held+0xe/0x50 [10746.651841][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10746.651845][ C0] ? rcu_read_lock_held+0xe/0x50 [10746.651848][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10746.651852][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10746.651862][ C0] ip_rcv+0x564/0x740 [10746.651865][ C0] ? __pfx_ip_rcv+0x10/0x10 [10746.651868][ C0] ? set_track_prepare+0x8a/0xd0 [10746.651874][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10746.651876][ C0] ? rest_init+0x153/0x260 [10746.651879][ C0] ? skb_clone+0x10b/0x330 [10746.651885][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10746.651892][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10746.651897][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10746.651902][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10746.651912][ C0] ? __tcf_classify+0x32c/0x7d0 [10746.651915][ C0] ? __pfx_ip_rcv+0x10/0x10 [10746.651918][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10746.651922][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10746.651926][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10746.651929][ C0] ? lock_acquire+0x1c1/0x220 [10746.651931][ C0] ? netif_receive_skb_internal+0x84/0x300 [10746.651935][ C0] netif_receive_skb_internal+0xb0/0x300 [10746.651937][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10746.651941][ C0] ? __copy_skb_header+0xaf/0x490 [10746.651943][ C0] ? __skb_clone+0x57a/0x760 [10746.651946][ C0] netif_receive_skb+0x55/0x280 [10746.651949][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10746.651958][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10746.651964][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10746.651971][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10746.651977][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10746.651985][ C0] ? hlock_class+0x4e/0x130 [10746.651992][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10746.652002][ C0] ? place_entity+0x21/0x2f0 [10746.652006][ C0] ? resched_curr+0x219/0x280 [10746.652010][ C0] ? __pfx_resched_curr+0x10/0x10 [10746.652013][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10746.652017][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10746.652023][ C0] ? wakeup_preempt+0x161/0x2c0 [10746.652026][ C0] ? activate_task+0xf5/0x260 [10746.652029][ C0] ? trace_sched_wakeup+0xd2/0x100 [10746.652035][ C0] ? do_raw_spin_unlock+0x58/0x220 [10746.652038][ C0] ? _raw_spin_unlock+0x23/0x40 [10746.652042][ C0] ? get_stack_info_noinstr+0x18/0x110 [10746.652045][ C0] ? get_stack_info+0x36/0xc0 [10746.652049][ C0] ? stack_access_ok+0xda/0x1f0 [10746.652051][ C0] ? get_reg+0x119/0x190 [10746.652055][ C0] __tcf_classify+0x32c/0x7d0 [10746.652060][ C0] tcf_classify+0x283/0x930 [10746.652063][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10746.652068][ C0] ? __pfx_tcf_classify+0x10/0x10 [10746.652070][ C0] ? arch_stack_walk+0x8c/0x100 [10746.652076][ C0] ? get_stack_info_noinstr+0x18/0x110 [10746.652079][ C0] tc_run+0x2e4/0x5d0 [10746.652084][ C0] ? __pfx_tc_run+0x10/0x10 [10746.652087][ C0] ? lock_acquire+0x1c1/0x220 [10746.652089][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10746.652094][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10746.652100][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10746.652103][ C0] ? ip_finish_output2+0x786/0x18e0 [10746.652107][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10746.652113][ C0] ? neigh_hh_output+0x348/0x590 [10746.652117][ C0] ? ip_finish_output2+0x262/0x18e0 [10746.652121][ C0] ip_finish_output2+0x786/0x18e0 [10746.652124][ C0] ? stack_depot_save_flags+0x45/0x550 [10746.652130][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10746.652138][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10746.652141][ C0] ? rcu_read_lock_held+0xe/0x50 [10746.652145][ C0] ? __ip_finish_output+0x10f/0x770 [10746.652149][ C0] ip_output+0x16b/0x4f0 [10746.652152][ C0] ? __run_timers.part.0+0x52d/0x890 [10746.652159][ C0] ? __pfx_ip_output+0x10/0x10 [10746.652162][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10746.652167][ C0] ? rcu_read_lock_held+0xe/0x50 [10746.652170][ C0] ? ip_local_out+0x114/0x3b0 [10746.652174][ C0] __ip_queue_xmit+0x672/0x1910 [10746.652178][ C0] ? __skb_clone+0x57a/0x760 [10746.652181][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10746.652188][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10746.652193][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10746.652196][ C0] tcp_write_xmit+0xe42/0x24c0 [10746.652201][ C0] ? tcp_current_mss+0x40a/0x510 [10746.652204][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10746.652207][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10746.652210][ C0] ? mark_lock_irq+0x6e2/0xa10 [10746.652212][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10746.652215][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10746.652219][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10746.652224][ C0] ? ktime_get+0xb6/0x190 [10746.652229][ C0] tcp_send_loss_probe+0x4c9/0x830 [10746.652234][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10746.652237][ C0] tcp_write_timer+0x82/0x1d0 [10746.652241][ C0] call_timer_fn+0x176/0x430 [10746.652245][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10746.652250][ C0] ? next_expiry_recalc+0xcd/0x220 [10746.652254][ C0] __run_timers.part.0+0x52d/0x890 [10746.652257][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10746.652262][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10746.652265][ C0] ? lock_acquire+0x1c1/0x220 [10746.652267][ C0] ? clockevents_program_event+0xf6/0x300 [10746.652272][ C0] ? lock_release+0x1d5/0x250 [10746.652275][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10746.652277][ C0] ? ktime_get+0xb6/0x190 [10746.652280][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10746.652284][ C0] ? clockevents_program_event+0x1ed/0x300 [10746.652288][ C0] run_timer_softirq+0x72/0x100 [10746.652292][ C0] __do_softirq+0x1bc/0x7ff [10746.652297][ C0] irq_exit_rcu+0x98/0xc0 [10746.652300][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10746.652304][ C0] [10746.652305][ C0] [10746.652306][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10746.652312][ C0] RIP: 0010:default_idle+0xf/0x20 [10746.652316][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10746.652318][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10746.652320][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10746.652322][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10746.652323][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10746.652325][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10746.652326][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10746.652330][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10746.652333][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10746.652337][ C0] default_idle_call+0x69/0xa0 [10746.652339][ C0] cpuidle_idle_call+0x1f6/0x280 [10746.652342][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10746.652347][ C0] ? lock_release+0x1d5/0x250 [10746.652351][ C0] do_idle+0xfb/0x160 [10746.652354][ C0] cpu_startup_entry+0x55/0x60 [10746.652357][ C0] rest_init+0x153/0x260 [10746.652359][ C0] ? acpi_enable_subsystem+0xac/0x150 [10746.652365][ C0] arch_call_rest_init+0x13/0x40 [10746.652370][ C0] start_kernel+0x314/0x3d0 [10746.652374][ C0] x86_64_start_reservations+0x18/0x30 [10746.652379][ C0] x86_64_start_kernel+0xba/0x110 [10746.652382][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10746.652390][ C0] [10746.652643][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10746.652647][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10746.652650][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10746.707590][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10746.708604][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10746.708925][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10746.709342][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10746.709760][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10746.710177][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10746.710594][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10746.711010][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10746.711481][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10746.711832][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10746.712253][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10746.712677][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10746.713104][ C1] Call Trace: [10746.713285][ C1] [10746.713442][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10746.713730][ C1] ? print_cpu_stall+0x263/0x6a0 [10746.713997][ C1] ? check_cpu_stall+0x284/0x500 [10746.714265][ C1] ? rcu_pending+0x92/0x360 [10746.714505][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [10746.714787][ C1] ? update_process_times+0xb9/0x110 [10746.715071][ C1] ? tick_sched_handle+0x67/0x130 [10746.715337][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [10746.715636][ C1] ? __run_hrtimer+0x1c3/0x710 [10746.715897][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10746.716226][ C1] ? __hrtimer_run_queues+0x197/0x270 [10746.716515][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10746.716818][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10746.717099][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10746.717428][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10746.717700][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10746.718025][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10746.718338][ C1] [10746.718494][ C1] [10746.718650][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10746.718976][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10746.719285][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10746.719594][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10746.719894][ C1] ? run_ksoftirqd+0xb/0x60 [10746.720140][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10746.720462][ C1] ? __orc_find+0x9c/0xf0 [10746.720695][ C1] ? lock_acquire+0x1c1/0x220 [10746.720947][ C1] ? irqentry_enter+0x2b/0x60 [10746.721202][ C1] do_raw_spin_lock+0x1ec/0x270 [10746.721463][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10746.721752][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10746.722053][ C1] ? lock_acquire+0x1c1/0x220 [10746.722302][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10746.722553][ C1] _raw_spin_lock_nested+0x65/0x80 [10746.722824][ C1] tcp_v4_rcv+0x2159/0x29b0 [10746.723071][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10746.723331][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10746.723604][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10746.723895][ C1] ip_local_deliver_finish+0x2ae/0x450 [10746.724194][ C1] ip_local_deliver+0x19d/0x480 [10746.724460][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10746.724745][ C1] ? rcu_read_lock_held+0xe/0x50 [10746.725010][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10746.725287][ C1] ? rcu_read_lock_held+0xe/0x50 [10746.725550][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10746.725888][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10746.726162][ C1] ip_rcv+0x564/0x740 [10746.726373][ C1] ? __pfx_ip_rcv+0x10/0x10 [10746.726615][ C1] ? set_track_prepare+0x8a/0xd0 [10746.726878][ C1] ? irqentry_enter+0x2b/0x60 [10746.727133][ C1] ? irqentry_enter+0x2b/0x60 [10746.727392][ C1] ? __pfx_ip_rcv+0x10/0x10 [10746.727636][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10746.727955][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10746.728298][ C1] ? netif_receive_skb_internal+0x84/0x300 [10746.728609][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10746.728946][ C1] netif_receive_skb_internal+0xb0/0x300 [10746.729245][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10746.729581][ C1] netif_receive_skb+0x55/0x280 [10746.729841][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10746.730172][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10746.730523][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10746.730835][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10746.731132][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10746.731437][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10746.731774][ C1] ? unwind_next_frame+0x1478/0x1d10 [10746.732058][ C1] ? arch_stack_walk+0x68/0x100 [10746.732318][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10746.732595][ C1] ? irqentry_enter+0x2b/0x60 [10746.732846][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10746.733163][ C1] ? irqentry_enter+0x2b/0x60 [10746.733416][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10746.733742][ C1] ? unwind_next_frame+0x1478/0x1d10 [10746.734023][ C1] ? arch_stack_walk+0x68/0x100 [10746.734295][ C1] __tcf_classify+0x32c/0x7d0 [10746.734546][ C1] tcf_classify+0x283/0x930 [10746.734789][ C1] ? __pfx_tcf_classify+0x10/0x10 [10746.735062][ C1] tc_run+0x2e4/0x5d0 [10746.735274][ C1] ? __pfx_tc_run+0x10/0x10 [10746.735516][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10746.735780][ C1] ? irqentry_enter+0x2b/0x60 [10746.736035][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10746.736328][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10746.736653][ C1] ip_finish_output2+0x786/0x18e0 [10746.736922][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10746.737213][ C1] ? rcu_read_lock_held+0xe/0x50 [10746.737481][ C1] ? __ip_finish_output+0x10f/0x770 [10746.737757][ C1] ip_output+0x16b/0x4f0 [10746.737983][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10746.738304][ C1] ? __pfx_ip_output+0x10/0x10 [10746.738557][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10746.738914][ C1] ? __pfx_ip_output+0x10/0x10 [10746.739175][ C1] __ip_queue_xmit+0x672/0x1910 [10746.739442][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10746.739721][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10746.740014][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10746.740298][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10746.740591][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10746.740874][ C1] tcp_delack_timer+0x84/0x240 [10746.741128][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10746.741416][ C1] call_timer_fn+0x176/0x430 [10746.741666][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10746.741938][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10746.742224][ C1] __run_timers.part.0+0x52d/0x890 [10746.742496][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10746.742779][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10746.743080][ C1] ? __pfx___schedule+0x10/0x10 [10746.743344][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10746.743668][ C1] run_timer_softirq+0x72/0x100 [10746.743927][ C1] __do_softirq+0x1bc/0x7ff [10746.744170][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10746.744451][ C1] run_ksoftirqd+0x2e/0x60 [10746.744689][ C1] smpboot_thread_fn+0x30e/0x840 [10746.744957][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10746.745246][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10746.745536][ C1] kthread+0x292/0x360 [10746.745754][ C1] ? __pfx_kthread+0x10/0x10 [10746.746003][ C1] ret_from_fork+0x34/0x70 [10746.746240][ C1] ? __pfx_kthread+0x10/0x10 [10746.746486][ C1] ret_from_fork_asm+0x1b/0x30 [10746.746744][ C1] [10772.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8926s! [swapper/0:0] [10772.527927][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10772.529135][ C0] irq event stamp: 27567077 [10772.529376][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10772.529910][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10772.530392][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10772.530906][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10772.531413][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10772.531904][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10772.532552][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10772.532894][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10772.533920][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10772.534255][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10772.534680][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10772.535106][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10772.535533][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10772.535961][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10772.536384][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10772.536856][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10772.537205][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10772.537629][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10772.538049][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10772.538469][ C0] Call Trace: [10772.538650][ C0] [10772.538806][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10772.539088][ C0] ? __run_hrtimer+0x1c3/0x710 [10772.539342][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10772.539636][ C0] ? __hrtimer_run_queues+0x197/0x270 [10772.539920][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10772.540225][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10772.540506][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10772.540826][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10772.541105][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10772.541383][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10772.541712][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10772.542030][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10772.542363][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10772.542673][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10772.542987][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10772.543291][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10772.543620][ C0] ? get_stack_info+0x36/0xc0 [10772.543881][ C0] ? lock_acquire+0x1c1/0x220 [10772.544151][ C0] ? lock_release+0x1d5/0x250 [10772.544404][ C0] do_raw_spin_lock+0x1ec/0x270 [10772.544666][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10772.544953][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10772.545251][ C0] ? lock_acquire+0x1c1/0x220 [10772.545503][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10772.545758][ C0] _raw_spin_lock_nested+0x65/0x80 [10772.546037][ C0] tcp_v4_rcv+0x2159/0x29b0 [10772.546284][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10772.546544][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10772.546813][ C0] ? __inet_lookup_established+0x341/0x610 [10772.547136][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10772.547431][ C0] ip_local_deliver_finish+0x2ae/0x450 [10772.547725][ C0] ip_local_deliver+0x19d/0x480 [10772.547987][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10772.548271][ C0] ? rcu_read_lock_held+0xe/0x50 [10772.548536][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10772.548817][ C0] ? rcu_read_lock_held+0xe/0x50 [10772.549084][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10772.549420][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10772.549698][ C0] ip_rcv+0x564/0x740 [10772.549916][ C0] ? __pfx_ip_rcv+0x10/0x10 [10772.550162][ C0] ? set_track_prepare+0x8a/0xd0 [10772.550430][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10772.550721][ C0] ? rest_init+0x153/0x260 [10772.550961][ C0] ? skb_clone+0x10b/0x330 [10772.551204][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10772.551543][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10772.551867][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10772.552164][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10772.552473][ C0] ? __tcf_classify+0x32c/0x7d0 [10772.552731][ C0] ? __pfx_ip_rcv+0x10/0x10 [10772.552971][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10772.553284][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10772.553582][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10772.553926][ C0] ? lock_acquire+0x1c1/0x220 [10772.554183][ C0] ? netif_receive_skb_internal+0x84/0x300 [10772.554491][ C0] netif_receive_skb_internal+0xb0/0x300 [10772.554792][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10772.555124][ C0] ? __copy_skb_header+0xaf/0x490 [10772.555390][ C0] ? __skb_clone+0x57a/0x760 [10772.555636][ C0] netif_receive_skb+0x55/0x280 [10772.555900][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10772.556230][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10772.556582][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10772.556893][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10772.557184][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10772.557488][ C0] ? hlock_class+0x4e/0x130 [10772.557737][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10772.558071][ C0] ? place_entity+0x21/0x2f0 [10772.558320][ C0] ? resched_curr+0x219/0x280 [10772.558572][ C0] ? __pfx_resched_curr+0x10/0x10 [10772.558838][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10772.559120][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10772.559400][ C0] ? wakeup_preempt+0x161/0x2c0 [10772.559660][ C0] ? activate_task+0xf5/0x260 [10772.559917][ C0] ? trace_sched_wakeup+0xd2/0x100 [10772.560196][ C0] ? do_raw_spin_unlock+0x58/0x220 [10772.560468][ C0] ? _raw_spin_unlock+0x23/0x40 [10772.560733][ C0] ? get_stack_info_noinstr+0x18/0x110 [10772.561027][ C0] ? get_stack_info+0x36/0xc0 [10772.561279][ C0] ? stack_access_ok+0xda/0x1f0 [10772.561542][ C0] ? get_reg+0x119/0x190 [10772.561771][ C0] __tcf_classify+0x32c/0x7d0 [10772.562029][ C0] tcf_classify+0x283/0x930 [10772.562276][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10772.562607][ C0] ? __pfx_tcf_classify+0x10/0x10 [10772.562878][ C0] ? arch_stack_walk+0x8c/0x100 [10772.563139][ C0] ? get_stack_info_noinstr+0x18/0x110 [10772.563426][ C0] tc_run+0x2e4/0x5d0 [10772.563647][ C0] ? __pfx_tc_run+0x10/0x10 [10772.563895][ C0] ? lock_acquire+0x1c1/0x220 [10772.564152][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10772.564426][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10772.564695][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10772.564978][ C0] ? ip_finish_output2+0x786/0x18e0 [10772.565254][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10772.565572][ C0] ? neigh_hh_output+0x348/0x590 [10772.565842][ C0] ? ip_finish_output2+0x262/0x18e0 [10772.566120][ C0] ip_finish_output2+0x786/0x18e0 [10772.566387][ C0] ? stack_depot_save_flags+0x45/0x550 [10772.566677][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10772.567037][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10772.567330][ C0] ? rcu_read_lock_held+0xe/0x50 [10772.567595][ C0] ? __ip_finish_output+0x10f/0x770 [10772.567875][ C0] ip_output+0x16b/0x4f0 [10772.568104][ C0] ? __run_timers.part.0+0x52d/0x890 [10772.568387][ C0] ? __pfx_ip_output+0x10/0x10 [10772.568647][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10772.568946][ C0] ? rcu_read_lock_held+0xe/0x50 [10772.569212][ C0] ? ip_local_out+0x114/0x3b0 [10772.569464][ C0] __ip_queue_xmit+0x672/0x1910 [10772.569723][ C0] ? __skb_clone+0x57a/0x760 [10772.569969][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10772.570255][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10772.570552][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10772.570873][ C0] tcp_write_xmit+0xe42/0x24c0 [10772.571128][ C0] ? tcp_current_mss+0x40a/0x510 [10772.571395][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10772.571677][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10772.571957][ C0] ? mark_lock_irq+0x6e2/0xa10 [10772.572213][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10772.572479][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10772.572797][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10772.573078][ C0] ? ktime_get+0xb6/0x190 [10772.573312][ C0] tcp_send_loss_probe+0x4c9/0x830 [10772.573589][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10772.573870][ C0] tcp_write_timer+0x82/0x1d0 [10772.574134][ C0] call_timer_fn+0x176/0x430 [10772.574380][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10772.574659][ C0] ? next_expiry_recalc+0xcd/0x220 [10772.574932][ C0] __run_timers.part.0+0x52d/0x890 [10772.575209][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10772.575490][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10772.575789][ C0] ? lock_acquire+0x1c1/0x220 [10772.576037][ C0] ? clockevents_program_event+0xf6/0x300 [10772.576342][ C0] ? lock_release+0x1d5/0x250 [10772.576592][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10772.576873][ C0] ? ktime_get+0xb6/0x190 [10772.577104][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10772.577403][ C0] ? clockevents_program_event+0x1ed/0x300 [10772.577716][ C0] run_timer_softirq+0x72/0x100 [10772.577978][ C0] __do_softirq+0x1bc/0x7ff [10772.578222][ C0] irq_exit_rcu+0x98/0xc0 [10772.578454][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10772.578753][ C0] [10772.578917][ C0] [10772.579079][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10772.579405][ C0] RIP: 0010:default_idle+0xf/0x20 [10772.579673][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10772.580696][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10772.581018][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10772.581440][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10772.581861][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10772.582284][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10772.582705][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10772.583127][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10772.583430][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10772.583704][ C0] default_idle_call+0x69/0xa0 [10772.583967][ C0] cpuidle_idle_call+0x1f6/0x280 [10772.584248][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10772.584541][ C0] ? lock_release+0x1d5/0x250 [10772.584795][ C0] do_idle+0xfb/0x160 [10772.585009][ C0] cpu_startup_entry+0x55/0x60 [10772.585265][ C0] rest_init+0x153/0x260 [10772.585490][ C0] ? acpi_enable_subsystem+0xac/0x150 [10772.585781][ C0] arch_call_rest_init+0x13/0x40 [10772.586051][ C0] start_kernel+0x314/0x3d0 [10772.586292][ C0] x86_64_start_reservations+0x18/0x30 [10772.586582][ C0] x86_64_start_kernel+0xba/0x110 [10772.586855][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10772.587187][ C0] [10772.587356][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8926s! [ksoftirqd/1:22] [10772.587809][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10772.589009][ C1] irq event stamp: 3886976 [10772.589250][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10772.589744][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10772.590238][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10772.590734][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10772.591229][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10772.591724][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10772.592373][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10772.592712][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10772.593733][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10772.594058][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10772.594488][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10772.594911][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10772.595339][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10772.595770][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10772.596193][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10772.596665][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10772.597014][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10772.597438][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10772.597856][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10772.598278][ C1] Call Trace: [10772.598456][ C1] [10772.598610][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10772.598889][ C1] ? __run_hrtimer+0x1c3/0x710 [10772.599143][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10772.599436][ C1] ? __hrtimer_run_queues+0x197/0x270 [10772.599721][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10772.600023][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10772.600303][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10772.600625][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10772.600902][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10772.601226][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10772.601535][ C1] [10772.601694][ C1] [10772.601854][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10772.602190][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10772.602494][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10772.602804][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10772.603114][ C1] ? run_ksoftirqd+0xb/0x60 [10772.603363][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10772.603694][ C1] ? __orc_find+0x9c/0xf0 [10772.603925][ C1] ? lock_acquire+0x1c1/0x220 [10772.604182][ C1] ? irqentry_enter+0x2b/0x60 [10772.604438][ C1] do_raw_spin_lock+0x1ec/0x270 [10772.604704][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10772.604994][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10772.605299][ C1] ? lock_acquire+0x1c1/0x220 [10772.605547][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10772.605797][ C1] _raw_spin_lock_nested+0x65/0x80 [10772.606072][ C1] tcp_v4_rcv+0x2159/0x29b0 [10772.606321][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10772.606587][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10772.606860][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10772.607152][ C1] ip_local_deliver_finish+0x2ae/0x450 [10772.607444][ C1] ip_local_deliver+0x19d/0x480 [10772.607707][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10772.607992][ C1] ? rcu_read_lock_held+0xe/0x50 [10772.608259][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10772.608541][ C1] ? rcu_read_lock_held+0xe/0x50 [10772.608809][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10772.609146][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10772.609425][ C1] ip_rcv+0x564/0x740 [10772.609641][ C1] ? __pfx_ip_rcv+0x10/0x10 [10772.609888][ C1] ? set_track_prepare+0x8a/0xd0 [10772.610156][ C1] ? irqentry_enter+0x2b/0x60 [10772.610409][ C1] ? irqentry_enter+0x2b/0x60 [10772.610658][ C1] ? __pfx_ip_rcv+0x10/0x10 [10772.610901][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10772.611215][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10772.611554][ C1] ? netif_receive_skb_internal+0x84/0x300 [10772.611862][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10772.612207][ C1] netif_receive_skb_internal+0xb0/0x300 [10772.612508][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10772.612842][ C1] netif_receive_skb+0x55/0x280 [10772.613104][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10772.613431][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10772.613779][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10772.614097][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10772.614394][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10772.614701][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10772.615034][ C1] ? unwind_next_frame+0x1478/0x1d10 [10772.615319][ C1] ? arch_stack_walk+0x68/0x100 [10772.615577][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10772.615856][ C1] ? irqentry_enter+0x2b/0x60 [10772.616107][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10772.616429][ C1] ? irqentry_enter+0x2b/0x60 [10772.616685][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10772.617009][ C1] ? unwind_next_frame+0x1478/0x1d10 [10772.617289][ C1] ? arch_stack_walk+0x68/0x100 [10772.617558][ C1] __tcf_classify+0x32c/0x7d0 [10772.617815][ C1] tcf_classify+0x283/0x930 [10772.618063][ C1] ? __pfx_tcf_classify+0x10/0x10 [10772.618337][ C1] tc_run+0x2e4/0x5d0 [10772.618555][ C1] ? __pfx_tc_run+0x10/0x10 [10772.618804][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10772.619076][ C1] ? irqentry_enter+0x2b/0x60 [10772.619325][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10772.619609][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10772.619935][ C1] ip_finish_output2+0x786/0x18e0 [10772.620210][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10772.620502][ C1] ? rcu_read_lock_held+0xe/0x50 [10772.620768][ C1] ? __ip_finish_output+0x10f/0x770 [10772.621050][ C1] ip_output+0x16b/0x4f0 [10772.621282][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10772.621603][ C1] ? __pfx_ip_output+0x10/0x10 [10772.621863][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10772.622217][ C1] ? __pfx_ip_output+0x10/0x10 [10772.622473][ C1] __ip_queue_xmit+0x672/0x1910 [10772.622741][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10772.623026][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10772.623328][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10772.623619][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10772.623919][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10772.624216][ C1] tcp_delack_timer+0x84/0x240 [10772.624475][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10772.624763][ C1] call_timer_fn+0x176/0x430 [10772.625015][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10772.625291][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10772.625573][ C1] __run_timers.part.0+0x52d/0x890 [10772.625849][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10772.626139][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10772.626440][ C1] ? __pfx___schedule+0x10/0x10 [10772.626708][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10772.627032][ C1] run_timer_softirq+0x72/0x100 [10772.627290][ C1] __do_softirq+0x1bc/0x7ff [10772.627531][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10772.627805][ C1] run_ksoftirqd+0x2e/0x60 [10772.628046][ C1] smpboot_thread_fn+0x30e/0x840 [10772.628312][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10772.628607][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10772.628897][ C1] kthread+0x292/0x360 [10772.629117][ C1] ? __pfx_kthread+0x10/0x10 [10772.629361][ C1] ret_from_fork+0x34/0x70 [10772.629603][ C1] ? __pfx_kthread+0x10/0x10 [10772.629850][ C1] ret_from_fork_asm+0x1b/0x30 [10772.630116][ C1] [10800.527476][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 8952s! [swapper/0:0] [10800.527941][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10800.529129][ C0] irq event stamp: 27567077 [10800.529364][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10800.529885][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10800.530343][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10800.530833][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10800.531333][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10800.531811][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10800.532472][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10800.532811][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10800.533813][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10800.534158][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10800.534575][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10800.534992][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10800.535412][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10800.535829][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10800.536247][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10800.536715][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10800.537057][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10800.537462][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10800.537869][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10800.538280][ C0] Call Trace: [10800.538461][ C0] [10800.538614][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10800.538881][ C0] ? __run_hrtimer+0x1c3/0x710 [10800.539129][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10800.539431][ C0] ? __hrtimer_run_queues+0x197/0x270 [10800.539721][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10800.540027][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10800.540311][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10800.540637][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10800.540902][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10800.541179][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10800.541493][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10800.541795][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10800.542122][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10800.542417][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10800.542718][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10800.543016][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10800.543358][ C0] ? get_stack_info+0x36/0xc0 [10800.543612][ C0] ? lock_acquire+0x1c1/0x220 [10800.543864][ C0] ? lock_release+0x1d5/0x250 [10800.544124][ C0] do_raw_spin_lock+0x1ec/0x270 [10800.544389][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10800.544676][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10800.544976][ C0] ? lock_acquire+0x1c1/0x220 [10800.545231][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10800.545474][ C0] _raw_spin_lock_nested+0x65/0x80 [10800.545738][ C0] tcp_v4_rcv+0x2159/0x29b0 [10800.545981][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10800.546236][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10800.546500][ C0] ? __inet_lookup_established+0x341/0x610 [10800.546815][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10800.547096][ C0] ip_local_deliver_finish+0x2ae/0x450 [10800.547399][ C0] ip_local_deliver+0x19d/0x480 [10800.547658][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10800.547944][ C0] ? rcu_read_lock_held+0xe/0x50 [10800.548212][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10800.548497][ C0] ? rcu_read_lock_held+0xe/0x50 [10800.548752][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10800.549081][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10800.549347][ C0] ip_rcv+0x564/0x740 [10800.549554][ C0] ? __pfx_ip_rcv+0x10/0x10 [10800.549787][ C0] ? set_track_prepare+0x8a/0xd0 [10800.550043][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10800.550326][ C0] ? rest_init+0x153/0x260 [10800.550556][ C0] ? skb_clone+0x10b/0x330 [10800.550796][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10800.551123][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10800.551456][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10800.551756][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10800.552068][ C0] ? __tcf_classify+0x32c/0x7d0 [10800.552332][ C0] ? __pfx_ip_rcv+0x10/0x10 [10800.552583][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10800.552892][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10800.553183][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10800.553512][ C0] ? lock_acquire+0x1c1/0x220 [10800.553755][ C0] ? netif_receive_skb_internal+0x84/0x300 [10800.554078][ C0] netif_receive_skb_internal+0xb0/0x300 [10800.554376][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10800.554716][ C0] ? __copy_skb_header+0xaf/0x490 [10800.554986][ C0] ? __skb_clone+0x57a/0x760 [10800.555236][ C0] netif_receive_skb+0x55/0x280 [10800.555493][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10800.555818][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10800.556165][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10800.556487][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10800.556764][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10800.557054][ C0] ? hlock_class+0x4e/0x130 [10800.557289][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10800.557627][ C0] ? place_entity+0x21/0x2f0 [10800.557875][ C0] ? resched_curr+0x219/0x280 [10800.558128][ C0] ? __pfx_resched_curr+0x10/0x10 [10800.558398][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10800.558692][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10800.558960][ C0] ? wakeup_preempt+0x161/0x2c0 [10800.559227][ C0] ? activate_task+0xf5/0x260 [10800.559475][ C0] ? trace_sched_wakeup+0xd2/0x100 [10800.559749][ C0] ? do_raw_spin_unlock+0x58/0x220 [10800.560025][ C0] ? _raw_spin_unlock+0x23/0x40 [10800.560285][ C0] ? get_stack_info_noinstr+0x18/0x110 [10800.560581][ C0] ? get_stack_info+0x36/0xc0 [10800.560828][ C0] ? stack_access_ok+0xda/0x1f0 [10800.561082][ C0] ? get_reg+0x119/0x190 [10800.561306][ C0] __tcf_classify+0x32c/0x7d0 [10800.561552][ C0] tcf_classify+0x283/0x930 [10800.561787][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10800.562106][ C0] ? __pfx_tcf_classify+0x10/0x10 [10800.562369][ C0] ? arch_stack_walk+0x8c/0x100 [10800.562624][ C0] ? get_stack_info_noinstr+0x18/0x110 [10800.562906][ C0] tc_run+0x2e4/0x5d0 [10800.563121][ C0] ? __pfx_tc_run+0x10/0x10 [10800.563374][ C0] ? lock_acquire+0x1c1/0x220 [10800.563621][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10800.563895][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10800.564172][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10800.564459][ C0] ? ip_finish_output2+0x786/0x18e0 [10800.564740][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10800.565065][ C0] ? neigh_hh_output+0x348/0x590 [10800.565335][ C0] ? ip_finish_output2+0x262/0x18e0 [10800.565609][ C0] ip_finish_output2+0x786/0x18e0 [10800.565871][ C0] ? stack_depot_save_flags+0x45/0x550 [10800.566162][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10800.566503][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10800.566785][ C0] ? rcu_read_lock_held+0xe/0x50 [10800.567044][ C0] ? __ip_finish_output+0x10f/0x770 [10800.567331][ C0] ip_output+0x16b/0x4f0 [10800.567558][ C0] ? __run_timers.part.0+0x52d/0x890 [10800.567844][ C0] ? __pfx_ip_output+0x10/0x10 [10800.568101][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10800.568404][ C0] ? rcu_read_lock_held+0xe/0x50 [10800.568674][ C0] ? ip_local_out+0x114/0x3b0 [10800.568923][ C0] __ip_queue_xmit+0x672/0x1910 [10800.569183][ C0] ? __skb_clone+0x57a/0x760 [10800.569426][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10800.569698][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10800.569987][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10800.570297][ C0] tcp_write_xmit+0xe42/0x24c0 [10800.570548][ C0] ? tcp_current_mss+0x40a/0x510 [10800.570805][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10800.571081][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10800.571368][ C0] ? mark_lock_irq+0x6e2/0xa10 [10800.571620][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10800.571891][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10800.572214][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10800.572499][ C0] ? ktime_get+0xb6/0x190 [10800.572724][ C0] tcp_send_loss_probe+0x4c9/0x830 [10800.572990][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10800.573267][ C0] tcp_write_timer+0x82/0x1d0 [10800.573512][ C0] call_timer_fn+0x176/0x430 [10800.573751][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10800.574043][ C0] ? next_expiry_recalc+0xcd/0x220 [10800.574318][ C0] __run_timers.part.0+0x52d/0x890 [10800.574590][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10800.574874][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10800.575172][ C0] ? lock_acquire+0x1c1/0x220 [10800.575425][ C0] ? clockevents_program_event+0xf6/0x300 [10800.575737][ C0] ? lock_release+0x1d5/0x250 [10800.575994][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10800.576275][ C0] ? ktime_get+0xb6/0x190 [10800.576518][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10800.576813][ C0] ? clockevents_program_event+0x1ed/0x300 [10800.577115][ C0] run_timer_softirq+0x72/0x100 [10800.577371][ C0] __do_softirq+0x1bc/0x7ff [10800.577611][ C0] irq_exit_rcu+0x98/0xc0 [10800.577838][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10800.578131][ C0] [10800.578283][ C0] [10800.578434][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10800.578741][ C0] RIP: 0010:default_idle+0xf/0x20 [10800.579005][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10800.580035][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10800.580359][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10800.580782][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10800.581195][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10800.581603][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10800.582010][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10800.582423][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10800.582720][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10800.582989][ C0] default_idle_call+0x69/0xa0 [10800.583255][ C0] cpuidle_idle_call+0x1f6/0x280 [10800.583520][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10800.583810][ C0] ? lock_release+0x1d5/0x250 [10800.584070][ C0] do_idle+0xfb/0x160 [10800.584283][ C0] cpu_startup_entry+0x55/0x60 [10800.584538][ C0] rest_init+0x153/0x260 [10800.584768][ C0] ? acpi_enable_subsystem+0xac/0x150 [10800.585055][ C0] arch_call_rest_init+0x13/0x40 [10800.585319][ C0] start_kernel+0x314/0x3d0 [10800.585564][ C0] x86_64_start_reservations+0x18/0x30 [10800.585860][ C0] x86_64_start_kernel+0xba/0x110 [10800.586121][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10800.586439][ C0] [10800.586599][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8952s! [ksoftirqd/1:22] [10800.587038][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10800.588233][ C1] irq event stamp: 3886976 [10800.588470][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10800.588964][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10800.589443][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10800.589926][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10800.590409][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10800.590887][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10800.591532][ C1] RIP: 0010:kasan_check_range+0x106/0x1c0 [10800.591837][ C1] Code: 00 74 f2 48 89 c2 b8 01 00 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff <5b> b8 01 00 00 00 5d 41 5c c3 cc cc cc cc 41 bc 08 00 00 00 45 29 [10800.592848][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000246 [10800.593158][ C1] RAX: ffffed10014131c4 RBX: ffffed10014131c4 RCX: ffffffff90c7aaa0 [10800.593564][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10800.593968][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: ffffed10014131c3 [10800.594403][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10800.594826][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10800.595249][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10800.595722][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10800.596067][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10800.596499][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10800.596906][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10800.597312][ C1] Call Trace: [10800.597482][ C1] [10800.597632][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10800.597900][ C1] ? __run_hrtimer+0x1c3/0x710 [10800.598148][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10800.598438][ C1] ? __hrtimer_run_queues+0x197/0x270 [10800.598715][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10800.599008][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10800.599294][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10800.599614][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10800.599888][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10800.600208][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10800.600515][ C1] [10800.600674][ C1] [10800.600834][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10800.601165][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10800.601467][ C1] ? kasan_check_range+0x106/0x1c0 [10800.601739][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [10800.602037][ C1] ? run_ksoftirqd+0xb/0x60 [10800.602283][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10800.602610][ C1] ? __orc_find+0x9c/0xf0 [10800.602846][ C1] ? lock_acquire+0x1c1/0x220 [10800.603088][ C1] ? irqentry_enter+0x2b/0x60 [10800.603349][ C1] do_raw_spin_lock+0x1ec/0x270 [10800.603605][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10800.603888][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10800.604192][ C1] ? lock_acquire+0x1c1/0x220 [10800.604440][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10800.604692][ C1] _raw_spin_lock_nested+0x65/0x80 [10800.604963][ C1] tcp_v4_rcv+0x2159/0x29b0 [10800.605221][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10800.605479][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10800.605745][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10800.606028][ C1] ip_local_deliver_finish+0x2ae/0x450 [10800.606314][ C1] ip_local_deliver+0x19d/0x480 [10800.606565][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10800.606840][ C1] ? rcu_read_lock_held+0xe/0x50 [10800.607096][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10800.607389][ C1] ? rcu_read_lock_held+0xe/0x50 [10800.607654][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10800.607990][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10800.608265][ C1] ip_rcv+0x564/0x740 [10800.608491][ C1] ? __pfx_ip_rcv+0x10/0x10 [10800.608727][ C1] ? set_track_prepare+0x8a/0xd0 [10800.608985][ C1] ? irqentry_enter+0x2b/0x60 [10800.609228][ C1] ? irqentry_enter+0x2b/0x60 [10800.609472][ C1] ? __pfx_ip_rcv+0x10/0x10 [10800.609704][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10800.610007][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10800.610336][ C1] ? netif_receive_skb_internal+0x84/0x300 [10800.610634][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10800.610967][ C1] netif_receive_skb_internal+0xb0/0x300 [10800.611277][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10800.611608][ C1] netif_receive_skb+0x55/0x280 [10800.611862][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10800.612185][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10800.612544][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10800.612851][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10800.613132][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10800.613425][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10800.613746][ C1] ? unwind_next_frame+0x1478/0x1d10 [10800.614041][ C1] ? arch_stack_walk+0x68/0x100 [10800.614300][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10800.614577][ C1] ? irqentry_enter+0x2b/0x60 [10800.614828][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10800.615144][ C1] ? irqentry_enter+0x2b/0x60 [10800.615395][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10800.615719][ C1] ? unwind_next_frame+0x1478/0x1d10 [10800.616000][ C1] ? arch_stack_walk+0x68/0x100 [10800.616263][ C1] __tcf_classify+0x32c/0x7d0 [10800.616525][ C1] tcf_classify+0x283/0x930 [10800.616763][ C1] ? __pfx_tcf_classify+0x10/0x10 [10800.617025][ C1] tc_run+0x2e4/0x5d0 [10800.617236][ C1] ? __pfx_tc_run+0x10/0x10 [10800.617474][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10800.617753][ C1] ? irqentry_enter+0x2b/0x60 [10800.618002][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10800.618287][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10800.618606][ C1] ip_finish_output2+0x786/0x18e0 [10800.618888][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10800.619172][ C1] ? rcu_read_lock_held+0xe/0x50 [10800.619449][ C1] ? __ip_finish_output+0x10f/0x770 [10800.619728][ C1] ip_output+0x16b/0x4f0 [10800.619956][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10800.620272][ C1] ? __pfx_ip_output+0x10/0x10 [10800.620538][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10800.620879][ C1] ? __pfx_ip_output+0x10/0x10 [10800.621132][ C1] __ip_queue_xmit+0x672/0x1910 [10800.621387][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10800.621662][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10800.621950][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10800.622228][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10800.622516][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10800.622795][ C1] tcp_delack_timer+0x84/0x240 [10800.623048][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10800.623344][ C1] call_timer_fn+0x176/0x430 [10800.623590][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10800.623867][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10800.624152][ C1] __run_timers.part.0+0x52d/0x890 [10800.624425][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10800.624709][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10800.625008][ C1] ? __pfx___schedule+0x10/0x10 [10800.625278][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10800.625591][ C1] run_timer_softirq+0x72/0x100 [10800.625843][ C1] __do_softirq+0x1bc/0x7ff [10800.626080][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10800.626345][ C1] run_ksoftirqd+0x2e/0x60 [10800.626580][ C1] smpboot_thread_fn+0x30e/0x840 [10800.626837][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10800.627123][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10800.627423][ C1] kthread+0x292/0x360 [10800.627647][ C1] ? __pfx_kthread+0x10/0x10 [10800.627894][ C1] ret_from_fork+0x34/0x70 [10800.628133][ C1] ? __pfx_kthread+0x10/0x10 [10800.628376][ C1] ret_from_fork_asm+0x1b/0x30 [10800.628640][ C1] [10824.749037][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [10824.749449][ C1] rcu: 1-....: (9557414 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=2283620 [10824.750040][ C1] rcu: (t=9630440 jiffies g=1007429 q=31 ncpus=4) [10824.750388][ C1] Sending NMI from CPU 1 to CPUs 0: [10824.750684][ C0] NMI backtrace for cpu 0 [10824.750691][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10824.750695][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10824.750697][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10824.750709][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10824.750713][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10824.750717][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10824.750718][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10824.750720][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10824.750722][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10824.750724][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10824.750726][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10824.750728][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10824.750731][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10824.750733][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10824.750734][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10824.750736][ C0] Call Trace: [10824.750740][ C0] [10824.750747][ C0] ? nmi_cpu_backtrace+0x112/0x220 [10824.750754][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [10824.750760][ C0] ? nmi_handle+0x156/0x420 [10824.750765][ C0] ? default_do_nmi+0x41/0x100 [10824.750769][ C0] ? exc_nmi+0xf3/0x120 [10824.750772][ C0] ? end_repeat_nmi+0xf/0x60 [10824.750777][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10824.750781][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10824.750785][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10824.750788][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10824.750792][ C0] [10824.750793][ C0] [10824.750795][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10824.750797][ C0] ? get_stack_info+0x36/0xc0 [10824.750802][ C0] ? lock_acquire+0x1c1/0x220 [10824.750808][ C0] ? lock_release+0x1d5/0x250 [10824.750812][ C0] do_raw_spin_lock+0x1ec/0x270 [10824.750816][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10824.750819][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10824.750822][ C0] ? lock_acquire+0x1c1/0x220 [10824.750825][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10824.750831][ C0] _raw_spin_lock_nested+0x65/0x80 [10824.750834][ C0] tcp_v4_rcv+0x2159/0x29b0 [10824.750842][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10824.750844][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10824.750849][ C0] ? __inet_lookup_established+0x341/0x610 [10824.750855][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10824.750868][ C0] ip_local_deliver_finish+0x2ae/0x450 [10824.750872][ C0] ip_local_deliver+0x19d/0x480 [10824.750875][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10824.750878][ C0] ? rcu_read_lock_held+0xe/0x50 [10824.750884][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10824.750888][ C0] ? rcu_read_lock_held+0xe/0x50 [10824.750891][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10824.750894][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10824.750907][ C0] ip_rcv+0x564/0x740 [10824.750910][ C0] ? __pfx_ip_rcv+0x10/0x10 [10824.750913][ C0] ? set_track_prepare+0x8a/0xd0 [10824.750918][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10824.750920][ C0] ? rest_init+0x153/0x260 [10824.750923][ C0] ? skb_clone+0x10b/0x330 [10824.750930][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10824.750937][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10824.750942][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10824.750948][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10824.750957][ C0] ? __tcf_classify+0x32c/0x7d0 [10824.750961][ C0] ? __pfx_ip_rcv+0x10/0x10 [10824.750964][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10824.750968][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10824.750971][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10824.750975][ C0] ? lock_acquire+0x1c1/0x220 [10824.750977][ C0] ? netif_receive_skb_internal+0x84/0x300 [10824.750981][ C0] netif_receive_skb_internal+0xb0/0x300 [10824.750984][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10824.750986][ C0] ? __copy_skb_header+0xaf/0x490 [10824.750990][ C0] ? __skb_clone+0x57a/0x760 [10824.750992][ C0] netif_receive_skb+0x55/0x280 [10824.750995][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10824.751004][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10824.751011][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10824.751018][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10824.751024][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10824.751033][ C0] ? hlock_class+0x4e/0x130 [10824.751040][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10824.751050][ C0] ? place_entity+0x21/0x2f0 [10824.751054][ C0] ? resched_curr+0x219/0x280 [10824.751058][ C0] ? __pfx_resched_curr+0x10/0x10 [10824.751060][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10824.751064][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10824.751069][ C0] ? wakeup_preempt+0x161/0x2c0 [10824.751072][ C0] ? activate_task+0xf5/0x260 [10824.751075][ C0] ? trace_sched_wakeup+0xd2/0x100 [10824.751080][ C0] ? do_raw_spin_unlock+0x58/0x220 [10824.751084][ C0] ? _raw_spin_unlock+0x23/0x40 [10824.751088][ C0] ? get_stack_info_noinstr+0x18/0x110 [10824.751091][ C0] ? get_stack_info+0x36/0xc0 [10824.751094][ C0] ? stack_access_ok+0xda/0x1f0 [10824.751096][ C0] ? get_reg+0x119/0x190 [10824.751100][ C0] __tcf_classify+0x32c/0x7d0 [10824.751105][ C0] tcf_classify+0x283/0x930 [10824.751108][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10824.751114][ C0] ? __pfx_tcf_classify+0x10/0x10 [10824.751116][ C0] ? arch_stack_walk+0x8c/0x100 [10824.751121][ C0] ? get_stack_info_noinstr+0x18/0x110 [10824.751125][ C0] tc_run+0x2e4/0x5d0 [10824.751131][ C0] ? __pfx_tc_run+0x10/0x10 [10824.751134][ C0] ? lock_acquire+0x1c1/0x220 [10824.751136][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10824.751141][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10824.751147][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10824.751150][ C0] ? ip_finish_output2+0x786/0x18e0 [10824.751154][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10824.751160][ C0] ? neigh_hh_output+0x348/0x590 [10824.751165][ C0] ? ip_finish_output2+0x262/0x18e0 [10824.751169][ C0] ip_finish_output2+0x786/0x18e0 [10824.751172][ C0] ? stack_depot_save_flags+0x45/0x550 [10824.751179][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10824.751187][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10824.751190][ C0] ? rcu_read_lock_held+0xe/0x50 [10824.751194][ C0] ? __ip_finish_output+0x10f/0x770 [10824.751198][ C0] ip_output+0x16b/0x4f0 [10824.751201][ C0] ? __run_timers.part.0+0x52d/0x890 [10824.751207][ C0] ? __pfx_ip_output+0x10/0x10 [10824.751210][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10824.751215][ C0] ? rcu_read_lock_held+0xe/0x50 [10824.751218][ C0] ? ip_local_out+0x114/0x3b0 [10824.751222][ C0] __ip_queue_xmit+0x672/0x1910 [10824.751227][ C0] ? __skb_clone+0x57a/0x760 [10824.751230][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10824.751238][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10824.751242][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10824.751247][ C0] tcp_write_xmit+0xe42/0x24c0 [10824.751252][ C0] ? tcp_current_mss+0x40a/0x510 [10824.751255][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10824.751258][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10824.751261][ C0] ? mark_lock_irq+0x6e2/0xa10 [10824.751263][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10824.751266][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10824.751269][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10824.751276][ C0] ? ktime_get+0xb6/0x190 [10824.751280][ C0] tcp_send_loss_probe+0x4c9/0x830 [10824.751284][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10824.751287][ C0] tcp_write_timer+0x82/0x1d0 [10824.751291][ C0] call_timer_fn+0x176/0x430 [10824.751294][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10824.751299][ C0] ? next_expiry_recalc+0xcd/0x220 [10824.751303][ C0] __run_timers.part.0+0x52d/0x890 [10824.751306][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10824.751311][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10824.751314][ C0] ? lock_acquire+0x1c1/0x220 [10824.751316][ C0] ? clockevents_program_event+0xf6/0x300 [10824.751321][ C0] ? lock_release+0x1d5/0x250 [10824.751323][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10824.751326][ C0] ? ktime_get+0xb6/0x190 [10824.751329][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10824.751333][ C0] ? clockevents_program_event+0x1ed/0x300 [10824.751337][ C0] run_timer_softirq+0x72/0x100 [10824.751340][ C0] __do_softirq+0x1bc/0x7ff [10824.751345][ C0] irq_exit_rcu+0x98/0xc0 [10824.751349][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10824.751353][ C0] [10824.751354][ C0] [10824.751355][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10824.751361][ C0] RIP: 0010:default_idle+0xf/0x20 [10824.751365][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10824.751367][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10824.751370][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10824.751372][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10824.751373][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10824.751375][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10824.751377][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10824.751380][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10824.751384][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10824.751387][ C0] default_idle_call+0x69/0xa0 [10824.751390][ C0] cpuidle_idle_call+0x1f6/0x280 [10824.751393][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10824.751398][ C0] ? lock_release+0x1d5/0x250 [10824.751402][ C0] do_idle+0xfb/0x160 [10824.751404][ C0] cpu_startup_entry+0x55/0x60 [10824.751407][ C0] rest_init+0x153/0x260 [10824.751409][ C0] ? acpi_enable_subsystem+0xac/0x150 [10824.751415][ C0] arch_call_rest_init+0x13/0x40 [10824.751421][ C0] start_kernel+0x314/0x3d0 [10824.751424][ C0] x86_64_start_reservations+0x18/0x30 [10824.751430][ C0] x86_64_start_kernel+0xba/0x110 [10824.751433][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10824.751442][ C0] [10824.751675][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10824.805580][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10824.806225][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10824.806568][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10824.807587][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10824.807912][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10824.808332][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10824.808750][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10824.809172][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10824.809592][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10824.810011][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10824.810482][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10824.810836][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10824.811257][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10824.811680][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10824.812106][ C1] Call Trace: [10824.812291][ C1] [10824.812446][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10824.812732][ C1] ? print_cpu_stall+0x263/0x6a0 [10824.813000][ C1] ? check_cpu_stall+0x284/0x500 [10824.813261][ C1] ? rcu_pending+0x92/0x360 [10824.813505][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [10824.813794][ C1] ? update_process_times+0xb9/0x110 [10824.814085][ C1] ? tick_sched_handle+0x67/0x130 [10824.814353][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [10824.814647][ C1] ? __run_hrtimer+0x1c3/0x710 [10824.814905][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10824.815231][ C1] ? __hrtimer_run_queues+0x197/0x270 [10824.815519][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10824.815824][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10824.816110][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10824.816430][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10824.816704][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10824.817033][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10824.817344][ C1] [10824.817500][ C1] [10824.817656][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10824.817985][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10824.818290][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10824.818608][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10824.818909][ C1] ? run_ksoftirqd+0xb/0x60 [10824.819151][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10824.819478][ C1] ? __orc_find+0x9c/0xf0 [10824.819710][ C1] ? lock_acquire+0x1c1/0x220 [10824.819966][ C1] ? irqentry_enter+0x2b/0x60 [10824.820223][ C1] do_raw_spin_lock+0x1ec/0x270 [10824.820485][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10824.820771][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10824.821071][ C1] ? lock_acquire+0x1c1/0x220 [10824.821318][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10824.821566][ C1] _raw_spin_lock_nested+0x65/0x80 [10824.821837][ C1] tcp_v4_rcv+0x2159/0x29b0 [10824.822088][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10824.822350][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10824.822622][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10824.822914][ C1] ip_local_deliver_finish+0x2ae/0x450 [10824.823209][ C1] ip_local_deliver+0x19d/0x480 [10824.823468][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10824.823752][ C1] ? rcu_read_lock_held+0xe/0x50 [10824.824022][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10824.824297][ C1] ? rcu_read_lock_held+0xe/0x50 [10824.824559][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10824.824897][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10824.825171][ C1] ip_rcv+0x564/0x740 [10824.825382][ C1] ? __pfx_ip_rcv+0x10/0x10 [10824.825622][ C1] ? set_track_prepare+0x8a/0xd0 [10824.825884][ C1] ? irqentry_enter+0x2b/0x60 [10824.826136][ C1] ? irqentry_enter+0x2b/0x60 [10824.826388][ C1] ? __pfx_ip_rcv+0x10/0x10 [10824.826631][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10824.826948][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10824.827292][ C1] ? netif_receive_skb_internal+0x84/0x300 [10824.827601][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10824.827936][ C1] netif_receive_skb_internal+0xb0/0x300 [10824.828235][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10824.828571][ C1] netif_receive_skb+0x55/0x280 [10824.828832][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10824.829164][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10824.829512][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10824.829824][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10824.830116][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10824.830422][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10824.830752][ C1] ? unwind_next_frame+0x1478/0x1d10 [10824.831035][ C1] ? arch_stack_walk+0x68/0x100 [10824.831293][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10824.831568][ C1] ? irqentry_enter+0x2b/0x60 [10824.831815][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10824.832131][ C1] ? irqentry_enter+0x2b/0x60 [10824.832384][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10824.832709][ C1] ? unwind_next_frame+0x1478/0x1d10 [10824.832987][ C1] ? arch_stack_walk+0x68/0x100 [10824.833253][ C1] __tcf_classify+0x32c/0x7d0 [10824.833514][ C1] tcf_classify+0x283/0x930 [10824.833759][ C1] ? __pfx_tcf_classify+0x10/0x10 [10824.834035][ C1] tc_run+0x2e4/0x5d0 [10824.834249][ C1] ? __pfx_tc_run+0x10/0x10 [10824.834490][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10824.834754][ C1] ? irqentry_enter+0x2b/0x60 [10824.835005][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10824.835297][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10824.835625][ C1] ip_finish_output2+0x786/0x18e0 [10824.835894][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10824.836183][ C1] ? rcu_read_lock_held+0xe/0x50 [10824.836452][ C1] ? __ip_finish_output+0x10f/0x770 [10824.836729][ C1] ip_output+0x16b/0x4f0 [10824.836956][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10824.837278][ C1] ? __pfx_ip_output+0x10/0x10 [10824.837534][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10824.837890][ C1] ? __pfx_ip_output+0x10/0x10 [10824.838150][ C1] __ip_queue_xmit+0x672/0x1910 [10824.838411][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10824.838691][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10824.838986][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10824.839275][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10824.839570][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10824.839853][ C1] tcp_delack_timer+0x84/0x240 [10824.840107][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10824.840394][ C1] call_timer_fn+0x176/0x430 [10824.840644][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10824.840917][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10824.841198][ C1] __run_timers.part.0+0x52d/0x890 [10824.841473][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10824.841758][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10824.842058][ C1] ? __pfx___schedule+0x10/0x10 [10824.842324][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10824.842647][ C1] run_timer_softirq+0x72/0x100 [10824.842906][ C1] __do_softirq+0x1bc/0x7ff [10824.843147][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10824.843419][ C1] run_ksoftirqd+0x2e/0x60 [10824.843660][ C1] smpboot_thread_fn+0x30e/0x840 [10824.843929][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10824.844221][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10824.844512][ C1] kthread+0x292/0x360 [10824.844728][ C1] ? __pfx_kthread+0x10/0x10 [10824.844976][ C1] ret_from_fork+0x34/0x70 [10824.845212][ C1] ? __pfx_kthread+0x10/0x10 [10824.845460][ C1] ret_from_fork_asm+0x1b/0x30 [10824.845719][ C1] [10852.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 9001s! [swapper/0:0] [10852.527926][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10852.529123][ C0] irq event stamp: 27567077 [10852.529365][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10852.529902][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10852.530378][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10852.530884][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10852.531377][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10852.531857][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10852.532506][ C0] RIP: 0010:kasan_check_range+0x158/0x1c0 [10852.532816][ C0] Code: 11 80 38 00 74 ef 4d 8d 1c 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 <48> 83 c0 01 48 39 d0 74 a5 80 38 00 74 f2 e9 74 ff ff ff b8 01 00 [10852.533848][ C0] RSP: 0018:ffffc900000069b8 EFLAGS: 00000246 [10852.534174][ C0] RAX: ffffed100141336b RBX: ffffed100141336c RCX: ffffffff90c7aaa0 [10852.534594][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10852.535013][ C0] RBP: ffffed100141336b R08: 0000000000000000 R09: ffffed100141336b [10852.535436][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10852.535858][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10852.536275][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10852.536742][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10852.537096][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10852.537514][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10852.537938][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10852.538364][ C0] Call Trace: [10852.538550][ C0] [10852.538707][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10852.538982][ C0] ? __run_hrtimer+0x1c3/0x710 [10852.539239][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10852.539527][ C0] ? __hrtimer_run_queues+0x197/0x270 [10852.539816][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10852.540123][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10852.540406][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10852.540729][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10852.541000][ C0] ? hrtimer_interrupt+0x31a/0x770 [10852.541275][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10852.541550][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10852.541877][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10852.542191][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10852.542519][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10852.542826][ C0] ? kasan_check_range+0x158/0x1c0 [10852.543107][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [10852.543400][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10852.543726][ C0] ? get_stack_info+0x36/0xc0 [10852.543985][ C0] ? lock_acquire+0x1c1/0x220 [10852.544238][ C0] ? lock_release+0x1d5/0x250 [10852.544485][ C0] do_raw_spin_lock+0x1ec/0x270 [10852.544744][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10852.545029][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10852.545328][ C0] ? lock_acquire+0x1c1/0x220 [10852.545581][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10852.545838][ C0] _raw_spin_lock_nested+0x65/0x80 [10852.546114][ C0] tcp_v4_rcv+0x2159/0x29b0 [10852.546359][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10852.546617][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10852.546886][ C0] ? __inet_lookup_established+0x341/0x610 [10852.547202][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10852.547496][ C0] ip_local_deliver_finish+0x2ae/0x450 [10852.547791][ C0] ip_local_deliver+0x19d/0x480 [10852.548051][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10852.548335][ C0] ? rcu_read_lock_held+0xe/0x50 [10852.548601][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10852.548881][ C0] ? rcu_read_lock_held+0xe/0x50 [10852.549145][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10852.549479][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10852.549759][ C0] ip_rcv+0x564/0x740 [10852.549973][ C0] ? __pfx_ip_rcv+0x10/0x10 [10852.550224][ C0] ? set_track_prepare+0x8a/0xd0 [10852.550492][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10852.550779][ C0] ? rest_init+0x153/0x260 [10852.551020][ C0] ? skb_clone+0x10b/0x330 [10852.551261][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10852.551603][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10852.551924][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10852.552220][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10852.552528][ C0] ? __tcf_classify+0x32c/0x7d0 [10852.552788][ C0] ? __pfx_ip_rcv+0x10/0x10 [10852.553027][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10852.553343][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10852.553641][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10852.553987][ C0] ? lock_acquire+0x1c1/0x220 [10852.554236][ C0] ? netif_receive_skb_internal+0x84/0x300 [10852.554547][ C0] netif_receive_skb_internal+0xb0/0x300 [10852.554849][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10852.555180][ C0] ? __copy_skb_header+0xaf/0x490 [10852.555445][ C0] ? __skb_clone+0x57a/0x760 [10852.555688][ C0] netif_receive_skb+0x55/0x280 [10852.555950][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10852.556281][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10852.556633][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10852.556944][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10852.557234][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10852.557534][ C0] ? hlock_class+0x4e/0x130 [10852.557780][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10852.558115][ C0] ? place_entity+0x21/0x2f0 [10852.558365][ C0] ? resched_curr+0x219/0x280 [10852.558615][ C0] ? __pfx_resched_curr+0x10/0x10 [10852.558882][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10852.559163][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10852.559444][ C0] ? wakeup_preempt+0x161/0x2c0 [10852.559705][ C0] ? activate_task+0xf5/0x260 [10852.559957][ C0] ? trace_sched_wakeup+0xd2/0x100 [10852.560237][ C0] ? do_raw_spin_unlock+0x58/0x220 [10852.560508][ C0] ? _raw_spin_unlock+0x23/0x40 [10852.560769][ C0] ? get_stack_info_noinstr+0x18/0x110 [10852.561063][ C0] ? get_stack_info+0x36/0xc0 [10852.561313][ C0] ? stack_access_ok+0xda/0x1f0 [10852.561571][ C0] ? get_reg+0x119/0x190 [10852.561795][ C0] __tcf_classify+0x32c/0x7d0 [10852.562057][ C0] tcf_classify+0x283/0x930 [10852.562301][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10852.562633][ C0] ? __pfx_tcf_classify+0x10/0x10 [10852.562899][ C0] ? arch_stack_walk+0x8c/0x100 [10852.563158][ C0] ? get_stack_info_noinstr+0x18/0x110 [10852.563446][ C0] tc_run+0x2e4/0x5d0 [10852.563666][ C0] ? __pfx_tc_run+0x10/0x10 [10852.563912][ C0] ? lock_acquire+0x1c1/0x220 [10852.564163][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10852.564437][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10852.564707][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10852.564992][ C0] ? ip_finish_output2+0x786/0x18e0 [10852.565268][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10852.565585][ C0] ? neigh_hh_output+0x348/0x590 [10852.565852][ C0] ? ip_finish_output2+0x262/0x18e0 [10852.566128][ C0] ip_finish_output2+0x786/0x18e0 [10852.566395][ C0] ? stack_depot_save_flags+0x45/0x550 [10852.566687][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10852.567043][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10852.567335][ C0] ? rcu_read_lock_held+0xe/0x50 [10852.567598][ C0] ? __ip_finish_output+0x10f/0x770 [10852.567879][ C0] ip_output+0x16b/0x4f0 [10852.568106][ C0] ? __run_timers.part.0+0x52d/0x890 [10852.568386][ C0] ? __pfx_ip_output+0x10/0x10 [10852.568641][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10852.568939][ C0] ? rcu_read_lock_held+0xe/0x50 [10852.569205][ C0] ? ip_local_out+0x114/0x3b0 [10852.569454][ C0] __ip_queue_xmit+0x672/0x1910 [10852.569710][ C0] ? __skb_clone+0x57a/0x760 [10852.569953][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10852.570236][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10852.570536][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10852.570857][ C0] tcp_write_xmit+0xe42/0x24c0 [10852.571113][ C0] ? tcp_current_mss+0x40a/0x510 [10852.571377][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10852.571655][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10852.571932][ C0] ? mark_lock_irq+0x6e2/0xa10 [10852.572188][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10852.572456][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10852.572771][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10852.573051][ C0] ? ktime_get+0xb6/0x190 [10852.573284][ C0] tcp_send_loss_probe+0x4c9/0x830 [10852.573558][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10852.573840][ C0] tcp_write_timer+0x82/0x1d0 [10852.574090][ C0] call_timer_fn+0x176/0x430 [10852.574335][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10852.574611][ C0] ? next_expiry_recalc+0xcd/0x220 [10852.574889][ C0] __run_timers.part.0+0x52d/0x890 [10852.575164][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10852.575447][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10852.575748][ C0] ? lock_acquire+0x1c1/0x220 [10852.575994][ C0] ? clockevents_program_event+0xf6/0x300 [10852.576299][ C0] ? lock_release+0x1d5/0x250 [10852.576549][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10852.576823][ C0] ? ktime_get+0xb6/0x190 [10852.577054][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10852.577349][ C0] ? clockevents_program_event+0x1ed/0x300 [10852.577663][ C0] run_timer_softirq+0x72/0x100 [10852.577921][ C0] __do_softirq+0x1bc/0x7ff [10852.578163][ C0] irq_exit_rcu+0x98/0xc0 [10852.578392][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10852.578690][ C0] [10852.578849][ C0] [10852.579007][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10852.579332][ C0] RIP: 0010:default_idle+0xf/0x20 [10852.579599][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10852.580617][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10852.580941][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10852.581362][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10852.581782][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10852.582206][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10852.582625][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10852.583045][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10852.583348][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10852.583620][ C0] default_idle_call+0x69/0xa0 [10852.583881][ C0] cpuidle_idle_call+0x1f6/0x280 [10852.584149][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10852.584444][ C0] ? lock_release+0x1d5/0x250 [10852.584702][ C0] do_idle+0xfb/0x160 [10852.584917][ C0] cpu_startup_entry+0x55/0x60 [10852.585175][ C0] rest_init+0x153/0x260 [10852.585402][ C0] ? acpi_enable_subsystem+0xac/0x150 [10852.585696][ C0] arch_call_rest_init+0x13/0x40 [10852.585966][ C0] start_kernel+0x314/0x3d0 [10852.586208][ C0] x86_64_start_reservations+0x18/0x30 [10852.586500][ C0] x86_64_start_kernel+0xba/0x110 [10852.586774][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10852.587105][ C0] [10852.587272][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 9001s! [ksoftirqd/1:22] [10852.587720][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10852.588913][ C1] irq event stamp: 3886976 [10852.589151][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10852.589642][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10852.590132][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10852.590624][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10852.591115][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10852.591604][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10852.592246][ C1] RIP: 0010:kasan_check_range+0x106/0x1c0 [10852.592548][ C1] Code: 00 74 f2 48 89 c2 b8 01 00 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff <5b> b8 01 00 00 00 5d 41 5c c3 cc cc cc cc 41 bc 08 00 00 00 45 29 [10852.593561][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000246 [10852.593889][ C1] RAX: ffffed10014131c4 RBX: ffffed10014131c4 RCX: ffffffff90c7aaa0 [10852.594311][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10852.594733][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: ffffed10014131c3 [10852.595157][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10852.595579][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10852.595998][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10852.596473][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10852.596818][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10852.597240][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10852.597657][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10852.598075][ C1] Call Trace: [10852.598253][ C1] [10852.598408][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10852.598683][ C1] ? __run_hrtimer+0x1c3/0x710 [10852.598939][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10852.599234][ C1] ? __hrtimer_run_queues+0x197/0x270 [10852.599519][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10852.599820][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10852.600096][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10852.600415][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10852.600692][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10852.601015][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10852.601322][ C1] [10852.601482][ C1] [10852.601646][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10852.601977][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10852.602280][ C1] ? kasan_check_range+0x106/0x1c0 [10852.602551][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [10852.602845][ C1] ? run_ksoftirqd+0xb/0x60 [10852.603091][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10852.603420][ C1] ? __orc_find+0x9c/0xf0 [10852.603649][ C1] ? lock_acquire+0x1c1/0x220 [10852.603908][ C1] ? irqentry_enter+0x2b/0x60 [10852.604165][ C1] do_raw_spin_lock+0x1ec/0x270 [10852.604427][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10852.604714][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10852.605013][ C1] ? lock_acquire+0x1c1/0x220 [10852.605259][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10852.605507][ C1] _raw_spin_lock_nested+0x65/0x80 [10852.605777][ C1] tcp_v4_rcv+0x2159/0x29b0 [10852.606026][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10852.606287][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10852.606558][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10852.606849][ C1] ip_local_deliver_finish+0x2ae/0x450 [10852.607143][ C1] ip_local_deliver+0x19d/0x480 [10852.607400][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10852.607683][ C1] ? rcu_read_lock_held+0xe/0x50 [10852.607946][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10852.608226][ C1] ? rcu_read_lock_held+0xe/0x50 [10852.608491][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10852.608823][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10852.609102][ C1] ip_rcv+0x564/0x740 [10852.609315][ C1] ? __pfx_ip_rcv+0x10/0x10 [10852.609558][ C1] ? set_track_prepare+0x8a/0xd0 [10852.609821][ C1] ? irqentry_enter+0x2b/0x60 [10852.610073][ C1] ? irqentry_enter+0x2b/0x60 [10852.610320][ C1] ? __pfx_ip_rcv+0x10/0x10 [10852.610559][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10852.610873][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10852.611210][ C1] ? netif_receive_skb_internal+0x84/0x300 [10852.611515][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10852.611858][ C1] netif_receive_skb_internal+0xb0/0x300 [10852.612160][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10852.612490][ C1] netif_receive_skb+0x55/0x280 [10852.612751][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10852.613077][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10852.613423][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10852.613740][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10852.614038][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10852.614346][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10852.614676][ C1] ? unwind_next_frame+0x1478/0x1d10 [10852.614960][ C1] ? arch_stack_walk+0x68/0x100 [10852.615219][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10852.615493][ C1] ? irqentry_enter+0x2b/0x60 [10852.615742][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10852.616059][ C1] ? irqentry_enter+0x2b/0x60 [10852.616312][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10852.616638][ C1] ? unwind_next_frame+0x1478/0x1d10 [10852.616918][ C1] ? arch_stack_walk+0x68/0x100 [10852.617184][ C1] __tcf_classify+0x32c/0x7d0 [10852.617440][ C1] tcf_classify+0x283/0x930 [10852.617686][ C1] ? __pfx_tcf_classify+0x10/0x10 [10852.617957][ C1] tc_run+0x2e4/0x5d0 [10852.618173][ C1] ? __pfx_tc_run+0x10/0x10 [10852.618422][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10852.618688][ C1] ? irqentry_enter+0x2b/0x60 [10852.618936][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10852.619218][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10852.619538][ C1] ip_finish_output2+0x786/0x18e0 [10852.619811][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10852.620105][ C1] ? rcu_read_lock_held+0xe/0x50 [10852.620369][ C1] ? __ip_finish_output+0x10f/0x770 [10852.620650][ C1] ip_output+0x16b/0x4f0 [10852.620877][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10852.621194][ C1] ? __pfx_ip_output+0x10/0x10 [10852.621452][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10852.621804][ C1] ? __pfx_ip_output+0x10/0x10 [10852.622061][ C1] __ip_queue_xmit+0x672/0x1910 [10852.622324][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10852.622608][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10852.622905][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10852.623198][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10852.623495][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10852.623788][ C1] tcp_delack_timer+0x84/0x240 [10852.624041][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10852.624333][ C1] call_timer_fn+0x176/0x430 [10852.624581][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10852.624856][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10852.625136][ C1] __run_timers.part.0+0x52d/0x890 [10852.625411][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10852.625695][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10852.625995][ C1] ? __pfx___schedule+0x10/0x10 [10852.626260][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10852.626580][ C1] run_timer_softirq+0x72/0x100 [10852.626839][ C1] __do_softirq+0x1bc/0x7ff [10852.627081][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10852.627354][ C1] run_ksoftirqd+0x2e/0x60 [10852.627595][ C1] smpboot_thread_fn+0x30e/0x840 [10852.627860][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10852.628153][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10852.628440][ C1] kthread+0x292/0x360 [10852.628661][ C1] ? __pfx_kthread+0x10/0x10 [10852.628906][ C1] ret_from_fork+0x34/0x70 [10852.629151][ C1] ? __pfx_kthread+0x10/0x10 [10852.629394][ C1] ret_from_fork_asm+0x1b/0x30 [10852.629656][ C1] [10880.527469][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 9027s! [swapper/0:0] [10880.527941][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10880.529145][ C0] irq event stamp: 27567077 [10880.529388][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10880.529921][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10880.530405][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10880.530913][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10880.531414][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10880.531894][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10880.532545][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10880.532887][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10880.533911][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10880.534240][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10880.534668][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10880.535093][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10880.535519][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10880.535940][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10880.536363][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10880.536843][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10880.537191][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10880.537616][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10880.538036][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10880.538455][ C0] Call Trace: [10880.538636][ C0] [10880.538801][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10880.539083][ C0] ? __run_hrtimer+0x1c3/0x710 [10880.539342][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10880.539632][ C0] ? __hrtimer_run_queues+0x197/0x270 [10880.539921][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10880.540230][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10880.540513][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10880.540841][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10880.541115][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10880.541397][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10880.541722][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10880.542032][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10880.542368][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10880.542670][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10880.542978][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10880.543285][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10880.543618][ C0] ? get_stack_info+0x36/0xc0 [10880.543875][ C0] ? lock_acquire+0x1c1/0x220 [10880.544132][ C0] ? lock_release+0x1d5/0x250 [10880.544383][ C0] do_raw_spin_lock+0x1ec/0x270 [10880.544646][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10880.544935][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10880.545237][ C0] ? lock_acquire+0x1c1/0x220 [10880.545485][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10880.545739][ C0] _raw_spin_lock_nested+0x65/0x80 [10880.546010][ C0] tcp_v4_rcv+0x2159/0x29b0 [10880.546259][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10880.546521][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10880.546793][ C0] ? __inet_lookup_established+0x341/0x610 [10880.547111][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10880.547400][ C0] ip_local_deliver_finish+0x2ae/0x450 [10880.547689][ C0] ip_local_deliver+0x19d/0x480 [10880.547953][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10880.548243][ C0] ? rcu_read_lock_held+0xe/0x50 [10880.548510][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10880.548786][ C0] ? rcu_read_lock_held+0xe/0x50 [10880.549050][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10880.549389][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10880.549662][ C0] ip_rcv+0x564/0x740 [10880.549873][ C0] ? __pfx_ip_rcv+0x10/0x10 [10880.550115][ C0] ? set_track_prepare+0x8a/0xd0 [10880.550377][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10880.550666][ C0] ? rest_init+0x153/0x260 [10880.550901][ C0] ? skb_clone+0x10b/0x330 [10880.551145][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10880.551483][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10880.551801][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10880.552101][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10880.552414][ C0] ? __tcf_classify+0x32c/0x7d0 [10880.552674][ C0] ? __pfx_ip_rcv+0x10/0x10 [10880.552918][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10880.553238][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10880.553540][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10880.553884][ C0] ? lock_acquire+0x1c1/0x220 [10880.554136][ C0] ? netif_receive_skb_internal+0x84/0x300 [10880.554448][ C0] netif_receive_skb_internal+0xb0/0x300 [10880.554746][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10880.555082][ C0] ? __copy_skb_header+0xaf/0x490 [10880.555350][ C0] ? __skb_clone+0x57a/0x760 [10880.555599][ C0] netif_receive_skb+0x55/0x280 [10880.555854][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10880.556178][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10880.556524][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10880.556839][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10880.557127][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10880.557425][ C0] ? hlock_class+0x4e/0x130 [10880.557668][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10880.557996][ C0] ? place_entity+0x21/0x2f0 [10880.558243][ C0] ? resched_curr+0x219/0x280 [10880.558497][ C0] ? __pfx_resched_curr+0x10/0x10 [10880.558768][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10880.559053][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10880.559329][ C0] ? wakeup_preempt+0x161/0x2c0 [10880.559586][ C0] ? activate_task+0xf5/0x260 [10880.559836][ C0] ? trace_sched_wakeup+0xd2/0x100 [10880.560112][ C0] ? do_raw_spin_unlock+0x58/0x220 [10880.560386][ C0] ? _raw_spin_unlock+0x23/0x40 [10880.560642][ C0] ? get_stack_info_noinstr+0x18/0x110 [10880.560930][ C0] ? get_stack_info+0x36/0xc0 [10880.561187][ C0] ? stack_access_ok+0xda/0x1f0 [10880.561451][ C0] ? get_reg+0x119/0x190 [10880.561678][ C0] __tcf_classify+0x32c/0x7d0 [10880.561927][ C0] tcf_classify+0x283/0x930 [10880.562171][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10880.562500][ C0] ? __pfx_tcf_classify+0x10/0x10 [10880.562769][ C0] ? arch_stack_walk+0x8c/0x100 [10880.563036][ C0] ? get_stack_info_noinstr+0x18/0x110 [10880.563328][ C0] tc_run+0x2e4/0x5d0 [10880.563542][ C0] ? __pfx_tc_run+0x10/0x10 [10880.563789][ C0] ? lock_acquire+0x1c1/0x220 [10880.564045][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10880.564321][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10880.564591][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10880.564881][ C0] ? ip_finish_output2+0x786/0x18e0 [10880.565161][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10880.565483][ C0] ? neigh_hh_output+0x348/0x590 [10880.565746][ C0] ? ip_finish_output2+0x262/0x18e0 [10880.566027][ C0] ip_finish_output2+0x786/0x18e0 [10880.566299][ C0] ? stack_depot_save_flags+0x45/0x550 [10880.566594][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10880.566944][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10880.567232][ C0] ? rcu_read_lock_held+0xe/0x50 [10880.567501][ C0] ? __ip_finish_output+0x10f/0x770 [10880.567778][ C0] ip_output+0x16b/0x4f0 [10880.568004][ C0] ? __run_timers.part.0+0x52d/0x890 [10880.568291][ C0] ? __pfx_ip_output+0x10/0x10 [10880.568543][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10880.568845][ C0] ? rcu_read_lock_held+0xe/0x50 [10880.569109][ C0] ? ip_local_out+0x114/0x3b0 [10880.569362][ C0] __ip_queue_xmit+0x672/0x1910 [10880.569624][ C0] ? __skb_clone+0x57a/0x760 [10880.569872][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10880.570152][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10880.570446][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10880.570765][ C0] tcp_write_xmit+0xe42/0x24c0 [10880.571025][ C0] ? tcp_current_mss+0x40a/0x510 [10880.571288][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10880.571571][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10880.571846][ C0] ? mark_lock_irq+0x6e2/0xa10 [10880.572101][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10880.572370][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10880.572697][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10880.572972][ C0] ? ktime_get+0xb6/0x190 [10880.573204][ C0] tcp_send_loss_probe+0x4c9/0x830 [10880.573475][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10880.573764][ C0] tcp_write_timer+0x82/0x1d0 [10880.574017][ C0] call_timer_fn+0x176/0x430 [10880.574267][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10880.574540][ C0] ? next_expiry_recalc+0xcd/0x220 [10880.574816][ C0] __run_timers.part.0+0x52d/0x890 [10880.575089][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10880.575375][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10880.575672][ C0] ? lock_acquire+0x1c1/0x220 [10880.575923][ C0] ? clockevents_program_event+0xf6/0x300 [10880.576232][ C0] ? lock_release+0x1d5/0x250 [10880.576485][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10880.576765][ C0] ? ktime_get+0xb6/0x190 [10880.576999][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10880.577298][ C0] ? clockevents_program_event+0x1ed/0x300 [10880.577607][ C0] run_timer_softirq+0x72/0x100 [10880.577869][ C0] __do_softirq+0x1bc/0x7ff [10880.578118][ C0] irq_exit_rcu+0x98/0xc0 [10880.578349][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10880.578652][ C0] [10880.578808][ C0] [10880.578965][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10880.579285][ C0] RIP: 0010:default_idle+0xf/0x20 [10880.579558][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10880.580584][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10880.580910][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10880.581329][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10880.581747][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10880.582169][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10880.582591][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10880.583009][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10880.583315][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10880.583590][ C0] default_idle_call+0x69/0xa0 [10880.583848][ C0] cpuidle_idle_call+0x1f6/0x280 [10880.584110][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10880.584409][ C0] ? lock_release+0x1d5/0x250 [10880.584659][ C0] do_idle+0xfb/0x160 [10880.584873][ C0] cpu_startup_entry+0x55/0x60 [10880.585126][ C0] rest_init+0x153/0x260 [10880.585354][ C0] ? acpi_enable_subsystem+0xac/0x150 [10880.585642][ C0] arch_call_rest_init+0x13/0x40 [10880.585907][ C0] start_kernel+0x314/0x3d0 [10880.586155][ C0] x86_64_start_reservations+0x18/0x30 [10880.586450][ C0] x86_64_start_kernel+0xba/0x110 [10880.586720][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10880.587045][ C0] [10880.587208][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 9027s! [ksoftirqd/1:22] [10880.587665][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10880.588846][ C1] irq event stamp: 3886976 [10880.589084][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10880.589583][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10880.590080][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10880.590580][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10880.591067][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10880.591562][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10880.592206][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10880.592549][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10880.593570][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10880.593898][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10880.594315][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10880.594732][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10880.595149][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10880.595565][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10880.595981][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10880.596450][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10880.596800][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10880.597224][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10880.597648][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10880.598074][ C1] Call Trace: [10880.598254][ C1] [10880.598411][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10880.598683][ C1] ? __run_hrtimer+0x1c3/0x710 [10880.598941][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10880.599233][ C1] ? __hrtimer_run_queues+0x197/0x270 [10880.599525][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10880.599833][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10880.600114][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10880.600437][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10880.600709][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10880.601036][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10880.601347][ C1] [10880.601502][ C1] [10880.601658][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10880.601984][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10880.602292][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10880.602602][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10880.602902][ C1] ? run_ksoftirqd+0xb/0x60 [10880.603145][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10880.603467][ C1] ? __orc_find+0x9c/0xf0 [10880.603705][ C1] ? lock_acquire+0x1c1/0x220 [10880.603956][ C1] ? irqentry_enter+0x2b/0x60 [10880.604208][ C1] do_raw_spin_lock+0x1ec/0x270 [10880.604466][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10880.604748][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10880.605045][ C1] ? lock_acquire+0x1c1/0x220 [10880.605298][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10880.605553][ C1] _raw_spin_lock_nested+0x65/0x80 [10880.605828][ C1] tcp_v4_rcv+0x2159/0x29b0 [10880.606073][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10880.606330][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10880.606598][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10880.606886][ C1] ip_local_deliver_finish+0x2ae/0x450 [10880.607177][ C1] ip_local_deliver+0x19d/0x480 [10880.607437][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10880.607724][ C1] ? rcu_read_lock_held+0xe/0x50 [10880.607988][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10880.608264][ C1] ? rcu_read_lock_held+0xe/0x50 [10880.608524][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10880.608862][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10880.609135][ C1] ip_rcv+0x564/0x740 [10880.609350][ C1] ? __pfx_ip_rcv+0x10/0x10 [10880.609590][ C1] ? set_track_prepare+0x8a/0xd0 [10880.609853][ C1] ? irqentry_enter+0x2b/0x60 [10880.610108][ C1] ? irqentry_enter+0x2b/0x60 [10880.610363][ C1] ? __pfx_ip_rcv+0x10/0x10 [10880.610607][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10880.610926][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10880.611270][ C1] ? netif_receive_skb_internal+0x84/0x300 [10880.611582][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10880.611920][ C1] netif_receive_skb_internal+0xb0/0x300 [10880.612219][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10880.612556][ C1] netif_receive_skb+0x55/0x280 [10880.612817][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10880.613148][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10880.613498][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10880.613820][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10880.614109][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10880.614409][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10880.614737][ C1] ? unwind_next_frame+0x1478/0x1d10 [10880.615016][ C1] ? arch_stack_walk+0x68/0x100 [10880.615282][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10880.615565][ C1] ? irqentry_enter+0x2b/0x60 [10880.615819][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10880.616141][ C1] ? irqentry_enter+0x2b/0x60 [10880.616389][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10880.616712][ C1] ? unwind_next_frame+0x1478/0x1d10 [10880.616995][ C1] ? arch_stack_walk+0x68/0x100 [10880.617257][ C1] __tcf_classify+0x32c/0x7d0 [10880.617509][ C1] tcf_classify+0x283/0x930 [10880.617757][ C1] ? __pfx_tcf_classify+0x10/0x10 [10880.618026][ C1] tc_run+0x2e4/0x5d0 [10880.618239][ C1] ? __pfx_tc_run+0x10/0x10 [10880.618481][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10880.618746][ C1] ? irqentry_enter+0x2b/0x60 [10880.619001][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10880.619291][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10880.619615][ C1] ip_finish_output2+0x786/0x18e0 [10880.619884][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10880.620175][ C1] ? rcu_read_lock_held+0xe/0x50 [10880.620443][ C1] ? __ip_finish_output+0x10f/0x770 [10880.620718][ C1] ip_output+0x16b/0x4f0 [10880.620943][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10880.621265][ C1] ? __pfx_ip_output+0x10/0x10 [10880.621519][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10880.621881][ C1] ? __pfx_ip_output+0x10/0x10 [10880.622141][ C1] __ip_queue_xmit+0x672/0x1910 [10880.622402][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10880.622681][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10880.622976][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10880.623260][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10880.623552][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10880.623841][ C1] tcp_delack_timer+0x84/0x240 [10880.624099][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10880.624381][ C1] call_timer_fn+0x176/0x430 [10880.624626][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10880.624903][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10880.625182][ C1] __run_timers.part.0+0x52d/0x890 [10880.625453][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10880.625743][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10880.626046][ C1] ? __pfx___schedule+0x10/0x10 [10880.626306][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10880.626624][ C1] run_timer_softirq+0x72/0x100 [10880.626889][ C1] __do_softirq+0x1bc/0x7ff [10880.627135][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10880.627412][ C1] run_ksoftirqd+0x2e/0x60 [10880.627649][ C1] smpboot_thread_fn+0x30e/0x840 [10880.627917][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10880.628206][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10880.628497][ C1] kthread+0x292/0x360 [10880.628715][ C1] ? __pfx_kthread+0x10/0x10 [10880.628965][ C1] ret_from_fork+0x34/0x70 [10880.629206][ C1] ? __pfx_kthread+0x10/0x10 [10880.629453][ C1] ret_from_fork_asm+0x1b/0x30 [10880.629709][ C1] [10902.847024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [10902.847422][ C0] rcu: 0-....: (9647610 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=2302353 [10902.847945][ C0] rcu: (t=9708538 jiffies g=1007429 q=31 ncpus=4) [10902.848295][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10902.848772][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10902.849420][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10902.849770][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10902.850799][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10902.851128][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10902.851550][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10902.851974][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10902.852400][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10902.852821][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10902.853241][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10902.853720][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10902.854072][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10902.854490][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10902.854909][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10902.855334][ C0] Call Trace: [10902.855519][ C0] [10902.855676][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10902.855961][ C0] ? print_cpu_stall+0x263/0x6a0 [10902.856230][ C0] ? check_cpu_stall+0x284/0x500 [10902.856492][ C0] ? rcu_pending+0x92/0x360 [10902.856739][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [10902.857023][ C0] ? update_process_times+0xb9/0x110 [10902.857308][ C0] ? tick_sched_handle+0x67/0x130 [10902.857579][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [10902.857881][ C0] ? __run_hrtimer+0x1c3/0x710 [10902.858136][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10902.858464][ C0] ? __hrtimer_run_queues+0x197/0x270 [10902.858749][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10902.859051][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10902.859329][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10902.859649][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10902.859925][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10902.860201][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10902.860526][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10902.860841][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10902.861173][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10902.861477][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10902.861791][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10902.862093][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10902.862418][ C0] ? get_stack_info+0x36/0xc0 [10902.862674][ C0] ? lock_acquire+0x1c1/0x220 [10902.862927][ C0] ? lock_release+0x1d5/0x250 [10902.863180][ C0] do_raw_spin_lock+0x1ec/0x270 [10902.863442][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10902.863731][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10902.864030][ C0] ? lock_acquire+0x1c1/0x220 [10902.864286][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10902.864542][ C0] _raw_spin_lock_nested+0x65/0x80 [10902.864818][ C0] tcp_v4_rcv+0x2159/0x29b0 [10902.865063][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10902.865321][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10902.865589][ C0] ? __inet_lookup_established+0x341/0x610 [10902.865900][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10902.866192][ C0] ip_local_deliver_finish+0x2ae/0x450 [10902.866484][ C0] ip_local_deliver+0x19d/0x480 [10902.866741][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10902.867022][ C0] ? rcu_read_lock_held+0xe/0x50 [10902.867286][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10902.867567][ C0] ? rcu_read_lock_held+0xe/0x50 [10902.867833][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10902.868168][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10902.868445][ C0] ip_rcv+0x564/0x740 [10902.868664][ C0] ? __pfx_ip_rcv+0x10/0x10 [10902.868908][ C0] ? set_track_prepare+0x8a/0xd0 [10902.869177][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10902.869464][ C0] ? rest_init+0x153/0x260 [10902.869704][ C0] ? skb_clone+0x10b/0x330 [10902.869941][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10902.870279][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10902.870607][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10902.870902][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10902.871209][ C0] ? __tcf_classify+0x32c/0x7d0 [10902.871469][ C0] ? __pfx_ip_rcv+0x10/0x10 [10902.871710][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10902.872022][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10902.872318][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10902.872661][ C0] ? lock_acquire+0x1c1/0x220 [10902.872914][ C0] ? netif_receive_skb_internal+0x84/0x300 [10902.873225][ C0] netif_receive_skb_internal+0xb0/0x300 [10902.873527][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10902.873854][ C0] ? __copy_skb_header+0xaf/0x490 [10902.874120][ C0] ? __skb_clone+0x57a/0x760 [10902.874367][ C0] netif_receive_skb+0x55/0x280 [10902.874628][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10902.874961][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10902.875311][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10902.875623][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10902.875913][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10902.876218][ C0] ? hlock_class+0x4e/0x130 [10902.876465][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10902.876796][ C0] ? place_entity+0x21/0x2f0 [10902.877044][ C0] ? resched_curr+0x219/0x280 [10902.877293][ C0] ? __pfx_resched_curr+0x10/0x10 [10902.877559][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10902.877838][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10902.878119][ C0] ? wakeup_preempt+0x161/0x2c0 [10902.878379][ C0] ? activate_task+0xf5/0x260 [10902.878632][ C0] ? trace_sched_wakeup+0xd2/0x100 [10902.878910][ C0] ? do_raw_spin_unlock+0x58/0x220 [10902.879182][ C0] ? _raw_spin_unlock+0x23/0x40 [10902.879443][ C0] ? get_stack_info_noinstr+0x18/0x110 [10902.879734][ C0] ? get_stack_info+0x36/0xc0 [10902.879983][ C0] ? stack_access_ok+0xda/0x1f0 [10902.880238][ C0] ? get_reg+0x119/0x190 [10902.880463][ C0] __tcf_classify+0x32c/0x7d0 [10902.880717][ C0] tcf_classify+0x283/0x930 [10902.880962][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10902.881292][ C0] ? __pfx_tcf_classify+0x10/0x10 [10902.881557][ C0] ? arch_stack_walk+0x8c/0x100 [10902.881815][ C0] ? get_stack_info_noinstr+0x18/0x110 [10902.882103][ C0] tc_run+0x2e4/0x5d0 [10902.882326][ C0] ? __pfx_tc_run+0x10/0x10 [10902.882570][ C0] ? lock_acquire+0x1c1/0x220 [10902.882822][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10902.883099][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10902.883363][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10902.883653][ C0] ? ip_finish_output2+0x786/0x18e0 [10902.883928][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10902.884250][ C0] ? neigh_hh_output+0x348/0x590 [10902.884517][ C0] ? ip_finish_output2+0x262/0x18e0 [10902.884793][ C0] ip_finish_output2+0x786/0x18e0 [10902.885059][ C0] ? stack_depot_save_flags+0x45/0x550 [10902.885354][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10902.885709][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10902.885999][ C0] ? rcu_read_lock_held+0xe/0x50 [10902.886262][ C0] ? __ip_finish_output+0x10f/0x770 [10902.886542][ C0] ip_output+0x16b/0x4f0 [10902.886772][ C0] ? __run_timers.part.0+0x52d/0x890 [10902.887054][ C0] ? __pfx_ip_output+0x10/0x10 [10902.887311][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10902.887609][ C0] ? rcu_read_lock_held+0xe/0x50 [10902.887874][ C0] ? ip_local_out+0x114/0x3b0 [10902.888126][ C0] __ip_queue_xmit+0x672/0x1910 [10902.888385][ C0] ? __skb_clone+0x57a/0x760 [10902.888632][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10902.888916][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10902.889216][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10902.889535][ C0] tcp_write_xmit+0xe42/0x24c0 [10902.889800][ C0] ? tcp_current_mss+0x40a/0x510 [10902.890066][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10902.890347][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10902.890624][ C0] ? mark_lock_irq+0x6e2/0xa10 [10902.890881][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10902.891147][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10902.891465][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10902.891743][ C0] ? ktime_get+0xb6/0x190 [10902.891976][ C0] tcp_send_loss_probe+0x4c9/0x830 [10902.892252][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10902.892532][ C0] tcp_write_timer+0x82/0x1d0 [10902.892787][ C0] call_timer_fn+0x176/0x430 [10902.893036][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10902.893307][ C0] ? next_expiry_recalc+0xcd/0x220 [10902.893589][ C0] __run_timers.part.0+0x52d/0x890 [10902.893862][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10902.894141][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10902.894441][ C0] ? lock_acquire+0x1c1/0x220 [10902.894689][ C0] ? clockevents_program_event+0xf6/0x300 [10902.894992][ C0] ? lock_release+0x1d5/0x250 [10902.895239][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10902.895512][ C0] ? ktime_get+0xb6/0x190 [10902.895740][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10902.896037][ C0] ? clockevents_program_event+0x1ed/0x300 [10902.896348][ C0] run_timer_softirq+0x72/0x100 [10902.896606][ C0] __do_softirq+0x1bc/0x7ff [10902.896846][ C0] irq_exit_rcu+0x98/0xc0 [10902.897082][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10902.897378][ C0] [10902.897538][ C0] [10902.897697][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10902.898018][ C0] RIP: 0010:default_idle+0xf/0x20 [10902.898285][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10902.899301][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10902.899624][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10902.900046][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10902.900465][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10902.900877][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10902.901291][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10902.901707][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10902.902007][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10902.902279][ C0] default_idle_call+0x69/0xa0 [10902.902535][ C0] cpuidle_idle_call+0x1f6/0x280 [10902.902796][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10902.903087][ C0] ? lock_release+0x1d5/0x250 [10902.903334][ C0] do_idle+0xfb/0x160 [10902.903549][ C0] cpu_startup_entry+0x55/0x60 [10902.903807][ C0] rest_init+0x153/0x260 [10902.904032][ C0] ? acpi_enable_subsystem+0xac/0x150 [10902.904319][ C0] arch_call_rest_init+0x13/0x40 [10902.904586][ C0] start_kernel+0x314/0x3d0 [10902.904825][ C0] x86_64_start_reservations+0x18/0x30 [10902.905114][ C0] x86_64_start_kernel+0xba/0x110 [10902.905384][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10902.905716][ C0] [10902.905886][ C0] Sending NMI from CPU 0 to CPUs 1: [10902.906172][ C1] NMI backtrace for cpu 1 [10902.906178][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10902.906182][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10902.906184][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10902.906191][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10902.906194][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10902.906197][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10902.906199][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10902.906201][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10902.906203][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10902.906204][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10902.906206][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10902.906208][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10902.906212][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10902.906214][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10902.906215][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10902.906217][ C1] Call Trace: [10902.906219][ C1] [10902.906222][ C1] ? nmi_cpu_backtrace+0x112/0x220 [10902.906228][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [10902.906233][ C1] ? nmi_handle+0x156/0x420 [10902.906237][ C1] ? default_do_nmi+0x41/0x100 [10902.906240][ C1] ? exc_nmi+0xf3/0x120 [10902.906243][ C1] ? end_repeat_nmi+0xf/0x60 [10902.906247][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10902.906251][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10902.906255][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10902.906258][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10902.906262][ C1] [10902.906263][ C1] [10902.906264][ C1] ? run_ksoftirqd+0xb/0x60 [10902.906269][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10902.906272][ C1] ? __orc_find+0x9c/0xf0 [10902.906275][ C1] ? lock_acquire+0x1c1/0x220 [10902.906279][ C1] ? irqentry_enter+0x2b/0x60 [10902.906284][ C1] do_raw_spin_lock+0x1ec/0x270 [10902.906288][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10902.906291][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10902.906294][ C1] ? lock_acquire+0x1c1/0x220 [10902.906296][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10902.906301][ C1] _raw_spin_lock_nested+0x65/0x80 [10902.906304][ C1] tcp_v4_rcv+0x2159/0x29b0 [10902.906312][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10902.906315][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10902.906320][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10902.906326][ C1] ip_local_deliver_finish+0x2ae/0x450 [10902.906330][ C1] ip_local_deliver+0x19d/0x480 [10902.906334][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10902.906336][ C1] ? rcu_read_lock_held+0xe/0x50 [10902.906340][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10902.906344][ C1] ? rcu_read_lock_held+0xe/0x50 [10902.906347][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10902.906351][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10902.906359][ C1] ip_rcv+0x564/0x740 [10902.906363][ C1] ? __pfx_ip_rcv+0x10/0x10 [10902.906366][ C1] ? set_track_prepare+0x8a/0xd0 [10902.906370][ C1] ? irqentry_enter+0x2b/0x60 [10902.906373][ C1] ? irqentry_enter+0x2b/0x60 [10902.906377][ C1] ? __pfx_ip_rcv+0x10/0x10 [10902.906379][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10902.906383][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10902.906386][ C1] ? netif_receive_skb_internal+0x84/0x300 [10902.906390][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10902.906393][ C1] netif_receive_skb_internal+0xb0/0x300 [10902.906395][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10902.906400][ C1] netif_receive_skb+0x55/0x280 [10902.906403][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10902.906411][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10902.906417][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10902.906424][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10902.906430][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10902.906442][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10902.906451][ C1] ? unwind_next_frame+0x1478/0x1d10 [10902.906454][ C1] ? arch_stack_walk+0x68/0x100 [10902.906458][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10902.906462][ C1] ? irqentry_enter+0x2b/0x60 [10902.906465][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10902.906469][ C1] ? irqentry_enter+0x2b/0x60 [10902.906473][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10902.906481][ C1] ? unwind_next_frame+0x1478/0x1d10 [10902.906483][ C1] ? arch_stack_walk+0x68/0x100 [10902.906487][ C1] __tcf_classify+0x32c/0x7d0 [10902.906492][ C1] tcf_classify+0x283/0x930 [10902.906496][ C1] ? __pfx_tcf_classify+0x10/0x10 [10902.906501][ C1] tc_run+0x2e4/0x5d0 [10902.906505][ C1] ? __pfx_tc_run+0x10/0x10 [10902.906510][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10902.906515][ C1] ? irqentry_enter+0x2b/0x60 [10902.906518][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10902.906521][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10902.906528][ C1] ip_finish_output2+0x786/0x18e0 [10902.906534][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10902.906537][ C1] ? rcu_read_lock_held+0xe/0x50 [10902.906541][ C1] ? __ip_finish_output+0x10f/0x770 [10902.906545][ C1] ip_output+0x16b/0x4f0 [10902.906548][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10902.906551][ C1] ? __pfx_ip_output+0x10/0x10 [10902.906555][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10902.906563][ C1] ? __pfx_ip_output+0x10/0x10 [10902.906567][ C1] __ip_queue_xmit+0x672/0x1910 [10902.906573][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10902.906580][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10902.906584][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10902.906588][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10902.906592][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10902.906595][ C1] tcp_delack_timer+0x84/0x240 [10902.906599][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10902.906602][ C1] call_timer_fn+0x176/0x430 [10902.906607][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10902.906612][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10902.906616][ C1] __run_timers.part.0+0x52d/0x890 [10902.906619][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10902.906624][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10902.906628][ C1] ? __pfx___schedule+0x10/0x10 [10902.906632][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10902.906637][ C1] run_timer_softirq+0x72/0x100 [10902.906641][ C1] __do_softirq+0x1bc/0x7ff [10902.906644][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10902.906648][ C1] run_ksoftirqd+0x2e/0x60 [10902.906652][ C1] smpboot_thread_fn+0x30e/0x840 [10902.906657][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10902.906661][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10902.906664][ C1] kthread+0x292/0x360 [10902.906667][ C1] ? __pfx_kthread+0x10/0x10 [10902.906670][ C1] ret_from_fork+0x34/0x70 [10902.906673][ C1] ? __pfx_kthread+0x10/0x10 [10902.906675][ C1] ret_from_fork_asm+0x1b/0x30 [10902.906683][ C1] [10928.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 9071s! [swapper/0:0] [10928.527923][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10928.529123][ C0] irq event stamp: 27567077 [10928.529366][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10928.529899][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10928.530370][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10928.530871][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10928.531361][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10928.531836][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10928.532481][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10928.532826][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10928.533853][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10928.534175][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10928.534593][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10928.535012][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10928.535431][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10928.535852][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10928.536270][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10928.536738][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10928.537091][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10928.537511][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10928.537936][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10928.538362][ C0] Call Trace: [10928.538545][ C0] [10928.538703][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10928.538979][ C0] ? __run_hrtimer+0x1c3/0x710 [10928.539238][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10928.539529][ C0] ? __hrtimer_run_queues+0x197/0x270 [10928.539818][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10928.540122][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10928.540402][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10928.540725][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10928.540997][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10928.541278][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10928.541602][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10928.541911][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10928.542246][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10928.542548][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10928.542856][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10928.543162][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10928.543495][ C0] ? get_stack_info+0x36/0xc0 [10928.543753][ C0] ? lock_acquire+0x1c1/0x220 [10928.544008][ C0] ? lock_release+0x1d5/0x250 [10928.544261][ C0] do_raw_spin_lock+0x1ec/0x270 [10928.544523][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10928.544812][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10928.545114][ C0] ? lock_acquire+0x1c1/0x220 [10928.545362][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10928.545616][ C0] _raw_spin_lock_nested+0x65/0x80 [10928.545887][ C0] tcp_v4_rcv+0x2159/0x29b0 [10928.546136][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10928.546396][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10928.546672][ C0] ? __inet_lookup_established+0x341/0x610 [10928.546987][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10928.547274][ C0] ip_local_deliver_finish+0x2ae/0x450 [10928.547562][ C0] ip_local_deliver+0x19d/0x480 [10928.547822][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10928.548111][ C0] ? rcu_read_lock_held+0xe/0x50 [10928.548380][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10928.548657][ C0] ? rcu_read_lock_held+0xe/0x50 [10928.548918][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10928.549257][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10928.549531][ C0] ip_rcv+0x564/0x740 [10928.549744][ C0] ? __pfx_ip_rcv+0x10/0x10 [10928.549986][ C0] ? set_track_prepare+0x8a/0xd0 [10928.550252][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10928.550542][ C0] ? rest_init+0x153/0x260 [10928.550778][ C0] ? skb_clone+0x10b/0x330 [10928.551019][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10928.551350][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10928.551667][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10928.551963][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10928.552276][ C0] ? __tcf_classify+0x32c/0x7d0 [10928.552538][ C0] ? __pfx_ip_rcv+0x10/0x10 [10928.552782][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10928.553097][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10928.553425][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10928.553771][ C0] ? lock_acquire+0x1c1/0x220 [10928.554025][ C0] ? netif_receive_skb_internal+0x84/0x300 [10928.554337][ C0] netif_receive_skb_internal+0xb0/0x300 [10928.554633][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10928.554966][ C0] ? __copy_skb_header+0xaf/0x490 [10928.555239][ C0] ? __skb_clone+0x57a/0x760 [10928.555487][ C0] netif_receive_skb+0x55/0x280 [10928.555745][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10928.556078][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10928.556425][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10928.556743][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10928.557030][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10928.557329][ C0] ? hlock_class+0x4e/0x130 [10928.557575][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10928.557901][ C0] ? place_entity+0x21/0x2f0 [10928.558146][ C0] ? resched_curr+0x219/0x280 [10928.558398][ C0] ? __pfx_resched_curr+0x10/0x10 [10928.558673][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10928.558958][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10928.559234][ C0] ? wakeup_preempt+0x161/0x2c0 [10928.559491][ C0] ? activate_task+0xf5/0x260 [10928.559742][ C0] ? trace_sched_wakeup+0xd2/0x100 [10928.560022][ C0] ? do_raw_spin_unlock+0x58/0x220 [10928.560298][ C0] ? _raw_spin_unlock+0x23/0x40 [10928.560557][ C0] ? get_stack_info_noinstr+0x18/0x110 [10928.560843][ C0] ? get_stack_info+0x36/0xc0 [10928.561098][ C0] ? stack_access_ok+0xda/0x1f0 [10928.561358][ C0] ? get_reg+0x119/0x190 [10928.561589][ C0] __tcf_classify+0x32c/0x7d0 [10928.561839][ C0] tcf_classify+0x283/0x930 [10928.562084][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10928.562413][ C0] ? __pfx_tcf_classify+0x10/0x10 [10928.562681][ C0] ? arch_stack_walk+0x8c/0x100 [10928.562944][ C0] ? get_stack_info_noinstr+0x18/0x110 [10928.563239][ C0] tc_run+0x2e4/0x5d0 [10928.563461][ C0] ? __pfx_tc_run+0x10/0x10 [10928.563706][ C0] ? lock_acquire+0x1c1/0x220 [10928.563959][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10928.564238][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10928.564503][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10928.564792][ C0] ? ip_finish_output2+0x786/0x18e0 [10928.565072][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10928.565396][ C0] ? neigh_hh_output+0x348/0x590 [10928.565659][ C0] ? ip_finish_output2+0x262/0x18e0 [10928.565938][ C0] ip_finish_output2+0x786/0x18e0 [10928.566209][ C0] ? stack_depot_save_flags+0x45/0x550 [10928.566507][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10928.566859][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10928.567147][ C0] ? rcu_read_lock_held+0xe/0x50 [10928.567417][ C0] ? __ip_finish_output+0x10f/0x770 [10928.567693][ C0] ip_output+0x16b/0x4f0 [10928.567919][ C0] ? __run_timers.part.0+0x52d/0x890 [10928.568206][ C0] ? __pfx_ip_output+0x10/0x10 [10928.568460][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10928.568759][ C0] ? rcu_read_lock_held+0xe/0x50 [10928.569022][ C0] ? ip_local_out+0x114/0x3b0 [10928.569278][ C0] __ip_queue_xmit+0x672/0x1910 [10928.569541][ C0] ? __skb_clone+0x57a/0x760 [10928.569795][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10928.570077][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10928.570371][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10928.570687][ C0] tcp_write_xmit+0xe42/0x24c0 [10928.570948][ C0] ? tcp_current_mss+0x40a/0x510 [10928.571213][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10928.571495][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10928.571771][ C0] ? mark_lock_irq+0x6e2/0xa10 [10928.572025][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10928.572295][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10928.572618][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10928.572894][ C0] ? ktime_get+0xb6/0x190 [10928.573125][ C0] tcp_send_loss_probe+0x4c9/0x830 [10928.573400][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10928.573682][ C0] tcp_write_timer+0x82/0x1d0 [10928.573940][ C0] call_timer_fn+0x176/0x430 [10928.574192][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10928.574464][ C0] ? next_expiry_recalc+0xcd/0x220 [10928.574739][ C0] __run_timers.part.0+0x52d/0x890 [10928.575010][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10928.575295][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10928.575593][ C0] ? lock_acquire+0x1c1/0x220 [10928.575848][ C0] ? clockevents_program_event+0xf6/0x300 [10928.576156][ C0] ? lock_release+0x1d5/0x250 [10928.576407][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10928.576686][ C0] ? ktime_get+0xb6/0x190 [10928.576918][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10928.577219][ C0] ? clockevents_program_event+0x1ed/0x300 [10928.577530][ C0] run_timer_softirq+0x72/0x100 [10928.577794][ C0] __do_softirq+0x1bc/0x7ff [10928.578042][ C0] irq_exit_rcu+0x98/0xc0 [10928.578276][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10928.578577][ C0] [10928.578733][ C0] [10928.578889][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10928.579205][ C0] RIP: 0010:default_idle+0xf/0x20 [10928.579480][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10928.580507][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10928.580830][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10928.581256][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10928.581675][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10928.582094][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10928.582517][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10928.582943][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10928.583247][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10928.583527][ C0] default_idle_call+0x69/0xa0 [10928.583785][ C0] cpuidle_idle_call+0x1f6/0x280 [10928.584048][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10928.584341][ C0] ? lock_release+0x1d5/0x250 [10928.584588][ C0] do_idle+0xfb/0x160 [10928.584800][ C0] cpu_startup_entry+0x55/0x60 [10928.585055][ C0] rest_init+0x153/0x260 [10928.585281][ C0] ? acpi_enable_subsystem+0xac/0x150 [10928.585566][ C0] arch_call_rest_init+0x13/0x40 [10928.585831][ C0] start_kernel+0x314/0x3d0 [10928.586078][ C0] x86_64_start_reservations+0x18/0x30 [10928.586373][ C0] x86_64_start_kernel+0xba/0x110 [10928.586640][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10928.586968][ C0] [10928.587133][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 9071s! [ksoftirqd/1:22] [10928.587583][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10928.588775][ C1] irq event stamp: 3886976 [10928.589013][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10928.589506][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10928.589996][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10928.590490][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10928.590980][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10928.591474][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10928.592123][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10928.592463][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10928.593486][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10928.593812][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10928.594240][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10928.594661][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10928.595083][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10928.595508][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10928.595934][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10928.596414][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10928.596764][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10928.597193][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10928.597614][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10928.598037][ C1] Call Trace: [10928.598213][ C1] [10928.598368][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10928.598644][ C1] ? __run_hrtimer+0x1c3/0x710 [10928.598898][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10928.599191][ C1] ? __hrtimer_run_queues+0x197/0x270 [10928.599476][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10928.599777][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10928.600055][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10928.600374][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10928.600651][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10928.600973][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10928.601283][ C1] [10928.601441][ C1] [10928.601600][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10928.601933][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10928.602237][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10928.602547][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10928.602854][ C1] ? run_ksoftirqd+0xb/0x60 [10928.603103][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10928.603437][ C1] ? __orc_find+0x9c/0xf0 [10928.603671][ C1] ? lock_acquire+0x1c1/0x220 [10928.603925][ C1] ? irqentry_enter+0x2b/0x60 [10928.604178][ C1] do_raw_spin_lock+0x1ec/0x270 [10928.604440][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10928.604729][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10928.605030][ C1] ? lock_acquire+0x1c1/0x220 [10928.605281][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10928.605533][ C1] _raw_spin_lock_nested+0x65/0x80 [10928.605805][ C1] tcp_v4_rcv+0x2159/0x29b0 [10928.606055][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10928.606317][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10928.606591][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10928.606881][ C1] ip_local_deliver_finish+0x2ae/0x450 [10928.607174][ C1] ip_local_deliver+0x19d/0x480 [10928.607431][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10928.607713][ C1] ? rcu_read_lock_held+0xe/0x50 [10928.607978][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10928.608258][ C1] ? rcu_read_lock_held+0xe/0x50 [10928.608526][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10928.608860][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10928.609137][ C1] ip_rcv+0x564/0x740 [10928.609356][ C1] ? __pfx_ip_rcv+0x10/0x10 [10928.609601][ C1] ? set_track_prepare+0x8a/0xd0 [10928.609868][ C1] ? irqentry_enter+0x2b/0x60 [10928.610120][ C1] ? irqentry_enter+0x2b/0x60 [10928.610371][ C1] ? __pfx_ip_rcv+0x10/0x10 [10928.610614][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10928.610925][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10928.611264][ C1] ? netif_receive_skb_internal+0x84/0x300 [10928.611573][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10928.611913][ C1] netif_receive_skb_internal+0xb0/0x300 [10928.612213][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10928.612543][ C1] netif_receive_skb+0x55/0x280 [10928.612801][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10928.613126][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10928.613479][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10928.613790][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10928.614081][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10928.614383][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10928.614715][ C1] ? unwind_next_frame+0x1478/0x1d10 [10928.615001][ C1] ? arch_stack_walk+0x68/0x100 [10928.615261][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10928.615535][ C1] ? irqentry_enter+0x2b/0x60 [10928.615785][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10928.616106][ C1] ? irqentry_enter+0x2b/0x60 [10928.616360][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10928.616684][ C1] ? unwind_next_frame+0x1478/0x1d10 [10928.616967][ C1] ? arch_stack_walk+0x68/0x100 [10928.617230][ C1] __tcf_classify+0x32c/0x7d0 [10928.617482][ C1] tcf_classify+0x283/0x930 [10928.617726][ C1] ? __pfx_tcf_classify+0x10/0x10 [10928.617996][ C1] tc_run+0x2e4/0x5d0 [10928.618217][ C1] ? __pfx_tc_run+0x10/0x10 [10928.618463][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10928.618732][ C1] ? irqentry_enter+0x2b/0x60 [10928.618981][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10928.619267][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10928.619586][ C1] ip_finish_output2+0x786/0x18e0 [10928.619859][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10928.620150][ C1] ? rcu_read_lock_held+0xe/0x50 [10928.620412][ C1] ? __ip_finish_output+0x10f/0x770 [10928.620692][ C1] ip_output+0x16b/0x4f0 [10928.620922][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10928.621240][ C1] ? __pfx_ip_output+0x10/0x10 [10928.621499][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10928.621849][ C1] ? __pfx_ip_output+0x10/0x10 [10928.622104][ C1] __ip_queue_xmit+0x672/0x1910 [10928.622367][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10928.622649][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10928.622945][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10928.623235][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10928.623540][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10928.623824][ C1] tcp_delack_timer+0x84/0x240 [10928.624081][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10928.624372][ C1] call_timer_fn+0x176/0x430 [10928.624623][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10928.624896][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10928.625177][ C1] __run_timers.part.0+0x52d/0x890 [10928.625451][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10928.625739][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10928.626040][ C1] ? __pfx___schedule+0x10/0x10 [10928.626301][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10928.626624][ C1] run_timer_softirq+0x72/0x100 [10928.626882][ C1] __do_softirq+0x1bc/0x7ff [10928.627124][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10928.627396][ C1] run_ksoftirqd+0x2e/0x60 [10928.627641][ C1] smpboot_thread_fn+0x30e/0x840 [10928.627904][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10928.628199][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10928.628488][ C1] kthread+0x292/0x360 [10928.628707][ C1] ? __pfx_kthread+0x10/0x10 [10928.628951][ C1] ret_from_fork+0x34/0x70 [10928.629192][ C1] ? __pfx_kthread+0x10/0x10 [10928.629436][ C1] ret_from_fork_asm+0x1b/0x30 [10928.629699][ C1] [10956.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 9098s! [swapper/0:0] [10956.527927][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10956.529123][ C0] irq event stamp: 27567077 [10956.529362][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [10956.529892][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [10956.530370][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [10956.530884][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [10956.531384][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10956.531866][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10956.532506][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [10956.532845][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [10956.533874][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10956.534198][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10956.534616][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10956.535033][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10956.535451][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10956.535868][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10956.536287][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10956.536755][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10956.537108][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10956.537527][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10956.537948][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10956.538372][ C0] Call Trace: [10956.538559][ C0] [10956.538716][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [10956.538990][ C0] ? __run_hrtimer+0x1c3/0x710 [10956.539248][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [10956.539537][ C0] ? __hrtimer_run_queues+0x197/0x270 [10956.539826][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [10956.540133][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10956.540418][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10956.540739][ C0] ? hrtimer_interrupt+0x2c3/0x770 [10956.541011][ C0] ? trace_rcu_dyntick+0x10a/0x150 [10956.541296][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10956.541617][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [10956.541928][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10956.542262][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10956.542565][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [10956.542867][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10956.543174][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10956.543510][ C0] ? get_stack_info+0x36/0xc0 [10956.543765][ C0] ? lock_acquire+0x1c1/0x220 [10956.544017][ C0] ? lock_release+0x1d5/0x250 [10956.544268][ C0] do_raw_spin_lock+0x1ec/0x270 [10956.544528][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10956.544810][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10956.545107][ C0] ? lock_acquire+0x1c1/0x220 [10956.545361][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10956.545618][ C0] _raw_spin_lock_nested+0x65/0x80 [10956.545895][ C0] tcp_v4_rcv+0x2159/0x29b0 [10956.546145][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10956.546404][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10956.546672][ C0] ? __inet_lookup_established+0x341/0x610 [10956.546985][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10956.547279][ C0] ip_local_deliver_finish+0x2ae/0x450 [10956.547572][ C0] ip_local_deliver+0x19d/0x480 [10956.547828][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10956.548110][ C0] ? rcu_read_lock_held+0xe/0x50 [10956.548376][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10956.548657][ C0] ? rcu_read_lock_held+0xe/0x50 [10956.548925][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10956.549260][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10956.549538][ C0] ip_rcv+0x564/0x740 [10956.549759][ C0] ? __pfx_ip_rcv+0x10/0x10 [10956.550004][ C0] ? set_track_prepare+0x8a/0xd0 [10956.550275][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10956.550565][ C0] ? rest_init+0x153/0x260 [10956.550806][ C0] ? skb_clone+0x10b/0x330 [10956.551045][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10956.551383][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10956.551707][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10956.552002][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10956.552311][ C0] ? __tcf_classify+0x32c/0x7d0 [10956.552571][ C0] ? __pfx_ip_rcv+0x10/0x10 [10956.552813][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10956.553127][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10956.553430][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10956.553770][ C0] ? lock_acquire+0x1c1/0x220 [10956.554020][ C0] ? netif_receive_skb_internal+0x84/0x300 [10956.554328][ C0] netif_receive_skb_internal+0xb0/0x300 [10956.554627][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10956.554954][ C0] ? __copy_skb_header+0xaf/0x490 [10956.555220][ C0] ? __skb_clone+0x57a/0x760 [10956.555476][ C0] netif_receive_skb+0x55/0x280 [10956.555738][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10956.556072][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10956.556422][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10956.556734][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10956.557031][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10956.557336][ C0] ? hlock_class+0x4e/0x130 [10956.557585][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10956.557917][ C0] ? place_entity+0x21/0x2f0 [10956.558166][ C0] ? resched_curr+0x219/0x280 [10956.558416][ C0] ? __pfx_resched_curr+0x10/0x10 [10956.558683][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10956.558965][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10956.559247][ C0] ? wakeup_preempt+0x161/0x2c0 [10956.559508][ C0] ? activate_task+0xf5/0x260 [10956.559762][ C0] ? trace_sched_wakeup+0xd2/0x100 [10956.560042][ C0] ? do_raw_spin_unlock+0x58/0x220 [10956.560314][ C0] ? _raw_spin_unlock+0x23/0x40 [10956.560576][ C0] ? get_stack_info_noinstr+0x18/0x110 [10956.560868][ C0] ? get_stack_info+0x36/0xc0 [10956.561119][ C0] ? stack_access_ok+0xda/0x1f0 [10956.561374][ C0] ? get_reg+0x119/0x190 [10956.561600][ C0] __tcf_classify+0x32c/0x7d0 [10956.561854][ C0] tcf_classify+0x283/0x930 [10956.562102][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10956.562433][ C0] ? __pfx_tcf_classify+0x10/0x10 [10956.562699][ C0] ? arch_stack_walk+0x8c/0x100 [10956.562957][ C0] ? get_stack_info_noinstr+0x18/0x110 [10956.563245][ C0] tc_run+0x2e4/0x5d0 [10956.563468][ C0] ? __pfx_tc_run+0x10/0x10 [10956.563709][ C0] ? lock_acquire+0x1c1/0x220 [10956.563954][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10956.564228][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10956.564494][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10956.564775][ C0] ? ip_finish_output2+0x786/0x18e0 [10956.565050][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10956.565371][ C0] ? neigh_hh_output+0x348/0x590 [10956.565638][ C0] ? ip_finish_output2+0x262/0x18e0 [10956.565917][ C0] ip_finish_output2+0x786/0x18e0 [10956.566184][ C0] ? stack_depot_save_flags+0x45/0x550 [10956.566475][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10956.566830][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10956.567121][ C0] ? rcu_read_lock_held+0xe/0x50 [10956.567383][ C0] ? __ip_finish_output+0x10f/0x770 [10956.567662][ C0] ip_output+0x16b/0x4f0 [10956.567893][ C0] ? __run_timers.part.0+0x52d/0x890 [10956.568176][ C0] ? __pfx_ip_output+0x10/0x10 [10956.568433][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10956.568731][ C0] ? rcu_read_lock_held+0xe/0x50 [10956.568998][ C0] ? ip_local_out+0x114/0x3b0 [10956.569250][ C0] __ip_queue_xmit+0x672/0x1910 [10956.569509][ C0] ? __skb_clone+0x57a/0x760 [10956.569756][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10956.570040][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10956.570341][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10956.570660][ C0] tcp_write_xmit+0xe42/0x24c0 [10956.570915][ C0] ? tcp_current_mss+0x40a/0x510 [10956.571188][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10956.571469][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10956.571753][ C0] ? mark_lock_irq+0x6e2/0xa10 [10956.572011][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10956.572278][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10956.572597][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10956.572875][ C0] ? ktime_get+0xb6/0x190 [10956.573111][ C0] tcp_send_loss_probe+0x4c9/0x830 [10956.573393][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10956.573677][ C0] tcp_write_timer+0x82/0x1d0 [10956.573929][ C0] call_timer_fn+0x176/0x430 [10956.574175][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10956.574452][ C0] ? next_expiry_recalc+0xcd/0x220 [10956.574725][ C0] __run_timers.part.0+0x52d/0x890 [10956.574998][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10956.575278][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10956.575579][ C0] ? lock_acquire+0x1c1/0x220 [10956.575828][ C0] ? clockevents_program_event+0xf6/0x300 [10956.576132][ C0] ? lock_release+0x1d5/0x250 [10956.576380][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10956.576654][ C0] ? ktime_get+0xb6/0x190 [10956.576882][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10956.577180][ C0] ? clockevents_program_event+0x1ed/0x300 [10956.577492][ C0] run_timer_softirq+0x72/0x100 [10956.577750][ C0] __do_softirq+0x1bc/0x7ff [10956.577991][ C0] irq_exit_rcu+0x98/0xc0 [10956.578221][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10956.578518][ C0] [10956.578677][ C0] [10956.578838][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10956.579161][ C0] RIP: 0010:default_idle+0xf/0x20 [10956.579432][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10956.580446][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10956.580766][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10956.581184][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10956.581600][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10956.582015][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10956.582430][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10956.582850][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10956.583153][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10956.583431][ C0] default_idle_call+0x69/0xa0 [10956.583686][ C0] cpuidle_idle_call+0x1f6/0x280 [10956.583955][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10956.584243][ C0] ? lock_release+0x1d5/0x250 [10956.584495][ C0] do_idle+0xfb/0x160 [10956.584710][ C0] cpu_startup_entry+0x55/0x60 [10956.584968][ C0] rest_init+0x153/0x260 [10956.585192][ C0] ? acpi_enable_subsystem+0xac/0x150 [10956.585481][ C0] arch_call_rest_init+0x13/0x40 [10956.585750][ C0] start_kernel+0x314/0x3d0 [10956.585990][ C0] x86_64_start_reservations+0x18/0x30 [10956.586280][ C0] x86_64_start_kernel+0xba/0x110 [10956.586551][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10956.586883][ C0] [10956.587050][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 9098s! [ksoftirqd/1:22] [10956.587506][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [10956.588688][ C1] irq event stamp: 3886976 [10956.588926][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [10956.589425][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [10956.589920][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [10956.590418][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [10956.590903][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10956.591399][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10956.592043][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10956.592388][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10956.593413][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [10956.593733][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10956.594152][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [10956.594568][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10956.594982][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10956.595396][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10956.595812][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10956.596279][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10956.596629][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10956.597051][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10956.597476][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10956.597893][ C1] Call Trace: [10956.598071][ C1] [10956.598233][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10956.598506][ C1] ? __run_hrtimer+0x1c3/0x710 [10956.598762][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10956.599052][ C1] ? __hrtimer_run_queues+0x197/0x270 [10956.599341][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10956.599645][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10956.599926][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10956.600251][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10956.600526][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10956.600852][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10956.601167][ C1] [10956.601323][ C1] [10956.601479][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10956.601806][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10956.602114][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10956.602425][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10956.602726][ C1] ? run_ksoftirqd+0xb/0x60 [10956.602971][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10956.603300][ C1] ? __orc_find+0x9c/0xf0 [10956.603530][ C1] ? lock_acquire+0x1c1/0x220 [10956.603779][ C1] ? irqentry_enter+0x2b/0x60 [10956.604029][ C1] do_raw_spin_lock+0x1ec/0x270 [10956.604287][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10956.604568][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10956.604868][ C1] ? lock_acquire+0x1c1/0x220 [10956.605122][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10956.605378][ C1] _raw_spin_lock_nested+0x65/0x80 [10956.605653][ C1] tcp_v4_rcv+0x2159/0x29b0 [10956.605898][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10956.606156][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10956.606425][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10956.606714][ C1] ip_local_deliver_finish+0x2ae/0x450 [10956.607004][ C1] ip_local_deliver+0x19d/0x480 [10956.607266][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10956.607552][ C1] ? rcu_read_lock_held+0xe/0x50 [10956.607819][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10956.608095][ C1] ? rcu_read_lock_held+0xe/0x50 [10956.608358][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10956.608695][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10956.608971][ C1] ip_rcv+0x564/0x740 [10956.609187][ C1] ? __pfx_ip_rcv+0x10/0x10 [10956.609427][ C1] ? set_track_prepare+0x8a/0xd0 [10956.609691][ C1] ? irqentry_enter+0x2b/0x60 [10956.609946][ C1] ? irqentry_enter+0x2b/0x60 [10956.610203][ C1] ? __pfx_ip_rcv+0x10/0x10 [10956.610447][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10956.610764][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10956.611108][ C1] ? netif_receive_skb_internal+0x84/0x300 [10956.611425][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10956.611763][ C1] netif_receive_skb_internal+0xb0/0x300 [10956.612061][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10956.612396][ C1] netif_receive_skb+0x55/0x280 [10956.612657][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10956.612986][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10956.613344][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10956.613660][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10956.613948][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10956.614252][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10956.614586][ C1] ? unwind_next_frame+0x1478/0x1d10 [10956.614866][ C1] ? arch_stack_walk+0x68/0x100 [10956.615129][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10956.615409][ C1] ? irqentry_enter+0x2b/0x60 [10956.615664][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10956.615983][ C1] ? irqentry_enter+0x2b/0x60 [10956.616233][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10956.616556][ C1] ? unwind_next_frame+0x1478/0x1d10 [10956.616838][ C1] ? arch_stack_walk+0x68/0x100 [10956.617099][ C1] __tcf_classify+0x32c/0x7d0 [10956.617348][ C1] tcf_classify+0x283/0x930 [10956.617590][ C1] ? __pfx_tcf_classify+0x10/0x10 [10956.617858][ C1] tc_run+0x2e4/0x5d0 [10956.618073][ C1] ? __pfx_tc_run+0x10/0x10 [10956.618315][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10956.618581][ C1] ? irqentry_enter+0x2b/0x60 [10956.618836][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10956.619125][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10956.619446][ C1] ip_finish_output2+0x786/0x18e0 [10956.619715][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10956.620004][ C1] ? rcu_read_lock_held+0xe/0x50 [10956.620269][ C1] ? __ip_finish_output+0x10f/0x770 [10956.620545][ C1] ip_output+0x16b/0x4f0 [10956.620773][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10956.621092][ C1] ? __pfx_ip_output+0x10/0x10 [10956.621347][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10956.621702][ C1] ? __pfx_ip_output+0x10/0x10 [10956.621959][ C1] __ip_queue_xmit+0x672/0x1910 [10956.622220][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10956.622497][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10956.622790][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10956.623075][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10956.623372][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10956.623660][ C1] tcp_delack_timer+0x84/0x240 [10956.623920][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10956.624205][ C1] call_timer_fn+0x176/0x430 [10956.624452][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10956.624729][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10956.625004][ C1] __run_timers.part.0+0x52d/0x890 [10956.625282][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10956.625572][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10956.625875][ C1] ? __pfx___schedule+0x10/0x10 [10956.626134][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10956.626455][ C1] run_timer_softirq+0x72/0x100 [10956.626716][ C1] __do_softirq+0x1bc/0x7ff [10956.626962][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10956.627237][ C1] run_ksoftirqd+0x2e/0x60 [10956.627473][ C1] smpboot_thread_fn+0x30e/0x840 [10956.627738][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10956.628026][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10956.628319][ C1] kthread+0x292/0x360 [10956.628540][ C1] ? __pfx_kthread+0x10/0x10 [10956.628787][ C1] ret_from_fork+0x34/0x70 [10956.629024][ C1] ? __pfx_kthread+0x10/0x10 [10956.629272][ C1] ret_from_fork_asm+0x1b/0x30 [10956.629528][ C1] [10980.910025][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [10980.910411][ C1] rcu: 1-....: (9713077 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=2320772 [10980.911001][ C1] rcu: (t=9786601 jiffies g=1007429 q=31 ncpus=4) [10980.911351][ C1] Sending NMI from CPU 1 to CPUs 0: [10980.911641][ C0] NMI backtrace for cpu 0 [10980.911648][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [10980.911653][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10980.911656][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10980.911667][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10980.911672][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [10980.911676][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10980.911678][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [10980.911680][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [10980.911681][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [10980.911683][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [10980.911685][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [10980.911687][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10980.911691][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [10980.911693][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10980.911694][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10980.911696][ C0] Call Trace: [10980.911700][ C0] [10980.911706][ C0] ? nmi_cpu_backtrace+0x112/0x220 [10980.911712][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [10980.911719][ C0] ? nmi_handle+0x156/0x420 [10980.911724][ C0] ? default_do_nmi+0x41/0x100 [10980.911729][ C0] ? exc_nmi+0xf3/0x120 [10980.911731][ C0] ? end_repeat_nmi+0xf/0x60 [10980.911736][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [10980.911740][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10980.911743][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10980.911747][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [10980.911751][ C0] [10980.911752][ C0] [10980.911753][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10980.911756][ C0] ? get_stack_info+0x36/0xc0 [10980.911761][ C0] ? lock_acquire+0x1c1/0x220 [10980.911767][ C0] ? lock_release+0x1d5/0x250 [10980.911771][ C0] do_raw_spin_lock+0x1ec/0x270 [10980.911775][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [10980.911778][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10980.911781][ C0] ? lock_acquire+0x1c1/0x220 [10980.911784][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [10980.911790][ C0] _raw_spin_lock_nested+0x65/0x80 [10980.911793][ C0] tcp_v4_rcv+0x2159/0x29b0 [10980.911801][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [10980.911804][ C0] ? __pfx_raw_v4_input+0x10/0x10 [10980.911808][ C0] ? __inet_lookup_established+0x341/0x610 [10980.911814][ C0] ip_protocol_deliver_rcu+0x93/0x360 [10980.911822][ C0] ip_local_deliver_finish+0x2ae/0x450 [10980.911827][ C0] ip_local_deliver+0x19d/0x480 [10980.911830][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [10980.911832][ C0] ? rcu_read_lock_held+0xe/0x50 [10980.911839][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [10980.911843][ C0] ? rcu_read_lock_held+0xe/0x50 [10980.911846][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10980.911850][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10980.911861][ C0] ip_rcv+0x564/0x740 [10980.911864][ C0] ? __pfx_ip_rcv+0x10/0x10 [10980.911868][ C0] ? set_track_prepare+0x8a/0xd0 [10980.911873][ C0] ? __pfx_set_track_prepare+0x10/0x10 [10980.911875][ C0] ? rest_init+0x153/0x260 [10980.911878][ C0] ? skb_clone+0x10b/0x330 [10980.911885][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10980.911891][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10980.911896][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [10980.911902][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [10980.911911][ C0] ? __tcf_classify+0x32c/0x7d0 [10980.911915][ C0] ? __pfx_ip_rcv+0x10/0x10 [10980.911917][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [10980.911922][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10980.911926][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10980.911929][ C0] ? lock_acquire+0x1c1/0x220 [10980.911932][ C0] ? netif_receive_skb_internal+0x84/0x300 [10980.911935][ C0] netif_receive_skb_internal+0xb0/0x300 [10980.911938][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10980.911941][ C0] ? __copy_skb_header+0xaf/0x490 [10980.911945][ C0] ? __skb_clone+0x57a/0x760 [10980.911947][ C0] netif_receive_skb+0x55/0x280 [10980.911950][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10980.911959][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10980.911966][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [10980.911973][ C0] tcf_action_exec.part.0+0x115/0x3d0 [10980.911978][ C0] fl_classify+0x4dc/0x650 [cls_flower] [10980.911987][ C0] ? hlock_class+0x4e/0x130 [10980.911993][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10980.912003][ C0] ? place_entity+0x21/0x2f0 [10980.912007][ C0] ? resched_curr+0x219/0x280 [10980.912011][ C0] ? __pfx_resched_curr+0x10/0x10 [10980.912014][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [10980.912018][ C0] ? unwind_next_frame+0x1cc/0x1d10 [10980.912024][ C0] ? wakeup_preempt+0x161/0x2c0 [10980.912027][ C0] ? activate_task+0xf5/0x260 [10980.912031][ C0] ? trace_sched_wakeup+0xd2/0x100 [10980.912036][ C0] ? do_raw_spin_unlock+0x58/0x220 [10980.912039][ C0] ? _raw_spin_unlock+0x23/0x40 [10980.912043][ C0] ? get_stack_info_noinstr+0x18/0x110 [10980.912046][ C0] ? get_stack_info+0x36/0xc0 [10980.912050][ C0] ? stack_access_ok+0xda/0x1f0 [10980.912052][ C0] ? get_reg+0x119/0x190 [10980.912055][ C0] __tcf_classify+0x32c/0x7d0 [10980.912060][ C0] tcf_classify+0x283/0x930 [10980.912064][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10980.912068][ C0] ? __pfx_tcf_classify+0x10/0x10 [10980.912070][ C0] ? arch_stack_walk+0x8c/0x100 [10980.912075][ C0] ? get_stack_info_noinstr+0x18/0x110 [10980.912078][ C0] tc_run+0x2e4/0x5d0 [10980.912083][ C0] ? __pfx_tc_run+0x10/0x10 [10980.912086][ C0] ? lock_acquire+0x1c1/0x220 [10980.912088][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [10980.912093][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [10980.912099][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [10980.912102][ C0] ? ip_finish_output2+0x786/0x18e0 [10980.912106][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10980.912112][ C0] ? neigh_hh_output+0x348/0x590 [10980.912116][ C0] ? ip_finish_output2+0x262/0x18e0 [10980.912120][ C0] ip_finish_output2+0x786/0x18e0 [10980.912123][ C0] ? stack_depot_save_flags+0x45/0x550 [10980.912129][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10980.912137][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [10980.912140][ C0] ? rcu_read_lock_held+0xe/0x50 [10980.912144][ C0] ? __ip_finish_output+0x10f/0x770 [10980.912148][ C0] ip_output+0x16b/0x4f0 [10980.912151][ C0] ? __run_timers.part.0+0x52d/0x890 [10980.912157][ C0] ? __pfx_ip_output+0x10/0x10 [10980.912161][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10980.912165][ C0] ? rcu_read_lock_held+0xe/0x50 [10980.912168][ C0] ? ip_local_out+0x114/0x3b0 [10980.912172][ C0] __ip_queue_xmit+0x672/0x1910 [10980.912177][ C0] ? __skb_clone+0x57a/0x760 [10980.912180][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [10980.912188][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [10980.912192][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [10980.912196][ C0] tcp_write_xmit+0xe42/0x24c0 [10980.912201][ C0] ? tcp_current_mss+0x40a/0x510 [10980.912204][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [10980.912207][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [10980.912210][ C0] ? mark_lock_irq+0x6e2/0xa10 [10980.912212][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [10980.912214][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [10980.912218][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10980.912223][ C0] ? ktime_get+0xb6/0x190 [10980.912227][ C0] tcp_send_loss_probe+0x4c9/0x830 [10980.912232][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10980.912235][ C0] tcp_write_timer+0x82/0x1d0 [10980.912239][ C0] call_timer_fn+0x176/0x430 [10980.912243][ C0] ? __pfx_call_timer_fn+0x10/0x10 [10980.912247][ C0] ? next_expiry_recalc+0xcd/0x220 [10980.912252][ C0] __run_timers.part.0+0x52d/0x890 [10980.912255][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [10980.912260][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [10980.912263][ C0] ? lock_acquire+0x1c1/0x220 [10980.912266][ C0] ? clockevents_program_event+0xf6/0x300 [10980.912272][ C0] ? lock_release+0x1d5/0x250 [10980.912275][ C0] ? kvm_clock_get_cycles+0x18/0x30 [10980.912278][ C0] ? ktime_get+0xb6/0x190 [10980.912281][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [10980.912284][ C0] ? clockevents_program_event+0x1ed/0x300 [10980.912289][ C0] run_timer_softirq+0x72/0x100 [10980.912292][ C0] __do_softirq+0x1bc/0x7ff [10980.912297][ C0] irq_exit_rcu+0x98/0xc0 [10980.912300][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [10980.912304][ C0] [10980.912305][ C0] [10980.912306][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10980.912313][ C0] RIP: 0010:default_idle+0xf/0x20 [10980.912317][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10980.912319][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [10980.912321][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [10980.912323][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [10980.912325][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [10980.912326][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [10980.912328][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [10980.912331][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10980.912335][ C0] ? cpuidle_idle_call+0x1f6/0x280 [10980.912339][ C0] default_idle_call+0x69/0xa0 [10980.912341][ C0] cpuidle_idle_call+0x1f6/0x280 [10980.912344][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [10980.912350][ C0] ? lock_release+0x1d5/0x250 [10980.912354][ C0] do_idle+0xfb/0x160 [10980.912357][ C0] cpu_startup_entry+0x55/0x60 [10980.912359][ C0] rest_init+0x153/0x260 [10980.912362][ C0] ? acpi_enable_subsystem+0xac/0x150 [10980.912369][ C0] arch_call_rest_init+0x13/0x40 [10980.912375][ C0] start_kernel+0x314/0x3d0 [10980.912379][ C0] x86_64_start_reservations+0x18/0x30 [10980.912384][ C0] x86_64_start_kernel+0xba/0x110 [10980.912388][ C0] secondary_startup_64_no_verify+0x16d/0x17b [10980.912397][ C0] [10980.912636][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [10980.966645][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10980.967288][ C1] RIP: 0010:kasan_check_range+0x1b/0x1c0 [10980.967593][ C1] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 53 <72> 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 23 [10980.968621][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000282 [10980.968946][ C1] RAX: ffff88800a098e1c RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [10980.969372][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [10980.969792][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [10980.970213][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [10980.970636][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [10980.971062][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10980.971532][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10980.971880][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [10980.972305][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10980.972723][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10980.973141][ C1] Call Trace: [10980.973326][ C1] [10980.973484][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10980.973769][ C1] ? print_cpu_stall+0x263/0x6a0 [10980.974034][ C1] ? check_cpu_stall+0x284/0x500 [10980.974297][ C1] ? rcu_pending+0x92/0x360 [10980.974541][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [10980.974825][ C1] ? update_process_times+0xb9/0x110 [10980.975104][ C1] ? tick_sched_handle+0x67/0x130 [10980.975376][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [10980.975676][ C1] ? __run_hrtimer+0x1c3/0x710 [10980.975926][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10980.976257][ C1] ? __hrtimer_run_queues+0x197/0x270 [10980.976540][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10980.976839][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10980.977114][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [10980.977436][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10980.977712][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [10980.978034][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [10980.978343][ C1] [10980.978502][ C1] [10980.978660][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10980.978991][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10980.979294][ C1] ? kasan_check_range+0x1b/0x1c0 [10980.979561][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [10980.979854][ C1] ? run_ksoftirqd+0xb/0x60 [10980.980098][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10980.980422][ C1] ? __orc_find+0x9c/0xf0 [10980.980656][ C1] ? lock_acquire+0x1c1/0x220 [10980.980907][ C1] ? irqentry_enter+0x2b/0x60 [10980.981160][ C1] do_raw_spin_lock+0x1ec/0x270 [10980.981421][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10980.981709][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10980.982010][ C1] ? lock_acquire+0x1c1/0x220 [10980.982259][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [10980.982511][ C1] _raw_spin_lock_nested+0x65/0x80 [10980.982782][ C1] tcp_v4_rcv+0x2159/0x29b0 [10980.983030][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10980.983294][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10980.983563][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10980.983850][ C1] ip_local_deliver_finish+0x2ae/0x450 [10980.984139][ C1] ip_local_deliver+0x19d/0x480 [10980.984401][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10980.984686][ C1] ? rcu_read_lock_held+0xe/0x50 [10980.984953][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [10980.985228][ C1] ? rcu_read_lock_held+0xe/0x50 [10980.985490][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10980.985828][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10980.986102][ C1] ip_rcv+0x564/0x740 [10980.986315][ C1] ? __pfx_ip_rcv+0x10/0x10 [10980.986557][ C1] ? set_track_prepare+0x8a/0xd0 [10980.986822][ C1] ? irqentry_enter+0x2b/0x60 [10980.987077][ C1] ? irqentry_enter+0x2b/0x60 [10980.987332][ C1] ? __pfx_ip_rcv+0x10/0x10 [10980.987577][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10980.987894][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10980.988236][ C1] ? netif_receive_skb_internal+0x84/0x300 [10980.988549][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10980.988886][ C1] netif_receive_skb_internal+0xb0/0x300 [10980.989185][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10980.989520][ C1] netif_receive_skb+0x55/0x280 [10980.989781][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10980.990112][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10980.990464][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10980.990776][ C1] tcf_action_exec.part.0+0x115/0x3d0 [10980.991066][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10980.991370][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10980.991701][ C1] ? unwind_next_frame+0x1478/0x1d10 [10980.991984][ C1] ? arch_stack_walk+0x68/0x100 [10980.992248][ C1] ? unwind_next_frame+0x1cc/0x1d10 [10980.992524][ C1] ? irqentry_enter+0x2b/0x60 [10980.992774][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10980.993092][ C1] ? irqentry_enter+0x2b/0x60 [10980.993350][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10980.993674][ C1] ? unwind_next_frame+0x1478/0x1d10 [10980.993956][ C1] ? arch_stack_walk+0x68/0x100 [10980.994216][ C1] __tcf_classify+0x32c/0x7d0 [10980.994466][ C1] tcf_classify+0x283/0x930 [10980.994707][ C1] ? __pfx_tcf_classify+0x10/0x10 [10980.994973][ C1] tc_run+0x2e4/0x5d0 [10980.995187][ C1] ? __pfx_tc_run+0x10/0x10 [10980.995428][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [10980.995693][ C1] ? irqentry_enter+0x2b/0x60 [10980.995948][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10980.996241][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10980.996566][ C1] ip_finish_output2+0x786/0x18e0 [10980.996834][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10980.997122][ C1] ? rcu_read_lock_held+0xe/0x50 [10980.997388][ C1] ? __ip_finish_output+0x10f/0x770 [10980.997663][ C1] ip_output+0x16b/0x4f0 [10980.997889][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10980.998208][ C1] ? __pfx_ip_output+0x10/0x10 [10980.998461][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [10980.998821][ C1] ? __pfx_ip_output+0x10/0x10 [10980.999079][ C1] __ip_queue_xmit+0x672/0x1910 [10980.999336][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10980.999614][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10980.999907][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10981.000189][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10981.000482][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10981.000766][ C1] tcp_delack_timer+0x84/0x240 [10981.001022][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10981.001310][ C1] call_timer_fn+0x176/0x430 [10981.001559][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10981.001831][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [10981.002112][ C1] __run_timers.part.0+0x52d/0x890 [10981.002385][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10981.002671][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10981.002970][ C1] ? __pfx___schedule+0x10/0x10 [10981.003239][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10981.003561][ C1] run_timer_softirq+0x72/0x100 [10981.003822][ C1] __do_softirq+0x1bc/0x7ff [10981.004069][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [10981.004344][ C1] run_ksoftirqd+0x2e/0x60 [10981.004578][ C1] smpboot_thread_fn+0x30e/0x840 [10981.004844][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10981.005133][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [10981.005426][ C1] kthread+0x292/0x360 [10981.005647][ C1] ? __pfx_kthread+0x10/0x10 [10981.005894][ C1] ret_from_fork+0x34/0x70 [10981.006132][ C1] ? __pfx_kthread+0x10/0x10 [10981.006378][ C1] ret_from_fork_asm+0x1b/0x30 [10981.006635][ C1] [11008.527461][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 9146s! [swapper/0:0] [11008.527927][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [11008.529116][ C0] irq event stamp: 27567077 [11008.529356][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [11008.529878][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [11008.530357][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [11008.530861][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [11008.531356][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [11008.531835][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11008.532471][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11008.532809][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11008.533832][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [11008.534156][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [11008.534578][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [11008.535001][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [11008.535423][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [11008.535843][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [11008.536265][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [11008.536739][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11008.537085][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [11008.537517][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11008.537935][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11008.538351][ C0] Call Trace: [11008.538528][ C0] [11008.538683][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [11008.538961][ C0] ? __run_hrtimer+0x1c3/0x710 [11008.539216][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [11008.539509][ C0] ? __hrtimer_run_queues+0x197/0x270 [11008.539793][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [11008.540093][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11008.540374][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [11008.540695][ C0] ? hrtimer_interrupt+0x2c3/0x770 [11008.540969][ C0] ? trace_rcu_dyntick+0x10a/0x150 [11008.541244][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [11008.541575][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [11008.541886][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11008.542216][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [11008.542520][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [11008.542834][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [11008.543137][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11008.543465][ C0] ? get_stack_info+0x36/0xc0 [11008.543714][ C0] ? lock_acquire+0x1c1/0x220 [11008.543962][ C0] ? lock_release+0x1d5/0x250 [11008.544210][ C0] do_raw_spin_lock+0x1ec/0x270 [11008.544466][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [11008.544746][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11008.545048][ C0] ? lock_acquire+0x1c1/0x220 [11008.545302][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [11008.545559][ C0] _raw_spin_lock_nested+0x65/0x80 [11008.545832][ C0] tcp_v4_rcv+0x2159/0x29b0 [11008.546076][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [11008.546331][ C0] ? __pfx_raw_v4_input+0x10/0x10 [11008.546597][ C0] ? __inet_lookup_established+0x341/0x610 [11008.546912][ C0] ip_protocol_deliver_rcu+0x93/0x360 [11008.547205][ C0] ip_local_deliver_finish+0x2ae/0x450 [11008.547495][ C0] ip_local_deliver+0x19d/0x480 [11008.547751][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [11008.548034][ C0] ? rcu_read_lock_held+0xe/0x50 [11008.548297][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [11008.548577][ C0] ? rcu_read_lock_held+0xe/0x50 [11008.548841][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11008.549175][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11008.549452][ C0] ip_rcv+0x564/0x740 [11008.549665][ C0] ? __pfx_ip_rcv+0x10/0x10 [11008.549909][ C0] ? set_track_prepare+0x8a/0xd0 [11008.550176][ C0] ? __pfx_set_track_prepare+0x10/0x10 [11008.550460][ C0] ? rest_init+0x153/0x260 [11008.550698][ C0] ? skb_clone+0x10b/0x330 [11008.550936][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11008.551271][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11008.551595][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [11008.551884][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [11008.552191][ C0] ? __tcf_classify+0x32c/0x7d0 [11008.552447][ C0] ? __pfx_ip_rcv+0x10/0x10 [11008.552686][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [11008.553001][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11008.553303][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11008.553639][ C0] ? lock_acquire+0x1c1/0x220 [11008.553887][ C0] ? netif_receive_skb_internal+0x84/0x300 [11008.554193][ C0] netif_receive_skb_internal+0xb0/0x300 [11008.554492][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11008.554820][ C0] ? __copy_skb_header+0xaf/0x490 [11008.555085][ C0] ? __skb_clone+0x57a/0x760 [11008.555331][ C0] netif_receive_skb+0x55/0x280 [11008.555590][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11008.555918][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11008.556267][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [11008.556576][ C0] tcf_action_exec.part.0+0x115/0x3d0 [11008.556866][ C0] fl_classify+0x4dc/0x650 [cls_flower] [11008.557173][ C0] ? hlock_class+0x4e/0x130 [11008.557420][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11008.557749][ C0] ? place_entity+0x21/0x2f0 [11008.557996][ C0] ? resched_curr+0x219/0x280 [11008.558243][ C0] ? __pfx_resched_curr+0x10/0x10 [11008.558507][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [11008.558789][ C0] ? unwind_next_frame+0x1cc/0x1d10 [11008.559072][ C0] ? wakeup_preempt+0x161/0x2c0 [11008.559334][ C0] ? activate_task+0xf5/0x260 [11008.559591][ C0] ? trace_sched_wakeup+0xd2/0x100 [11008.559866][ C0] ? do_raw_spin_unlock+0x58/0x220 [11008.560136][ C0] ? _raw_spin_unlock+0x23/0x40 [11008.560395][ C0] ? get_stack_info_noinstr+0x18/0x110 [11008.560684][ C0] ? get_stack_info+0x36/0xc0 [11008.560931][ C0] ? stack_access_ok+0xda/0x1f0 [11008.561186][ C0] ? get_reg+0x119/0x190 [11008.561414][ C0] __tcf_classify+0x32c/0x7d0 [11008.561665][ C0] tcf_classify+0x283/0x930 [11008.561907][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11008.562238][ C0] ? __pfx_tcf_classify+0x10/0x10 [11008.562500][ C0] ? arch_stack_walk+0x8c/0x100 [11008.562758][ C0] ? get_stack_info_noinstr+0x18/0x110 [11008.563056][ C0] tc_run+0x2e4/0x5d0 [11008.563271][ C0] ? __pfx_tc_run+0x10/0x10 [11008.563512][ C0] ? lock_acquire+0x1c1/0x220 [11008.563760][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [11008.564030][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [11008.564298][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [11008.564586][ C0] ? ip_finish_output2+0x786/0x18e0 [11008.564859][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [11008.565174][ C0] ? neigh_hh_output+0x348/0x590 [11008.565438][ C0] ? ip_finish_output2+0x262/0x18e0 [11008.565711][ C0] ip_finish_output2+0x786/0x18e0 [11008.565975][ C0] ? stack_depot_save_flags+0x45/0x550 [11008.566268][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11008.566619][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [11008.566908][ C0] ? rcu_read_lock_held+0xe/0x50 [11008.567172][ C0] ? __ip_finish_output+0x10f/0x770 [11008.567450][ C0] ip_output+0x16b/0x4f0 [11008.567679][ C0] ? __run_timers.part.0+0x52d/0x890 [11008.567957][ C0] ? __pfx_ip_output+0x10/0x10 [11008.568214][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11008.568514][ C0] ? rcu_read_lock_held+0xe/0x50 [11008.568780][ C0] ? ip_local_out+0x114/0x3b0 [11008.569029][ C0] __ip_queue_xmit+0x672/0x1910 [11008.569288][ C0] ? __skb_clone+0x57a/0x760 [11008.569531][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [11008.569813][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [11008.570111][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [11008.570431][ C0] tcp_write_xmit+0xe42/0x24c0 [11008.570686][ C0] ? tcp_current_mss+0x40a/0x510 [11008.570950][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [11008.571229][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [11008.571507][ C0] ? mark_lock_irq+0x6e2/0xa10 [11008.571762][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [11008.572026][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [11008.572345][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11008.572624][ C0] ? ktime_get+0xb6/0x190 [11008.572856][ C0] tcp_send_loss_probe+0x4c9/0x830 [11008.573137][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [11008.573419][ C0] tcp_write_timer+0x82/0x1d0 [11008.573668][ C0] call_timer_fn+0x176/0x430 [11008.573919][ C0] ? __pfx_call_timer_fn+0x10/0x10 [11008.574196][ C0] ? next_expiry_recalc+0xcd/0x220 [11008.574465][ C0] __run_timers.part.0+0x52d/0x890 [11008.574738][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [11008.575018][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [11008.575320][ C0] ? lock_acquire+0x1c1/0x220 [11008.575568][ C0] ? clockevents_program_event+0xf6/0x300 [11008.575870][ C0] ? lock_release+0x1d5/0x250 [11008.576117][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11008.576394][ C0] ? ktime_get+0xb6/0x190 [11008.576629][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [11008.576923][ C0] ? clockevents_program_event+0x1ed/0x300 [11008.577238][ C0] run_timer_softirq+0x72/0x100 [11008.577495][ C0] __do_softirq+0x1bc/0x7ff [11008.577738][ C0] irq_exit_rcu+0x98/0xc0 [11008.577966][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [11008.578265][ C0] [11008.578422][ C0] [11008.578581][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11008.578899][ C0] RIP: 0010:default_idle+0xf/0x20 [11008.579165][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11008.580175][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [11008.580495][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [11008.580911][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [11008.581328][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [11008.581743][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [11008.582161][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [11008.582578][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11008.582878][ C0] ? cpuidle_idle_call+0x1f6/0x280 [11008.583156][ C0] default_idle_call+0x69/0xa0 [11008.583408][ C0] cpuidle_idle_call+0x1f6/0x280 [11008.583670][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [11008.583957][ C0] ? lock_release+0x1d5/0x250 [11008.584212][ C0] do_idle+0xfb/0x160 [11008.584430][ C0] cpu_startup_entry+0x55/0x60 [11008.584686][ C0] rest_init+0x153/0x260 [11008.584909][ C0] ? acpi_enable_subsystem+0xac/0x150 [11008.585200][ C0] arch_call_rest_init+0x13/0x40 [11008.585473][ C0] start_kernel+0x314/0x3d0 [11008.585715][ C0] x86_64_start_reservations+0x18/0x30 [11008.586005][ C0] x86_64_start_kernel+0xba/0x110 [11008.586275][ C0] secondary_startup_64_no_verify+0x16d/0x17b [11008.586604][ C0] [11008.586768][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 9146s! [ksoftirqd/1:22] [11008.587220][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [11008.588409][ C1] irq event stamp: 3886976 [11008.588643][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [11008.589141][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [11008.589638][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [11008.590139][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [11008.590626][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [11008.591122][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11008.591766][ C1] RIP: 0010:kasan_check_range+0x69/0x1c0 [11008.592067][ C1] Code: 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 <48> c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 [11008.593091][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000212 [11008.593415][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [11008.593833][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [11008.594255][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffff88800a098e1b [11008.594677][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [11008.595095][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [11008.595514][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11008.595985][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11008.596331][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [11008.596751][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11008.597167][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11008.597583][ C1] Call Trace: [11008.597761][ C1] [11008.597918][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11008.598195][ C1] ? __run_hrtimer+0x1c3/0x710 [11008.598451][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11008.598749][ C1] ? __hrtimer_run_queues+0x197/0x270 [11008.599035][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11008.599337][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11008.599613][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [11008.599937][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11008.600216][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [11008.600542][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [11008.600849][ C1] [11008.601009][ C1] [11008.601170][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11008.601502][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11008.601803][ C1] ? kasan_check_range+0x69/0x1c0 [11008.602072][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [11008.602363][ C1] ? run_ksoftirqd+0xb/0x60 [11008.602608][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11008.602934][ C1] ? __orc_find+0x9c/0xf0 [11008.603172][ C1] ? lock_acquire+0x1c1/0x220 [11008.603423][ C1] ? irqentry_enter+0x2b/0x60 [11008.603674][ C1] do_raw_spin_lock+0x1ec/0x270 [11008.603934][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11008.604220][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11008.604518][ C1] ? lock_acquire+0x1c1/0x220 [11008.604769][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [11008.605022][ C1] _raw_spin_lock_nested+0x65/0x80 [11008.605299][ C1] tcp_v4_rcv+0x2159/0x29b0 [11008.605546][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11008.605804][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11008.606073][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11008.606357][ C1] ip_local_deliver_finish+0x2ae/0x450 [11008.606645][ C1] ip_local_deliver+0x19d/0x480 [11008.606909][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11008.607198][ C1] ? rcu_read_lock_held+0xe/0x50 [11008.607465][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [11008.607739][ C1] ? rcu_read_lock_held+0xe/0x50 [11008.608005][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11008.608343][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11008.608615][ C1] ip_rcv+0x564/0x740 [11008.608827][ C1] ? __pfx_ip_rcv+0x10/0x10 [11008.609068][ C1] ? set_track_prepare+0x8a/0xd0 [11008.609330][ C1] ? irqentry_enter+0x2b/0x60 [11008.609581][ C1] ? irqentry_enter+0x2b/0x60 [11008.609834][ C1] ? __pfx_ip_rcv+0x10/0x10 [11008.610078][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11008.610395][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11008.610738][ C1] ? netif_receive_skb_internal+0x84/0x300 [11008.611048][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11008.611385][ C1] netif_receive_skb_internal+0xb0/0x300 [11008.611682][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11008.612017][ C1] netif_receive_skb+0x55/0x280 [11008.612278][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11008.612613][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11008.612962][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11008.613283][ C1] tcf_action_exec.part.0+0x115/0x3d0 [11008.613568][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11008.613869][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11008.614195][ C1] ? unwind_next_frame+0x1478/0x1d10 [11008.614473][ C1] ? arch_stack_walk+0x68/0x100 [11008.614734][ C1] ? unwind_next_frame+0x1cc/0x1d10 [11008.615017][ C1] ? irqentry_enter+0x2b/0x60 [11008.615269][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11008.615591][ C1] ? irqentry_enter+0x2b/0x60 [11008.615842][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11008.616164][ C1] ? unwind_next_frame+0x1478/0x1d10 [11008.616447][ C1] ? arch_stack_walk+0x68/0x100 [11008.616706][ C1] __tcf_classify+0x32c/0x7d0 [11008.616958][ C1] tcf_classify+0x283/0x930 [11008.617201][ C1] ? __pfx_tcf_classify+0x10/0x10 [11008.617469][ C1] tc_run+0x2e4/0x5d0 [11008.617682][ C1] ? __pfx_tc_run+0x10/0x10 [11008.617925][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [11008.618191][ C1] ? irqentry_enter+0x2b/0x60 [11008.618442][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11008.618728][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11008.619058][ C1] ip_finish_output2+0x786/0x18e0 [11008.619326][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11008.619614][ C1] ? rcu_read_lock_held+0xe/0x50 [11008.619881][ C1] ? __ip_finish_output+0x10f/0x770 [11008.620159][ C1] ip_output+0x16b/0x4f0 [11008.620384][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11008.620705][ C1] ? __pfx_ip_output+0x10/0x10 [11008.620961][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [11008.621317][ C1] ? __pfx_ip_output+0x10/0x10 [11008.621577][ C1] __ip_queue_xmit+0x672/0x1910 [11008.621838][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11008.622119][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11008.622414][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11008.622699][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11008.622993][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11008.623287][ C1] tcp_delack_timer+0x84/0x240 [11008.623544][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11008.623828][ C1] call_timer_fn+0x176/0x430 [11008.624074][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11008.624351][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [11008.624628][ C1] __run_timers.part.0+0x52d/0x890 [11008.624900][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11008.625191][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11008.625492][ C1] ? __pfx___schedule+0x10/0x10 [11008.625750][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11008.626069][ C1] run_timer_softirq+0x72/0x100 [11008.626330][ C1] __do_softirq+0x1bc/0x7ff [11008.626576][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [11008.626852][ C1] run_ksoftirqd+0x2e/0x60 [11008.627091][ C1] smpboot_thread_fn+0x30e/0x840 [11008.627360][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [11008.627650][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [11008.627942][ C1] kthread+0x292/0x360 [11008.628160][ C1] ? __pfx_kthread+0x10/0x10 [11008.628408][ C1] ret_from_fork+0x34/0x70 [11008.628646][ C1] ? __pfx_kthread+0x10/0x10 [11008.628894][ C1] ret_from_fork_asm+0x1b/0x30 [11008.629153][ C1] [11036.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 9172s! [swapper/0:0] [11036.527910][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [11036.529065][ C0] irq event stamp: 27567077 [11036.529297][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [11036.529809][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [11036.530274][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [11036.530772][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [11036.531257][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [11036.531722][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11036.532341][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [11036.532665][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [11036.533691][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [11036.534011][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [11036.534428][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [11036.534831][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [11036.535237][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [11036.535640][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [11036.536046][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [11036.536499][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11036.536840][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [11036.537247][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11036.537656][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11036.538068][ C0] Call Trace: [11036.538247][ C0] [11036.538399][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [11036.538667][ C0] ? __run_hrtimer+0x1c3/0x710 [11036.538916][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [11036.539200][ C0] ? __hrtimer_run_queues+0x197/0x270 [11036.539482][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [11036.539778][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11036.540055][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [11036.540367][ C0] ? hrtimer_interrupt+0x2c3/0x770 [11036.540631][ C0] ? trace_rcu_dyntick+0x10a/0x150 [11036.540903][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [11036.541216][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [11036.541517][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11036.541842][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [11036.542136][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [11036.542428][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [11036.542725][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11036.543068][ C0] ? get_stack_info+0x36/0xc0 [11036.543321][ C0] ? lock_acquire+0x1c1/0x220 [11036.543573][ C0] ? lock_release+0x1d5/0x250 [11036.543822][ C0] do_raw_spin_lock+0x1ec/0x270 [11036.544082][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [11036.544369][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11036.544656][ C0] ? lock_acquire+0x1c1/0x220 [11036.544901][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [11036.545154][ C0] _raw_spin_lock_nested+0x65/0x80 [11036.545422][ C0] tcp_v4_rcv+0x2159/0x29b0 [11036.545659][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [11036.545928][ C0] ? __pfx_raw_v4_input+0x10/0x10 [11036.546197][ C0] ? __inet_lookup_established+0x341/0x610 [11036.546510][ C0] ip_protocol_deliver_rcu+0x93/0x360 [11036.546802][ C0] ip_local_deliver_finish+0x2ae/0x450 [11036.547101][ C0] ip_local_deliver+0x19d/0x480 [11036.547349][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [11036.547622][ C0] ? rcu_read_lock_held+0xe/0x50 [11036.547879][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [11036.548151][ C0] ? rcu_read_lock_held+0xe/0x50 [11036.548410][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11036.548734][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11036.549004][ C0] ip_rcv+0x564/0x740 [11036.549218][ C0] ? __pfx_ip_rcv+0x10/0x10 [11036.549457][ C0] ? set_track_prepare+0x8a/0xd0 [11036.549717][ C0] ? __pfx_set_track_prepare+0x10/0x10 [11036.549997][ C0] ? rest_init+0x153/0x260 [11036.550233][ C0] ? skb_clone+0x10b/0x330 [11036.550464][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11036.550792][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11036.551108][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [11036.551393][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [11036.551691][ C0] ? __tcf_classify+0x32c/0x7d0 [11036.551941][ C0] ? __pfx_ip_rcv+0x10/0x10 [11036.552177][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [11036.552480][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11036.552775][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11036.553132][ C0] ? lock_acquire+0x1c1/0x220 [11036.553380][ C0] ? netif_receive_skb_internal+0x84/0x300 [11036.553687][ C0] netif_receive_skb_internal+0xb0/0x300 [11036.553984][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11036.554333][ C0] ? __copy_skb_header+0xaf/0x490 [11036.554597][ C0] ? __skb_clone+0x57a/0x760 [11036.554843][ C0] netif_receive_skb+0x55/0x280 [11036.555104][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11036.555445][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11036.555783][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [11036.556086][ C0] tcf_action_exec.part.0+0x115/0x3d0 [11036.556368][ C0] fl_classify+0x4dc/0x650 [cls_flower] [11036.556663][ C0] ? hlock_class+0x4e/0x130 [11036.556902][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11036.557223][ C0] ? place_entity+0x21/0x2f0 [11036.557464][ C0] ? resched_curr+0x219/0x280 [11036.557704][ C0] ? __pfx_resched_curr+0x10/0x10 [11036.557962][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [11036.558235][ C0] ? unwind_next_frame+0x1cc/0x1d10 [11036.558508][ C0] ? wakeup_preempt+0x161/0x2c0 [11036.558760][ C0] ? activate_task+0xf5/0x260 [11036.559006][ C0] ? trace_sched_wakeup+0xd2/0x100 [11036.559276][ C0] ? do_raw_spin_unlock+0x58/0x220 [11036.559538][ C0] ? _raw_spin_unlock+0x23/0x40 [11036.559791][ C0] ? get_stack_info_noinstr+0x18/0x110 [11036.560074][ C0] ? get_stack_info+0x36/0xc0 [11036.560315][ C0] ? stack_access_ok+0xda/0x1f0 [11036.560561][ C0] ? get_reg+0x119/0x190 [11036.560780][ C0] __tcf_classify+0x32c/0x7d0 [11036.561026][ C0] tcf_classify+0x283/0x930 [11036.561264][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11036.561588][ C0] ? __pfx_tcf_classify+0x10/0x10 [11036.561846][ C0] ? arch_stack_walk+0x8c/0x100 [11036.562097][ C0] ? get_stack_info_noinstr+0x18/0x110 [11036.562377][ C0] tc_run+0x2e4/0x5d0 [11036.562591][ C0] ? __pfx_tc_run+0x10/0x10 [11036.562829][ C0] ? lock_acquire+0x1c1/0x220 [11036.563095][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [11036.563366][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [11036.563631][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [11036.563916][ C0] ? ip_finish_output2+0x786/0x18e0 [11036.564198][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [11036.564509][ C0] ? neigh_hh_output+0x348/0x590 [11036.564767][ C0] ? ip_finish_output2+0x262/0x18e0 [11036.565035][ C0] ip_finish_output2+0x786/0x18e0 [11036.565292][ C0] ? stack_depot_save_flags+0x45/0x550 [11036.565575][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11036.565920][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [11036.566203][ C0] ? rcu_read_lock_held+0xe/0x50 [11036.566457][ C0] ? __ip_finish_output+0x10f/0x770 [11036.566728][ C0] ip_output+0x16b/0x4f0 [11036.566951][ C0] ? __run_timers.part.0+0x52d/0x890 [11036.567227][ C0] ? __pfx_ip_output+0x10/0x10 [11036.567477][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11036.567766][ C0] ? rcu_read_lock_held+0xe/0x50 [11036.568024][ C0] ? ip_local_out+0x114/0x3b0 [11036.568268][ C0] __ip_queue_xmit+0x672/0x1910 [11036.568520][ C0] ? __skb_clone+0x57a/0x760 [11036.568760][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [11036.569036][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [11036.569328][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [11036.569637][ C0] tcp_write_xmit+0xe42/0x24c0 [11036.569887][ C0] ? tcp_current_mss+0x40a/0x510 [11036.570147][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [11036.570421][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [11036.570691][ C0] ? mark_lock_irq+0x6e2/0xa10 [11036.570941][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [11036.571200][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [11036.571510][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11036.571785][ C0] ? ktime_get+0xb6/0x190 [11036.572014][ C0] tcp_send_loss_probe+0x4c9/0x830 [11036.572283][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [11036.572556][ C0] tcp_write_timer+0x82/0x1d0 [11036.572804][ C0] call_timer_fn+0x176/0x430 [11036.573068][ C0] ? __pfx_call_timer_fn+0x10/0x10 [11036.573347][ C0] ? next_expiry_recalc+0xcd/0x220 [11036.573621][ C0] __run_timers.part.0+0x52d/0x890 [11036.573893][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [11036.574181][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [11036.574473][ C0] ? lock_acquire+0x1c1/0x220 [11036.574714][ C0] ? clockevents_program_event+0xf6/0x300 [11036.575007][ C0] ? lock_release+0x1d5/0x250 [11036.575247][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11036.575512][ C0] ? ktime_get+0xb6/0x190 [11036.575736][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [11036.576043][ C0] ? clockevents_program_event+0x1ed/0x300 [11036.576354][ C0] run_timer_softirq+0x72/0x100 [11036.576611][ C0] __do_softirq+0x1bc/0x7ff [11036.576851][ C0] irq_exit_rcu+0x98/0xc0 [11036.577080][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [11036.577383][ C0] [11036.577538][ C0] [11036.577697][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11036.578008][ C0] RIP: 0010:default_idle+0xf/0x20 [11036.578267][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11036.579255][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [11036.579564][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [11036.579969][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [11036.580374][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [11036.580778][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [11036.581182][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [11036.581590][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11036.581882][ C0] ? cpuidle_idle_call+0x1f6/0x280 [11036.582147][ C0] default_idle_call+0x69/0xa0 [11036.582396][ C0] cpuidle_idle_call+0x1f6/0x280 [11036.582648][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [11036.582953][ C0] ? lock_release+0x1d5/0x250 [11036.583205][ C0] do_idle+0xfb/0x160 [11036.583420][ C0] cpu_startup_entry+0x55/0x60 [11036.583677][ C0] rest_init+0x153/0x260 [11036.583901][ C0] ? acpi_enable_subsystem+0xac/0x150 [11036.584197][ C0] arch_call_rest_init+0x13/0x40 [11036.584477][ C0] start_kernel+0x314/0x3d0 [11036.584716][ C0] x86_64_start_reservations+0x18/0x30 [11036.585007][ C0] x86_64_start_kernel+0xba/0x110 [11036.585280][ C0] secondary_startup_64_no_verify+0x16d/0x17b [11036.585619][ C0] [11036.585799][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 9172s! [ksoftirqd/1:22] [11036.586254][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [11036.587433][ C1] irq event stamp: 3886976 [11036.587661][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [11036.588147][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [11036.588629][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [11036.589115][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [11036.589590][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [11036.590071][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11036.590699][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11036.591033][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11036.592036][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [11036.592352][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [11036.592765][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [11036.593200][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [11036.593623][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [11036.594038][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [11036.594453][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11036.594907][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11036.595249][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [11036.595655][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11036.596066][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11036.596477][ C1] Call Trace: [11036.596656][ C1] [11036.596807][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11036.597074][ C1] ? __run_hrtimer+0x1c3/0x710 [11036.597323][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11036.597609][ C1] ? __hrtimer_run_queues+0x197/0x270 [11036.597890][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11036.598189][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11036.598463][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [11036.598774][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11036.599041][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [11036.599365][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [11036.599667][ C1] [11036.599819][ C1] [11036.599972][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11036.600294][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11036.600592][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11036.600897][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11036.601192][ C1] ? run_ksoftirqd+0xb/0x60 [11036.601427][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11036.601745][ C1] ? __orc_find+0x9c/0xf0 [11036.601973][ C1] ? lock_acquire+0x1c1/0x220 [11036.602223][ C1] ? irqentry_enter+0x2b/0x60 [11036.602472][ C1] do_raw_spin_lock+0x1ec/0x270 [11036.602728][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11036.603032][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11036.603330][ C1] ? lock_acquire+0x1c1/0x220 [11036.603581][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [11036.603834][ C1] _raw_spin_lock_nested+0x65/0x80 [11036.604119][ C1] tcp_v4_rcv+0x2159/0x29b0 [11036.604360][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11036.604613][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11036.604874][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11036.605152][ C1] ip_local_deliver_finish+0x2ae/0x450 [11036.605433][ C1] ip_local_deliver+0x19d/0x480 [11036.605690][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11036.605973][ C1] ? rcu_read_lock_held+0xe/0x50 [11036.606253][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [11036.606530][ C1] ? rcu_read_lock_held+0xe/0x50 [11036.606792][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11036.607130][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11036.607408][ C1] ip_rcv+0x564/0x740 [11036.607614][ C1] ? __pfx_ip_rcv+0x10/0x10 [11036.607848][ C1] ? set_track_prepare+0x8a/0xd0 [11036.608104][ C1] ? irqentry_enter+0x2b/0x60 [11036.608349][ C1] ? irqentry_enter+0x2b/0x60 [11036.608594][ C1] ? __pfx_ip_rcv+0x10/0x10 [11036.608830][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11036.609140][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11036.609475][ C1] ? netif_receive_skb_internal+0x84/0x300 [11036.609775][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11036.610104][ C1] netif_receive_skb_internal+0xb0/0x300 [11036.610394][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11036.610719][ C1] netif_receive_skb+0x55/0x280 [11036.610974][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11036.611298][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11036.611636][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11036.611940][ C1] tcf_action_exec.part.0+0x115/0x3d0 [11036.612224][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11036.612523][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11036.612843][ C1] ? unwind_next_frame+0x1478/0x1d10 [11036.613147][ C1] ? arch_stack_walk+0x68/0x100 [11036.613408][ C1] ? unwind_next_frame+0x1cc/0x1d10 [11036.613687][ C1] ? irqentry_enter+0x2b/0x60 [11036.613938][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11036.614266][ C1] ? irqentry_enter+0x2b/0x60 [11036.614526][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11036.614848][ C1] ? unwind_next_frame+0x1478/0x1d10 [11036.615132][ C1] ? arch_stack_walk+0x68/0x100 [11036.615391][ C1] __tcf_classify+0x32c/0x7d0 [11036.615644][ C1] tcf_classify+0x283/0x930 [11036.615889][ C1] ? __pfx_tcf_classify+0x10/0x10 [11036.616150][ C1] tc_run+0x2e4/0x5d0 [11036.616357][ C1] ? __pfx_tc_run+0x10/0x10 [11036.616592][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [11036.616851][ C1] ? irqentry_enter+0x2b/0x60 [11036.617096][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11036.617377][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11036.617694][ C1] ip_finish_output2+0x786/0x18e0 [11036.617954][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11036.618238][ C1] ? rcu_read_lock_held+0xe/0x50 [11036.618499][ C1] ? __ip_finish_output+0x10f/0x770 [11036.618769][ C1] ip_output+0x16b/0x4f0 [11036.618989][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11036.619302][ C1] ? __pfx_ip_output+0x10/0x10 [11036.619551][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [11036.619896][ C1] ? __pfx_ip_output+0x10/0x10 [11036.620150][ C1] __ip_queue_xmit+0x672/0x1910 [11036.620402][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11036.620675][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11036.620962][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11036.621241][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11036.621527][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11036.621803][ C1] tcp_delack_timer+0x84/0x240 [11036.622053][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11036.622331][ C1] call_timer_fn+0x176/0x430 [11036.622572][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11036.622838][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [11036.623138][ C1] __run_timers.part.0+0x52d/0x890 [11036.623410][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11036.623700][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11036.624001][ C1] ? __pfx___schedule+0x10/0x10 [11036.624267][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11036.624580][ C1] run_timer_softirq+0x72/0x100 [11036.624834][ C1] __do_softirq+0x1bc/0x7ff [11036.625073][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [11036.625342][ C1] run_ksoftirqd+0x2e/0x60 [11036.625573][ C1] smpboot_thread_fn+0x30e/0x840 [11036.625837][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [11036.626121][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [11036.626405][ C1] kthread+0x292/0x360 [11036.626615][ C1] ? __pfx_kthread+0x10/0x10 [11036.626857][ C1] ret_from_fork+0x34/0x70 [11036.627087][ C1] ? __pfx_kthread+0x10/0x10 [11036.627329][ C1] ret_from_fork_asm+0x1b/0x30 [11036.627581][ C1] [11059.009024][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [11059.009403][ C0] rcu: 0-....: (9803480 ticks this GP) idle=bc7c/0/0x3 softirq=297651/297651 fqs=2339651 [11059.009909][ C0] rcu: (t=9864700 jiffies g=1007429 q=31 ncpus=4) [11059.010248][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [11059.010709][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11059.011338][ C0] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [11059.011672][ C0] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c [11059.012667][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [11059.012985][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [11059.013396][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [11059.013812][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [11059.014225][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [11059.014633][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [11059.015041][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [11059.015501][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11059.015838][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [11059.016248][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11059.016654][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11059.017060][ C0] Call Trace: [11059.017234][ C0] [11059.017386][ C0] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [11059.017668][ C0] ? print_cpu_stall+0x263/0x6a0 [11059.017924][ C0] ? check_cpu_stall+0x284/0x500 [11059.018181][ C0] ? rcu_pending+0x92/0x360 [11059.018412][ C0] ? rcu_sched_clock_irq+0x107/0x3f0 [11059.018686][ C0] ? update_process_times+0xb9/0x110 [11059.018964][ C0] ? tick_sched_handle+0x67/0x130 [11059.019225][ C0] ? tick_nohz_highres_handler+0xa7/0xd0 [11059.019515][ C0] ? __run_hrtimer+0x1c3/0x710 [11059.019764][ C0] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [11059.020082][ C0] ? __hrtimer_run_queues+0x197/0x270 [11059.020363][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [11059.020657][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11059.020930][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [11059.021251][ C0] ? hrtimer_interrupt+0x2c3/0x770 [11059.021515][ C0] ? trace_rcu_dyntick+0x10a/0x150 [11059.021786][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [11059.022100][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [11059.022402][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11059.022733][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [11059.023034][ C0] ? queued_spin_lock_slowpath+0xa3/0xb90 [11059.023334][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [11059.023650][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11059.023977][ C0] ? get_stack_info+0x36/0xc0 [11059.024227][ C0] ? lock_acquire+0x1c1/0x220 [11059.024476][ C0] ? lock_release+0x1d5/0x250 [11059.024730][ C0] do_raw_spin_lock+0x1ec/0x270 [11059.024980][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [11059.025253][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11059.025542][ C0] ? lock_acquire+0x1c1/0x220 [11059.025789][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [11059.026039][ C0] _raw_spin_lock_nested+0x65/0x80 [11059.026306][ C0] tcp_v4_rcv+0x2159/0x29b0 [11059.026543][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [11059.026791][ C0] ? __pfx_raw_v4_input+0x10/0x10 [11059.027051][ C0] ? __inet_lookup_established+0x341/0x610 [11059.027352][ C0] ip_protocol_deliver_rcu+0x93/0x360 [11059.027656][ C0] ip_local_deliver_finish+0x2ae/0x450 [11059.027949][ C0] ip_local_deliver+0x19d/0x480 [11059.028208][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [11059.028490][ C0] ? rcu_read_lock_held+0xe/0x50 [11059.028761][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [11059.029033][ C0] ? rcu_read_lock_held+0xe/0x50 [11059.029291][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11059.029615][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11059.029886][ C0] ip_rcv+0x564/0x740 [11059.030095][ C0] ? __pfx_ip_rcv+0x10/0x10 [11059.030333][ C0] ? set_track_prepare+0x8a/0xd0 [11059.030594][ C0] ? __pfx_set_track_prepare+0x10/0x10 [11059.030872][ C0] ? rest_init+0x153/0x260 [11059.031105][ C0] ? skb_clone+0x10b/0x330 [11059.031338][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11059.031666][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11059.031978][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [11059.032262][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [11059.032559][ C0] ? __tcf_classify+0x32c/0x7d0 [11059.032830][ C0] ? __pfx_ip_rcv+0x10/0x10 [11059.033073][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [11059.033387][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11059.033686][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11059.034033][ C0] ? lock_acquire+0x1c1/0x220 [11059.034274][ C0] ? netif_receive_skb_internal+0x84/0x300 [11059.034570][ C0] netif_receive_skb_internal+0xb0/0x300 [11059.034860][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11059.035180][ C0] ? __copy_skb_header+0xaf/0x490 [11059.035437][ C0] ? __skb_clone+0x57a/0x760 [11059.035673][ C0] netif_receive_skb+0x55/0x280 [11059.035924][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11059.036245][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11059.036583][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [11059.036885][ C0] tcf_action_exec.part.0+0x115/0x3d0 [11059.037167][ C0] fl_classify+0x4dc/0x650 [cls_flower] [11059.037459][ C0] ? hlock_class+0x4e/0x130 [11059.037701][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11059.038020][ C0] ? place_entity+0x21/0x2f0 [11059.038261][ C0] ? resched_curr+0x219/0x280 [11059.038501][ C0] ? __pfx_resched_curr+0x10/0x10 [11059.038758][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [11059.039031][ C0] ? unwind_next_frame+0x1cc/0x1d10 [11059.039301][ C0] ? wakeup_preempt+0x161/0x2c0 [11059.039555][ C0] ? activate_task+0xf5/0x260 [11059.039802][ C0] ? trace_sched_wakeup+0xd2/0x100 [11059.040069][ C0] ? do_raw_spin_unlock+0x58/0x220 [11059.040331][ C0] ? _raw_spin_unlock+0x23/0x40 [11059.040583][ C0] ? get_stack_info_noinstr+0x18/0x110 [11059.040865][ C0] ? get_stack_info+0x36/0xc0 [11059.041104][ C0] ? stack_access_ok+0xda/0x1f0 [11059.041352][ C0] ? get_reg+0x119/0x190 [11059.041571][ C0] __tcf_classify+0x32c/0x7d0 [11059.041815][ C0] tcf_classify+0x283/0x930 [11059.042051][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11059.042372][ C0] ? __pfx_tcf_classify+0x10/0x10 [11059.042628][ C0] ? arch_stack_walk+0x8c/0x100 [11059.042884][ C0] ? get_stack_info_noinstr+0x18/0x110 [11059.043169][ C0] tc_run+0x2e4/0x5d0 [11059.043377][ C0] ? __pfx_tc_run+0x10/0x10 [11059.043612][ C0] ? lock_acquire+0x1c1/0x220 [11059.043854][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [11059.044119][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [11059.044379][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [11059.044655][ C0] ? ip_finish_output2+0x786/0x18e0 [11059.044922][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [11059.045229][ C0] ? neigh_hh_output+0x348/0x590 [11059.045486][ C0] ? ip_finish_output2+0x262/0x18e0 [11059.045753][ C0] ip_finish_output2+0x786/0x18e0 [11059.046011][ C0] ? stack_depot_save_flags+0x45/0x550 [11059.046295][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11059.046637][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [11059.046918][ C0] ? rcu_read_lock_held+0xe/0x50 [11059.047174][ C0] ? __ip_finish_output+0x10f/0x770 [11059.047445][ C0] ip_output+0x16b/0x4f0 [11059.047669][ C0] ? __run_timers.part.0+0x52d/0x890 [11059.047939][ C0] ? __pfx_ip_output+0x10/0x10 [11059.048188][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11059.048476][ C0] ? rcu_read_lock_held+0xe/0x50 [11059.048736][ C0] ? ip_local_out+0x114/0x3b0 [11059.048979][ C0] __ip_queue_xmit+0x672/0x1910 [11059.049230][ C0] ? __skb_clone+0x57a/0x760 [11059.049466][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [11059.049742][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [11059.050031][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [11059.050343][ C0] tcp_write_xmit+0xe42/0x24c0 [11059.050592][ C0] ? tcp_current_mss+0x40a/0x510 [11059.050849][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [11059.051120][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [11059.051390][ C0] ? mark_lock_irq+0x6e2/0xa10 [11059.051639][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [11059.051896][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [11059.052201][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11059.052472][ C0] ? ktime_get+0xb6/0x190 [11059.052697][ C0] tcp_send_loss_probe+0x4c9/0x830 [11059.052986][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [11059.053268][ C0] tcp_write_timer+0x82/0x1d0 [11059.053518][ C0] call_timer_fn+0x176/0x430 [11059.053764][ C0] ? __pfx_call_timer_fn+0x10/0x10 [11059.054037][ C0] ? next_expiry_recalc+0xcd/0x220 [11059.054307][ C0] __run_timers.part.0+0x52d/0x890 [11059.054580][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [11059.054869][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [11059.055162][ C0] ? lock_acquire+0x1c1/0x220 [11059.055403][ C0] ? clockevents_program_event+0xf6/0x300 [11059.055695][ C0] ? lock_release+0x1d5/0x250 [11059.055933][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11059.056199][ C0] ? ktime_get+0xb6/0x190 [11059.056421][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [11059.056708][ C0] ? clockevents_program_event+0x1ed/0x300 [11059.057013][ C0] run_timer_softirq+0x72/0x100 [11059.057264][ C0] __do_softirq+0x1bc/0x7ff [11059.057503][ C0] irq_exit_rcu+0x98/0xc0 [11059.057746][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [11059.058042][ C0] [11059.058199][ C0] [11059.058357][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11059.058680][ C0] RIP: 0010:default_idle+0xf/0x20 [11059.058950][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11059.059930][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [11059.060242][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [11059.060646][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [11059.061048][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [11059.061451][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [11059.061855][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [11059.062261][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11059.062554][ C0] ? cpuidle_idle_call+0x1f6/0x280 [11059.062820][ C0] default_idle_call+0x69/0xa0 [11059.063065][ C0] cpuidle_idle_call+0x1f6/0x280 [11059.063320][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [11059.063601][ C0] ? lock_release+0x1d5/0x250 [11059.063849][ C0] do_idle+0xfb/0x160 [11059.064061][ C0] cpu_startup_entry+0x55/0x60 [11059.064310][ C0] rest_init+0x153/0x260 [11059.064527][ C0] ? acpi_enable_subsystem+0xac/0x150 [11059.064811][ C0] arch_call_rest_init+0x13/0x40 [11059.065073][ C0] start_kernel+0x314/0x3d0 [11059.065309][ C0] x86_64_start_reservations+0x18/0x30 [11059.065593][ C0] x86_64_start_kernel+0xba/0x110 [11059.065859][ C0] secondary_startup_64_no_verify+0x16d/0x17b [11059.066184][ C0] [11059.066345][ C0] Sending NMI from CPU 0 to CPUs 1: [11059.066622][ C1] NMI backtrace for cpu 1 [11059.066632][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [11059.066636][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11059.066637][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11059.066644][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11059.066647][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [11059.066650][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [11059.066652][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [11059.066654][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [11059.066655][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [11059.066657][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [11059.066659][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11059.066661][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11059.066664][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [11059.066665][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11059.066667][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11059.066668][ C1] Call Trace: [11059.066670][ C1] [11059.066673][ C1] ? nmi_cpu_backtrace+0x112/0x220 [11059.066679][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [11059.066684][ C1] ? nmi_handle+0x156/0x420 [11059.066688][ C1] ? default_do_nmi+0x41/0x100 [11059.066691][ C1] ? exc_nmi+0xf3/0x120 [11059.066694][ C1] ? end_repeat_nmi+0xf/0x60 [11059.066698][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11059.066701][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11059.066705][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11059.066708][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11059.066711][ C1] [11059.066712][ C1] [11059.066713][ C1] ? run_ksoftirqd+0xb/0x60 [11059.066719][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11059.066722][ C1] ? __orc_find+0x9c/0xf0 [11059.066725][ C1] ? lock_acquire+0x1c1/0x220 [11059.066729][ C1] ? irqentry_enter+0x2b/0x60 [11059.066733][ C1] do_raw_spin_lock+0x1ec/0x270 [11059.066737][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11059.066740][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11059.066743][ C1] ? lock_acquire+0x1c1/0x220 [11059.066745][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [11059.066749][ C1] _raw_spin_lock_nested+0x65/0x80 [11059.066752][ C1] tcp_v4_rcv+0x2159/0x29b0 [11059.066760][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11059.066763][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11059.066768][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11059.066774][ C1] ip_local_deliver_finish+0x2ae/0x450 [11059.066778][ C1] ip_local_deliver+0x19d/0x480 [11059.066780][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11059.066783][ C1] ? rcu_read_lock_held+0xe/0x50 [11059.066787][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [11059.066791][ C1] ? rcu_read_lock_held+0xe/0x50 [11059.066794][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11059.066797][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11059.066806][ C1] ip_rcv+0x564/0x740 [11059.066810][ C1] ? __pfx_ip_rcv+0x10/0x10 [11059.066812][ C1] ? set_track_prepare+0x8a/0xd0 [11059.066816][ C1] ? irqentry_enter+0x2b/0x60 [11059.066819][ C1] ? irqentry_enter+0x2b/0x60 [11059.066823][ C1] ? __pfx_ip_rcv+0x10/0x10 [11059.066825][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11059.066829][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11059.066833][ C1] ? netif_receive_skb_internal+0x84/0x300 [11059.066835][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11059.066838][ C1] netif_receive_skb_internal+0xb0/0x300 [11059.066841][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11059.066845][ C1] netif_receive_skb+0x55/0x280 [11059.066848][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11059.066855][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11059.066861][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11059.066868][ C1] tcf_action_exec.part.0+0x115/0x3d0 [11059.066873][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11059.066884][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11059.066893][ C1] ? unwind_next_frame+0x1478/0x1d10 [11059.066896][ C1] ? arch_stack_walk+0x68/0x100 [11059.066900][ C1] ? unwind_next_frame+0x1cc/0x1d10 [11059.066903][ C1] ? irqentry_enter+0x2b/0x60 [11059.066907][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11059.066911][ C1] ? irqentry_enter+0x2b/0x60 [11059.066914][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11059.066922][ C1] ? unwind_next_frame+0x1478/0x1d10 [11059.066925][ C1] ? arch_stack_walk+0x68/0x100 [11059.066929][ C1] __tcf_classify+0x32c/0x7d0 [11059.066934][ C1] tcf_classify+0x283/0x930 [11059.066938][ C1] ? __pfx_tcf_classify+0x10/0x10 [11059.066942][ C1] tc_run+0x2e4/0x5d0 [11059.066946][ C1] ? __pfx_tc_run+0x10/0x10 [11059.066951][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [11059.066956][ C1] ? irqentry_enter+0x2b/0x60 [11059.066959][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11059.066962][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11059.066969][ C1] ip_finish_output2+0x786/0x18e0 [11059.066974][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11059.066977][ C1] ? rcu_read_lock_held+0xe/0x50 [11059.066981][ C1] ? __ip_finish_output+0x10f/0x770 [11059.066985][ C1] ip_output+0x16b/0x4f0 [11059.066988][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11059.066991][ C1] ? __pfx_ip_output+0x10/0x10 [11059.066995][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [11059.067003][ C1] ? __pfx_ip_output+0x10/0x10 [11059.067007][ C1] __ip_queue_xmit+0x672/0x1910 [11059.067012][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11059.067018][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11059.067023][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11059.067027][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11059.067031][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11059.067033][ C1] tcp_delack_timer+0x84/0x240 [11059.067037][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11059.067040][ C1] call_timer_fn+0x176/0x430 [11059.067044][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11059.067049][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [11059.067052][ C1] __run_timers.part.0+0x52d/0x890 [11059.067056][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11059.067060][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11059.067065][ C1] ? __pfx___schedule+0x10/0x10 [11059.067069][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11059.067074][ C1] run_timer_softirq+0x72/0x100 [11059.067077][ C1] __do_softirq+0x1bc/0x7ff [11059.067081][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [11059.067085][ C1] run_ksoftirqd+0x2e/0x60 [11059.067088][ C1] smpboot_thread_fn+0x30e/0x840 [11059.067093][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [11059.067096][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [11059.067099][ C1] kthread+0x292/0x360 [11059.067103][ C1] ? __pfx_kthread+0x10/0x10 [11059.067106][ C1] ret_from_fork+0x34/0x70 [11059.067109][ C1] ? __pfx_kthread+0x10/0x10 [11059.067112][ C1] ret_from_fork_asm+0x1b/0x30 [11059.067119][ C1] [11084.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 9217s! [swapper/0:0] [11084.527909][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [11084.529062][ C0] irq event stamp: 27567077 [11084.529294][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [11084.529807][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [11084.530267][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [11084.530766][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [11084.531253][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [11084.531720][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11084.532342][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11084.532679][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11084.533673][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [11084.533988][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [11084.534395][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [11084.534799][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [11084.535206][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [11084.535610][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [11084.536017][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [11084.536471][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11084.536813][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [11084.537220][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11084.537631][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11084.538043][ C0] Call Trace: [11084.538224][ C0] [11084.538377][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [11084.538644][ C0] ? __run_hrtimer+0x1c3/0x710 [11084.538893][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [11084.539173][ C0] ? __hrtimer_run_queues+0x197/0x270 [11084.539454][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [11084.539750][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11084.540046][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [11084.540371][ C0] ? hrtimer_interrupt+0x2c3/0x770 [11084.540641][ C0] ? trace_rcu_dyntick+0x10a/0x150 [11084.540918][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [11084.541244][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [11084.541544][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11084.541867][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [11084.542161][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [11084.542459][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [11084.542782][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11084.543106][ C0] ? get_stack_info+0x36/0xc0 [11084.543365][ C0] ? lock_acquire+0x1c1/0x220 [11084.543621][ C0] ? lock_release+0x1d5/0x250 [11084.543886][ C0] do_raw_spin_lock+0x1ec/0x270 [11084.544141][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [11084.544418][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11084.544707][ C0] ? lock_acquire+0x1c1/0x220 [11084.544945][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [11084.545188][ C0] _raw_spin_lock_nested+0x65/0x80 [11084.545455][ C0] tcp_v4_rcv+0x2159/0x29b0 [11084.545697][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [11084.545950][ C0] ? __pfx_raw_v4_input+0x10/0x10 [11084.546214][ C0] ? __inet_lookup_established+0x341/0x610 [11084.546522][ C0] ip_protocol_deliver_rcu+0x93/0x360 [11084.546803][ C0] ip_local_deliver_finish+0x2ae/0x450 [11084.547085][ C0] ip_local_deliver+0x19d/0x480 [11084.547336][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [11084.547612][ C0] ? rcu_read_lock_held+0xe/0x50 [11084.547872][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [11084.548140][ C0] ? rcu_read_lock_held+0xe/0x50 [11084.548394][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11084.548721][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11084.548986][ C0] ip_rcv+0x564/0x740 [11084.549192][ C0] ? __pfx_ip_rcv+0x10/0x10 [11084.549424][ C0] ? set_track_prepare+0x8a/0xd0 [11084.549679][ C0] ? __pfx_set_track_prepare+0x10/0x10 [11084.549962][ C0] ? rest_init+0x153/0x260 [11084.550192][ C0] ? skb_clone+0x10b/0x330 [11084.550427][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11084.550750][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11084.551061][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [11084.551352][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [11084.551653][ C0] ? __tcf_classify+0x32c/0x7d0 [11084.551909][ C0] ? __pfx_ip_rcv+0x10/0x10 [11084.552151][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [11084.552458][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11084.552754][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11084.553088][ C0] ? lock_acquire+0x1c1/0x220 [11084.553355][ C0] ? netif_receive_skb_internal+0x84/0x300 [11084.553666][ C0] netif_receive_skb_internal+0xb0/0x300 [11084.553966][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11084.554310][ C0] ? __copy_skb_header+0xaf/0x490 [11084.554574][ C0] ? __skb_clone+0x57a/0x760 [11084.554815][ C0] netif_receive_skb+0x55/0x280 [11084.555066][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11084.555381][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11084.555716][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [11084.556021][ C0] tcf_action_exec.part.0+0x115/0x3d0 [11084.556298][ C0] fl_classify+0x4dc/0x650 [cls_flower] [11084.556586][ C0] ? hlock_class+0x4e/0x130 [11084.556822][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11084.557141][ C0] ? place_entity+0x21/0x2f0 [11084.557378][ C0] ? resched_curr+0x219/0x280 [11084.557625][ C0] ? __pfx_resched_curr+0x10/0x10 [11084.557886][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [11084.558161][ C0] ? unwind_next_frame+0x1cc/0x1d10 [11084.558427][ C0] ? wakeup_preempt+0x161/0x2c0 [11084.558673][ C0] ? activate_task+0xf5/0x260 [11084.558912][ C0] ? trace_sched_wakeup+0xd2/0x100 [11084.559178][ C0] ? do_raw_spin_unlock+0x58/0x220 [11084.559444][ C0] ? _raw_spin_unlock+0x23/0x40 [11084.559695][ C0] ? get_stack_info_noinstr+0x18/0x110 [11084.559975][ C0] ? get_stack_info+0x36/0xc0 [11084.560225][ C0] ? stack_access_ok+0xda/0x1f0 [11084.560476][ C0] ? get_reg+0x119/0x190 [11084.560699][ C0] __tcf_classify+0x32c/0x7d0 [11084.560943][ C0] tcf_classify+0x283/0x930 [11084.561177][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11084.561493][ C0] ? __pfx_tcf_classify+0x10/0x10 [11084.561755][ C0] ? arch_stack_walk+0x8c/0x100 [11084.562009][ C0] ? get_stack_info_noinstr+0x18/0x110 [11084.562292][ C0] tc_run+0x2e4/0x5d0 [11084.562501][ C0] ? __pfx_tc_run+0x10/0x10 [11084.562755][ C0] ? lock_acquire+0x1c1/0x220 [11084.563006][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [11084.563285][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [11084.563549][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [11084.563835][ C0] ? ip_finish_output2+0x786/0x18e0 [11084.564119][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [11084.564434][ C0] ? neigh_hh_output+0x348/0x590 [11084.564690][ C0] ? ip_finish_output2+0x262/0x18e0 [11084.564962][ C0] ip_finish_output2+0x786/0x18e0 [11084.565225][ C0] ? stack_depot_save_flags+0x45/0x550 [11084.565510][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11084.565849][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [11084.566130][ C0] ? rcu_read_lock_held+0xe/0x50 [11084.566388][ C0] ? __ip_finish_output+0x10f/0x770 [11084.566654][ C0] ip_output+0x16b/0x4f0 [11084.566874][ C0] ? __run_timers.part.0+0x52d/0x890 [11084.567151][ C0] ? __pfx_ip_output+0x10/0x10 [11084.567399][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11084.567692][ C0] ? rcu_read_lock_held+0xe/0x50 [11084.567945][ C0] ? ip_local_out+0x114/0x3b0 [11084.568196][ C0] __ip_queue_xmit+0x672/0x1910 [11084.568459][ C0] ? __skb_clone+0x57a/0x760 [11084.568703][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [11084.568973][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [11084.569259][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [11084.569566][ C0] tcp_write_xmit+0xe42/0x24c0 [11084.569816][ C0] ? tcp_current_mss+0x40a/0x510 [11084.570090][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [11084.570373][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [11084.570645][ C0] ? mark_lock_irq+0x6e2/0xa10 [11084.570896][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [11084.571167][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [11084.571492][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11084.571757][ C0] ? ktime_get+0xb6/0x190 [11084.571980][ C0] tcp_send_loss_probe+0x4c9/0x830 [11084.572245][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [11084.572520][ C0] tcp_write_timer+0x82/0x1d0 [11084.572768][ C0] call_timer_fn+0x176/0x430 [11084.573009][ C0] ? __pfx_call_timer_fn+0x10/0x10 [11084.573273][ C0] ? next_expiry_recalc+0xcd/0x220 [11084.573540][ C0] __run_timers.part.0+0x52d/0x890 [11084.573803][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [11084.574079][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [11084.574366][ C0] ? lock_acquire+0x1c1/0x220 [11084.574612][ C0] ? clockevents_program_event+0xf6/0x300 [11084.574912][ C0] ? lock_release+0x1d5/0x250 [11084.575157][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11084.575428][ C0] ? ktime_get+0xb6/0x190 [11084.575652][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [11084.575945][ C0] ? clockevents_program_event+0x1ed/0x300 [11084.576245][ C0] run_timer_softirq+0x72/0x100 [11084.576498][ C0] __do_softirq+0x1bc/0x7ff [11084.576737][ C0] irq_exit_rcu+0x98/0xc0 [11084.576964][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [11084.577254][ C0] [11084.577405][ C0] [11084.577555][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11084.577861][ C0] RIP: 0010:default_idle+0xf/0x20 [11084.578124][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11084.579116][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [11084.579430][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [11084.579840][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [11084.580252][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [11084.580657][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [11084.581063][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [11084.581478][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11084.581776][ C0] ? cpuidle_idle_call+0x1f6/0x280 [11084.582045][ C0] default_idle_call+0x69/0xa0 [11084.582296][ C0] cpuidle_idle_call+0x1f6/0x280 [11084.582553][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [11084.582866][ C0] ? lock_release+0x1d5/0x250 [11084.583114][ C0] do_idle+0xfb/0x160 [11084.583324][ C0] cpu_startup_entry+0x55/0x60 [11084.583575][ C0] rest_init+0x153/0x260 [11084.583804][ C0] ? acpi_enable_subsystem+0xac/0x150 [11084.584090][ C0] arch_call_rest_init+0x13/0x40 [11084.584353][ C0] start_kernel+0x314/0x3d0 [11084.584604][ C0] x86_64_start_reservations+0x18/0x30 [11084.584886][ C0] x86_64_start_kernel+0xba/0x110 [11084.585145][ C0] secondary_startup_64_no_verify+0x16d/0x17b [11084.585466][ C0] [11084.585626][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 9217s! [ksoftirqd/1:22] [11084.586070][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [11084.587221][ C1] irq event stamp: 3886976 [11084.587448][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [11084.587935][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [11084.588417][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [11084.588900][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [11084.589382][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [11084.589861][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11084.590492][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11084.590828][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11084.591824][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [11084.592143][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [11084.592554][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [11084.592966][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [11084.593373][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [11084.593779][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [11084.594186][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11084.594638][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11084.594982][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [11084.595392][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11084.595799][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11084.596211][ C1] Call Trace: [11084.596387][ C1] [11084.596540][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11084.596810][ C1] ? __run_hrtimer+0x1c3/0x710 [11084.597060][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11084.597341][ C1] ? __hrtimer_run_queues+0x197/0x270 [11084.597620][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11084.597919][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11084.598192][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [11084.598506][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11084.598774][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [11084.599091][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [11084.599395][ C1] [11084.599547][ C1] [11084.599700][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11084.600021][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11084.600338][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11084.600653][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11084.600954][ C1] ? run_ksoftirqd+0xb/0x60 [11084.601197][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11084.601530][ C1] ? __orc_find+0x9c/0xf0 [11084.601755][ C1] ? lock_acquire+0x1c1/0x220 [11084.602007][ C1] ? irqentry_enter+0x2b/0x60 [11084.602256][ C1] do_raw_spin_lock+0x1ec/0x270 [11084.602514][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11084.602814][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11084.603113][ C1] ? lock_acquire+0x1c1/0x220 [11084.603365][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [11084.603619][ C1] _raw_spin_lock_nested+0x65/0x80 [11084.603903][ C1] tcp_v4_rcv+0x2159/0x29b0 [11084.604140][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11084.604391][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11084.604651][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11084.604929][ C1] ip_local_deliver_finish+0x2ae/0x450 [11084.605212][ C1] ip_local_deliver+0x19d/0x480 [11084.605465][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11084.605744][ C1] ? rcu_read_lock_held+0xe/0x50 [11084.606005][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [11084.606275][ C1] ? rcu_read_lock_held+0xe/0x50 [11084.606531][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11084.606860][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11084.607125][ C1] ip_rcv+0x564/0x740 [11084.607335][ C1] ? __pfx_ip_rcv+0x10/0x10 [11084.607570][ C1] ? set_track_prepare+0x8a/0xd0 [11084.607825][ C1] ? irqentry_enter+0x2b/0x60 [11084.608071][ C1] ? irqentry_enter+0x2b/0x60 [11084.608317][ C1] ? __pfx_ip_rcv+0x10/0x10 [11084.608554][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11084.608862][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11084.609195][ C1] ? netif_receive_skb_internal+0x84/0x300 [11084.609498][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11084.609825][ C1] netif_receive_skb_internal+0xb0/0x300 [11084.610112][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11084.610437][ C1] netif_receive_skb+0x55/0x280 [11084.610693][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11084.611014][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11084.611354][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11084.611655][ C1] tcf_action_exec.part.0+0x115/0x3d0 [11084.611935][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11084.612230][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11084.612551][ C1] ? unwind_next_frame+0x1478/0x1d10 [11084.612832][ C1] ? arch_stack_walk+0x68/0x100 [11084.613086][ C1] ? unwind_next_frame+0x1cc/0x1d10 [11084.613356][ C1] ? irqentry_enter+0x2b/0x60 [11084.613624][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11084.613945][ C1] ? irqentry_enter+0x2b/0x60 [11084.614196][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11084.614516][ C1] ? unwind_next_frame+0x1478/0x1d10 [11084.614802][ C1] ? arch_stack_walk+0x68/0x100 [11084.615056][ C1] __tcf_classify+0x32c/0x7d0 [11084.615298][ C1] tcf_classify+0x283/0x930 [11084.615532][ C1] ? __pfx_tcf_classify+0x10/0x10 [11084.615793][ C1] tc_run+0x2e4/0x5d0 [11084.616002][ C1] ? __pfx_tc_run+0x10/0x10 [11084.616240][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [11084.616499][ C1] ? irqentry_enter+0x2b/0x60 [11084.616745][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11084.617024][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11084.617342][ C1] ip_finish_output2+0x786/0x18e0 [11084.617604][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11084.617883][ C1] ? rcu_read_lock_held+0xe/0x50 [11084.618144][ C1] ? __ip_finish_output+0x10f/0x770 [11084.618413][ C1] ip_output+0x16b/0x4f0 [11084.618633][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11084.618947][ C1] ? __pfx_ip_output+0x10/0x10 [11084.619198][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [11084.619541][ C1] ? __pfx_ip_output+0x10/0x10 [11084.619792][ C1] __ip_queue_xmit+0x672/0x1910 [11084.620046][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11084.620318][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11084.620604][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11084.620887][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11084.621175][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11084.621453][ C1] tcp_delack_timer+0x84/0x240 [11084.621701][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11084.621980][ C1] call_timer_fn+0x176/0x430 [11084.622224][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11084.622491][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [11084.622788][ C1] __run_timers.part.0+0x52d/0x890 [11084.623060][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11084.623350][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11084.623652][ C1] ? __pfx___schedule+0x10/0x10 [11084.623908][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11084.624224][ C1] run_timer_softirq+0x72/0x100 [11084.624485][ C1] __do_softirq+0x1bc/0x7ff [11084.624729][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [11084.625003][ C1] run_ksoftirqd+0x2e/0x60 [11084.625240][ C1] smpboot_thread_fn+0x30e/0x840 [11084.625507][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [11084.625798][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [11084.626090][ C1] kthread+0x292/0x360 [11084.626306][ C1] ? __pfx_kthread+0x10/0x10 [11084.626552][ C1] ret_from_fork+0x34/0x70 [11084.626789][ C1] ? __pfx_kthread+0x10/0x10 [11084.627038][ C1] ret_from_fork_asm+0x1b/0x30 [11084.627298][ C1] [11112.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 9243s! [swapper/0:0] [11112.527913][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [11112.529083][ C0] irq event stamp: 27567077 [11112.529321][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [11112.529840][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [11112.530299][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [11112.530784][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [11112.531260][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [11112.531726][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11112.532355][ C0] RIP: 0010:kasan_check_range+0x12/0x1c0 [11112.532655][ C0] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [11112.533648][ C0] RSP: 0018:ffffc900000069c8 EFLAGS: 00000202 [11112.533962][ C0] RAX: ffff88800a099b58 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [11112.534374][ C0] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a099b58 [11112.534782][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [11112.535191][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [11112.535601][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [11112.536018][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [11112.536477][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11112.536815][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [11112.537230][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11112.537637][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11112.538044][ C0] Call Trace: [11112.538215][ C0] [11112.538367][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [11112.538638][ C0] ? __run_hrtimer+0x1c3/0x710 [11112.538885][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [11112.539169][ C0] ? __hrtimer_run_queues+0x197/0x270 [11112.539443][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [11112.539734][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11112.540003][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [11112.540313][ C0] ? hrtimer_interrupt+0x2c3/0x770 [11112.540584][ C0] ? trace_rcu_dyntick+0x10a/0x150 [11112.540849][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [11112.541168][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [11112.541471][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11112.541789][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [11112.542087][ C0] ? kasan_check_range+0x12/0x1c0 [11112.542349][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [11112.542640][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11112.542952][ C0] ? get_stack_info+0x36/0xc0 [11112.543202][ C0] ? lock_acquire+0x1c1/0x220 [11112.543448][ C0] ? lock_release+0x1d5/0x250 [11112.543693][ C0] do_raw_spin_lock+0x1ec/0x270 [11112.543947][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [11112.544227][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11112.544520][ C0] ? lock_acquire+0x1c1/0x220 [11112.544762][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [11112.545007][ C0] _raw_spin_lock_nested+0x65/0x80 [11112.545271][ C0] tcp_v4_rcv+0x2159/0x29b0 [11112.545513][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [11112.545767][ C0] ? __pfx_raw_v4_input+0x10/0x10 [11112.546032][ C0] ? __inet_lookup_established+0x341/0x610 [11112.546336][ C0] ip_protocol_deliver_rcu+0x93/0x360 [11112.546618][ C0] ip_local_deliver_finish+0x2ae/0x450 [11112.546901][ C0] ip_local_deliver+0x19d/0x480 [11112.547158][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [11112.547438][ C0] ? rcu_read_lock_held+0xe/0x50 [11112.547698][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [11112.547964][ C0] ? rcu_read_lock_held+0xe/0x50 [11112.548219][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11112.548545][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11112.548811][ C0] ip_rcv+0x564/0x740 [11112.549016][ C0] ? __pfx_ip_rcv+0x10/0x10 [11112.549249][ C0] ? set_track_prepare+0x8a/0xd0 [11112.549506][ C0] ? __pfx_set_track_prepare+0x10/0x10 [11112.549787][ C0] ? rest_init+0x153/0x260 [11112.550014][ C0] ? skb_clone+0x10b/0x330 [11112.550250][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11112.550573][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11112.550880][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [11112.551171][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [11112.551474][ C0] ? __tcf_classify+0x32c/0x7d0 [11112.551727][ C0] ? __pfx_ip_rcv+0x10/0x10 [11112.551964][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [11112.552273][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11112.552568][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11112.552899][ C0] ? lock_acquire+0x1c1/0x220 [11112.553144][ C0] ? netif_receive_skb_internal+0x84/0x300 [11112.553446][ C0] netif_receive_skb_internal+0xb0/0x300 [11112.553735][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11112.554059][ C0] ? __copy_skb_header+0xaf/0x490 [11112.554322][ C0] ? __skb_clone+0x57a/0x760 [11112.554562][ C0] netif_receive_skb+0x55/0x280 [11112.554810][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11112.555124][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11112.555461][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [11112.555772][ C0] tcf_action_exec.part.0+0x115/0x3d0 [11112.556051][ C0] fl_classify+0x4dc/0x650 [cls_flower] [11112.556341][ C0] ? hlock_class+0x4e/0x130 [11112.556577][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11112.556895][ C0] ? place_entity+0x21/0x2f0 [11112.557134][ C0] ? resched_curr+0x219/0x280 [11112.557381][ C0] ? __pfx_resched_curr+0x10/0x10 [11112.557644][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [11112.557920][ C0] ? unwind_next_frame+0x1cc/0x1d10 [11112.558188][ C0] ? wakeup_preempt+0x161/0x2c0 [11112.558439][ C0] ? activate_task+0xf5/0x260 [11112.558682][ C0] ? trace_sched_wakeup+0xd2/0x100 [11112.558949][ C0] ? do_raw_spin_unlock+0x58/0x220 [11112.559216][ C0] ? _raw_spin_unlock+0x23/0x40 [11112.559464][ C0] ? get_stack_info_noinstr+0x18/0x110 [11112.559742][ C0] ? get_stack_info+0x36/0xc0 [11112.559989][ C0] ? stack_access_ok+0xda/0x1f0 [11112.560245][ C0] ? get_reg+0x119/0x190 [11112.560465][ C0] __tcf_classify+0x32c/0x7d0 [11112.560706][ C0] tcf_classify+0x283/0x930 [11112.560938][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11112.561257][ C0] ? __pfx_tcf_classify+0x10/0x10 [11112.561518][ C0] ? arch_stack_walk+0x8c/0x100 [11112.561777][ C0] ? get_stack_info_noinstr+0x18/0x110 [11112.562062][ C0] tc_run+0x2e4/0x5d0 [11112.562270][ C0] ? __pfx_tc_run+0x10/0x10 [11112.562502][ C0] ? lock_acquire+0x1c1/0x220 [11112.562753][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [11112.563020][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [11112.563278][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [11112.563558][ C0] ? ip_finish_output2+0x786/0x18e0 [11112.563829][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [11112.564142][ C0] ? neigh_hh_output+0x348/0x590 [11112.564397][ C0] ? ip_finish_output2+0x262/0x18e0 [11112.564669][ C0] ip_finish_output2+0x786/0x18e0 [11112.564933][ C0] ? stack_depot_save_flags+0x45/0x550 [11112.565219][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11112.565558][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [11112.565836][ C0] ? rcu_read_lock_held+0xe/0x50 [11112.566097][ C0] ? __ip_finish_output+0x10f/0x770 [11112.566366][ C0] ip_output+0x16b/0x4f0 [11112.566585][ C0] ? __run_timers.part.0+0x52d/0x890 [11112.566862][ C0] ? __pfx_ip_output+0x10/0x10 [11112.567106][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11112.567400][ C0] ? rcu_read_lock_held+0xe/0x50 [11112.567654][ C0] ? ip_local_out+0x114/0x3b0 [11112.567900][ C0] __ip_queue_xmit+0x672/0x1910 [11112.568154][ C0] ? __skb_clone+0x57a/0x760 [11112.568395][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [11112.568665][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [11112.568954][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [11112.569264][ C0] tcp_write_xmit+0xe42/0x24c0 [11112.569517][ C0] ? tcp_current_mss+0x40a/0x510 [11112.569770][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [11112.570046][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [11112.570312][ C0] ? mark_lock_irq+0x6e2/0xa10 [11112.570559][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [11112.570825][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [11112.571138][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11112.571404][ C0] ? ktime_get+0xb6/0x190 [11112.571627][ C0] tcp_send_loss_probe+0x4c9/0x830 [11112.571891][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [11112.572166][ C0] tcp_write_timer+0x82/0x1d0 [11112.572411][ C0] call_timer_fn+0x176/0x430 [11112.572657][ C0] ? __pfx_call_timer_fn+0x10/0x10 [11112.572921][ C0] ? next_expiry_recalc+0xcd/0x220 [11112.573191][ C0] __run_timers.part.0+0x52d/0x890 [11112.573454][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [11112.573732][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [11112.574021][ C0] ? lock_acquire+0x1c1/0x220 [11112.574265][ C0] ? clockevents_program_event+0xf6/0x300 [11112.574565][ C0] ? lock_release+0x1d5/0x250 [11112.574811][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11112.575083][ C0] ? ktime_get+0xb6/0x190 [11112.575310][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [11112.575603][ C0] ? clockevents_program_event+0x1ed/0x300 [11112.575905][ C0] run_timer_softirq+0x72/0x100 [11112.576160][ C0] __do_softirq+0x1bc/0x7ff [11112.576401][ C0] irq_exit_rcu+0x98/0xc0 [11112.576626][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [11112.576920][ C0] [11112.577072][ C0] [11112.577223][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11112.577536][ C0] RIP: 0010:default_idle+0xf/0x20 [11112.577800][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11112.578797][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [11112.579120][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [11112.579527][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [11112.579935][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [11112.580346][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [11112.580757][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [11112.581166][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11112.581462][ C0] ? cpuidle_idle_call+0x1f6/0x280 [11112.581732][ C0] default_idle_call+0x69/0xa0 [11112.581979][ C0] cpuidle_idle_call+0x1f6/0x280 [11112.582237][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [11112.582521][ C0] ? lock_release+0x1d5/0x250 [11112.582769][ C0] do_idle+0xfb/0x160 [11112.582976][ C0] cpu_startup_entry+0x55/0x60 [11112.583223][ C0] rest_init+0x153/0x260 [11112.583443][ C0] ? acpi_enable_subsystem+0xac/0x150 [11112.583722][ C0] arch_call_rest_init+0x13/0x40 [11112.583980][ C0] start_kernel+0x314/0x3d0 [11112.584220][ C0] x86_64_start_reservations+0x18/0x30 [11112.584509][ C0] x86_64_start_kernel+0xba/0x110 [11112.584767][ C0] secondary_startup_64_no_verify+0x16d/0x17b [11112.585083][ C0] [11112.585241][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 9243s! [ksoftirqd/1:22] [11112.585683][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [11112.586830][ C1] irq event stamp: 3886976 [11112.587058][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [11112.587539][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [11112.588020][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [11112.588503][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [11112.588974][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [11112.589453][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11112.590079][ C1] RIP: 0010:kasan_check_range+0x77/0x1c0 [11112.590372][ C1] Code: ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 <48> 89 e8 49 8d 59 01 48 89 da 48 29 ea 48 83 fa 10 0f 8e c0 00 00 [11112.591357][ C1] RSP: 0018:ffffc9000019e9c8 EFLAGS: 00000286 [11112.591670][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [11112.592075][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [11112.592478][ C1] RBP: ffffed10014131c3 R08: 0000000000000000 R09: ffffed10014131c3 [11112.592891][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [11112.593308][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [11112.593717][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11112.594174][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11112.594512][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [11112.594921][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11112.595328][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11112.595732][ C1] Call Trace: [11112.595904][ C1] [11112.596054][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11112.596323][ C1] ? __run_hrtimer+0x1c3/0x710 [11112.596568][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11112.596852][ C1] ? __hrtimer_run_queues+0x197/0x270 [11112.597127][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11112.597420][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11112.597689][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [11112.597999][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11112.598270][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [11112.598584][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [11112.598883][ C1] [11112.599038][ C1] [11112.599192][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11112.599514][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11112.599806][ C1] ? kasan_check_range+0x77/0x1c0 [11112.600067][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [11112.600352][ C1] ? run_ksoftirqd+0xb/0x60 [11112.600588][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11112.600906][ C1] ? __orc_find+0x9c/0xf0 [11112.601133][ C1] ? lock_acquire+0x1c1/0x220 [11112.601381][ C1] ? irqentry_enter+0x2b/0x60 [11112.601629][ C1] do_raw_spin_lock+0x1ec/0x270 [11112.601887][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11112.602169][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11112.602461][ C1] ? lock_acquire+0x1c1/0x220 [11112.602708][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [11112.602954][ C1] _raw_spin_lock_nested+0x65/0x80 [11112.603220][ C1] tcp_v4_rcv+0x2159/0x29b0 [11112.603456][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11112.603705][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11112.603966][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11112.604243][ C1] ip_local_deliver_finish+0x2ae/0x450 [11112.604522][ C1] ip_local_deliver+0x19d/0x480 [11112.604775][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11112.605054][ C1] ? rcu_read_lock_held+0xe/0x50 [11112.605314][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [11112.605583][ C1] ? rcu_read_lock_held+0xe/0x50 [11112.605837][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11112.606166][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11112.606430][ C1] ip_rcv+0x564/0x740 [11112.606637][ C1] ? __pfx_ip_rcv+0x10/0x10 [11112.606872][ C1] ? set_track_prepare+0x8a/0xd0 [11112.607126][ C1] ? irqentry_enter+0x2b/0x60 [11112.607371][ C1] ? irqentry_enter+0x2b/0x60 [11112.607617][ C1] ? __pfx_ip_rcv+0x10/0x10 [11112.607854][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11112.608159][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11112.608492][ C1] ? netif_receive_skb_internal+0x84/0x300 [11112.608793][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11112.609121][ C1] netif_receive_skb_internal+0xb0/0x300 [11112.609408][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11112.609733][ C1] netif_receive_skb+0x55/0x280 [11112.609989][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11112.610307][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11112.610647][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11112.610948][ C1] tcf_action_exec.part.0+0x115/0x3d0 [11112.611231][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11112.611526][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11112.611846][ C1] ? unwind_next_frame+0x1478/0x1d10 [11112.612120][ C1] ? arch_stack_walk+0x68/0x100 [11112.612370][ C1] ? unwind_next_frame+0x1cc/0x1d10 [11112.612640][ C1] ? irqentry_enter+0x2b/0x60 [11112.612886][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11112.613203][ C1] ? irqentry_enter+0x2b/0x60 [11112.613446][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11112.613757][ C1] ? unwind_next_frame+0x1478/0x1d10 [11112.614030][ C1] ? arch_stack_walk+0x68/0x100 [11112.614280][ C1] __tcf_classify+0x32c/0x7d0 [11112.614525][ C1] tcf_classify+0x283/0x930 [11112.614759][ C1] ? __pfx_tcf_classify+0x10/0x10 [11112.615020][ C1] tc_run+0x2e4/0x5d0 [11112.615229][ C1] ? __pfx_tc_run+0x10/0x10 [11112.615466][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [11112.615724][ C1] ? irqentry_enter+0x2b/0x60 [11112.615969][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11112.616249][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11112.616566][ C1] ip_finish_output2+0x786/0x18e0 [11112.616827][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11112.617106][ C1] ? rcu_read_lock_held+0xe/0x50 [11112.617365][ C1] ? __ip_finish_output+0x10f/0x770 [11112.617633][ C1] ip_output+0x16b/0x4f0 [11112.617853][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11112.618166][ C1] ? __pfx_ip_output+0x10/0x10 [11112.618415][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [11112.618758][ C1] ? __pfx_ip_output+0x10/0x10 [11112.619006][ C1] __ip_queue_xmit+0x672/0x1910 [11112.619260][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11112.619529][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11112.619815][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11112.620094][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11112.620379][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11112.620656][ C1] tcp_delack_timer+0x84/0x240 [11112.620905][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11112.621185][ C1] call_timer_fn+0x176/0x430 [11112.621428][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11112.621694][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [11112.621966][ C1] __run_timers.part.0+0x52d/0x890 [11112.622233][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11112.622511][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11112.622807][ C1] ? __pfx___schedule+0x10/0x10 [11112.623057][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11112.623364][ C1] run_timer_softirq+0x72/0x100 [11112.623617][ C1] __do_softirq+0x1bc/0x7ff [11112.623854][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [11112.624123][ C1] run_ksoftirqd+0x2e/0x60 [11112.624352][ C1] smpboot_thread_fn+0x30e/0x840 [11112.624613][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [11112.624896][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [11112.625180][ C1] kthread+0x292/0x360 [11112.625390][ C1] ? __pfx_kthread+0x10/0x10 [11112.625630][ C1] ret_from_fork+0x34/0x70 [11112.625861][ C1] ? __pfx_kthread+0x10/0x10 [11112.626103][ C1] ret_from_fork_asm+0x1b/0x30 [11112.626356][ C1] [11137.070024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [11137.070412][ C1] rcu: 1-....: (9868746 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=2357738 [11137.070980][ C1] rcu: (t=9942761 jiffies g=1007429 q=31 ncpus=4) [11137.071320][ C1] Sending NMI from CPU 1 to CPUs 0: [11137.071597][ C0] NMI backtrace for cpu 0 [11137.071603][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [11137.071607][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11137.071610][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11137.071620][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11137.071624][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [11137.071644][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [11137.071646][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [11137.071648][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [11137.071650][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [11137.071651][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [11137.071653][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [11137.071655][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11137.071658][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [11137.071660][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11137.071662][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11137.071663][ C0] Call Trace: [11137.071666][ C0] [11137.071671][ C0] ? nmi_cpu_backtrace+0x112/0x220 [11137.071677][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [11137.071683][ C0] ? nmi_handle+0x156/0x420 [11137.071689][ C0] ? default_do_nmi+0x41/0x100 [11137.071694][ C0] ? exc_nmi+0xf3/0x120 [11137.071696][ C0] ? end_repeat_nmi+0xf/0x60 [11137.071701][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [11137.071705][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [11137.071709][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [11137.071712][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [11137.071716][ C0] [11137.071717][ C0] [11137.071718][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11137.071721][ C0] ? get_stack_info+0x36/0xc0 [11137.071726][ C0] ? lock_acquire+0x1c1/0x220 [11137.071732][ C0] ? lock_release+0x1d5/0x250 [11137.071735][ C0] do_raw_spin_lock+0x1ec/0x270 [11137.071739][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [11137.071742][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11137.071745][ C0] ? lock_acquire+0x1c1/0x220 [11137.071748][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [11137.071753][ C0] _raw_spin_lock_nested+0x65/0x80 [11137.071757][ C0] tcp_v4_rcv+0x2159/0x29b0 [11137.071765][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [11137.071767][ C0] ? __pfx_raw_v4_input+0x10/0x10 [11137.071771][ C0] ? __inet_lookup_established+0x341/0x610 [11137.071778][ C0] ip_protocol_deliver_rcu+0x93/0x360 [11137.071786][ C0] ip_local_deliver_finish+0x2ae/0x450 [11137.071790][ C0] ip_local_deliver+0x19d/0x480 [11137.071794][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [11137.071796][ C0] ? rcu_read_lock_held+0xe/0x50 [11137.071802][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [11137.071806][ C0] ? rcu_read_lock_held+0xe/0x50 [11137.071808][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11137.071812][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11137.071823][ C0] ip_rcv+0x564/0x740 [11137.071827][ C0] ? __pfx_ip_rcv+0x10/0x10 [11137.071830][ C0] ? set_track_prepare+0x8a/0xd0 [11137.071835][ C0] ? __pfx_set_track_prepare+0x10/0x10 [11137.071837][ C0] ? rest_init+0x153/0x260 [11137.071840][ C0] ? skb_clone+0x10b/0x330 [11137.071847][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11137.071853][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11137.071858][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [11137.071864][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [11137.071874][ C0] ? __tcf_classify+0x32c/0x7d0 [11137.071877][ C0] ? __pfx_ip_rcv+0x10/0x10 [11137.071880][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [11137.071884][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11137.071888][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11137.071891][ C0] ? lock_acquire+0x1c1/0x220 [11137.071893][ C0] ? netif_receive_skb_internal+0x84/0x300 [11137.071897][ C0] netif_receive_skb_internal+0xb0/0x300 [11137.071900][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11137.071903][ C0] ? __copy_skb_header+0xaf/0x490 [11137.071906][ C0] ? __skb_clone+0x57a/0x760 [11137.071909][ C0] netif_receive_skb+0x55/0x280 [11137.071912][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11137.071921][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11137.071928][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [11137.071935][ C0] tcf_action_exec.part.0+0x115/0x3d0 [11137.071940][ C0] fl_classify+0x4dc/0x650 [cls_flower] [11137.071948][ C0] ? hlock_class+0x4e/0x130 [11137.071954][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11137.071964][ C0] ? place_entity+0x21/0x2f0 [11137.071968][ C0] ? resched_curr+0x219/0x280 [11137.071972][ C0] ? __pfx_resched_curr+0x10/0x10 [11137.071975][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [11137.071978][ C0] ? unwind_next_frame+0x1cc/0x1d10 [11137.071983][ C0] ? wakeup_preempt+0x161/0x2c0 [11137.071986][ C0] ? activate_task+0xf5/0x260 [11137.071989][ C0] ? trace_sched_wakeup+0xd2/0x100 [11137.071994][ C0] ? do_raw_spin_unlock+0x58/0x220 [11137.071998][ C0] ? _raw_spin_unlock+0x23/0x40 [11137.072002][ C0] ? get_stack_info_noinstr+0x18/0x110 [11137.072005][ C0] ? get_stack_info+0x36/0xc0 [11137.072009][ C0] ? stack_access_ok+0xda/0x1f0 [11137.072011][ C0] ? get_reg+0x119/0x190 [11137.072014][ C0] __tcf_classify+0x32c/0x7d0 [11137.072019][ C0] tcf_classify+0x283/0x930 [11137.072023][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11137.072028][ C0] ? __pfx_tcf_classify+0x10/0x10 [11137.072030][ C0] ? arch_stack_walk+0x8c/0x100 [11137.072034][ C0] ? get_stack_info_noinstr+0x18/0x110 [11137.072038][ C0] tc_run+0x2e4/0x5d0 [11137.072042][ C0] ? __pfx_tc_run+0x10/0x10 [11137.072046][ C0] ? lock_acquire+0x1c1/0x220 [11137.072048][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [11137.072053][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [11137.072059][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [11137.072061][ C0] ? ip_finish_output2+0x786/0x18e0 [11137.072065][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [11137.072071][ C0] ? neigh_hh_output+0x348/0x590 [11137.072075][ C0] ? ip_finish_output2+0x262/0x18e0 [11137.072079][ C0] ip_finish_output2+0x786/0x18e0 [11137.072083][ C0] ? stack_depot_save_flags+0x45/0x550 [11137.072089][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11137.072097][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [11137.072100][ C0] ? rcu_read_lock_held+0xe/0x50 [11137.072104][ C0] ? __ip_finish_output+0x10f/0x770 [11137.072108][ C0] ip_output+0x16b/0x4f0 [11137.072111][ C0] ? __run_timers.part.0+0x52d/0x890 [11137.072118][ C0] ? __pfx_ip_output+0x10/0x10 [11137.072121][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11137.072126][ C0] ? rcu_read_lock_held+0xe/0x50 [11137.072129][ C0] ? ip_local_out+0x114/0x3b0 [11137.072133][ C0] __ip_queue_xmit+0x672/0x1910 [11137.072137][ C0] ? __skb_clone+0x57a/0x760 [11137.072140][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [11137.072148][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [11137.072152][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [11137.072156][ C0] tcp_write_xmit+0xe42/0x24c0 [11137.072161][ C0] ? tcp_current_mss+0x40a/0x510 [11137.072164][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [11137.072167][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [11137.072170][ C0] ? mark_lock_irq+0x6e2/0xa10 [11137.072172][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [11137.072175][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [11137.072178][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11137.072183][ C0] ? ktime_get+0xb6/0x190 [11137.072188][ C0] tcp_send_loss_probe+0x4c9/0x830 [11137.072192][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [11137.072195][ C0] tcp_write_timer+0x82/0x1d0 [11137.072199][ C0] call_timer_fn+0x176/0x430 [11137.072203][ C0] ? __pfx_call_timer_fn+0x10/0x10 [11137.072207][ C0] ? next_expiry_recalc+0xcd/0x220 [11137.072211][ C0] __run_timers.part.0+0x52d/0x890 [11137.072215][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [11137.072219][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [11137.072222][ C0] ? lock_acquire+0x1c1/0x220 [11137.072225][ C0] ? clockevents_program_event+0xf6/0x300 [11137.072229][ C0] ? lock_release+0x1d5/0x250 [11137.072232][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11137.072235][ C0] ? ktime_get+0xb6/0x190 [11137.072237][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [11137.072241][ C0] ? clockevents_program_event+0x1ed/0x300 [11137.072246][ C0] run_timer_softirq+0x72/0x100 [11137.072249][ C0] __do_softirq+0x1bc/0x7ff [11137.072254][ C0] irq_exit_rcu+0x98/0xc0 [11137.072258][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [11137.072262][ C0] [11137.072263][ C0] [11137.072264][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11137.072271][ C0] RIP: 0010:default_idle+0xf/0x20 [11137.072275][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11137.072277][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [11137.072280][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [11137.072282][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [11137.072283][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [11137.072285][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [11137.072287][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [11137.072290][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11137.072294][ C0] ? cpuidle_idle_call+0x1f6/0x280 [11137.072297][ C0] default_idle_call+0x69/0xa0 [11137.072299][ C0] cpuidle_idle_call+0x1f6/0x280 [11137.072302][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [11137.072307][ C0] ? lock_release+0x1d5/0x250 [11137.072311][ C0] do_idle+0xfb/0x160 [11137.072314][ C0] cpu_startup_entry+0x55/0x60 [11137.072316][ C0] rest_init+0x153/0x260 [11137.072318][ C0] ? acpi_enable_subsystem+0xac/0x150 [11137.072324][ C0] arch_call_rest_init+0x13/0x40 [11137.072329][ C0] start_kernel+0x314/0x3d0 [11137.072332][ C0] x86_64_start_reservations+0x18/0x30 [11137.072338][ C0] x86_64_start_kernel+0xba/0x110 [11137.072341][ C0] secondary_startup_64_no_verify+0x16d/0x17b [11137.072349][ C0] [11137.072593][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [11137.125247][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11137.125871][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11137.126211][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11137.127203][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [11137.127516][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [11137.127926][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [11137.128333][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [11137.128758][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [11137.129178][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [11137.129599][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11137.130083][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11137.130419][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [11137.130832][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11137.131237][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11137.131640][ C1] Call Trace: [11137.131810][ C1] [11137.131958][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [11137.132239][ C1] ? print_cpu_stall+0x263/0x6a0 [11137.132517][ C1] ? check_cpu_stall+0x284/0x500 [11137.132778][ C1] ? rcu_pending+0x92/0x360 [11137.133020][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [11137.133305][ C1] ? update_process_times+0xb9/0x110 [11137.133583][ C1] ? tick_sched_handle+0x67/0x130 [11137.133858][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [11137.134148][ C1] ? __run_hrtimer+0x1c3/0x710 [11137.134391][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [11137.134710][ C1] ? __hrtimer_run_queues+0x197/0x270 [11137.134984][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11137.135275][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11137.135541][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [11137.135847][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11137.136115][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [11137.136424][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [11137.136723][ C1] [11137.136876][ C1] [11137.137030][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11137.137350][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11137.137663][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11137.137970][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11137.138274][ C1] ? run_ksoftirqd+0xb/0x60 [11137.138520][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11137.138851][ C1] ? __orc_find+0x9c/0xf0 [11137.139076][ C1] ? lock_acquire+0x1c1/0x220 [11137.139317][ C1] ? irqentry_enter+0x2b/0x60 [11137.139558][ C1] do_raw_spin_lock+0x1ec/0x270 [11137.139809][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11137.140086][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11137.140374][ C1] ? lock_acquire+0x1c1/0x220 [11137.140618][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [11137.140864][ C1] _raw_spin_lock_nested+0x65/0x80 [11137.141131][ C1] tcp_v4_rcv+0x2159/0x29b0 [11137.141385][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11137.141641][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11137.141908][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11137.142192][ C1] ip_local_deliver_finish+0x2ae/0x450 [11137.142493][ C1] ip_local_deliver+0x19d/0x480 [11137.142741][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11137.143012][ C1] ? rcu_read_lock_held+0xe/0x50 [11137.143267][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [11137.143536][ C1] ? rcu_read_lock_held+0xe/0x50 [11137.143799][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11137.144121][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11137.144390][ C1] ip_rcv+0x564/0x740 [11137.144602][ C1] ? __pfx_ip_rcv+0x10/0x10 [11137.144838][ C1] ? set_track_prepare+0x8a/0xd0 [11137.145095][ C1] ? irqentry_enter+0x2b/0x60 [11137.145337][ C1] ? irqentry_enter+0x2b/0x60 [11137.145578][ C1] ? __pfx_ip_rcv+0x10/0x10 [11137.145811][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11137.146113][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11137.146442][ C1] ? netif_receive_skb_internal+0x84/0x300 [11137.146739][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11137.147068][ C1] netif_receive_skb_internal+0xb0/0x300 [11137.147356][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11137.147673][ C1] netif_receive_skb+0x55/0x280 [11137.147923][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11137.148236][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11137.148570][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11137.148873][ C1] tcf_action_exec.part.0+0x115/0x3d0 [11137.149149][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11137.149438][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11137.149752][ C1] ? unwind_next_frame+0x1478/0x1d10 [11137.150021][ C1] ? arch_stack_walk+0x68/0x100 [11137.150273][ C1] ? unwind_next_frame+0x1cc/0x1d10 [11137.150542][ C1] ? irqentry_enter+0x2b/0x60 [11137.150787][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11137.151098][ C1] ? irqentry_enter+0x2b/0x60 [11137.151339][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11137.151648][ C1] ? unwind_next_frame+0x1478/0x1d10 [11137.151920][ C1] ? arch_stack_walk+0x68/0x100 [11137.152169][ C1] __tcf_classify+0x32c/0x7d0 [11137.152409][ C1] tcf_classify+0x283/0x930 [11137.152669][ C1] ? __pfx_tcf_classify+0x10/0x10 [11137.152939][ C1] tc_run+0x2e4/0x5d0 [11137.153158][ C1] ? __pfx_tc_run+0x10/0x10 [11137.153404][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [11137.153682][ C1] ? irqentry_enter+0x2b/0x60 [11137.153924][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11137.154200][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11137.154510][ C1] ip_finish_output2+0x786/0x18e0 [11137.154775][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11137.155056][ C1] ? rcu_read_lock_held+0xe/0x50 [11137.155309][ C1] ? __ip_finish_output+0x10f/0x770 [11137.155580][ C1] ip_output+0x16b/0x4f0 [11137.155804][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11137.156114][ C1] ? __pfx_ip_output+0x10/0x10 [11137.156365][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [11137.156705][ C1] ? __pfx_ip_output+0x10/0x10 [11137.156950][ C1] __ip_queue_xmit+0x672/0x1910 [11137.157206][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11137.157480][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11137.157768][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11137.158049][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11137.158339][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11137.158618][ C1] tcp_delack_timer+0x84/0x240 [11137.158868][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11137.159144][ C1] call_timer_fn+0x176/0x430 [11137.159384][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11137.159650][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [11137.159917][ C1] __run_timers.part.0+0x52d/0x890 [11137.160180][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11137.160461][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11137.160754][ C1] ? __pfx___schedule+0x10/0x10 [11137.161003][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11137.161309][ C1] run_timer_softirq+0x72/0x100 [11137.161561][ C1] __do_softirq+0x1bc/0x7ff [11137.161799][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [11137.162071][ C1] run_ksoftirqd+0x2e/0x60 [11137.162299][ C1] smpboot_thread_fn+0x30e/0x840 [11137.162561][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [11137.162846][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [11137.163126][ C1] kthread+0x292/0x360 [11137.163338][ C1] ? __pfx_kthread+0x10/0x10 [11137.163574][ C1] ret_from_fork+0x34/0x70 [11137.163807][ C1] ? __pfx_kthread+0x10/0x10 [11137.164043][ C1] ret_from_fork_asm+0x1b/0x30 [11137.164298][ C1] [11164.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 9291s! [swapper/0:0] [11164.527909][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [11164.529090][ C0] irq event stamp: 27567077 [11164.529333][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [11164.529863][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [11164.530339][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [11164.530824][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [11164.531299][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [11164.531763][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11164.532400][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11164.532728][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11164.533712][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [11164.534022][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [11164.534427][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [11164.534830][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [11164.535233][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [11164.535635][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [11164.536039][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [11164.536496][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11164.536837][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [11164.537251][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11164.537665][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11164.538073][ C0] Call Trace: [11164.538246][ C0] [11164.538400][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [11164.538668][ C0] ? __run_hrtimer+0x1c3/0x710 [11164.538919][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [11164.539201][ C0] ? __hrtimer_run_queues+0x197/0x270 [11164.539480][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [11164.539775][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11164.540049][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [11164.540383][ C0] ? hrtimer_interrupt+0x2c3/0x770 [11164.540655][ C0] ? trace_rcu_dyntick+0x10a/0x150 [11164.540932][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [11164.541256][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [11164.541574][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11164.541900][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [11164.542193][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [11164.542516][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [11164.542817][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11164.543142][ C0] ? get_stack_info+0x36/0xc0 [11164.543398][ C0] ? lock_acquire+0x1c1/0x220 [11164.543660][ C0] ? lock_release+0x1d5/0x250 [11164.543904][ C0] do_raw_spin_lock+0x1ec/0x270 [11164.544159][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [11164.544439][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11164.544732][ C0] ? lock_acquire+0x1c1/0x220 [11164.544974][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [11164.545221][ C0] _raw_spin_lock_nested+0x65/0x80 [11164.545485][ C0] tcp_v4_rcv+0x2159/0x29b0 [11164.545730][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [11164.545984][ C0] ? __pfx_raw_v4_input+0x10/0x10 [11164.546250][ C0] ? __inet_lookup_established+0x341/0x610 [11164.546558][ C0] ip_protocol_deliver_rcu+0x93/0x360 [11164.546837][ C0] ip_local_deliver_finish+0x2ae/0x450 [11164.547117][ C0] ip_local_deliver+0x19d/0x480 [11164.547373][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [11164.547653][ C0] ? rcu_read_lock_held+0xe/0x50 [11164.547913][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [11164.548181][ C0] ? rcu_read_lock_held+0xe/0x50 [11164.548436][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11164.548763][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11164.549030][ C0] ip_rcv+0x564/0x740 [11164.549235][ C0] ? __pfx_ip_rcv+0x10/0x10 [11164.549468][ C0] ? set_track_prepare+0x8a/0xd0 [11164.549724][ C0] ? __pfx_set_track_prepare+0x10/0x10 [11164.550005][ C0] ? rest_init+0x153/0x260 [11164.550234][ C0] ? skb_clone+0x10b/0x330 [11164.550469][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11164.550792][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11164.551102][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [11164.551391][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [11164.551693][ C0] ? __tcf_classify+0x32c/0x7d0 [11164.551946][ C0] ? __pfx_ip_rcv+0x10/0x10 [11164.552182][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [11164.552531][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11164.552827][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11164.553167][ C0] ? lock_acquire+0x1c1/0x220 [11164.553417][ C0] ? netif_receive_skb_internal+0x84/0x300 [11164.553730][ C0] netif_receive_skb_internal+0xb0/0x300 [11164.554020][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11164.554348][ C0] ? __copy_skb_header+0xaf/0x490 [11164.554610][ C0] ? __skb_clone+0x57a/0x760 [11164.554849][ C0] netif_receive_skb+0x55/0x280 [11164.555096][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11164.555409][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11164.555745][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [11164.556053][ C0] tcf_action_exec.part.0+0x115/0x3d0 [11164.556330][ C0] fl_classify+0x4dc/0x650 [cls_flower] [11164.556620][ C0] ? hlock_class+0x4e/0x130 [11164.556855][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11164.557174][ C0] ? place_entity+0x21/0x2f0 [11164.557412][ C0] ? resched_curr+0x219/0x280 [11164.557659][ C0] ? __pfx_resched_curr+0x10/0x10 [11164.557922][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [11164.558198][ C0] ? unwind_next_frame+0x1cc/0x1d10 [11164.558467][ C0] ? wakeup_preempt+0x161/0x2c0 [11164.558716][ C0] ? activate_task+0xf5/0x260 [11164.558958][ C0] ? trace_sched_wakeup+0xd2/0x100 [11164.559245][ C0] ? do_raw_spin_unlock+0x58/0x220 [11164.559520][ C0] ? _raw_spin_unlock+0x23/0x40 [11164.559775][ C0] ? get_stack_info_noinstr+0x18/0x110 [11164.560062][ C0] ? get_stack_info+0x36/0xc0 [11164.560325][ C0] ? stack_access_ok+0xda/0x1f0 [11164.560584][ C0] ? get_reg+0x119/0x190 [11164.560804][ C0] __tcf_classify+0x32c/0x7d0 [11164.561045][ C0] tcf_classify+0x283/0x930 [11164.561277][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11164.561594][ C0] ? __pfx_tcf_classify+0x10/0x10 [11164.561854][ C0] ? arch_stack_walk+0x8c/0x100 [11164.562113][ C0] ? get_stack_info_noinstr+0x18/0x110 [11164.562417][ C0] tc_run+0x2e4/0x5d0 [11164.562633][ C0] ? __pfx_tc_run+0x10/0x10 [11164.562881][ C0] ? lock_acquire+0x1c1/0x220 [11164.563135][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [11164.563410][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [11164.563681][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [11164.563961][ C0] ? ip_finish_output2+0x786/0x18e0 [11164.564232][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [11164.564544][ C0] ? neigh_hh_output+0x348/0x590 [11164.564799][ C0] ? ip_finish_output2+0x262/0x18e0 [11164.565072][ C0] ip_finish_output2+0x786/0x18e0 [11164.565335][ C0] ? stack_depot_save_flags+0x45/0x550 [11164.565620][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11164.565959][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [11164.566238][ C0] ? rcu_read_lock_held+0xe/0x50 [11164.566501][ C0] ? __ip_finish_output+0x10f/0x770 [11164.566770][ C0] ip_output+0x16b/0x4f0 [11164.566990][ C0] ? __run_timers.part.0+0x52d/0x890 [11164.567266][ C0] ? __pfx_ip_output+0x10/0x10 [11164.567510][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11164.567804][ C0] ? rcu_read_lock_held+0xe/0x50 [11164.568060][ C0] ? ip_local_out+0x114/0x3b0 [11164.568306][ C0] __ip_queue_xmit+0x672/0x1910 [11164.568561][ C0] ? __skb_clone+0x57a/0x760 [11164.568806][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [11164.569078][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [11164.569364][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [11164.569674][ C0] tcp_write_xmit+0xe42/0x24c0 [11164.569926][ C0] ? tcp_current_mss+0x40a/0x510 [11164.570180][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [11164.570454][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [11164.570742][ C0] ? mark_lock_irq+0x6e2/0xa10 [11164.570994][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [11164.571263][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [11164.571582][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11164.571860][ C0] ? ktime_get+0xb6/0x190 [11164.572084][ C0] tcp_send_loss_probe+0x4c9/0x830 [11164.572368][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [11164.572645][ C0] tcp_write_timer+0x82/0x1d0 [11164.572898][ C0] call_timer_fn+0x176/0x430 [11164.573146][ C0] ? __pfx_call_timer_fn+0x10/0x10 [11164.573417][ C0] ? next_expiry_recalc+0xcd/0x220 [11164.573697][ C0] __run_timers.part.0+0x52d/0x890 [11164.573959][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [11164.574237][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [11164.574525][ C0] ? lock_acquire+0x1c1/0x220 [11164.574768][ C0] ? clockevents_program_event+0xf6/0x300 [11164.575067][ C0] ? lock_release+0x1d5/0x250 [11164.575312][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11164.575582][ C0] ? ktime_get+0xb6/0x190 [11164.575809][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [11164.576100][ C0] ? clockevents_program_event+0x1ed/0x300 [11164.576399][ C0] run_timer_softirq+0x72/0x100 [11164.576657][ C0] __do_softirq+0x1bc/0x7ff [11164.576896][ C0] irq_exit_rcu+0x98/0xc0 [11164.577125][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [11164.577419][ C0] [11164.577569][ C0] [11164.577719][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11164.578026][ C0] RIP: 0010:default_idle+0xf/0x20 [11164.578290][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11164.579283][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [11164.579599][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [11164.580007][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [11164.580419][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [11164.580828][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [11164.581239][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [11164.581648][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11164.581944][ C0] ? cpuidle_idle_call+0x1f6/0x280 [11164.582211][ C0] default_idle_call+0x69/0xa0 [11164.582480][ C0] cpuidle_idle_call+0x1f6/0x280 [11164.582741][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [11164.583036][ C0] ? lock_release+0x1d5/0x250 [11164.583286][ C0] do_idle+0xfb/0x160 [11164.583499][ C0] cpu_startup_entry+0x55/0x60 [11164.583755][ C0] rest_init+0x153/0x260 [11164.583975][ C0] ? acpi_enable_subsystem+0xac/0x150 [11164.584255][ C0] arch_call_rest_init+0x13/0x40 [11164.584512][ C0] start_kernel+0x314/0x3d0 [11164.584750][ C0] x86_64_start_reservations+0x18/0x30 [11164.585036][ C0] x86_64_start_kernel+0xba/0x110 [11164.585294][ C0] secondary_startup_64_no_verify+0x16d/0x17b [11164.585608][ C0] [11164.585765][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 9291s! [ksoftirqd/1:22] [11164.586205][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [11164.587354][ C1] irq event stamp: 3886976 [11164.587581][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [11164.588066][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [11164.588548][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [11164.589032][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [11164.589527][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [11164.590020][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11164.590667][ C1] RIP: 0010:queued_spin_lock_slowpath+0xc2/0xb90 [11164.590998][ C1] Code: 41 83 e4 07 49 01 c5 41 83 c4 03 be 04 00 00 00 48 89 ef e8 d0 bb 0c fe 41 0f b6 45 00 41 38 c4 7c 08 84 c0 0f 85 42 09 00 00 <8b> 5d 00 85 db 75 62 be 04 00 00 00 48 89 ef e8 da bb 0c fe 89 d8 [11164.591983][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000246 [11164.592297][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [11164.592734][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [11164.593155][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [11164.593587][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [11164.594000][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [11164.594409][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11164.594864][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11164.595201][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [11164.595610][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11164.596015][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11164.596420][ C1] Call Trace: [11164.596591][ C1] [11164.596740][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11164.597010][ C1] ? __run_hrtimer+0x1c3/0x710 [11164.597255][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11164.597539][ C1] ? __hrtimer_run_queues+0x197/0x270 [11164.597814][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11164.598108][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11164.598378][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [11164.598687][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11164.598960][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [11164.599276][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [11164.599576][ C1] [11164.599731][ C1] [11164.599885][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11164.600209][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11164.600501][ C1] ? queued_spin_lock_slowpath+0xc2/0xb90 [11164.600816][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11164.601117][ C1] ? run_ksoftirqd+0xb/0x60 [11164.601358][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11164.601683][ C1] ? __orc_find+0x9c/0xf0 [11164.601915][ C1] ? lock_acquire+0x1c1/0x220 [11164.602171][ C1] ? irqentry_enter+0x2b/0x60 [11164.602428][ C1] do_raw_spin_lock+0x1ec/0x270 [11164.602687][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11164.602971][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11164.603269][ C1] ? lock_acquire+0x1c1/0x220 [11164.603529][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [11164.603775][ C1] _raw_spin_lock_nested+0x65/0x80 [11164.604043][ C1] tcp_v4_rcv+0x2159/0x29b0 [11164.604282][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11164.604532][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11164.604793][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11164.605070][ C1] ip_local_deliver_finish+0x2ae/0x450 [11164.605350][ C1] ip_local_deliver+0x19d/0x480 [11164.605606][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11164.605885][ C1] ? rcu_read_lock_held+0xe/0x50 [11164.606144][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [11164.606417][ C1] ? rcu_read_lock_held+0xe/0x50 [11164.606672][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11164.606999][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11164.607265][ C1] ip_rcv+0x564/0x740 [11164.607470][ C1] ? __pfx_ip_rcv+0x10/0x10 [11164.607703][ C1] ? set_track_prepare+0x8a/0xd0 [11164.607959][ C1] ? irqentry_enter+0x2b/0x60 [11164.608204][ C1] ? irqentry_enter+0x2b/0x60 [11164.608449][ C1] ? __pfx_ip_rcv+0x10/0x10 [11164.608685][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11164.608994][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11164.609328][ C1] ? netif_receive_skb_internal+0x84/0x300 [11164.609628][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11164.609956][ C1] netif_receive_skb_internal+0xb0/0x300 [11164.610247][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11164.610572][ C1] netif_receive_skb+0x55/0x280 [11164.610825][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11164.611148][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11164.611486][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11164.611790][ C1] tcf_action_exec.part.0+0x115/0x3d0 [11164.612074][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11164.612394][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11164.612718][ C1] ? unwind_next_frame+0x1478/0x1d10 [11164.612994][ C1] ? arch_stack_walk+0x68/0x100 [11164.613256][ C1] ? unwind_next_frame+0x1cc/0x1d10 [11164.613535][ C1] ? irqentry_enter+0x2b/0x60 [11164.613790][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11164.614103][ C1] ? irqentry_enter+0x2b/0x60 [11164.614347][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11164.614660][ C1] ? unwind_next_frame+0x1478/0x1d10 [11164.614935][ C1] ? arch_stack_walk+0x68/0x100 [11164.615187][ C1] __tcf_classify+0x32c/0x7d0 [11164.615433][ C1] tcf_classify+0x283/0x930 [11164.615667][ C1] ? __pfx_tcf_classify+0x10/0x10 [11164.615928][ C1] tc_run+0x2e4/0x5d0 [11164.616136][ C1] ? __pfx_tc_run+0x10/0x10 [11164.616372][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [11164.616635][ C1] ? irqentry_enter+0x2b/0x60 [11164.616879][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11164.617157][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11164.617474][ C1] ip_finish_output2+0x786/0x18e0 [11164.617734][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11164.618014][ C1] ? rcu_read_lock_held+0xe/0x50 [11164.618275][ C1] ? __ip_finish_output+0x10f/0x770 [11164.618544][ C1] ip_output+0x16b/0x4f0 [11164.618764][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11164.619079][ C1] ? __pfx_ip_output+0x10/0x10 [11164.619344][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [11164.619700][ C1] ? __pfx_ip_output+0x10/0x10 [11164.619960][ C1] __ip_queue_xmit+0x672/0x1910 [11164.620221][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11164.620502][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11164.620798][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11164.621076][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11164.621362][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11164.621637][ C1] tcp_delack_timer+0x84/0x240 [11164.621883][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11164.622167][ C1] call_timer_fn+0x176/0x430 [11164.622431][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11164.622707][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [11164.622983][ C1] __run_timers.part.0+0x52d/0x890 [11164.623254][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11164.623552][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11164.623845][ C1] ? __pfx___schedule+0x10/0x10 [11164.624098][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11164.624405][ C1] run_timer_softirq+0x72/0x100 [11164.624658][ C1] __do_softirq+0x1bc/0x7ff [11164.624897][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [11164.625165][ C1] run_ksoftirqd+0x2e/0x60 [11164.625396][ C1] smpboot_thread_fn+0x30e/0x840 [11164.625658][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [11164.625940][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [11164.626224][ C1] kthread+0x292/0x360 [11164.626435][ C1] ? __pfx_kthread+0x10/0x10 [11164.626675][ C1] ret_from_fork+0x34/0x70 [11164.626905][ C1] ? __pfx_kthread+0x10/0x10 [11164.627147][ C1] ret_from_fork_asm+0x1b/0x30 [11164.627398][ C1] [11192.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 9317s! [swapper/0:0] [11192.527911][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [11192.529068][ C0] irq event stamp: 27567077 [11192.529302][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [11192.529814][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [11192.530282][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [11192.530774][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [11192.531277][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [11192.531756][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11192.532404][ C0] RIP: 0010:__kasan_check_read+0x0/0x20 [11192.532694][ C0] Code: 48 c7 c7 48 56 98 91 5b 5d 41 5c e9 8a de 9b ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [11192.533687][ C0] RSP: 0018:ffffc900000069d0 EFLAGS: 00000202 [11192.534001][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [11192.534411][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [11192.534821][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [11192.535228][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [11192.535634][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [11192.536044][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [11192.536504][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11192.536838][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [11192.537253][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11192.537662][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11192.538067][ C0] Call Trace: [11192.538239][ C0] [11192.538391][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [11192.538662][ C0] ? __run_hrtimer+0x1c3/0x710 [11192.538911][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [11192.539196][ C0] ? __hrtimer_run_queues+0x197/0x270 [11192.539473][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [11192.539765][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11192.540032][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [11192.540346][ C0] ? hrtimer_interrupt+0x2c3/0x770 [11192.540615][ C0] ? trace_rcu_dyntick+0x10a/0x150 [11192.540881][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [11192.541202][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [11192.541505][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11192.541824][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [11192.542125][ C0] ? __pfx___kasan_check_read+0x10/0x10 [11192.542415][ C0] queued_spin_lock_slowpath+0xb0/0xb90 [11192.542700][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11192.543017][ C0] ? get_stack_info+0x36/0xc0 [11192.543269][ C0] ? lock_acquire+0x1c1/0x220 [11192.543518][ C0] ? lock_release+0x1d5/0x250 [11192.543765][ C0] do_raw_spin_lock+0x1ec/0x270 [11192.544019][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [11192.544298][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11192.544587][ C0] ? lock_acquire+0x1c1/0x220 [11192.544825][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [11192.545072][ C0] _raw_spin_lock_nested+0x65/0x80 [11192.545335][ C0] tcp_v4_rcv+0x2159/0x29b0 [11192.545577][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [11192.545830][ C0] ? __pfx_raw_v4_input+0x10/0x10 [11192.546094][ C0] ? __inet_lookup_established+0x341/0x610 [11192.546400][ C0] ip_protocol_deliver_rcu+0x93/0x360 [11192.546684][ C0] ip_local_deliver_finish+0x2ae/0x450 [11192.546965][ C0] ip_local_deliver+0x19d/0x480 [11192.547217][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [11192.547493][ C0] ? rcu_read_lock_held+0xe/0x50 [11192.547754][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [11192.548021][ C0] ? rcu_read_lock_held+0xe/0x50 [11192.548276][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11192.548602][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11192.548868][ C0] ip_rcv+0x564/0x740 [11192.549075][ C0] ? __pfx_ip_rcv+0x10/0x10 [11192.549307][ C0] ? set_track_prepare+0x8a/0xd0 [11192.549564][ C0] ? __pfx_set_track_prepare+0x10/0x10 [11192.549846][ C0] ? rest_init+0x153/0x260 [11192.550076][ C0] ? skb_clone+0x10b/0x330 [11192.550311][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11192.550634][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11192.550967][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [11192.551266][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [11192.551574][ C0] ? __tcf_classify+0x32c/0x7d0 [11192.551837][ C0] ? __pfx_ip_rcv+0x10/0x10 [11192.552087][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [11192.552416][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11192.552711][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11192.553051][ C0] ? lock_acquire+0x1c1/0x220 [11192.553302][ C0] ? netif_receive_skb_internal+0x84/0x300 [11192.553617][ C0] netif_receive_skb_internal+0xb0/0x300 [11192.553903][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11192.554226][ C0] ? __copy_skb_header+0xaf/0x490 [11192.554488][ C0] ? __skb_clone+0x57a/0x760 [11192.554729][ C0] netif_receive_skb+0x55/0x280 [11192.554978][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11192.555295][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11192.555630][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [11192.555935][ C0] tcf_action_exec.part.0+0x115/0x3d0 [11192.556212][ C0] fl_classify+0x4dc/0x650 [cls_flower] [11192.556501][ C0] ? hlock_class+0x4e/0x130 [11192.556735][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11192.557051][ C0] ? place_entity+0x21/0x2f0 [11192.557287][ C0] ? resched_curr+0x219/0x280 [11192.557533][ C0] ? __pfx_resched_curr+0x10/0x10 [11192.557794][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [11192.558070][ C0] ? unwind_next_frame+0x1cc/0x1d10 [11192.558337][ C0] ? wakeup_preempt+0x161/0x2c0 [11192.558584][ C0] ? activate_task+0xf5/0x260 [11192.558823][ C0] ? trace_sched_wakeup+0xd2/0x100 [11192.559087][ C0] ? do_raw_spin_unlock+0x58/0x220 [11192.559353][ C0] ? _raw_spin_unlock+0x23/0x40 [11192.559604][ C0] ? get_stack_info_noinstr+0x18/0x110 [11192.559888][ C0] ? get_stack_info+0x36/0xc0 [11192.560135][ C0] ? stack_access_ok+0xda/0x1f0 [11192.560385][ C0] ? get_reg+0x119/0x190 [11192.560608][ C0] __tcf_classify+0x32c/0x7d0 [11192.560852][ C0] tcf_classify+0x283/0x930 [11192.561088][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11192.561425][ C0] ? __pfx_tcf_classify+0x10/0x10 [11192.561695][ C0] ? arch_stack_walk+0x8c/0x100 [11192.561957][ C0] ? get_stack_info_noinstr+0x18/0x110 [11192.562251][ C0] tc_run+0x2e4/0x5d0 [11192.562479][ C0] ? __pfx_tc_run+0x10/0x10 [11192.562716][ C0] ? lock_acquire+0x1c1/0x220 [11192.562958][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [11192.563227][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [11192.563483][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [11192.563761][ C0] ? ip_finish_output2+0x786/0x18e0 [11192.564032][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [11192.564346][ C0] ? neigh_hh_output+0x348/0x590 [11192.564601][ C0] ? ip_finish_output2+0x262/0x18e0 [11192.564871][ C0] ip_finish_output2+0x786/0x18e0 [11192.565133][ C0] ? stack_depot_save_flags+0x45/0x550 [11192.565417][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11192.565756][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [11192.566036][ C0] ? rcu_read_lock_held+0xe/0x50 [11192.566297][ C0] ? __ip_finish_output+0x10f/0x770 [11192.566563][ C0] ip_output+0x16b/0x4f0 [11192.566782][ C0] ? __run_timers.part.0+0x52d/0x890 [11192.567059][ C0] ? __pfx_ip_output+0x10/0x10 [11192.567306][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11192.567597][ C0] ? rcu_read_lock_held+0xe/0x50 [11192.567849][ C0] ? ip_local_out+0x114/0x3b0 [11192.568097][ C0] __ip_queue_xmit+0x672/0x1910 [11192.568362][ C0] ? __skb_clone+0x57a/0x760 [11192.568604][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [11192.568882][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [11192.569168][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [11192.569474][ C0] tcp_write_xmit+0xe42/0x24c0 [11192.569723][ C0] ? tcp_current_mss+0x40a/0x510 [11192.569977][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [11192.570253][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [11192.570518][ C0] ? mark_lock_irq+0x6e2/0xa10 [11192.570762][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [11192.571025][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [11192.571337][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11192.571602][ C0] ? ktime_get+0xb6/0x190 [11192.571824][ C0] tcp_send_loss_probe+0x4c9/0x830 [11192.572089][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [11192.572385][ C0] tcp_write_timer+0x82/0x1d0 [11192.572639][ C0] call_timer_fn+0x176/0x430 [11192.572886][ C0] ? __pfx_call_timer_fn+0x10/0x10 [11192.573158][ C0] ? next_expiry_recalc+0xcd/0x220 [11192.573442][ C0] __run_timers.part.0+0x52d/0x890 [11192.573704][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [11192.573980][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [11192.574268][ C0] ? lock_acquire+0x1c1/0x220 [11192.574512][ C0] ? clockevents_program_event+0xf6/0x300 [11192.574812][ C0] ? lock_release+0x1d5/0x250 [11192.575056][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11192.575327][ C0] ? ktime_get+0xb6/0x190 [11192.575552][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [11192.575844][ C0] ? clockevents_program_event+0x1ed/0x300 [11192.576143][ C0] run_timer_softirq+0x72/0x100 [11192.576396][ C0] __do_softirq+0x1bc/0x7ff [11192.576634][ C0] irq_exit_rcu+0x98/0xc0 [11192.576861][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [11192.577152][ C0] [11192.577302][ C0] [11192.577453][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11192.577758][ C0] RIP: 0010:default_idle+0xf/0x20 [11192.578021][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11192.579012][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [11192.579326][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [11192.579735][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [11192.580146][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [11192.580551][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [11192.580976][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [11192.581401][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11192.581708][ C0] ? cpuidle_idle_call+0x1f6/0x280 [11192.581982][ C0] default_idle_call+0x69/0xa0 [11192.582264][ C0] cpuidle_idle_call+0x1f6/0x280 [11192.582525][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [11192.582817][ C0] ? lock_release+0x1d5/0x250 [11192.583065][ C0] do_idle+0xfb/0x160 [11192.583275][ C0] cpu_startup_entry+0x55/0x60 [11192.583533][ C0] rest_init+0x153/0x260 [11192.583756][ C0] ? acpi_enable_subsystem+0xac/0x150 [11192.584034][ C0] arch_call_rest_init+0x13/0x40 [11192.584290][ C0] start_kernel+0x314/0x3d0 [11192.584528][ C0] x86_64_start_reservations+0x18/0x30 [11192.584811][ C0] x86_64_start_kernel+0xba/0x110 [11192.585070][ C0] secondary_startup_64_no_verify+0x16d/0x17b [11192.585388][ C0] [11192.585548][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 9317s! [ksoftirqd/1:22] [11192.585992][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [11192.587141][ C1] irq event stamp: 3886976 [11192.587368][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [11192.587848][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [11192.588328][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [11192.588810][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [11192.589280][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [11192.589759][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11192.590387][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11192.590717][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11192.591730][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [11192.592057][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [11192.592480][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [11192.592895][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [11192.593298][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [11192.593704][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [11192.594107][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11192.594556][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11192.594898][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [11192.595305][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11192.595712][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11192.596120][ C1] Call Trace: [11192.596295][ C1] [11192.596447][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11192.596709][ C1] ? __run_hrtimer+0x1c3/0x710 [11192.596958][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11192.597237][ C1] ? __hrtimer_run_queues+0x197/0x270 [11192.597516][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11192.597812][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11192.598084][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [11192.598400][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11192.598666][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [11192.598980][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [11192.599287][ C1] [11192.599438][ C1] [11192.599589][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11192.599908][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11192.600204][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11192.600508][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11192.600800][ C1] ? run_ksoftirqd+0xb/0x60 [11192.601036][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11192.601354][ C1] ? __orc_find+0x9c/0xf0 [11192.601578][ C1] ? lock_acquire+0x1c1/0x220 [11192.601825][ C1] ? irqentry_enter+0x2b/0x60 [11192.602073][ C1] do_raw_spin_lock+0x1ec/0x270 [11192.602351][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11192.602634][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11192.602931][ C1] ? lock_acquire+0x1c1/0x220 [11192.603182][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [11192.603443][ C1] _raw_spin_lock_nested+0x65/0x80 [11192.603709][ C1] tcp_v4_rcv+0x2159/0x29b0 [11192.603945][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11192.604196][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11192.604456][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11192.604732][ C1] ip_local_deliver_finish+0x2ae/0x450 [11192.605010][ C1] ip_local_deliver+0x19d/0x480 [11192.605263][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11192.605542][ C1] ? rcu_read_lock_held+0xe/0x50 [11192.605801][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [11192.606070][ C1] ? rcu_read_lock_held+0xe/0x50 [11192.606324][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11192.606652][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11192.606918][ C1] ip_rcv+0x564/0x740 [11192.607126][ C1] ? __pfx_ip_rcv+0x10/0x10 [11192.607360][ C1] ? set_track_prepare+0x8a/0xd0 [11192.607615][ C1] ? irqentry_enter+0x2b/0x60 [11192.607859][ C1] ? irqentry_enter+0x2b/0x60 [11192.608105][ C1] ? __pfx_ip_rcv+0x10/0x10 [11192.608341][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11192.608646][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11192.608977][ C1] ? netif_receive_skb_internal+0x84/0x300 [11192.609279][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11192.609605][ C1] netif_receive_skb_internal+0xb0/0x300 [11192.609891][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11192.610216][ C1] netif_receive_skb+0x55/0x280 [11192.610471][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11192.610790][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11192.611149][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11192.611459][ C1] tcf_action_exec.part.0+0x115/0x3d0 [11192.611747][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11192.612050][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11192.612388][ C1] ? unwind_next_frame+0x1478/0x1d10 [11192.612658][ C1] ? arch_stack_walk+0x68/0x100 [11192.612914][ C1] ? unwind_next_frame+0x1cc/0x1d10 [11192.613185][ C1] ? irqentry_enter+0x2b/0x60 [11192.613431][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11192.613744][ C1] ? irqentry_enter+0x2b/0x60 [11192.613988][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11192.614300][ C1] ? unwind_next_frame+0x1478/0x1d10 [11192.614573][ C1] ? arch_stack_walk+0x68/0x100 [11192.614823][ C1] __tcf_classify+0x32c/0x7d0 [11192.615066][ C1] tcf_classify+0x283/0x930 [11192.615300][ C1] ? __pfx_tcf_classify+0x10/0x10 [11192.615560][ C1] tc_run+0x2e4/0x5d0 [11192.615769][ C1] ? __pfx_tc_run+0x10/0x10 [11192.616006][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [11192.616264][ C1] ? irqentry_enter+0x2b/0x60 [11192.616510][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11192.616788][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11192.617109][ C1] ip_finish_output2+0x786/0x18e0 [11192.617370][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11192.617648][ C1] ? rcu_read_lock_held+0xe/0x50 [11192.617906][ C1] ? __ip_finish_output+0x10f/0x770 [11192.618175][ C1] ip_output+0x16b/0x4f0 [11192.618394][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11192.618727][ C1] ? __pfx_ip_output+0x10/0x10 [11192.618982][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [11192.619333][ C1] ? __pfx_ip_output+0x10/0x10 [11192.619589][ C1] __ip_queue_xmit+0x672/0x1910 [11192.619848][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11192.620126][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11192.620418][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11192.620701][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11192.620994][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11192.621278][ C1] tcp_delack_timer+0x84/0x240 [11192.621531][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11192.621816][ C1] call_timer_fn+0x176/0x430 [11192.622065][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11192.622342][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [11192.622616][ C1] __run_timers.part.0+0x52d/0x890 [11192.622887][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11192.623180][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11192.623481][ C1] ? __pfx___schedule+0x10/0x10 [11192.623737][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11192.624053][ C1] run_timer_softirq+0x72/0x100 [11192.624313][ C1] __do_softirq+0x1bc/0x7ff [11192.624556][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [11192.624831][ C1] run_ksoftirqd+0x2e/0x60 [11192.625067][ C1] smpboot_thread_fn+0x30e/0x840 [11192.625334][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [11192.625623][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [11192.625913][ C1] kthread+0x292/0x360 [11192.626128][ C1] ? __pfx_kthread+0x10/0x10 [11192.626374][ C1] ret_from_fork+0x34/0x70 [11192.626611][ C1] ? __pfx_kthread+0x10/0x10 [11192.626858][ C1] ret_from_fork_asm+0x1b/0x30 [11192.627117][ C1] [11215.163024][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [11215.163420][ C1] rcu: 1-....: (9946566 ticks this GP) idle=0744/1/0x4000000000000000 softirq=347217/347220 fqs=2376014 [11215.164006][ C1] rcu: (t=10020854 jiffies g=1007429 q=31 ncpus=4) [11215.164358][ C1] Sending NMI from CPU 1 to CPUs 0: [11215.164648][ C0] NMI backtrace for cpu 0 [11215.164654][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [11215.164658][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11215.164661][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11215.164673][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11215.164676][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [11215.164680][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [11215.164682][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [11215.164684][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [11215.164685][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [11215.164688][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [11215.164690][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [11215.164692][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11215.164696][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [11215.164698][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11215.164699][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11215.164701][ C0] Call Trace: [11215.164704][ C0] [11215.164708][ C0] ? nmi_cpu_backtrace+0x112/0x220 [11215.164714][ C0] ? nmi_cpu_backtrace_handler+0x11/0x20 [11215.164721][ C0] ? nmi_handle+0x156/0x420 [11215.164726][ C0] ? default_do_nmi+0x41/0x100 [11215.164731][ C0] ? exc_nmi+0xf3/0x120 [11215.164734][ C0] ? end_repeat_nmi+0xf/0x60 [11215.164738][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [11215.164742][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [11215.164746][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [11215.164750][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [11215.164753][ C0] [11215.164754][ C0] [11215.164755][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11215.164758][ C0] ? get_stack_info+0x36/0xc0 [11215.164763][ C0] ? lock_acquire+0x1c1/0x220 [11215.164768][ C0] ? lock_release+0x1d5/0x250 [11215.164772][ C0] do_raw_spin_lock+0x1ec/0x270 [11215.164776][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [11215.164779][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11215.164782][ C0] ? lock_acquire+0x1c1/0x220 [11215.164784][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [11215.164790][ C0] _raw_spin_lock_nested+0x65/0x80 [11215.164794][ C0] tcp_v4_rcv+0x2159/0x29b0 [11215.164801][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [11215.164804][ C0] ? __pfx_raw_v4_input+0x10/0x10 [11215.164808][ C0] ? __inet_lookup_established+0x341/0x610 [11215.164815][ C0] ip_protocol_deliver_rcu+0x93/0x360 [11215.164823][ C0] ip_local_deliver_finish+0x2ae/0x450 [11215.164827][ C0] ip_local_deliver+0x19d/0x480 [11215.164831][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [11215.164833][ C0] ? rcu_read_lock_held+0xe/0x50 [11215.164840][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [11215.164844][ C0] ? rcu_read_lock_held+0xe/0x50 [11215.164847][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11215.164851][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11215.164862][ C0] ip_rcv+0x564/0x740 [11215.164865][ C0] ? __pfx_ip_rcv+0x10/0x10 [11215.164868][ C0] ? set_track_prepare+0x8a/0xd0 [11215.164873][ C0] ? __pfx_set_track_prepare+0x10/0x10 [11215.164876][ C0] ? rest_init+0x153/0x260 [11215.164879][ C0] ? skb_clone+0x10b/0x330 [11215.164885][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11215.164893][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11215.164899][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [11215.164904][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [11215.164914][ C0] ? __tcf_classify+0x32c/0x7d0 [11215.164918][ C0] ? __pfx_ip_rcv+0x10/0x10 [11215.164921][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [11215.164925][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11215.164928][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11215.164931][ C0] ? lock_acquire+0x1c1/0x220 [11215.164934][ C0] ? netif_receive_skb_internal+0x84/0x300 [11215.164937][ C0] netif_receive_skb_internal+0xb0/0x300 [11215.164940][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11215.164943][ C0] ? __copy_skb_header+0xaf/0x490 [11215.164946][ C0] ? __skb_clone+0x57a/0x760 [11215.164949][ C0] netif_receive_skb+0x55/0x280 [11215.164951][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11215.164959][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11215.164966][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [11215.164973][ C0] tcf_action_exec.part.0+0x115/0x3d0 [11215.164978][ C0] fl_classify+0x4dc/0x650 [cls_flower] [11215.164987][ C0] ? hlock_class+0x4e/0x130 [11215.164994][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11215.165004][ C0] ? place_entity+0x21/0x2f0 [11215.165007][ C0] ? resched_curr+0x219/0x280 [11215.165011][ C0] ? __pfx_resched_curr+0x10/0x10 [11215.165014][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [11215.165018][ C0] ? unwind_next_frame+0x1cc/0x1d10 [11215.165025][ C0] ? wakeup_preempt+0x161/0x2c0 [11215.165027][ C0] ? activate_task+0xf5/0x260 [11215.165031][ C0] ? trace_sched_wakeup+0xd2/0x100 [11215.165036][ C0] ? do_raw_spin_unlock+0x58/0x220 [11215.165040][ C0] ? _raw_spin_unlock+0x23/0x40 [11215.165043][ C0] ? get_stack_info_noinstr+0x18/0x110 [11215.165046][ C0] ? get_stack_info+0x36/0xc0 [11215.165050][ C0] ? stack_access_ok+0xda/0x1f0 [11215.165052][ C0] ? get_reg+0x119/0x190 [11215.165056][ C0] __tcf_classify+0x32c/0x7d0 [11215.165060][ C0] tcf_classify+0x283/0x930 [11215.165064][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11215.165069][ C0] ? __pfx_tcf_classify+0x10/0x10 [11215.165071][ C0] ? arch_stack_walk+0x8c/0x100 [11215.165077][ C0] ? get_stack_info_noinstr+0x18/0x110 [11215.165080][ C0] tc_run+0x2e4/0x5d0 [11215.165085][ C0] ? __pfx_tc_run+0x10/0x10 [11215.165088][ C0] ? lock_acquire+0x1c1/0x220 [11215.165091][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [11215.165095][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [11215.165101][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [11215.165104][ C0] ? ip_finish_output2+0x786/0x18e0 [11215.165108][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [11215.165114][ C0] ? neigh_hh_output+0x348/0x590 [11215.165118][ C0] ? ip_finish_output2+0x262/0x18e0 [11215.165122][ C0] ip_finish_output2+0x786/0x18e0 [11215.165126][ C0] ? stack_depot_save_flags+0x45/0x550 [11215.165133][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11215.165140][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [11215.165144][ C0] ? rcu_read_lock_held+0xe/0x50 [11215.165148][ C0] ? __ip_finish_output+0x10f/0x770 [11215.165152][ C0] ip_output+0x16b/0x4f0 [11215.165155][ C0] ? __run_timers.part.0+0x52d/0x890 [11215.165160][ C0] ? __pfx_ip_output+0x10/0x10 [11215.165163][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11215.165168][ C0] ? rcu_read_lock_held+0xe/0x50 [11215.165171][ C0] ? ip_local_out+0x114/0x3b0 [11215.165175][ C0] __ip_queue_xmit+0x672/0x1910 [11215.165180][ C0] ? __skb_clone+0x57a/0x760 [11215.165183][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [11215.165190][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [11215.165195][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [11215.165198][ C0] tcp_write_xmit+0xe42/0x24c0 [11215.165204][ C0] ? tcp_current_mss+0x40a/0x510 [11215.165206][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [11215.165209][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [11215.165212][ C0] ? mark_lock_irq+0x6e2/0xa10 [11215.165214][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [11215.165217][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [11215.165221][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11215.165226][ C0] ? ktime_get+0xb6/0x190 [11215.165230][ C0] tcp_send_loss_probe+0x4c9/0x830 [11215.165234][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [11215.165238][ C0] tcp_write_timer+0x82/0x1d0 [11215.165242][ C0] call_timer_fn+0x176/0x430 [11215.165245][ C0] ? __pfx_call_timer_fn+0x10/0x10 [11215.165250][ C0] ? next_expiry_recalc+0xcd/0x220 [11215.165254][ C0] __run_timers.part.0+0x52d/0x890 [11215.165257][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [11215.165262][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [11215.165265][ C0] ? lock_acquire+0x1c1/0x220 [11215.165267][ C0] ? clockevents_program_event+0xf6/0x300 [11215.165272][ C0] ? lock_release+0x1d5/0x250 [11215.165275][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11215.165277][ C0] ? ktime_get+0xb6/0x190 [11215.165280][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [11215.165284][ C0] ? clockevents_program_event+0x1ed/0x300 [11215.165288][ C0] run_timer_softirq+0x72/0x100 [11215.165292][ C0] __do_softirq+0x1bc/0x7ff [11215.165296][ C0] irq_exit_rcu+0x98/0xc0 [11215.165299][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [11215.165303][ C0] [11215.165304][ C0] [11215.165305][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11215.165311][ C0] RIP: 0010:default_idle+0xf/0x20 [11215.165315][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11215.165317][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [11215.165319][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [11215.165320][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [11215.165322][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [11215.165323][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [11215.165325][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [11215.165328][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11215.165332][ C0] ? cpuidle_idle_call+0x1f6/0x280 [11215.165336][ C0] default_idle_call+0x69/0xa0 [11215.165339][ C0] cpuidle_idle_call+0x1f6/0x280 [11215.165341][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [11215.165347][ C0] ? lock_release+0x1d5/0x250 [11215.165351][ C0] do_idle+0xfb/0x160 [11215.165353][ C0] cpu_startup_entry+0x55/0x60 [11215.165356][ C0] rest_init+0x153/0x260 [11215.165359][ C0] ? acpi_enable_subsystem+0xac/0x150 [11215.165365][ C0] arch_call_rest_init+0x13/0x40 [11215.165370][ C0] start_kernel+0x314/0x3d0 [11215.165374][ C0] x86_64_start_reservations+0x18/0x30 [11215.165379][ C0] x86_64_start_kernel+0xba/0x110 [11215.165383][ C0] secondary_startup_64_no_verify+0x16d/0x17b [11215.165391][ C0] [11215.165644][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [11215.219334][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11215.219979][ C1] RIP: 0010:kasan_check_range+0x12/0x1c0 [11215.220281][ C1] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [11215.221302][ C1] RSP: 0018:ffffc9000019e9d8 EFLAGS: 00000202 [11215.221628][ C1] RAX: ffff88800a098e18 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [11215.222048][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a098e18 [11215.222469][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [11215.222885][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [11215.223304][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [11215.223720][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11215.224184][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11215.224534][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [11215.224949][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11215.225367][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11215.225788][ C1] Call Trace: [11215.225972][ C1] [11215.226127][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [11215.226411][ C1] ? print_cpu_stall+0x263/0x6a0 [11215.226678][ C1] ? check_cpu_stall+0x284/0x500 [11215.226938][ C1] ? rcu_pending+0x92/0x360 [11215.227181][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [11215.227465][ C1] ? update_process_times+0xb9/0x110 [11215.227746][ C1] ? tick_sched_handle+0x67/0x130 [11215.228016][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [11215.228316][ C1] ? __run_hrtimer+0x1c3/0x710 [11215.228569][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [11215.228897][ C1] ? __hrtimer_run_queues+0x197/0x270 [11215.229181][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11215.229481][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11215.229755][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [11215.230071][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11215.230348][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [11215.230669][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [11215.230975][ C1] [11215.231133][ C1] [11215.231293][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11215.231623][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11215.231924][ C1] ? kasan_check_range+0x12/0x1c0 [11215.232195][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [11215.232489][ C1] ? run_ksoftirqd+0xb/0x60 [11215.232735][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11215.233064][ C1] ? __orc_find+0x9c/0xf0 [11215.233292][ C1] ? lock_acquire+0x1c1/0x220 [11215.233541][ C1] ? irqentry_enter+0x2b/0x60 [11215.233796][ C1] do_raw_spin_lock+0x1ec/0x270 [11215.234059][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11215.234342][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11215.234638][ C1] ? lock_acquire+0x1c1/0x220 [11215.234888][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [11215.235143][ C1] _raw_spin_lock_nested+0x65/0x80 [11215.235417][ C1] tcp_v4_rcv+0x2159/0x29b0 [11215.235663][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11215.235920][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11215.236187][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11215.236471][ C1] ip_local_deliver_finish+0x2ae/0x450 [11215.236757][ C1] ip_local_deliver+0x19d/0x480 [11215.237020][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11215.237308][ C1] ? rcu_read_lock_held+0xe/0x50 [11215.237573][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [11215.237848][ C1] ? rcu_read_lock_held+0xe/0x50 [11215.238109][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11215.238445][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11215.238716][ C1] ip_rcv+0x564/0x740 [11215.238927][ C1] ? __pfx_ip_rcv+0x10/0x10 [11215.239166][ C1] ? set_track_prepare+0x8a/0xd0 [11215.239427][ C1] ? irqentry_enter+0x2b/0x60 [11215.239677][ C1] ? irqentry_enter+0x2b/0x60 [11215.239929][ C1] ? __pfx_ip_rcv+0x10/0x10 [11215.240172][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11215.240490][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11215.240832][ C1] ? netif_receive_skb_internal+0x84/0x300 [11215.241140][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11215.241476][ C1] netif_receive_skb_internal+0xb0/0x300 [11215.241773][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11215.242111][ C1] netif_receive_skb+0x55/0x280 [11215.242369][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11215.242693][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11215.243038][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11215.243351][ C1] tcf_action_exec.part.0+0x115/0x3d0 [11215.243636][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11215.243936][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11215.244261][ C1] ? unwind_next_frame+0x1478/0x1d10 [11215.244539][ C1] ? arch_stack_walk+0x68/0x100 [11215.244800][ C1] ? unwind_next_frame+0x1cc/0x1d10 [11215.245078][ C1] ? irqentry_enter+0x2b/0x60 [11215.245329][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11215.245649][ C1] ? irqentry_enter+0x2b/0x60 [11215.245899][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11215.246219][ C1] ? unwind_next_frame+0x1478/0x1d10 [11215.246499][ C1] ? arch_stack_walk+0x68/0x100 [11215.246757][ C1] __tcf_classify+0x32c/0x7d0 [11215.247007][ C1] tcf_classify+0x283/0x930 [11215.247248][ C1] ? __pfx_tcf_classify+0x10/0x10 [11215.247514][ C1] tc_run+0x2e4/0x5d0 [11215.247731][ C1] ? __pfx_tc_run+0x10/0x10 [11215.247972][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [11215.248236][ C1] ? irqentry_enter+0x2b/0x60 [11215.248488][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11215.248774][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11215.249098][ C1] ip_finish_output2+0x786/0x18e0 [11215.249366][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11215.249652][ C1] ? rcu_read_lock_held+0xe/0x50 [11215.249919][ C1] ? __ip_finish_output+0x10f/0x770 [11215.250196][ C1] ip_output+0x16b/0x4f0 [11215.250421][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11215.250746][ C1] ? __pfx_ip_output+0x10/0x10 [11215.251001][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [11215.251355][ C1] ? __pfx_ip_output+0x10/0x10 [11215.251614][ C1] __ip_queue_xmit+0x672/0x1910 [11215.251874][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11215.252158][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11215.252457][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11215.252746][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11215.253043][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11215.253334][ C1] tcp_delack_timer+0x84/0x240 [11215.253590][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11215.253871][ C1] call_timer_fn+0x176/0x430 [11215.254115][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11215.254391][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [11215.254665][ C1] __run_timers.part.0+0x52d/0x890 [11215.254934][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11215.255223][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11215.255521][ C1] ? __pfx___schedule+0x10/0x10 [11215.255779][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11215.256095][ C1] run_timer_softirq+0x72/0x100 [11215.256356][ C1] __do_softirq+0x1bc/0x7ff [11215.256600][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [11215.256874][ C1] run_ksoftirqd+0x2e/0x60 [11215.257111][ C1] smpboot_thread_fn+0x30e/0x840 [11215.257379][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [11215.257668][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [11215.257957][ C1] kthread+0x292/0x360 [11215.258172][ C1] ? __pfx_kthread+0x10/0x10 [11215.258419][ C1] ret_from_fork+0x34/0x70 [11215.258653][ C1] ? __pfx_kthread+0x10/0x10 [11215.258900][ C1] ret_from_fork_asm+0x1b/0x30 [11215.259157][ C1] WAIT TIMEOUT stdout Ctrl-C stdout Ctrl-C stdout ^C[11240.527460][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 9362s! [swapper/0:0] [11240.527904][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [11240.529101][ C0] irq event stamp: 27567077 [11240.529341][ C0] hardirqs last enabled at (27567077): [] cpuidle_idle_call+0x1f6/0x280 [11240.529866][ C0] hardirqs last disabled at (27567076): [] do_idle+0xeb/0x160 [11240.530344][ C0] softirqs last enabled at (27567072): [] __do_softirq+0x519/0x7ff [11240.530835][ C0] softirqs last disabled at (27567065): [] irq_exit_rcu+0x98/0xc0 [11240.531317][ C0] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G L 6.8.0-rc2-virtme #1 [11240.531786][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11240.532413][ C0] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11240.532747][ C0] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11240.533743][ C0] RSP: 0018:ffffc900000069d8 EFLAGS: 00000202 [11240.534058][ C0] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [11240.534468][ C0] RDX: ffffed100141336c RSI: 0000000000000004 RDI: ffff88800a099b58 [11240.534880][ C0] RBP: ffff88800a099b58 R08: 0000000000000000 R09: ffffed100141336b [11240.535287][ C0] R10: ffff88800a099b5b R11: 0000008000000000 R12: 0000000000000003 [11240.535694][ C0] R13: ffffed100141336b R14: 0000000000000001 R15: 1ffff92000000d3c [11240.536105][ C0] FS: 0000000000000000(0000) GS:ffff888035200000(0000) knlGS:0000000000000000 [11240.536565][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11240.536900][ C0] CR2: 0000561149a581b0 CR3: 0000000009b94006 CR4: 00000000001706f0 [11240.537313][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11240.537721][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11240.538129][ C0] Call Trace: [11240.538300][ C0] [11240.538450][ C0] ? watchdog_timer_fn+0x2cf/0x3c0 [11240.538721][ C0] ? __run_hrtimer+0x1c3/0x710 [11240.538970][ C0] ? __pfx_watchdog_timer_fn+0x10/0x10 [11240.539256][ C0] ? __hrtimer_run_queues+0x197/0x270 [11240.539533][ C0] ? __pfx___hrtimer_run_queues+0x10/0x10 [11240.539824][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11240.540096][ C0] ? ktime_get_update_offsets_now+0xe4/0x2d0 [11240.540409][ C0] ? hrtimer_interrupt+0x2c3/0x770 [11240.540675][ C0] ? trace_rcu_dyntick+0x10a/0x150 [11240.540942][ C0] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [11240.541262][ C0] ? sysvec_apic_timer_interrupt+0x39/0x80 [11240.541565][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11240.541886][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [11240.542207][ C0] ? queued_spin_lock_slowpath+0x12d/0xb90 [11240.542517][ C0] ? queued_spin_lock_slowpath+0xb0/0xb90 [11240.542821][ C0] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11240.543149][ C0] ? get_stack_info+0x36/0xc0 [11240.543404][ C0] ? lock_acquire+0x1c1/0x220 [11240.543647][ C0] ? lock_release+0x1d5/0x250 [11240.543888][ C0] do_raw_spin_lock+0x1ec/0x270 [11240.544137][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [11240.544410][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11240.544699][ C0] ? lock_acquire+0x1c1/0x220 [11240.544945][ C0] ? tcp_v4_rcv+0x2159/0x29b0 [11240.545196][ C0] _raw_spin_lock_nested+0x65/0x80 [11240.545462][ C0] tcp_v4_rcv+0x2159/0x29b0 [11240.545697][ C0] ? __pfx_tcp_v4_rcv+0x10/0x10 [11240.545945][ C0] ? __pfx_raw_v4_input+0x10/0x10 [11240.546205][ C0] ? __inet_lookup_established+0x341/0x610 [11240.546506][ C0] ip_protocol_deliver_rcu+0x93/0x360 [11240.546789][ C0] ip_local_deliver_finish+0x2ae/0x450 [11240.547072][ C0] ip_local_deliver+0x19d/0x480 [11240.547321][ C0] ? __pfx_ip_local_deliver+0x10/0x10 [11240.547596][ C0] ? rcu_read_lock_held+0xe/0x50 [11240.547853][ C0] ? tcp_v4_early_demux+0x5a9/0x950 [11240.548125][ C0] ? rcu_read_lock_held+0xe/0x50 [11240.548382][ C0] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11240.548705][ C0] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11240.548976][ C0] ip_rcv+0x564/0x740 [11240.549185][ C0] ? __pfx_ip_rcv+0x10/0x10 [11240.549423][ C0] ? set_track_prepare+0x8a/0xd0 [11240.549681][ C0] ? __pfx_set_track_prepare+0x10/0x10 [11240.549958][ C0] ? rest_init+0x153/0x260 [11240.550191][ C0] ? skb_clone+0x10b/0x330 [11240.550423][ C0] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11240.550748][ C0] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11240.551061][ C0] ? tcf_action_exec.part.0+0x115/0x3d0 [11240.551349][ C0] ? fl_classify+0x4dc/0x650 [cls_flower] [11240.551648][ C0] ? __tcf_classify+0x32c/0x7d0 [11240.551898][ C0] ? __pfx_ip_rcv+0x10/0x10 [11240.552139][ C0] __netif_receive_skb_one_core+0x166/0x1b0 [11240.552444][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11240.552736][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11240.553063][ C0] ? lock_acquire+0x1c1/0x220 [11240.553305][ C0] ? netif_receive_skb_internal+0x84/0x300 [11240.553602][ C0] netif_receive_skb_internal+0xb0/0x300 [11240.553892][ C0] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11240.554217][ C0] ? __copy_skb_header+0xaf/0x490 [11240.554475][ C0] ? __skb_clone+0x57a/0x760 [11240.554711][ C0] netif_receive_skb+0x55/0x280 [11240.554962][ C0] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11240.555282][ C0] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11240.555622][ C0] tcf_mirred_act+0x338/0x780 [act_mirred] [11240.555925][ C0] tcf_action_exec.part.0+0x115/0x3d0 [11240.556207][ C0] fl_classify+0x4dc/0x650 [cls_flower] [11240.556500][ C0] ? hlock_class+0x4e/0x130 [11240.556742][ C0] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11240.557062][ C0] ? place_entity+0x21/0x2f0 [11240.557303][ C0] ? resched_curr+0x219/0x280 [11240.557544][ C0] ? __pfx_resched_curr+0x10/0x10 [11240.557802][ C0] ? __pfx_sched_clock_cpu+0x10/0x10 [11240.558076][ C0] ? unwind_next_frame+0x1cc/0x1d10 [11240.558369][ C0] ? wakeup_preempt+0x161/0x2c0 [11240.558633][ C0] ? activate_task+0xf5/0x260 [11240.558888][ C0] ? trace_sched_wakeup+0xd2/0x100 [11240.559165][ C0] ? do_raw_spin_unlock+0x58/0x220 [11240.559435][ C0] ? _raw_spin_unlock+0x23/0x40 [11240.559695][ C0] ? get_stack_info_noinstr+0x18/0x110 [11240.559985][ C0] ? get_stack_info+0x36/0xc0 [11240.560237][ C0] ? stack_access_ok+0xda/0x1f0 [11240.560486][ C0] ? get_reg+0x119/0x190 [11240.560705][ C0] __tcf_classify+0x32c/0x7d0 [11240.560950][ C0] tcf_classify+0x283/0x930 [11240.561187][ C0] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11240.561511][ C0] ? __pfx_tcf_classify+0x10/0x10 [11240.561768][ C0] ? arch_stack_walk+0x8c/0x100 [11240.562042][ C0] ? get_stack_info_noinstr+0x18/0x110 [11240.562335][ C0] tc_run+0x2e4/0x5d0 [11240.562551][ C0] ? __pfx_tc_run+0x10/0x10 [11240.562791][ C0] ? lock_acquire+0x1c1/0x220 [11240.563038][ C0] ? __dev_queue_xmit+0x1c1/0x1ca0 [11240.563318][ C0] __dev_queue_xmit+0x8eb/0x1ca0 [11240.563578][ C0] ? __pfx___dev_queue_xmit+0x10/0x10 [11240.563854][ C0] ? ip_finish_output2+0x786/0x18e0 [11240.564126][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [11240.564437][ C0] ? neigh_hh_output+0x348/0x590 [11240.564694][ C0] ? ip_finish_output2+0x262/0x18e0 [11240.564961][ C0] ip_finish_output2+0x786/0x18e0 [11240.565221][ C0] ? stack_depot_save_flags+0x45/0x550 [11240.565507][ C0] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11240.565851][ C0] ? __pfx_ip_finish_output2+0x10/0x10 [11240.566135][ C0] ? rcu_read_lock_held+0xe/0x50 [11240.566391][ C0] ? __ip_finish_output+0x10f/0x770 [11240.566662][ C0] ip_output+0x16b/0x4f0 [11240.566885][ C0] ? __run_timers.part.0+0x52d/0x890 [11240.567159][ C0] ? __pfx_ip_output+0x10/0x10 [11240.567407][ C0] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11240.567696][ C0] ? rcu_read_lock_held+0xe/0x50 [11240.567955][ C0] ? ip_local_out+0x114/0x3b0 [11240.568199][ C0] __ip_queue_xmit+0x672/0x1910 [11240.568450][ C0] ? __skb_clone+0x57a/0x760 [11240.568687][ C0] __tcp_transmit_skb+0x22b1/0x2d20 [11240.568963][ C0] ? __pfx___tcp_transmit_skb+0x10/0x10 [11240.569252][ C0] ? tcp_small_queue_check.isra.0+0xe9/0x380 [11240.569564][ C0] tcp_write_xmit+0xe42/0x24c0 [11240.569814][ C0] ? tcp_current_mss+0x40a/0x510 [11240.570072][ C0] ? __pfx_tcp_current_mss+0x10/0x10 [11240.570343][ C0] ? __pfx_tcp_write_xmit+0x10/0x10 [11240.570617][ C0] ? mark_lock_irq+0x6e2/0xa10 [11240.570866][ C0] ? tcp_mstamp_refresh+0x16/0xa0 [11240.571124][ C0] ? trace_irq_enable.constprop.0+0xd4/0x100 [11240.571431][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11240.571706][ C0] ? ktime_get+0xb6/0x190 [11240.571932][ C0] tcp_send_loss_probe+0x4c9/0x830 [11240.572205][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [11240.572479][ C0] tcp_write_timer+0x82/0x1d0 [11240.572723][ C0] call_timer_fn+0x176/0x430 [11240.572963][ C0] ? __pfx_call_timer_fn+0x10/0x10 [11240.573230][ C0] ? next_expiry_recalc+0xcd/0x220 [11240.573494][ C0] __run_timers.part.0+0x52d/0x890 [11240.573760][ C0] ? __pfx_tcp_write_timer+0x10/0x10 [11240.574034][ C0] ? __pfx___run_timers.part.0+0x10/0x10 [11240.574327][ C0] ? lock_acquire+0x1c1/0x220 [11240.574570][ C0] ? clockevents_program_event+0xf6/0x300 [11240.574865][ C0] ? lock_release+0x1d5/0x250 [11240.575105][ C0] ? kvm_clock_get_cycles+0x18/0x30 [11240.575370][ C0] ? ktime_get+0xb6/0x190 [11240.575593][ C0] ? __pfx_lapic_next_deadline+0x10/0x10 [11240.575881][ C0] ? clockevents_program_event+0x1ed/0x300 [11240.576187][ C0] run_timer_softirq+0x72/0x100 [11240.576438][ C0] __do_softirq+0x1bc/0x7ff [11240.576675][ C0] irq_exit_rcu+0x98/0xc0 [11240.576897][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [11240.577189][ C0] [11240.577343][ C0] [11240.577497][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11240.577807][ C0] RIP: 0010:default_idle+0xf/0x20 [11240.578067][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 73 92 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11240.579050][ C0] RSP: 0018:ffffffff91c07df8 EFLAGS: 00000246 [11240.579361][ C0] RAX: ffff8880353f7520 RBX: 1ffffffff2380fc1 RCX: ffffffff90c47942 [11240.579766][ C0] RDX: ffffed1006a7eea5 RSI: 0000000000000004 RDI: ffffffff8e6968b6 [11240.580170][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006a7eea4 [11240.580572][ C0] R10: ffff8880353f7523 R11: ffff8880353fc348 R12: 0000000000000000 [11240.580977][ C0] R13: ffffffff91c1ce00 R14: dffffc0000000000 R15: 0000000000013d50 [11240.581383][ C0] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11240.581675][ C0] ? cpuidle_idle_call+0x1f6/0x280 [11240.581938][ C0] default_idle_call+0x69/0xa0 [11240.582213][ C0] cpuidle_idle_call+0x1f6/0x280 [11240.582476][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [11240.582764][ C0] ? lock_release+0x1d5/0x250 [11240.583018][ C0] do_idle+0xfb/0x160 [11240.583250][ C0] cpu_startup_entry+0x55/0x60 [11240.583498][ C0] rest_init+0x153/0x260 [11240.583714][ C0] ? acpi_enable_subsystem+0xac/0x150 [11240.583997][ C0] arch_call_rest_init+0x13/0x40 [11240.584259][ C0] start_kernel+0x314/0x3d0 [11240.584494][ C0] x86_64_start_reservations+0x18/0x30 [11240.584777][ C0] x86_64_start_kernel+0xba/0x110 [11240.585039][ C0] secondary_startup_64_no_verify+0x16d/0x17b [11240.585359][ C0] [11240.585519][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 9362s! [ksoftirqd/1:22] [11240.585953][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 sch_prio act_mirred cls_matchall sch_red dummy sch_tbf 8021q ip_gre gre act_gact cls_flower sch_ingress bridge stp llc vrf veth [11240.587119][ C1] irq event stamp: 3886976 [11240.587351][ C1] hardirqs last enabled at (3886975): [] irqentry_exit+0x3b/0x90 [11240.587832][ C1] hardirqs last disabled at (3886976): [] __schedule+0xa87/0x1ac0 [11240.588334][ C1] softirqs last enabled at (3886464): [] __do_softirq+0x519/0x7ff [11240.588826][ C1] softirqs last disabled at (3886323): [] irq_exit_rcu+0x98/0xc0 [11240.589322][ C1] CPU: 1 PID: 22 Comm: ksoftirqd/1 Tainted: G L 6.8.0-rc2-virtme #1 [11240.589812][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11240.590457][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11240.590787][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11240.591784][ C1] RSP: 0018:ffffc9000019e9e8 EFLAGS: 00000202 [11240.592106][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff90c7aaa0 [11240.592515][ C1] RDX: ffffed10014131c4 RSI: 0000000000000004 RDI: ffff88800a098e18 [11240.592923][ C1] RBP: ffff88800a098e18 R08: 0000000000000000 R09: ffffed10014131c3 [11240.593334][ C1] R10: ffff88800a098e1b R11: 0000008000000000 R12: 0000000000000003 [11240.593747][ C1] R13: ffffed10014131c3 R14: 0000000000000001 R15: 1ffff92000033d3e [11240.594155][ C1] FS: 0000000000000000(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11240.594609][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11240.594945][ C1] CR2: 000056114a94d000 CR3: 0000000009b94004 CR4: 00000000001706f0 [11240.595352][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11240.595759][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11240.596163][ C1] Call Trace: [11240.596335][ C1] [11240.596485][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11240.596755][ C1] ? __run_hrtimer+0x1c3/0x710 [11240.597000][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11240.597288][ C1] ? __hrtimer_run_queues+0x197/0x270 [11240.597565][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11240.597858][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11240.598130][ C1] ? ktime_get_update_offsets_now+0xe4/0x2d0 [11240.598439][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11240.598709][ C1] ? __sysvec_apic_timer_interrupt+0xc1/0x380 [11240.599024][ C1] ? sysvec_apic_timer_interrupt+0x70/0x80 [11240.599324][ C1] [11240.599479][ C1] [11240.599633][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11240.599956][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11240.600250][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11240.600554][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11240.600849][ C1] ? run_ksoftirqd+0xb/0x60 [11240.601090][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11240.601412][ C1] ? __orc_find+0x9c/0xf0 [11240.601635][ C1] ? lock_acquire+0x1c1/0x220 [11240.601880][ C1] ? irqentry_enter+0x2b/0x60 [11240.602150][ C1] do_raw_spin_lock+0x1ec/0x270 [11240.602416][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11240.602706][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11240.603006][ C1] ? lock_acquire+0x1c1/0x220 [11240.603262][ C1] ? tcp_v4_rcv+0x2159/0x29b0 [11240.603505][ C1] _raw_spin_lock_nested+0x65/0x80 [11240.603771][ C1] tcp_v4_rcv+0x2159/0x29b0 [11240.604014][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11240.604271][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11240.604536][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11240.604817][ C1] ip_local_deliver_finish+0x2ae/0x450 [11240.605101][ C1] ip_local_deliver+0x19d/0x480 [11240.605352][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11240.605628][ C1] ? rcu_read_lock_held+0xe/0x50 [11240.605885][ C1] ? tcp_v4_early_demux+0x5a9/0x950 [11240.606160][ C1] ? rcu_read_lock_held+0xe/0x50 [11240.606418][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11240.606744][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11240.607014][ C1] ip_rcv+0x564/0x740 [11240.607224][ C1] ? __pfx_ip_rcv+0x10/0x10 [11240.607464][ C1] ? set_track_prepare+0x8a/0xd0 [11240.607723][ C1] ? irqentry_enter+0x2b/0x60 [11240.607965][ C1] ? irqentry_enter+0x2b/0x60 [11240.608208][ C1] ? __pfx_ip_rcv+0x10/0x10 [11240.608442][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11240.608745][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11240.609075][ C1] ? netif_receive_skb_internal+0x84/0x300 [11240.609373][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11240.609706][ C1] netif_receive_skb_internal+0xb0/0x300 [11240.609998][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11240.610322][ C1] netif_receive_skb+0x55/0x280 [11240.610575][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11240.610892][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11240.611234][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11240.611542][ C1] tcf_action_exec.part.0+0x115/0x3d0 [11240.611821][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11240.612125][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11240.612448][ C1] ? unwind_next_frame+0x1478/0x1d10 [11240.612722][ C1] ? arch_stack_walk+0x68/0x100 [11240.612973][ C1] ? unwind_next_frame+0x1cc/0x1d10 [11240.613242][ C1] ? irqentry_enter+0x2b/0x60 [11240.613484][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11240.613797][ C1] ? irqentry_enter+0x2b/0x60 [11240.614046][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11240.614363][ C1] ? unwind_next_frame+0x1478/0x1d10 [11240.614635][ C1] ? arch_stack_walk+0x68/0x100 [11240.614893][ C1] __tcf_classify+0x32c/0x7d0 [11240.615144][ C1] tcf_classify+0x283/0x930 [11240.615383][ C1] ? __pfx_tcf_classify+0x10/0x10 [11240.615649][ C1] tc_run+0x2e4/0x5d0 [11240.615859][ C1] ? __pfx_tc_run+0x10/0x10 [11240.616102][ C1] __dev_queue_xmit+0x8eb/0x1ca0 [11240.616363][ C1] ? irqentry_enter+0x2b/0x60 [11240.616606][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11240.616882][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11240.617200][ C1] ip_finish_output2+0x786/0x18e0 [11240.617465][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11240.617748][ C1] ? rcu_read_lock_held+0xe/0x50 [11240.618009][ C1] ? __ip_finish_output+0x10f/0x770 [11240.618285][ C1] ip_output+0x16b/0x4f0 [11240.618531][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11240.618851][ C1] ? __pfx_ip_output+0x10/0x10 [11240.619111][ C1] ? __pfx_vrf_output_direct_finish+0x10/0x10 [vrf] [11240.619461][ C1] ? __pfx_ip_output+0x10/0x10 [11240.619715][ C1] __ip_queue_xmit+0x672/0x1910 [11240.619982][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11240.620265][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11240.620574][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11240.620857][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11240.621148][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11240.621427][ C1] tcp_delack_timer+0x84/0x240 [11240.621678][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11240.621953][ C1] call_timer_fn+0x176/0x430 [11240.622223][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11240.622497][ C1] ? _raw_spin_unlock_irq+0x28/0x50 [11240.622777][ C1] __run_timers.part.0+0x52d/0x890 [11240.623052][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11240.623347][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11240.623637][ C1] ? __pfx___schedule+0x10/0x10 [11240.623892][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11240.624205][ C1] run_timer_softirq+0x72/0x100 [11240.624455][ C1] __do_softirq+0x1bc/0x7ff [11240.624689][ C1] ? __pfx_run_ksoftirqd+0x10/0x10 [11240.624956][ C1] run_ksoftirqd+0x2e/0x60 [11240.625189][ C1] smpboot_thread_fn+0x30e/0x840 [11240.625448][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [11240.625733][ C1] ? __pfx_smpboot_thread_fn+0x10/0x10 [11240.626019][ C1] kthread+0x292/0x360 [11240.626231][ C1] ? __pfx_kthread+0x10/0x10 [11240.626468][ C1] ret_from_fork+0x34/0x70 [11240.626701][ C1] ? __pfx_kthread+0x10/0x10 [11240.626943][ C1] ret_from_fork_asm+0x1b/0x30 [11240.627198][ C1] WAIT TIMEOUT stdout